Cabin atmosphere mode control system

Abstract

The cabin atmosphere mode control system comprises an emotion recognition module, a voice recognition module and a control module, wherein the emotion recognition module comprises a face recognition unit and a voice recognition unit; the emotion analysis module comprises a face analysis unit and a voice analysis unit; the face analysis unit is used for analyzing the face image acquired by the face recognition unit and inputting a basic emotion label and a corresponding score; the voice analysis unit analyzes the voice signals collected by the voice recognition unit, performs weighted fusion on acoustic features and semantic features, and outputs various basic emotion tags and corresponding scores; when the face analysis unit and the voice analysis unit work at the same time, the emotion analysis module adopts a conservative discrimination mechanism to add scores of the face emotion label and the voice emotion label and then outputs a comprehensive emotion label according to a preset frequency; and the cabin adjusting module can adjust corresponding cabin components according to the comprehensive emotion label.

Description

TECHNICAL FIELD

[0001] The present application relates to an atmosphere mode control system, in particular to a cockpit atmosphere mode control system. BACKGROUND

[0002] In the field of intelligent cockpit of automobile, in order to improve user experience and emotional value, the atmosphere mode function is becoming more and more important. The common cockpit atmosphere mode function at present is usually preset fixed mode, which needs user to actively operate the vehicle screen to select or trigger. This way has obvious shortcomings: 1, passivity: unable to actively perceive the atmosphere in the car and the user's emotional state, must wait for user to manually operate, lack of intelligent. 2, single: the preset mode is limited, it is difficult to meet the different personalized needs of different users and the real-time change of emotional state. 3, weak linkage: although it can adjust part of the hardware, it lacks coordinated linkage control of multiple environmental factors in the cockpit, and the experience is not immersive and unified.

[0003] With the popularity of in-vehicle cameras, microphones and seat sensors and other hardware devices, it has a hardware basis to use these existing sensors to judge the current emotional state of the user in multiple dimensions. Although there are attempts to use a single sensor to determine emotion in the prior art, there are the following problems: 1, insufficient recognition accuracy: single modal recognition is easily affected by environmental interference and individual differences. 2, lack of conflict arbitration mechanism: when multiple sensors such as cameras and microphones are used at the same time, different sensors may identify inconsistent emotional results, and existing solutions lack effective comprehensive judgment mechanism to solve such conflicts and obtain reliable overall emotional judgment. 3, insufficient linkage execution: even if the emotional state is identified, how to accurately and cooperatively control the diversified hardware modules in the cockpit based on the judgment result to form a complete "perception-judgment-execution" closed loop, the existing technical solutions are generally not deep and systematic enough.

[0004] Therefore, there is an urgent need for a technical solution that can overcome the above-mentioned defects: actively and multi-dimensionally comprehensively judge the atmosphere in the car and the user's emotional state using the existing multiple sensors in the car; design an effective conflict arbitration mechanism to obtain a reliable comprehensive emotional conclusion; and based on this conclusion, intelligently link and control the wide range of hardware environment modules in the cockpit to automatically switch to the appropriate atmosphere mode, thereby actively improving the user's emotional value and improving the driving experience and safety. SUMMARY

[0005] The present application provides a cockpit atmosphere mode control system, which aims to solve the problems of passive operation, single modal recognition and lack of multi-hardware linkage in traditional solutions.

[0006] The present application provides a cockpit atmosphere mode control system, which includes:

[0007] Emotion recognition module: the emotion analysis module includes a facial recognition unit and a speech recognition unit, which respectively collect the driver's facial image and voice signal through the vehicle-mounted camera and microphone;

[0008] Emotion analysis module: including facial analysis unit and speech analysis unit:

[0009] The facial analysis unit analyzes the facial image collected by the facial recognition unit and outputs basic emotion labels and corresponding scores;

[0010] The speech analysis unit analyzes the voice signal collected by the voice recognition unit and performs weighted fusion on acoustic features and semantic features, and outputs multiple basic emotion labels and corresponding scores.

[0011] When the facial analysis unit and the speech analysis unit work simultaneously, the emotion analysis module adopts a conservative discrimination mechanism, adds the scores of the facial and speech emotion labels, and outputs a comprehensive emotion label according to a preset frequency;

[0012] Cabin adjustment module: the cabin adjustment module includes atmosphere lights, wallpapers, audio systems, playlists, car skins, air conditioning modules, and instruments, and the cabin adjustment module can adjust the corresponding cabin components according to the comprehensive emotion label.

[0013] In one embodiment, the facial recognition unit can perform automatic white balance and histogram equalization processing on the face image data to eliminate glare and shadow interference, perform dynamic light compensation, analyze and judge the occlusion situation through eye and nose bridge area features, and not perform face recognition when there is occlusion.

[0014] In one embodiment, the speech recognition module includes a speech signal preprocessing and feature extraction unit, which is used for standardizing sampling, cutting, extracting acoustic features such as pitch change, sound intensity, and speech speed information, and converting speech into text and extracting keyword groups and semantic information features.

[0015] In one embodiment, the emotion label includes happy, relaxed, calm, low, and depressed, and the basic emotion label and score correspond to: 300 points represent happy, 200 points represent relaxed, 0 points represent calm, -200 points represent low, and -300 points represent depressed.

[0016] In one embodiment, the atmosphere light adjustment in the cabin adjustment module includes color, brightness, and flashing mode. When the comprehensive emotion label is happy, the atmosphere light is warm yellow or pink, the brightness is bright, and the flashing frequency is fast. When the comprehensive emotion label is depressed, the atmosphere light is blue or purple, the brightness is soft and dim, and it remains constant.

[0017] In one embodiment, the audio system adjustment in the cabin adjustment module includes volume and sound effect, when the comprehensive emotion label is happy, the volume is moderate and the sound effect is relaxed and pleasant; when the comprehensive emotion label is low, the volume is very low and the sound effect is low.

[0018] In one embodiment, the playlist adjustment in the cabin adjustment module is to call a corresponding song list according to the comprehensive emotion label, when the comprehensive emotion label is relaxed, a soothing light music or meditation music song list is called; when the comprehensive emotion label is depressed, a soft and sad music song list is called.

[0019] In one embodiment, the car machine skin adjustment in the cabin adjustment module includes replacing the screen-off clock, Dock, colorful road, 3D car model dressing and car model background, application ICON, system color and control library color, when the comprehensive emotion label is calm, a simple and neutral skin style is adopted.

[0020] In one embodiment, the air conditioner adjustment includes: when the comprehensive emotion label is relaxed, the temperature is appropriate and the wind speed is slow; when the comprehensive emotion label is depressed, the temperature is lower and the wind speed is weak. Each gear is preset with a temperature-wind speed linkage parameter table.

[0021] In one embodiment, the instrument interface style switching logic is:

[0022] The happy state enables a sports style interface;

[0023] The depressed state enables a navigation style interface;

[0024] Each emotion gear is bound to a preset FPK view and a local color matching scheme.

[0025] The present application has the following beneficial effects:

[0026] 1. Multi-source fusion judgment is accurate: the camera, microphone and seat sensor data are comprehensively utilized, a conservative judgment mechanism is combined, the emotion recognition accuracy is significantly improved, and the multi-source data conflict is effectively solved.

[0027] 2. Low reuse hardware cost: the existing camera, microphone and seat sensor in the vehicle are directly called, and no new hardware needs to be added to realize the function.

[0028] 3. Multi-module cooperative linkage: based on the recognized multi-gear emotion state, the ambient light, wallpaper, volume, sound effect, music song list, car machine skin, air conditioner, instrument style and other cabin environment modules are automatically linked and adjusted. BRIEF DESCRIPTION OF DRAWINGS

[0029] Figure 1 is a cabin atmosphere mode control system component module schematic diagram of the present application;

[0030] Figure 2 is a facial recognition and facial analysis schematic diagram in an embodiment of the cockpit atmosphere mode control system of the present application;

[0031] Figure 3 is a voice recognition and voice analysis schematic diagram in an embodiment of the cockpit atmosphere mode control system of the present application;

[0032] Figure 4 is a comprehensive conservative discriminant mechanism that adds the scores of facial and voice emotion labels and outputs a comprehensive emotion label according to a preset frequency in an embodiment of the cockpit atmosphere mode control system of the present application;

[0033] Figure 5 is a cockpit atmosphere mode classification schematic diagram in an embodiment of the cockpit atmosphere mode control system of the present application;

[0034] Figure 6 is a working method flowchart schematic diagram in an embodiment of the cockpit atmosphere mode control system of the present application.

[0035] Reference signs:

[0036] Emotion recognition module-1;

[0037] Facial recognition unit-11;

[0038] Voice recognition unit-12;

[0039] Emotion analysis module-2;

[0040] Facial analysis unit-21;

[0041] Voice analysis unit-22;

[0042] Cockpit adjustment module-3. DETAILED DESCRIPTION

[0043] In order to make the purpose, technical scheme and advantages of the present application clearer, the technical scheme in the embodiments of the present application will be described in more detail below in combination with the drawings in the embodiments of the present application. In the drawings, the same or similar reference signs represent the same or similar elements or elements with the same or similar functions. The described embodiments are part of the embodiments of the present application, not all embodiments. The embodiments described below by referring to the drawings are exemplary and are intended to explain the present application, and cannot be understood as a limitation of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0044] In addition, it needs to be explained that, unless otherwise explicitly specified and limited, the "installation", "connection", "connection" and similar words used in the description of the present application should be understood broadly, for example, the connection can be fixed connection, or detachable connection, or integrally connected; can be mechanical connection, or electrical connection; can be directly connected, or indirectly connected through intermediate medium, or the internal communication of two elements, and those skilled in the art can understand the specific meaning of the present application according to the specific situation.

[0045] Figure 1 is a seat cabin atmosphere mode control system component module schematic diagram, as Figure 1 shown, the present application provides a kind of seat cabin atmosphere mode control system, comprising:

[0046] Emotion recognition module 1: the emotion analysis module includes face recognition unit 11 and voice recognition unit 12, through vehicle-mounted camera, microphone respectively collects driver face image and voice signal;

[0047] Combining driver posture adjusts face detection area, receives face image data by camera, uses automatic white balance and histogram equalization to eliminate reflection, shadow interference, to carry out dynamic light compensation. By eye, nose bridge area feature analysis to judge the shielding condition, when the user face has shielding object, will not carry out face recognition.

[0048] Emotion analysis module 2: including face analysis unit 21 and voice analysis unit 22:

[0049] The face analysis unit 21 analyzes the face image collected by the face recognition unit 11 and inputs the basic emotion label and corresponding score;

[0050] Migrate learning is carried out using a pre-trained lightweight network, which only needs small computing power to obtain good recognition results.

[0051] In one embodiment, the face recognition unit 11 can perform automatic white balance and histogram equalization processing on the face image data to eliminate reflection and shadow interference, perform dynamic light compensation, and judge the shielding condition by eye and nose bridge area feature analysis. When there is shielding, face recognition is not performed. Specifically, Figure 2 is a seat cabin atmosphere mode control system face recognition and face analysis schematic diagram, as Figure 2 shown, focus on the dynamic changes of key areas such as eyes, eyebrows and corners of the mouth, extract 6 key facial features such as blink frequency, corner shape, eye position, eye shape, eye opening and eyebrow shape for classification and recognition, and in the emotion analysis module 2, the emotion analysis module 2 is an emotion classifier, further judges and outputs 5 basic emotion labels: happy, relaxed, calm, low, and depressed.

[0052] The emotion is scored by an emotion label and score correspondence table, for subsequent comprehensive emotion judgment.

[0053] In one embodiment, the emotion labels include happy, relaxed, calm, low, and depressed, and the basic emotion label and score correspondence is: 300 points for happy, 200 points for relaxed, 0 points for calm, -200 points for low, and -300 points for depressed.

[0054] The voice analysis unit 22 analyzes the voice signal collected by the voice recognition unit 12 and performs weighted fusion of acoustic features and semantic features, and outputs various basic emotion labels and corresponding scores.

[0055] In one embodiment, the voice recognition module includes a voice signal preprocessing and feature extraction unit, which is used for standardizing sampling, cutting, extracting pitch change, sound intensity, speech rate information, and other acoustic features of voice data, and simultaneously converting voice into text and extracting key word groups and semantic information features.

[0056] Specifically, Figure 3 is a voice recognition and voice analysis schematic diagram of a cockpit atmosphere mode control system of the present application, as Figure 3 When the user inputs a voice, the voice recognition unit 12 needs to process the voice. First, the input voice data is standardized and sampled, and is cut according to a preset time length or semantic paragraph, and acoustic feature extraction is performed according to parameters such as pitch change, sound intensity, and speech rate information; simultaneously, the voice is converted into text, and key word groups and semantic information features in the text are extracted.

[0057] The voice analysis unit 22 is an emotion classification model, which is a pre-trained neural network model. This model performs weighted fusion of acoustic features and semantic features, thereby improving the accuracy of emotion judgment. The emotion state output outputs five emotion labels: happy, relaxed, calm, low, and depressed.

[0058] The emotion is scored by an emotion label and score correspondence table, for subsequent comprehensive emotion judgment.

[0059] When the facial analysis unit 21 and the voice analysis unit 22 work simultaneously, the emotion analysis module 2 adopts a conservative discrimination mechanism, adds the scores of the facial and voice emotion labels, and outputs a comprehensive emotion label according to a preset frequency;

[0060] Specifically, Figure 4 is a comprehensive conservative discrimination mechanism of a cockpit atmosphere mode control system of the present application, which adds the scores of the facial and voice emotion labels and outputs a comprehensive emotion label according to a preset frequency, as Figure 4As shown, since there are currently two ways to identify user emotions, when both methods are running at the same time, there may be a problem of inconsistent output emotions. To solve this problem, a conservative judgment mechanism needs to be introduced, that is, the two output values are added and then classified. In this process, the conservative principle can be defined as being more inclined to move the emotions towards the center, that is, the calm direction, so when dividing the range, the frequency of different values appearing is combined.

[0061] Cabin adjustment module 3: The cabin adjustment module includes atmosphere lights, wallpapers, audio systems, playlists, car skin, air conditioning modules, and instruments, which can adjust the corresponding cabin components according to the comprehensive emotion label.

[0062] 1. Atmosphere lights

[0063] The in-car atmosphere light module is responsible for controlling the multi-color atmosphere lights inside the vehicle. These lights are usually located in places such as door trim, foot area, welcome step, instrument panel, and central passage, using LED as the light source, providing a variety of color choices. Control attributes include the color, brightness, and color distribution scheme displayed, as well as the flashing mode.

[0064] 2. Audio

[0065] The audio system provides a variety of audio functions. The features related to this invention include audio volume and premium profiles of the brand sound system. These premium profiles allow users to adjust the volume and sound settings according to personal preferences, thereby achieving a better auditory experience. Specifically, users can adjust in the following ways:

[0066] 1. Volume control:

[0067] Adjust the system volume to ensure that the sound is moderate, not too loud or too soft.

[0068] On different devices (such as computers, mobile phones, etc.), adjustments can be made through system settings or volume adjustment functions within the application.

[0069] 2. Brand sound system presets:

[0070] Choose different preset configuration files, which are usually provided by sound manufacturers to optimize specific types of audio content (such as music, movies, etc.).

[0071] Advanced users can also customize configuration files by adjusting parameters such as equalizers (EQ), compressors, etc., to further optimize sound effects.

[0072] 3. Sound settings:

[0073] Select different sound modes in the operating system or application, such as "music", "movie", etc., to adapt to different listening scenarios.

[0074] Further improve audio quality with professional audio software and plugins, such as using equalizers to adjust frequency response and using reverb to increase spatial sense.

[0075] Through the above adjustment, the user can better control the performance of the audio system and obtain a more satisfactory auditory experience.

[0076] 3. Liquid crystal dial (instrument)

[0077] The instrument provides the customer with various views (FPK views) for selection, and the present application will also use these views. The elements of the instrument will be transformed according to the set mode, mainly involving style and partial color.

[0078] 4. Play list

[0079] The play list provides online play lists of streaming media network applications provided by various streaming media service providers in the vehicle. The premise is that the corresponding App of the streaming media service provider is installed in the infotainment system. According to the music type provided by each streaming media, it provides song lists in different modes, such as a soft song list will provide music with a soothing attribute for the user to experience.

[0080] 5. Skin replacement:

[0081] This module mainly refers to the theme elements of different styles in the car entertainment system, and the theme skin item type is the clock when the screen is off, the program dock, the colorful road, the 3D car model dressing and the car model background, the application icon, the system color and the control library color, etc. Generally, the system will support the UI elements:

[0082] a) Static UI elements, animations (including boot animations), 3D, sound effects, etc.

[0083] b) Controls, icons, illustrations, etc.

[0084] c) Background (including wallpaper, app background, card background, pop-up box background, etc.).

[0085] Then in the present application, the original ability of the system will also be used to replace these elements.

[0086] 6. Wallpaper replacement

[0087] Wallpaper refers to the background of the main interface of the car machine, which usually has wallpaper, as well as desktop wallpaper, system wallpaper, and screen-off wallpaper (screen saver). The wallpaper can be replaced by the user, and the corresponding picture can be generated by AI or the user's custom photo can be replaced, so that the user can define personalization.

[0088] 7. Air conditioning module

[0089] The main module is the original air conditioning module on the car, which can support the adjustment of air speed and indoor temperature.

[0090] In one embodiment, the atmosphere light adjustment in the cabin adjustment module 3 includes color, brightness and flashing mode. When the comprehensive emotional label is happy, the atmosphere light is warm yellow or pink, bright in brightness, and flashes at a faster frequency. When the comprehensive emotional label is depressed, the atmosphere light is blue or purple, soft and dim in brightness, and keeps constant.

[0091] The system converts the judgment result into corresponding atmosphere light control instructions and transmits them to the atmosphere light controller through the in-vehicle communication network. The controller adjusts the color, brightness and flashing mode of the atmosphere light according to the instructions. For example, when the user is in a happy state, the instructions are sent to make the atmosphere light present bright and cheerful colors such as warm yellow or pink, and flash at a faster frequency. If the user is in a depressed state, adjust to soft and dim cool tones such as blue or purple, and keep constant.

[0092] The system transmits the judgment result information to the wallpaper management module of the car machine, which selects appropriate wallpapers from the wallpaper library according to the preset rules. Then, the selected wallpapers are loaded onto the car machine screen and co-driver screen through data transmission. For example, when it is judged to be a relaxation scene, natural scenery type wallpapers are selected for display.

[0093] In one embodiment, the audio system adjustment in the cabin adjustment module 3 includes volume and sound effect. When the comprehensive emotional label is happy, the volume is moderate and the sound effect is relaxed and pleasant. When the comprehensive emotional label is low, the volume is very low and the sound effect is low.

[0094] The system generates volume and sound effect adjustment instructions according to the judgment result and sends them to the audio control system. The system adjusts the volume and sound effect type according to the instructions. For example, in a happy scene, increase the volume and turn on lively sound effects; in a quiet and relaxing scene, reduce the volume and select soft sound effects.

[0095] In one embodiment, the playlist adjustment in the cabin adjustment module 3 is to call the corresponding song list according to the comprehensive emotional label. When the comprehensive emotional label is relaxed, call the soothing light music or meditation music playlist; when the comprehensive emotional label is depressed, call the soft and sad music playlist.

[0096] The system sends the judgment result to the music playing system (referring to the online music module in the car), which selects the music list that meets the current atmosphere from the music library according to the judgment result. Then, play according to certain rules. For example, play upbeat pop music when happy, and play soothing light music when tired.

[0097] In one embodiment, the vehicle skin adjustment in the cockpit adjustment module 3 includes changing the off-screen clock, navigation dock, colorful roads, 3D car model decoration and car model background, application icons, system colors and control library colors. When the overall mood tag is calm, a simple and neutral skin style is adopted.

[0098] Ambient lighting skin templates are pre-set to correspond to different judgment results. The system calls the corresponding template based on the judgment result and directly switches the display effect of the ambient lighting. For example, a brightly colored skin with rich dynamic changes is designed for exciting scenes, and the system immediately switches to this skin when the excited state is judged.

[0099] In one embodiment, the air conditioning adjustment includes: when the overall mood label is relaxed, the temperature is suitable and the fan speed is slow; when the overall mood label is depressed, the temperature is low and the fan speed is weak. Each setting has a preset temperature-fan speed linkage parameter table.

[0100] The system generates air conditioning control commands based on the judgment results and sends them to the air conditioning control system. The system then adjusts the air conditioner's temperature, fan speed, and mode according to the commands. For example, when it's hot and the user is irritable, the temperature is lowered and the fan speed is increased; when it's cold and the user is relaxed, the temperature is appropriately raised and the fan speed is decreased.

[0101] In one embodiment, the logic for switching the instrument interface style is as follows:

[0102] The happy state activates the sports-style interface;

[0103] A navigation-style interface is enabled when the user is frustrated.

[0104] Each mood level is bound to a preset FPK view and local color scheme.

[0105] The system generates air conditioning control commands based on the judgment results and sends them to the instrument controller, which controls the style of the instrument interface and the colors on the instrument screen. For example, there are interface styles related to Sport, Classic, Gentle, Navigation, and Intelligent Driving.

[0106] Figure 5 This is a schematic diagram illustrating the classification of cabin atmosphere modes in a cabin atmosphere mode control system according to the present invention, as shown below. Figure 5 As shown, the linkage rules of the subsystem are assigned different modes according to the five gears.

[0107] Figure 6 This is a schematic diagram of the working method of a cabin atmosphere mode control system according to the present invention. Figure 6 The diagram shows the entire adjustment process.

[0108] The application ingeniously uses the camera for monitoring the state of the driver and the existing microphone in the vehicle based on the existing sensors in the vehicle. Finally, through relevant logical arbitration, it is concluded what the overall mood of the driver is at this moment, and finally the ambient light, car machine home wallpaper, car interior volume, brand sound sound, music, car machine, skin in the co-driver screen and air conditioner are ingeniously combined according to the arbitration conclusion. The overall link is shown in the following figure. When the invention is used in the intelligent cabin, the linkage of the whole intelligent cabin is improved, and the emotional value is brought to the driver, so that the user's mood is calmed down when the user is in a bad mood, and the corresponding emotional value is given when the user is in an excited state, so as to reduce the road rage and the occurrence of related traffic accidents.

[0109] The above-described embodiments are only further descriptions of the present application, and do not limit the present application in other forms, and the present application can have other various embodiments. Those skilled in the art can make various corresponding modifications and changes according to the present application without departing from the spirit and essence of the present application, and these corresponding modifications and changes should fall within the protection scope of the present application.

[0110] In the description of the present application, it should be noted that the terms used herein are only for describing specific embodiments, and are not intended to limit the exemplary embodiments according to the present application. For ease of description, the sizes of the parts shown in the drawings are not drawn in proportion to the actual proportions. The techniques, methods and devices known to those skilled in the relevant art can not be discussed in detail, but should be considered as part of the authorized description under appropriate circumstances. In all examples shown and discussed herein, any specific value should be interpreted as merely exemplary, and not as a limitation. Therefore, other examples of exemplary embodiments can have different values. It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further discussed in subsequent drawings.

[0111] It should be noted that, in the present application, the terms "comprising", "containing" or any other variant thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements is not necessarily limited to those elements, but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. It should also be noted that the scope of the methods and apparatus in the present application is not limited by the order of the functions performed, as shown or discussed, or by the order of the steps presented, but can include performing functions in an order different from that shown or discussed, for example, the described methods can be performed in an order different from that described, and various steps can be added, omitted, or combined, in addition, features described with respect to certain examples can be combined in other examples.

[0112] The above-described embodiments are provided to persons skilled in the art to implement or use the present application, and the persons skilled in the art can make various modifications or changes to the above-described embodiments without departing from the application idea of the present application, and thus the protection scope of the present application is not limited by the above-described embodiments, but is the maximum scope of the innovative features mentioned in the claims.

Claims

1. A cabin atmosphere mode control system, characterized in that, include: Emotion recognition module: The emotion recognition module includes a facial recognition unit and a voice recognition unit, which collect the driver's facial image and voice signal through an in-vehicle camera and microphone, respectively; Emotion analysis module: includes facial analysis unit and voice analysis unit. The facial analysis unit analyzes the facial images collected by the facial recognition unit and outputs basic emotion tags and corresponding scores; The speech analysis unit analyzes the speech signals collected by the speech recognition unit and performs weighted fusion of acoustic features and semantic features to output a variety of basic emotion labels and corresponding scores. When the facial analysis unit and the voice analysis unit work simultaneously, the emotion analysis module adopts a conservative discrimination mechanism, which adds the scores of facial and voice emotion labels and outputs a comprehensive emotion label at a preset frequency. Cockpit Adjustment Module: The cockpit adjustment module includes ambient lighting, wallpaper, audio system, playlist, vehicle infotainment skin, air conditioning module, and instrument panel. The cockpit adjustment module can adjust the corresponding cockpit components according to the comprehensive mood tags.

2. The cabin atmosphere mode control system according to claim 1, characterized in that, The facial recognition unit can perform automatic white balance and histogram equalization on facial image data to eliminate reflections and shadows, perform dynamic light compensation, and determine occlusion through feature analysis of the eye and nose areas. When occlusion exists, facial recognition will not be performed.

3. The cabin atmosphere mode control system according to claim 1, characterized in that, The speech recognition module includes a speech signal preprocessing and feature extraction unit. The speech signal preprocessing and feature extraction unit is used to standardize and segment the speech data, extract acoustic features such as pitch change, sound intensity, and speech rate information, and at the same time convert the speech into text and extract keyword groups and semantic information features.

4. The cabin atmosphere mode control system according to claim 1, characterized in that, The emotion labels include happy, relaxed, calm, depressed, and frustrated. The basic emotion labels and scores are as follows: 300 points represent happy, 200 points represent relaxed, 0 points represent calm, -200 points represent depressed, and -300 points represent frustrated.

5. The cabin atmosphere mode control system according to claim 1, characterized in that, The ambient lighting adjustment in the cockpit adjustment module includes color, brightness, and flashing mode. When the overall emotion label is happy, the ambient light is warm yellow or pink, bright, and flashes at a relatively fast frequency; when the overall emotion label is depressed, the ambient light is blue or purple, soft and dim, and remains constantly lit.

6. The cabin atmosphere mode control system according to claim 1, characterized in that, The audio system adjustment in the cockpit adjustment module includes volume and sound effects. When the overall emotion label is happy, the volume is moderate and the sound effect is relaxed and pleasant; when the overall emotion label is depressed, the volume is very low and the sound effect is deep.

7. The cabin atmosphere mode control system according to claim 1, characterized in that, The playlist adjustment in the cockpit adjustment module calls the corresponding playlist based on the overall mood tag. When the overall mood tag is relaxed, it calls a playlist of soothing light music or meditation music; when the overall mood tag is depressed, it calls a playlist of gentle and sad music.

8. The cabin atmosphere mode control system according to claim 1, characterized in that, The vehicle skin adjustment in the cockpit adjustment module includes changing the always-on clock, Dock, colorful roads, 3D car model decorations and backgrounds, application icons, system colors and control library colors. When the overall mood tag is calm, a simple and neutral skin style is adopted.

9. The cabin atmosphere mode control system according to claim 1, characterized in that, The air conditioning adjustment includes: when the overall mood label is relaxed, the temperature is suitable and the wind speed is slow; when the overall mood label is depressed, the temperature is low and the wind speed is weak. Each setting has a preset temperature-wind speed linkage parameter table.

10. The cabin atmosphere mode control system according to claim 1, characterized in that, The logic for switching instrument interface styles is as follows: The happy state activates the sports-style interface; A navigation-style interface is enabled when the user is frustrated. Each mood level is bound to a preset FPK view and local color scheme.

Images