AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method and system

Abstract

The invention discloses an AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method and system, and the method comprises the steps: obtaining the facial expression information, captured by a camera, of a driver and passengers and the sound feature information collected by a microphone, and recognizing the current emotion state of the driver and passengers according to the facial expression information and the sound feature information; according to the recognized current emotional state, atmosphere elements in the vehicle are automatically adjusted, and the atmosphere elements comprise music elements, lamplight elements and fragrance elements. The AI emotion recognition technology is introduced, self-adaptive adjustment of the atmosphere in the vehicle is achieved, and the comfort and personalized experience of a driver and passengers are remarkably improved.

Description

Technical Field

[0001] The present invention relates to the field of automobile intelligent technology, and in particular discloses an AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method and system. Background Art

[0002] With the rapid development of automobile intelligence, the comfort and personalization needs of drivers and passengers are increasing. However, most existing in-car atmosphere adjustment systems rely on preset scenes or manual adjustment, and lack the ability to make adaptive adjustments based on the real-time emotional changes of drivers and passengers.

[0003] Therefore, it is of great significance to develop a system that can intelligently identify the emotions of drivers and passengers and automatically adjust the atmosphere in the car accordingly. Summary of the invention

[0004] The present invention provides an AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method and system, aiming to solve the technical problem that most existing in-vehicle atmosphere adjustment systems rely on preset scenes or manual adjustment and lack the ability to adaptively adjust according to the real-time emotional changes of the driver and passengers.

[0005] One aspect of the present invention relates to an AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method, comprising the following steps:

[0006] Obtaining the facial expression information of the driver or passenger captured by the camera and the sound feature information collected by the microphone, and identifying the current emotional state of the driver or passenger based on the facial expression information and the sound feature information;

[0007] Based on the current emotional state identified, the atmosphere elements in the car are automatically adjusted, including music elements, lighting elements and fragrance elements.

[0008] Furthermore, the current emotional state includes a happy state, an angry and irritable state, and a sad and depressed state. The steps of obtaining the facial expression information of the driver and the passenger captured by the camera and the sound feature information collected by the microphone, and identifying the current emotional state of the driver and the passenger based on the facial expression information and the sound feature information include:

[0009] If the facial expression information of the driver or passenger is recognized as a smile with the corners of the mouth raised, it is determined that the facial expression information of the driver or passenger is in a happy state;

[0010] If the facial expression information of the driver and passenger is recognized as a frown with wrinkles between the eyebrows, it is determined that the facial expression information of the driver and passenger is in an angry and irritable state;

[0011] If the facial expression information of the driver and passenger is recognized as drooping eyebrows with the ends of the eyebrows pointing downward, it is determined that the facial expression information of the driver and passenger is in a sad and depressed state.

[0012] Furthermore, the current emotional state includes a happy state, and the step of automatically adjusting the atmosphere elements in the vehicle according to the identified current emotional state includes:

[0013] If the current emotional state of the driver is recognized as happy, the online music in the music element is automatically adjusted to cheerful music;

[0014] If the current emotional state of the driver is detected as happy, the ambient light setting in the lighting element will be automatically adjusted to a vibrant light;

[0015] If it is recognized that the driver's current emotional state is happy, the air conditioning in the fragrance element will be automatically adjusted to amber orange fragrance.

[0016] Furthermore, the current emotional state includes an angry and irritable state, and the step of automatically adjusting the atmosphere elements in the vehicle according to the identified current emotional state data includes:

[0017] If the current emotional state of the driver is detected to be angry and irritable, the online music in the music element is automatically adjusted to metal music;

[0018] If the current emotional state of the driver is detected to be angry or irritable, the ambient light setting in the lighting element is automatically adjusted to a brightly colored light;

[0019] If it is identified that the driver's current emotional state is angry and irritable, the air conditioner in the fragrance element will be automatically adjusted to a high-boiling-point fragrance.

[0020] Furthermore, the current emotional state includes a sad and depressed state, and the step of automatically adjusting the atmosphere elements in the vehicle according to the identified current emotional state data includes:

[0021] If the current emotional state of the driver is detected to be sad or depressed, the online music in the music element is automatically adjusted to soft music;

[0022] If the current emotional state of the driver is detected to be sad or depressed, the ambient light setting in the lighting element will be automatically adjusted to a dim and soft light;

[0023] If it is detected that the driver's current emotional state is sad or depressed, the air conditioner in the fragrance element will be automatically adjusted to a white and refreshing fragrance.

[0024] Another aspect of the present invention relates to an AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system, comprising:

[0025] An emotion recognition module is used to obtain the facial expression information of the driver and passenger captured by the camera and the sound feature information collected by the microphone, and identify the current emotional state of the driver and passenger based on the facial expression information and the sound feature information;

[0026] The atmosphere adjustment module is used to automatically adjust the atmosphere elements in the car according to the recognized current emotional state. The atmosphere elements include music elements, lighting elements and fragrance elements.

[0027] Furthermore, the emotion recognition module includes:

[0028] The first recognition unit is used to determine that the facial expression information of the driver and passenger is in a happy state if the facial expression information of the driver and passenger is recognized as a smile with the corners of the mouth raised;

[0029] The second recognition unit is configured to determine that the facial expression information of the driver and passenger is in an angry and irritable state if the facial expression information of the driver and passenger is recognized as a frown with wrinkles formed between the eyebrows;

[0030] The third recognition unit is used to determine that the facial expression information of the driver and passenger is in a sad and depressed state if it is recognized that the facial expression information of the driver and passenger is drooping and the eyebrows are pointed downward.

[0031] Furthermore, the atmosphere adjustment module includes:

[0032] A first happy state adjustment unit is used to automatically adjust the online music in the music element to cheerful music if it is recognized that the current emotional state of the driver is a happy state;

[0033] A second happy state adjustment unit is used to automatically adjust the ambient light setting in the lighting element to a vibrant light if it is recognized that the current emotional state of the driver is a happy state;

[0034] The third happy state adjustment unit is used to automatically adjust the air conditioner in the fragrance element to an amber orange fragrance if it is recognized that the current emotional state of the driver and the passenger is a happy state.

[0035] Furthermore, the atmosphere adjustment module includes:

[0036] A first anger and irritability state adjustment unit is used to automatically adjust the online music in the music element to metal music if it is recognized that the current emotional state of the driver is an anger and irritability state;

[0037] A second anger and irritability state adjustment unit is used to automatically adjust the ambient light setting in the lighting element to a light with a distinct color if it is recognized that the current emotional state of the driver and passenger is an angry and irritable state;

[0038] The third anger and irritability state adjustment unit is used to automatically adjust the air conditioner in the fragrance element to a high-boiling-point fragrance if it is recognized that the current emotional state of the driver and the occupant is an angry and irritable state.

[0039] Furthermore, the atmosphere adjustment module includes:

[0040] A first sadness and depression state adjustment unit is used to automatically adjust the online music in the music element to soft music if it is recognized that the current emotional state of the driver is a sadness and depression state;

[0041] The second sadness and depression state adjustment unit is used to automatically adjust the ambient light setting in the lighting element to a dim and soft light if it is recognized that the current emotional state of the driver and passenger is a sadness and depression state;

[0042] The third sadness and depression state adjustment unit is used to automatically adjust the air conditioner in the fragrance element to a white refreshing fragrance if it is recognized that the current emotional state of the driver and the passenger is a sadness and depression state.

[0043] The beneficial effects achieved by the present invention are:

[0044] The present invention provides an AI-based emotion recognition and in-car atmosphere adaptive adjustment method and system, which obtains the facial expression information of the driver and passenger captured by the camera and the sound feature information collected by the microphone, and identifies the current emotional state of the driver and passenger based on the facial expression information and the sound feature information; according to the identified current emotional state, automatically adjusts the atmosphere elements in the car, and the atmosphere elements include music elements, lighting elements and fragrance elements. The AI-based emotion recognition and in-car atmosphere adaptive adjustment method and system provided by the present invention realizes the adaptive adjustment of the in-car atmosphere by introducing AI emotion recognition technology, and significantly improves the comfort and personalized experience of the driver and passenger. At the same time, the system has self-learning and optimization capabilities, and can continuously improve service quality and user satisfaction. In addition, the system also has broad application prospects and can be extended to various types of automobiles and transportation tools, bringing a more intelligent and convenient travel experience to the driver and passenger. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] Figure 1 The figure is a flow chart of an embodiment of the AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method of the present invention. DETAILED DESCRIPTION

[0046] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0047] like Figure 1 As shown, the first embodiment of the present invention proposes an AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method, comprising the following steps:

[0048] Step S100: Obtain the facial expression information of the driver or passenger captured by the camera and the sound feature information collected by the microphone, and identify the current emotional state of the driver or passenger based on the facial expression information and the sound feature information.

[0049] The camera and microphone installed in the car are used to capture the facial expressions, voice characteristics and other information of the driver and passengers, and emotion recognition is performed by continuously optimizing the deep learning algorithm. It can accurately identify the basic emotions of the driver and passengers, such as the facial expressions of the monitored driver (see Note 1 for the recognition of joy, anger, sorrow and happiness), and output the emotion recognition results in real time.

[0050] Note 1:

[0051] Joy: This is a facial expression where the corners of the mouth turn up to form a smile. The degree of the smile may vary from a slight upward turn of the corners of the mouth (a hint of joy) to a full-on grin. The eyes may narrow and wrinkles may appear at the corners of the eyes (more obvious when there is genuine joy).

[0052] Angry: Facial expressions: Frowning, wrinkles forming between the brows. Eyes widen and become sharp, possibly with a glare. Mouth is tightly closed or teeth are clenched, lips may become thin or tilted to one side.

[0053] Sadness: That is, facial expression. Eyebrows may droop, with the tips of the eyebrows pointing downward. The corners of the mouth may turn downward, and there may be a slight tremor. The eyes may become dull, or have tears in them, and the look may be dim.

[0054] Joy: refers to positive emotions in a broad sense, including pleasant emotions such as happiness.

[0055] Step S200: Automatically adjust the atmosphere elements in the car according to the identified current emotional state, where the atmosphere elements include music elements, lighting elements and fragrance elements.

[0056] According to the output of the emotion recognition module, the data is transmitted to the controllers such as the car computer, lighting and fragrance system for execution, and the music, lighting, fragrance and other atmosphere elements in the car are automatically adjusted. For example, when the system recognizes that the driver is in a happy mood, it automatically plays cheerful music, adjusts the lighting to warm tones such as red or orange, and releases pleasant fragrance; when it recognizes that the driver is in an irritable or tired mood, it adjusts to soft music, reduces the brightness of the lights, and releases a fragrance that helps to relax.

[0057] Furthermore, the AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method proposed in this embodiment further includes the following steps after step S200:

[0058] Step S300: By continuously collecting the driver's and passengers' emotional change data and corresponding atmosphere adjustment feedback, the relevant rules are updated through the AI ​​big model data, and the emotion recognition algorithm and atmosphere adjustment strategy are gradually optimized to provide more accurate and personalized services.

[0059] In this embodiment, it has the ability of self-learning and optimization. By continuously collecting the emotional change data of the driver and the corresponding atmosphere adjustment feedback, the relevant rules are updated through the AI ​​(Artificial Intelligence) large model data, and the emotion recognition algorithm and atmosphere adjustment strategy are gradually optimized to provide more accurate and personalized services.

[0060] Furthermore, the present embodiment provides an AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method, step S100 includes:

[0061] Step S110: If it is recognized that the facial expression information of the driver and passenger is that the corners of the mouth are raised to form a smile, it is determined that the facial expression information of the driver and passenger is in a happy state.

[0062] The state of happiness refers to the state when the corners of the mouth are raised and a smile is formed. It refers to a broad positive emotion, including joy and other pleasant emotional states. The degree of smile in the state of happiness may vary, from a slight upward turn of the corners of the mouth (a hint of joy) to a big grin. The eyes may be narrowed and wrinkles may appear at the corners of the eyes (more obvious when there is true joy).

[0063] Step S120: If the facial expression information of the driver and passenger is identified as a frown with wrinkles formed between the eyebrows, it is determined that the facial expression information of the driver and passenger is in an angry and irritable state.

[0064] The angry and irritable state refers to the state of facial expression where the brows are furrowed and wrinkles form between the brows. In the angry and irritable state, the eyes are wide open and the eyes become sharp, and there may be a feeling of glaring. The mouth is tightly closed or teeth are clenched, and the lips may become thin or tilted to one side.

[0065] Step S130: If it is recognized that the facial expression information of the driver and passenger is drooping eyebrows with the ends of the eyebrows pointing downward, it is determined that the facial expression information of the driver and passenger is in a sad and depressed state.

[0066] Sadness and depression refer to a state where the eyebrows droop down and the tips of the eyebrows turn downward. In a sad and depressed state, the corners of the mouth turn downward and there may be a slight tremor. The eyes may become dull or have tears in them and look dim.

[0067] Furthermore, the present embodiment provides an AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method, step S200 includes:

[0068] Step S210: If it is identified that the current emotional state of the driver is a happy state, the online music in the music element is automatically adjusted to cheerful music.

[0069] When the car detects that the driver is in a happy mood, the in-car audio system can automatically switch to a cheerful and fast-paced music playlist. For example, playing some popular dynamic dance music, such as Jay Chou's "Busy Cowboys", its cheerful melody and energetic rhythm can further enhance the sense of pleasure. At the same time, the music volume can be appropriately increased to create a more enthusiastic atmosphere.

[0070] Step S220: If it is identified that the current emotional state of the driver and passenger is happy, the ambient light setting in the lighting element is automatically adjusted to a vibrant light.

[0071] When the driver is identified as being in a happy mood, the interior ambient light can be adjusted to bright warm colors, such as orange or yellow, to enhance the cheerful atmosphere. The lights can be flashing or gradient, simulating the effect of party lights, adding fun and vitality to the car. For example, the ambient light gradually lights up from one side of the door to the other side in a slow rhythm, and then reverses the cycle, giving a flowing visual effect.

[0072] Step S230: If it is identified that the current emotional state of the driver and passenger is happy, the air conditioner in the fragrance element is automatically adjusted to an amber orange fragrance.

[0073] When the driver is detected to be in a happy mood, the air conditioner in the fragrance element is automatically adjusted to the amber light orange fragrance. The amber light orange fragrance cleverly combines the freshness of citrus and the warmth of amber to create a bright yet deep scent. When you first smell it, the freshness of grapefruit, citrus and bergamot hits your nose, as if you are in an orchard in early summer; then, the floral scent of star anise and geranium is slowly released, adding a bit of freshness and elegance to the fragrance; finally, the deep tone of amber and vanilla gradually emerges, bringing a warm and comfortable feeling.

[0074] Preferably, the present embodiment provides an AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method, step S200 includes:

[0075] Step S240: If it is identified that the current emotional state of the driver is angry and irritable, the online music in the music element is automatically adjusted to metal music.

[0076] When it is recognized that the driver is in an angry and irritable mood, the online music in the music element is automatically adjusted to metal music. Metal music is a form of music, mainly heavy metal, including black metal, death metal, thrash metal, new metal, doom metal, glam metal, heavy metal and industrial metal.

[0077] Step S250: If it is identified that the current emotional state of the driver is angry and irritable, the ambient light setting in the lighting element is automatically adjusted to a light with a distinct color.

[0078] When the driver is detected to be angry or irritable, the ambient light setting in the lighting element is automatically adjusted to a light with a distinct color. The distinct colors of light include blue or green, because the most conspicuous light colors at night may be blue or green. Blue and green light are also more likely to attract people's attention, so they are often used as warning colors when driving at night or in situations where safety needs to be improved.

[0079] Step S260: If it is identified that the current emotional state of the driver is angry and irritable, the air conditioner in the fragrance element is automatically adjusted to a high-boiling-point fragrance.

[0080] When it is detected that the driver is in an angry and irritable mood, the air conditioner in the fragrance element is automatically adjusted to the Gaoyang Boiling Point Fragrance. Gaoyang Boiling Point Fragrance is a fragrance suitable for use when the sun is strong at noon. Its fragrance is strong and passionate, which can enhance the vitality of the atmosphere in the car. The fragrance characteristics of Gaoyang Boiling Point Fragrance are: the top notes are bergamot and ocean, which bring a fresh and refreshing feeling. The middle notes are lavender, geranium and rosemary, which are mixed to create a unique floral aroma. The base notes are patchouli and tonka bean, which add a touch of depth and persistence to the fragrance. The use scenario of Gaoyang Boiling Point Fragrance is particularly suitable for use when the sun is strong at noon. Its strong fragrance can refresh the mind and bring vitality to the driver and passengers.

[0081] Furthermore, the present embodiment provides an AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method, step S200 includes:

[0082] Step S270: If it is identified that the current emotional state of the driver is sad or depressed, the online music in the music element is automatically adjusted to soft music.

[0083] When it is detected that the driver is in a sad and depressed mood, the online music in the music element is automatically adjusted to soft music. Soft music usually refers to music with soft melodies and slow rhythms, which can bring people a sense of tranquility and relaxation. Soft music is often used for healing, sleep aid or to create a relaxing atmosphere.

[0084] Soft music belongs to "light music" or "gentle music" in the music classification, and its English translation is light music and gentle music respectively. This kind of music is characterized by beautiful melody and steady rhythm, and often has a healing effect, which can help people relax and relieve stress. For example, some specific soft music works include: "Autumn Rose": a world classic with melodious melody, ethereal beauty. "Breeze Valley": a work in Bandari's album, with beautiful melody, soothing body and mind. "Annie's Song": a piece of pure music, fresh and natural, healing the soul. "Sundial Dreams": soft and delicate, pure and beautiful. "Poetic": soft melody, light clouds and breeze.

[0085] Step S280: If it is identified that the current emotional state of the driver is sad or depressed, the ambient light setting in the lighting element is automatically adjusted to a dim and soft light.

[0086] When it is detected that the driver is in a sad and depressed mood, the ambient light setting in the lighting element is automatically adjusted to dim and soft light. Dim and soft lighting can create a particularly peaceful, warm and atmospheric environment. Dim and soft lighting is often not too glaring, but illuminates the space in a gentle and comfortable way. It may come from floor lamps, local spotlights or other types of warm light source lamps with soft beams and a color temperature usually between 3000K and 3500K. Such a color temperature can prevent the light from being too yellow or too white, creating a warm atmosphere just right. In such an environment, the driver can temporarily forget their troubles and enjoy a moment of tranquility and beauty.

[0087] Step S290: If it is identified that the current emotional state of the driver and passenger is sad or depressed, the air conditioner in the fragrance element is automatically adjusted to a white refreshing fragrance.

[0088] When the driver is identified as being in a sad and depressed mood, the air conditioner in the fragrance element is automatically adjusted to a white and refreshing fragrance. White and refreshing fragrance is often associated with natural and pure images, such as the morning sun, white flowers, etc., which can create a peaceful and comfortable atmosphere. White and refreshing fragrance adds a sense of tranquility and comfort to the driver.

[0089] The present invention relates to an AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system, comprising an emotion recognition module and an atmosphere adjustment module, wherein the emotion recognition module is used to obtain facial expression information of a driver or occupant captured by a camera and sound feature information collected by a microphone, and to identify the current emotional state of the driver or occupant based on the facial expression information and the sound feature information; the atmosphere adjustment module is used to automatically adjust the atmosphere elements in the vehicle according to the identified current emotional state, and the atmosphere elements include music elements, lighting elements and fragrance elements.

[0090] The emotion recognition module uses the camera and microphone installed in the car to capture the facial expressions, voice characteristics and other information of the driver and passengers, and performs emotion recognition by continuously optimizing the deep learning algorithm. It can accurately identify the basic emotions of the driver and passengers, such as the facial expressions of the monitored driver, and output the emotion recognition results in real time.

[0091] Based on the output of the emotion recognition module, the atmosphere adjustment module transmits data to the controllers such as the car computer, lighting and fragrance system for execution, and automatically adjusts the atmosphere elements such as music, lighting, fragrance, etc. in the car. For example, when the system recognizes that the driver is in a happy mood, it automatically plays cheerful music, adjusts the lighting to warm tones such as red or orange, and releases pleasant fragrance; when it recognizes that the driver is in an irritable or tired mood, it adjusts to soft music, reduces the brightness of the lights, and releases a fragrance that helps to relax.

[0092] The AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system provided by the present invention also includes a learning and optimization module, which has self-learning and optimization capabilities. It is used to continuously collect the driver's emotional change data and corresponding atmosphere adjustment feedback, update relevant rules through AI large model data, gradually optimize the emotion recognition algorithm and atmosphere adjustment strategy, and provide more accurate and personalized services.

[0093] The learning and optimization module has the ability to self-learn and optimize. By continuously collecting the driver's and passengers' emotional change data and corresponding atmosphere adjustment feedback, it updates the relevant rules through AI (Artificial Intelligence) large model data, gradually optimizes the emotion recognition algorithm and atmosphere adjustment strategy, and provides more accurate and personalized services.

[0094] Furthermore, the AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system provided in this embodiment, the emotion recognition module includes a first recognition unit, a second recognition unit and a third recognition unit, wherein the first recognition unit is used to judge that the facial expression information of the driver and passenger is in a happy state if it is recognized that the facial expression information of the driver and passenger is that the corners of the mouth are raised to form a smile; the second recognition unit is used to judge that the facial expression information of the driver and passenger is in an angry and irritable state if it is recognized that the facial expression information of the driver and passenger is that the brows are frowned and wrinkles are formed between the brows; the third recognition unit is used to judge that the facial expression information of the driver and passenger is in a sad and depressed state if it is recognized that the facial expression information of the driver and passenger is that the eyebrows are drooping and the tips of the eyebrows are downward.

[0095] Preferably, the AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system provided in this embodiment, the atmosphere adjustment module includes a first happy state adjustment unit, a second happy state adjustment unit and a third happy state adjustment unit, wherein the first happy state adjustment unit is used to automatically adjust the online music in the music element to cheerful music if it is recognized that the current emotional state of the driver and passenger is a happy state; the second happy state adjustment unit is used to automatically adjust the atmosphere light setting in the lighting element to a vibrant light if it is recognized that the current emotional state of the driver and passenger is a happy state; the third happy state adjustment unit is used to automatically adjust the air conditioner in the fragrance element to an amber orange fragrance if it is recognized that the current emotional state of the driver and passenger is a happy state.

[0096] Furthermore, the AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system provided in this embodiment, the atmosphere adjustment module includes a first angry and irritable state adjustment unit, a second angry and irritable state adjustment unit and a third angry and irritable state adjustment unit, wherein the first angry and irritable state adjustment unit is used to automatically adjust the online music in the music element to metal music if it is recognized that the current emotional state of the driver and occupant is an angry and irritable state; the second angry and irritable state adjustment unit is used to automatically adjust the atmosphere light setting in the lighting element to a light with a distinct color if it is recognized that the current emotional state of the driver and occupant is an angry and irritable state; the third angry and irritable state adjustment unit is used to automatically adjust the air conditioner in the fragrance element to a high-yang boiling point fragrance if it is recognized that the current emotional state of the driver and occupant is an angry and irritable state.

[0097] Furthermore, the AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system provided in this embodiment, the atmosphere adjustment module includes a first sad and depressed state adjustment unit, a second sad and depressed state adjustment unit and a third sad and depressed state adjustment unit, wherein the first sad and depressed state adjustment unit is used to automatically adjust the online music in the music element to soft music if it is recognized that the current emotional state of the driver and passenger is a sad and depressed state; the second sad and depressed state adjustment unit is used to automatically adjust the atmosphere light setting in the lighting element to dim and soft light if it is recognized that the current emotional state of the driver and passenger is a sad and depressed state; the third sad and depressed state adjustment unit is used to automatically adjust the air conditioner in the fragrance element to white and refreshing fragrance if it is recognized that the current emotional state of the driver and passenger is a sad and depressed state.

[0098] This embodiment provides an AI-based emotion recognition and in-car atmosphere adaptive adjustment method and system. Compared with the prior art, by acquiring the facial expression information of the driver and passenger captured by the camera and the sound feature information collected by the microphone, the current emotional state of the driver and passenger is identified based on the facial expression information and the sound feature information; according to the identified current emotional state, the atmosphere elements in the car are automatically adjusted, and the atmosphere elements include music elements, lighting elements and fragrance elements. The AI-based emotion recognition and in-car atmosphere adaptive adjustment method and system provided in this embodiment, by introducing AI emotion recognition technology, realizes the adaptive adjustment of the in-car atmosphere, significantly improving the comfort and personalized experience of the driver and passenger. At the same time, the system has the ability of self-learning and optimization, and can continuously improve the service quality and user satisfaction. In addition, the system also has a broad application prospect, and can be extended to various types of automobiles and transportation tools, bringing a more intelligent and convenient travel experience to the driver and passenger.

[0099] Although preferred embodiments of the present invention have been described, additional changes and modifications may be made to these embodiments by those skilled in the art once the basic inventive concepts are known. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention. Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. An AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method, characterized in that: The following steps are involved: Acquire the facial expression information of the driver or passenger captured by the camera and the sound feature information collected by the microphone, and identify the current emotional state of the driver or passenger based on the facial expression information and the sound feature information; According to the identified current emotional state, the atmosphere elements in the car are automatically adjusted, and the atmosphere elements include music elements, lighting elements and fragrance elements.

2. The AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method according to claim 1, characterized in that: The current emotional state includes a happy state, an angry and irritable state, and a sad and depressed state. The steps of obtaining the facial expression information of the driver and the passenger captured by the camera and the sound feature information collected by the microphone, and identifying the current emotional state of the driver and the passenger based on the facial expression information and the sound feature information include: If the facial expression information of the driver or passenger is recognized as a smile with the corners of the mouth raised, it is determined that the facial expression information of the driver or passenger is in a happy state; If the facial expression information of the driver and passenger is recognized as a frown with wrinkles between the eyebrows, it is determined that the facial expression information of the driver and passenger is in an angry and irritable state; If the facial expression information of the driver and passenger is recognized as drooping eyebrows with the ends of the eyebrows pointing downward, it is determined that the facial expression information of the driver and passenger is in a sad and depressed state.

3. The AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method according to claim 1, characterized in that: The current emotional state includes a happy state, and the step of automatically adjusting the atmosphere elements in the car according to the identified current emotional state includes: If it is recognized that the current emotional state of the driver is happy, the online music in the music element is automatically adjusted to cheerful music; If it is recognized that the current emotional state of the driver is happy, the ambient light setting in the lighting element is automatically adjusted to a vibrant light; If it is recognized that the current emotional state of the driver and passenger is happy, the air conditioner in the fragrance element is automatically adjusted to an amber orange fragrance.

4. The AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method according to claim 1, characterized in that: The current emotional state includes an angry and irritable state. The step of automatically adjusting the atmosphere elements in the car according to the identified current emotional state data includes: If it is identified that the current emotional state of the driver is angry and irritable, the online music in the music element is automatically adjusted to metal music; If it is identified that the current emotional state of the driver is angry and irritable, the ambient light setting in the lighting element is automatically adjusted to a light with a bright color; If it is identified that the current emotional state of the driver and passenger is angry and irritable, the air conditioner in the fragrance element is automatically adjusted to a high-boiling-point fragrance.

5. The AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment method according to claim 1, characterized in that: The current emotional state includes a sad and depressed state. The step of automatically adjusting the atmosphere elements in the vehicle according to the identified current emotional state data includes: If it is identified that the current emotional state of the driver is sad or depressed, the online music in the music element is automatically adjusted to soft music; If it is identified that the current emotional state of the driver is sad or depressed, the ambient light setting in the lighting element is automatically adjusted to a dim and soft light; If it is identified that the current emotional state of the driver and passenger is sad and depressed, the air conditioner in the fragrance element is automatically adjusted to a white and refreshing fragrance.

6. An AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system, characterized in that: include: An emotion recognition module is used to obtain the facial expression information of the driver and passenger captured by the camera and the sound feature information collected by the microphone, and recognize the current emotional state of the driver and passenger based on the facial expression information and the sound feature information; The atmosphere adjustment module is used to automatically adjust the atmosphere elements in the car according to the identified current emotional state, and the atmosphere elements include music elements, lighting elements and fragrance elements.

7. The AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system as claimed in claim 6, characterized in that: The emotion recognition module comprises: The first recognition unit is used to determine that the facial expression information of the driver and passenger is in a happy state if the facial expression information of the driver and passenger is recognized as a smile with the corners of the mouth raised; The second recognition unit is configured to determine that the facial expression information of the driver and passenger is in an angry and irritable state if the facial expression information of the driver and passenger is recognized as a frown with wrinkles formed between the eyebrows; The third recognition unit is used to determine that the facial expression information of the driver and passenger is in a sad and depressed state if it is recognized that the facial expression information of the driver and passenger is drooping and the eyebrows are pointed downward.

8. The AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system as claimed in claim 6, characterized in that: The atmosphere adjustment module comprises: A first happy state adjustment unit is used to automatically adjust the online music in the music element to cheerful music if it is recognized that the current emotional state of the driver is a happy state; A second happy state adjustment unit is used to automatically adjust the ambient light setting in the lighting element to a vibrant light if it is recognized that the current emotional state of the driver is a happy state; The third happy state adjustment unit is used to automatically adjust the air conditioner in the fragrance element to an amber orange fragrance if it is recognized that the current emotional state of the driver and the passenger is a happy state.

9. The AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system as claimed in claim 6, characterized in that: The atmosphere adjustment module comprises: A first anger and irritability state adjustment unit, configured to automatically adjust the online music in the music element to metal music if it is recognized that the current emotional state of the driver is an anger and irritability state; A second anger and irritability state adjustment unit is used to automatically adjust the ambient light setting in the lighting element to a light with a distinct color if it is recognized that the current emotional state of the driver and the occupant is an angry and irritable state; The third anger and irritability state adjustment unit is used to automatically adjust the air conditioner in the fragrance element to a high-boiling-point fragrance if it is recognized that the current emotional state of the driver and the passenger is an angry and irritable state.

10. The AI-based emotion recognition and in-vehicle atmosphere adaptive adjustment system according to claim 6, characterized in that: The atmosphere adjustment module comprises: a first sadness and depression state adjustment unit, configured to automatically adjust the online music in the music element to soft music if it is recognized that the current emotional state of the driver is a sadness and depression state; a second sadness and depression state adjustment unit, configured to automatically adjust the ambient light setting in the lighting element to a dim and soft light if it is recognized that the current emotional state of the driver and passenger is a sadness and depression state; The third sadness and depression state adjustment unit is used to automatically adjust the air conditioner in the fragrance element to a white refreshing fragrance if it is recognized that the current emotional state of the driver and the passenger is a sadness and depression state.

Images