Vehicles and methods of controlling vehicles

By installing sensors on the seat to measure acceleration and contact pressure, and combining this with electroencephalogram (EEG) and heart rate information, emotion modeling is performed, solving the problem of driver emotion recognition and achieving emotion regulation and improved driving experience.

CN114454781BActive Publication Date: 2026-11-17HYUNDAI MOTOR CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110960199.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-11-04
Filing Date
2021-08-20
Publication Date
2026-11-17
Estimated Expiration
2041-08-20

AI Technical Summary

Technical Problem

Existing technologies struggle to accurately identify a driver's emotions, especially when the driver is in close contact with the seat; image analysis alone is insufficient to detect changes in their emotions.

Method used

By installing multiple sensors on the seat, the acceleration, contact pressure, and load information of the driver's back and thighs are measured to determine the human body's vibration sensitivity. Combined with electroencephalogram and heart rate information, quadrant diagrams are used to model emotions and control output devices such as speakers and vibrators to regulate the driver's emotions.

Benefits of technology

It enables accurate identification and regulation of driver emotions, improves the driving experience, enhances vehicle marketability, and reduces development costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114454781B_ABST
    Figure CN114454781B_ABST
Patent Text Reader

Abstract

This invention relates to a vehicle and a method for controlling the vehicle. The vehicle includes: a plurality of sensors mounted on a seat, an output device, and a controller. The controller is configured to obtain the acceleration of each of a first seat in contact with the driver's back and a second seat in contact with the driver's thigh via the plurality of sensors; determine a specific frequency of each of the first and second seats; determine contact pressure information and load information of each of the first and second seats via the plurality of sensors; determine human body vibration sensitivity using at least one of the specific frequency, contact pressure information, and load information; determine the driver's emotional information based on the human body vibration sensitivity, said emotional information including positive emotional information and arousal emotional information; and control the output device according to the driver's emotional information.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to vehicles and methods for controlling vehicles. Background Technology

[0002] Typically, driver emotions are estimated by analyzing image data of driver movement and using a database of edge regions, angles, and distance information.

[0003] However, when using image analysis to analyze the posture of a driver sitting in a driver's seat, it is difficult to accurately identify the driver's emotions and make decisions using limited image information, except for actions such as yawning or turning their head, when the driver's back and thighs are in close contact with the seat. Summary of the Invention

[0004] One aspect of the present invention is to provide a vehicle and a method for controlling the vehicle, wherein the vehicle measures the frequency and acceleration of the seat in which the driver sits to determine human body vibration sensitivity, determines the driver's emotional information based on the human body vibration sensitivity, and controls the output device based on this.

[0005] Other aspects of the invention will be set forth in part in the description which follows, and will be apparent in part from the description, or may be learned by practice of the invention.

[0006] According to one aspect of the present invention, a vehicle is provided, comprising: a plurality of sensors mounted on a seat, an output device, and a controller, the controller being configured to obtain acceleration of each of a first seat in contact with the driver's back and a second seat in contact with the driver's thigh via the plurality of sensors, determine a specific frequency of each of the first and second seats, determine contact pressure information and load information of each of the first and second seats via the plurality of sensors, determine human body vibration sensitivity using at least one of the specific frequency, contact pressure information, and load information, determine driver's emotional information based on the human body vibration sensitivity, the driver's emotional information including positive emotional information and arousal emotional information, and control the output device according to the driver's emotional information.

[0007] The controller can be configured to perform emotion modeling based on the driver's emotional information.

[0008] The controller can be configured to perform emotion modeling using a quadrant diagram, which has positive emotion information on the horizontal axis and arousal emotion information on the vertical axis.

[0009] The controller can be configured to set a movement mode in each quadrant of the quadrant diagram, so that the driver's emotional information is transformed into positive emotional information.

[0010] In response to the driver's emotional information, which is a pattern of moving from the second quadrant to the first quadrant, a pattern of moving from the second quadrant to the fourth quadrant, a pattern of moving from the third quadrant to the first quadrant, and a pattern of moving from the third quadrant to the fourth quadrant, the controller can be configured to determine that the driver's emotion has changed to a positive emotion.

[0011] The controller can be configured to measure the driver's electroencephalogram (EEG) information and the driver's heart rate.

[0012] The controller can be configured to reflect EEG information and heart rate to determine an emotion index based on emotional information.

[0013] The controller can be configured to determine the driver's emotional information as positive as the higher the emotional index of positive emotional information and the emotional index of arousal emotional information, and to determine the driver's emotional information as negative as the lower the emotional index of positive emotional information and the emotional index of arousal emotional information.

[0014] The output device may include at least one speaker, seat, and steering wheel.

[0015] A specific frequency can be the frequency at which the human body is most sensitive to vibration.

[0016] According to another aspect of the present invention, a method for controlling a vehicle is provided, comprising: obtaining, by a controller, the acceleration of each of a first seat in contact with the driver's back and a second seat in contact with the driver's thigh via a plurality of sensors; determining, by the controller, a specific frequency of each of the first and second seats; determining, by the controller, contact pressure information and load information of each of the first and second seats via the plurality of sensors; determining, by the controller, human body vibration sensitivity using at least one of the specific frequency, contact pressure information, and load information; determining, by the controller, driver's emotional information based on the human body vibration sensitivity, the driver's emotional information including positive emotional information and arousal emotional information; and controlling an output device according to the driver's emotional information.

[0017] The method may further include emotion modeling performed by the controller based on the driver's emotional information.

[0018] The method may further include the controller performing emotion modeling using a quadrant diagram, the quadrant diagram having positive emotion information as the horizontal axis and arousal emotion information as the vertical axis.

[0019] The method may further include setting a movement pattern by the controller in each quadrant of the quadrant diagram, so that the driver's emotional information is transformed into positive emotional information.

[0020] The method may further include, in response to the driver’s emotional information, determining by the controller that the driver’s emotion has changed to a positive emotion when the driver’s emotion changes from a pattern of moving from the second quadrant to the first quadrant, a pattern of moving from the second quadrant to the fourth quadrant, a pattern of moving from the third quadrant to the first quadrant, and a pattern of moving from the third quadrant to the fourth quadrant.

[0021] The method may further include measuring the driver's electroencephalogram (EEG) information and the driver's heart rate by the controller.

[0022] The method may further include using a controller to reflect EEG information and heart rate to determine an emotion index of emotional information.

[0023] The method may further include: as the emotional index of positive emotional information and the emotional index of arousal emotional information increase, the controller determines the driver's emotional information as positive emotional information; and as the emotional index of positive emotional information and the emotional index of arousal emotional information decrease, the controller determines the driver's emotional information as negative emotional information.

[0024] The output device may include at least one speaker, seat, and steering wheel.

[0025] A specific frequency can be the frequency at which the human body is most sensitive to vibration. Attached Figure Description

[0026] These and / or other aspects of the invention will become clearer and more readily understood from the following description of embodiments, taken in conjunction with the accompanying drawings, in which: Figure 1 This is a control block diagram of a vehicle according to an embodiment of the present invention.

[0027] Figure 2A This is an internal schematic diagram of a vehicle according to an embodiment of the present invention. Figure 2B It is a graph of human body vibration sensitivity for determining the human body vibration sensitivity of a vehicle according to an embodiment of the present invention.

[0028] Figures 3A to 3D This is a schematic diagram illustrating the determination of seat contact pressure and load in a vehicle according to an embodiment of the present invention. Figure 3E It is a graph according to an embodiment of the present invention used to determine the seat contact pressure and load of a vehicle.

[0029] Figure 4A , Figure 4B and Figure 4CThis is a schematic diagram illustrating the perceived intensity based on a specific frequency of a vehicle seat according to an embodiment of the present invention.

[0030] Figure 5A and Figure 5C This is a schematic diagram of a vehicle driver's emotion model according to an embodiment of the present invention. Figure 5B It is a graph representing a model of a vehicle driver's emotions according to an embodiment of the present invention.

[0031] Figure 6A and Figure 6B This is a schematic diagram of the emotional index of a vehicle driver according to an embodiment of the present invention.

[0032] Figure 7A It is a chart of the driver's emotional information according to an embodiment of the present invention. Figure 7B This is a schematic diagram of the emotional information of a vehicle driver according to an embodiment of the present invention.

[0033] Figure 8 This is a schematic diagram of the driver's emotional information according to an embodiment of the present invention.

[0034] Figure 9 This is a flowchart illustrating a method for controlling a vehicle according to another embodiment of the present invention. Detailed Implementation

[0035] Throughout this specification, the same reference numerals refer to the same elements. Not all elements of embodiments of the invention will be described, but descriptions of content well known in the art or overlapping with each other in exemplary embodiments will be omitted. Terms used throughout this specification, such as “~part,” “~module,” “~component,” “~block,” etc., can be implemented in software and / or hardware, and multiple “~parts,” “~modules,” “~components,” or “~blocks” can be implemented in a single element, or a single “~part,” “~module,” “~component,” or “~block” can include multiple elements.

[0036] It will also be understood that the term “connection” and its derivatives refer to both direct and indirect connections, with indirect connections including connections via wireless communication networks.

[0037] The terms “including (or encompassing)” and “include (or contain)” are inclusive or open-ended and do not exclude additional, undescribed elements or method steps unless otherwise mentioned.

[0038] Furthermore, when stated as a layer "above" another layer or substrate, the layer may be directly above the other layer or substrate or may have a third layer arranged between the two.

[0039] It should be understood that although the terms first, second, third, etc., are used herein to describe individual elements, components, regions, layers, and / or parts, these elements, components, regions, layers, and / or parts should not be limited by these terms. These terms are used only to distinguish one element, component, region, layer, or part from another region, layer, or part.

[0040] It should be understood that the singular forms “one,” “a,” and “the” include plural objects unless otherwise explicitly stated in the context.

[0041] The reference numerals used for method steps are for illustrative purposes only and do not restrict the order of steps. Therefore, unless the context clearly indicates otherwise, the order in which the steps are written may be otherwise.

[0042] The working principle and implementation scheme of the present invention will now be described with reference to the accompanying drawings.

[0043] Figure 1 This is a control block diagram of a vehicle according to an embodiment of the present invention. Figure 2A and Figure 2B This is a schematic diagram of the interior of a vehicle according to an embodiment of the present invention and a schematic diagram of human body vibration sensitivity for determining the human body vibration sensitivity of the vehicle.

[0044] refer to Figure 1 , Figure 2A and Figure 2B The vehicle 1 may include multiple sensors 110, output devices 120, and controllers 100 installed in the seats.

[0045] The controller 100 can obtain acceleration from each of the first seat that contacts the driver's back and the second seat that contacts the driver's thigh through multiple sensors 110, determine the specific frequency of each of the first and second seats, determine the contact pressure information and load information of each of the first and second seats through multiple sensors 110, determine the human body vibration sensitivity using at least one of the specific frequency, contact pressure information and load information, determine the driver's emotional information including positive emotional information and arousal emotional information based on the human body vibration sensitivity, and control the output device 120 according to the driver's emotional information.

[0046] Multiple sensors 110 may be installed in the seat of vehicle 1, and may be 4-axis accelerometers and contact pressure measuring devices, but the invention is not limited thereto.

[0047] refer to Figure 2AThe two sensors 25 and 26 can be mounted on the first seat that contacts the driver's back, and one sensor can be mounted at the top based on the center of the first seat, and the other sensor can be mounted at the bottom. However, there are no particular limitations on the number and location of the sensors 110.

[0048] refer to Figure 2A The four sensors 21, 22, 23, and 24 can be mounted on the second seat that contacts the driver's thighs, and one sensor can be mounted at each of the following locations: above, below, to the left, and to the right of the center of the second seat. However, there are no particular limitations on the number and location of the sensors 110.

[0049] The controller 100 can use frequency and acceleration to determine the resonant frequency and vibration sensitivity.

[0050] refer to Figure 2B Acceleration can be obtained from each of the multiple sensors 21, 22, 23, 24, 25 and 26, and the vibration sensitivity corresponding to the multiple sensors 21, 22, 23, 24, 25 and 26 can be determined by utilizing the acceleration variation according to each frequency of the multiple sensors 21, 22, 23, 24, 25 and 26.

[0051] Figures 3A to 3D This is a schematic diagram illustrating the determination of seat contact pressure and load in a vehicle according to an embodiment of the present invention.

[0052] Figure 3A This is a diagram showing the driver's back and thighs in close contact with the seat. Figure 3B This is a schematic diagram showing a driver sitting with only their thighs in close contact with the seat and their back not in close contact with the seat.

[0053] Figure 3C This is a schematic diagram showing the state of pressure and load distribution on the seat contacts when the driver's back and thighs are in close contact with the seat.

[0054] Figure 3D This is a schematic diagram illustrating the pressure and load distribution at the seat contacts when the driver is seated with only their thighs in close contact with the seat and their back not in close contact with the seat. In this situation, Figure 3E The graph shows the change in contact pressure over time.

[0055] Here, the controller 100 can measure the pressure on each of the multiple sensors 21, 22, 23, 24, 25 and 26 to analyze the load on the seat contacts.

[0056] The controller 100 can determine specific frequencies sensitive to human body vibrations for each of the first seat that the driver's back contacts and the second seat that the driver's thighs contact. For example, the specific frequencies may be 50 Hz, 70 Hz, 90 Hz, or 110 Hz, but are not limited thereto.

[0057] The controller 100 can obtain the maximum contact pressure value of each of the first seat that the driver's back is in contact with and the second seat that the driver's thighs are in contact with.

[0058] The controller 100 can determine human vibration sensitivity using the frequency, contact pressure information, and load information that the human body is sensitive to. More specifically, the controller 100 can determine human vibration sensitivity by measuring changes in sensing intensity based on the vibration amplitude of each of the specific frequencies that the human body is sensitive to: 50 Hz, 70 Hz, 90 Hz, and 110 Hz.

[0059] The controller 100 can perform emotion modeling based on positive emotion information and arousal emotion information.

[0060] More specifically, the controller 100 can perform driver emotion modeling using a quadrant diagram, which has positive emotion information as the horizontal axis and arousal emotion information as the vertical axis. The controller 100 can perform emotion modeling by setting a movement pattern in each quadrant of the quadrant diagram to transform the driver's emotion information into positive emotion information.

[0061] The controller 100 can determine the driver's electroencephalogram (EEG) information and heart rate variability (HRV).

[0062] The controller 100 can perform emotion index analysis of the driver's emotional information by reflecting the driver's EEG information and HRV.

[0063] The controller 100 can utilize frontal alpha asymmetry (FAA) valence analysis as a measure of positive emotion in driver emotional information for use in emotion index analysis. In this case, FAA valence analysis can be a phenomenon where alpha band EEG activity in the frontal lobe indicates left-right hemisphere asymmetry.

[0064] Furthermore, the controller 100 can utilize the Frontal Theta Differential Entropy (FTDE) arousal analysis method as a measure of arousal emotion in the driver's emotional information for use in emotion index analysis. In this case, the FTDE arousal analysis method can represent the differential entropy value of brain signals in the theta band (4 to 8 Hz) of the central frontal lobe of the driver.

[0065] The controller 100 can use HRV analysis to determine the driver's heart rate fluctuations. In this case, HRV can refer to the change in the time interval between adjacent heartbeats.

[0066] The controller 100 can control the output device 120 based on at least one of the driver's emotional information, emotional modeling, and emotional index.

[0067] Refer again Figure 1 The controller 100 can control the speaker 121 to output sound so as to change the driver's mood to a positive mood.

[0068] The controller 100 can control the haptic generator 122 and the vibrator 123 to induce a positive emotion in the driver and control the output of ultrasonic waves or vibrations. Here, the vibrator 123 may include an actuator, and multiple vibrators 123 may be mounted on the seat of the vehicle 1.

[0069] The controller 100 can output sound, vibration and ultrasound simultaneously, and can automatically output sound, vibration and ultrasound by setting the output time of sound, vibration and ultrasound based on the driver's emotional information and emotional modeling.

[0070] The controller 100 can smoothly control the steering wheel of the vehicle 1, thereby changing the driver's mood to a positive one.

[0071] The controller 100 may include a non-volatile memory and a processor. The non-volatile memory stores algorithms for controlling the operation of components in the vehicle 1, or data about programs implementing those algorithms. The processor performs the aforementioned operations using the data stored in the memory. The memory and processor may be implemented as separate chips. Alternatively, the memory and processor may be implemented on a single chip.

[0072] The storage device may correspond to a memory that stores the information mentioned above and the information described below. In order to store various types of information, the storage device may be implemented as at least one of, but not limited to, non-volatile storage devices (e.g., cache, read-only memory (ROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM)), volatile storage devices (e.g., random access memory (RAM)), or storage media (e.g., hard disk drive (HDD) or optical disk drive (CD) ROM).

[0073] Figure 4A , Figure 4B and Figure 4C This is a schematic diagram illustrating the perceived intensity based on a specific frequency of a vehicle seat according to an embodiment of the present invention.

[0074] refer to Figure 4A It can identify low frequencies in each seat, including the first seat where the driver's back is in contact and the second seat where the driver's thighs are in contact, which are frequencies sensitive to human vibration. For example, frequencies sensitive to human vibration can be 50 Hz, 70 Hz, 90 Hz, and 110 Hz, but are not limited to these.

[0075] refer to Figure 4B and Figure 4C It can identify each of the frequencies 50 Hz, 70 Hz, 90 Hz and 110 Hz that are sensitive to human vibration, and can sense the intensity according to the change in vibration amplitude, and can identify human vibration sensitivity.

[0076] For more details, see the reference. Figure 4B The human vibration sensitivity of the first seat can be identified based on contact pressure information, load information, and the frequency of human vibration sensitivity of the first seat in contact with the driver's back.

[0077] In addition, refer to Figure 4C The human vibration sensitivity of the second seat can be identified based on contact pressure information, load information, and the frequency of human vibration sensitivity of the second seat in contact with the driver's thigh.

[0078] Figure 5A and Figure 5C This is a schematic diagram of the emotion modeling of a vehicle driver according to an embodiment of the present invention.

[0079] Vehicle 1 can perform emotion modeling based on the driver's emotional information, which includes the driver's positive emotional information and arousal emotional information.

[0080] More specifically, vehicle 1 can perform driver emotion modeling based on a quadrant diagram, which has positive emotion information as the horizontal axis and arousal emotion information as the vertical axis.

[0081] Vehicle 1 can perform emotion modeling by setting a movement mode in each quadrant of the quadrant diagram to transform the driver's emotional information into positive emotional information.

[0082] Traditionally, separate camera equipment is required to recognize a driver's facial expressions and determine their emotions. However, this approach is limited in its accuracy due to a large margin of error.

[0083] In an embodiment of the present invention, in order to determine the emotion based on the driver's voice (e.g., coughing, singing, laughing, crying, etc.), a configuration is disclosed that determines the driver's emotional changes based on a music pattern and performs the emotion determination based on the driver's voice and seating posture.

[0084] For example, refer to Figure 5A When the driver's emotional information is determined to be in the second or third quadrant of the emotion modeling diagram, vehicle 1 can determine that the driver is in a negative emotional state. When the driver's emotional information is determined to be in the first or fourth quadrant of the emotion modeling diagram, vehicle 1 can determine that the driver is in a positive emotional state.

[0085] For example, refer to Figure 5A Vehicle 1 demonstrates four patterns of driver emotion determined based on deep learning.

[0086] In the case of a pattern of moving from the second quadrant to the first quadrant, a pattern of moving from the second quadrant to the fourth quadrant, a pattern of moving from the third quadrant to the first quadrant, and a pattern of moving from the third quadrant to the fourth quadrant, vehicle 1 can determine that the driver's emotion changes from positive to positive.

[0087] For example, Figure 5B This is a diagram illustrating a method for transforming deep learning-based driver emotions into output sounds and vibrations that convey positive emotions.

[0088] When vehicle 1 outputs sound and vibration simultaneously, it can be determined that the driver's mood has turned into a positive mood.

[0089] For more details, see the reference. Figure 5B When the vehicle 1 control output device 120 causes a significant change in the position of the vibration, a greater vibration intensity, and a faster sound rhythm, it can be determined that the driver's positive emotions and arousal levels are increased. At this time, referencing... Figure 5CThe portions of linearity that increase and decrease can be identified as the driver's positive emotions. For example, a driver may be in an emotional state such as liking, wanting to feel more often, feeling comfortable, or satisfied.

[0090] In addition, refer to Figure 5B When the vehicle 1 control output device 120 causes a small change in the position of the vibration, a large vibration intensity, and a fast sound rhythm, it can be determined that the driver's positive emotions are reduced while the driver's arousal emotions are increased. In this case, refer to Figure 5C This can be a uniform vibration with no increase or decrease in linearity.

[0091] In addition, refer to Figure 5B When the vehicle 1 control output device 120 causes a large change in the position of the vibration, a small vibration intensity, and a slow sound rhythm, it can be determined that the driver's positive emotions and arousal emotions are reduced.

[0092] For example, when describing the driver's emotional changes based on the sound output from speaker 121, in order to execute the mode of moving from the third quadrant to the first quadrant, vehicle 1 can use smooth, continuous notes and drawn-out notes to send a clear melody, use simple, bright, warm and soft chords, and use various instruments (such as acoustic instruments with a bright and clear feel like a piano) to output the first sound.

[0093] In addition, in order to perform the mode of moving from the second quadrant to the fourth quadrant, vehicle 1 can use stable chords with a slow rhythm, bright and comfortable feel, clearly distinguish the melody and accompaniment by limiting the number of piano arpeggios (the feeling of calm waves), the music played by string instruments with long note lengths and the number of instruments, and use beach wave sound ASMR to output a second sound.

[0094] In addition, for the fourth quadrant fixed mode, vehicle 1 can output a third sound by using a slow-paced, repetitive rhythmic pattern that provides a stable and comfortable feeling, a soft, clear and bright piano sound, bird sounds, forest sounds, long and smooth connecting melody lines, and combinations of notes.

[0095] Figure 6A and Figure 6B This is a schematic diagram of the emotional index of a vehicle driver according to an embodiment of the present invention.

[0096] refer to Figure 6A The horizontal axis represents emotions such as happiness, joy, sadness, and fear corresponding to the driver's emotional information. The vertical axis represents the driver's EEG information, which can be obtained by comparing and evaluating the index of EEG activity in the frontal alpha band with values ​​between 1 and 4. (Reference) Figure 6BThe horizontal axis can represent positive emotional information, and the vertical axis can represent the driver's EEG information, which can be obtained by comparing and evaluating the index of EEG activity in the frontal alpha band with values ​​between 1 and 4.

[0097] In this context, it can mean that the higher the EEG value, the greater the relative emotional change in the driver.

[0098] Here, we use FAA (frontal alpha asymmetry) valence analysis to analyze the sentiment index. FAA valence analysis refers to the asymmetry of EEG activity in the frontal alpha band between the left and right hemispheres. It can be used as a measure of positive emotional information.

[0099] On the other hand, to improve the accuracy of the driver emotion index, the FTDE arousal analysis method can be used. FTDE arousal analysis can represent the differential entropy value of brain signals in the etaner frequency band (4 to 8 Hz) of the central frontal lobe of the driver. Theetaner activity in brain regions can be used as a measure of arousal emotion information based on the driver's seating posture.

[0100] Figure 7A It is a chart of the driver's emotional information according to an embodiment of the present invention. Figure 7B This is a schematic diagram of the emotional information of a vehicle driver according to an embodiment of the present invention.

[0101] refer to Figure 7A It can identify how vibrational stimulation can alter a driver's emotional state based on their posture.

[0102] More specifically, when the vehicle 1 control output device 120 gradually increases the vibration stimulation from the starting point of the vibration stimulation, changes the vibration position, and gradually decreases the vibration stimulation from the middle to the end point, it can identify that the driver may have a comfortable emotional state.

[0103] Furthermore, when the vehicle 1 controls the output device 120 to make the length of a single vibration longer, the vibration position change, the vibration intensity weaker and gradually decrease, it is possible to identify the emotional state that the driver may be interested in.

[0104] Furthermore, when the vehicle 1 control output device 120 makes the vibration intensity weak, gradually increases the vibration stimulation from the starting point of the vibration stimulation, and gradually decreases the vibration stimulation from the middle to the end point, it can identify the emotional state that the driver may have that the driver wants to experience frequently.

[0105] Furthermore, when the vehicle 1 control output device 120 causes the vibration position to change or the vibration intensity to weaken, it can identify that the driver may be in a stress-relieving emotional state.

[0106] Furthermore, when the vehicle 1 control output device 120 causes the vibration position to change, the vibration intensity to be weaker, and the vibration stimulation to not gradually increase (gradually increase) from the starting point of the vibration stimulation and the vibration position to change, it can be identified that the driver's preference may be in a high emotional state.

[0107] Furthermore, when the vehicle 1 control output device 120 causes the vibration position to change or the vibration intensity to weaken, it can be identified that the driver's emotions may be in a positive emotional state.

[0108] Furthermore, when the vehicle 1 control output device 120 causes the vibration stimulus to gradually increase when the vibration position changes, the vibration intensity is stronger, the vibration position changes, and when the vehicle 1 control output device 120 causes the vibration stimulus to gradually increase when the vibration intensity is weak, it can be identified that the driver's emotions may have an aroused emotional state.

[0109] like Figure 7A As shown, vehicle 1 can determine the driver's emotional information into three models.

[0110] refer to Figure 7B The horizontal axis represents positive emotions, and the vertical axis represents arousal emotions. The higher the positive and arousal emotion indices, the more likely the driver is experiencing emotions such as excitement, happiness, and satisfaction—positive emotions like pleasure. Conversely, the lower the positive and arousal emotion indices, the more likely the driver is experiencing emotions such as irritability, depression, despair, and fear—negative emotions like depression.

[0111] More specifically, refer to Equation 1 below, where DE is an abbreviation for differential entropy and represents the differential entropy value of brain signals in the etaner band (4 to 8 Hz) of the central frontal lobe, and etaner activity in the corresponding brain region can be used as a measure of arousal in determining the driver’s emotional information.

[0112] Equation 1 Referring to Equation 2 below, FAA is an abbreviation for Frontal Alpha Asymmetry. It is an index created by observing the asymmetry in EEG activity in the frontal alpha band between the left and right hemispheres, and it is larger when expressing positive emotions. It can be used as a measure to identify positive emotions in emotional information.

[0113] Equation 2 Figure 8 This is a schematic diagram of the emotional information of a vehicle according to an embodiment of the present invention.

[0114] refer to Figure 8When vehicle 1 outputs auditory, kinematic, tactile, and visual information through seat posture analysis, it can be determined that the contribution to the driver's positive emotions, from highest to lowest, is auditory, kinematic, and tactile.

[0115] Figure 9 This is a flowchart illustrating a method for controlling a vehicle according to another embodiment of the present invention.

[0116] Vehicle 1 can obtain frequencies from each of the first seat that contacts the driver's back and the second seat that contacts the driver's thighs. More specifically, in step 910, vehicle 1 can determine a specific frequency that is sensitive to human body vibrations.

[0117] In step 920, vehicle 1 can determine the acceleration of each of the first and second seats by means of sensors attached to the first seat that contacts the driver's back and the second seat that contacts the driver's thigh.

[0118] Here, multiple sensors 110 can be mounted on the seats of vehicle 1, and can be 4-axis accelerometers. More specifically, one sensor 110 can be mounted at each of the upper and lower parts based on the center of the first seat, and the sensor 110 can be mounted on the second seat that contacts the driver's thigh, and one sensor 110 can be mounted at each of the upper, lower, left, and right parts based on the center of the second seat. However, there are no particular limitations on the number and location of the sensors 110.

[0119] In step 930, vehicle 1 can use sensor 110 to determine the contact pressure and load information of the first seat that the driver's back is in contact with and the second seat that the driver's thighs are in contact with.

[0120] Here, sensor 110 can be a contact pressure measuring device, but is not limited to this.

[0121] In step 940, vehicle 1 can determine the driver's human body vibration sensitivity.

[0122] More specifically, vehicle 1 can determine the human vibration sensitivity frequency for each of the first and second seats. For example, it can be 50 Hz, 70 Hz, 90 Hz, and 110 Hz. Vehicle 1 can determine the human vibration sensitivity by utilizing at least one of the following: changes in acceleration based on the human vibration sensitivity frequency, seat contact pressure information, and load information.

[0123] In step 950, vehicle 1 can determine the driver's emotional information based on the driver's human body vibration sensitivity.

[0124] Here, the driver's emotional information can include positive emotional information and arousal emotional information.

[0125] In step 960, vehicle 1 can perform driver emotion modeling based on positive emotion information and arousal emotion information.

[0126] More specifically, vehicle 1 can perform driver emotion modeling using a quadrant diagram, which has positive emotion information as the horizontal axis and arousal emotion information as the vertical axis. Furthermore, vehicle 1 can perform emotion modeling by setting movement patterns in each quadrant of the quadrant diagram to transform the driver's emotion information into positive emotion information.

[0127] In step 970, vehicle 1 can determine the emotional index of the driver's emotional information.

[0128] In this scenario, vehicle 1 can determine the driver's EEG information and HRV in order to determine the driver's emotional index.

[0129] Vehicle 1 can use HRV analysis to determine the driver's heart rate fluctuations.

[0130] More specifically, vehicle 1 can utilize the FAA valence analysis method as a measure of positive emotions in driver emotional information for use in emotion index analysis.

[0131] In addition, vehicle 1 can use the FTDE arousal analysis method as a measure of arousal emotion in the driver's emotional information for emotional index analysis.

[0132] More specifically, the higher the positive emotion index and the arousal emotion index, the more likely the driver's emotional information is excitement, happiness, and satisfaction—positive emotions such as pleasure. Conversely, the lower the positive emotion index and the arousal emotion index, the more likely the driver's emotional information is irritability, depression, despair, and fear—negative emotions such as depression.

[0133] In step 980, vehicle 1 can control output device 120 based on at least one of the driver's emotional information, emotional modeling, and emotional index.

[0134] More specifically, vehicle 1 can control speaker 121 to output sound in order to transform the driver's mood into a positive one.

[0135] Vehicle 1 can control the haptic generator 122 and the vibrator 123 to transform the driver's emotions into positive emotions and control the output of ultrasonic waves or vibrations. Here, the vibrator 123 may include an actuator, and multiple vibrators 123 may be installed in the seat of vehicle 1.

[0136] Vehicle 1 can simultaneously output sound, vibration, and ultrasound, and can automatically output sound, vibration, and ultrasound by setting the output time based on the driver's emotional information and emotion modeling.

[0137] Vehicle 1 can be smoothly controlled by steering wheel, thus changing the driver's mood to a positive one.

[0138] According to an embodiment of the present invention, vehicle 1 may employ a high-performance electronic sound generator (ESG) sound.

[0139] In an embodiment of the present invention, vehicle 1 may employ a vibrating music seat, a massage seat, and electric vehicle sound therapy.

[0140] According to an embodiment of the present invention, vehicle 1 may employ a subpack of autonomous vehicles.

[0141] According to an embodiment of the present invention, since the vehicle takes into account the driver's emotions, it has the effect of improving marketability.

[0142] Furthermore, reducing costs through software and algorithm implementation and compatibility with all vehicle models has the effect of minimizing development costs.

[0143] The disclosed embodiments can be implemented in the form of a recording medium storing computer-executable instructions that can be executed by a processor. These instructions can be stored as program code, and when executed by a processor, they can generate program modules to perform the steps of the disclosed embodiments. The recording medium can be implemented non-volatilely as a non-volatile computer-readable recording medium.

[0144] Non-volatile computer-readable recording media can include all types of recording media that store commands that can be interpreted by a computer. For example, non-volatile computer-readable recording media can be, for example, ROM, RAM, magnetic tape, magnetic disk, flash memory, optical data storage devices, etc.

[0145] Schemes of the present invention have now been described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention can be practiced in other forms than those described above without altering the technical concept or essential characteristics of the invention. The above embodiments are merely examples and should not be interpreted in a restrictive sense.

Claims

1. A vehicle comprising: Multiple sensors installed in the seat; Output devices; as well as The controller is configured as follows: The acceleration of each of the first seat that contacts the driver's back and the second seat that contacts the driver's thighs is obtained through multiple sensors; Determine the specific frequency of each of the first and second seats; Human vibration sensitivity is determined based on the amplitude of a specific frequency. Based on the relationship between previously generated vibration stimuli and driver's emotional information, the driver's emotional information is determined based on human vibration sensitivity. Based on the driver's emotional information and the relationship between vibration stimulation and the driver's emotional information, emotion modeling is performed, and the output device is controlled according to the emotion modeling.

2. The vehicle according to claim 1, wherein, The controller is further configured to perform emotion modeling using a quadrant diagram, which has positive emotion information on the horizontal axis and arousal emotion information on the vertical axis.

3. The vehicle according to claim 2, wherein, The controller is further configured to set a movement mode in each quadrant of the quadrant diagram, so that the driver's emotional information is transformed into positive emotional information.

4. The vehicle according to claim 3, wherein, In response to driver emotional information, the controller is configured to determine that the driver's emotion has changed to a positive emotion if the driver moves from the second quadrant to the first quadrant, from the second quadrant to the fourth quadrant, from the third quadrant to the first quadrant, or from the third quadrant to the fourth quadrant.

5. The vehicle according to claim 1, wherein, Based on EEG information and heart rate, the relationship between vibration stimulation and the driver's emotional information is generated using an emotion index.

6. The vehicle according to claim 5, wherein, The controller is further configured as follows: As the emotional index of positive emotional information and the emotional index of arousal emotional information increase, the driver's emotional information is identified as positive emotional information. As the emotional index of positive emotional information and the emotional index of arousal emotional information decrease, the driver's emotional information is determined to be negative emotional information.

7. The vehicle according to claim 1, wherein, The output device includes at least one speaker, seat, and steering wheel.

8. A method for controlling a vehicle, comprising: The controller obtains the acceleration of each of the first seat that contacts the driver's back and the second seat that contacts the driver's thighs through multiple sensors; The controller determines the specific frequency of each of the first and second seats; The controller determines the human body's vibration sensitivity based on the amplitude of a specific frequency. The controller determines the driver's emotional information based on the relationship between previously generated vibration stimuli and the driver's emotional information, and on the basis of human vibration sensitivity. The controller performs emotion modeling based on the driver's emotional information and the relationship between vibration stimulation and the driver's emotional information, and controls the output device based on the emotion modeling.

9. The method of claim 8, further comprising: The controller performs emotion modeling using a quadrant diagram, which has positive emotion information on the horizontal axis and arousal emotion information on the vertical axis.

10. The method of claim 9, further comprising: The controller sets the movement mode in each quadrant of the quadrant diagram, so that the driver's emotional information is transformed into positive emotional information.

11. The method of claim 10, further comprising: In response to the driver's emotional information, if the driver moves from the second quadrant to the first quadrant, from the second quadrant to the fourth quadrant, from the third quadrant to the first quadrant, or from the third quadrant to the fourth quadrant, the controller determines that the driver's emotion has changed to a positive emotion.

12. The method of claim 8, further comprising: Based on EEG information and heart rate, the relationship between vibration stimulation and the driver's emotional information is generated using an emotion index.

13. The method of claim 12, further comprising: As the emotional index of positive emotional information and the emotional index of arousal emotional information increase, the controller determines that the driver's emotional information is positive emotional information; As the emotional index of positive emotional information and the emotional index of arousal emotional information decrease, the controller determines that the driver's emotional information is negative emotional information.

14. The method according to claim 8, wherein, The output device includes at least one speaker, seat, and steering wheel.

Citation Information

Patent Citations

  • System and method for responding to driver state

    US20160001781A1

  • Biometric sensor fusion to classify vehicle passenger state

    US20190332902A1