Emotion regulation method, system and device, equipment and storage medium

Abstract

The invention provides an emotion regulation method, system and device, equipment and a storage medium, and belongs to the technical field of vehicles. The method comprises the following steps: acquiring emotion reference data of a user and current driving data of a vehicle; determining a current emotion type of the user based on the emotion reference data and an emotion prediction model; determining a target emotion regulation strategy corresponding to the current emotion type and the current driving data based on a corresponding relationship among the emotion type, the driving data and a plurality of emotion regulation strategies; and based on the target emotion adjustment strategy, controlling the vehicle to perform emotion adjustment operation. By the adoption of the method and device, the vehicle is controlled and adjusted according to the target emotion adjusting strategy, so that the emotion of the user is adjusted, the emotion tends to be gentle, and the safety of the user in the driving process is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle technology, and in particular to an emotion regulation method, system, device, equipment, and storage medium. Background Art

[0002] Although vehicles are popular, safe driving is the most important part of the vehicle driving process.

[0003] Current vehicles are usually equipped with a safe driving reminder system. For example, when the vehicle is driving too fast, a voice reminder will be given to the user that the vehicle is currently driving too fast.

[0004] However, a user's emotions while driving also have a significant impact on driving safety. For example, when a user is happy, their emotions are relatively stable, and driving safety is also higher. However, when a user is angry, dangerous driving behaviors may occur, thereby reducing driving safety. However, currently, there is no comprehensive method for emotion monitoring and regulation to regulate user emotions while driving. Summary of the Invention

[0005] The present disclosure provides an emotion regulation method that can solve the technical problems existing in the related technologies. The technical solution is as follows:

[0006] In a first aspect, a method for regulating emotions is provided, the method being applied to a vehicle, the method comprising:

[0007] Obtain the user's emotional reference data and the vehicle's current driving data;

[0008] Determining the user's current emotion type based on the emotion reference data and the emotion prediction model;

[0009] determining a target emotion regulation strategy corresponding to the current emotion type and the current driving data based on a correspondence between the emotion type, the driving data, and a plurality of emotion regulation strategies;

[0010] Based on the target emotion regulation strategy, the vehicle is controlled to perform an emotion regulation operation.

[0011] In a possible implementation, the emotion reference data includes at least one of facial image data, voice data, heart rate data, and skin conductance data of the user.

[0012] In a possible implementation, the current driving data of the vehicle includes at least one of the vehicle's speed, steering wheel angle, accelerator, steering angle, navigation route, weather information, and road condition information.

[0013] In a possible implementation, the current emotion type is one of happiness, sadness, anger, fear, surprise, disgust, and neutral.

[0014] In one possible implementation, different emotion regulation strategies correspond to different emotion regulation triggers;

[0015] The determining, based on the correspondence between the emotion type, the driving data, and the plurality of emotion regulation strategies, a target emotion regulation strategy corresponding to the current emotion type and the current driving data includes:

[0016] Determining, among the emotion regulation trigger conditions corresponding to the multiple emotion regulation strategies, a target emotion regulation trigger condition satisfied by the current emotion type and the current driving data;

[0017] Determine the emotion regulation strategy corresponding to the target emotion regulation trigger condition as the target emotion regulation strategy.

[0018] In one possible implementation, controlling the vehicle to perform an emotion adjustment operation includes:

[0019] Control at least one of a music application, an ambient lighting system, a fragrance release device, a seat massage device, a voice interaction application, and an ADAS auxiliary system in the vehicle to perform emotion adjustment operations.

[0020] In a second aspect, an emotion regulation system is provided, the emotion regulation system comprising a vehicle controller and a backend server;

[0021] The vehicle controller is configured to obtain the user's emotion reference data and locally store the emotion reference data, obtain the vehicle's current driving data and send the current driving data to the backend server; determine the user's current emotion type based on the emotion reference data and the emotion prediction model, and send the current emotion type to the backend server;

[0022] The backend server is configured to determine a target emotion regulation strategy corresponding to the current emotion type and the current driving data based on a correspondence between the emotion type, the driving data, and a plurality of emotion regulation strategies, and send the target emotion regulation strategy to the vehicle controller;

[0023] The vehicle controller is used to control the vehicle to perform emotion regulation operations based on the target emotion regulation strategy.

[0024] In a third aspect, an emotion regulation device is provided, the device comprising:

[0025] An acquisition module is used to obtain the user's emotional reference data and the vehicle's current driving data;

[0026] A first determining module, configured to determine the current emotion type of the user based on the emotion reference data and the emotion prediction model;

[0027] a second determining module, configured to determine a target emotion regulation strategy corresponding to the current emotion type and the current driving data based on a correspondence between the emotion type, the driving data, and a plurality of emotion regulation strategies;

[0028] A control module is used to control the vehicle to perform an emotion regulation operation based on the target emotion regulation strategy.

[0029] In a possible implementation, the emotion reference data includes at least one of facial image data, voice data, heart rate data, and skin conductance data of the user.

[0030] In a possible implementation, the current driving data of the vehicle includes at least one of the vehicle's speed, steering wheel angle, accelerator, steering angle, navigation route, weather information, and road condition information.

[0031] In a possible implementation, the current emotion type is one of happiness, sadness, anger, fear, surprise, disgust, and neutral.

[0032] In one possible implementation, different emotion regulation strategies correspond to different emotion regulation triggers;

[0033] The second determining module is configured to:

[0034] Determining, among the emotion regulation trigger conditions corresponding to the multiple emotion regulation strategies, a target emotion regulation trigger condition satisfied by the current emotion type and the current driving data;

[0035] Determine the emotion regulation strategy corresponding to the target emotion regulation trigger condition as the target emotion regulation strategy.

[0036] In a possible implementation, the control module is configured to:

[0037] Control at least one of a music application, an ambient lighting system, a fragrance release device, a seat massage device, a voice interaction application, a HUD (head-up display) system, a steering wheel vibration device, an air purification system, and an ADAS (Advanced Driver Assistance System) auxiliary system in the vehicle to perform emotion adjustment operations.

[0038] In a fourth aspect, a computer device is provided, comprising a processor and a memory, wherein the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement the operation performed by the emotion regulation method.

[0039] In a fifth aspect, a computer-readable storage medium is provided, wherein the storage medium stores at least one instruction, and the instruction is loaded and executed by a processor to implement the operations performed by the emotion regulation method.

[0040] In a sixth aspect, a computer program product is provided, wherein the computer program product comprises at least one instruction, and the at least one instruction is loaded and executed by a processor to implement the operations performed by the emotion regulation method.

[0041] The beneficial effects of the technical solution provided by the present disclosure are: the solution mentioned in the present disclosure can determine the user's current emotion type based on the user's emotion reference data, and then determine a reasonable and effective target emotion regulation strategy through the current emotion type and the current driving data of the user when driving the vehicle. The vehicle can be controlled and adjusted according to the target emotion regulation strategy, thereby regulating the user's emotions and making his emotions tend to be calm, thereby improving the safety of the user during driving. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0043] Figure 1 is a flow chart of an emotion regulation method provided by an embodiment of the present disclosure;

[0044] Figure 2 is a workflow diagram of an emotion regulation system provided by an embodiment of the present disclosure;

[0045] Figure 3 is a structural diagram of an emotion regulation device provided by an embodiment of the present disclosure;

[0046] Figure 4 This is a structural block diagram of a terminal provided by an embodiment of the present disclosure;

[0047] Figure 5 This is a structural block diagram of a server provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0048] In order to make the objectives, technical solutions and advantages of the present disclosure more clear, the embodiments of the present disclosure will be further described in detail below with reference to the accompanying drawings.

[0049] Figure 1 This is a flow chart of an emotion regulation method provided by an embodiment of the present disclosure. Figure 1 , the embodiment includes:

[0050] 101. Obtain the user's emotional reference data and the vehicle's current driving data.

[0051] In implementation, when the vehicle is powered on, the user's emotional reference data and the vehicle's current driving data can be obtained in real time.

[0052] Among them, the user's emotional reference data is data that can provide a reference basis for the user's current emotional judgment. In the embodiment of the present disclosure, the user's emotional reference data may include at least one of the user's facial image data, voice data, heart rate data, and skin conductance data.

[0053] The user's facial image data can more intuitively reflect the user's current emotions. For example, when the user frowns, it indicates that the user's emotions are relatively negative, and when the user smiles, it indicates that the user's emotions are relatively positive. Voice data usually contains the user's current actual needs. The text and tone in the voice data can reflect the user's current emotions. Heart rate data is the user's current heart rate. When the heart rate is fast, it indicates that the user is more excited at this time. When the heart rate is normal, it indicates that the user's current emotions are relatively calm. Skin conductance data can be the skin conductance data corresponding to the user's palms. Skin conductance data can reflect different data depending on whether the user's palms are sweating. Therefore, skin conductance data can also reflect the user's current emotions to a certain extent.

[0054] The user's emotion reference data may be any one or a combination of the above, or may include any other reasonable data, which is not limited in the embodiments of the present disclosure.

[0055] The vehicle's current driving data may include at least one of the following: vehicle speed, steering wheel angle, accelerator, steering angle, navigation route, weather information, and road condition information. Of course, in addition to including one or more of the above, the vehicle's current driving data may also include any other reasonable data, which is not limited in the present embodiment.

[0056] 102. Determine the user's current emotion type based on the emotion reference data and the emotion prediction model.

[0057] In implementation, after obtaining the user's emotion reference data, the emotion reference data can be input into the emotion prediction model to obtain the output of the user's current emotion type.

[0058] In an embodiment of the present disclosure, the emotion prediction model may be a trained machine learning model, which may include a temporal channel (LSTM+1D-CNN), a spatial channel (ResNet50+Transformer), and a fusion layer.

[0059] During implementation, time-series data such as voice data, heart rate data, and skin conductance data from the emotion reference data can be input into the time-series channel for feature extraction to obtain a first feature vector. Spatial data such as facial data from the emotion reference data can be input into the spatial channel for feature extraction to obtain a second feature vector. The first and second feature vectors can then be input into the fusion layer for fusion processing and prediction, resulting in the output of the user's current emotion type.

[0060] Of course, in addition to the above structure, the emotion prediction model can also have any other reasonable structure, which is not limited in the embodiments of the present disclosure.

[0061] In a possible implementation, the current emotion type may be one of happiness, sadness, anger, fear, surprise, disgust, and neutral.

[0062] 103. Based on the correspondence between the emotion type, the driving data, and the plurality of emotion regulation strategies, determine a target emotion regulation strategy corresponding to the current emotion type and the current driving data.

[0063] In implementation, based on the correspondence between pre-stored emotion types, driving data and multiple emotion regulation strategies, a target emotion regulation strategy corresponding to the current emotion type and current driving data can be determined among multiple emotion regulation strategies. This emotion regulation strategy is the most reasonable and effective emotion regulation strategy currently determined based on the user's current emotion type and the vehicle's current driving data.

[0064] In one possible implementation, different emotion regulation strategies correspond to different emotion regulation triggering conditions, and the method for determining the target emotion regulation strategy may be:

[0065] Among the emotion regulation trigger conditions corresponding to the multiple emotion regulation strategies, a target emotion regulation trigger condition that is satisfied by the current emotion type and the current driving data is determined, and the emotion regulation strategy corresponding to the target emotion trigger regulation condition is determined as the target emotion regulation strategy.

[0066] In practice, multiple pre-stored emotion regulation strategies correspond to different emotion regulation trigger conditions. Once the user's current emotion type is determined, the system can traverse these multiple emotion regulation trigger conditions to determine which of the multiple emotion regulation trigger conditions the current emotion type and driving data meet. Once a determination is made, the satisfied emotion regulation trigger condition can be used to determine the target emotion regulation trigger condition.

[0067] Then, the emotion regulation strategy corresponding to the target emotion regulation triggering condition is determined as the target emotion regulation strategy.

[0068] In one possible implementation, the emotion regulation trigger conditions may include driving scene conditions and emotion type conditions. Different emotion condition trigger conditions may have different driving scene conditions and the same emotion type conditions, or the same driving scene conditions and different emotion type conditions, or different driving scene conditions and different emotion type conditions.

[0069] The emotion type condition can correspond to different current emotion types, and the driving scene condition can be the following three:

[0070] 1. If the vehicle speed is less than or equal to 60 km / h, it is traveling in a straight line, and the ambient lighting is good, the current driving scenario is safe.

[0071] 2. If the vehicle speed is greater than 60 km / h and less than 100 km / h, and there are frequent detours on urban roads, the current driving scenario is medium-risk.

[0072] 3. If the vehicle speed is greater than or equal to 100 km / h, it is rainy or snowy, and there is sudden acceleration / braking, then the current driving scenario is high-risk.

[0073] The emotion regulation strategies corresponding to the above emotion regulation triggering conditions may include:

[0074] If the current driving data is determined to meet the safe driving scenario, the user is allowed to activate music applications, ambient lighting systems, fragrance release devices, seat massage devices, voice interaction applications, etc. If the current driving data is determined to meet the medium-risk driving scenario, the user is only allowed to activate the ambient lighting system, seat massage devices, voice interaction applications, etc. If the current driving data is determined to meet the medium-risk driving scenario, the user is only allowed to activate the voice interaction applications, etc.

[0075] Furthermore, the emotion regulation strategy also includes, based on the activation control that meets the above driving scenario conditions, controlling the applications, devices, systems, etc. that are allowed to be activated according to the current emotion type as follows:

[0076] When the current emotion is happiness, the system recommends an upbeat playlist when the user launches the music app, and increases the ambient lighting brightness when the user activates the ambient lighting system. When the current emotion is sadness, the system releases a warm fragrance when the user activates the fragrance release device, and a voice prompt asks the user whether to activate the seat massage device. When the current emotion is anger, the system lowers the volume when the user launches the music app, and releases lavender fragrance when the user activates the fragrance release device. When the current emotion is fear, the system controls the voice interaction application to provide soothing voice prompts to the user and automatically increases the HUD brightness. When the current emotion is surprise, the system controls the steering wheel to briefly vibrate as a reminder, and the ambient lighting to flash as a reminder. When the current emotion is disgust, the system activates the air purifier and automatically releases lemon fragrance. When the current emotion is neutral, the current cabin environment is maintained.

[0077] In particular, when it is detected that the user's current emotion type is anger and the driving scene conditions meet high-risk driving scenarios, the ADAS assistance system is automatically triggered to improve driving safety.

[0078] Of course, in addition to the above, the emotional condition strategy may also be any other reasonable setting, and the embodiments of the present disclosure do not specifically limit this.

[0079] 104. Based on the target emotion regulation strategy, control the vehicle to perform emotion regulation operations.

[0080] In implementation, after determining the target emotion regulation strategy, at least one of the music application, ambient light system, fragrance release device, seat massage device, voice interaction application, HUD system, steering wheel vibration device, air purification system, and ADAS auxiliary system in the vehicle can be controlled to perform emotion regulation operations according to the target emotion regulation strategy.

[0081] All the above optional technical solutions can be arbitrarily combined to form optional embodiments of the present disclosure, and will not be described in detail here.

[0082] The solution mentioned in the embodiment of the present disclosure can determine the user's current emotion type based on the user's emotion reference data, and then determine a reasonable and effective target emotion regulation strategy based on the current emotion type and the current driving data of the user when driving the vehicle. The vehicle can be controlled and adjusted according to the target emotion regulation strategy, thereby regulating the user's emotions and making his emotions tend to be calm, thereby improving the user's safety during driving.

[0083] The present disclosure also provides an emotion regulation system. Figure 2 ,The emotion regulation system includes a vehicle controller and a backend server.

[0084] The vehicle controller is used to obtain the user's emotional reference data and store the emotional reference data locally, obtain the vehicle's current driving data and send the current driving data to the background server; based on the emotional reference data and the emotional prediction model, determine the user's current emotional type and send the current emotional type to the background server.

[0085] The backend server is used to determine a target emotion regulation strategy corresponding to the current emotion type and the current driving data based on the correspondence between the emotion type, the driving data and the multiple emotion regulation strategies, and send the target emotion regulation strategy to the vehicle controller.

[0086] The vehicle controller is used to control the vehicle to perform emotion regulation operations based on the target emotion regulation strategy.

[0087] In this way, the data involving user privacy in the emotional reference data can be stored only in the vehicle controller, that is, only stored locally, and will not be sent to the background server for storage. On the one hand, it avoids the leakage of user privacy data, and on the other hand, it provides a good service experience for user privacy protection.

[0088] Furthermore, the current emotion data stored in the vehicle controller can be encrypted to further improve privacy protection.

[0089] In a possible implementation, the vehicle controller may be a main control of the vehicle or other regional controllers, etc., which is not specifically limited in the embodiment of the present disclosure.

[0090] In a possible implementation, the emotion regulation system may further include a data acquisition device, which is used to collect the user's current emotion data and the vehicle's current driving data, and send the current emotion data and the current driving data to the vehicle controller.

[0091] The data acquisition device may include at least one of a visual sensor, a voice sensor, a capacitive heart rate sensor, a skin conductance sensor, and a vehicle data interface.

[0092] Among them, the visual sensor can be a camera (resolution 1080P, frame rate 30fps) of the DMS (Driver Monitor System) in the car, which is installed behind the steering wheel and covers the driver's face and upper body posture through a wide-angle lens.

[0093] The voice sensor can be an array microphone (4-microphone ring layout) integrated into the roof console, supporting active noise reduction and sound source localization.

[0094] The capacitive heart rate sensor can be embedded in the steering wheel grip area and collects heart rate signals through contact electrodes with a sampling rate of 100Hz.

[0095] The skin conductance sensor can be integrated into the surface of the seat armrest and uses a flexible electrode patch to measure changes in the driver's hand skin conductance.

[0096] The vehicle data interface can obtain current driving data such as vehicle speed, acceleration, steering angle, gear position, navigation route (including traffic congestion level) in real time through the CAN bus.

[0097] The embodiment of the present disclosure provides an emotion regulation device, which may be the computer device in the above embodiment, such as Figure 3 As shown, the device includes:

[0098] An acquisition module 310 is used to acquire the user's emotional reference data and the vehicle's current driving data;

[0099] A first determination module 320 is configured to determine the current emotion type of the user based on the emotion reference data and the emotion prediction model;

[0100] A second determining module 330 is configured to determine a target emotion regulation strategy corresponding to the current emotion type and the current driving data based on a correspondence between the emotion type, the driving data, and a plurality of emotion regulation strategies;

[0101] The control module 340 is configured to control the vehicle to perform an emotion regulation operation based on the target emotion regulation strategy.

[0102] In a possible implementation, the emotion reference data includes at least one of facial image data, voice data, heart rate data, and skin conductance data of the user.

[0103] In a possible implementation, the current driving data of the vehicle includes at least one of the vehicle's speed, steering wheel angle, accelerator, steering angle, navigation route, weather information, and road condition information.

[0104] In a possible implementation, the current emotion type is one of happiness, sadness, anger, fear, surprise, disgust, and neutral.

[0105] In one possible implementation, different emotion regulation strategies correspond to different emotion regulation triggers;

[0106] The second determining module 330 is configured to:

[0107] Determining, among the emotion regulation trigger conditions corresponding to the multiple emotion regulation strategies, a target emotion regulation trigger condition satisfied by the current emotion type and the current driving data;

[0108] Determine the emotion regulation strategy corresponding to the target emotion regulation trigger condition as the target emotion regulation strategy.

[0109] In a possible implementation, the control module 340 is configured to:

[0110] Control at least one of a music application, an ambient light system, a fragrance release device, a seat massage device, a voice interaction application, a HUD system, a steering wheel vibration device, an air purification system, and an ADAS auxiliary system in the vehicle to perform emotion adjustment operations.

[0111] It should be noted that the above-described embodiment of the emotion regulation device is merely an example of the division of the aforementioned functional modules when performing emotion regulation. In actual applications, the aforementioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to perform all or part of the functions described above. Furthermore, the emotion regulation device and the emotion regulation method embodiments provided in the above-described embodiment are based on the same concept. The specific implementation process is detailed in the method embodiments and will not be further described here.

[0112] Figure 4 The following is a block diagram of a terminal 400 according to an exemplary embodiment of the present disclosure. The terminal may be the computer device described in the aforementioned embodiments. The terminal 400 may be a smartphone, a tablet computer, an MP3 player (moving picture experts group audio layer III), an MP4 player (moving picture experts group audio layer IV), a laptop computer, or a desktop computer. The terminal 400 may also be referred to as a user device, a portable terminal, a laptop terminal, a desktop terminal, or other similar names.

[0113] Typically, the terminal 400 includes a processor 401 and a memory 402 .

[0114] The processor 401 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 401 may be implemented in at least one hardware form of DSP (digital signal processing), FPGA (field-programmable gate array), or PLA (programmable logic array). The processor 401 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (central processing unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 401 may be integrated with a GPU (graphics processing unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 401 may also include an AI (artificial intelligence) processor, which is used to process computing operations related to machine learning.

[0115] Memory 402 may include one or more computer-readable storage media, which may be non-transitory. Memory 402 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in memory 402 is used to store at least one instruction, which is executed by processor 401 to implement the emotion regulation method provided in the method embodiments of the present disclosure.

[0116] In some embodiments, terminal 400 may optionally include a peripheral device interface 403 and at least one peripheral device. Processor 401, memory 402, and peripheral device interface 403 may be connected via a bus or signal lines. Each peripheral device may be connected to peripheral device interface 403 via a bus, signal lines, or circuit boards. Specifically, the peripheral device may include at least one of a radio frequency circuit 404, a display screen 405, a camera 406, an audio circuit 407, a positioning component 408, and a power supply 409.

[0117] The peripheral device interface 403 can be used to connect at least one I / O (input / output)-related peripheral device to the processor 401 and the memory 402. In some embodiments, the processor 401, the memory 402, and the peripheral device interface 403 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 401, the memory 402, and the peripheral device interface 403 can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0118] The radio frequency circuit 404 is used to receive and transmit RF (radio frequency) signals, also known as electromagnetic signals. The radio frequency circuit 404 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 404 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 404 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The radio frequency circuit 404 can communicate with other terminals via at least one wireless communication protocol. Such wireless communication protocols include, but are not limited to, metropolitan area networks, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (wireless fidelity) networks. In some embodiments, the radio frequency circuit 404 may also include circuits related to NFC (near field communication), which is not limited in this disclosure.

[0119] Display screen 405 is used to display a user interface (UI). This UI may include graphics, text, icons, videos, or any combination thereof. If display screen 405 is a touchscreen display, it is also capable of collecting touch signals on or above the surface of display screen 405. These touch signals can be input as control signals to processor 401 for processing. Display screen 405 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there can be a single display screen 405, located on the front panel of terminal 400. In other embodiments, there can be at least two display screens 405, located on different surfaces of terminal 400 or in a foldable design. In still other embodiments, display screen 405 can be a flexible display, located on a curved or foldable surface of terminal 400. Display screen 405 can also be configured as a non-rectangular, irregular shape, also known as a special-shaped screen. Display screen 405 can be made of materials such as LCD (liquid crystal display) and OLED (organic light-emitting diode).

[0120] The camera assembly 406 is used to capture images or videos. Optionally, the camera assembly 406 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the terminal, and the rear camera is arranged on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (virtual reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 406 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0121] The audio circuit 407 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals that are input into the processor 401 for processing, or input into the radio frequency circuit 404 to achieve voice communication. For the purpose of stereo sound collection or noise reduction, there may be multiple microphones, each disposed at different locations on the terminal 400. The microphone may also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert electrical signals from the processor 401 or the radio frequency circuit 404 into sound waves. The speaker may be a traditional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert electrical signals into sound waves audible to humans, but also convert electrical signals into sound waves inaudible to humans for purposes such as distance measurement. In some embodiments, the audio circuit 407 may also include a headphone jack.

[0122] The positioning component 408 is used to locate the current geographic location of the terminal 400 to implement navigation or LBS (location-based service). The positioning component 408 can be a positioning component based on the GPS (global positioning system), Beidou system, Greiner system or Galileo system.

[0123] Power supply 409 is used to power various components in terminal 400. Power supply 409 can be AC power, DC power, a disposable battery, or a rechargeable battery. When power supply 409 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0124] In some embodiments, the terminal 400 further includes one or more sensors 410 , including but not limited to: an acceleration sensor 411 , a gyroscope sensor 412 , a pressure sensor 413 , a fingerprint sensor 414 , an optical sensor 415 , and a proximity sensor 416 .

[0125] Accelerometer 411 can detect the magnitude of acceleration along the three coordinate axes of the coordinate system established by terminal 400. For example, accelerometer 411 can be used to detect the components of gravity acceleration along the three coordinate axes. Processor 401 can control display screen 405 to display the user interface in either a landscape or portrait view based on the gravity acceleration signal collected by accelerometer 411. Accelerometer 411 can also be used to collect game or user motion data.

[0126] The gyroscope sensor 412 can detect the orientation and rotation angle of the terminal 400. It can also work with the accelerometer 411 to collect the user's 3D movements of the terminal 400. Based on the data collected by the gyroscope sensor 412, the processor 401 can implement the following functions: motion sensing (e.g., changing the UI based on the user's tilt), image stabilization during shooting, game control, and inertial navigation.

[0127] The pressure sensor 413 can be provided on the side frame of the terminal 400 and / or below the display screen 405. When the pressure sensor 413 is provided on the side frame of the terminal 400, it can detect the user's gripping signal of the terminal 400, and the processor 401 can perform left-hand or right-hand recognition or shortcut operations based on the gripping signal collected by the pressure sensor 413. When the pressure sensor 413 is provided below the display screen 405, the processor 401 controls the operable controls on the UI interface based on the user's pressure operation on the display screen 405. Operable controls include at least one of a button control, a scroll bar control, an icon control, and a menu control.

[0128] The fingerprint sensor 414 is used to collect the user's fingerprint. The processor 401 identifies the user's identity based on the fingerprint collected by the fingerprint sensor 414, or the fingerprint sensor 414 identifies the user's identity based on the collected fingerprint. When the user's identity is recognized as a trusted identity, the processor 401 authorizes the user to perform relevant sensitive operations, such as unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings. The fingerprint sensor 414 can be set on the front, back, or side of the terminal 400. When a physical button or manufacturer logo is provided on the terminal 400, the fingerprint sensor 414 can be integrated with the physical button or manufacturer logo.

[0129] Optical sensor 415 is used to detect ambient light intensity. In one embodiment, processor 401 can control the display brightness of display screen 405 based on the ambient light intensity detected by optical sensor 415. Specifically, when the ambient light intensity is high, the display brightness of display screen 405 is increased; when the ambient light intensity is low, the display brightness of display screen 405 is decreased. In another embodiment, processor 401 can also dynamically adjust the shooting parameters of camera assembly 406 based on the ambient light intensity detected by optical sensor 415.

[0130] Proximity sensor 416, also known as a distance sensor, is typically located on the front panel of terminal 400. Proximity sensor 416 is used to detect the distance between the user and the front of terminal 400. In one embodiment, when proximity sensor 416 detects that the distance between the user and the front of terminal 400 is gradually decreasing, processor 401 controls display screen 405 to switch from the screen-on state to the screen-off state. When proximity sensor 416 detects that the distance between the user and the front of terminal 400 is gradually increasing, processor 401 controls display screen 405 to switch from the screen-off state to the screen-on state.

[0131] Those skilled in the art will understand that Figure 4 The structure shown in the figure does not constitute a limitation on the terminal 400, and the terminal 400 may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

[0132] Figure 5 is a schematic diagram of the structure of a server provided in an embodiment of the present disclosure. The server 500 may vary significantly due to different configurations or performance, and may include one or more processors (central processing units, CPUs) 501 and one or more memories 502. The memories 502 store at least one instruction, which is loaded and executed by the processor 501 to implement the methods provided in the above-mentioned various method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and input / output interfaces for input and output. The server may also include other components for implementing device functions, which are not described in detail here.

[0133] In an exemplary embodiment, a computer-readable storage medium is also provided, such as a memory including instructions, which can be executed by a processor in a terminal to perform the emotion regulation method in the above embodiment. The computer-readable storage medium can be non-transitory. For example, the computer-readable storage medium can be a ROM (read-only memory), a RAM (random access memory), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0134] Those skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, which may be a read-only memory, a disk, or an optical disk, etc.

[0135] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.), and signals (including but not limited to signals transmitted between user terminals and other devices, etc.) involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data must comply with the relevant laws, regulations, and standards of the relevant countries and regions. For example, the "current mood data" and "current driving data" involved in this disclosure are all obtained with full authorization.

[0136] The above description is merely an optional embodiment of the present disclosure and is not intended to limit the present disclosure. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present disclosure shall be included in the scope of protection of the present disclosure.

Claims

1. A method for regulating emotions, characterized in that: The method is applied to a vehicle, and comprises: Obtain the user's emotional reference data and the vehicle's current driving data; Determining the user's current emotion type based on the emotion reference data and the emotion prediction model; determining a target emotion regulation strategy corresponding to the current emotion type and the current driving data based on a correspondence between the emotion type, the driving data, and a plurality of emotion regulation strategies; Based on the target emotion regulation strategy, the vehicle is controlled to perform an emotion regulation operation.

2. The method according to claim 1, characterized in that The emotion reference data includes at least one of facial image data, voice data, heart rate data, and skin conductance data of the user.

3. The method according to claim 1, characterized in that The current driving data of the vehicle includes at least one of the vehicle speed, steering wheel angle, accelerator, steering angle, navigation route, weather information, and road condition information.

4. The method according to claim 1, wherein The current emotion type is one of happiness, sadness, anger, fear, surprise, disgust, and neutral.

5. The method according to claim 1, wherein Different emotion regulation strategies correspond to different emotion regulation triggers; The determining, based on the correspondence between the emotion type, the driving data, and the plurality of emotion regulation strategies, a target emotion regulation strategy corresponding to the current emotion type and the current driving data includes: Determining, among the emotion regulation trigger conditions corresponding to the multiple emotion regulation strategies, a target emotion regulation trigger condition satisfied by the current emotion type and the current driving data; Determine the emotion regulation strategy corresponding to the target emotion regulation trigger condition as the target emotion regulation strategy.

6. The method according to claim 1, characterized in that The controlling the vehicle to perform an emotion adjustment operation includes: Control at least one of a music application, an ambient light system, a fragrance release device, a seat massage device, a voice interaction application, a HUD system, a steering wheel vibration device, an air purification system, and an ADAS auxiliary system in the vehicle to perform emotion adjustment operations.

7. An emotion regulation system, characterized in that: The emotion regulation system includes a vehicle controller and a backend server; The vehicle controller is configured to obtain the user's emotional reference data and store the emotional reference data locally, obtain the vehicle's current driving data and send the current driving data to the backend server; Determining the user's current emotion type based on the emotion reference data and the emotion prediction model, and sending the current emotion type to the backend server; The backend server is configured to determine a target emotion regulation strategy corresponding to the current emotion type and the current driving data based on a correspondence between the emotion type, the driving data, and a plurality of emotion regulation strategies, and send the target emotion regulation strategy to the vehicle controller; The vehicle controller is used to control the vehicle to perform emotion regulation operations based on the target emotion regulation strategy.

8. An emotion regulation device, characterized in that: The device comprises: An acquisition module is used to obtain the user's emotional reference data and the vehicle's current driving data; A first determining module, configured to determine the current emotion type of the user based on the emotion reference data and the emotion prediction model; a second determining module, configured to determine a target emotion regulation strategy corresponding to the current emotion type and the current driving data based on a correspondence between the emotion type, the driving data, and a plurality of emotion regulation strategies; A control module is used to control the vehicle to perform an emotion regulation operation based on the target emotion regulation strategy.

9. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the operation performed by the emotion regulation method according to any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that The storage medium stores at least one instruction, and the at least one instruction is loaded and executed by the processor to implement the operation performed by the emotion regulation method according to any one of claims 1 to 6.

Images