Vehicle cabin environment control method and device, electronic equipment and storage medium
By collecting and analyzing the physiological signals and behavioral information of passengers in the cabin of the vehicle and adjusting the cabin environmental parameters, the problem of the failure of the existing technology to cope with the emotional needs of passengers is solved, and the passenger's riding experience and environmental matching are improved.
Patent Information
- Application Number
- CN202411258541.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-09
- Publication Date
- 2024-11-15
AI Technical Summary
The existing vehicle cockpit system fails to effectively respond to passengers' emotional needs, and lacks a response mechanism for changes in emotional state caused by various factors when driving or riding in a car, which affects passengers' comfort and satisfaction.
By collecting physiological signals and behavioral information of passengers in the cabin of the vehicle, determining the current emotional state, and adjusting the cockpit environmental parameters under certain conditions to match the passengers' emotional state, including adjustments to environmental factors such as temperature, lighting, and music.
It improves the accuracy and ride experience of passengers' emotional state, reduces resource waste and unnecessary interference, and ensures the significance and effectiveness of environmental parameter adjustments.
Smart Images

Figure CN118953370A_ABST
Abstract
Description
Technical Field
[0001] The present specification relates to the field of vehicle-mounted electronic technology, and in particular to a method, device, electronic device and storage medium for controlling a vehicle cabin environment. Background Art
[0002] The vehicle cabin environment refers to the space and environment inside the vehicle, covering all physical and sensory aspects. For example, the temperature control device, in-vehicle infotainment system, lighting system, etc. jointly determine the overall experience of the vehicle cabin environment and affect the comfort, safety and satisfaction of passengers in the car.
[0003] Related technologies mainly focus on improving the functionality of vehicle cockpit systems, such as navigation, entertainment and safety assistance functions, but rarely consider the emotional needs of passengers. When people are driving or riding in a car, their emotional state may fluctuate due to various factors, such as traffic congestion, work pressure or personal emotions, and the vehicle cockpit systems of related technologies lack effective response mechanisms for this. Summary of the invention
[0004] In order to overcome the problems existing in the related art, this specification provides a control method, device, electronic device and storage medium for a vehicle cabin environment.
[0005] According to a first aspect of an embodiment of this specification, a method for controlling a vehicle cabin environment is provided, the method comprising:
[0006] Collect physiological signals and behavioral information of passengers in the vehicle cabin;
[0007] determining a current emotional state of the passenger based on the physiological signal and the behavioral information;
[0008] When the current emotional state satisfies an adjustment condition, the environmental parameters of the vehicle cabin are adjusted so that the adjusted cabin environment matches the current emotional state.
[0009] According to a second aspect of an embodiment of this specification, a device for controlling a vehicle cabin environment is provided, the device comprising:
[0010] A collection module, used to collect physiological signals and behavioral information of passengers in the vehicle cabin;
[0011] an emotional state determination module, configured to determine the current emotional state of the passenger based on the physiological signal and the behavioral information;
[0012] The adjustment module is used to adjust the environmental parameters of the vehicle cabin when the current emotional state meets the adjustment conditions, so that the adjusted cabin environment matches the current emotional state.
[0013] According to a third aspect of the embodiments of this specification, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the steps of the method described in the first aspect are implemented.
[0014] According to a fourth aspect of the embodiments of this specification, there is provided a computer-readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the steps of the method described in the first aspect.
[0015] The technical solutions provided by the embodiments of this specification may have the following beneficial effects:
[0016] In the embodiments of this specification, by comprehensively analyzing multimodal data such as physiological signals and behavioral information of passengers in the vehicle cabin to determine the current emotional state of passengers, it is possible to effectively avoid the influence of the environment and individual differences on a single signal source, thereby improving the accuracy of determining the current emotional state of passengers. Then, the environmental parameters of the vehicle cabin are adjusted according to the current emotional state so that the adjusted cabin environment matches the current emotional state. By providing corresponding cabin environment adjustment schemes according to the different emotional states of passengers, the passenger experience can be improved. In addition, after determining the current emotional state of the passenger, this scheme can adjust the environmental parameters of the vehicle cabin when the current emotional state meets the adjustment conditions. By setting the adjustment conditions for triggering the adjustment of the vehicle cabin environment, it can be ensured that each parameter adjustment of the vehicle cabin environment is meaningful, reducing unnecessary waste of resources and unnecessary interference to passengers.
[0017] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present specification. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the specification and, together with the description, serve to explain the principles of the specification.
[0019] Figure 1 The flowchart of a method for controlling a vehicle cabin environment is shown in accordance with an exemplary embodiment of the present specification.
[0020] Figure 2 It is a structural schematic diagram of a control system of a vehicle cabin environment shown in this specification according to an exemplary embodiment.
[0021] Figure 3 is a flow chart of another method for controlling a vehicle cabin environment according to an exemplary embodiment of the present specification.
[0022] Figure 4It is a structural schematic diagram of an electronic device according to an exemplary embodiment of the present specification.
[0023] Figure 5 It is a block diagram of a vehicle cabin environment control device shown in this specification according to an exemplary embodiment. DETAILED DESCRIPTION
[0024] Next, the embodiments of this specification are described in detail.
[0025] like Figure 1 As shown, Figure 1 1 is a flow chart of a method for controlling a vehicle cabin environment according to an exemplary embodiment of the present specification, comprising steps 101-103:
[0026] Step 101: Collect physiological signals and behavioral information of passengers in the vehicle cabin.
[0027] In an embodiment shown, physiological signals may include but are not limited to heart rate, skin electrical activity, respiratory rate, body temperature, blood oxygen saturation, eye movement signals and other different physiological signals. It is understandable that the types of physiological signals that can be collected by those skilled in the art are not limited to the types listed above, and those skilled in the art can also collect more physiological signals that can reflect the emotional state of the passenger.
[0028] In one illustrated embodiment, physiological signals of passengers can be collected by installing various sensors in the vehicle cabin. For example, sensors can be embedded in the seat backs or seat cushions of the vehicle to detect the user's heart rate signals through photoplethysmography technology. For example, a heart rate sensor can be embedded in the steering wheel, and the pulse signal can be detected when the driver holds the steering wheel. Electrodes can also be integrated on the steering wheel to measure changes in the driver's skin electrical activity. In addition, those skilled in the art can also install non-contact infrared sensors on the dashboard to monitor the driver's breathing rate or body temperature. Of course, the driver's eye movements and pupil changes can also be tracked by a camera in the vehicle cabin.
[0029] In another embodiment shown, the vehicle system can be linked with a health monitoring device (such as a heart rate watch) worn by a passenger, and physiological signals such as heart rate signals or respiratory rate detected by the health monitoring device can be obtained through communication technologies such as Bluetooth and wireless networks. In this embodiment, by obtaining the physiological signals monitored by the health monitoring device, it is possible to avoid placing a large number of sensors in the cabin, thereby saving vehicle resources.
[0030] Since health monitoring equipment is usually designed for health data collection and uses high-precision sensors, it can provide more accurate physiological signal measurements. Therefore, if the health monitoring equipment in the vehicle cabin and the passengers are both capable of collecting the same physiological signals, the physiological signals collected by the health monitoring equipment can be used first.
[0031] In one illustrated embodiment, behavioral information includes, but is not limited to, facial expressions, such as frowning, smiling, and pupil dilation, which represent different emotional states. Subtle changes in facial expressions can be captured by a camera. Passenger voice information can be obtained, for example, people speak louder when angry and faster when nervous, so emotional states can be inferred based on voice features such as pitch, speed, and volume. Changes in passenger body posture can be monitored by seat sensors to identify the passenger's uneasy or relaxed emotional state. Behavioral information can also be changes in driving style, for example, abnormal acceleration, braking, or steering behavior can also identify changes in the passenger's current emotional state.
[0032] By combining behavioral information and physiological signals, we can reduce the misjudgment caused by a single data source, thereby providing a more accurate assessment of emotional state. For example, some people's facial expressions are naturally "stiff", and it is difficult to reflect their emotional state through their facial expressions, and even to get wrong assessment results. By combining these people's physiological signals, we can cross-validate physiological signals and behavioral information, thereby avoiding potential misjudgments.
[0033] It is understandable that the object of emotional state analysis in this specification is not limited to the driver. The "passenger" in the vehicle cabin involved in this specification can be any person in the cabin, such as the driver, the front passenger and / or the back passenger.
[0034] Step 102: Determine the current emotional state of the passenger based on the physiological signal and the behavioral information.
[0035] In an illustrated embodiment, after the raw data of physiological signals and behavioral information are obtained, the raw data can be cleaned, and the current emotional state of the passenger can be determined based on the physiological signals and behavioral information after data cleaning. For example, high-frequency noise in the raw data or interference within a specific frequency range can be removed by a filter (such as a low-pass filter, a band-pass filter, etc.). For example, missing values can be filled by interpolation, average value filling, etc. For example, techniques such as moving average or Gaussian smoothing can be applied to reduce data fluctuations. In this embodiment, by performing data cleaning on the raw data, errors and inconsistencies in the raw data can be eliminated, thereby providing high-quality data input for subsequent emotional state analysis solutions.
[0036] Since the sensors that collect physiological signals are easily affected by noise, these noises can easily lead to misjudgment of emotional states. When the noise exceeds a certain noise threshold, it cannot be solved by data cleaning. In addition, incomplete physiological signals and behavioral information collected will also affect the judgment of emotional states. For example, in the signal collection stage, if one or more physiological signals and behavioral information are not collected, then due to the lack of necessary physiological signals, it is difficult to accurately judge the emotional state of passengers based on incomplete physiological signals and behavioral information.
[0037] In view of the above technical problems, in an embodiment shown, data features of physiological signals and behavioral information can be extracted, and when the data features match the use conditions, the current emotional state of the passenger can be determined based on the physiological signals and behavioral information that meet the use conditions. For example, the use condition can be a preset number of signals used to determine the current emotional state of the passenger, and the data features can be the number of signal types in the same batch of signals actually collected. Assuming that the physiological signals and behavioral information used to determine the current emotional state of the passenger are four types of data, namely heart rate, skin electrode activity, facial expression and voice, the preset number can be selected as 4. If the heart rate signal is missing from the signals collected from the same batch, the number of signal types actually collected is 3, which is not equal to the preset number, so the emotional state of the passenger can be judged not based on the remaining three types of data in the batch. For another example, the use condition can be a preset noise threshold, and the data features can be the noise contained in the physiological signals or behavioral signals in the same batch of signals actually collected. Assuming that the noise contained in the collected heart rate signal exceeds the noise threshold, the emotional state of the passenger can also be judged not based on the physiological signals and behavioral information of the batch.
[0038] In an illustrated embodiment, an emotional state rule base can be established to determine the current emotional state of the passenger by comparing the collected physiological signals and behavioral information with the preset emotional state judgment rules. For example, some rules included in the emotional state rule base may be: Rule 1: If the passenger's heart rate is 20% higher than the normal value, the passenger may be in a state of tension or anxiety. Rule 2: If the passenger is monitored to smile and the voice tone is rising, the passenger may be in a happy state. Rule 3: If the passenger's eyebrows are monitored to be depressed and the voice tone is falling, the passenger may be in an angry and frustrated state. Assuming that the passenger's current emotional state is determined to meet Rules 1 and 3 after comparing the collected physiological signals and behavioral information with the preset emotional state judgment rules, it can be judged that the passenger's current emotional state is a negative emotional state.
[0039] In another illustrated embodiment, the current emotional state of the passenger can be identified by an emotion recognition model based on the collected physiological signals and behavioral information. Specifically, the collected physiological signals and behavioral information can be preprocessed, and then key features can be extracted from the preprocessed data, and the emotion recognition model can be used to identify the emotional state from the key features. For example, first, the collected physiological signals and behavioral information can be cleaned to remove outliers and noise. Then, specific extraction strategies can be used to extract key features for different types of physiological signals and behavioral information. For example, for heart rate signals, time domain features, frequency features, and nonlinear features of heart rate signals can be extracted; for skin electrical activity signals, skin conductance levels and skin conductance responses in skin electrical activity signals can be extracted. Finally, the emotion recognition model can be used to identify the emotional state from the key features. The type of emotion recognition model can be a machine learning model or a deep learning model, such as a support vector machine, a random forest, a convolutional neural network, a recurrent neural network, etc. Of course, the recognition results of multiple different models can also be fused, for example, the recognition results of multiple models can be fused using an ensemble learning method.
[0040] In one illustrated embodiment, an emotion recognition model can be deployed locally in the vehicle, the collected physiological signals and behavioral information can be input into the emotion recognition model, and the current emotional state output by the emotion recognition model can be obtained. In this embodiment, by deploying the emotion recognition model locally in the vehicle, first, low-latency data processing and emotion recognition can be achieved, ensuring that the vehicle system can respond to the emotional changes of passengers in a timely manner and immediately adjust the vehicle cabin environment. Second, since sensitive data such as physiological signals and behavioral information are processed locally without uploading to an external server, the privacy and security of data processing can be improved, and the risk of data leakage can be reduced. Third, the emotion recognition model can be customized according to the specific needs of passengers in the vehicle, and the local emotion recognition model can be continuously optimized based on the feedback results of the passengers to make it more in line with the behavioral characteristics of the passengers.
[0041] In another illustrated embodiment, the emotion recognition model can be deployed on a server, and the vehicle can upload the collected physiological signals and behavioral information to the server, and receive the current emotional state output by the emotion recognition model sent by the server. In this embodiment, by deploying the emotion recognition model on the server, on the one hand, the server can provide more powerful computing resources to support more complex models and algorithms. On the other hand, the emotion recognition model can be updated only on the server to achieve rapid deployment of the model.
[0042] In another illustrated embodiment, emotion recognition models may be deployed on the server and locally in the vehicle, respectively. When it is determined that the communication signal between the vehicle and the server is good, the collected physiological signals and behavioral information are uploaded to the server, and the current emotional state output by the emotion recognition model sent by the server is received. When it is determined that the communication signal between the vehicle and the server is poor, the collected physiological signals and behavioral information are input into the locally deployed emotion recognition model, and the current emotional state output by the emotion recognition model is obtained. In this embodiment, the locally deployed model or the server-deployed model is dynamically selected according to the communication conditions. When the communication is good, the emotion recognition model deployed on the server can use its powerful computing power to improve the accuracy of emotion recognition. In the case of poor communication, the emotion recognition model deployed locally in the vehicle can also respond quickly to changes in the emotional state of the passenger.
[0043] Physiological signals and behavioral information can reveal an individual's health status, emotional state, and behavior patterns, and the leakage of this information may lead to the violation of passengers' personal privacy. For example, leaked physiological data may be used by insurance companies or employers to improperly evaluate individuals, leading to discriminatory treatment. For example, third parties may use or sell this data without authorization for improper commercial or research purposes.
[0044] In an illustrated embodiment, when uploading physiological signals and behavioral information to a server, in order to ensure that the physiological signals and behavioral information are not leaked during transmission, the physiological signals and behavioral information may be uploaded to the server after being encrypted. For example, an encryption protocol (such as TLS / SSL) may be used to protect the confidentiality of the data and prevent it from being intercepted or tampered with during transmission. For example, when processing physiological signals and behavioral information, it may be separated from personal identity information, and anonymization or identification may be used to protect passenger privacy.
[0045] Since affective states themselves can also reveal sensitive information about passengers’ moods and psychological states, which may be used to infer passengers’ health status and behavior patterns, unencrypted affective states may also be stolen and used for improper purposes.
[0046] Therefore, in another illustrated embodiment, a state ciphertext sent by a server may be received, the current emotional state may be encrypted in the state ciphertext, and the state ciphertext may be decrypted using a specific key to obtain the current emotional state. In this embodiment, by protecting the privacy of the emotional state data, the emotional state data may be effectively prevented from being leaked.
[0047] Of course, the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this manual are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.
[0048] In an illustrated embodiment, after adjusting the cabin environment, the vehicle may respond to the passenger's feedback information regarding the adjusted cabin environment, and update the parameters of the emotion recognition model based on the feedback information. The emotion recognition model may be an emotion recognition model deployed locally in the vehicle or on a server. Specifically, the vehicle obtains passenger feedback information on the adjusted cabin environment through questionnaires, voice commands, and the like. Based on the passenger's feedback information, the performance of the current emotion recognition model may be evaluated. If the feedback information indicates that the model fails to accurately identify the passenger's emotional state or does not respond well to the adjusted cabin environment, the model's parameters may be updated through some learning mechanism (such as online learning or incremental learning). Over time, by continuously collecting feedback and updating model parameters, the emotion recognition model can become more accurate in identifying the passenger's emotions.
[0049] Step 103: When the current emotional state satisfies an adjustment condition, adjust the environmental parameters of the vehicle cabin so that the adjusted cabin environment matches the current emotional state.
[0050] In an illustrated embodiment, the environmental parameters of the vehicle cabin that can be adjusted include temperature control parameters, lighting control parameters, music playback parameters, seat adjustment parameters, and multimedia setting parameters. A configuration file of the correspondence between emotional states and environmental parameters of the vehicle cabin can be stored locally in the vehicle. For example, the environmental parameters of the vehicle cabin corresponding to the anxiety state can be different environmental parameters such as adjusting the cabin temperature to a preset temperature, playing soothing music, and dimming the lighting to a preset brightness. When the vehicle system detects that the passenger is in an anxious state, the environmental parameters of the vehicle cabin can be adjusted to indicate lowering the cabin temperature, playing soothing music, and dimming the lighting environment of the cabin.
[0051] When the passenger has no emotional fluctuations, it indicates that the passenger is relatively calm at this time, and there is no need to adjust the vehicle cabin environment to improve the passenger's emotional state. Therefore, in an embodiment shown, an adjustment condition can be set on the vehicle, and the environmental parameters of the vehicle cabin are adjusted when the current emotional state meets the adjustment condition. For example, the vehicle can trigger the cabin environment adjustment function only when it detects that the passenger's emotional fluctuations are large, thereby avoiding frequent or unnecessary environmental changes and improving the user experience.
[0052] Specifically, the emotional state can be divided into a positive emotional state, a neutral emotional state, and a negative emotional state. When the determined emotional state is a positive emotional state or a negative emotional state, the parameters of the cabin environment can be adjusted according to the emotional state. If the determined emotional state is a neutral state, the vehicle cabin environment may not be adjusted. It can be seen that this scheme does not set corresponding vehicle cabin environment adjustment strategies for all emotional states. After identifying that the passenger's emotional state belongs to a neutral emotional state, no processing may be performed to avoid disturbing the passenger's calm state of mind and avoiding unnecessary emotional changes. Among them, the positive emotional state, the neutral emotional state, and the negative emotional state can be represented by a numerical range. For example, (0,1) represents the emotional state of the passenger. The closer the value is to 0, the more negative the passenger's emotional state is, and the closer the value is to 1, the more positive the passenger's emotional state is. If the value is between [0.3, 0.6], it can indicate that the passenger's emotional state is a neutral emotional state; if the value is between (0, 0.3), it can indicate that the passenger's emotional state is a negative emotional state; if the value is between (0.6, 1), it can indicate that the passenger's emotional state is a positive emotional state.
[0053] In an illustrated embodiment, after adjusting the environmental parameters of the vehicle cabin, the collection of physiological signals and behavioral information of passengers in the vehicle cabin can be suspended, and when the collection condition is triggered, the collection of physiological signals and behavioral information of passengers in the vehicle cabin can be resumed. Specifically, the vehicle can continuously collect the physiological signals and behavioral information of passengers. When the vehicle detects that the emotional state of the passenger meets the adjustment condition, it starts to automatically adjust the environmental parameters of the vehicle cabin. After adjusting the cabin environmental parameters, the collection of the physiological signals and behavioral information of the passenger can be suspended, that is, the physiological data of the passenger will not be continuously monitored. When the collection condition is triggered, the collection of physiological signals and behavioral information of passengers in the vehicle cabin is resumed. The collection condition can be a preset time interval, for example, the collection condition is triggered after the preset time interval of adjusting the environmental parameters of the vehicle cabin, and the collection of physiological signals and behavioral information of passengers in the vehicle cabin is resumed. In this embodiment, by pausing and resuming signal collection when necessary, the vehicle can manage resources more efficiently and focus on collecting data at critical moments, thereby reducing unnecessary resource loss.
[0054] In one illustrated embodiment, Figure 2As shown, the vehicle may be equipped with a heart rate acquisition device 211, a micro-expression acquisition device 212, and a skin electricity acquisition device 213, etc., for collecting physiological signals and behavioral information of passengers in the vehicle cabin. The collected physiological signals and behavioral information are sent to the central processing unit 22, and the current emotional state of the passenger is determined by the emotion recognition model. When the current emotional state meets the adjustment conditions, the environmental parameters corresponding to the current emotional state are sent to the environmental control unit 23, so that the environmental control unit 23 can control the working process of the cabin control modules such as the temperature control module 241, the music control module 242, and the seat control module 243 according to the environmental control parameters.
[0055] In one illustrated embodiment, Figure 3 As shown, Figure 3 FIG. 3 is a flowchart of another method for controlling a vehicle cabin environment according to an exemplary embodiment of the present specification, comprising steps 301-305:
[0056] Step 301: Collect physiological signals and behavioral information of passengers in the vehicle cabin.
[0057] Step 302: Determine whether the collected physiological signals and behavioral information of the passengers in the vehicle cabin meet the usage conditions. If yes, execute step 303; otherwise, end this solution.
[0058] Step 303: Determine the current emotional state of the passenger based on the collected physiological signals and behavioral information.
[0059] Step 304: If the current emotional state meets the adjustment conditions, execute step 305; otherwise, end this solution.
[0060] Step 305: Adjust the environmental parameters of the vehicle cabin so that the adjusted cabin environment matches the current emotional state.
[0061] Corresponding to the embodiments of the aforementioned method, this specification also provides embodiments of a device and a terminal to which it is applied.
[0062] like Figure 4 As shown, Figure 4It is a structural diagram of an electronic device shown in this specification according to an exemplary embodiment. At the hardware level, the device includes a processor 402, an internal bus 404, a network interface 406, a memory 408 and a non-volatile memory 410, and of course may also include hardware required for other services. One or more embodiments of this specification can be implemented based on software, such as the processor 402 reading the corresponding computer program from the non-volatile memory 410 into the memory 408 and then running it. Of course, in addition to the software implementation, one or more embodiments of this specification do not exclude other implementation methods, such as logic devices or a combination of software and hardware, etc., that is to say, the execution subject of the following processing flow is not limited to each logic module, but can also be hardware or logic devices.
[0063] like Figure 5 As shown, Figure 5 is a block diagram of a vehicle cabin environment control device according to an exemplary embodiment of the present specification. The device can be applied to Figure 4 In the electronic device 400 shown, the technical solution of this specification is implemented. The device includes:
[0064] The collection module 502 is used to collect physiological signals and behavioral information of passengers in the vehicle cabin;
[0065] an emotional state determination module 506, for determining the current emotional state of the passenger based on the physiological signal and the behavioral information;
[0066] The adjustment module 510 is used to adjust the environmental parameters of the vehicle cabin when the current emotional state meets the adjustment conditions, so that the adjusted cabin environment matches the current emotional state.
[0067] Optionally, the device further comprises a data feature extraction module 504 for extracting data features of the physiological signal and the behavioral information, and determining the current emotional state of the passenger based on the physiological signal and the behavioral information when the data features match the usage conditions.
[0068] Optionally, the current emotional state is one of a positive emotional state, a neutral emotional state and a negative emotional state, and the current emotional state satisfies an adjustment condition, including: the current emotional state is a positive emotional state or a negative emotional state.
[0069] Optionally, the emotional state determination module 506 is specifically configured to identify the current emotional state of the passenger through an emotion recognition model based on the physiological signal and the behavioral information.
[0070] Optionally, the emotion state determination module 506 is specifically used to input the physiological signal and the behavior information into the emotion recognition model and obtain the current emotion state output by the emotion recognition model when the emotion recognition model is deployed locally in the vehicle; or, when the emotion recognition model is deployed on a server, upload the physiological signal and the behavior information to the server and receive the current emotion state output by the emotion recognition model sent by the server.
[0071] Optionally, the emotional state determination module 506 is specifically used to upload the encrypted physiological signals and behavioral information to the server; and / or, receive the state ciphertext sent by the server, and use a specific key to decrypt the state ciphertext to obtain the current emotional state.
[0072] Optionally, the device further comprises a parameter updating module 512 for responding to feedback information from the passenger regarding the adjusted cabin environment and updating parameters of the emotion recognition model based on the feedback information.
[0073] Optionally, the device also includes a collection time control module 508, which is used to suspend the collection of physiological signals and behavioral information of passengers in the vehicle cabin after adjusting the environmental parameters of the vehicle cabin; and resume the collection of physiological signals and behavioral information of passengers in the vehicle cabin when the collection conditions are triggered.
[0074] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, which will not be repeated here.
[0075] For the device embodiment, since it basically corresponds to the method embodiment, the relevant parts can refer to the partial description of the method embodiment. The device embodiment described above is only schematic, wherein the modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this specification. Ordinary technicians in this field can understand and implement it without paying creative work.
[0076] The present specification also provides a computer-readable storage medium having a computer program stored thereon, and when the program is executed by a processor, the steps of any of the aforementioned vehicle cabin environment control methods provided in the present application are implemented.
[0077] Specifically, computer-readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including, for example, semiconductor memory devices (such as EPROM, EEPROM and flash memory devices), magnetic disks (such as internal hard disks or removable disks), magneto-optical disks, and CD ROM and DVD-ROM disks.
Claims
1. A method for controlling a vehicle cabin environment, characterized in that: The method comprises: Collect physiological signals and behavioral information of passengers in the vehicle cabin; determining a current emotional state of the passenger based on the physiological signal and the behavioral information; When the current emotional state satisfies an adjustment condition, the environmental parameters of the vehicle cabin are adjusted so that the adjusted cabin environment matches the current emotional state.
2. The method according to claim 1, characterized in that The method further comprises: extracting data features of the physiological signal and the behavioral information; The determining the current emotional state of the passenger based on the physiological signal and the behavioral information includes: determining the current emotional state of the passenger based on the physiological signal and the behavioral information when the data feature matches the usage condition.
3. The method according to claim 1, characterized in that The current emotional state is one of a positive emotional state, a neutral emotional state and a negative emotional state, and the current emotional state satisfies an adjustment condition, including: The current emotional state is a positive emotional state or a negative emotional state.
4. The method according to claim 1, characterized in that: The determining the current emotional state of the passenger based on the physiological signal and the behavioral information comprises: Based on the physiological signal and the behavioral information, the current emotional state of the passenger is identified through an emotion recognition model.
5. The method according to claim 4, characterized in that The identifying the current emotional state of the passenger by using an emotion recognition model comprises: In the case where the emotion recognition model is deployed locally in the vehicle, the physiological signal and the behavior information are input into the emotion recognition model, and a current emotion state output by the emotion recognition model is obtained; or, When the emotion recognition model is deployed on a server, the physiological signal and the behavior information are uploaded to the server, and the current emotion state output by the emotion recognition model sent by the server is received.
6. The method according to claim 5, characterized in that The uploading of the physiological signal and the behavior information to the server includes: uploading the encrypted physiological signal and behavior information to the server; and / or, The receiving the current emotional state output by the emotion recognition model sent by the server includes: receiving a state ciphertext sent by the server, and using a specific key to decrypt the state ciphertext to obtain the current emotional state.
7. The method according to any one of claims 4 to 6, characterized in that: Also includes: In response to feedback information from the passenger regarding the adjusted cabin environment, parameters of the emotion recognition model are updated based on the feedback information.
8. The method according to claim 1, characterized in that The method further comprises: After adjusting the environmental parameters of the vehicle cabin, suspending the collection of physiological signals and behavioral information of passengers in the vehicle cabin; When the collection condition is triggered, the collection of physiological signals and behavior information of passengers in the vehicle cabin is resumed.
9. A vehicle cabin environment control device, characterized in that: The device comprises: A collection module, used to collect physiological signals and behavioral information of passengers in the vehicle cabin; an emotional state determination module, configured to determine the current emotional state of the passenger based on the physiological signal and the behavioral information; The adjustment module is used to adjust the environmental parameters of the vehicle cabin when the current emotional state meets the adjustment conditions, so that the adjusted cabin environment matches the current emotional state.
10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the steps of the method according to any one of claims 1 to 8 are implemented.
11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.
Citation Information
Cited By
Vehicle cab control method and device and storage medium
CN120840346A
