Vehicle cabin environment control method and device and computer program product

Abstract

The invention discloses a vehicle cabin environment control method and device and a computer program product, and the method comprises the steps: carrying out the recognition of the identity of a user at a non-driver position in a vehicle cabin, and the eye state of the user; according to the identified user identity, acquiring physiological data collected by the intelligent wearable device; judging the sleep state of the user according to the recognized eye state of the user and the acquired physiological data; and according to the sleep state of the user, switching the vehicle cabin to a sleep environment. By combining the physiological data and eye movement analysis of the user, accurate recognition and intelligent response to the sleep demand of the user are realized. The user can automatically switch to the sleep environment when the user needs to sleep only by performing initial account association setting. According to the invention, on the premise of not increasing any extra hardware cost, the accuracy of sleep state identification is obviously improved.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent connected vehicles, and in particular to a vehicle cabin environment control method, device and computer program product. Background Art

[0002] With the development of intelligent automobile technology, providing passengers with a comfortable riding experience has become the key. Currently, the rear-seat sleeping environment control in the cabin is mainly activated manually or by voice by the front-seat passengers, and the system adjusts the in-car environment accordingly, such as lowering the volume and adjusting the air conditioning.

[0003] However, this solution has obvious flaws: first, the user needs to actively operate, or ignore it due to fatigue or ignorance of the function, or do not activate it because they do not want to disturb the front passenger, resulting in the function being idle. Second, it is difficult for the front passenger to accurately perceive the sleep needs of the rear passengers, and in the absence of effective communication, it is difficult to activate the sleep mode in time.

[0004] More importantly, the existing solutions lack intelligence in judging the sleeping state of passengers. Once the sleep mode is turned on, environmental parameters such as air conditioning temperature and wind speed are fixed and cannot be dynamically adjusted according to the actual sleeping state of the passengers. This may cause passengers to wake up during sleep due to environmental discomfort, affecting their sleep quality.

[0005] It is particularly noteworthy that the existing technology mainly relies on the user's active operation to judge the sleep state, and lacks the ability to make intelligent judgments through data fusion. This not only limits the accuracy of the judgment, but also affects the timeliness and effectiveness of environmental control. Summary of the invention

[0006] The technical problem to be solved by the embodiments of the present invention is to provide a vehicle cabin environment control method, device and computer program product to significantly improve the judgment accuracy and realize intelligent control of the vehicle interior environment without increasing additional costs.

[0007] In order to solve the above technical problems, the present invention provides a vehicle cabin environment control method, comprising the following steps:

[0008] Identify the identity and eye status of users in non-driver seats in the vehicle cabin;

[0009] According to the identified user identity, the physiological data collected by the user's smart wearable device is obtained;

[0010] Determining the sleep state of the user according to the identified eye state of the user and the acquired physiological data;

[0011] The vehicle cabin is switched to a sleeping environment according to the sleeping state of the user.

[0012] Preferably, judging the sleep state of the user according to the identified eye state of the user and the acquired physiological data specifically includes:

[0013] When the physiological data and eye status meet the following conditions at the same time, it is determined that the user has entered the sleep state:

[0014] The body surface temperature drops below a preset first threshold;

[0015] The heart rate drops below a preset second threshold;

[0016] The heart rate variability exceeds a preset third threshold;

[0017] The eye closure duration exceeds a preset fourth threshold.

[0018] Preferably, judging the sleep state of the user according to the identified eye state of the user and the acquired physiological data specifically includes:

[0019] Extract the changing trend of heart rate, the stability of heart rate variability, and the rate of decrease of body surface temperature from physiological data as physiological characteristic quantities;

[0020] Extracting the eye closing duration and eye closing frequency from the eye closing duration data as eye closing duration feature quantities;

[0021] Using a machine learning algorithm or a statistical method to fuse the physiological feature quantity, the physiological data feature, and the eye closure duration feature quantity;

[0022] The fused data is input into the pre-trained sleep state judgment model to output the user's sleep state.

[0023] Preferably, switching the vehicle cabin to a sleeping environment according to the sleeping state of the user specifically includes:

[0024] When it is determined that the user has entered a sleep state, switching the vehicle cabin to a sleep environment includes at least automatically raising the air-conditioning temperature or lowering the air-conditioning speed, as well as lowering the volume in the cabin, closing the sunroof and windows, and adjusting the seat angle, any one or any combination thereof.

[0025] Preferably, when determining that the user has entered the sleeping state, the method further includes:

[0026] Prompt the user to switch the vehicle cabin to a sleeping environment through a pop-up window on the armrest screen or voice assistant;

[0027] After the user responds with consent, the vehicle cabin is switched to a sleeping environment.

[0028] Preferably, the identifying of the identity of the user in the non-driver's seat in the vehicle cabin and the eye state thereof specifically includes:

[0029] The OMS collects the face of the person in the front passenger seat or the rear seat area and compares it with the pre-registered user face ID to obtain the corresponding user identity;

[0030] The user's eye state is identified through the occupant monitoring system OMS to obtain the user's eye closing time data.

[0031] Preferably, the step of obtaining physiological data collected by the smart wearable device of the user according to the identified user identity specifically includes:

[0032] According to the identified user identity, the physiological data collected by the user's smart wearable device and synchronized to the cloud server is obtained from the cloud server.

[0033] The present invention also provides a vehicle cabin environment control device, comprising:

[0034] An identification module, used to identify the identity and eye status of a user in a non-driver's seat in a vehicle cabin;

[0035] An acquisition module is used to acquire physiological data collected by the smart wearable device of the user according to the identified user identity;

[0036] A determination module, configured to determine the sleep state of the user according to the identified eye state of the user and the acquired physiological data;

[0037] A control module is used to switch the vehicle cabin to a sleeping environment according to the sleeping state of the user.

[0038] The present invention also provides a vehicle cabin environment control device, comprising:

[0039] one or more processors;

[0040] Memory;

[0041] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to execute the vehicle cabin environment control method.

[0042] The present invention also provides a computer program product, comprising computer instructions, wherein the computer instructions instruct a computer device to execute operations corresponding to the method.

[0043] The implementation of the present invention has the following beneficial effects: The present invention realizes accurate identification and intelligent response to the user's sleep needs by combining the user's physiological data with eye movement analysis. The user only needs to make initial account association settings to automatically switch to the sleep environment when he needs to sleep. Without adding any additional hardware costs, the present invention significantly improves the accuracy of sleep state recognition, and provides users with an intelligent and comfortable rest solution while driving, allowing users to fully pay attention to and improve their sleep quality while enjoying convenient travel, thereby contributing to the realization of a healthy life. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0045] Figure 1 It is a flow chart of a vehicle cabin environment control method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0046] The following descriptions of the embodiments refer to the accompanying drawings to illustrate specific embodiments in which the present invention may be implemented.

[0047] Please refer to Figure 1 As shown, a first embodiment of the present invention provides a vehicle cabin environment control method, comprising the following steps:

[0048] Identify the identity and eye status of users in non-driver seats in the vehicle cabin;

[0049] According to the identified user identity, the physiological data collected by the user's smart wearable device is obtained;

[0050] Determining the sleep state of the user according to the identified eye state of the user and the acquired physiological data;

[0051] The vehicle cabin is switched to a sleeping environment according to the sleeping state of the user.

[0052] Through the above steps, it can be seen that the embodiment of the present invention obtains the data of the third-party smart wearable device and the in-vehicle sensor data, and judges the user's sleep state after a certain fusion, which can improve the accuracy of judgment without increasing the cost, realize the intelligent control of the vehicle cabin environment, and provide a more humane and comfortable riding experience.

[0053] Specifically, in an embodiment of the present invention, the user completes the registration and binding of the vehicle account and FaceID (Face ID) in advance, and binds the personal smart wearable device to FaceID. Specifically, the user first creates an account on the vehicle's vehicle system and completes the FaceID registration. FaceID performs identity authentication by capturing and analyzing the user's facial features. At the same time, the user also needs to bind his or her smart wearable device (such as a smart watch, bracelet, etc.) to FaceID. In this way, the vehicle can identify the user through FaceID and establish contact with the user's smart wearable device.

[0054] The user's smart wearable device records physiological data reflecting the user's physical condition and physiological state in real time, including body surface temperature, heart rate, heart rate variability (HRV), etc. The smart wearable device synchronizes these physiological data to the vehicle's cloud server through wireless networks (such as Bluetooth, Wi-Fi, etc.). In this way, the vehicle or the cloud can obtain the user's physiological data at any time to provide data support for subsequent cabin environment control.

[0055] When a user enters the car cabin and sits down in a non-driving seat (such as the front passenger seat or the back seat), the seat sensor will sense the presence of a heavy object, which means that the user has taken a seat. At the same time, the OMS (Occupant Monitoring System) in the car will start, and perform facial recognition on the seat area through a camera or other sensors. The OMS compares the collected face with the previously registered FaceID to identify the user currently sitting in the seat.

[0056] Once the recognition is successful, the vehicle can combine the user's physiological data obtained from the cloud to provide more personalized services or control the cabin environment. It is understandable that when a person usually goes from a wakeful state to a sleep state, the aforementioned two physiological data, body surface temperature and heart rate, will show a downward trend, while the heart rate variability will show an increasing trend. The heart rate drops because the body's metabolism slows down during sleep, and the heart does not need to beat as fast as when awake; the body surface temperature drops because the body reduces heat dissipation during sleep in order to conserve energy; the heart rate variability increases because in the sleep state, the parasympathetic nerve activity is enhanced, making the changes in the heart rhythm more complex and regular.

[0057] In addition to physiological data, the embodiment of the present invention also uses the OMS in the car to monitor the user's eye closing time. If the user's eye closing time exceeds a certain threshold within a certain period of time (for example, closing the eyes for several minutes in a row), and the body surface temperature and heart rate show a downward trend, and the heart rate variability shows an upward trend, it will be determined that the user may have entered a sleep state.

[0058] Specifically, when integrating the physiological data and eye state of the user, the embodiment of the present invention can set corresponding thresholds as judgment conditions. When the physiological data and the eye closure time data simultaneously meet their respective judgment conditions, it is determined that the user has entered the sleep state. These judgment conditions are, for example:

[0059] (1) The body surface temperature drops below a preset first threshold;

[0060] (2) the heart rate drops below a preset second threshold;

[0061] (3) heart rate variability exceeds a preset third threshold;

[0062] (4) The eye closure duration exceeds a preset fourth threshold.

[0063] It is understandable that the setting of the above thresholds needs to be flexibly adjusted according to actual data and user needs. A large number of users' physiological data and eye status data can be collected, and the most appropriate threshold can be determined through statistical analysis. As an example, in an embodiment of the present invention, the first threshold can be preset to 36°C, the second threshold can be preset to 60 times / minute, the third threshold can be preset to 100ms, and the fourth threshold can be preset to 3 minutes.

[0064] In addition to the above threshold comparison method, the data fusion of the embodiment of the present invention can also be performed by feature extraction and construction of a judgment model, which is specifically described below:

[0065] First, extract physiological characteristics from physiological data, such as the trend of heart rate change, the stability of heart rate variability, the rate of decrease of body surface temperature, etc.; extract eye closure duration characteristics such as eye closure duration and eye closure frequency from eye closure duration data. Then, use machine learning algorithms (such as neural networks, decision trees, etc.) or statistical methods (such as weighted average, linear regression, etc.) to fuse physiological data characteristics and eye closure duration characteristics. When fusion, the weights of different characteristics can also be considered to reflect their importance in sleep state judgment. Input the fused data into the pre-trained sleep state judgment model, and finally output the user's sleep state, such as awake, light sleep, deep sleep, etc. The sleep state judgment model can be rule-based, statistical, or machine learning-based. When training the model, user data with known sleep states can be used as a training set, and the accuracy of judgment can be improved by iteratively optimizing model parameters. From the perspective of optimizing existing hardware resources, a data fusion algorithm with low computational complexity but good effect can be selected, for example, a simple statistical method (such as weighted average) or a linear model can be selected.

[0066] Once it is determined that the user has fallen asleep, the car's interior environment will be automatically switched to a sleeping environment, such as raising the air-conditioning temperature or lowering the air-conditioning speed, to prevent the user from catching a cold while sleeping.

[0067] The vehicle continuously obtains the user's physiological data, especially heart rate and body surface temperature, from the cloud server. When these data drop to a certain level, it is considered that the user may have entered a deeper sleep stage from light sleep. The light sleep stage usually lasts 20-25 minutes. At this time, the user's heart rate and body surface temperature drop, but the amplitude is relatively small. When the user enters a deeper sleep stage, the heart rate and body surface temperature will drop further to a lower level. The user's sleep depth is judged by monitoring these changes, and the in-car environment is adjusted accordingly to provide more comfortable sleeping conditions. As an example, when the user's heart rate drops by more than 10bp and the body temperature drops by more than 1°C, the user is deemed to have entered a deep sleep state.

[0068] It should be noted that third-party smart wearable devices (such as smart watches, smart bracelets, etc.) usually judge the sleep state by monitoring the user's physiological indicators. These devices detect whether the watch or bracelet remains relatively still, and monitor the numerical changes of physiological data such as heart rate and body temperature. When the device detects that the user remains still for a long time, and the values ​​of indicators such as heart rate and body temperature decrease, it will be judged that the user may have entered a sleep state. However, in a riding scenario (such as the user is in the car), due to factors such as bumpy roads and vehicle turns, the built-in gyroscope or gravity acceleration sensor of the watch or bracelet may mistakenly think that the user is in a dynamic state, resulting in a misjudgment. Therefore, the present invention does not directly rely on these sensors to judge the user's sleep state, but adopts a comprehensive judgment method: integrating the physiological data of third-party smart wearable devices with the in-vehicle sensor data. By monitoring the user's eye movements, such as the length of time the eyes are closed, the frequency of blinking, etc., the user's sleep state can be judged more directly - because when the user enters the sleep state, their eye movements usually change significantly. Combined with the user's physiological data collected by the third-party smart wearable device for comprehensive judgment, it can more accurately reflect the user's sleep state and avoid the misjudgment that may be caused by a single data source. In addition, the embodiment of the present invention does not increase additional hardware costs. It uses existing third-party smart wearable devices and in-vehicle sensors to obtain data, and integrates and judges through algorithms, which not only makes full use of existing resources, but also improves the accuracy of judgment.

[0069] In addition to automatically switching the vehicle cabin to the sleeping environment according to the user's sleeping state, the embodiment of the present invention also prompts the user whether to switch the vehicle cabin to the sleeping environment through a pop-up window on the armrest screen and a voice assistant. The user can reply with voice to agree or click the pop-up window on the armrest screen to agree. After the user agrees, the cabin switches to the sleeping environment and automatically adjusts the air conditioning temperature or wind speed according to the user's sleeping state.

[0070] Corresponding to the vehicle cabin environment control method described in the first embodiment of the present invention, the second embodiment of the present invention further provides a vehicle cabin environment control device, including:

[0071] An identification module, used to identify the identity and eye status of a user in a non-driver's seat in a vehicle cabin;

[0072] An acquisition module is used to acquire physiological data collected by the smart wearable device of the user according to the identified user identity;

[0073] A determination module, configured to determine the sleep state of the user according to the identified eye state of the user and the acquired physiological data;

[0074] A control module is used to switch the vehicle cabin to a sleeping environment according to the sleeping state of the user.

[0075] Corresponding to the vehicle cabin environment control method described in the first embodiment of the present invention, the third embodiment of the present invention further provides a vehicle cabin environment control device, including:

[0076] one or more processors;

[0077] Memory;

[0078] One or more applications, wherein the one or more applications are stored in the memory and are configured to be executed by the one or more processors, and the one or more applications are configured to execute the vehicle cabin environment control method described in the aforementioned embodiment 1 of the present invention.

[0079] Corresponding to the vehicle cabin environment control method described in the aforementioned embodiment 1 of the present invention, embodiment 4 of the present invention also provides a computer program product, including computer instructions, and the computer instructions instruct a computer device to perform operations corresponding to the vehicle cabin environment control method described in the aforementioned embodiment 1 of the present invention.

[0080] Preferably, the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor, or the processor may be any conventional processor. The processor is the control center of the device, and various parts of the device are connected using various interfaces and lines.

[0081] The memory mainly includes a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function, etc., and the data storage area can store related data, etc. In addition, the memory can be a high-speed random access memory, or a non-volatile memory, such as a plug-in hard disk, a smart memory card (SmartMedia Card, SMC), a secure digital (Secure Digital, SD) card, and a flash card (Flash Card), etc., or the memory can also be other volatile solid-state storage devices.

[0082] It should be noted that the above-mentioned device may include but is not limited to a processor and a memory, which can be understood by those skilled in the art.

[0083] For the working principle and process of the above embodiment, please refer to the description of the above embodiment of the present invention, which will not be repeated here.

[0084] It can be seen from the above description that compared with the prior art, the beneficial effect of the present invention is that the present invention realizes accurate identification and intelligent response to the user's sleep needs by combining the user's physiological data with eye movement analysis. The user only needs to make the initial account association settings to automatically switch to the sleep environment when he needs to sleep. Without adding any additional hardware costs, the present invention significantly improves the accuracy of sleep state recognition, and provides users with an intelligent and comfortable rest solution while driving, allowing users to fully pay attention to and improve their sleep quality while enjoying convenient travel, thereby contributing to the realization of a healthy life.

[0085] The above disclosure is only the preferred embodiment of the present invention, which certainly cannot be used to limit the scope of the present invention. Therefore, equivalent changes made according to the claims of the present invention are still within the scope of the present invention.

Claims

1. A vehicle cabin environment control method, characterized in that: The following steps are involved: Identify the identity and eye status of users in non-driver seats in the vehicle cabin; According to the identified user identity, the physiological data collected by the user's smart wearable device is obtained; Determining the sleep state of the user according to the identified eye state of the user and the acquired physiological data; The vehicle cabin is switched to a sleeping environment according to the sleeping state of the user.

2. The method according to claim 1, characterized in that The step of determining the sleep state of the user according to the identified eye state of the user and the acquired physiological data specifically includes: When the physiological data and eye status meet the following conditions at the same time, it is determined that the user has entered the sleep state: The body surface temperature drops below a preset first threshold; The heart rate drops below a preset second threshold; The heart rate variability exceeds a preset third threshold; The eye closure duration exceeds a preset fourth threshold.

3. The method according to claim 1, characterized in that The step of determining the sleep state of the user according to the identified eye state of the user and the acquired physiological data specifically includes: Extract the changing trend of heart rate, the stability of heart rate variability, and the rate of decrease of body surface temperature from physiological data as physiological characteristic quantities; Extracting the eye closing duration and eye closing frequency from the eye closing duration data as eye closing duration feature quantities; Using a machine learning algorithm or a statistical method to fuse the physiological feature quantity, the physiological data feature, and the eye closure duration feature quantity; The fused data is input into the pre-trained sleep state judgment model to output the user's sleep state.

4. The method according to claim 1, characterized in that The step of switching the vehicle cabin to a sleeping environment according to the sleeping state of the user specifically includes: When it is determined that the user has entered a sleep state, switching the vehicle cabin to a sleep environment includes at least automatically raising the air-conditioning temperature or lowering the air-conditioning speed, as well as lowering the volume in the cabin, closing the sunroof and windows, and adjusting the seat angle, any one or any combination thereof.

5. The method according to claim 1, characterized in that When determining that the user has entered the sleep state, it also includes: Prompt the user to switch the vehicle cabin to a sleeping environment through a pop-up window on the armrest screen or voice assistant; After the user responds with consent, the vehicle cabin is switched to a sleeping environment.

6. The method according to claim 1, characterized in that The identifying of the identity of the user in the non-driver's seat in the vehicle cabin and the eye state thereof specifically includes: The OMS collects the face of the person in the front passenger seat or the rear seat area and compares it with the pre-registered user face ID to obtain the corresponding user identity; The user's eye state is identified through the occupant monitoring system OMS to obtain the user's eye closing time data.

7. The method according to claim 6, characterized in that The step of obtaining the physiological data collected by the smart wearable device of the user according to the identified user identity specifically includes: According to the identified user identity, the physiological data collected by the user's smart wearable device and synchronized to the cloud server is obtained from the cloud server.

8. A vehicle cabin environment control device, characterized in that: include: An identification module, used to identify the identity and eye status of a user in a non-driver's seat in a vehicle cabin; An acquisition module is used to acquire physiological data collected by the smart wearable device of the user according to the identified user identity; A determination module, configured to determine the sleep state of the user according to the identified eye state of the user and the acquired physiological data; A control module is used to switch the vehicle cabin to a sleeping environment according to the sleeping state of the user.

9. A vehicle cabin environment control device, characterized in that: include: one or more processors; Memory; One or more applications, wherein the one or more applications are stored in the memory and are configured to be executed by the one or more processors, and the one or more applications are configured to execute the vehicle cabin environment control method according to any one of claims 1 to 7.

10. A computer program product, characterized in that The method comprises computer instructions, wherein the computer instructions instruct a computer device to execute operations corresponding to the method according to any one of claims 1 to 7.

Images