Vehicle control method, device, vehicle, storage medium and program product

Abstract

The present disclosure relates to a vehicle control method and device, a vehicle, a storage medium and a program product, and relates to the technical field of intelligent cockpit. The vehicle control method comprises: in response to a breathing mode trigger of a vehicle, determining breathing information, the breathing information being used to represent a breathing condition of a user in the vehicle; and controlling a target device of the vehicle according to the breathing information. The technical solution can realize intelligent control of the vehicle device in the breathing mode of the vehicle, thereby improving the user experience.

Description

Technical Field

[0001] This disclosure relates to the field of intelligent cockpit technology, and in particular to vehicle control methods, devices, vehicles, storage media, and program products. Background Technology

[0002] With the development of vehicle technology, smart cockpit technology has also evolved. The smart cockpit aims to integrate various internet and artificial intelligence technologies to create a brand-new integrated digital platform within the vehicle, providing drivers with an intelligent experience. Summary of the Invention

[0003] To overcome the problems existing in the related technologies, this disclosure provides a vehicle control method, device, vehicle, storage medium, and program product.

[0004] According to a first aspect of the present disclosure, a vehicle control method is provided, comprising: determining breathing information in response to a breathing pattern triggering of a vehicle, the breathing information being used to characterize the breathing status of a user inside the vehicle; and controlling a target device of the vehicle based on the breathing information.

[0005] Optionally, the target device includes a display device, and controlling the target device of the vehicle based on the breathing information includes: controlling the display device based on the breathing information.

[0006] Optionally, controlling the display device based on the breathing information includes: controlling the display device to display one or more of the following: breathing waveform, breathing rate, breathing depth, and breathing state, based on the breathing information.

[0007] Optionally, the respiratory information includes a respiratory waveform, respiratory frequencies corresponding to multiple times, respiratory depths corresponding to multiple times, and respiratory states corresponding to multiple times. The step of controlling the display device to display one or more of the respiratory waveform, respiratory frequency, respiratory depth, and respiratory state based on the respiratory information includes: determining respiratory frequency distribution information based on the respiratory frequencies corresponding to the multiple times; determining respiratory depth distribution information based on the respiratory depths corresponding to the multiple times; determining respiratory state distribution information based on the respiratory states corresponding to the multiple times; and controlling the display device to display the respiratory waveform, the respiratory frequency distribution information, the respiratory depth distribution information, and the respiratory state distribution information.

[0008] Optionally, the target device includes an ambient light, and controlling the target device of the vehicle based on the breathing information includes controlling the lighting effect of the ambient light based on the breathing information.

[0009] Optionally, the breathing information includes breathing frequency, breathing state, and breathing depth. Controlling the lighting effect of the ambient light based on the breathing information includes: controlling the brightness of the ambient light based on the breathing frequency; and / or controlling the color of the ambient light based on the breathing state; and / or controlling the softness of the ambient light based on the breathing depth.

[0010] Optionally, the target device includes an air conditioner, and controlling the target device of the vehicle based on the breathing information includes controlling the operating status of the air conditioner based on the breathing information.

[0011] Optionally, controlling the operating status of the air conditioner based on the breathing information includes: controlling the temperature and / or operating mode of the air conditioner based on the breathing information.

[0012] Optionally, the breathing mode is a meditation mode, and the breathing information includes real-time breathing information and historical breathing information. The step of controlling the operating status of the air conditioner based on the breathing information includes: determining the real-time meditation depth based on the real-time breathing information; determining the change in meditation depth based on the real-time breathing information and the historical breathing information; and controlling the temperature and / or operating mode of the air conditioner based on the real-time meditation depth and the change in meditation depth.

[0013] Optionally, the target device includes a seat, and controlling the target device of the vehicle based on the breathing information includes controlling the state of the seat based on the breathing information.

[0014] Optionally, the breathing mode is a meditation mode, and the breathing information includes real-time breathing information and historical breathing information. The step of controlling the state of the seat based on the breathing information includes: determining the real-time meditation depth based on the real-time breathing information; determining the change in meditation depth based on the real-time breathing information and the historical breathing information; and controlling the state of the seat based on the real-time meditation depth and the change in meditation depth.

[0015] Optionally, controlling the state of the seat based on the real-time meditation depth and the amount of change in meditation depth includes: controlling the massage mode of the seat when the real-time meditation depth is lower than a preset meditation depth and / or the amount of change in meditation depth is lower than a preset amount of change in meditation depth.

[0016] Optionally, the vehicle control method further includes controlling the state of the vehicle's seats in response to a breathing pattern triggering the vehicle.

[0017] Optionally, the target device includes an audio playback device, and controlling the target device of the vehicle based on the breathing information includes: controlling the playback of the audio playback device based on the breathing information.

[0018] Optionally, the breathing information includes breathing depth and breathing frequency, and the step of controlling the playback of the audio playback device based on the breathing information includes: determining the audio to be played based on the breathing frequency; determining the audio playback parameters corresponding to the audio to be played based on the breathing depth; and controlling the playback of the audio playback device based on the audio to be played and the audio playback parameters.

[0019] Optionally, the target device includes an aromatherapy device, and controlling the target device of the vehicle based on the breathing information includes controlling the aromatherapy effect of the aromatherapy device based on the breathing information.

[0020] Optionally, the breathing information includes breathing frequency and breathing depth, and controlling the aromatherapy effect of the aromatherapy device based on the breathing information includes: controlling the aromatherapy frequency of the aromatherapy device based on the breathing frequency; and / or controlling the aromatherapy concentration and / or aromatherapy scent of the aromatherapy device based on the breathing depth.

[0021] Optionally, determining the breathing information in response to a vehicle's breathing pattern trigger includes: acquiring a target acoustic signal with breathing signal characteristics in response to a vehicle's breathing pattern trigger; and determining the breathing information based on the target acoustic signal.

[0022] Optionally, the vehicle includes a sound wave emitting device and a sound wave receiving device, and the acquisition of the target sound wave signal with respiratory signal characteristics includes: emitting a first sound wave signal in the vehicle through the sound wave emitting device and receiving a second sound wave signal in the vehicle through the sound wave receiving device; and determining the target sound wave signal with respiratory signal characteristics based on the first sound wave signal and the second sound wave signal.

[0023] Optionally, determining the target acoustic signal with respiratory signal characteristics based on the first acoustic signal and the second acoustic signal includes: performing channel estimation based on the first acoustic signal and the second acoustic signal to obtain the difference acoustic signal between the first acoustic signal and the second acoustic signal; and determining the target acoustic signal with respiratory signal characteristics based on the difference acoustic signal.

[0024] Optionally, determining the breathing information based on the target acoustic signal includes: determining the phase change direction of the target acoustic signal in the complex plane; determining the breathing state, which is either an exhalation state or an inhalation state, based on the phase change direction; and determining the breathing information based on the breathing state and the target acoustic signal.

[0025] Optionally, the number of target acoustic signals is multiple, and determining the breathing state based on the phase change direction includes: determining the breathing state corresponding to each of the multiple target acoustic signals based on the phase change direction corresponding to each of the multiple target acoustic signals; and determining the final breathing state based on the breathing state corresponding to each of the multiple target acoustic signals.

[0026] Optionally, determining the breathing information based on the breathing state and the target sound wave signal includes: adjusting the waveforms of the multiple target sound wave signals according to the breathing states corresponding to the multiple target sound wave signals respectively, to obtain multiple adjusted sound wave signals, wherein the phase change direction and amplitude change law of each adjusted sound wave signal are matched with the breathing state corresponding to each adjusted sound wave signal; determining the breathing waveform based on the multiple adjusted sound wave signals; and determining the breathing information based on the breathing state and the breathing waveform.

[0027] Optionally, determining the breathing waveform based on the plurality of adjusted acoustic signals includes: aligning the phases of the plurality of adjusted acoustic signals in a complex plane to obtain a plurality of aligned acoustic signals; superimposing the plurality of aligned acoustic signals to obtain a superimposed complex signal; and projecting the superimposed complex signal to obtain the breathing waveform.

[0028] Optionally, projecting the superimposed complex signal to obtain the respiratory waveform includes: determining the amplitude change information and phase change information of the superimposed complex signal; projecting the superimposed complex signal according to the amplitude change information and the phase change information to obtain the respiratory waveform, wherein the respiratory waveform is a waveform represented by amplitude or a waveform represented by phase.

[0029] Optionally, determining the breathing information based on the breathing state and the breathing waveform includes: determining the user's breathing depth and breathing rate based on the breathing waveform; and determining the breathing waveform, the breathing state, the breathing depth, and the breathing rate as the breathing information.

[0030] According to a second aspect of the present disclosure, a vehicle control device is provided, comprising: a determining module configured to determine breathing information in response to a breathing pattern triggering of a vehicle, the breathing information being used to characterize the breathing status of a user inside the vehicle; and a control module configured to control a target device of the vehicle based on the breathing information.

[0031] According to a third aspect of the present disclosure, a vehicle is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to execute the executable instructions to implement the vehicle control method as described in the first aspect of the present disclosure.

[0032] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided having computer program instructions stored thereon that, when executed by a processor, implement the vehicle control method as described in the first aspect of the present disclosure.

[0033] According to a fifth aspect of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the vehicle control method as described in the first aspect of the present disclosure.

[0034] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects: When a vehicle triggers a breathing mode, breathing information representing the user's breathing pattern is determined. Based on this breathing information, target devices within the vehicle are controlled, enabling intelligent device control based on breathing information. This allows the operation of target devices to adapt to the user's breathing patterns, improving the user experience. Therefore, this technical solution can achieve intelligent control of vehicle devices in a breathing mode, thereby enhancing the user experience.

[0035] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0036] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0037] Figure 1 This is a flowchart illustrating a vehicle control method according to an exemplary embodiment.

[0038] Figure 2 This is a schematic diagram of the display interface of a vehicle infotainment display screen according to an exemplary embodiment.

[0039] Figure 3A This is an example diagram illustrating an exhalation waveform according to an exemplary embodiment.

[0040] Figure 3B This is an example diagram illustrating an inhalation waveform according to an exemplary embodiment.

[0041] Figure 4 This is a flowchart illustrating a vehicle control application according to an exemplary embodiment.

[0042] Figure 5 This is a block diagram of a vehicle control device according to an exemplary embodiment.

[0043] Figure 6 This is a block diagram illustrating a vehicle according to an exemplary embodiment. Detailed Implementation

[0044] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0045] It should be noted that all actions involving the acquisition of signals, information, or data in this disclosure are carried out in compliance with the relevant data protection laws and policies of the country where the location is situated, and with authorization from the owner of the relevant device.

[0046] With the development of vehicle technology, smart cockpit technology has also evolved. The smart cockpit aims to integrate various internet and artificial intelligence technologies to create a brand-new integrated digital platform within the vehicle, providing drivers with an intelligent experience.

[0047] In related smart cockpit technologies, various vehicle devices can be controlled based on user-triggered requests. However, the intelligence of this control method is relatively poor, resulting in a subpar user experience.

[0048] Based on this, the present disclosure provides a technical solution that, when a vehicle triggers a breathing mode, determines breathing information that characterizes the user's breathing status, controls the target device of the vehicle based on the breathing information, realizes intelligent device control based on breathing information, and enables the operation of the target device to adapt to the user's breathing status, thereby improving the user experience.

[0049] Therefore, this technical solution can achieve intelligent control of vehicle equipment in the vehicle's breathing mode, thereby improving the user experience.

[0050] Regarding the breathing mode, it could be a mode that controls the device based on the user's breathing. When this mode is triggered, the vehicle can intelligently control its equipment based on the user's breathing.

[0051] As an example, breathing mode could be a special vehicle control mode. Once activated, the user doesn't need to actively control the vehicle; it can autonomously adjust its controls based on the user's breathing patterns to enhance the user experience. Alternatively, users could indirectly achieve intelligent vehicle control and improve the user experience through different breathing patterns.

[0052] As an example, breathing patterns can be meditation patterns. Meditation, which helps relax the mind and body and improve concentration by focusing on breathing and thinking, has gained increasing attention. Meditation patterns can provide users with breathing exercises and relaxation guidance to help them better relax and concentrate, thereby relieving stress and calming emotions.

[0053] The technical solution of this disclosure embodiment can provide meditation services to users through a vehicle. Furthermore, the vehicle's equipment can be intelligently controlled based on the user's breathing patterns during meditation.

[0054] Therefore, in the vehicle's meditation mode, this technical solution can not only achieve intelligent control of vehicle equipment, but also enhance the user's meditation experience.

[0055] In the application scenario of smart cockpits, users may have a need for meditation. Therefore, a meditation system can be integrated into the smart cockpit. Through this meditation system, users can be assisted in meditation when they have a need for it, thereby providing users with a more intelligent experience.

[0056] It is understood that the breathing mode can be adapted to more scenarios besides the two examples mentioned above, but will not be listed one by one in this disclosure.

[0057] Figure 1 This is a flowchart illustrating a vehicle control method according to an exemplary embodiment, which can be applied to a vehicle, such as... Figure 1 As shown, the vehicle control method includes the following steps: Step S11: In response to the vehicle's breathing pattern trigger, determine breathing information, which is used to characterize the breathing status of the user inside the vehicle.

[0058] Step S12: Control the target equipment of the vehicle based on the breathing information.

[0059] In step S11, the user can initiate a breathing mode activation request through the vehicle's voice assistant, thereby triggering the vehicle's breathing mode. For example, the user issues a voice command to the vehicle's voice assistant, taking the breathing mode as meditation mode as an example. The voice command could be: "XX, I need to meditate"; "XX, please help me meditate," etc. Here, XX can be the name of the vehicle's voice assistant.

[0060] In some embodiments, after the breathing mode is triggered, the vehicle can control the entertainment system to play music corresponding to the breathing mode. The vehicle can also control the interior lighting to adjust to a state suitable for the breathing mode. Furthermore, the vehicle can adjust the interior air conditioning temperature, mode, etc., to a state suitable for the breathing mode. Additionally, the vehicle can also adjust the seat mode, angle, etc., to a state suitable for the breathing mode.

[0061] As an example, the vehicle's seat status can be controlled in response to a breathing pattern trigger. For example, the seat angle can be adjusted to its maximum, or the seat massage function can be activated.

[0062] In some embodiments, after the breathing mode is triggered, preset content can be displayed on the vehicle's infotainment screen. Taking the breathing mode as a meditation mode as an example, information guiding the user to meditate can be displayed on the vehicle's infotainment screen, etc., without limitation.

[0063] In some embodiments, taking the breathing mode as a meditation mode as an example, the vehicle can also control the entertainment system to play content to guide the user in meditation, such as audio, video, etc.

[0064] After the breathing mode is triggered, breathing information that characterizes the breathing status of the user inside the vehicle can be determined. The user inside the vehicle can be either the driver or a passenger.

[0065] In some embodiments, step S11 may include: in response to a breathing pattern triggering of the vehicle, acquiring a target acoustic signal with breathing signal characteristics; and determining breathing information based on the target acoustic signal.

[0066] In this implementation, since the target acoustic signal has respiratory signal characteristics, real-time and accurate detection of respiratory information can be achieved based on the target acoustic signal.

[0067] In some embodiments, the vehicle can acquire target acoustic signals with respiratory signal characteristics in real time. Accordingly, the determined respiratory information will change according to the user's breathing pattern, rather than being fixed.

[0068] In some embodiments, the vehicle may include a sound wave emitting device and a sound wave receiving device, through which the target sound wave signal can be acquired.

[0069] In some embodiments, the acoustic emitting device may include at least one loudspeaker that can play an ultrasonic signal modulated with a specific baseband signal.

[0070] In some embodiments, the sound wave receiving device may include at least one microphone that can receive ultrasonic signals and modulate a specific baseband signal transmitted by a speaker.

[0071] Therefore, the target sound wave signal can be determined based on the sound wave signal emitted by the sound wave emitting device and the sound wave signal received by the sound wave receiving device.

[0072] Therefore, as an optional implementation, acquiring a target acoustic signal with respiratory signal characteristics includes: transmitting a first acoustic signal inside a vehicle via an acoustic wave transmitting device and receiving a second acoustic signal inside a vehicle via an acoustic wave receiving device; and determining the target acoustic signal with respiratory signal characteristics based on the first acoustic signal and the second acoustic signal.

[0073] In this implementation, the first acoustic signal can be an ultrasonic signal modulated with a specific baseband signal, and the second acoustic signal can be a mediated specific baseband signal. For specific implementations of the baseband signal, ultrasonic signal, signal modulation, and signal modulation, please refer to mature technologies in the field.

[0074] Regarding ultrasound signals, they are inaudible to the human ear and their signal changes are affected by a person's breathing.

[0075] Therefore, in addition to ultrasound signals, the first sound wave signal can also be a signal that is inaudible to other people's ears and whose signal changes due to the influence of a person's breathing.

[0076] In this way, breath detection can avoid affecting the user's breathing, thus improving the user experience.

[0077] In some embodiments, determining a target acoustic signal with respiratory signal characteristics based on a first acoustic signal and a second acoustic signal includes: performing channel estimation based on the first acoustic signal and the second acoustic signal to obtain a difference acoustic signal between the first acoustic signal and the second acoustic signal; and determining the target acoustic signal with respiratory signal characteristics based on the difference acoustic signal.

[0078] It can be understood that the first sound wave signal is the original sound wave signal emitted by the sound wave transmitting device, and the second sound wave signal is the sound wave signal received by the sound wave receiving device, which may be affected by human breathing. Therefore, channel estimation is performed on the first and second sound wave signals to obtain the differential sound wave signal, which may include the target sound wave signal with respiratory signal characteristics.

[0079] In some embodiments, channel estimation can employ autocorrelation methods, least squares methods, etc. For details, please refer to mature technologies in this field, which will not be described in detail here.

[0080] In some embodiments, based on the differential acoustic signal, it can be determined whether an acoustic signal with preset respiratory signal characteristics is included. If it is included, the corresponding acoustic signal is determined as the target acoustic signal.

[0081] In some embodiments, the number of acoustic signals having preset respiratory signal characteristics may be one or more.

[0082] In some embodiments, the preset respiratory signal characteristics may include periodicity characteristics and frequency characteristics. For example, if the frequency of a sound wave signal falls within a preset frequency range and the sound wave signal is a periodic waveform, then the sound wave signal is determined to be a target sound wave signal with respiratory signal characteristics.

[0083] In some embodiments, when determining respiratory signal characteristics, methods such as autocorrelation and spectral analysis can be combined to determine the respiratory signal characteristics. For details, please refer to the mature technologies in this field, which will not be described in detail here.

[0084] In some embodiments, determining a target acoustic signal with respiratory signal characteristics can also be understood as extracting the target acoustic signal with respiratory signal characteristics from the differential acoustic signal and performing further analysis.

[0085] In some embodiments, if no target acoustic signal with respiratory signal characteristics is extracted, the detection of acoustic signals with respiratory signal characteristics can continue. That is, the detection of target acoustic signals is an ongoing process.

[0086] In some embodiments, respiratory information may include, but is not limited to, respiratory state, respiratory waveform, respiratory rate, and respiratory depth.

[0087] For these four types of information, we can first determine the respiratory status, then determine the respiratory waveform, and finally determine the respiratory rate and respiratory depth.

[0088] Therefore, as an optional implementation, determining respiratory information based on the target acoustic signal includes: determining the phase change direction of the target acoustic signal in the complex plane; determining the respiratory state, which is either an exhalation state or an inhalation state, based on the phase change direction; and determining respiratory information based on the respiratory state and the target acoustic signal.

[0089] In some embodiments, in conjunction with the aforementioned methods of acquiring acoustic signals, the target acoustic signal can be a signal in the complex plane. Therefore, the direction of phase change of the target acoustic signal in the complex plane can be directly determined.

[0090] In some embodiments, if the phase change direction is a counterclockwise rotation in the complex plane, representing a gradual increase in phase, the breathing state can be determined as an inspiratory state. If the phase change direction is a clockwise rotation in the complex plane, representing a gradual decrease in phase, the breathing state can be determined as an expiratory state.

[0091] In some embodiments, when there are multiple target acoustic signals, the respiratory state can be determined by combining multiple target acoustic signals.

[0092] Therefore, as an optional implementation, determining the breathing state based on the phase change direction includes: determining the breathing state corresponding to each of the multiple target sound wave signals based on the phase change direction corresponding to each of the multiple target sound wave signals; and determining the final breathing state based on the breathing state corresponding to each of the multiple target sound wave signals.

[0093] In this implementation, each of the multiple target acoustic signals corresponds to a phase change direction. Therefore, the breathing state corresponding to each of the multiple target acoustic signals can be determined based on the phase change direction corresponding to each of the multiple target acoustic signals.

[0094] Furthermore, it is possible to determine the frequency of exhalation and inhalation in the respiratory states corresponding to multiple target sound wave signals, and the state with the higher frequency of occurrence is determined as the final respiratory state.

[0095] In some embodiments, the target acoustic signal may be in the form of a carrier wave, and correspondingly, multiple target acoustic signals may be regarded as multiple alternative carrier waves.

[0096] In some embodiments, if the frequency of exhalation and inhalation is the same, the target sound wave signal with a larger phase change can be determined from multiple target sound wave signals, and the breathing state corresponding to the target sound wave signal can be determined as the final breathing state.

[0097] It is understandable that, in addition to the above-mentioned integration method of respiratory state, other integration methods can also be used, and no limitation will be made here.

[0098] This implementation method allows for the combination of respiratory states from multiple alternative carrier waves to determine a more accurate respiratory state, thereby improving the accuracy of respiratory detection.

[0099] Furthermore, after determining the respiratory state, the respiratory information can be determined by combining the respiratory state with the target sound wave signal. The respiratory state can be used to adjust the waveform of the sound wave signal.

[0100] Therefore, as an optional implementation, determining respiratory information based on respiratory state and target sound wave signals includes: adjusting the waveforms of multiple target sound wave signals according to the respiratory states corresponding to each of the multiple target sound wave signals to obtain multiple adjusted sound wave signals, wherein the phase change direction and amplitude change law of each adjusted sound wave signal are matched with the respiratory state corresponding to each adjusted sound wave signal; determining the respiratory waveform based on the multiple adjusted sound wave signals; and determining respiratory information based on the respiratory state and respiratory waveform.

[0101] In this implementation, the waveforms of each target sound wave signal are adjusted according to the breathing state corresponding to each target sound wave signal, so that the phase change direction and amplitude change law of each adjusted sound wave signal match the breathing state corresponding to each adjusted sound wave signal. That is, the phase change direction and amplitude change law of the adjusted sound wave signals are consistent and match the corresponding breathing state.

[0102] For example, from a human perspective, during inhalation, the chest cavity expands, the distance between the chest cavity and the sound wave transmitter gradually decreases, and the perceived carrier amplitude gradually decreases. During exhalation, the chest cavity contracts, the distance between the chest cavity and the sound wave transmitter gradually increases, and the perceived carrier amplitude gradually increases.

[0103] Therefore, if the target sound wave signal corresponds to an inhalation state, but the amplitude changes gradually, it needs to be adjusted to gradually decrease. If the target sound wave signal corresponds to an exhalation state, but the amplitude changes gradually, it needs to be adjusted to gradually increase.

[0104] Furthermore, the respiratory waveform can be obtained from the adjusted sound wave signal. Therefore, respiratory information can be determined based on the respiratory state and the respiratory waveform.

[0105] In some embodiments, determining a respiratory waveform based on multiple adjusted acoustic signals includes: aligning the multiple adjusted acoustic signals in a complex plane to obtain multiple aligned acoustic signals; superimposing the multiple aligned acoustic signals to obtain a superimposed complex signal; and projecting the superimposed complex signal to obtain a respiratory waveform.

[0106] In this implementation, the multiple adjusted acoustic signals still exist in the complex plane. Therefore, the multiple adjusted acoustic signals can be phase aligned in the complex plane first, and then superimposed to obtain a superimposed complex signal. Furthermore, by projecting the complex signal onto a two-dimensional plane, a breathing waveform can be obtained.

[0107] In this implementation method, phase alignment can keep the phases of multiple adjusted acoustic signals consistent, and the superposition operation can enhance the signal, thereby improving the quality of the final respiratory waveform.

[0108] In some embodiments, projecting the superimposed complex signals can be understood as converting the complex signals into a visualized breathing waveform.

[0109] As an optional implementation, the superimposed complex signal is projected to obtain a respiratory waveform, including: determining the amplitude change information and phase change information of the superimposed complex signal; and projecting the superimposed complex signal according to the amplitude change information and the phase change direction information to obtain a respiratory waveform, wherein the respiratory waveform is a waveform represented by amplitude or a waveform represented by phase.

[0110] In some embodiments, amplitude change information may include the magnitude of amplitude change, and phase change information may include the magnitude and direction of phase change.

[0111] In some embodiments, the final respiratory waveform representation can be determined based on amplitude change information and phase change information.

[0112] For example, by comparing the magnitudes of amplitude and phase changes, if the amplitude change is greater, the respiratory waveform is represented by amplitude. Thus, the superimposed complex signal can be projected as a respiratory waveform represented by amplitude. If the phase change is greater, the respiratory waveform is represented by phase. Thus, the superimposed complex signal can be projected as a respiratory waveform represented by phase.

[0113] Furthermore, when multiple phase change directions are involved, the superimposed complex signal can be projected onto the phase change direction with the largest phase change magnitude to obtain the respiratory waveform.

[0114] Furthermore, respiratory waveforms can characterize the changes in amplitude over time, or the changes in phase over time.

[0115] Furthermore, after obtaining the respiratory waveform, the respiratory depth and respiratory rate can be determined by combining the respiratory waveform.

[0116] Therefore, as an optional implementation, determining respiratory information based on respiratory state and respiratory waveform includes: determining the user's respiratory depth and respiratory rate based on the respiratory waveform; and determining the respiratory waveform, respiratory state, respiratory depth, and respiratory rate as respiratory information.

[0117] In some embodiments, the breathing depth can be determined by the difference between the peaks and troughs in the breathing waveform, and the breathing depth can be a relative depth value.

[0118] Therefore, determining respiratory depth may include: identifying peaks and troughs in the respiratory waveform, determining the difference between the most recent peak and trough as the maximum respiratory depth; determining the difference between the amplitude of the real-time waveform and the peak or trough; and using the ratio of the difference to the maximum value as the current relative respiratory depth.

[0119] It is understood that the breathing waveform in this embodiment is a continuous waveform that changes over time. Therefore, it involves multiple moments. By integrating the continuous breathing waveforms from previous moments, the peaks and troughs can be determined.

[0120] In some embodiments, determining the respiratory rate may include: calculating the autocorrelation of the respiratory waveform, calculating the respiratory cycle based on the peaks and troughs of the autocorrelation, and using the reciprocal of the respiratory cycle as the respiratory rate.

[0121] In this implementation, the respiratory cycle can be determined by autocorrelation, and thus the respiratory rate can be determined.

[0122] Furthermore, respiratory waveforms, respiratory status, respiratory depth, and respiratory rate can be integrated into respiratory information.

[0123] In some embodiments, the respiratory state may involve respiratory states corresponding to multiple moments, the respiratory depth may involve respiratory depths corresponding to multiple moments, and the respiratory rate may involve respiratory rates corresponding to multiple moments. The multiple moments may include the current moment and historical moments. Furthermore, the respiratory waveform may be a waveform that changes over time.

[0124] Furthermore, in step S12, the target equipment of the vehicle is controlled based on the breathing information.

[0125] In some embodiments, the target device may be a device that affects the user's breathing, and may involve a variety of smart devices in a smart cockpit scenario.

[0126] As an alternative implementation, the target device includes a display device, which may be a vehicle infotainment display screen.

[0127] Therefore, as an optional implementation, step S12 includes: controlling the display device based on the breathing information.

[0128] In some embodiments, display control of the display device based on respiratory information includes: controlling the display device to display one or more of respiratory waveform, respiratory rate, respiratory depth, and respiratory state based on the respiratory information.

[0129] As an optional implementation, when the respiratory information includes a respiratory waveform, respiratory frequencies corresponding to multiple times, respiratory depths corresponding to multiple times, and respiratory states corresponding to multiple times, the display device is controlled to display one or more of the respiratory waveform, respiratory frequency, respiratory depth, and respiratory state based on the respiratory information. This includes: determining respiratory frequency distribution information based on the respiratory frequencies corresponding to multiple times; determining respiratory depth distribution information based on the respiratory depths corresponding to multiple times; determining respiratory state distribution information based on the respiratory states corresponding to multiple times; and controlling the display device to display the respiratory waveform, respiratory frequency distribution information, respiratory depth distribution information, and respiratory state distribution information.

[0130] In this implementation, the display device can display the respiratory waveform. Additionally, it can display three types of distribution information.

[0131] In some embodiments, respiratory rate distribution information may include information characterizing the distribution of respiratory rate, such as the time of highest respiratory rate distribution, the time of lowest respiratory rate distribution, and the time of distribution of the highest frequency respiratory rate.

[0132] In some embodiments, respiratory depth distribution information may include information characterizing the distribution of respiratory depth, such as the time of highest respiratory depth distribution, the time of lowest respiratory depth distribution, and the time of distribution of the most frequent respiratory depth.

[0133] In some embodiments, respiratory state distribution information may include information characterizing the distribution of respiratory states, such as total number of breaths, total number of exhalations, and total number of inhalations.

[0134] In some embodiments, the display device can be controlled to display corresponding information. Furthermore, during visualization, the display device can be controlled to employ different visualization display formats.

[0135] For example, you can first define an area on the vehicle's infotainment display for displaying breathing information, and then divide that area into different display positions for different breathing information. The display can then show each type of breathing information in its corresponding position.

[0136] In some embodiments, the display area occupied by the breathing waveform may be larger than the display area occupied by other information.

[0137] In related technologies, taking meditation mode as an example, users cannot intuitively perceive their breathing. Furthermore, users can only try to align their breathing with the meditation rhythm according to a given frequency, rather than focusing effectively on their breathing. Additionally, the UI displays a fixed breathing frequency, resulting in poor visualization. Consequently, the user's meditation experience is subpar.

[0138] In this embodiment of the disclosure, breathing information can be visualized through a display device, allowing users to understand their breathing during meditation in a timely manner, thereby enabling them to adaptively adjust their breathing and improve the meditation effect.

[0139] Therefore, in the context of a smart cockpit, accurate and real-time detection of breathing information can be achieved, and the visualization of breathing information can enhance the user's meditation experience.

[0140] This implementation method ensures that the final breathing information presented to the user matches their actual breathing pattern. The user can adjust their breathing based on the visually displayed information. Subsequently, after adjustment, corresponding visual information matching the adjusted breathing pattern will be displayed.

[0141] Figure 2 This is a schematic diagram of a display interface for an in-vehicle infotainment display screen according to an exemplary embodiment, such as... Figure 2 As shown, the display interface is divided into four areas: a respiratory waveform display area, a total respiratory count display area, a respiratory depth distribution display area, and a respiratory rate distribution display area. Different respiratory information can be displayed in each of these different areas.

[0142] Figure 3A This is an example diagram illustrating an exhalation waveform according to an exemplary embodiment, such as... Figure 3A As shown, the user's exhalation state changes continuously over time.

[0143] Figure 3B This is an example diagram illustrating an inhalation waveform according to an exemplary embodiment, such as... Figure 3B As shown, the user's inhalation state changes continuously over time.

[0144] In addition, Figure 3A and Figure 3B In the waveform, the horizontal axis represents time, and the vertical axis can be either phase or amplitude, without any limitation.

[0145] In some embodiments, in addition to controlling the display device to display breathing information, the display device can also be controlled to display content that matches the user's breathing information.

[0146] For example, when breathing depth is low, it indicates that the user's meditation state is poor. In this case, content that can help the user improve breathing depth can be displayed on the display device, such as dynamic or static images with a certain meditation guidance effect.

[0147] In some embodiments, in addition to visualizing respiratory information, other intelligent devices in the vehicle can be controlled based on the respiratory information to achieve auxiliary intelligent applications in the intelligent cockpit scenario.

[0148] As an optional implementation, the target device includes an ambient light, and step S12 includes: controlling the lighting effect of the ambient light according to breathing information.

[0149] It's understandable that ambient lighting can have different effects on users depending on the lighting effect. Therefore, controlling the lighting effects based on breathing information can make the ambient lighting's operation adapt to the user's breathing pattern, improving the user experience, such as enhancing the user's meditation experience.

[0150] In some embodiments, the lighting effects of ambient lights may include: light brightness, light color, and light softness, etc., and different breathing information can correspond to different lighting effects.

[0151] In some embodiments, the brightness of the ambient light can be controlled according to the breathing frequency. For example, the lower the breathing frequency, the dimmer the light, so that changes in breathing frequency are reflected in changes in the brightness of the ambient light.

[0152] In some embodiments, the color of the ambient light can be controlled according to the breathing state.

[0153] For example, when the breathing state is exhalation, the ambient light is controlled to display one light color (e.g., white), and when the breathing state is inhalation, the ambient light is controlled to display another light color (e.g., yellow). Thus, changes in breathing state can be represented by changes in the ambient light color.

[0154] In some embodiments, the softness of the ambient light can be controlled according to the depth of breathing.

[0155] For example, the deeper the breathing depth, the softer the light. Thus, changes in breathing depth can be represented by variations in the softness of the ambient light.

[0156] It is understood that, in addition to the lighting effects mentioned above, more lighting effects may be involved; and different lighting effects may also be controlled by other different breathing information, such as breathing state, which may also be used to control the softness of the light. The above examples do not constitute a limitation on the embodiments of this disclosure.

[0157] As an optional implementation, the target device includes an air conditioner, and step S12 includes: controlling the operating status of the air conditioner based on breathing information.

[0158] In this implementation, breathing information can be used to control the operating status of the air conditioner. The operating status can involve one or more of the following: temperature and operating mode.

[0159] Operating modes, such as cooling mode, heating mode, air purification mode, humidification mode, etc. Temperature can be understood as the air conditioner's set temperature within the corresponding operating mode.

[0160] In some embodiments, respiratory information may include real-time respiratory information and historical respiratory information, that is, respiratory information at the current moment and respiratory information at a historical moment.

[0161] In some embodiments, the temperature and / or operating mode of the air conditioner can be controlled based on real-time breathing information. For example, if the user's breathing is rapid (rapid breathing rate), the air conditioner temperature can be lowered, or the air conditioner can be switched to cooling mode.

[0162] In some embodiments, when the breathing mode is meditation mode, controlling the temperature and / or operating mode of the air conditioner based on breathing information may include: determining the real-time meditation depth based on real-time breathing information; determining the amount of change in meditation depth based on real-time breathing information and historical breathing information; and controlling the temperature and / or operating mode of the air conditioner based on the real-time meditation depth and the amount of change in meditation depth.

[0163] In this implementation, breathing information can be used to assess the user's meditation depth. Thus, by combining real-time breathing information, the real-time meditation depth can be determined, and by combining real-time breathing information with historical breathing information, the amount of change in meditation depth can be determined.

[0164] In some embodiments, a meditation depth assessment model can be pre-trained, which may be a large language model. The training data for the assessment model may include sample breathing information and meditation depth labels. The model is trained using this training data, and the resulting pre-trained assessment model can assess meditation depth based on breathing information.

[0165] Therefore, this assessment model can determine the real-time meditation depth based on real-time breathing information, and the historical meditation depth based on historical breathing information. Furthermore, by combining the difference between the historical meditation depth and the real-time meditation depth, the amount of change in meditation depth can be determined.

[0166] For example, suppose the current time is t, and the historical times include t-1, t-2, and t-3. Then, the real-time meditation depth is the meditation depth determined based on the breathing information at time t. Determining the change in meditation depth can include: determining the meditation depth corresponding to the three times t-1, t-2, and t-3 respectively; then, determining the difference in meditation depth between two adjacent times; and finally, averaging the differences in meditation depth between adjacent times to obtain the change in meditation depth. Alternatively, the change in meditation depth can be obtained by subtracting the meditation depth at time t from the meditation depth at time t-1.

[0167] In some embodiments, the real-time meditation depth and the amount of change in meditation depth can determine how the air conditioning temperature is adjusted.

[0168] For example, if the real-time meditation depth is high (e.g., higher than the preset meditation depth) and / or the amount of change in meditation depth is large (e.g., greater than the preset amount of change in meditation depth), it is determined not to adjust the air conditioning temperature.

[0169] For example, if the real-time meditation depth is low (e.g., below the preset meditation depth) and / or the change in meditation depth is small (e.g., less than the preset meditation change), the air conditioning temperature will be adjusted. Specifically, the adjustment could be: if the current air conditioning temperature is high, lower the air conditioning temperature; if the current air conditioning temperature is low, raise the air conditioning temperature.

[0170] In some embodiments, the real-time meditation depth and the amount of change in meditation depth can determine how the operating mode is adjusted.

[0171] For example, if the real-time meditation depth is high (e.g., higher than the preset meditation depth) and / or the amount of change in meditation depth is large (e.g., greater than the preset amount of change in meditation depth), it is determined that the operating mode will not be adjusted.

[0172] For example, if the real-time meditation depth is low (e.g., below the preset meditation depth) and / or the change in meditation depth is small (e.g., less than the preset change in meditation depth), the operating mode is adjusted. The adjustment can be made by switching to an operating mode different from the current one.

[0173] Through the above implementation methods, breathing information can be combined to achieve intelligent control of the air conditioner's operating status, adapt to the user's breathing conditions, and improve the user experience, such as enhancing the user's meditation effect (experience).

[0174] As an optional implementation, the target device includes a seat, and step S12 includes: controlling the state of the seat based on breathing information.

[0175] In this implementation, the seat's state can be adjusted based on breathing information. The seat's state can involve its angle and operating mode, such as massage mode or non-massage mode.

[0176] In some embodiments, when the breathing mode is meditation mode, the state of the seat is controlled based on breathing information, including: determining the real-time meditation depth based on real-time breathing information; determining the change in meditation depth based on real-time breathing information and historical breathing information; and controlling the state of the seat based on the real-time meditation depth and the change in meditation depth.

[0177] In this implementation, the method for determining the real-time meditation depth and the amount of change in meditation depth can be referred to the aforementioned embodiments, and will not be repeated here.

[0178] In some embodiments, the real-time meditation depth and the amount of change in meditation depth can determine how the seat angle is adjusted.

[0179] For example, if the real-time meditation depth is high (e.g., higher than the preset meditation depth) and / or the amount of change in meditation depth is large (e.g., greater than the preset amount of change in meditation depth), it is determined not to adjust the seat angle.

[0180] For example, if the real-time meditation depth is low (e.g., below the preset meditation depth) and / or the change in meditation depth is small (e.g., less than the preset meditation change), the seat angle will be adjusted. The adjustment could specifically be to raise the seat angle.

[0181] In some embodiments, the real-time meditation depth and the amount of change in meditation depth can determine how the massage mode is adjusted.

[0182] As an example, when the real-time meditation depth is lower than the preset meditation depth, and / or the change in meditation depth is lower than the preset change in meditation depth, the massage mode of the chair can be controlled. Specific control methods could include increasing the massage intensity, for example, adding a back massage to the existing head massage.

[0183] As an example, in cases where the real-time meditation depth is high (e.g., higher than the preset meditation depth) and / or the amount of change in meditation depth is large (e.g., greater than the preset amount of change in meditation depth), it is determined that the massage mode will not be adjusted.

[0184] Through the above implementation methods, intelligent control of the seat status can be achieved by combining breathing information, adapting to the user's breathing situation, and improving the user experience, such as enhancing the user's meditation effect (experience).

[0185] In some embodiments, the target device includes an audio playback device, and step S12 may include: controlling the playback of the audio playback device based on breathing information.

[0186] In some embodiments, the audio playback device may be part of the vehicle's multimedia system to play different types of audio, such as music, radio dramas, etc.

[0187] In some embodiments, playing control of an audio playback device based on breathing information includes: determining the audio to be played based on breathing frequency; determining the audio playback parameters corresponding to the audio to be played based on breathing depth; and playing control of the audio playback device based on the audio to be played and the audio playback parameters.

[0188] Taking music as an example, breathing frequency can be used to determine the rhythm, melody, style, etc. of the music being played. Thus, changes in breathing frequency can be reflected in the effect of the played music. In some embodiments, different breathing frequencies can be pre-configured to correspond to different rhythms, melodies, and styles of the music; based on the current breathing frequency, the corresponding rhythm, melody, style, etc., can be determined.

[0189] Taking music as an example, breathing depth can be used to determine audio playback parameters. Audio playback parameters can include sound effects, sound quality, etc. Thus, changes in breathing depth can be represented by the effects of the played music. In some embodiments, different sound qualities and effects corresponding to different breathing depths can be pre-configured, and the corresponding sound qualities and effects can be determined based on the current breathing depth.

[0190] Through the above implementation methods, breathing information can be combined to achieve intelligent control of audio playback devices, adapt to the user's breathing situation, and improve the user experience, such as enhancing the user's meditation effect (experience).

[0191] In some embodiments, the target device includes an aromatherapy device, and step S12 may include: controlling the aromatherapy effect of the aromatherapy device based on breathing information.

[0192] In some embodiments, the aromatherapy frequency of the aromatherapy device can be controlled according to the breathing rate. Here, the aromatherapy frequency can be understood as the frequency at which the aromatherapy device releases aromatherapy substances; the higher the release frequency, the more obvious the aromatherapy effect.

[0193] In some embodiments, the aromatherapy frequency may be consistent with the breathing frequency, or the breathing frequency may be converted into a corresponding aromatherapy frequency.

[0194] In some embodiments, breathing depth can be used to determine aroma concentration and / or aroma odor.

[0195] As an example, the deeper the breath, the lower the concentration of aromatherapy, in order to reduce the impact on breathing.

[0196] As an example, the deeper the breath, the lighter the aromatherapy scent, in order to reduce its impact on breathing.

[0197] It is understood that the above-described control method for aromatherapy devices is merely an example and does not constitute a limitation on the embodiments disclosed herein.

[0198] Through the above implementation methods, the aromatherapy effect of the aromatherapy device can be intelligently controlled by combining breathing information, adapting to the user's breathing situation, and improving the user experience, such as enhancing the user's meditation effect (experience).

[0199] In some embodiments, the control of various target devices may include: generating corresponding control commands through the vehicle's controller, then synchronizing the control commands to the corresponding target devices, and the target devices executing the control commands. The specific generation and synchronization methods of the control commands can be found in mature smart cockpit technologies in the field, and will not be described in detail here.

[0200] It is understood that, in addition to the control of the aforementioned equipment, intelligent control of more vehicle equipment can also be involved. Furthermore, the specific methods of intelligent control can be flexibly configured to suit different application scenarios and do not constitute a limitation on the embodiments disclosed herein.

[0201] Figure 4 This is an application flowchart illustrating vehicle control according to an exemplary embodiment, such as... Figure 4 As shown, the application process includes: First, the user activates breathing mode. Then, the speaker plays an ultrasonic signal, and the microphone receives the ultrasonic signal. Based on the transmitted and received ultrasonic signals, channel estimation is performed to obtain channel state information (i.e., the aforementioned differential acoustic signal).

[0202] Next, the breathing state can be determined based on the channel state information. Furthermore, the breathing waveform can be extracted based on the breathing state.

[0203] Furthermore, based on the breathing waveform, the user's breathing depth and breathing rate can be detected.

[0204] Next, information such as respiratory waveforms, respiratory status, respiratory depth, and respiratory rate will be visualized. Furthermore, it can also be used for auxiliary intelligent applications, namely, intelligent control of various devices.

[0205] The technical solution of this disclosure allows users to obtain detailed information about their current breathing status in real time without wearing any devices, enabling them to adjust and guide their breathing, thereby helping them relax and concentrate, relieve stress, calm emotions, and improve user experience.

[0206] Figure 5 This is a block diagram illustrating a vehicle control device according to an exemplary embodiment. (Refer to...) Figure 5 The device includes: The determination module 501 is configured to determine breathing information in response to a breathing pattern trigger in the vehicle, the breathing information being used to characterize the breathing status of a user inside the vehicle. The control module 502 is configured to control the target device of the vehicle based on the breathing information.

[0207] Optionally, the target device includes a display device, and the control module 502 is further configured to: control the display device to display information based on the breathing information.

[0208] Optionally, the control module 502 is further configured to: control the display device to display one or more of the following: respiratory waveform, respiratory rate, respiratory depth, and respiratory status, based on the respiratory information.

[0209] Optionally, the control module 502 is further configured to: determine respiratory frequency distribution information based on the respiratory frequencies corresponding to the plurality of times; determine respiratory depth distribution information based on the respiratory depths corresponding to the plurality of times; determine respiratory state distribution information based on the respiratory states corresponding to the plurality of times; and control the display device to display the respiratory waveform, the respiratory frequency distribution information, the respiratory depth distribution information, and the respiratory state distribution information.

[0210] Optionally, the target device includes an ambient light, and the control module 502 is further configured to control the lighting effect of the ambient light based on the breathing information.

[0211] Optionally, the control module 502 is further configured to: control the brightness of the ambient light according to the breathing frequency; and / or control the color of the ambient light according to the breathing state; and / or control the softness of the ambient light according to the breathing depth.

[0212] Optionally, the target device includes an air conditioner, and the control module 502 is further configured to control the operating status of the air conditioner based on the breathing information.

[0213] Optionally, the control module 502 is also configured to control the temperature and / or operating mode of the air conditioner based on the breathing information.

[0214] Optionally, the breathing mode is a meditation mode, and the breathing information includes real-time breathing information and historical breathing information. The control module 502 is further configured to: determine the real-time meditation depth based on the real-time breathing information; determine the change in meditation depth based on the real-time breathing information and the historical breathing information; and control the temperature and / or operating mode of the air conditioner based on the real-time meditation depth and the change in meditation depth.

[0215] Optionally, the target device includes a seat, and the control module 502 is further configured to control the state of the seat based on the breathing information.

[0216] Optionally, the breathing mode is a meditation mode, and the control module 502 is further configured to: determine the real-time meditation depth based on the real-time breathing information; determine the change in meditation depth based on the real-time breathing information and the historical breathing information; and control the state of the seat based on the real-time meditation depth and the change in meditation depth.

[0217] Optionally, the control module 502 is further configured to control the massage mode of the seat when the real-time meditation depth is lower than the preset meditation depth and / or the amount of change in meditation depth is lower than the preset amount of change in meditation depth.

[0218] Optionally, the control module 502 is also configured to control the state of the vehicle's seats in response to a breathing pattern triggering the vehicle.

[0219] Optionally, the target device includes an audio playback device, and the control module 502 is further configured to: control the playback of the audio playback device based on the breathing information.

[0220] Optionally, the control module 502 is further configured to: determine the audio to be played based on the breathing frequency; determine the audio playback parameters corresponding to the audio to be played based on the breathing depth; and perform playback control on the audio playback device based on the audio to be played and the audio playback parameters.

[0221] Optionally, the target device includes an aromatherapy device, and the control module 502 is further configured to control the aromatherapy effect of the aromatherapy device based on the breathing information.

[0222] Optionally, the control module 502 is further configured to: control the aromatherapy frequency of the aromatherapy device according to the breathing frequency; and / or control the aromatherapy concentration and / or aromatherapy scent of the aromatherapy device according to the breathing depth.

[0223] Optionally, the determining module 501 is further configured to: in response to a breathing pattern trigger of the vehicle, acquire a target acoustic signal with breathing signal characteristics; and determine the breathing information based on the target acoustic signal.

[0224] Optionally, the determining module 501 is further configured to: transmit a first sound wave signal in the vehicle via the sound wave transmitting device, and receive a second sound wave signal in the vehicle via the sound wave receiving device; and determine a target sound wave signal with respiratory signal characteristics based on the first sound wave signal and the second sound wave signal.

[0225] Optionally, the determining module 501 is further configured to: perform channel estimation based on the first acoustic signal and the second acoustic signal to obtain a difference acoustic signal between the first acoustic signal and the second acoustic signal; and determine a target acoustic signal with respiratory signal characteristics based on the difference acoustic signal.

[0226] Optionally, the determining module 501 is further configured to: determine the phase change direction of the target acoustic signal in the complex plane; determine the breathing state, which is either an exhalation state or an inhalation state, based on the phase change direction; and determine the breathing information based on the breathing state and the target acoustic signal.

[0227] Optionally, the determining module 501 is further configured to: determine the breathing state corresponding to each of the multiple target sound wave signals based on the phase change direction corresponding to each of the multiple target sound wave signals; and determine the final breathing state based on the breathing state corresponding to each of the multiple target sound wave signals.

[0228] Optionally, the determining module 501 is further configured to: adjust the waveforms of the multiple target sound wave signals according to the breathing states corresponding to the multiple target sound wave signals respectively, to obtain multiple adjusted sound wave signals, wherein the phase change direction and amplitude change law of each adjusted sound wave signal are matched with the breathing state corresponding to each adjusted sound wave signal; determine the breathing waveform according to the multiple adjusted sound wave signals; and determine the breathing information according to the breathing state and the breathing waveform.

[0229] Optionally, the determining module 501 is further configured to: perform phase alignment of the plurality of adjusted acoustic signals in a complex plane to obtain a plurality of aligned acoustic signals; superimpose the plurality of aligned acoustic signals to obtain a superimposed complex signal; and project the superimposed complex signal to obtain the breathing waveform.

[0230] Optionally, the determining module 501 is further configured to: determine the amplitude change information and phase change information of the superimposed complex signal; and project the superimposed complex signal according to the amplitude change information and the phase change information to obtain the breathing waveform, wherein the breathing waveform is a waveform represented by amplitude or a waveform represented by phase.

[0231] Optionally, the determining module 501 is further configured to: determine the user's breathing depth and breathing rate based on the breathing waveform; and determine the breathing waveform, the breathing state, the breathing depth, and the breathing rate as the breathing information.

[0232] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0233] This disclosure also provides a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, implement the steps of the vehicle control method provided in this disclosure.

[0234] Figure 6 This is a block diagram illustrating a vehicle 600 according to an exemplary embodiment. For example, vehicle 600 can be a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicle. Vehicle 600 can be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle.

[0235] Reference Figure 6 The vehicle 600 may include various subsystems, such as an infotainment system 610, a perception system 620, a decision control system 630, a drive system 640, and a computing platform 650. The vehicle 600 may also include more or fewer subsystems, and each subsystem may include multiple components. Furthermore, each subsystem and each component of the vehicle 600 can be interconnected via wired or wireless means.

[0236] In some embodiments, the infotainment system 610 may include a communication system, an entertainment system, and a navigation system, etc.

[0237] The perception system 620 may include several sensors for sensing information about the environment surrounding the vehicle 600. For example, the perception system 620 may include a global positioning system (which may be GPS, BeiDou, or other positioning systems), an inertial measurement unit (IMU), lidar, millimeter-wave radar, ultrasonic radar, and a camera device.

[0238] The decision control system 630 may include a computing system, a vehicle controller, a steering system, a throttle, and a braking system.

[0239] The drive system 640 may include components that provide powered motion to the vehicle 600. In one embodiment, the drive system 640 may include an engine, an energy source, a transmission system, and wheels. The engine may be one or a combination of internal combustion engines, electric motors, and compressed air engines. The engine is capable of converting energy provided by the energy source into mechanical energy.

[0240] Some or all of the functions of vehicle 600 are controlled by computing platform 650. Computing platform 650 may include at least one processor 651 and memory 652, processor 651 can execute instructions 653 stored in memory 652.

[0241] Processor 651 can be any conventional processor, such as a commercially available CPU. Processors may also include graphics processing units (GPUs), field-programmable gate arrays (FPGAs), systems-on-chips (SoCs), application-specific integrated circuits (ASICs), or combinations thereof.

[0242] The memory 652 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0243] In addition to instruction 653, memory 652 can also store data, such as road maps, route information, vehicle position, direction, speed, and other data. The data stored in memory 652 can be used by computing platform 650.

[0244] In this embodiment of the disclosure, processor 651 may execute instructions 653 to complete all or part of the steps of the vehicle control method described above.

[0245] In another exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program executable by a programmable device, the computer program having a code portion for performing the vehicle control method described above when executed by the programmable device.

[0246] Those skilled in the art will also understand that the various illustrative logical blocks and steps listed in the embodiments of this application can be implemented by electronic hardware, computer software, or a combination of both. Whether such functionality is implemented through hardware or software depends on the specific application and the overall system design requirements. Those skilled in the art can implement the described functionality using various methods for each specific application, but such implementation should not be construed as exceeding the scope of protection of the embodiments of this application.

[0247] Furthermore, the term “exemplary” is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as advantageous compared to other aspects or designs. Rather, the use of the term “exemplary” is intended to present the concept in a concrete manner. As used herein, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless otherwise specified or clear from the context, “X applies A or B” is intended to mean any of the natural inclusive arrangements. That is, “X applies A or B” satisfies any of the foregoing instances if X applies A; X applies B; or both X applies A and B. Additionally, unless otherwise specified or clear from the context to refer to the singular form, the articles “a” and “an” as used in this application and the appended claims are generally understood to mean “one or more.”

[0248] Similarly, although this disclosure has been shown and described with respect to one or more implementations, equivalent variations and modifications will occur to those skilled in the art upon reading and understanding the specification and drawings. This disclosure includes all such modifications and variations and is limited only by the scope of the claims. In particular, with respect to the various functions performed by the components described above (e.g., elements, resources, etc.), unless otherwise indicated, the terminology used to describe such components is intended to correspond to any component (functionally equivalent) that performs the specific function of the described component, even if structurally not equivalent to the disclosed structure. Furthermore, although specific features of this disclosure may have been disclosed with respect to only one of several implementations, such features may be combined with one or more other features of other implementations, as may be desired and advantageous for any given or particular application. Moreover, with regard to the terms “comprising,” “owning,” “having,” “having,” or variations thereof as used in the detailed description or claims, such terms are intended to be inclusive in a manner similar to the term “including.”

[0249] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.

[0250] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A vehicle control method, characterized in that, include: In response to a breathing pattern trigger in the vehicle, breathing information is determined, which is used to characterize the breathing status of the user inside the vehicle; The target equipment of the vehicle is controlled based on the breathing information.

2. The vehicle control method according to claim 1, characterized in that, The target device includes a display device, and controlling the target device of the vehicle based on the breathing information includes: The display device is controlled based on the breathing information.

3. The vehicle control method according to claim 2, characterized in that, The step of controlling the display device based on the breathing information includes: Based on the respiratory information, the display device is controlled to display one or more of the following: respiratory waveform, respiratory rate, respiratory depth, and respiratory status.

4. The vehicle control method according to claim 3, characterized in that, The respiratory information includes a respiratory waveform, respiratory frequency at multiple times, respiratory depth at multiple times, and respiratory state at multiple times. The step of controlling the display device to display one or more of the respiratory waveform, respiratory frequency, respiratory depth, and respiratory state based on the respiratory information includes: Based on the respiratory frequencies corresponding to the multiple time points, determine the respiratory frequency distribution information; Based on the respiratory depth corresponding to the multiple time points, determine the respiratory depth distribution information; Based on the respiratory states corresponding to the multiple time points, determine the respiratory state distribution information; The display device is controlled to display the breathing waveform, the breathing frequency distribution information, the breathing depth distribution information, and the breathing state distribution information.

5. The vehicle control method according to claim 1, characterized in that, The target device includes ambient lighting, and controlling the target device of the vehicle based on the breathing information includes: The lighting effects of the ambient light are controlled based on the breathing information.

6. The vehicle control method according to claim 5, characterized in that, The breathing information includes breathing frequency, breathing state, and breathing depth. Controlling the lighting effects of the ambient light based on the breathing information includes: The brightness of the ambient light is controlled according to the breathing frequency; and / or, The ambient light color is controlled according to the breathing state; and / or, The softness of the ambient light is controlled based on the breathing depth.

7. The vehicle control method according to claim 1, characterized in that, The target device includes an air conditioner, and controlling the target device of the vehicle based on the breathing information includes: The operating status of the air conditioner is controlled based on the breathing information.

8. The vehicle control method according to claim 7, characterized in that, The step of controlling the operating status of the air conditioner based on the breathing information includes: Based on the breathing information, the temperature and / or operating mode of the air conditioner are controlled.

9. The vehicle control method according to claim 8, characterized in that, The breathing mode is a meditation mode, and the breathing information includes real-time breathing information and historical breathing information. Controlling the temperature and / or operating mode of the air conditioner based on the breathing information includes: The real-time meditation depth is determined based on the real-time breathing information. The amount of change in meditation depth is determined based on the real-time breathing information and the historical breathing information; The temperature and / or operating mode of the air conditioner are controlled based on the real-time meditation depth and the amount of change in meditation depth.

10. The vehicle control method according to claim 1, characterized in that, The target device includes a seat, and controlling the target device of the vehicle based on the breathing information includes: The state of the seat is controlled based on the breathing information.

11. The vehicle control method according to claim 10, characterized in that, The breathing mode is a meditation mode, and the breathing information includes real-time breathing information and historical breathing information. Controlling the state of the seat based on the breathing information includes: The real-time meditation depth is determined based on the real-time breathing information. The amount of change in meditation depth is determined based on the real-time breathing information and the historical breathing information; The state of the seat is controlled based on the real-time meditation depth and the amount of change in meditation depth.

12. The vehicle control method according to claim 11, characterized in that, The control of the seat's state based on the real-time meditation depth and the change in meditation depth includes: When the real-time meditation depth is lower than the preset meditation depth, and / or the change in meditation depth is lower than the preset change in meditation depth, the massage mode of the seat is controlled.

13. The vehicle control method according to claim 1, characterized in that, The vehicle control method further includes: In response to a breathing pattern trigger in the vehicle, the state of the vehicle's seats is controlled.

14. The vehicle control method according to claim 1, characterized in that, The target device includes an audio playback device, and controlling the target device of the vehicle based on the breathing information includes: Based on the breathing information, the audio playback device is controlled for playback.

15. The vehicle control method according to claim 14, characterized in that, The respiratory information includes respiratory depth and respiratory rate. The step of controlling playback on the audio playback device based on the respiratory information includes: Based on the breathing rate, determine the audio to be played; Based on the breathing depth, determine the audio playback parameters corresponding to the audio to be played; The audio playback device is controlled to play based on the audio to be played and the audio playback parameters.

16. The vehicle control method according to claim 1, characterized in that, The target device includes an aromatherapy device, and controlling the target device in the vehicle based on the breathing information includes: The aromatherapy effect of the aromatherapy device is controlled based on the breathing information.

17. The vehicle control method according to claim 16, characterized in that, The breathing information includes breathing frequency and breathing depth. Controlling the aromatherapy effect of the aromatherapy device based on the breathing information includes: The aromatherapy frequency of the aromatherapy device is controlled according to the breathing frequency; and / or, The aroma concentration and / or aroma of the aromatherapy device are controlled according to the breathing depth.

18. The vehicle control method according to any one of claims 1 to 17, characterized in that, The process of determining breathing information in response to a vehicle's breathing pattern trigger includes: In response to the vehicle's breathing pattern triggering, acquire target acoustic signals with breathing signal characteristics; The breathing information is determined based on the target acoustic signal.

19. The vehicle control method according to claim 18, characterized in that, The vehicle includes a sound wave emitting device and a sound wave receiving device, wherein acquiring the target sound wave signal with respiratory signal characteristics includes: The first sound wave signal is emitted inside the vehicle by the sound wave emitting device, and the second sound wave signal is received inside the vehicle by the sound wave receiving device. Based on the first acoustic signal and the second acoustic signal, a target acoustic signal with respiratory signal characteristics is determined.

20. The vehicle control method according to claim 19, characterized in that, The step of determining the target acoustic signal with respiratory signal characteristics based on the first acoustic signal and the second acoustic signal includes: Channel estimation is performed based on the first acoustic signal and the second acoustic signal to obtain the difference acoustic signal between the first acoustic signal and the second acoustic signal; Based on the differential acoustic signals, a target acoustic signal with respiratory signal characteristics is determined.

21. The vehicle control method according to claim 18, characterized in that, The step of determining respiratory information based on the target acoustic signal includes: Determine the direction of phase change of the target acoustic signal in the complex plane; The breathing state is determined based on the direction of the phase change, and the breathing state is either exhalation or inhalation. The breathing information is determined based on the breathing state and the target acoustic signal.

22. The vehicle control method according to claim 21, characterized in that, The number of target acoustic signals is multiple, and the step of determining the breathing state based on the phase change direction includes: The breathing state corresponding to each of the multiple target acoustic signals is determined based on the phase change direction of each of the multiple target acoustic signals. The final breathing state is determined based on the breathing states corresponding to the multiple target acoustic signals.

23. The vehicle control method according to claim 21, characterized in that, Determining the respiratory information based on the respiratory state and the target acoustic signal includes: Based on the breathing states corresponding to the multiple target acoustic signals, the waveforms of the multiple target acoustic signals are adjusted to obtain multiple adjusted acoustic signals. The phase change direction and amplitude change law of each adjusted acoustic signal are matched with the breathing state corresponding to each adjusted acoustic signal. The breathing waveform is determined based on the multiple adjusted acoustic signals; The respiratory information is determined based on the respiratory state and the respiratory waveform.

24. The vehicle control method according to claim 23, characterized in that, Determining the breathing waveform based on the plurality of adjusted acoustic signals includes: The multiple adjusted acoustic signals are phase aligned in the complex plane to obtain multiple aligned acoustic signals. The multiple aligned acoustic signals are superimposed to obtain a superimposed complex signal; The respiratory waveform is obtained by projecting the superimposed complex signal.

25. The vehicle control method according to claim 24, characterized in that, The step of projecting the superimposed complex signal to obtain the respiratory waveform includes: Determine the amplitude and phase changes of the superimposed complex signal; Based on the amplitude change information and the phase change information, the superimposed complex signal is projected to obtain the breathing waveform, wherein the breathing waveform is a waveform represented by amplitude or a waveform represented by phase.

26. The vehicle control method according to claim 23, characterized in that, Determining the respiratory information based on the respiratory state and the respiratory waveform includes: Based on the breathing waveform, determine the user's breathing depth and breathing rate; The respiratory waveform, respiratory state, respiratory depth, and respiratory frequency are determined as the respiratory information.

27. A vehicle control device, characterized in that, include: The determination module is configured to determine breathing information in response to a breathing pattern trigger in the vehicle, the breathing information being used to characterize the breathing status of a user inside the vehicle; The control module is configured to control the target device of the vehicle based on the breathing information.

28. A vehicle, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to execute the executable instructions to implement the vehicle control method as described in any one of claims 1 to 26.

29. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the vehicle control method as described in any one of claims 1 to 26.

30. A computer program product, characterized in that, It includes a computer program that, when executed by a processor, implements the vehicle control method according to any one of claims 1 to 26.

Images