Vehicle audio partition adjustment method, device and equipment

Abstract

The invention provides a vehicle audio partition adjustment method, device and equipment, and is applied to the technical field of artificial intelligence, and the method comprises the steps: obtaining the state information of a target passenger; and determining the current state of the target passenger according to the state information. When it is determined that the current state of the target passenger is the sleep state, audio data of a plurality of first sound boxes of a seat where the target passenger is located and noise data of the environment where the target passenger is located are obtained. Each first sound box is arranged at a preset position of a seat where the target passenger is located. And according to the current state and the noise data of the target passenger, respectively adjusting the audio data of each first sound box so as to meet the sleep state of the target passenger. The problem that sleep of passengers is interfered by noise due to the fact that a traditional automobile sleep system lacks intelligent perception on the sleep state of the passengers can be solved.

Description

Technical Field

[0001] This application relates to the field of vehicle audio zone control technology, and in particular to a vehicle audio zone adjustment method, apparatus and equipment. Background Technology

[0002] With the continuous development of automotive intelligent technology, in-vehicle comfort features are gradually becoming an important part of enhancing the driving and riding experience. In long-distance driving or autonomous driving scenarios, passengers may want to have a more comfortable and quiet resting experience in the car environment, especially when they are sleeping, their sensitivity to the sound environment is significantly increased.

[0003] In related technologies, in-car audio systems typically employ uniform volume control or simple zone division, such as differentiating sound output areas by the physical location of front and rear speakers, or allowing passengers to manually adjust the volume to their needs. However, this control method lacks the ability to perceive the physiological state of passengers. Especially after a passenger falls asleep, the system cannot dynamically adjust the zone or sound output according to their sleep state. This can lead to unnecessary noise interference from other passengers' voice calls, entertainment audio, etc., affecting their sleep quality and rest. Summary of the Invention

[0004] The purpose of this application is to provide a method, device, and equipment for adjusting vehicle audio zones, thereby solving the problem that traditional car sleep systems lack intelligent perception of passengers' sleep status, resulting in noise interference with passengers' sleep.

[0005] In a first aspect, embodiments of this application provide a method for adjusting vehicle audio zones. The method includes: acquiring the state information of a target passenger; determining the current state of the target passenger based on the state information; if the current state of the target passenger is determined to be a sleep state, acquiring audio data of multiple first speakers at the target passenger's seat and noise data of the target passenger's environment; each first speaker being set at a preset position at the target passenger's seat; and adjusting the audio data of each first speaker according to the target passenger's current state and the noise data to satisfy the target passenger's sleep state.

[0006] The vehicle audio zone adjustment method provided in this application acquires the real-time status information of a target passenger in the vehicle and analyzes whether the target passenger is currently asleep based on this status information. Furthermore, if it is determined that the target passenger is asleep, the audio data of each first speaker is adjusted by combining the audio data of multiple speakers at the passenger's seat and the noise data of the surrounding environment. This creates a quiet and comfortable environment for the sleeping passenger, avoids noise interference from other noises, improves the in-vehicle comfort experience, and enhances the personalized interactive experience of the smart cockpit.

[0007] One possible implementation involves the status information including one or more of the following: facial features, respiratory rate, and heart rate. Based on this status information, the current status of the target passenger is determined, including: identifying the target passenger's facial expression and facial muscle state based on facial features; determining the respiratory rate interval to which the respiratory rate belongs and the heart rate interval to which the heart rate belongs; and finally, determining the target passenger's current status based on the facial expression, facial muscle state, respiratory rate interval, and heart rate interval.

[0008] One possible implementation involves determining the current state of a target passenger based on facial expression, facial muscle state, respiratory rate range, and heart rate range, including: determining the target passenger's current state as awake when the facial expression is determined to be open eyes, tense facial muscles, and a first respiratory rate range and heart rate range; and / or determining the target passenger's current state as REM sleep when the facial expression is determined to be rapid eye movement (REM) sleep, relaxed facial muscles, and a second respiratory rate range and heart rate range; and / or determining the target passenger's current state as core sleep when the facial expression is determined to be calm, relaxed facial muscles, a third respiratory rate range, and a fourth heart rate range; and / or determining the target passenger's current state as deep sleep when the facial expression is calm, fully relaxed facial muscles, and a fourth respiratory rate range and heart rate range.

[0009] One possible implementation involves the following: audio data includes the audio type and audio output parameters of the played audio. Noise data includes the location of the noise source and noise source data. Based on the target passenger's current state and the noise data, the audio data of each first speaker is adjusted, including: determining an audio type matching the target passenger's current state; and determining the audio output parameters of each first speaker based on the noise source location, noise source data, and the distance between the target passenger's seat and the noise source location.

[0010] One possible implementation involves audio output parameters including phase and amplitude. The audio output parameters for each first speaker are determined based on the noise source location and the distance between the target passenger's seat and the noise source location. This includes determining a phase adjustment matrix corresponding to the target passenger's seat based on the noise source location and the distance between the target passenger's seat and the noise source location. Based on the phase adjustment matrix, the phase and amplitude of all first speakers at the target passenger's seat are adjusted to cancel out the generated noise.

[0011] One possible implementation includes volume as an audio output parameter. Based on the noise source location and the distance between the target passenger's seat and the noise source location, the audio output parameters for each first speaker are determined, including: acquiring the target passenger's head data; constructing a three-dimensional sound field model based on the head data; using the three-dimensional sound field model to simulate sound propagation effects in three-dimensional space; and determining the volume, phase, and amplitude of each first speaker relative to the target passenger based on the three-dimensional sound field model.

[0012] One possible implementation of the vehicle audio zoning adjustment method provided in this application embodiment further includes: acquiring the driving information of the target vehicle and the destination of the target passenger; determining the wake-up time of the target passenger based on the driving information and destination; and adjusting the audio data at the wake-up time to wake up the target passenger in advance.

[0013] One possible implementation of the vehicle audio zoning adjustment method provided in this application embodiment further includes: adjusting audio data to alleviate the startled state of the target passenger when the current state of the target passenger is detected as being awake.

[0014] Secondly, embodiments of this application provide a vehicle audio zone adjustment device, which includes an acquisition module, a determination module, and an adjustment module.

[0015] The acquisition module is used to acquire the status information of the target passenger.

[0016] The determination module is used to determine the current status of the target passenger based on the status information.

[0017] The acquisition module is also used to acquire audio data from multiple first speakers at the target passenger's seat and noise data from the target passenger's environment, provided that the target passenger's current state is determined to be sleep. Each first speaker is set at a preset position at the target passenger's seat.

[0018] The adjustment module is used to adjust the audio data of each first speaker according to the current state of the target passenger and noise data, so as to meet the sleep state of the target passenger.

[0019] One possible implementation is that the status information includes one or more of the following: facial features, respiratory rate, and heart rate. When determining the current status of the target passenger based on the status information, the determination module specifically identifies the target passenger's facial expression and facial muscle state based on facial features. It also determines the respiratory rate interval to which the respiratory rate belongs and the heart rate interval to which the heart rate belongs. Based on the facial expression, facial muscle state, respiratory rate interval, and heart rate interval, the current status of the target passenger is determined.

[0020] One possible implementation involves the determining module, when determining the current state of a target passenger based on facial expression, facial muscle state, respiratory rate range, and heart rate range, specifically determining the target passenger's current state as awake when the facial expression is determined to be open eyes, tense facial muscles, and a first respiratory rate range and a first heart rate range. And / or, determining the target passenger's current state as REM sleep when the facial expression is rapid eye movement (REM) eyes, relaxed facial muscles, and a second respiratory rate range and a second heart rate range. And / or, determining the target passenger's current state as core sleep when the facial expression is calm, relaxed facial muscles, a third respiratory rate range, and a third heart rate range. And / or, determining the target passenger's current state as deep sleep when the facial expression is calm, fully relaxed facial muscles, a fourth respiratory rate range, and a fourth heart rate range.

[0021] One possible implementation is that the audio data includes the audio type and audio output parameters of the played audio. The noise data includes the location of the noise source and noise source data. When the adjustment module adjusts the audio data of each first speaker based on the target passenger's current state and the noise data, it specifically determines the audio type matching the target passenger's current state. The audio output parameters of each first speaker are determined based on the noise source location, noise source data, and the distance between the target passenger's seat and the noise source location.

[0022] One possible implementation involves audio output parameters including phase and amplitude. When determining the audio output parameters of each first speaker based on the noise source location and the distance between the target passenger's seat and the noise source location, the determining module specifically determines the phase adjustment matrix corresponding to the target passenger's seat based on the noise source location and the distance between the target passenger's seat and the noise source location. Based on the phase adjustment matrix, the phase and amplitude of all first speakers at the target passenger's seat are adjusted to cancel out the generated noise.

[0023] One possible implementation includes volume as an audio output parameter. Specifically, the determination module acquires the target passenger's head data when determining the audio output parameters for each first speaker based on the noise source location and the distance between the target passenger's seat and the noise source location. A three-dimensional sound field model is constructed based on the head data. This model simulates sound propagation in three-dimensional space. The volume, phase, and amplitude of each first speaker relative to the target passenger are then determined based on the three-dimensional sound field model.

[0024] In one possible implementation, the vehicle audio zone adjustment device provided in this application embodiment is further used to acquire the driving information of the target vehicle and the destination of the target passenger. Based on the driving information and destination, the wake-up time of the target passenger is determined. Audio data is adjusted at the wake-up time to wake the target passenger in advance.

[0025] In one possible implementation, the vehicle audio zone adjustment device provided in this application embodiment is further used to adjust audio data to alleviate the startled state of the target passenger when the current state of the target passenger is detected to be awake.

[0026] Thirdly, embodiments of this application provide a vehicle audio zone adjustment device, which has the function of implementing the vehicle audio zone adjustment method of the first aspect or any possible implementation thereof. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-described function.

[0027] Fourthly, embodiments of this application provide a computer-readable storage medium storing instructions that, when executed on a computer, enable the computer to perform the vehicle audio zoning adjustment method of the first aspect or any possible implementation thereof.

[0028] Fifthly, embodiments of this application provide a computer program product containing instructions that, when run on a computer, enable the computer to execute the vehicle audio zoning adjustment method described in the first aspect or any possible implementation thereof.

[0029] The technical effects of any of the design methods in aspects two through five can be found in aspect one or in different possible implementations of aspect one, and will not be repeated here. Attached Figure Description

[0030] To more clearly illustrate the technical solutions in the specific embodiments of this application or the prior art, the drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0031] Figure 1 A system architecture diagram of a vehicle audio zone adjustment system provided in this application embodiment; Figure 2 A flowchart illustrating a vehicle audio zone adjustment method provided in this application embodiment; Figure 3 A schematic diagram of a vehicle audio zone adjustment device provided in this application embodiment; Figure 4 Another system architecture diagram of a vehicle audio zone adjustment system provided in this application embodiment. Detailed Implementation

[0032] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The components of the embodiments of this application described and shown in the accompanying drawings can generally be arranged and designed in various different configurations.

[0033] Therefore, the following detailed description of the embodiments of this application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely to illustrate selected embodiments of the application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without inventive effort are within the scope of protection of this application.

[0034] In related technologies, the development of smart cockpit technology has enabled in-vehicle audio systems to have certain zone control capabilities, such as independent muting and sleep optimization. However, this control method usually requires passengers to manually adjust or preset modes. During vehicle operation, passengers may randomly enter a sleep state. At this time, the audio system still requires manual adjustment and cannot dynamically adjust the sound zone or sound output of their seat according to their sleep state. This can lead to unnecessary sound interference from other passengers' voice calls, entertainment audio, etc., which may affect the sleeper's sleep quality and rest.

[0035] Based on this, embodiments of this application provide a vehicle audio zone adjustment method, apparatus, and device. The method includes acquiring the state information of a target passenger. Based on the state information, the current state of the target passenger is determined. If the current state of the target passenger is determined to be a sleep state, audio data from multiple first speakers at the target passenger's seat and noise data of the target passenger's environment are acquired. Each first speaker is respectively set at a preset position at the target passenger's seat. Based on the target passenger's current state and the noise data, the audio data of each first speaker is adjusted to meet the target passenger's sleep state.

[0036] The vehicle audio zone adjustment method provided in this application acquires the real-time status information of a target passenger in the vehicle and analyzes whether the target passenger is currently asleep based on this status information. Furthermore, if it is determined that the target passenger is asleep, the audio data of each first speaker is adjusted by combining the audio data of multiple speakers at the passenger's seat and the noise data of the surrounding environment. This creates a quiet and comfortable environment for the sleeping passenger, avoids noise interference from other noises, improves the in-vehicle comfort experience, and enhances the personalized interactive experience of the smart cockpit.

[0037] The methods provided in the embodiments of this application will be described below with reference to specific examples.

[0038] On one hand, embodiments of this application provide a vehicle audio zone adjustment system. For example... Figure 1 As shown, the vehicle audio zone adjustment system 100 may include: a sensor 101, a control unit 102, and multiple first speakers 103.

[0039] Sensor 101 is used to acquire the target passenger's status information and the noise data of the environment in which the target passenger is located. The target passenger's status information may include facial expression, facial muscle state, respiratory rate, and heart rate. The noise data of the target passenger's environment may include noise generated by the vehicle's own equipment during operation, noise from other vehicles around the vehicle, and sounds made by passengers other than the target passenger.

[0040] For example, sensor 101 may include a camera, an infrared sensor, a heart rate monitor, a radar sensor, and a microphone. The camera can be used to capture the passenger's facial expressions and muscle states, analyzing whether the passenger is asleep using image recognition technology. The infrared sensor can be used to monitor the passenger's breathing rate by monitoring temperature changes during breathing; the infrared sensor can be installed near the seat back or headrest to ensure accurate detection of the passenger's breathing rate. The heart rate monitor can measure the passenger's heart rate using photoelectric or bioelectric technology; the heart rate monitor can be integrated into the seat back, armrest, or seatbelt to continuously provide heart rate data. The radar sensor can detect the passenger's minute movements, such as the rise and fall of the chest during breathing, by emitting and receiving electromagnetic waves, thereby accurately measuring the breathing rate. The microphone is used to collect noise inside and around the vehicle, including noise from the vehicle's own equipment, noise from other vehicles, and the voices of other passengers inside the vehicle. These microphones are distributed in different locations within the vehicle, such as the ceiling, near the seats, and near the windows, to comprehensively capture ambient noise.

[0041] The control unit 102 is used to acquire the target passenger's status information collected by the sensor 101 and the ambient noise of the target passenger's environment. Using the vehicle audio zoning adjustment method provided in this application embodiment, the control unit determines the target passenger's current status based on the target passenger's status information, and determines the audio data of each first speaker 103 that matches the target passenger's current status based on the passenger's current status and ambient noise data. The control unit 102 then sends the audio data to each first speaker 103 in the form of an audio control command.

[0042] The first speaker 103 is used to receive audio control commands sent by the control unit 102, and under the control of the audio control commands, to provide a natural and comfortable audio experience for the target passenger by adjusting the volume, phase and amplitude.

[0043] The number of first speakers 103 is multiple. Each of the multiple first speakers 103 is installed at a preset position on the seat where the target passenger is located. For example, the first speakers can be installed in areas such as the seat headrest, backrest, armrest, door, and interior ceiling.

[0044] It should be noted that this application does not limit the placement of the first speaker. The selection of the placement location of the first speaker aims to ensure that the audio can be accurately transmitted to the vicinity of the passenger's ears, while reducing sound reflection and interference during sound propagation within the vehicle. By placing speakers in these different locations, the system can make precise audio adjustments based on the passenger's state and ambient noise, providing passengers with a more comfortable, personalized, and intelligent audio experience.

[0045] It should be noted that the above Figure 1The illustrated vehicle audio zone adjustment of 100 is merely an example illustrating the application scenario of this application solution, and is not intended to limit the application scenario of this application solution.

[0046] On the one hand, embodiments of this application provide a method for adjusting vehicle audio zones, which can be performed by... Figure 1 The vehicle audio zone adjustment system shown is in operation. Figure 2 As shown, the method may include the following steps.

[0047] S201, Obtain the status information of the target passenger.

[0048] The status information includes one or more of the following: facial features, respiratory rate, and heart rate.

[0049] One possible approach is to capture the facial features of the target passenger using a camera. The camera can be mounted on the roof of the vehicle or in front of the seats to clearly capture images of the passenger's face.

[0050] Another possible approach is to monitor the target passenger's breathing rate using sensors. These sensors can include infrared sensors and radar sensors. The infrared and radar sensors can be mounted near the seat back or headrest to ensure accurate detection of the passenger's breathing signals.

[0051] Specifically, infrared sensors detect temperature changes in exhaled and inhaled air. When a person breathes, the exhaled air is warmer, and the infrared sensor can capture this temperature change to calculate the respiratory rate. Radar sensors can detect minute movements of a passenger's chest by emitting and receiving electromagnetic waves, thereby measuring the passenger's respiratory rate.

[0052] Another possible implementation involves monitoring the target passenger's heart rate using a heart rate monitor. This monitor can be integrated into the seat back, armrest, or seatbelt for continuous monitoring.

[0053] Specifically, heart rate monitors can acquire the heart rate of a target passenger using photoplethysmography (PPG) or bioelectrical measurement techniques. PPG technology uses optical sensors to detect changes in blood flow within blood vessels to measure heart rate, while bioelectrical measurement measures heart rate by detecting the electrical activity of the heart.

[0054] S202, Determine the current status of the target passenger based on the status information.

[0055] Specifically, after obtaining the target passenger's status information, the current status of the target passenger is determined based on the facial features, respiratory rate, and heart rate in the target passenger's status information.

[0056] The current state of the target passenger can include a clear state, REM sleep state, core sleep state, and deep sleep state.

[0057] One possible implementation involves identifying the target passenger's facial expression and facial muscle state based on their facial features. Then, based on the target passenger's respiratory rate and heart rate, the respiratory rate interval and heart rate interval are determined, respectively. Finally, the target passenger's current state is determined based on their facial expression, facial muscle state, respiratory rate interval, and heart rate interval.

[0058] For example, after obtaining the target passenger's status information, the facial features of the target passenger are first analyzed to identify the passenger's current expression and facial muscle state. For instance, through images captured by a camera, it can be determined whether the passenger's eyes are open and whether their facial muscles are tense or relaxed. Simultaneously, since changes in respiratory rate and heart rate are closely related to a person's physiological state, respiratory rate and heart rate can be compared with preset intervals to determine their respective intervals. Therefore, based on the expression state, facial muscle state, respiratory rate interval, and heart rate interval, the current state of the target passenger is determined.

[0059] Furthermore, when determining the current state of a target passenger based on facial expression, facial muscle state, respiratory rate range, and heart rate range, the following possible implementation methods can be used.

[0060] The first possible implementation method is to determine that the target passenger's current state is awake when the facial expression is determined to be open, the facial muscles are in a tense state, the respiratory rate range is the first respiratory rate range, and the heart rate range is the first heart rate range.

[0061] For example, if the target passenger's facial expression is determined to be: eyes open; facial muscles showing tension such as furrowed brows and slightly pursed lips; respiratory rate of 18 breaths per minute, falling within the first heart rate zone of 15-20 beats per minute; and heart rate of 85 beats per minute, falling within the first heart rate zone of 70-90 beats per minute, it can be determined that the target passenger is conscious at this time.

[0062] The second possible implementation method is to determine the current state of the target passenger as REM sleep when the facial expression is rapid eye movement, the facial muscles are relaxed, the respiratory rate range is the second respiratory rate range, and the heart rate range is the second heart rate range.

[0063] For example, if the target passenger's facial expression is determined to be rapid eye movement (REM) sleep, and their facial muscles are relaxed (e.g., a calm expression without obvious signs of tension), and their respiratory rate is 25 breaths per minute (below the second respiratory rate range of 20-30 breaths per minute), and their heart rate is 95 beats per minute (below the second heart rate range of 80-100 beats per minute), then it can be determined that the target passenger is in REM sleep.

[0064] The third possible implementation method is to determine the target passenger's current state as core sleep state when the facial expression is calm, the facial muscles are relaxed, the respiratory rate range is the third respiratory rate range, and the heart rate range is the third heart rate range.

[0065] For example, the target passenger's facial expression is calm, with relaxed facial muscles and a peaceful expression, showing no obvious signs of tension or anxiety. The target passenger's respiratory rate is 12 breaths per minute, falling within the third respiratory rate range of 10-15 breaths per minute. The target passenger's heart rate is 65 beats per minute, falling within the third heart rate range of 60-70 beats per minute. These physiological indicators suggest that the passenger is in a relatively quiet and relaxed state, confirming that the target passenger is in core sleep.

[0066] The fourth possible implementation method is to determine that the target passenger's current state is a deep sleep state when the facial expression is calm, the facial muscles are completely relaxed, the respiratory rate range is the fourth respiratory rate range, and the heart rate range is the fourth heart rate range.

[0067] For example, the target passenger's facial expression is calm, with completely relaxed facial muscles and a very peaceful expression, showing no signs of tension or anxiety. The target passenger's breathing rate is 8 breaths per minute, falling within the fourth respiratory rate range of 5-10 breaths per minute. The target passenger's heart rate is 55 beats per minute, falling within the fourth heart rate range of 50-60 beats per minute. These physiological indicators suggest that the passenger is in a state of deep relaxation and tranquility, confirming that the target passenger is in deep sleep.

[0068] S203, if it is determined that the current state of the target passenger is asleep, acquire the audio data of multiple first speakers at the seat where the target passenger is located and the noise data of the environment where the target passenger is located.

[0069] Each first speaker is installed at a preset position in the seat of the target passenger. The audio data of each first speaker includes the audio type and audio output parameters.

[0070] For example, the first speaker can be placed in the headrest, backrest, or other position of the target passenger's seat to ensure that the audio is accurately delivered to the vicinity of the passenger's ears. The type of audio played by the first speaker can be the content currently being played, such as music, news broadcasts, audiobooks, white noise, or other types of audio. The audio output parameters of the first speaker can include the volume, phase, and amplitude of the played audio, which determine the audio playback effect. For example, the volume needs to be low enough so as not to disturb sleeping passengers; adjustments to the phase and amplitude can be used to cancel out ambient noise or create a more comfortable audio environment.

[0071] Additionally, noise data regarding the target passenger's environment is also considered. Noise data can come from the operation of the vehicle's own equipment, such as the air conditioning and engine; it can also come from other vehicles around the vehicle, such as traffic noise outside the vehicle; and it can also include sounds made by other passengers inside the vehicle, such as conversations or cell phone ringing.

[0072] For example, to accurately acquire noise data about the environment in which the target passenger is located, microphones can be placed in multiple locations inside the vehicle. These microphones can capture noise from different sources and convert it into electrical signals. The system then analyzes these signals to determine information such as the frequency, intensity, and direction of the noise source.

[0073] S204, based on the current state of the target passenger and noise data, adjust the audio data of each first speaker to meet the sleep state of the target passenger.

[0074] Specifically, after determining the current state of the target passenger and obtaining the noise data of the environment in which the target passenger is located, the first audio type played by the first speaker and the audio output parameters of each first speaker are adjusted based on the current state of the target passenger and the noise data, so as to ensure that the most comfortable audio environment can always be provided for the target passenger, reduce external noise interference, and improve the sleep quality of the target passenger.

[0075] One possible implementation involves determining the audio type that matches the target passenger's current state. The audio output parameters for each first speaker are determined based on the noise source location, noise source data, and the distance between the target passenger's seat and the noise source location.

[0076] For example, when it is determined that the target passenger is asleep, the appropriate audio type can be selected based on the passenger's specific sleep stage. For instance, if the passenger is in REM or core sleep, soft, natural sounds such as a gentle breeze or the soft sound of waves can be played, as these sounds help relax the passenger's nerves and promote deeper sleep. For passengers in deep sleep, more soothing, slower-paced music can be played, or the audio output can be reduced to minimize disturbance.

[0077] One possible implementation, the process of determining the audio output parameters of each first speaker based on the location of the noise source and the distance between the target passenger's seat and the noise source location, may include determining a phase adjustment matrix corresponding to the target passenger's seat based on the noise source location and the distance between the target passenger's seat and the noise source location. Based on the phase adjustment matrix, the phase and amplitude of all the first speakers at the target passenger's seat are adjusted to cancel out the generated noise.

[0078] The phase adjustment matrix is ​​constructed based on the location of the noise source and the distance between the noise source and the target passenger's seat. This phase adjustment matrix comprehensively considers the characteristics of the noise source, such as its direction, intensity, and frequency, as well as the distance between the passenger's seat and the noise source. It can provide a precise phase and amplitude adjustment scheme for each first speaker, so that the audio emitted by each first speaker can produce a phase cancellation effect with the noise near the target passenger's ear.

[0079] Specifically, a microphone array distributed throughout the vehicle is used to determine the location of the noise source. Simultaneously, the distance between the target passenger's location and the noise source is calculated. Based on a phase adjustment matrix, the phase and amplitude of all the first speakers at the target passenger's seat are adjusted. The phase adjustment can be achieved by changing the phase of the audio signal emitted by the speakers to be opposite to the phase of the noise. The amplitude adjustment can be achieved by adjusting the amplitude of the audio signal emitted by the speakers according to the noise intensity, in order to cancel out the noise.

[0080] For example, if the noise source is located on the right side of the vehicle and close to the passenger's seat, the phase adjustment matrix will instruct the right-side speaker to emit an audio signal with the opposite phase and matching amplitude to the noise. Simultaneously, the left-side speaker may make appropriate phase and amplitude adjustments based on the noise propagation characteristics and the passenger's head position to enhance the cancellation effect. This process adjusts the audio output parameters of all primary speakers around the target passenger based on the noise source's location and distance from the target passenger's seat, effectively reducing noise interference and improving the target passenger's sleep quality.

[0081] Another possible implementation, where the process of determining the audio output parameters of each first speaker based on the location of the noise source and the distance between the target passenger's seat and the noise source, may include acquiring the target passenger's head data. Based on the head data, a three-dimensional sound field model is constructed. This model simulates the sound propagation effects in three-dimensional space. Based on the three-dimensional sound field model, the volume, phase, and amplitude of each first speaker relative to the target passenger's head are determined.

[0082] Specifically, sensors are used to acquire head data of the target passenger, such as pressure sensors, cameras, or infrared sensors, to obtain information such as the position, orientation, size, and shape of the target passenger's head. Simultaneously, minute movements and positional changes of the target passenger's head are monitored in real time.

[0083] After acquiring the target passenger's head data, a three-dimensional sound field model is constructed based on this data. This three-dimensional sound field model can simulate the propagation effects of sound in three-dimensional space, such as sound reflection, refraction, and attenuation. The construction process of the three-dimensional sound field model involves considering the target passenger's head position, direction, size, and shape to determine their influence on sound reception. Furthermore, the construction process can also consider the impact of the vehicle's internal physical structure, such as the roof, windows, and seats, on sound propagation.

[0084] Furthermore, after constructing the 3D sound field model, the optimal volume for each speaker is calculated based on the passenger's head position and direction, as well as the intensity and distance of the noise source. For example, if the passenger's head is tilted to one side, the volume of the speaker on that side can be appropriately increased to ensure that the sound is evenly transmitted to the target passenger's ears. Simultaneously, the intensity of the noise source is considered, and the volume is adjusted appropriately to mask the noise without being too loud to disturb the passenger's sleep. At the same time, the phase of each first speaker is adjusted based on the predicted sound propagation path and time delay in the 3D sound field model. Precise phase adjustment ensures that the sound emitted by each first speaker produces the best cancellation effect near the passenger's ears, thereby reducing noise interference. For example, if the noise source is from the rear of the vehicle, the phase of the rear first speaker can be adjusted to be opposite to the phase of the noise source, thus producing a cancellation effect near the target passenger's ears. Finally, based on the amplitude characteristics of the noise source, the amplitude of the speakers is adjusted to ensure that the sound emitted by each first speaker can effectively mask or cancel the noise, while maintaining a smooth and comfortable audio experience. For example, if the amplitude of the noise changes significantly, the amplitude of the first sound can be dynamically adjusted to adapt to this change while avoiding abrupt changes in the sound.

[0085] To further enhance passenger comfort and convenience, the vehicle audio zone adjustment method provided in this application embodiment also provides wake-up functionality for passengers.

[0086] Specifically, based on the current driving information of the target vehicle and the target passenger's destination, the wake-up time of the target passenger is determined, and the audio data of all first speakers is adjusted at that wake-up time to wake up the target passenger in advance.

[0087] For example, the first step is to obtain the target vehicle's driving information, such as its current speed, route, and estimated arrival time. Simultaneously, the destination information of the target passenger is obtained, for example, through the target vehicle's navigation system or by the passenger's input. Based on the target vehicle's driving information and the target passenger's destination, the wake-up time is calculated.

[0088] The wake-up time can be a period of time before the target vehicle is expected to arrive at its destination. The length of this period can be adjusted based on the passenger's sleep state and the vehicle's driving conditions. For example, if the passenger is in a deep sleep, they can be woken up 15 minutes before the expected arrival time to allow them sufficient time to gradually recover. If the passenger is in a light sleep, the wake-up time can be closer to the expected arrival time.

[0089] Once the wake-up time is determined, the audio data of all primary speakers is adjusted to wake the target passenger in advance. This process is gradual to ensure a comfortable transition from sleep to wakefulness. For example, the volume of the primary speakers is gradually increased, and soothing music or natural sounds, such as birdsong or gentle waves, are played to help passengers wake up naturally rather than being startled by sudden noise. Simultaneously, the audio type and output parameters are dynamically adjusted based on the passenger's sleep state and ambient noise to ensure the comfort and effectiveness of the wake-up process.

[0090] Simultaneously, during the adjustment process, the audio output can be continuously optimized based on changes in the target passenger's real-time status and vehicle driving conditions. For example, if the vehicle encounters traffic congestion during the wake-up process, causing a delay in the estimated arrival time, the wake-up time can be adjusted accordingly to ensure that the passenger is fully awake when the vehicle arrives at its destination. Furthermore, the audio output can be further optimized based on passenger feedback, such as manual adjustments to the audio system or voice commands, to meet the passenger's personalized needs.

[0091] Furthermore, if the target passenger is detected to be in a startled state, the audio data is adjusted to alleviate the startled state.

[0092] For example, the system continuously monitors the target passenger's state using multiple sensors, such as by detecting changes in facial features, heart rate, and respiratory rate. For instance, the system might detect sudden tension in the passenger's facial muscles, a sharp increase in heart rate, and a faster breathing rate, changes that suggest the passenger may be awakened.

[0093] When a passenger is detected suddenly waking from sleep, the volume of the audio system should be quickly reduced to avoid further agitation. The current audio type played on the primary speaker should be switched to a soothing type, such as gentle natural sounds (like rain or a light breeze) or calming music (like light music or meditation music). Simultaneously, the audio data should be adjusted gradually to avoid abrupt changes causing secondary agitation. For example, the volume can be reduced first, then gradually switched to a soothing audio type, and the audio output parameters adjusted progressively until the passenger calms down.

[0094] The above primarily describes the solutions provided in this application from the perspective of the device's working principle. It is understood that, in order to achieve the aforementioned functions, the vehicle audio zone adjustment device includes corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should readily recognize that, based on the algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0095] This application embodiment can divide the vehicle audio zone adjustment device into functional modules according to the above method example. For example, each function can be divided into a separate functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module.

[0096] It should be noted that the module division in this embodiment is illustrative and represents only one logical functional division; in actual implementation, other division methods may be used. When dividing functional modules according to their respective functions, Figure 3 A schematic diagram of a possible configuration of the vehicle audio zone adjustment device involved in the above and embodiments is shown. Figure 3 As shown, the vehicle audio zone adjustment device 300 may include: an acquisition module 301, a determination module 302, and an adjustment module 303.

[0097] The acquisition module 301 is used to support the vehicle audio zone adjustment device 300 in execution. Figure 2 S201 and S203 in the vehicle audio zone adjustment method shown.

[0098] Determine module 302, used to support the vehicle audio zone adjustment device 300 in execution. Figure 2 S202 in the vehicle audio zone adjustment method shown.

[0099] Adjustment module 303 is used to support the vehicle audio zone adjustment device 300 in execution. Figure 2 S204 in the vehicle audio zone adjustment method shown.

[0100] One possible implementation is that the status information includes one or more of the following: facial features, respiratory rate, and heart rate. When determining the current status of the target passenger based on the status information, the determination module specifically identifies the target passenger's facial expression and facial muscle state based on facial features. It also determines the respiratory rate interval to which the respiratory rate belongs and the heart rate interval to which the heart rate belongs. Based on the facial expression, facial muscle state, respiratory rate interval, and heart rate interval, the current status of the target passenger is determined.

[0101] One possible implementation involves the determining module, when determining the current state of a target passenger based on facial expression, facial muscle state, respiratory rate range, and heart rate range, specifically determining the target passenger's current state as awake when the facial expression is determined to be open eyes, tense facial muscles, and a first respiratory rate range and a first heart rate range. And / or, determining the target passenger's current state as REM sleep when the facial expression is rapid eye movement (REM) eyes, relaxed facial muscles, and a second respiratory rate range and a second heart rate range. And / or, determining the target passenger's current state as core sleep when the facial expression is calm, relaxed facial muscles, a third respiratory rate range, and a third heart rate range. And / or, determining the target passenger's current state as deep sleep when the facial expression is calm, fully relaxed facial muscles, a fourth respiratory rate range, and a fourth heart rate range.

[0102] One possible implementation is that the audio data includes the audio type and audio output parameters of the played audio. The noise data includes the location of the noise source and noise source data. When the adjustment module adjusts the audio data of each first speaker based on the target passenger's current state and the noise data, it specifically determines the audio type matching the target passenger's current state. The audio output parameters of each first speaker are determined based on the noise source location, noise source data, and the distance between the target passenger's seat and the noise source location.

[0103] One possible implementation involves audio output parameters including phase and amplitude. When determining the audio output parameters of each first speaker based on the noise source location and the distance between the target passenger's seat and the noise source location, the determining module specifically determines the phase adjustment matrix corresponding to the target passenger's seat based on the noise source location and the distance between the target passenger's seat and the noise source location. Based on the phase adjustment matrix, the phase and amplitude of all first speakers at the target passenger's seat are adjusted to cancel out the generated noise.

[0104] One possible implementation includes volume as an audio output parameter. Specifically, the determination module acquires the target passenger's head data when determining the audio output parameters for each first speaker based on the noise source location and the distance between the target passenger's seat and the noise source location. A three-dimensional sound field model is constructed based on the head data. This model simulates sound propagation in three-dimensional space. The volume, phase, and amplitude of each first speaker relative to the target passenger are then determined based on the three-dimensional sound field model.

[0105] In one possible implementation, the vehicle audio zone adjustment device provided in this application embodiment is further used to acquire the driving information of the target vehicle and the destination of the target passenger. Based on the driving information and destination, the wake-up time of the target passenger is determined. Audio data is adjusted at the wake-up time to wake the target passenger in advance.

[0106] In one possible implementation, the vehicle audio zone adjustment device provided in this application embodiment is further used to adjust audio data to alleviate the startled state of the target passenger when the current state of the target passenger is detected to be awake.

[0107] It should be noted that all relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.

[0108] The vehicle audio zone adjustment device 300 provided in this application embodiment is used to perform the above-mentioned... Figure 2 The vehicle audio zone adjustment method shown can achieve the same effect as the vehicle audio zone adjustment method described above.

[0109] This application also provides a vehicle audio zone adjustment device, which can perform the vehicle audio zone adjustment method and related steps described in the above method embodiments.

[0110] This application also provides a computer-readable storage medium storing instructions that, when executed, perform the vehicle audio zone adjustment method and related steps in the above method embodiments.

[0111] This application also provides a computer program product that, when run on a computer, causes the computer to execute the vehicle audio zoning adjustment method and related steps described in the above method embodiments.

[0112] In some embodiments, the methods shown in this application can be implemented as computer program instructions encoded in a machine-readable format on a computer-readable storage medium or on other non-transitory media or articles of art.

[0113] This application also provides a vehicle audio zone adjustment system 100, such as... Figure 4 As shown, the vehicle audio zone adjustment system 100 includes at least one processor 401 and at least one interface circuit 402.

[0114] As an example, when the vehicle audio zone adjustment system 100 includes a processor and an interface circuit, the processor can be... Figure 4 The processor 401 shown in the solid box (or the processor 401 shown in the dashed box) can be an interface circuit. Figure 4 The interface circuit 402 is shown in the solid box (or the dashed box). When the vehicle audio zone adjustment system 100 includes two processors and two interface circuits, the two processors include... Figure 4 The processor 401 shown in the solid box and the processor 401 shown in the dashed box, these two interface circuits include Figure 4 Interface circuit 402 is shown in both solid and dashed boxes. No limitations are imposed on this.

[0115] Processor 401 and interface circuit 402 can be interconnected via a line. For example, interface circuit 402 can be used to receive signals. Alternatively, interface circuit 402 can be used to send signals to other devices (e.g., processor 401). For instance, interface circuit 402 can read computer instructions stored in memory and send those instructions to processor 401. Processor 401 executes the instructions and, in conjunction with input / output devices, implements the various steps in the above embodiments, such as implementing... Figure 2The illustrated method embodiments represent the various steps performed. Of course, this chip system may also include other discrete components, and this application embodiment does not specifically limit this.

[0116] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0117] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0118] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0119] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0120] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, or the part that contributes to it, or all or part of the technical solution, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0121] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for adjusting vehicle audio zones, characterized in that, The method includes: Obtain the target passenger's status information; Based on the status information, determine the current status of the target passenger; If the current state of the target passenger is determined to be a sleeping state, the audio data of multiple first speakers at the seat where the target passenger is located and the noise data of the environment where the target passenger is located are acquired; each of the first speakers is set at a preset position at the seat where the target passenger is located. Based on the current state of the target passenger and the noise data, the audio data of each of the first speakers is adjusted to meet the sleep state of the target passenger.

2. The method according to claim 1, characterized in that, The status information includes one or more of the following: facial features, respiratory rate, and heart rate; determining the current status of the target passenger based on the status information includes: Based on the facial features, the target passenger's facial expression and facial muscle state are identified; Determine the respiratory rate interval to which the respiratory rate belongs and the heart rate interval to which the heart rate belongs, respectively; The current state of the target passenger is determined based on the facial expression, facial muscle state, respiratory rate range, and heart rate range.

3. The method according to claim 2, characterized in that, Determining the current state of the target passenger based on the facial expression state, facial muscle state, respiratory rate range, and heart rate range includes: When the facial expression is determined to be eyes open, the facial muscles are in a tense state, the respiratory rate range is the first respiratory rate range, and the heart rate range is the first heart rate range, the current state of the target passenger is determined to be conscious. And / or, when the facial expression state is determined to be rapid eye movement, the facial muscle state is a relaxed state, the respiratory rate range is a second respiratory rate range, and the heart rate range is a second heart rate range, the current state of the target passenger is determined to be a rapid eye movement sleep state. And / or, when the facial expression is determined to be calm, the facial muscles are determined to be relaxed, the respiratory rate range is the third respiratory rate range, and the heart rate range is the third heart rate range, the current state of the target passenger is determined to be core sleep state. And / or, when the facial expression is determined to be calm, the facial muscles are determined to be completely relaxed, the respiratory rate range is the fourth respiratory rate range, and the heart rate range is the fourth heart rate range, the current state of the target passenger is determined to be deep sleep.

4. The method according to claim 1, characterized in that, The audio data includes the audio type and audio output parameters of the played audio; the noise data includes the location of the noise source and noise source data; adjusting the audio data of each of the first speakers according to the current state of the target passenger and the noise data includes: Based on the current state of the target passenger, determine the audio type that matches the current state of the target passenger; The audio output parameters of each first speaker are determined based on the location of the noise source, the noise source data, and the distance between the seat of the target passenger and the location of the noise source.

5. The method according to claim 4, characterized in that, The audio output parameters include phase and amplitude; determining the audio output parameters of each first speaker based on the location of the noise source and the distance between the target passenger's seat and the noise source location includes: Based on the location of the noise source and the distance between the target passenger's seat and the noise source location, determine the phase adjustment matrix corresponding to the target passenger's seat; Based on the phase adjustment matrix, the phase and amplitude of all the first speakers at the target passenger's seat are adjusted to cancel out the generated noise.

6. The method according to claim 4, characterized in that, The audio output parameters also include volume; determining the audio output parameters of each first speaker based on the location of the noise source and the distance between the target passenger's seat and the noise source location includes: Obtain the head data of the target passenger; Based on the head data, a three-dimensional sound field model is constructed; the three-dimensional sound field model is used to simulate the sound propagation effect in three-dimensional space. Based on the three-dimensional sound field model, the volume, phase, and amplitude of each of the first speakers relative to the target passenger are determined.

7. The method according to claim 1, characterized in that, The method further includes: Obtain the driving information of the target vehicle and the destination of the target passenger; Based on the driving information and the destination, determine the wake-up time of the target passenger; The audio data is adjusted at the wake-up time to wake up the target passenger in advance.

8. The method according to claim 1, characterized in that, The method further includes: If the target passenger is detected to be in a startled state, the audio data is adjusted to alleviate the startled state of the target passenger.

9. A vehicle audio zone adjustment device, characterized in that, The device includes: The acquisition module is used to acquire the status information of the target passenger; The determination module is used to determine the current state of the target passenger based on the state information; The acquisition module is further configured to acquire audio data of multiple first speakers at the seat where the target passenger is located and noise data of the environment where the target passenger is located, when it is determined that the current state of the target passenger is a sleeping state; each first speaker is respectively set at a preset position at the seat where the target passenger is located; An adjustment module is used to adjust the audio data of each of the first speakers according to the current state of the target passenger and the noise data, so as to meet the sleep state of the target passenger.

10. A vehicle audio zone adjustment device, characterized in that, The vehicle audio zone adjustment device includes a processor and a memory, the memory storing machine-executable instructions that can be executed by the processor, the processor executing the machine-executable instructions to implement the vehicle audio zone adjustment method according to any one of claims 1 to 8.

Images