Multi-tone-area voice acquisition method and device, electronic equipment, chip and medium

Abstract

The invention provides a multi-tone-area voice acquisition method and device, electronic equipment, a chip and a medium, and relates to the technical field of voice interaction. The method comprises the steps that in response to a first state change signal of a first seat where a target object is located, a target sound area corresponding to the first seat is updated, and the first state change signal comprises at least one of a position change signal and a posture change signal and a pressure change signal; and collecting a voice signal of the target object in the target voice area. Through the technical scheme provided by the invention, the problem that normal voice interaction is influenced when a driver adjusts the seat in the cabin is solved, and the user experience of voice interaction in the cabin is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of voice interaction, and particularly to a multi-zone voice acquisition method, apparatus, electronic device, chip and medium. Background Art

[0002] Multi-zone voice acquisition divides different seats into multiple independent zones, so as to perform voice acquisition on sound sources within the zones, ensuring zone isolation. When the driver's seat tilts backward, the voice of the driver may be located at the position of the left rear-row zone, resulting in incorrect zone positioning and causing the problem that the driver's seat adjustment in the cockpit affects normal voice interaction. Summary of the Invention

[0003] The present disclosure provides a multi-zone voice acquisition method, apparatus, electronic device, chip and medium to solve the problem that the driver's seat adjustment in the cockpit affects normal voice interaction. By monitoring the change in the state of the seat where the driver is seated, the change in the driver's posture is reflected, so as to adjust the driver's zone range, ensure the continuity of voice interaction with the in-vehicle computer, and improve the user experience of voice interaction in the cockpit.

[0004] In a first aspect embodiment of the present disclosure, a multi-zone voice acquisition method is proposed, and the method includes:

[0005] Responding to a first state change signal of a first seat where a target object is located in a vehicle cockpit, and updating a target zone corresponding to the first seat, where the first state change signal includes at least one of a position change signal, a posture change signal and a pressure change signal;

[0006] Collecting a voice signal of the target object within the target zone.

[0007] In an embodiment of the present disclosure, responding to a first state change signal of a first seat where a target object is located in a vehicle cockpit and updating a target zone corresponding to the first seat includes:

[0008] Monitoring a first displacement, a first tilt angle and a first pressure value of the first seat;

[0009] If the first displacement is greater than or equal to a first distance threshold, triggering a position change signal;

[0010] If the first tilt angle is greater than or equal to a first angle threshold, triggering a posture change signal;

[0011] If the first pressure value is greater than or equal to a first pressure threshold, triggering a pressure change signal;

[0012] Updating the range of the target zone corresponding to the first seat according to at least one of the position change signal, the posture change signal and the pressure change signal.

[0013] In one embodiment of the present disclosure, updating the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, and the pressure change signal includes:

[0014] If the position change signal, the attitude change signal, and the pressure change signal are all triggered, it is determined that the range of the target sound zone corresponding to the first seat is the preset sound zone range.

[0015] In one embodiment of the present disclosure, updating the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, and the pressure change signal further includes:

[0016] Determining the range of the target sound zone of the first seat according to a mapping table between at least one of the value of the position change signal, the value of the attitude change signal, and the value of the pressure change signal and the preset sound zone range.

[0017] In one embodiment of the present disclosure, in response to the position and attitude changes of the target object in the vehicle cockpit on the first seat, updating the target sound zone corresponding to the first seat further includes:

[0018] Monitoring the first displacement, the first tilt angle, the first pressure value of the first seat, and the second pressure value of the second seat, where the second seat corresponds to an adjacent sound zone to the first seat;

[0019] If the first displacement is greater than or equal to the first distance threshold, triggering the position change signal;

[0020] If the first tilt angle is greater than or equal to the first angle threshold, triggering the attitude change signal;

[0021] If the first pressure value is greater than or equal to the first pressure threshold, triggering the pressure change signal;

[0022] If the second pressure value is less than or equal to the second pressure threshold, triggering the second seat unoccupied signal, where the second seat unoccupied signal is a signal indicating that the seat adjacent to the first seat in the vehicle cockpit is unoccupied;

[0023] Updating the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, the pressure change signal, and the second seat unoccupied signal.

[0024] In one embodiment of the present disclosure, before updating the target sound zone corresponding to the first seat in response to the first state change signal of the target object in the vehicle cockpit on the first seat, it further includes:

[0025] Collecting a calibrated sound signal through a microphone array deployed inside the vehicle cockpit;

[0026] Perform sound zone calibration on the vehicle cockpit according to the calibrated sound signal to generate at least two sound zones.

[0027] A second aspect embodiment of the present disclosure provides a multi-sound zone voice acquisition device, which includes:

[0028] A sound zone update module, configured to update the target sound zone corresponding to the first seat in response to a first state change signal of the target object in the vehicle cockpit, where the first state change signal includes at least one of a position change signal and an attitude change signal and a pressure change signal;

[0029] A voice acquisition module, configured to acquire the voice signal of the target object in the target sound zone.

[0030] A third aspect embodiment of the present disclosure provides an electronic device, including: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method of any one of the first aspect embodiments of the present disclosure.

[0031] A fourth aspect embodiment of the present disclosure provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the method of the first aspect embodiment of the present disclosure.

[0032] A fifth aspect embodiment of the present disclosure provides a computer program product, which includes a computer program, and the computer program implements the method of any one of the first aspect embodiments of the present disclosure when executed by a processor.

[0033] A sixth aspect embodiment of the present disclosure provides a chip, including at least one processor and a communication interface; the communication interface is used to receive signals input to the chip or signals output from the chip, and the processor communicates with the communication interface and implements the method of any one of the first aspect embodiments of the present disclosure through logic circuits or by executing code instructions.

[0034] In summary, according to the multi-sound zone voice acquisition method proposed by the present disclosure, in response to a first state change signal of the target object in the vehicle cockpit, the target sound zone corresponding to the first seat is updated, where the first state change signal includes at least one of a position change signal and an attitude change signal and a pressure change signal, and the sound zone range is intelligently adjusted according to the attitude of the target object, providing a basis for multi-sound zone voice acquisition; the voice signal of the target object in the target sound zone is acquired, maintaining the continuity of the voice interaction of the target object. The user experience of voice interaction in the cockpit is improved.

[0035] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and do not limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure, and do not constitute an improper limitation of the present disclosure.

[0037] Figure 1 Schematic diagram of sound pickup in a fixed sound zone in the related art;

[0038] Figure 2 Flowchart of a multi - sound - zone voice acquisition method according to an embodiment of the present disclosure;

[0039] Figure 3 Flowchart of updating the target sound zone corresponding to the first seat in response to a first - state change signal of the first seat where the target object is located in the vehicle cockpit;

[0040] Figure 4 Flowchart of updating the range of the target sound zone corresponding to the first seat according to at least one of a position change signal, an attitude change signal, and a pressure change signal;

[0041] Figure 5 Flowchart of updating the range of the target sound zone corresponding to the first seat according to at least one of a position change signal, an attitude change signal, and a pressure change signal;

[0042] Figure 6 Flowchart of updating the target sound zone corresponding to the first seat in response to the position and attitude changes of the first seat where the target object is located in the vehicle cockpit;

[0043] Figure 7 Flowchart of calibrating the sound zone before updating the target sound zone corresponding to the first seat in response to a first - state change signal of the first seat where the target object is located in the vehicle cockpit;

[0044] Figure 8 Signal flow diagram of multi - sound - zone voice acquisition according to an embodiment of the present disclosure;

[0045] Figure 9 Schematic diagram of updating the target sound zone corresponding to the first seat according to an embodiment of the present disclosure;

[0046] Figure 10 Schematic structural diagram of a multi - sound - zone voice acquisition device according to an embodiment of the present disclosure;

[0047] Figure 11It is a block diagram of an electronic device for implementing the multi - zone voice acquisition method of the present disclosure shown according to an exemplary embodiment;

[0048] Figure 12 It is a schematic structural diagram of a chip according to an embodiment of the present disclosure. Detailed implementation manners

[0049] The embodiments of the present disclosure will be described in detail below. The examples of the embodiments are shown in the drawings, where the same or similar reference numerals identify the same or similar elements or elements with the same or similar functions throughout. The embodiments described by referring to the drawings below are exemplary and are intended to explain the present disclosure, and should not be construed as a limitation to the present disclosure.

[0050] In the field of intelligent cockpit voice interaction, in addition to enabling the vehicle to identify the speaker in the current cockpit and provide personalized services, sound source localization can also achieve directional sound pickup. Due to the high noise inside and outside the vehicle, and the discussions and echoes among passengers will affect the sound pickup quality of voice interaction, sound source localization can enable the microphone array to lock the sound in a certain direction or position. Sound source localization can determine the current speaker based on the set sound zones. If the voice signal collected by the microphone array is located in a certain sound zone among the calibrated multi - zones, then this sound zone is used as the range of the current speaker, so as to continuously collect the voice commands issued by the speaker and respond.

[0051] The sound zones in the cockpit have developed from dual - zones to four - zones. The dual - zone divides the cockpit into the left and right sides, so it is impossible to distinguish whether the speaker is the driver or the passenger on the left side of the second row, and there are relatively large limitations. The four - zone can divide the cockpit into four areas: the driver, the co - driver, the left rear row, and the right rear row, which can better solve the limitation problem of the dual - zone.

[0052] In the actual usage scenario of intelligent cockpit voice interaction, when the driver adjusts the seat to move backward or adjusts the seat back to tilt backward, with the displacement or posture change of the driver's body, a situation of crossing sound zones will occur and enter the sound zone of the left side of the second row. This will cause the ongoing voice interaction between the driver and the in - vehicle computer to be automatically interrupted. The voice interaction system will consider the current speaker as the passenger in the left - hand seat of the second row, thus giving up sound pickup and responding to the commands corresponding to the driver's permissions, while picking up and responding to the voice commands of the passenger in the left - hand seat of the second row. This causes the problem that the driver's adjustment of the seat affects normal voice interaction.

[0053] Figure 1 It is a schematic diagram of sound pickup through fixed sound zones in the related art. As Figure 1As shown in the figure, inside the vehicle cockpit, the main driver's activity space is deployed with a main driver's sound zone, which directionally picks up the voice of the driver. The left space in the second row behind the main driver is deployed with a second row left sound zone, which directionally picks up the voice of the passenger in this seat. The target object, that is, the user or the driver, moves backward or tilts the seat during the voice interaction with the in-vehicle computer. The target object enters the sound zone range of the second row left, resulting in the interruption of the voice interaction between the target object and the in-vehicle computer. During the continuous voice utterance of the target object, the second row left sound zone is awakened, so that the driver's instruction is received by the voice interaction system as the identity of the passenger. Since the voice instruction permission of the passenger is lower than that of the driver, it leads to a poor voice interaction experience when the target object adjusts the seat and causes cross-sound zone.

[0054] The method proposed in this disclosure can be applied to fields such as intelligent cockpit audio software or hardware architectures. The main application scenario of this technology is inside the vehicle, especially excellent in enhancing the driving experience, and can be applied to vehicles with different seat layouts such as four-seater, five-seater, and seven-seater vehicles. For example, when the driver adjusts the seat to a comfortable position, he can still continue the previous voice interaction with the in-vehicle computer, allowing the driver to focus on driving without being distracted due to the change of the sound zone. In addition, this personalized setting can not only improve the comfort and safety of the driver, but also help to enhance the function of the in-vehicle audio system and provide a more personalized audio experience for users. The application scenario is not limited in the embodiments of this disclosure.

[0055] The following will introduce in detail the multi-sound zone voice collection method provided by this application in conjunction with the accompanying drawings.

[0056] Figure 2 It is a flowchart of a multi-sound zone voice collection method according to an embodiment of this disclosure. As Figure 2 shown in the embodiment, the multi-sound zone voice collection method includes:

[0057] Step 201, in response to a first state change signal of a first seat where a target object is located in the vehicle cockpit, update the target sound zone corresponding to the first seat, where the first state change signal includes at least one of a position change signal, an attitude change signal, and a pressure change signal.

[0058] In this embodiment, the target object refers to a passenger or a driver in the vehicle cockpit. Preferably, the target object is the driver. The first seat refers to the seat on which the target object is currently sitting in the vehicle cockpit. The target sound area is the sound area corresponding to the first seat of the target object. The first state change signal refers to a signal indicating a state change of the first seat, including at least one of a position change signal, an attitude change signal, and a pressure change signal. The position change signal refers to a signal indicating a displacement of the first seat in the front-rear direction. The attitude change signal refers to a signal indicating an angle change between the backrest part and the seat cushion part of the first seat. The pressure change signal refers to a signal indicating a change in the pressure value collected by a sensor deployed on the backrest part of the seat. When the first seat of the target object detects the first state change signal, it triggers an update of the target sound area corresponding to the first seat. For example, if the driver adjusts the seat to move backward or the backrest to tilt backward, it triggers the first state change signal of the first seat, thereby expanding the sound area corresponding to the original first seat to the target sound area, and the target sound area includes the sound area corresponding to the first seat and part or all of the sound area behind the first seat.

[0059] Step 202: Collect the voice signal of the target object within the target sound area.

[0060] In this embodiment, after updating the target sound area of the first seat of the target object, in order to enable the continuous voice interaction between the target object and the in-vehicle computer in the cockpit, the voice signal within the updated target sound area is continuously picked up as the voice signal of the target object.

[0061] In summary, according to the multi-sound area voice collection method proposed by the present disclosure, in response to the first state change signal of the first seat where the target object is located in the vehicle cockpit, the target sound area corresponding to the first seat is updated, where the first state change signal includes at least one of a position change signal, an attitude change signal, and a pressure change signal, and the sound area range is intelligently adjusted according to the attitude of the target object, providing a basis for multi-sound area voice collection; collecting the voice signal of the target object within the target sound area maintains the continuity of the voice interaction of the target object. The user experience of voice interaction in the cockpit is improved.

[0062] Figure 3 It is a flowchart of updating the target sound area corresponding to the first seat in response to the first state change signal of the first seat where the target object is located in the vehicle cockpit according to an embodiment of the present disclosure. Figure 3 It is a further description of Figure 2 Step 201, based on the Figure 3 shown embodiment, includes the following steps:

[0063] Step 301: Monitor the first displacement, the first tilt angle, and the first pressure value of the first seat.

[0064] In this embodiment, the first displacement refers to the displacement value of the first seat in the front-back direction, the first tilt angle refers to the forward or backward tilt value of the backrest of the first seat, and the first pressure value refers to the pressure value detected by the backrest of the first seat. Monitoring the first displacement, the first tilt angle, and the first pressure value of the first seat can provide a data basis for the state change of the first seat.

[0065] Step 302, if the first displacement is greater than or equal to the first distance threshold, trigger a position change signal.

[0066] In this embodiment, the first distance threshold is a threshold used to characterize a relatively large value of the first displacement of the first seat. If the first displacement is greater than or equal to the first distance threshold, it indicates that the front-back displacement of the first seat is relatively large, and a position change signal is triggered.

[0067] Step 303, if the first tilt angle is greater than or equal to the first angle threshold, trigger an attitude change signal.

[0068] In this embodiment, the first angle threshold is a threshold used to characterize a relatively large first tilt angle of the backrest of the first seat. If the first tilt angle is greater than or equal to the first angle threshold, it indicates that the tilt angle of the backrest of the first seat is relatively large, and an attitude change signal is triggered.

[0069] Step 304, if the first pressure value is greater than or equal to the first pressure threshold, trigger a pressure change signal.

[0070] In this embodiment, the first pressure threshold is a threshold used to characterize a relatively large first pressure value detected by the backrest of the first seat. If the first pressure value is greater than or equal to the first pressure threshold, it indicates that the backrest of the first seat is in a state of being squeezed backward, and a pressure change signal is triggered.

[0071] Step 305, update the range of the target sound zone corresponding to the first seat according to at least one of the position change signal and the attitude change signal and the pressure change signal.

[0072] In this embodiment, the range of the target sound zone refers to the area formed in space for microphone directional sound pickup. Update the range of the target sound zone corresponding to the first seat according to at least one of the position change signal and the attitude change signal and the pressure change signal.

[0073] In this embodiment, by monitoring the state of the first seat, in response to the first state change signal of the target object in the first seat in the vehicle cockpit, the target sound zone corresponding to the first seat is updated. In other words, the sound zone range is intelligently adjusted according to the attitude of the target object, providing a basis for multi-zone voice collection. For updating the target sound zone, there are also the following methods that can be implemented.

[0074] Figure 4A flowchart for updating the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, and the pressure change signal in an embodiment of the present disclosure. Figure 4 is a specific description of Figure 3 step 305 of Figure 4 The embodiment shown includes the following steps:

[0075] Step 401, if the position change signal, the attitude change signal, and the pressure change signal are all triggered, determine that the range of the target sound zone corresponding to the first seat is the preset sound zone range.

[0076] In this embodiment, the preset sound zone range refers to the maximum sound zone range of the first seat set in advance. When the position change signal, the attitude change signal, and the pressure change signal of the first seat are triggered simultaneously, it indicates that the user is making a large adjustment to the first seat. Then, update the range of the target sound zone corresponding to the first seat to the preset sound zone range. Thus, ensure that the user's original sound zone is quickly switched to a larger sound zone to guarantee the continuity of voice interaction. For the target sound zone, there are also the following methods for updating.

[0077] Figure 5 A flowchart for updating the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, and the pressure change signal in an embodiment of the present disclosure. Figure 5 is a specific description of Figure 3 step 305 of Figure 5 The embodiment shown includes the following steps:

[0078] Step 501, determine the range of the target sound zone of the first seat according to the mapping table between at least one of the value of the position change signal, the value of the attitude change signal, and the value of the pressure change signal and the preset sound zone range.

[0079] In this embodiment, the value of the position change signal refers to the displacement value of the first seat in the front-back direction, with the unit of meter (m) or centimeter (cm). The value of the attitude change signal refers to the angle value formed by the backrest and the seat cushion of the first seat, with the unit of degree (°). The value of the pressure change signal refers to the pressure value of the target object detected by the backrest of the first seat, expressed in voltage or current. Preferably, the pressure change value is expressed in voltage, with the unit of volt (V). The mapping table between at least one of the value of the position change signal, the value of the attitude change signal, and the value of the pressure change signal and the preset sound zone range refers to the mapping table formed by using at least one of the value of the position change signal, the value of the attitude change signal, and the value of the pressure change signal of the first seat and the corresponding value of the target range of the target sound zone to be updated in the test environment before leaving the factory. For example, when the first seat moves backward by 1 cm, the target sound zone of the first seat can be extended backward by 5 cm based on the original target sound zone of the first seat. Or, when the backrest of the first seat tilts backward by 5°, the target sound zone of the first seat can be extended backward by 10 cm. Or, when the value of the pressure change signal of the first seat is 10 V, the first seat moves backward by 2 cm, and the backrest of the first seat tilts backward by 10°, the target sound zone of the first seat can be extended backward by 15 cm. The target sound zone can also be updated by the following method.

[0080] Figure 6 It is a flowchart for updating the target sound zone corresponding to the first seat in response to the position and attitude changes of the target object in the first seat in the vehicle cockpit according to an embodiment of the present disclosure. Figure 6 It is a further description of Figure 2 Step 201 of, based on Figure 6 The embodiment shown includes the following steps:

[0081] Step 601, monitor the first displacement, the first tilt angle, the first pressure value of the first seat, and the second pressure value of the second seat, where the second seat corresponds to an adjacent sound zone to the first seat.

[0082] In this embodiment, the second seat refers to the seat adjacent to the first seat in the vehicle cockpit, corresponding to a different sound zone from the first seat. The second pressure value refers to the pressure value generated by the extrusion detected by the backrest of the second seat. Monitor the state change signal of the first seat, that is, the first displacement, the first tilt angle, the first pressure value, and the second pressure value of the second seat.

[0083] Step 602, if the first displacement is greater than or equal to the first distance threshold, trigger the position change signal.

[0084] In this embodiment, if the first displacement of the first seat is greater than or equal to the first distance threshold, it means that the displacement of the first seat in the front-back direction is relatively large, and then the position change signal is triggered.

[0085] Step 603, if the first tilt angle is greater than or equal to the first angle threshold, trigger an attitude change signal.

[0086] In this embodiment, if the first tilt angle of the first seat is greater than or equal to the first angle threshold, it indicates that the backrest of the first seat has tilted significantly, and then an attitude change signal is triggered.

[0087] Step 604, if the first pressure value is greater than or equal to the first pressure threshold, trigger a pressure change signal.

[0088] In this embodiment, if the first pressure value of the first seat is greater than or equal to the first pressure threshold, it indicates that the backrest of the first seat has been significantly squeezed, and then a pressure change signal is triggered.

[0089] Step 605, if the second pressure value is less than or equal to the second pressure threshold, trigger a second seat unoccupied signal, where the second seat unoccupied signal is a signal indicating that the seat adjacent to the first seat in the vehicle cockpit is unoccupied.

[0090] In this embodiment, the second pressure threshold is a threshold used to characterize that the pressure generated by the squeeze detected by the backrest of the second seat is small, and the second seat unoccupied signal is a signal generated when no pressure is detected on the second seat, that is, it indicates that no one is sitting on this seat. If the second pressure value is less than or equal to the second pressure threshold, it means that the second seat is unoccupied, and the second seat unoccupied signal is triggered.

[0091] Step 606, update the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, the pressure change signal, and the second seat unoccupied signal.

[0092] In this embodiment, according to at least one of the position change signal, the attitude change signal, the pressure change signal, and the second seat unoccupied signal of the first seat, it can be used to update the range of the target sound zone corresponding to the first seat. The specific update method is similar to Figure 5 Step 501 of the above embodiment, and the second seat unoccupied signal is added on the basis of step 501. For example, if the second seat unoccupied signal is true, the value of the pressure change signal of the first seat is 10V, the first seat moves backward 2 cm, and the backrest of the first seat tilts backward 10°, the target sound zone of the first seat can be extended backward by 20 cm. That is, to ensure that when the second seat is unoccupied, the target sound zone of the first seat can occupy more areas of the sound zone of the second seat, so as to ensure a good experience for the voice interaction of the target object of the first seat. Before using the area determined by the sound zone, it is necessary to calibrate the sound zone.

[0093] Figure 7A flowchart for calibrating a sound zone before updating a target sound zone corresponding to a first seat in response to a first state change signal of a target object in a vehicle cockpit. Figure 7 is a further description of Figure 2 step 201 of, based on Figure 7 the embodiment shown, includes the following steps:

[0094] Step 701, collect a calibration sound signal through a microphone array deployed inside the vehicle cockpit.

[0095] In this embodiment, the microphone array refers to a system composed of a certain number of microphones, which can be divided into a linear array, a planar array, and a three-dimensional array according to the layout shape. The calibration sound signal is a sound signal collected by emitting sounds in all pre-divided sound zones based on the microphone array deployed inside the vehicle cockpit, and associating the sound signal with the divided sound zones, thereby forming a calibration sound signal.

[0096] Step 702, perform sound zone calibration on the vehicle cockpit according to the calibration sound signal to generate at least two sound zones.

[0097] In this embodiment, sound zone calibration refers to the process of dividing and confirming the sound pickup area of the microphone array inside the vehicle cockpit to pre-determine the sound zones. Sound zone calibration generates at least two sound zones. Through this sound zone determination method, multiple different sound zones inside the vehicle cockpit are obtained, providing a basis for updating the target sound zone range.

[0098] Figure 8It is a signal flow diagram of multi-zone voice acquisition according to an embodiment of the present disclosure. In this embodiment, the voice engine VoiceEngine is instantiated as instance, and based on the vehicle factory attributes, the in-vehicle matrix signal service of the vehicle service CarService is registered, and the registered instance object is returned. Then, a seat property event SeatPropertyEvent instance of the cache event CacheEvent and the seat property event processor SeatPropertyEventProcessor is created to return the vehicle factory attribute CarPropertyFactory. The vehicle service CarService listens to the data of each vehicle sensor through the property event onPropertyEvent and synchronizes it to the vehicle factory attribute CarPropertyFactory. The cache event CacheEvent created according to the vehicle factory attributes listens to the signal changes such as seat pressure, angle, and displacement recorded by the seat property event processor SeatPropertyEventProcessor. The voice engine VoiceEngine is notified by the update event updateEvent, and then the voice area processing module VoiceAreaProcess of the acoustic front-end processing engine (Speech Enhancement Software Engine, SSE) is notified by updating the seat signal updateSeatSignal. The voice area processing module expands the voice area range corresponding to the driver's seat position when the front-back position of the seat, the backrest angle, and the backrest pressure reach the set thresholds, and the seat pressure signal of the left second-row seat is in the unoccupied state. The co-pilot seat can be adjusted in the same way. This improves the accuracy of voice wake-up and recognition when the user lies back in the driver's or co-pilot seat, and enhances the voice interaction experience in the cockpit.

[0099] Figure 9 It is a schematic diagram of updating the target voice area corresponding to the first seat according to an embodiment of the present disclosure. In this embodiment, as Figure 9 shown, the normal four-zone range is divided into four voice area ranges according to the four seats in the vehicle cockpit, namely the driver's seat voice area, the co-pilot seat voice area, the left second-row seat voice area, and the right second-row seat voice area. Each voice area represents different sound sources and characteristics in the vehicle. After the driver adjusts the seat, the voice area of the driver's seat in the voice area range expands from the original area above the dotted line to the gray area, maintaining the continuity of the voice interaction between the driver and the in-vehicle computer and improving the user experience of voice interaction in the cockpit.

[0100] An embodiment of the present disclosure provides a multi - zone voice acquisition method. In response to a first - state change signal of a first seat where a target object is located in a vehicle cockpit, the target sound zone corresponding to the first seat is updated. The first - state change signal includes at least one of a position - change signal and an attitude - change signal and a pressure - change signal. The sound - zone range is intelligently adjusted according to the attitude of the target object, providing a basis for multi - zone voice acquisition; the voice signal of the target object within the target sound zone is collected, maintaining the continuity of the voice interaction of the target object. The user experience of voice interaction in the cockpit is improved.

[0101] Corresponding to the methods provided in the above - mentioned several embodiments, the present disclosure also provides a multi - zone voice acquisition device. Since the device provided in the embodiment of the present disclosure corresponds to the methods provided in the above - mentioned several embodiments, the implementation manners of the methods are also applicable to the device provided in this embodiment and will not be described in detail in this embodiment.

[0102] Figure 10 A schematic structural diagram of a multi - zone voice acquisition device 1000 according to an embodiment of the present disclosure. As Figure 10 shown, the multi - zone voice acquisition device includes:

[0103] A sound - zone update module 1010, configured to update the target sound zone corresponding to the first seat in response to a first - state change signal of the first seat where a target object is located in a vehicle cockpit, where the first - state change signal includes at least one of a position - change signal and an attitude - change signal and a pressure - change signal;

[0104] A voice acquisition module 1020, configured to collect the voice signal of the target object within the target sound zone.

[0105] In some embodiments, the sound - zone update module 1010 is configured to:

[0106] Monitor the first displacement, the first tilt angle, and the first pressure value of the first seat;

[0107] If the first displacement is greater than or equal to the first distance threshold, trigger a position - change signal;

[0108] If the first tilt angle is greater than or equal to the first angle threshold, trigger an attitude - change signal;

[0109] If the first pressure value is greater than or equal to the first pressure threshold, trigger a pressure - change signal;

[0110] Update the range of the target sound zone corresponding to the first seat according to at least one of the position - change signal and the attitude - change signal and the pressure - change signal.

[0111] In some embodiments, the sound zone update module 1010 updates the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, and the pressure change signal in the following manner:

[0112] If the position change signal, the attitude change signal, and the pressure change signal are all triggered, determine that the range of the target sound zone corresponding to the first seat is the preset sound zone range.

[0113] In some embodiments, the sound zone update module 1010 also updates the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, and the pressure change signal in the following manner:

[0114] Determine the range of the target sound zone of the first seat according to a mapping table between at least one of the value of the position change signal, the value of the attitude change signal, and the value of the pressure change signal and the preset sound zone range.

[0115] In some embodiments, the sound zone update module 1010 is further configured to:

[0116] Monitor the first displacement, the first tilt angle, the first pressure value of the first seat, and the second pressure value of the second seat, where the second seat corresponds to an adjacent sound zone to the first seat;

[0117] If the first displacement is greater than or equal to the first distance threshold, trigger the position change signal;

[0118] If the first tilt angle is greater than or equal to the first angle threshold, trigger the attitude change signal;

[0119] If the first pressure value is greater than or equal to the first pressure threshold, trigger the pressure change signal;

[0120] If the second pressure value is less than or equal to the second pressure threshold, trigger the second seat unoccupied signal, where the second seat unoccupied signal is a signal indicating that the seat adjacent to the first seat in the vehicle cockpit is unoccupied;

[0121] Update the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, the pressure change signal, and the second seat unoccupied signal.

[0122] In some embodiments, before the sound zone update module 1010 updates the target sound zone corresponding to the first seat in response to a first state change signal of a target object in the first seat in the vehicle cockpit, it is further configured to:

[0123] Collect a calibrated sound signal through a microphone array deployed inside the vehicle cockpit;

[0124] Perform sound zone calibration on the vehicle cockpit according to the calibrated sound signal to generate at least two sound zones.

[0125] In summary, through the multi-zone voice acquisition device, in response to the first state change signal of the first seat where the target object is located in the vehicle cockpit, the target sound zone corresponding to the first seat is updated, where the first state change signal includes at least one of a position change signal, an attitude change signal, and a pressure change signal; and the voice signal of the target object in the target sound zone is collected. This device solves the problem that the driver's seat adjustment in the cockpit affects normal voice interaction, and improves the user experience of voice interaction in the cockpit. In addition, the application scenarios of this device are rich and can be applied in scenarios such as intelligent vehicles, human-computer interaction, games, and virtual reality.

[0126] In the above embodiments provided by the present application, the methods and devices provided by the embodiments of the present application are introduced. In order to implement the various functions in the methods provided by the above embodiments of the present application, the electronic device may include a hardware structure, a software module, and implement the above various functions in the form of a hardware structure, a software module, or a combination of a hardware structure and a software module. A certain function among the above various functions may be executed in the form of a hardware structure, a software module, or a combination of a hardware structure and a software module.

[0127] Figure 11 It is a block diagram of an electronic device 1100 for implementing the above multi-zone voice acquisition method shown according to an exemplary embodiment.

[0128] For example, the electronic device 1100 may be a mobile phone, a computer, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0129] Referring to Figure 11 , the electronic device 1100 may include one or more of the following components: a processing component 1102, a memory 1104, a power supply component 1106, a multimedia component 1108, an audio component 1110, an input / output (I / O) interface 1112, a sensor component 1114, and a communication component 1116.

[0130] The processing component 1102 generally controls the overall operation of the electronic device 1100, such as operations associated with display, telephone calls, data communication, camera operations, and recording operations. The processing component 1102 may include one or more processors 1120 to execute instructions to complete all or part of the steps of the above methods. In addition, the processing component 1102 may include one or more modules to facilitate the interaction between the processing component 1102 and other components. For example, the processing component 1102 may include a multimedia module to facilitate the interaction between the multimedia component 1108 and the processing component 1102.

[0131] The memory 1104 is configured to store various types of data to support the operation of the electronic device 600. Examples of such data include instructions for any application or method operating on the electronic device 1100, contact data, phone book data, messages, pictures, videos, and the like. The memory 1104 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0132] The power supply component 1106 provides power to various components of the electronic device 1100. The power supply component 1106 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 1100.

[0133] The multimedia component 1108 includes a screen that provides an output interface between the electronic device 1100 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can not only sense the boundaries of touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 1108 includes a front camera and / or a rear camera. When the electronic device 1100 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0134] The audio component 1110 is configured to output and / or input audio signals. For example, the audio component 1110 includes a microphone (MIC) that is configured to receive external audio signals when the electronic device 1100 is in an operating mode, such as a call mode, a recording mode, and a voice collection mode. The received audio signals can be further stored in the memory 1104 or transmitted via the communication component 1116. In some embodiments, the audio component 1110 further includes a speaker for outputting audio signals.

[0135] The I / O interface 1112 provides an interface between the processing component 1102 and a peripheral interface module, which can be a keyboard, a click wheel, buttons, etc. These buttons can include, but are not limited to: a home button, a volume button, a start button, and a lock button.

[0136] The sensor assembly 1114 includes one or more sensors for providing status assessments of various aspects for the electronic device 1100. For example, the sensor assembly 1114 can detect the on / off state of the electronic device 1100, the relative positioning of components, such as components for the display and keypad of the electronic device 1100. The sensor assembly 1114 can also detect a change in the position of the electronic device 1100 or a component of the electronic device 1100, the presence or absence of user contact with the electronic device 1100, the orientation or acceleration / deceleration of the electronic device 1100, and a change in the temperature of the electronic device 1100. The sensor assembly 1114 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 1114 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1114 can also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0137] The communication component 1116 is configured to facilitate communication between the electronic device 1100 and other devices in a wired or wireless manner. The electronic device 1100 can access a wireless network based on communication standards, such as WiFi, 2G or 3G, 4G LTE, 5G NR (New Radio), or a combination thereof. In an exemplary embodiment, the communication component 1116 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 1116 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0138] In an exemplary embodiment, the electronic device 1100 can be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above-described methods.

[0139] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1104 including instructions, and the above instructions can be executed by a processor 1120 of the electronic device 1100 to complete the above-described methods. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0140] Embodiments of the present disclosure also propose a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause a computer to execute the multi-zone voice acquisition method described in the above embodiments of the present disclosure.

[0141] Embodiments of the present disclosure also propose a computer program product, including a computer program, where the computer program, when executed by a processor, implements the multi-zone voice acquisition method described in the above embodiments of the present disclosure.

[0142] Figure 12 FIG. 1200 is a schematic structural diagram of a chip 1200 for implementing the above multi-zone voice acquisition method according to an exemplary embodiment.

[0143] Referring to Figure 12 , the chip 1200 includes at least one communication interface 1201 and a processor 1202; the communication interface 1201 is configured to receive signals input to the chip 1200 or signals output from the chip 1200, and the processor 1202 communicates with the communication interface 1201 and implements the multi-zone voice acquisition method described in the above embodiments through logic circuits or by executing code instructions.

[0144] It should be noted that the terms "first", "second", etc. in the description of the present disclosure, the specification and the claims, and the above drawings are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances, so that the embodiments of the present disclosure described herein can be implemented in an order different from those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0145] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples", etc. means that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic descriptions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0146] Any process or method description represented in a flowchart or otherwise described herein can be understood to represent a module, segment, or portion of code including one or more executable instructions for implementing a specific logical function or process, and the scope of the preferred embodiments of the present disclosure includes additional implementations, where functions may be executed in a manner that is not shown or discussed, including in a substantially simultaneous manner according to the functions involved or in a reverse order, which should be understood by those skilled in the art to which the embodiments of the present disclosure pertain.

[0147] The logic and / or steps represented in a flowchart or otherwise described herein, for example, can be considered a sequenced list of executable instructions for implementing a logical function, and can be embodied specifically in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, a system including a processing module, or other systems that can fetch and execute instructions from the instruction execution system, apparatus, or device. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium include the following: an electrical connection having one or more wirings (control method), a portable computer diskette (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can even be paper or other suitable medium on which a program can be printed, as the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpretation, or other suitable processing as necessary, and then stored in a computer memory.

[0148] It should be understood that various parts of the embodiments of the present disclosure can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or a combination of the following techniques known in the art can be used: discrete logic circuits having logic gate circuits for implementing logical functions on data signals, application specific integrated circuits having appropriate combinational logic gate circuits, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), and the like.

[0149] Those of ordinary skill in the art can understand that all or part of the steps carried out in implementing the above-described embodiment methods can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiment.

[0150] In addition, in each of the various embodiments of the present disclosure, the functional units can be integrated in a processing module, or each unit can exist physically alone, or two or more units can be integrated in a module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module. When the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. The above-mentioned storage medium can be a read-only memory, a magnetic disk, an optical disk, or the like.

[0151] Although the embodiments of the present disclosure have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present disclosure. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present disclosure.

Claims

1. A multi-region voice acquisition method, characterized in that, The method includes: In response to a first state change signal of a first seat where a target object is located in a vehicle cockpit, updating a target sound zone corresponding to the first seat, where the first state change signal includes at least one of a position change signal and an attitude change signal and a pressure change signal; Collecting a voice signal of the target object within the target sound zone.

2. The method according to claim 1, wherein The updating of the target sound zone corresponding to the first seat in response to the first state change signal of the first seat where the target object is located in the vehicle cockpit includes: Monitoring a first displacement, a first tilt angle, and a first pressure value of the first seat; If the first displacement is greater than or equal to a first distance threshold, triggering the position change signal; If the first tilt angle is greater than or equal to a first angle threshold, triggering the attitude change signal; If the first pressure value is greater than or equal to a first pressure threshold, triggering the pressure change signal; Updating the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, and the pressure change signal.

3. The method according to claim 2, wherein, The updating of the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, and the pressure change signal includes: If the position change signal, the attitude change signal, and the pressure change signal are all triggered, determining the range of the target sound zone corresponding to the first seat as a preset sound zone range.

4. The method according to claim 2, wherein The updating of the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, and the pressure change signal further includes: Determining the range of the target sound zone of the first seat according to a mapping table between at least one of the value of the position change signal, the value of the attitude change signal, and the value of the pressure change signal and the preset sound zone range.

5. The method according to claim 1, characterized in that The updating of the target sound zone corresponding to the first seat in response to the position and attitude changes of the first seat where the target object is located in the vehicle cockpit further includes: Monitoring a first displacement, a first tilt angle, a first pressure value of the first seat, and a second pressure value of a second seat, where the second seat corresponds to an adjacent sound zone to the first seat; If the first displacement is greater than or equal to a first distance threshold, triggering the position change signal; If the first tilt angle is greater than or equal to a first angle threshold, triggering the attitude change signal; If the first pressure value is greater than or equal to a first pressure threshold, triggering the pressure change signal; If the second pressure value is less than or equal to a second pressure threshold, triggering a second seat unoccupied signal, where the second seat unoccupied signal is a signal indicating that the seat adjacent to the first seat in the vehicle cockpit is unoccupied; Updating the range of the target sound zone corresponding to the first seat according to at least one of the position change signal, the attitude change signal, the pressure change signal, and the second seat unoccupied signal.

6. The method according to claim 1, wherein Before updating the target sound zone corresponding to the first seat in response to the first state change signal of the first seat where the target object is located in the vehicle cockpit, it further includes: Collect a calibrated sound signal through a microphone array deployed inside the vehicle cockpit; Perform sound zone calibration on the vehicle cockpit according to the calibrated sound signal to generate at least two sound zones.

7. A multi - tone - area voice acquisition device, characterized in that, The device includes: A sound zone update module, configured to update a target sound zone corresponding to the first seat in response to a first state change signal of a target object in the vehicle cockpit, where the first state change signal includes at least one of a position change signal and an attitude change signal and a pressure change signal; A voice collection module, configured to collect a voice signal of the target object in the target sound zone.

8. An electronic device, characterized in that, Including: At least one processor; And A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method according to any one of claims 1-6.

9. A non-transitory computer-readable storage medium storing computer instructions, characterized in that, The computer instructions are used to cause the computer to execute the method according to any one of claims 1-6.

10. A chip, characterized in that, Including at least one processor and a communication interface; the communication interface is configured to receive a signal input to the chip or a signal output from the chip, and the processor communicates with the communication interface and implements the method according to any one of claims 1-6 through a logic circuit or by executing code instructions.

Images