Sound processing method, device, vehicle, electronic equipment and medium

By working together with the microphone groups inside and outside the car to filter and match the sounds outside the car, the problem of external sounds interfering with the driver is solved, important sounds are reminded, and the driving experience and safety are improved.

CN116072138BActive Publication Date: 2025-10-03ZHEJIANG LIANKONG TECH CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310009411.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-01-03
Publication Date
2025-10-03
Estimated Expiration
2043-01-03

AI Technical Summary

Technical Problem

Existing technologies cannot effectively distinguish whether sounds outside the vehicle require the driver's attention, resulting in irrelevant sounds disturbing the driver and affecting the driving experience.

Method used

Through the coordinated work of the microphone group inside the car and the microphone group outside the car, the same parts of the sound outside the car are filtered out and matched with the sound information stored in the vehicle to determine whether the sound outside the car is directed at the vehicle itself, and a reminder is given inside the vehicle.

Benefits of technology

It improves the driving experience, prevents interference from irrelevant sounds, ensures that the driver can obtain important external information in a timely manner, and improves safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116072138B_ABST
    Figure CN116072138B_ABST
Patent Text Reader

Abstract

The present invention provides a sound processing method, device, vehicle, electronic device and medium, which are applied to a vehicle, wherein the vehicle includes: an in-vehicle microphone group and an out-vehicle microphone group; the method includes: when the in-vehicle sound received by the in-vehicle microphone group exceeds a preset threshold, filtering out the same sound part in the out-vehicle sound received by the out-vehicle microphone group; comparing the filtered out-vehicle sound with the sound information stored in the vehicle, and determining that the filtered out-vehicle sound and the sound information stored in the vehicle match; the sound information stored in the vehicle is a sound that requires the driver's attention; determining that the filtered out-vehicle sound is a sound directed at the own vehicle; and in response to the fact that the filtered out-vehicle sound matches the sound information stored in the vehicle, and the filtered out-vehicle sound is a sound directed at the own vehicle, making a reminder inside the vehicle regarding the filtered out-vehicle sound.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a sound processing method, device, vehicle, electronic equipment and medium. Background Art

[0002] In the prior art, when media is played in the car or children are making noise, the sound may be very loud, and the driver cannot hear the horn sound outside due to interference, so that the driver cannot make an accurate judgment on the current road conditions.

[0003] Existing technology uses an external microphone to receive sounds outside the vehicle. When the received external sound exceeds a threshold, the sound picked up by the external microphone is played inside the vehicle, while the media volume inside the vehicle is reduced. However, this method cannot distinguish whether the received sound is the sound that the driver needs to hear. The sound received may be a horn or other noise that is irrelevant to driving. This method can cause irrelevant sounds to disturb the driver inside the vehicle, affecting the driver's experience. Summary of the Invention

[0004] To overcome the problems existing in the related art, the present invention provides a sound processing method, device, vehicle, electronic equipment and medium.

[0005] According to a first aspect of an embodiment of the present invention, there is provided a sound processing method for a vehicle, the vehicle comprising: an in-vehicle microphone group and an out-vehicle microphone group; the method comprising:

[0006] When the in-car sound received by the in-car microphone group exceeds a preset threshold, filtering out the same sound portion of the outside-car sound received by the outside-car microphone group, wherein the same sound portion is the same as the in-car sound in the outside-car sound received by the outside-car microphone group;

[0007] comparing the filtered sound outside the vehicle with the sound information stored in the vehicle to determine whether the filtered sound outside the vehicle and the sound information stored in the vehicle match; and determining that the sound information stored in the vehicle is a sound requiring the driver's attention;

[0008] Determining that the filtered external sound is a sound directed at the own vehicle;

[0009] In response to the filtered sound outside the vehicle matching the sound information stored in the vehicle, and the filtered sound outside the vehicle is a sound for the vehicle itself, a reminder is made inside the vehicle regarding the filtered sound outside the vehicle.

[0010] Preferably, when the in-car sound received by the in-car microphone group exceeds a preset threshold, the method includes:

[0011] When the vehicle doors and windows are closed, the in-vehicle sound received by the in-vehicle microphone group exceeds the preset threshold.

[0012] Preferably, the method further comprises:

[0013] Before comparing the filtered external sound with the sound information stored in the vehicle, irrelevant noise in the external sound received by the external microphone group is filtered out. The irrelevant noise is ambient sound that does not affect the driving of the vehicle.

[0014] Preferably, the off-vehicle microphone group includes: at least two microphones;

[0015] Determining whether the filtered external sound is directed to the vehicle itself includes:

[0016] determining a source direction of the filtered external sound according to a time difference between different microphones in the external microphone group receiving the filtered external sound;

[0017] In response to the source direction being a preset direction, the filtered external vehicle sound is determined to be a sound directed to the own vehicle.

[0018] Preferably, determining whether the filtered sound outside the vehicle matches the sound information stored in the vehicle comprises: if the filtered sound outside the vehicle matches a preset category of sound in the sound information stored in the vehicle, determining that the filtered sound outside the vehicle is the preset category of sound;

[0019] Determining that the filtered sound outside the vehicle is a sound directed at the own vehicle includes: in response to the filtered sound outside the vehicle being the preset category sound, determining that the filtered sound outside the vehicle is a sound directed at the own vehicle.

[0020] Preferably, making a reminder inside the vehicle for the filtered sound outside the vehicle includes:

[0021] The media sound inside the vehicle is reduced, and the filtered outside vehicle sound is played at a position inside the vehicle corresponding to the source direction of the filtered outside vehicle sound.

[0022] According to a second aspect of an embodiment of the present invention, there is provided a sound processing device for use in a vehicle, the vehicle comprising an in-vehicle microphone group and an out-vehicle microphone group; the device comprising: an out-vehicle sound filtering module, a sound matching determination module, a sound targeting determination module, and a vehicle state adjustment module;

[0023] The exterior sound filtering module is configured to filter out the identical sound portion of the exterior sound received by the exterior microphone group when the interior sound received by the interior microphone group exceeds a preset threshold, wherein the identical sound portion is the identical sound portion of the exterior sound received by the exterior microphone group with the interior sound;

[0024] The sound matching determination module is configured to compare the filtered external sound with the sound information stored in the vehicle to determine whether the filtered external sound and the sound information stored in the vehicle match; and the sound information stored in the vehicle is a sound requiring the driver's attention.

[0025] The sound targeting determination module is used to determine whether the filtered external sound is a sound targeting the vehicle itself;

[0026] The vehicle status adjustment module is used to respond to the matching of the filtered external sound with the sound information stored in the vehicle, and the filtered external sound is the sound of the vehicle itself, and make a reminder of the filtered external sound inside the vehicle.

[0027] According to a third aspect of an embodiment of the present invention, there is provided a vehicle, comprising: an in-vehicle microphone group, an out-vehicle microphone group, and a processing device;

[0028] The in-car microphone group is used to receive sounds inside the car;

[0029] The external microphone group is used to receive sounds outside the vehicle;

[0030] The processing device is used to obtain the in-vehicle sound and the out-vehicle sound and execute the above-mentioned sound processing method.

[0031] According to a fourth aspect of an embodiment of the present invention, there is provided an electronic device, comprising: a processor and a memory for storing processor-executable instructions; wherein the processor implements the above-mentioned sound processing method by running the executable instructions.

[0032] According to a fifth aspect of an embodiment of the present invention, a computer-readable storage medium is provided, on which computer instructions are stored. When the instructions are executed by a processor, the steps of the above-mentioned sound processing method are implemented.

[0033] The technical solutions provided by the embodiments of the present invention may have the following beneficial effects:

[0034] In this embodiment of the present invention, two microphones are provided, one inside and one outside the vehicle. When the sound received by the interior microphone set exceeds a threshold, the exterior microphone set is used to receive the sound outside the vehicle. The sound outside the vehicle and the sound received by the interior microphone set are compared and filtered. The processed exterior sound is then matched with the sound information stored within the vehicle system to determine whether the received sound is a pre-stored sound. The driver is also assessed to determine whether the sound is intended for the vehicle. If all of these steps match, the received sound is determined to be a sound that the driver needs to hear, and a reminder is issued within the vehicle.

[0035] In the above series of steps, the in-car microphone first confirms that the current in-car sound requires this function to be enabled before proceeding to the subsequent steps, which can reduce the operating load of the in-car system. After the external sound is enabled, a series of steps are performed to determine if the sound currently received by the external microphone is a sound that the driver needs to hear, then the vehicle status is adjusted and a reminder is issued. This can effectively improve the driving experience and prevent the impact of irrelevant sounds.

[0036] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The accompanying drawings herein are incorporated into the specification and constitute a part of the present invention, illustrate embodiments consistent with the present invention, and together with the description, are used to explain the technical solutions of the present invention.

[0038] Figure 1 This is a flowchart of a sound processing method provided by an exemplary embodiment.

[0039] Figure 1A is a detailed flow chart provided according to an exemplary embodiment.

[0040] Figure 1B is a detailed flow chart provided according to an exemplary embodiment.

[0041] Figure 2 FIG. 1 is a diagram of microphone arrangement provided by an exemplary embodiment.

[0042] Figure 3 It is a structural diagram of a sound processing device provided by an exemplary embodiment. DETAILED DESCRIPTION

[0043] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with this specification. Rather, they are merely examples of apparatus and methods consistent with certain aspects of this specification, as detailed in the appended claims.

[0044] The terms used in this specification are for the purpose of describing specific embodiments only and are not intended to limit the present invention. As used in this specification and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.

[0045] It should be understood that although the terms first, second, third, etc. may be used in this specification to describe various information, such information should not be limited to these terms. These terms are merely used to distinguish information of the same type from one another. For example, first information may also be referred to as second information, and similarly, second information may also be referred to as first information without departing from the scope of this specification. Depending on the context, the term "if" as used herein may be interpreted as "when," "when," or "in response to determining."

[0046] In order to improve the problem that the driver cannot hear the sound outside the car clearly when the sound inside the car is too loud, the present invention provides a sound processing method. The method will be described in detail below through exemplary embodiments, but should not be limited to this.

[0047] Figure 1 This is a flow chart of a sound processing method provided by an exemplary embodiment, wherein the sound processing method is applied to a vehicle, wherein the vehicle includes: an in-vehicle microphone group and an out-vehicle microphone group. Figure 1 As shown, the method may include the following processing:

[0048] In step S101, when the in-car sound received by the in-car microphone group exceeds a preset threshold, the same sound portion of the outside-car sound received by the outside-car microphone group is filtered out, where the same sound portion is the same as the in-car sound in the outside-car sound received by the outside-car microphone group.

[0049] The in-car microphone group and the out-car microphone group are used to receive sounds inside the car and outside the car, respectively. The system first determines whether the sound received by the in-car microphone group exceeds a preset threshold, indicating that the sound inside the car is too loud. If the sound received by the in-car microphone group exceeds the preset threshold, the out-car sound received by the out-car microphone group is processed, filtering out any portion of the out-car sound received by the out-car microphone group that is identical to the in-car sound. The in-car sound refers to the sound received by the in-car microphone group, and the filtered-out identical portion is the sound received by both the in-car microphone group and the out-car microphone group.

[0050] For example, when the sound inside the car is not too loud, the driver inside can hear the sound outside the car. In this case, there is no need to use the external microphone to receive the external sound and perform a series of subsequent processing to alert the driver. However, when the sound inside the car is too loud, exceeding the preset threshold, and the driver cannot hear the external sound, using the external microphone to receive the external sound in this case can be more effective and prevent the vehicle from making unnecessary processing.

[0051] Moreover, when the sound inside the car is very loud, the microphone group outside the car may also receive the sound inside the car, so the sound outside the car received by the microphone group outside the car can be filtered. Figure 1A A detailed flow chart is provided according to an exemplary embodiment. Figure 1A As shown, after filtering, we can obtain an accurate representation of sounds coming only from outside the vehicle, such as other car horns. This method prevents the vehicle from alerting the driver due to sounds coming from inside the vehicle, such as the sound of media or children's toys.

[0052] For example, if a child's toy inside the car honks and this sound is picked up by an external microphone, without filtering, the toy's whistle, as received by the external microphone, will be used for subsequent judgment and, based on the judgment, will determine whether to alert the driver. However, the toy's whistle does not need to alert the driver, as the driver can already hear it. Therefore, it is necessary to filter out the internal sounds from the external microphones to ensure that the vehicle's alerts are based on external sounds, avoiding alerting the driver to internal sounds and creating a negative user experience.

[0053] For example, the system will compare the external sounds with the media sounds inside the car and filter out the same parts of the sounds. This is because if the media sounds inside the car are too loud, they will also be picked up by the external microphone. If the internal media sounds a whistle and it is picked up by the external microphone but not filtered, the above problem will also occur. You can directly compare the external sounds received by the external microphone with the media sounds, or you can compare the external sounds with the media sounds inside the car received by the internal microphone group to prevent the internal media sounds from being recorded by the external microphone, so that you can provide reminders for unnecessary sounds later.

[0054] In one example, when the in-car sound received by the in-car microphone group exceeds a preset threshold, it includes: when the vehicle doors and windows are closed, the in-car sound received by the in-car microphone group exceeds the preset threshold.

[0055] Before processing the sound received by the external microphones and making subsequent judgments, the system first determines whether the windows are closed and that the sound inside the vehicle exceeds a preset threshold. This is to further determine that the driver inside the vehicle may not be able to clearly hear the outside sounds. This avoids using external microphones to receive and process external sounds to alert the driver inside the vehicle when the driver can hear the outside sounds, causing the user to receive unnecessary prompts and a poor user experience. This method also avoids unnecessary resource consumption of the vehicle system.

[0056] In step S102, the filtered sound outside the vehicle is compared with the sound information stored in the vehicle to determine whether the filtered sound outside the vehicle and the sound information stored in the vehicle match; the sound information stored in the vehicle is a sound that requires the driver's attention.

[0057] After filtering out the identical portions of the external sound and the internal sound, the external sound is compared with the sound information stored in the vehicle. The sound information stored in the vehicle indicates sounds that require the driver's attention, such as vehicle horns, bus sirens, or the shouts of passers-by. The filtered external sound is compared with the stored internal sound information to determine whether the received external sound requires the driver's attention.

[0058] For example, different types of sounds, such as horns for different types of vehicles and various public transportation sirens, are pre-stored in the vehicle. For example, the low-frequency frequency of a fire truck sirens is 650Hz to 750Hz, and the high-frequency frequency is 1450Hz to 1550Hz. The low-frequency frequency of an ambulance sirens is 650Hz to 750Hz, and the high-frequency frequency is 900Hz to 1000Hz. The voiceprint features of these sirens are stored in a database within the vehicle's main engine. The voiceprints of these sounds are recognized using a trained program. Because different sirens correspond to different voiceprint information, the voiceprint features of sounds received outside the vehicle can be compared with the voiceprint features of sounds stored in the database to determine whether the received sound belongs to these pre-stored sounds. If so, the driver can determine whether the received sound is directed at the vehicle itself, and based on this determination, decide whether to issue an alert.

[0059] In one example, before comparing the filtered external sound with the sound information stored in the vehicle, irrelevant noise in the external sound received by the external microphone group is filtered out. The irrelevant noise is ambient sound that does not affect the driving of the vehicle.

[0060] Figure 1B is a detailed flow chart provided according to an exemplary embodiment. Figure 1B As shown, before comparing the filtered outside sound with the sound information stored in the vehicle and determining whether there is a match, it is necessary to filter out irrelevant noise from the outside sound received by the outside microphone group. For example, when the car is driving, the outside microphone group receives irrelevant noises such as wind noise and the ambient sound of the roadside on a noisy street. By filtering out these irrelevant sounds, the matching of the filtered outside sound with the stored sound can be more accurate and faster. This irrelevant noise filtering process and the aforementioned process of filtering the same part of the sound inside and outside the car can be performed simultaneously, before or after it, or the microphone can be directly wrapped with windproof and noise-proof sound to reduce noise, as long as the filtering is completed before matching with the stored sound information.

[0061] In step S103 , it is determined whether the filtered external sound is directed to the vehicle itself.

[0062] Before determining whether the received sound needs to be alerted to the driver, it is also necessary to determine whether the received filtered external sound is directed to the vehicle itself.

[0063] It should be noted that there is no necessary order in which to determine whether the filtered sound outside the vehicle is directed at one's own vehicle and whether the filtered sound outside the vehicle matches the sound information stored in the vehicle. You can first determine whether the filtered sound outside the vehicle is directed at one's own vehicle, and then determine whether the filtered sound outside the vehicle matches the stored sound information; you can also first determine whether the filtered sound outside the vehicle matches the stored sound information, and then determine whether the filtered sound outside the vehicle is directed at one's own vehicle; or you can simultaneously determine whether these two conditions are met. That is, there is no necessary order in which to execute step S102 and step S103. Only when the conditions of these two steps are met will the driver in the vehicle be reminded based on the filtered sound outside the vehicle. In this embodiment, step S102 is executed first and then step S103, but this should not be a limitation.

[0064] In one example, the external vehicle microphone group includes at least two microphones, and determining that the filtered external vehicle sound is a sound directed at the own vehicle includes: determining the source direction of the filtered external vehicle sound based on the time difference between different microphones in the external vehicle microphone group receiving the filtered external vehicle sound; and determining that the filtered external vehicle sound is a sound directed at the own vehicle in response to the source direction being a preset direction.

[0065] It can be understood that the sound received by the external microphone group is very noisy. When we determine whether the filtered external sound is directed at the vehicle itself, we can determine whether it is directed at the vehicle itself based on the time difference when the external microphone group receives the filtered external sound. The external microphone group can include multiple microphones, such as Figure 2 As shown, microphones 201, 202, 203, and 204 are respectively arranged in four directions outside the vehicle, and microphones 211, 212, 213, and 214 are arranged inside the vehicle. Other microphones of different numbers and positions can also be arranged according to specific circumstances, and are not limited to this.

[0066] like Figure 2 As shown, due to the different placement of microphones outside the vehicle, the time it receives sound varies. For example, since the speed of sound is 340 meters per second, a one-meter distance will result in a 3-ms difference in the time it receives the sound. Based on the time differences in the sound received by the different microphones, the direction of the sound outside the vehicle, i.e., the source direction of the sound, is determined. A determination is then made as to whether this direction is a preset direction. If the sound source direction is a preset direction, the sound is determined to be directed at the user.

[0067] For example, when the vehicle is driving, when the microphone group outside the vehicle receives a horn sound from the right side, the microphone on the left side of the vehicle will receive it later than the microphone on the right side. By the time difference of receiving the sound, it is determined that the horn sound comes from the right. When we set it so that only the sound source directly behind is directed at our own vehicle, we will not process the horn sound, because the sound on the right side is most likely the horn sound issued by the vehicle in the right lane to the car in front of it, and not directed at our vehicle. It can be preset that only the sound behind the vehicle is directed at our vehicle. When it is determined that the sound source is from the right, no subsequent reminder will be issued. It can also be set to other directions, and multiple directions can be preset directions. There is no restriction here.

[0068] When determining the direction of a sound source, in addition to the time difference received by the microphone outside the car, the direction of the sound source can also be determined by the difference in the sound intensity received by the microphone. Because the microphones outside the car are distributed in different positions, the intensity of the sound sources received in different directions will also be different. The direction of the sound source can be determined based on the difference in the received sound intensity. This is just one way to determine the direction of the sound, and I will not elaborate on it here.

[0069] In one example, determining that the filtered sound outside the vehicle matches the sound information stored in the vehicle includes: if the filtered sound outside the vehicle matches the preset category sound in the sound information stored in the vehicle, determining that the filtered sound outside the vehicle is the preset category sound; determining that the filtered sound outside the vehicle is a sound directed to the own vehicle includes: in response to the filtered sound outside the vehicle being the preset category sound, determining that the filtered sound outside the vehicle is a sound directed to the own vehicle.

[0070] It can be understood that the preset category of sounds in the sound information stored in the vehicle can be certain specific sounds stored in the vehicle. When the filtered sound outside the vehicle matches certain specific sounds stored in the vehicle, the sound can be directly determined to be directed at the vehicle itself without having to determine its source direction. For example, the sound information stored in the vehicle can include multiple types of sounds, illustratively including the sirens of ambulances, fire trucks, and police cars, of which the "fire truck sirens" can be set as the preset category of sounds. If the filtered sound outside the vehicle matches the fire truck sirens, it can be determined that the sound outside the vehicle is a sound of the preset category. When the filtered sound outside the vehicle matches the preset category of sounds, regardless of the source direction of the sound outside the vehicle, it can be considered that the sound outside the vehicle is a sound directed at the vehicle itself.

[0071] For example, if the preset category of sound is a fire alarm, then when the filtered sound outside the vehicle is the same as the fire alarm stored in the vehicle, even if the source direction of the fire alarm is not the preset direction, the sound will be identified as a sound directed at the vehicle itself and a reminder will be given to the driver in the vehicle.

[0072] In step S104, in response to the filtered sound outside the vehicle matching the sound information stored in the vehicle, and the filtered sound outside the vehicle is a sound for the vehicle itself, a reminder is made inside the vehicle regarding the filtered sound outside the vehicle.

[0073] When it is determined that the received filtered sound outside the vehicle matches the sound information inside the vehicle, and when it is determined that the filtered sound outside the vehicle is directed at the vehicle itself, a reminder of the filtered sound outside the vehicle will be made inside the vehicle.

[0074] In one example, the reminder of the filtered sound outside the vehicle is made inside the vehicle, including: reducing the media sound inside the vehicle, and playing the filtered sound outside the vehicle at a direction inside the vehicle corresponding to the source direction of the filtered sound outside the vehicle.

[0075] It can be understood that after determining that the received filtered sound outside the car is a sound that needs to be provided to the people in the car,

[0076] After the sound of the wake-up call is heard, the media sound inside the car will be reduced, so that the driver inside the car can hear the filtered outside sound played by 5 more clearly, and in the same direction as the source of the filtered outside sound.

[0077] For example, if there is an alarm in the back row, the sound in the car will be played louder in the back row. This will make the driver feel that the alarm sound is coming from the back. If there is an alarm sound coming from the left, the left row speaker will play louder and the right row speaker will play a lower sound. For some special external sounds, such as

[0078] The sirens of fire trucks can also be used to flash indicator lights inside the car as a reminder, which allows people inside the car to feel the sounds outside the car more accurately and make more accurate decisions.

[0079] The sound processing method in this embodiment compares and filters the sound outside the car received by the car microphone and the sound inside the car received by the car microphone to prevent the false reminder caused by the sound inside the car received by the car microphone, and compares the filtered sound with the sound information stored in the car.

[0080] Comparison is used to determine the type of sound outside the car; it is also determined whether the sound outside the car is directed at the vehicle itself; after a series of steps, after determining that the sound outside the car needs to be reminded to the driver, a sound is made inside the car.

[0081] It effectively improves the driver's ability to perceive sounds outside the car, improves driving safety, and through a series of judgment steps, it can further increase the necessity of reminding the occupants of the car, improving the driver's experience.

[0082] To implement the sound processing method provided in an embodiment of the present invention, the present invention also provides a sound processing device for use in a vehicle, wherein the vehicle includes an in-vehicle microphone set and an external microphone set. The structure of the device is described in detail below, and the detailed processing of each module can be combined with the above embodiments.

[0083] Figure 3 is a structural diagram of a sound processing device provided by an exemplary embodiment. Figure 3

[0084] As shown, the sound processing device includes: an external sound filtering module 301, a sound matching determination module 302, a sound matching determination module 303 and a vehicle state adjustment module 304;

[0085] The outside-vehicle sound filtering module 301 is used to filter out the same sound part of the outside-vehicle sound received by the outside-vehicle microphone group when the inside-vehicle sound received by the inside-vehicle microphone group exceeds a preset threshold. The same sound part is the part of the outside-vehicle sound received by the outside-vehicle microphone group that is the same as the inside-vehicle sound.

[0086] The sound matching module 302 is used to compare the filtered sound outside the vehicle with the sound information stored in the vehicle to determine whether the filtered sound outside the vehicle and the sound information stored in the vehicle match; the sound information stored in the vehicle is a sound that requires the driver's attention.

[0087] The sound targeting module 303 is used to determine whether the filtered external sound is a sound targeting the vehicle itself.

[0088] The vehicle state adjustment module 304 is configured to respond to the filtered external sound and the stored

[0089] The sound information inside the vehicle is matched, and the filtered sound outside the vehicle is the sound of the vehicle itself, and a reminder of the filtered sound outside the vehicle is made inside the vehicle.

[0090] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.

[0091] An embodiment of the present invention further provides a vehicle, comprising: an in-vehicle microphone group, an out-vehicle microphone group, and a processing device; the in-vehicle microphone group is used to receive sounds in the vehicle; the out-vehicle microphone group is used to receive sounds outside the vehicle; the processing device is used to obtain the in-vehicle sounds and the out-vehicle sounds.

[0092] And execute the sound processing method described in any embodiment of the present invention.

[0093] The above-mentioned processing device can be a vehicle control device, which can control various hardware devices of the vehicle, such as a processor, a vehicle control system, etc. After receiving the sound, the control device can execute the sound processing method described in any embodiment of the present invention.

[0094] An embodiment of the present invention further provides an electronic device, comprising: a processor and a memory for storing processor-executable instructions; wherein the processor implements the sound processing method described in any embodiment of the present invention by running the executable instructions.

[0095] The present invention also provides a computer-readable storage medium having computer instructions stored thereon, which, when executed by a processor, implement the steps of the sound processing method as described in any embodiment of the present invention.

[0096] 5. As the device embodiments generally correspond to the method embodiments, reference will be made to the description of the method embodiments for relevant details. The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules, i.e., they may be located in one location or distributed across multiple network modules. Some or all of these modules may be selected based on actual needs to achieve the objectives of the present invention. Persons of ordinary skill in the art will be able to understand and implement these embodiments without inventive effort.

[0097] The foregoing description describes specific embodiments of the present invention. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or the sequential order to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0098] Other embodiments of the present invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention claimed herein. The present invention is intended to cover any variations, uses, or adaptations of the present invention that follow from the general principles of the invention and include common knowledge or customary techniques in the art not claimed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the invention being indicated by the following claims.

[0099] It should be understood that the present invention is not limited to the exact construction described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

[0100] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A sound processing method, applied to a vehicle, characterized in that: The vehicle includes: an in-vehicle microphone group and an out-vehicle microphone group; the method includes: When the in-car sound received by the in-car microphone group exceeds a preset threshold, filtering out the same sound portion of the outside-car sound received by the outside-car microphone group, wherein the same sound portion is the same as the in-car sound in the outside-car sound received by the outside-car microphone group; comparing the filtered sound outside the vehicle with the sound information stored in the vehicle to determine whether the filtered sound outside the vehicle and the sound information stored in the vehicle match; and determining that the sound information stored in the vehicle is a sound requiring the driver's attention; Determining that the filtered external sound is a sound directed at the own vehicle; comprising: determining a source direction of the filtered external sound, and in response to the source direction being a preset direction, determining that the filtered external sound is a sound directed at the own vehicle; In response to the filtered sound outside the vehicle matching the sound information stored in the vehicle, and the filtered sound outside the vehicle is a sound for the vehicle itself, a reminder is made inside the vehicle regarding the filtered sound outside the vehicle.

2. The method according to claim 1, characterized in that When the in-car sound received by the in-car microphone group exceeds a preset threshold, the method includes: When the vehicle doors and windows are closed, the in-vehicle sound received by the in-vehicle microphone group exceeds the preset threshold.

3. The method according to claim 1, characterized in that The method further comprises: Before comparing the filtered external sound with the sound information stored in the vehicle, irrelevant noise in the external sound received by the external microphone group is filtered out. The irrelevant noise is ambient sound that does not affect the driving of the vehicle.

4. The method according to claim 1, wherein The external microphone group includes: at least two microphones; The determining of the source direction of the filtered external sound, and in response to the source direction being a preset direction, determining that the filtered external sound is a sound directed at the own vehicle, includes: determining a source direction of the filtered external sound according to a time difference between different microphones in the external microphone group receiving the filtered external sound; In response to the source direction being a preset direction, the filtered external vehicle sound is determined to be a sound directed to the own vehicle.

5. The method according to claim 1, wherein Determining whether the filtered sound outside the vehicle matches the sound information stored in the vehicle includes: if the filtered sound outside the vehicle matches a preset category of sound in the sound information stored in the vehicle, determining that the filtered sound outside the vehicle is the preset category of sound; Determining that the filtered sound outside the vehicle is a sound directed at the own vehicle includes: in response to the filtered sound outside the vehicle being the preset category sound, determining that the filtered sound outside the vehicle is a sound directed at the own vehicle.

6. The method according to claim 1, wherein Prompting a reminder inside the vehicle regarding the filtered sound outside the vehicle includes: The media sound inside the vehicle is reduced, and the filtered outside vehicle sound is played at a position inside the vehicle corresponding to the source direction of the filtered outside vehicle sound.

7. A sound processing device, applied to a vehicle, characterized in that: The vehicle includes an in-vehicle microphone group and an out-vehicle microphone group; the device includes: an out-vehicle sound filtering module, a sound matching determination module, a sound targeting determination module, and a vehicle state adjustment module; The exterior sound filtering module is configured to filter out the identical sound portion of the exterior sound received by the exterior microphone group when the interior sound received by the interior microphone group exceeds a preset threshold, wherein the identical sound portion is the identical sound portion of the exterior sound received by the exterior microphone group with the interior sound; The sound matching determination module is configured to compare the filtered external sound with the sound information stored in the vehicle to determine whether the filtered external sound and the sound information stored in the vehicle match; and the sound information stored in the vehicle is a sound requiring the driver's attention. The sound targeting determination module is used to determine whether the filtered external sound is a sound targeting the own vehicle; including: determining a source direction of the filtered external sound, and in response to the source direction being a preset direction, determining that the filtered external sound is a sound targeting the own vehicle; The vehicle status adjustment module is used to respond to the matching of the filtered external sound with the sound information stored in the vehicle, and the filtered external sound is the sound of the vehicle itself, and make a reminder of the filtered external sound inside the vehicle.

8. A vehicle, characterized in that: The vehicle comprises: an in-vehicle microphone group, an out-vehicle microphone group, and a processing device; The in-car microphone group is used to receive sounds inside the car; The external microphone group is used to receive sounds outside the vehicle; The processing device is used to obtain the in-vehicle sound and the out-vehicle sound, and execute the sound processing method according to any one of claims 1 to 6.

9. An electronic device, characterized in that: include: A processor and a memory for storing processor-executable instructions; wherein the processor implements the sound processing method according to any one of claims 1 to 6 by running the executable instructions.

10. A computer-readable storage medium having computer instructions stored thereon, characterized in that: When the instruction is executed by a processor, the steps of the sound processing method according to any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Human voice recognition prompting device and method for vehicle

    CN108597524A

  • Environment sound control method and system for automobile intelligent cabin

    CN111816199A