Audio processing method and related equipment
By extracting and filtering the center channel audio to obtain the human voice signal, and performing phase correction processing to match it with the center channel audio, the problem of the center channel human voice being off-center from the listening position is solved, thus improving the listening effect.
Patent Information
- Application Number
- CN202210921716.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-02
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2042-08-02
AI Technical Summary
In spaces where the center channel cannot be placed directly in front of the listener's line of sight, the vocals are played in a direction other than directly in front of the listener's line of sight, resulting in a poor listening experience.
The center channel audio is extracted from the audio signal, filtered to obtain the human voice signal, and then the human voice signal is matched with the center channel audio through the panning correction process. Finally, the processed human voice signal is played through the directional door channels of the audio system.
This ensures that the human voice signal and the center channel audio arrive at the listening position simultaneously, improving the listening experience and allowing users to perceive that the sound source is directly in front of the listening position.
Smart Images

Figure CN115474130B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to an audio processing method and related equipment. Background Art
[0002] The vocal part of the sound system is generally included in the center audio. When placed indoors, the center channel corresponding to the center audio can be placed directly in front of the listening position.
[0003] However, for some spaces where the center channel cannot be placed directly in front of the listening position (for example, irregular spaces, spaces inside a car, etc.), the vocal part in the center channel will be played in directions other than directly in front of the listening position, resulting in poor listening effect at the listening position. Summary of the invention
[0004] In view of this, the purpose of this application is to propose an audio processing method and related equipment to solve or partially solve the above technical problems.
[0005] The first aspect of the present application provides an audio processing method, comprising:
[0006] Extracting center channel audio from an audio signal;
[0007] Filtering the center channel audio to obtain a human voice signal;
[0008] Performing phase correction processing on the human voice signal to obtain a processed human voice signal that matches the center channel audio;
[0009] The processed vocal signal is played through the directional gate channel of the sound system.
[0010] Based on the same inventive concept, the second aspect of the present application proposes an audio processing device, comprising:
[0011] A center channel audio acquisition module is configured to extract the center channel audio from the audio signal;
[0012] A vocal processing module, configured to filter the center channel audio to obtain a vocal signal, and perform phase correction on the vocal signal to obtain a processed vocal signal that matches the center channel audio;
[0013] The playing module is configured to play the processed human voice signal through the directional gate channel of the sound system.
[0014] Based on the same inventive concept, the third aspect of the present application proposes a non-transitory computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a computer to execute the method described in the first aspect.
[0015] Based on the same inventive concept, the fourth aspect of the present application proposes an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method described in the first aspect when executing the program.
[0016] Based on the same inventive concept, the fifth aspect of the present application proposes a vehicle, comprising: the audio processing device described in the second aspect, or the non-transitory computer-readable storage medium described in the third aspect, or the electronic device described in the fourth aspect.
[0017] From the above, it can be seen that the audio processing method and related equipment provided by the present application can extract the human voice signal from the center channel audio of the audio signal, and perform phase correction processing so that the human voice signal can match the center channel audio; thereafter, the processed human voice signal is played through the directional gate channel of the audio system, so that the human voice signal played by the directional gate channel is matched with the center channel audio played by the center channel, so that the human voice signal and the center channel audio can reach the listening position at the same time, ensuring that the user can perceive that the source of the sound is directly in front of the listening position, so that the audio system can take into account the hearing sense of people at each listening position and improve the listening effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the technical solutions in the present application or related technologies, the drawings required for use in the embodiments or related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0019] Figure 1 A schematic diagram of an application scenario of an embodiment of the present application;
[0020] Figure 2A A flowchart of an audio processing method according to an embodiment of the present application;
[0021] Figure 2B A schematic diagram of an execution process of audio processing according to an embodiment of the present application;
[0022] Figure 2C A schematic diagram of another execution process of audio processing according to an embodiment of the present application;
[0023] Figure 3is a structural block diagram of an audio processing device according to an embodiment of the present application;
[0024] Figure 4 A schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION
[0025] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.
[0026] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.
[0027] Based on the description of the background technology, in the field of in-car audio systems, with the current increase in user demand, multi-channel audio track content decoded by, for example, Dolby, DTS (data distribution service) and the like will become mainstream. This type of audio track was used in home theaters in the early stages of design, and most human voices were only included in the center channel, which was placed in line with the only listening position in the room, that is, placed directly in front of the listening position's line of sight. In car audio, the space is small and the listening position is far from the center speaker, and there are multiple seats in the car, that is, multiple listening positions, and the center speaker is not directly in front of any listening position, which makes the subjective listening experience relatively poor, and the human voice is completely biased towards the center speaker.
[0028] The channel allocation after decoding of Dolby, DTS and other encoded audio sources is fixed. For example, taking 7.1.4 channels as an example, the order of the 12 channels is 1. Left channel; 2. Right channel; 3. Center channel; 4. Subwoofer; 5. Left surround; 6. Right surround; 7. Left back surround; 8. Right back surround; 9. Left front 3D; 10. Right front 3D; 11. Left back 3D; 12. Right back 3D. The decoder requires that the corresponding relationship between each digital channel and the physical channel is:
[0029] 1. Left channel → left front door speaker channel;
[0030] 2. Right channel → right front door speaker channel;
[0031] 3. Center channel → center channel;
[0032] 4. Subwoofer → Subwoofer channel;
[0033] 5. Left surround → left surround channel;
[0034] 6.Right surround→right surround channel;
[0035] 7. Left rear surround → Left rear surround channel;
[0036] 8.Right rear surround→right rear surround channel;
[0037] 9. Left front 3D → Left front 3D channel;
[0038] 10.Right front 3D→Right front 3D channel;
[0039] 11. Left rear 3D → Left rear 3D channel;
[0040] 12.Right rear 3D→Right rear 3D channel.
[0041] It can be seen from this that the center speaker in the car audio system only corresponds to the center channel, and most of the center channel audio track is vocals, which cannot meet the experience of the human voice directly in front of multiple listening positions, thus seriously affecting the playback effect of the audio system.
[0042] The sound system mentioned in the present application can be a vehicle-mounted sound system installed in a vehicle or a sound system installed in a special-shaped space. The present application is preferably applied to a vehicle-mounted sound system.
[0043] Taking the car audio system as an example, the application process is as follows:
[0044] The specific signal chain is as follows: Figure 1 As shown:
[0045] In the figure, the HU (Head unit) is installed with audio or video playback software, which obtains audio data from it and decodes it through a decoder to obtain an audio signal, which is processed in the DSP (Digital Signal Processing). The DSP is pre-set with a global volume control and a multi-channel media playback signal chain, and the signal chain for audio processing of human voice (i.e., the execution chain of the subsequent audio processing method) needs to be embedded between the volume control and the multi-channel media playback signal chain.
[0046] After DSP processing, the DAC (digital-to-analog converter) performs digital-to-analog conversion processing, and then it is played through the sound channel, played into the car environment, and transmitted to the human ear through the car environment.
[0047] In DSP, the audio signal composed of digital signals needs to be processed. The full amplitude value of the digital signal is 0dB, and attenuation can only be done on this basis. According to the sampling theorem, when a discrete digital signal is converted into a continuous analog signal, if the signal amplitude is greater than 0dB, the part above 0dB will not be converted into an analog signal, which is called clipping, that is, digital distortion occurs.
[0048] Since the present application involves gain setting and processing, if the gain is positive, that is, at maximum volume, if the signal chain for audio processing of human voice is before the global volume control, the overall signal amplitude will exceed 0dB. In order to avoid clipping distortion, the audio processing program for human voice in the sound system needs to be embedded after the volume control.
[0049] The audio processing procedure for human voice is to remix the multi-track audio source, that is, to re-edit the audio source. It is the prerequisite for multi-channel media playback processing, so it should be embedded before the multi-channel media playback signal chain.
[0050] Based on the description of the above application scenario, this embodiment proposes an audio processing method, such as Figure 2A As shown, the audio processing method of this embodiment includes:
[0051] Step 201: extract center channel audio from an audio signal.
[0052] In some embodiments, the audio signal includes: directional channel audio and center channel audio. Therefore, when extracting, the directional channel audio is also extracted to facilitate subsequent mixing with the human voice signal.
[0053] The directional channel audio includes: at least two first directional channel audios and at least two second directional channel audios.
[0054] The audio signal is obtained after being decoded by a decoder, such as Figure 2C As shown, the audio signal may further include at least one of the following: subwoofer, left rear surround, right rear surround, left front 3D, right front 3D, left rear 3D, and right rear 3D.
[0055] In specific implementation, since the human voice signal is generally distributed in the center channel audio, it is necessary to obtain the center channel audio from the audio signal for processing.
[0056] Step 202: Filter the center channel audio to obtain a human voice signal.
[0057] Step 203: Perform phase correction processing on the vocal signal to obtain a processed vocal signal that matches the center channel audio.
[0058] In specific implementation, since there may be other sounds besides human voice in the center channel audio, it is necessary to filter out these other sounds, thereby ensuring the purity of the human voice signal and avoiding interference from other sounds. Then, the human voice signal (i.e. the obtained bass or bass+mid-tone) is delayed so that the time when the human voice signal reaches the listening position is consistent with the center channel audio, or the human voice signal is gain processed so that the sound gain of the human voice signal matches the center channel audio.
[0059] Step 204: Play the processed human voice signal through the directional gate channel of the sound system.
[0060] The directional channel audio includes at least one of left channel audio, right channel audio, left surround audio, and right surround audio.
[0061] In some embodiments, if directional channel audio is extracted from the audio signal, then in step 204: the processed human voice signal is mixed with the directional channel audio to obtain mixed audio; and the mixed audio is played as the directional channel of the sound system.
[0062] The directional door channel includes at least one of a left front door channel, a right front door channel, a left rear door channel and a right rear door channel.
[0063] Through the above scheme, the human voice signal in the center channel audio of the audio signal can be extracted and phase correction processing can be performed, so that the human voice signal can match the center channel audio; then, the processed human voice signal is played through the directional gate channel of the audio system, so that the human voice signal played by the directional gate channel is matched with the center channel audio played by the center channel, so that the human voice signal and the center channel audio can reach the listening position at the same time, ensuring that the user can perceive that the source of the sound is right in front of the listening position, so that the audio system can take into account the hearing sense of people at each listening position and improve the listening effect.
[0064] In some embodiments, the pan correction in step 203 includes gain processing:
[0065] intercepting a human voice frequency component in the human voice signal;
[0066] Determine gain data according to the difference between the frequency component of the center channel audio and the frequency component of the human voice;
[0067] The gain of the human voice frequency is adjusted according to the gain data to obtain the processed human voice signal that matches the center channel audio.
[0068] Through the above scheme, the gain processing process is carried out, and the gain data can be data set by the user. The gain data corresponds to the increase or decrease in the sound volume. After the user sets it, the human voice signal can be subjected to phase correction processing according to the set gain data, so that the sound gain of the human voice signal part matches the center channel audio.
[0069] In some embodiments, the phase correction in step 203 includes delay processing:
[0070] The human voice signal is delayed according to the delay time to obtain the processed human voice signal that matches the center channel audio, and the delay time is predetermined according to the distance from the directional gate channel to the human ear.
[0071] Through the above solution, the user can set the corresponding delay time according to the actual situation of the center channel audio. The delay time is the length of the forward or backward delay, so that the time when the human voice signal reaches the listening position can be consistent with the center channel audio.
[0072] The above-mentioned phase correction process may be any one of the gain processing and the delay processing, or both the gain processing and the delay processing may be present. In the case where both the gain processing and the delay processing are present, the gain processing process and the delay processing process may be performed simultaneously, or the gain processing process may be performed first and then the delay processing process, or the delay processing process may be performed first and then the gain processing process, which is not specifically limited here.
[0073] In some embodiments, the gain processing / delay processing process can also be completed automatically, and the specific process is as follows:
[0074] Before step 203, the method further includes:
[0075] Step 203a1, obtaining a plurality of historical center channel audios and a plurality of historical vocal signals, wherein each historical center channel audio corresponds to a historical vocal signal, to form an audio pair.
[0076] Step 203a2: Obtain the historical gain data / historical delay time corresponding to each of the audio pairs, and label each audio pair using the historical gain data / historical delay time to obtain training sample data.
[0077] Here, a predetermined amount of training sample data may be obtained, or training sample data within a predetermined historical time range may be obtained. The specific amount or time range may be determined according to actual conditions.
[0078] Step 203a3, construct a neural network, use the training sample data to perform supervised learning training on the neural network, and obtain a neural network model. The neural network includes: an input layer, multiple hidden layers and an output layer. Each layer is provided with an artificial neuron with computing and processing capabilities, and each layer is connected to each other through connection parameters. During the learning and training process, the audio pairs in the training sample data are input into the neural network, and the corresponding gain data or delay time is output after the neural network processing. The output result is compared with the marked historical gain data / historical delay time. If the comparison is the same, the next training sample is subjected to learning and training processing. If the comparison is different, the connection parameters of the neural network are adjusted, and then the output result is compared with the marked data. After that, the next training sample is subjected to learning and training, until all training samples are fully trained. In this way, a neural network model is finally obtained.
[0079] Based on the neural network model obtained above, the gain processing or delay processing process includes:
[0080] Step 203b1, inputting the human voice signal and the center channel audio into a neural network model for analysis and processing to obtain corresponding gain data or delay time.
[0081] Step 203b2: performing phase correction processing on the vocal signal according to the gain data or the delay time to obtain the processed vocal signal that matches the center channel audio.
[0082] In specific implementation, the neural network model can analyze and process the center channel audio and vocal signals to obtain corresponding gain data or delay time. This eliminates the need to manually set the corresponding gain data or delay time, saves labor costs, and improves the intelligent effect of audio processing.
[0083] In some embodiments, the first direction and the second direction are set as two opposite directions, the directional gate channel includes: a first directional gate channel and a second directional gate channel, and the audio signal includes: a first directional channel audio and a second directional channel audio;
[0084] The step of mixing the processed human voice signal with the directional channel audio to obtain mixed audio, and playing the mixed audio through the directional channel of the sound system includes:
[0085] The processed human voice signal is mixed with the first directional channel audio and the second directional channel audio respectively (i.e., Mixer) to obtain the first directional mixed audio and the second directional mixed audio;
[0086] The first-category directional mixed audio is sent to the first-category directional gate channel for playback, and the second-category directional mixed audio is sent to the second-category directional gate channel for playback.
[0087] The first direction in the above refers to the left or front channel, and the second direction refers to the right or rear channel. When the first direction refers to the left channel, the second direction refers to the right channel. When the first direction refers to the front channel, the second direction refers to the rear channel.
[0088] Through the above scheme, the processed human voice signal is mixed with the at least two first direction channel audios and the at least two second direction channel audios to obtain at least two first-category directional mixed audios and at least two second-category directional mixed audios. The at least two first-category directional mixed audios are sent to the at least two first sub-directional gate channels for playback, and the at least two second-category directional mixed audios are sent to the at least two second sub-directional gate channels for playback.
[0089] In some embodiments, the first type of directional gate channels includes at least two first sub-directional gate channels, the second type of directional gate channels includes at least two second sub-directional gate channels, the number of the first sub-directional gate channels is the same as the number of the second sub-directional gate channels, wherein the first sub-direction is the same as the first type of direction, and the second sub-direction is the same as the second type of direction;
[0090] The processing of mixing the processed human voice signal with the first type directional channel audio and the second type directional channel audio to obtain the first type directional mixed audio and the second type directional mixed audio comprises:
[0091] The processed human voice signal is mixed with at least two first-direction channel audios and at least two second-direction channel audios respectively to obtain at least two first-category directional mixed audios and at least two second-category directional mixed audios, wherein the first direction is the same as the first-category direction, and the second direction is the same as the second-category direction;
[0092] The at least two first-category directional mixed audios are respectively sent to at least two first-category directional gate channels for playback, and the at least two second-category directional mixed audios are respectively sent to at least two second-category directional gate channels for playback.
[0093] In specific implementation, the at least two first sub-direction door channels of this embodiment are preferably: a left front door channel (i.e., a left front door speaker channel) and a left rear door channel (i.e., a left rear door speaker channel). The at least two second sub-direction door channels of this embodiment are preferably: a right front door channel (i.e., a right front door speaker channel) and a right rear door channel (i.e., a right rear door speaker channel).
[0094] Or, if Figure 2B As shown, the at least two first sub-direction door channels of this embodiment are preferably: a left front door channel (i.e., a left front door speaker channel) and a right front door channel (i.e., a right front door speaker channel). The at least two second sub-direction door channels of this embodiment are preferably: a left rear door channel (i.e., a left rear door speaker channel) and a right rear door channel (i.e., a right rear door speaker channel).
[0095] In specific implementation, the sound system has, in addition to the above-mentioned channels, Figure 2C As shown, it may also include: a subwoofer speaker channel, a left surround speaker channel, a right surround speaker channel, a left front 3D speaker channel, a right front 3D speaker channel, a left rear 3D speaker channel, and a right rear 3D speaker channel.
[0096] At least two first sub-direction gate channels are played and at least two second sub-direction gate channels are played, and the center channel may not be played. Alternatively, at least two first sub-direction gate channels are played and at least two second sub-direction gate channels are played, and the center channel audio in the audio signal is played together through the center channel.
[0097] In this way, vocal signals can be played in at least two first sub-direction door channels (i.e., the left front door speaker channel and the left rear door speaker channel, or the left front door speaker channel and the right front door speaker channel) and at least two second sub-direction door channels (i.e., the right front door speaker channel and the right rear door speaker channel, or the left rear door speaker channel and the right rear door speaker channel), and the vocal signal in the center channel can be corrected to the front of each listening position.
[0098] Through the scheme described in the above embodiment, the human voice no longer deviates from the front of the listening position's line of sight, but is only emitted from the center direction. With the help of gate bass or gate bass + gate mid-range, the human voice is assisted to be migrated to the front of the listening position's line of sight, so that the human voice of each listening position comes from the front, which can take into account everyone's auditory experience, significantly improve the auditory experience of playing multi-channel audio tracks in the broadcasting space, and make the broadcasting effect more realistic and shocking.
[0099] In some embodiments, the human voice signal includes a first human voice signal and a second human voice signal, and the processed human voice signal includes the processed first human voice signal and the processed second human voice signal;
[0100] The processing of mixing the processed human voice signal with the first type directional channel audio and the second type directional channel audio to obtain the first type directional mixed audio and the second type directional mixed audio comprises:
[0101] Mixing the processed first human voice signal with the first directional channel audio to obtain the first-category directional mixed audio, wherein the first direction is the same as the first-category direction;
[0102] The processed second human voice signal is mixed with the second directional channel audio to obtain the second-category directional mixed audio, wherein the second direction is the same as the second-category direction.
[0103] In a specific implementation, since the two front door channels and the two rear door channels are set at different positions and have different connection lines, in order to avoid different delays caused by different distances during the transmission process, it is necessary to copy the center channel audio into at least two center channel audios, and perform filtering processing and gain processing / delay processing (G / D) processing respectively to obtain a first vocal signal and a second vocal signal, wherein the first vocal signal is forwarded to the two front door channels for mixing and then played, and the second vocal signal is forwarded to the two rear door channels for mixing and then played.
[0104] Through the above solution, it can be ensured that the human voice can enter the human ear at the same time after being played through the front door channel and the back door channel.
[0105] In some embodiments, the filtering process is a low-frequency filtering (i.e., LPF, Low-pass filter) process, wherein the setting range of the crossover point of the low-frequency filtering process is 150Hz to 900Hz. In specific implementation, according to the audio characteristics of the human voice (the human voice is generally bass or bass + mid-range), it is necessary to set the crossover point when performing low-frequency filtering processing, and filter the bass or bass + mid-range to obtain a human voice signal. The crossover point can be a frequency point or a frequency range, and the frequency point and the frequency range are both selected from 150Hz to 900Hz according to actual needs. In this way, the purity of the human voice signal after filtering can be better guaranteed, and interference from other noises can be avoided, which affects the effect of subsequent gain processing or delay processing.
[0106] Based on the same inventive concept, this embodiment provides an audio processing device corresponding to the audio processing method in the above embodiment.
[0107] like Figure 3 As shown, the device comprises:
[0108] A center channel audio acquisition module 31 is configured to extract the center channel audio from the audio signal;
[0109] The vocal processing module 32 is configured to filter the center channel audio to obtain a vocal signal, and perform phase correction on the vocal signal to obtain a processed vocal signal that matches the center channel audio;
[0110] The playing module 33 is configured to play the processed human voice signal through the directional gate channel of the sound system.
[0111] In some embodiments, the vocal processing module 32 is further configured to:
[0112] intercepting a human voice frequency component in the human voice signal;
[0113] Determine gain data according to the difference between the frequency component of the center channel audio and the frequency component of the human voice;
[0114] The gain of the human voice frequency is adjusted according to the gain data to obtain the processed human voice signal that matches the center channel audio.
[0115] In some embodiments, the vocal processing module 32 is further configured to:
[0116] The human voice signal is delayed according to the delay time to obtain the processed human voice signal that matches the center channel audio, and the delay time is predetermined according to the distance from the directional gate channel to the human ear.
[0117] In some embodiments, the center channel audio acquisition module 31 is further configured to extract the directional channel audio from the audio signal;
[0118] The playing module 33 is further configured to mix the processed human voice signal with the directional channel audio to obtain mixed audio; and play the mixed audio through the directional door channel of the sound system.
[0119] In some embodiments, the first direction and the second direction are set as two opposite directions, the directional gate channel includes: a first directional gate channel and a second directional gate channel, and the audio signal includes: a first directional channel audio and a second directional channel audio;
[0120] The playback module 33 is further configured as follows:
[0121] The processed human voice signal is mixed with the first directional channel audio and the second directional channel audio respectively to obtain the first directional mixed audio and the second directional mixed audio;
[0122] The first-category directional mixed audio is sent to the first-category directional gate channel for playback, and the second-category directional mixed audio is sent to the second-category directional gate channel for playback.
[0123] In some embodiments, the first type of directional gate channels includes at least two first sub-directional gate channels, the second type of directional gate channels includes at least two second sub-directional gate channels, the number of the first sub-directional gate channels is the same as the number of the second sub-directional gate channels, wherein the first sub-direction is the same as the first type of direction, and the second sub-direction is the same as the second type of direction;
[0124] The playback module 33 is further configured to:
[0125] The processed human voice signal is mixed with at least two first-direction channel audios and at least two second-direction channel audios respectively to obtain at least two first-category directional mixed audios and at least two second-category directional mixed audios, wherein the first direction is the same as the first-category direction, and the second direction is the same as the second-category direction;
[0126] The at least two first-category directional mixed audios are respectively sent to at least two first-category directional gate channels for playback, and the at least two second-category directional mixed audios are respectively sent to at least two second-category directional gate channels for playback.
[0127] In some embodiments, the human voice signal includes a first human voice signal and a second human voice signal, and the processed human voice signal includes the processed first human voice signal and the processed second human voice signal;
[0128] The playback module 33 is further configured to:
[0129] Mixing the processed first human voice signal with the first directional channel audio to obtain the first-category directional mixed audio, wherein the first direction is the same as the first-category direction;
[0130] The processed second human voice signal is mixed with the second directional channel audio to obtain the second-category directional mixed audio, wherein the second direction is the same as the second-category direction.
[0131] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments, the present application also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the method described in any of the above embodiments.
[0132] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.
[0133] The computer instructions stored in the storage medium of the above embodiments are used to enable the computer to execute the method described in any of the above embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be repeated here.
[0134] Based on the same inventive concept, corresponding to the method of any of the above embodiments, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the method of any of the above embodiments when executing the program. The electronic device may be an audio system, specifically an audio system disposed in a special-shaped space or a vehicle-mounted audio system.
[0135] Figure 4 A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 410, a memory 420, an input / output interface 430, a communication interface 440, and a bus 450. The processor 410, the memory 420, the input / output interface 430, and the communication interface 440 are connected to each other through the bus 450 in the device.
[0136] The processor 410 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.
[0137] The memory 420 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 420 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 420 and are called and executed by the processor 410.
[0138] The input / output interface 430 is used to connect the input / output module to realize information input and output. The input / output module can be configured as a component in the device (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.
[0139] The communication interface 440 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).
[0140] The bus 450 comprises a pathway for transmitting information between the various components of the device (eg, the processor 410, the memory 420, the input / output interface 430, and the communication interface 440).
[0141] It should be noted that, although the above device only shows the processor 410, the memory 420, the input / output interface 430, the communication interface 440 and the bus 450, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.
[0142] The electronic device of the above embodiment is used to implement the corresponding method in any of the above embodiments, and has the beneficial effects of the corresponding method embodiment, which will not be described in detail here.
[0143] Based on the same inventive concept, this embodiment provides a vehicle corresponding to the electronic device of any of the above embodiments, on which the audio processing device described in the above embodiments, or the non-transitory computer-readable storage medium described in the above embodiments, or the electronic device described in the above embodiments is installed.
[0144] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.
[0145] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power supply / ground connection with the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform to be implemented in the embodiments of the present application (that is, these details should be fully within the scope of understanding of those skilled in the art). In the case of elaborating specific details (e.g., circuits) to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered to be illustrative rather than restrictive.
[0146] Although the present application has been described in conjunction with specific embodiments of the present application, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.
[0147] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the scope of protection of the present application.
[0148] It should be noted that, in this application, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
Claims
1. An audio processing method, characterized in that: include: Extracting center channel audio and directional channel audio from an audio signal; Filtering the center channel audio to obtain a human voice signal; Performing phase correction processing on the vocal signal to obtain a processed vocal signal that matches the center channel audio, wherein the vocal signal includes a first vocal signal and a second vocal signal, and the processed vocal signal includes the processed first vocal signal and the processed second vocal signal; Mixing the processed first human voice signal with the first directional channel audio to obtain a first-category directional mixed audio, wherein the first direction is the same as the first-category direction; Mixing the processed second human voice signal with the second directional channel audio to obtain a second type of directional mixed audio, wherein the second direction is the same as the second type of direction; Play the mixed audio as the directional door channel of the sound system.
2. The method according to claim 1, characterized in that Performing phase correction processing on the human voice signal to obtain a processed human voice signal that matches the center channel audio includes: intercepting a human voice frequency component in the human voice signal; Determine gain data according to the difference between the frequency component of the center channel audio and the frequency component of the human voice; The gain of the human voice frequency is adjusted according to the gain data to obtain the processed human voice signal that matches the center channel audio.
3. The method according to claim 1, characterized in that Performing phase correction processing on the human voice signal to obtain a processed human voice signal that matches the center channel audio includes: The human voice signal is delayed according to the delay time to obtain the processed human voice signal that matches the center channel audio, and the delay time is predetermined according to the distance from the directional gate channel to the human ear.
4. The method according to claim 1, characterized in that The first direction and the second direction are set to be two opposite directions, the directional gate channel includes: a first directional gate channel and a second directional gate channel, and the audio signal includes: a first directional channel audio and a second directional channel audio; The step of playing the mixed audio through the directional door channel of the sound system includes: The first-category directional mixed audio is sent to the first-category directional gate channel for playback, and the second-category directional mixed audio is sent to the second-category directional gate channel for playback.
5. The method according to claim 1, characterized in that The first type of directional gate channels includes at least two first sub-directional gate channels, the second type of directional gate channels includes at least two second sub-directional gate channels, the number of the first sub-directional gate channels is the same as the number of the second sub-directional gate channels, wherein the first sub-direction is the same as the first type of direction, and the second sub-direction is the same as the second type of direction; The processing of mixing the processed human voice signal with the first type directional channel audio and the second type directional channel audio to obtain the first type directional mixed audio and the second type directional mixed audio comprises: The processed human voice signal is mixed with at least two first-direction channel audios and at least two second-direction channel audios respectively to obtain at least two first-category directional mixed audios and at least two second-category directional mixed audios, wherein the first direction is the same as the first-category direction, and the second direction is the same as the second-category direction; The at least two first-category directional mixed audios are respectively sent to at least two first-category directional gate channels for playback, and the at least two second-category directional mixed audios are respectively sent to at least two second-category directional gate channels for playback.
6. An audio processing device, characterized in that: include: A center channel audio acquisition module is configured to extract center channel audio and directional channel audio from the audio signal; a vocal processing module, configured to filter the center channel audio to obtain a vocal signal, perform phase correction on the vocal signal, and obtain a processed vocal signal matching the center channel audio, wherein the vocal signal includes a first vocal signal and a second vocal signal, and the processed vocal signal includes a processed first vocal signal and a processed second vocal signal; The playback module is configured to mix the processed first-channel human voice signal with the first-direction channel audio to obtain a first-category directional mixed audio, wherein the first direction is the same as the first-category direction; mix the processed second-channel human voice signal with the second-direction channel audio to obtain a second-category directional mixed audio, wherein the second direction is the same as the second-category direction; and play the mixed audio through the directional gate channel of the sound system.
7. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to enable a computer to execute the method according to any one of claims 1 to 5.
8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method according to any one of claims 1 to 5 is implemented.
9. A vehicle, characterized in that: include: The audio processing device of claim 6, or the non-transitory computer-readable storage medium of claim 7, or the electronic device of claim 8.
