Earphone surround sound processing method based on audio signal processing and medium

Abstract

The invention relates to the technical field of voice signal processing, and discloses an earphone surround sound processing method based on audio signal processing and a medium, and the method comprises the steps: measuring the head coordinates of a user; analyzing an audio phase difference between the left earphone audio and the right earphone audio, determining an audio distance difference between the left earphone audio and the right earphone audio, and identifying an audio source coordinate of the audio in the earphone through the audio distance difference; determining a first model parameter of a head-related transmission model by using the left earphone audio and the right earphone audio, and determining a second model parameter of the head-related transmission model by using the head coordinate and the audio source coordinate; sound source reconstruction is carried out on the audio in the earphone through the first model parameter and the second model parameter, and audio reconstruction is carried out on the audio of the left earphone and the audio of the right earphone; and respectively carrying out audio enhancement on the reconstructed left audio and the reconstructed right audio. According to the invention, the surround stereo effect of the voice signal can be realized by using the head-related transmission function in the earphone.

Description

Technical Field

[0001] The invention relates to a method and medium for processing surround sound of headphones based on audio signal processing, and belongs to the technical field of speech signal processing. Background Art

[0002] Nowadays, headphone surround sound processing technology is designed to allow users to obtain a more realistic and immersive audio experience when using headphones. The human auditory system can determine the direction and position of the sound by receiving information such as the time difference, intensity difference and phase difference of the sound through the two ears. Headphone surround sound processing technology uses this principle to simulate the position of different sound sources in space by processing the audio signal, giving users the illusion that the sound comes from different directions, making users seem to be in different spatial environments. Each person's head shape, auricle structure, etc. are different, which leads to differences in the spatial perception of sound among different people. The head-related transfer function (HRTF) is a function that describes the transmission characteristics from the sound source to the two ears. It includes the impact of individual differences on the spatial perception of sound. In headphone surround sound processing, HRTF can be used to provide each user with a personalized surround sound experience.

[0003] At present, the ability to process the surround stereoscopic properties of signals in headphones is insufficient for the following reasons: the audio in headphones comes from terminal devices, such as audio signals stored in terminal devices such as mobile phones and computers, and these audio signals are signals recorded in a recording studio. In order to achieve the surround stereoscopic effect of the signal in the headphones, it is necessary to restore the on-site environment when the audio signal was recorded as much as possible, that is, the signal obtained from the three-dimensional scene contained in the audio signal when it was recorded in the recording studio. The existing technology often simulates the propagation scene when the voice signal is emitted, reflected, etc. in the real scene through the voice signal received by the sound sensor to achieve the surround stereoscopic playback of the voice signal, and the sound sensor and the sound source are in the same scene, for example, the sound sensor and the sound source are in the same recording studio, but the headphones and the sound source are not in the same scene, for example, the sound source is in a recording studio, and the user wearing the headphones to listen to music is in the subway. Therefore, it is relatively difficult for the existing technology to use the head-related transfer function in the headphones to achieve the surround stereoscopic effect of the voice signal. Summary of the invention

[0004] The present invention provides a method and medium for processing surround sound of headphones based on audio signal processing, the main purpose of which is to use the head-related transfer function in headphones to achieve the surround sound effect of voice signals.

[0005] To achieve the above object, the present invention provides a headphone surround sound processing method based on audio signal processing, comprising: After the user puts on the earphone, the head coordinates of the user are measured by a positioning device built into the earphone, a head-related transmission model of the user is prepared, and the left earphone audio and the right earphone audio of the earphone are respectively collected; Analyze the audio phase difference between the left earphone audio and the right earphone audio, determine the audio distance difference between the left earphone audio and the right earphone audio by using the audio phase difference, and identify the audio source coordinates of the audio in the earphone by using the audio distance difference; Determine a first model parameter of the head-related transfer model using the left earphone audio and the right earphone audio, and determine a second model parameter of the head-related transfer model using the head coordinates and the audio source coordinates; Reconstruct the sound source of the audio in the earphone by using the first model parameter and the second model parameter to obtain a reconstructed sound source, and reconstruct the left earphone audio and the right earphone audio based on the reconstructed sound source to obtain a reconstructed left audio and a reconstructed right audio; The reconstructed left audio and the reconstructed right audio are respectively enhanced to obtain enhanced left audio and enhanced right audio. After the enhanced left audio and the enhanced right audio are respectively played in the earphone, surround stereo processing of the audio in the earphone is completed to obtain a surround stereo processing result.

[0006] Optionally, measuring the head coordinates of the user by using a positioning device built into the headset includes: Acquire a left ear positioning device and a right ear positioning device in the positioning device; Locating the left ear coordinates of the user by using the left ear positioning device; Locating the coordinates of the user's right ear by using the right ear positioning device; The left ear coordinates and the right ear coordinates are used as the head coordinates.

[0007] Optionally, the analyzing the audio phase difference between the left earphone audio and the right earphone audio includes: Calculating the left audio phase of the left earphone audio; Calculating the right audio phase of the right earphone audio; determining a first audio phase difference between the left audio phase and the right audio phase; Get the scene center point corresponding to the audio in the earphone; Taking the average audio phase between the left audio phase and the right audio phase as the central audio phase of the scene center point; determining a second audio phase difference between the left audio phase and the center audio phase; determining a third audio phase difference between the right audio phase and the center audio phase; The first audio phase difference, the second audio phase difference, and the third audio phase difference are used as the audio phase difference between the left earphone audio and the right earphone audio.

[0008] Optionally, the determining, by using the audio phase difference, an audio distance difference between the left earphone audio and the right earphone audio includes: According to the first audio phase difference in the audio phase difference, the first audio time difference between the left earphone audio and the right earphone audio is calculated using the following formula: in, Indicates the first audio time difference, represents the first audio phase difference, Indicates the mean of the circular frequencies of the left earphone audio and the right earphone audio; Determine a first audio distance difference between the left earphone audio and the right earphone audio using a preset sound speed and the audio time difference; Respectively determining a second audio distance difference and a third audio distance difference corresponding to the second audio phase difference and the third audio phase difference in the audio phase difference; The first audio distance difference, the second audio distance difference, and the third audio distance difference are used as the audio distance difference between the left earphone audio and the right earphone audio.

[0009] Optionally, identifying the audio source coordinates of the audio in the headset by using the audio distance difference includes: Obtaining a first audio distance difference, a second audio distance difference, and a third audio distance difference from the audio distance differences; The audio source coordinates of the audio in the earphone are determined according to the first audio distance difference, the second audio distance difference and the third audio distance difference.

[0010] Optionally, the determining a first model parameter of the head-related transfer model by using the left earphone audio and the right earphone audio includes: Obtaining individual symbols in the head-related transfer model; Adjust the individual symbol to the left value corresponding to the left earphone audio; Adjust the individual symbol to the right value corresponding to the right earphone audio; The left value and the right value are used as first model parameters of the head-related transfer model.

[0011] Optionally, the determining a second model parameter of the head-related transfer model by using the head coordinates and the audio source coordinates includes: Obtaining left ear coordinates and right ear coordinates in the head coordinates; Calculating the coordinate distance between the left ear coordinate and the right ear coordinate; Obtain the on-site left-right distance, on-site left source distance, and on-site right source distance corresponding to the audio source coordinates; Identify the distance multiple between the coordinate distance and the left and right distance of the scene; Determine the left source coordinate distance and the right source coordinate distance corresponding to the on-site left source distance respectively by using the distance multiple; Constructing a left sphere of the left ear coordinates with the left ear coordinates as the center of the left sphere and the left source coordinate distance as the radius of the left sphere; Constructing a right sphere of the right ear coordinates with the right ear coordinates as the center of the right sphere and the right source coordinate distance as the radius of the right sphere; Using the sphere intersection point between the left sphere and the right sphere as the stereo source coordinates corresponding to the head coordinates; identifying a central source distance between the stereo source coordinates and a central coordinate of the coordinate distance; Obtain the horizontal azimuth, sound source elevation, angular frequency mean, left sound pressure, right sound pressure and sound pressure mean corresponding to the audio source coordinates; The mid-source distance, the horizontal azimuth, the sound source elevation, the angular frequency mean, the left sound pressure, the right sound pressure and the sound pressure mean are used as second model parameters.

[0012] Optionally, based on the reconstructed sound source, respectively reconstructing the left earphone audio and the right earphone audio to obtain the reconstructed left audio and the reconstructed right audio, comprises: Obtaining the left value, right value, horizontal azimuth, sound source elevation angle, angular frequency average, left sound pressure, right sound pressure and sound pressure average in the reconstructed sound source; Reconstruct the left earphone audio according to the left value, the horizontal azimuth, the sound source elevation angle, the angular frequency average, the left sound pressure and the sound pressure average to obtain a reconstructed left audio; The right earphone audio is reconstructed according to the right value, the horizontal azimuth, the sound source elevation angle, the angular frequency average, the right sound pressure and the sound pressure average to obtain the reconstructed right audio.

[0013] Optionally, the performing audio enhancement on the reconstructed left audio and the reconstructed right audio respectively to obtain enhanced left audio and enhanced right audio includes: Performing audio enhancement on the reconstructed left audio to obtain enhanced left audio; The reconstructed right audio is subjected to audio enhancement to obtain enhanced right audio.

[0014] In order to solve the above problems, the present invention also provides a headphone surround sound processing medium based on audio signal processing, the medium comprising: An audio acquisition module, used for measuring the head coordinates of the user through a positioning device built into the earphone after the user puts on the earphone, preparing a head-related transmission model of the user, and respectively acquiring the left earphone audio and the right earphone audio of the earphone; a coordinate identification module, configured to analyze an audio phase difference between the left earphone audio and the right earphone audio, determine an audio distance difference between the left earphone audio and the right earphone audio using the audio phase difference, and identify an audio source coordinate of the audio in the earphone using the audio distance difference; a parameter determination module, configured to determine a first model parameter of the head-related transfer model using the left earphone audio and the right earphone audio, and to determine a second model parameter of the head-related transfer model using the head coordinates and the audio source coordinates; an audio reconstruction module, configured to reconstruct the sound source of the audio in the earphone by using the first model parameter and the second model parameter to obtain a reconstructed sound source, and to reconstruct the left earphone audio and the right earphone audio respectively based on the reconstructed sound source to obtain a reconstructed left audio and a reconstructed right audio; The stereo processing module is used to perform audio enhancement on the reconstructed left audio and the reconstructed right audio respectively to obtain enhanced left audio and enhanced right audio. After playing the enhanced left audio and the enhanced right audio in the earphone respectively, the surround stereo processing of the audio in the earphone is completed to obtain a surround stereo processing result.

[0015] Compared with the problem described in the background technology, the embodiment of the present invention locates the position of both ears through GPS positioning technology, and calculates the distance difference contained in the audio through the difference of the binaural audio, and then determines the position of the sound source relative to the earphone in the scene where the earphone is located based on the distance multiple between the distance between the binaural ears and the distance of the sound receiving device in the actual recording scene. Furthermore, the calculated virtual position information of the sound source relative to the earphone is applied to the head-related transmission model, and the audio signal in the earphone is reconstructed through the head-related transmission model, so as to increase the surround stereo effect in the earphone audio signal, and finally enhance the sound quality of the mid- and low-frequency audio signals, so as to achieve the surround stereo effect of the audio signal in the earphone by using the head-related transmission model. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A schematic flow chart of a method for processing headphone surround sound based on audio signal processing provided by an embodiment of the present invention; Figure 2 A schematic diagram of modules for implementing the headphone surround sound processing method based on audio signal processing provided by an embodiment of the present invention.

[0017] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings in conjunction with the embodiments. DETAILED DESCRIPTION

[0018] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0019] The embodiment of the present application provides a method for processing surround sound of headphones based on audio signal processing. The execution subject of the method for processing surround sound of headphones based on audio signal processing includes but is not limited to at least one of the electronic devices such as a server and a terminal that can be configured to execute the method provided by the embodiment of the present application. In other words, the method for processing surround sound of headphones based on audio signal processing can be executed by software or hardware installed on a terminal device or a server device. The server includes but is not limited to: a single server, a server cluster, a cloud server or a cloud server cluster, etc.

[0020] Embodiment 1: Reference Figure 1 FIG. 1 is a flow chart of a method for processing surround sound of headphones based on audio signal processing according to an embodiment of the present invention. In this embodiment, the method for processing surround sound of headphones based on audio signal processing includes: S1. After the user puts on headphones, the head coordinates of the user are measured by a positioning device built into the headphones, a head-related transmission model of the user is prepared, and the left headphone audio and the right headphone audio of the headphones are respectively collected.

[0021] In one embodiment of the present invention, measuring the head coordinates of the user through the positioning device built into the headset includes: obtaining a left ear positioning device and a right ear positioning device in the positioning device; locating the left ear coordinates of the user through the left ear positioning device; locating the right ear coordinates of the user through the right ear positioning device; and using the left ear coordinates and the right ear coordinates as the head coordinates.

[0022] Among them, the positioning device refers to a GPS positioning device, the left ear positioning device is installed in the left earphone, and the right ear positioning device is installed in the right earphone. The left ear coordinates refer to the position of the left earphone when the user wears the earphone, and the right ear coordinates are the same.

[0023] Furthermore, in an embodiment of the present invention, the head-related transmission model refers to a mathematical model that describes the changes in sound caused by the reflection and diffraction process of the head, auricle and torso before reaching the ear canal, and any symbol in the head-related transmission model has no specific value, and subsequent calculations are required to determine the specific value of each symbol.

[0024] S2. Analyze the audio phase difference between the left earphone audio and the right earphone audio, determine the audio distance difference between the left earphone audio and the right earphone audio by using the audio phase difference, and identify the audio source coordinates of the audio in the earphone by using the audio distance difference.

[0025] In one embodiment of the present invention, the analyzing the audio phase difference between the left earphone audio and the right earphone audio includes: calculating the left audio phase of the left earphone audio using the following formula: in, Indicates the left audio phase, represents the left earphone audio at time t, Indicates the amplitude of the left earphone audio. represents the angular frequency of the left earphone audio, and t represents the sequence number of the time; Calculate the right audio phase of the right earphone audio; determine a first audio phase difference between the left audio phase and the right audio phase; obtain the scene center point corresponding to the audio in the earphone; use the average audio phase between the left audio phase and the right audio phase as the center audio phase of the scene center point; determine the second audio phase difference between the left audio phase and the center audio phase; determine the third audio phase difference between the right audio phase and the center audio phase; use the first audio phase difference, the second audio phase difference and the third audio phase difference as the audio phase difference between the left earphone audio and the right earphone audio.

[0026] Among them, the first audio phase difference refers to the difference between the left audio phase and the right audio phase, and the on-site center point refers to the center point between the coordinates of the left sound receiving device (on-site left receiving device) and the coordinates of the right sound receiving device (on-site right receiving device) in the on-site environment when recording the audio. The left sound receiving device does not refer to the left device in position, but refers to the device that transmits audio to the left earphone, and the same applies to the right sound receiving device.

[0027] Optionally, the principles of determining the second audio phase difference between the left audio phase and the center audio phase and determining the third audio phase difference between the right audio phase and the center audio phase are similar to the principles of determining the first audio phase difference between the left audio phase and the right audio phase, and are not further elaborated here.

[0028] In one embodiment of the present invention, the step of determining the audio distance difference between the left earphone audio and the right earphone audio by using the audio phase difference includes: calculating the first audio time difference between the left earphone audio and the right earphone audio by using the following formula according to the first audio phase difference in the audio phase difference:

[0029] in, Indicates the first audio time difference, represents the first audio phase difference, Indicates the mean of the circular frequencies of the left earphone audio and the right earphone audio; A first audio distance difference between the left earphone audio and the right earphone audio is determined using a preset sound speed and the audio time difference; a second audio distance difference and a third audio distance difference corresponding to the second audio phase difference and the third audio phase difference in the audio phase difference are respectively determined; and the first audio distance difference, the second audio distance difference and the third audio distance difference are used as the audio distance difference between the left earphone audio and the right earphone audio.

[0030] The first audio distance difference refers to the product of a preset sound speed and the audio time difference.

[0031] Optionally, the principle of respectively determining the second audio distance difference and the third audio distance difference corresponding to the second audio phase difference and the third audio phase difference in the audio phase difference is similar to the aforementioned principle of determining the first audio distance difference between the left earphone audio and the right earphone audio using a preset sound speed and the audio time difference, and is not elaborated here.

[0032] Furthermore, in an embodiment of the present invention, the audio source coordinates refer to the position of the sound source in a real scene, such as the position of the sound source in a recording studio.

[0033] In one embodiment of the present invention, identifying the audio source coordinates of the audio in the headset by the audio distance difference includes: obtaining a first audio distance difference, a second audio distance difference, and a third audio distance difference in the audio distance difference; and determining the audio source coordinates of the audio in the headset by using the following formula according to the first audio distance difference, the second audio distance difference, and the third audio distance difference: in, represents the audio source coordinates, represents the least squares method, (1) represents equation 1, (2) represents equation 2, (3) represents equation 3, represents the first audio distance difference, represents the second audio distance difference, represents the third audio distance difference, Indicates the coordinates of the left receiving device on site corresponding to the audio in the headphones. Indicates the coordinates of the on-site right receiving device corresponding to the audio in the headphones, Represents the coordinates of the center point of the scene.

[0034] It should be noted that the least squares method mentioned above can be used to solve The specific value of .

[0035] S3. Determine first model parameters of the head-related transfer model using the left earphone audio and the right earphone audio, and determine second model parameters of the head-related transfer model using the head coordinates and the audio source coordinates.

[0036] In one embodiment of the present invention, the use of the left-side headphone audio and the right-side headphone audio to determine the first model parameter of the head-related transmission model includes: obtaining individual symbols in the head-related transmission model; adjusting the individual symbols to left-side values ​​corresponding to the left-side headphone audio; adjusting the individual symbols to right-side values ​​corresponding to the right-side headphone audio; and using the left-side values ​​and the right-side values ​​as the first model parameters of the head-related transmission model.

[0037] Among them, individual symbols refer to the subsequent In , you can use Indicates the value on the left, using It represents the value on the right side. The value on the left side and the value on the right side just represent different calculation objects, which include the left earphone and the right earphone.

[0038] In one embodiment of the present invention, the use of the head coordinates and the audio source coordinates to determine the second model parameters of the head-related transmission model includes: obtaining the left ear coordinates and the right ear coordinates in the head coordinates; calculating the coordinate distance between the left ear coordinates and the right ear coordinates; obtaining the on-site left-right distance, the on-site left source distance and the on-site right source distance corresponding to the audio source coordinates; identifying the distance multiples between the coordinate distance and the on-site left-right distance; using the distance multiples to respectively determine the left source coordinate distance and the right source coordinate distance corresponding to the on-site left source distance; constructing the left sphere with the left ear coordinates as the center of the left sphere and the left source coordinate distance as the radius of the left sphere. A left sphere of the right ear coordinates; constructing the right sphere of the right ear coordinates with the right ear coordinates as the center of the right sphere and the right source coordinate distance as the radius of the right sphere; using the sphere intersection between the left sphere and the right sphere as the stereo source coordinates corresponding to the head coordinates; identifying the mid-source distance between the stereo source coordinates and the center coordinates of the coordinate distance; obtaining the horizontal azimuth angle, sound source elevation angle, angular frequency mean, left sound pressure, right sound pressure and sound pressure mean corresponding to the audio source coordinates; using the mid-source distance, the horizontal azimuth angle, the sound source elevation angle, the angular frequency mean, the left sound pressure, the right sound pressure and the sound pressure mean as the second model parameters.

[0039] Among them, the on-site left-right distance refers to the distance between the on-site left receiving device and the on-site right receiving device, the on-site left source distance refers to the distance between the on-site left receiving device and the audio source coordinates, the on-site right source distance refers to the distance between the on-site right receiving device and the audio source coordinates, the distance multiple refers to the multiple of the on-site left-right distance magnified by the coordinate distance, the left source coordinate distance refers to the distance between the virtual sound source and the left ear coordinates for the headset, and the left source coordinate distance can be obtained by reducing the on-site left source distance by the distance multiple. The right source coordinate distance is similar to the left source coordinate distance. The sphere intersection point can have one or more. You can choose any one of them. The stereo source coordinates refer to the virtual sound source coordinates relative to the headphones. The angular frequency mean refers to the mean of the angular frequencies of the left headphone audio and the right headphone audio. The left sound pressure is directly related to the amplitude of the left headphone audio. There is a positive correlation between the left sound pressure and the amplitude of the left headphone audio. The right sound pressure is the same as the left sound pressure. The sound pressure mean is the mean of the left sound pressure and the right sound pressure. The horizontal azimuth and sound source elevation are the angles of sound emission measured in real scenes, such as the angle of sound emitted by a sound-emitting device measured in a recording studio.

[0040] S4. Reconstruct the sound source of the audio in the earphone using the first model parameters and the second model parameters to obtain a reconstructed sound source. Based on the reconstructed sound source, reconstruct the left earphone audio and the right earphone audio respectively to obtain a reconstructed left audio and a reconstructed right audio.

[0041] It should be noted that the process of reconstructing the sound source of the audio in the earphone by using the first model parameter and the second model parameter to obtain the reconstructed sound source refers to determining the sound source by using the first model parameter and the second model parameter. , The reconstructed sound source refers to the information related to the sound source described by the first model parameters and the second model parameters, not the sound source itself, for example , .

[0042] In one embodiment of the present invention, based on the reconstructed sound source, the left earphone audio and the right earphone audio are respectively reconstructed to obtain the reconstructed left audio and the reconstructed right audio, including: obtaining the left value, the right value, the horizontal azimuth angle, the sound source elevation angle, the angular frequency mean, the left sound pressure, the right sound pressure and the sound pressure mean in the reconstructed sound source; according to the left value, the horizontal azimuth angle, the sound source elevation angle, the angular frequency mean, the left sound pressure and the sound pressure mean, the left earphone audio is reconstructed using the following formula to obtain the reconstructed left audio: in, Reconstructs the left audio. Indicates the left earphone audio. represents the mid-source distance, represents the horizontal azimuth, represents the elevation angle of the sound source, Indicates the angular frequency of the left earphone audio, represents the mean angular frequency, Indicates the value on the left. represents the left side sound pressure, represents the mean sound pressure, A serial number indicating a time; The right earphone audio is reconstructed according to the right value, the horizontal azimuth, the sound source elevation angle, the angular frequency average, the right sound pressure and the sound pressure average to obtain the reconstructed right audio.

[0043] Optionally, the audio of the right earphone is reconstructed according to the right numerical value, the horizontal azimuth angle, the sound source elevation angle, the angular frequency average, the right sound pressure and the sound pressure average to obtain the calculation principle of reconstructing the right audio. The calculation principle of reconstructing the left earphone audio according to the left numerical value, the horizontal azimuth angle, the sound source elevation angle, the angular frequency average, the left sound pressure and the sound pressure average to obtain the reconstructed left audio is similar to the aforementioned audio reconstruction according to the left numerical value, the horizontal azimuth angle, the sound source elevation angle, the angular frequency average, the left sound pressure and the sound pressure average to obtain the reconstructed left audio, and will not be repeated here.

[0044] S5. Perform audio enhancement on the reconstructed left audio and the reconstructed right audio respectively to obtain enhanced left audio and enhanced right audio. After playing the enhanced left audio and the enhanced right audio in the earphone respectively, complete surround sound processing of the audio in the earphone to obtain a surround sound processing result.

[0045] In one embodiment of the present invention, the step of performing audio enhancement on the reconstructed left audio and the reconstructed right audio to obtain enhanced left audio and enhanced right audio includes: performing audio enhancement on the reconstructed left audio using the following formula to obtain enhanced left audio: in, Indicates enhancing the left audio. Reconstructs the mid- and low-frequency signals in the left audio. Represents the high-frequency signal in the reconstructed left audio. represents the concatenation function; The reconstructed right audio is subjected to audio enhancement to obtain enhanced right audio.

[0046] It should be noted that through Splicing and hour, and From different times, you need to follow the order of time. and An audio signal arranged as a series of consecutive moments.

[0047] Compared with the problem described in the background technology, the embodiment of the present invention locates the position of both ears through GPS positioning technology, and calculates the distance difference contained in the audio through the difference of the binaural audio, and then determines the position of the sound source relative to the earphone in the scene where the earphone is located based on the distance multiple between the distance between the binaural ears and the distance of the sound receiving device in the actual recording scene. Furthermore, the calculated virtual position information of the sound source relative to the earphone is applied to the head-related transmission model, and the audio signal in the earphone is reconstructed through the head-related transmission model, so as to increase the surround stereo effect in the earphone audio signal, and finally enhance the sound quality of the mid- and low-frequency audio signals, so as to achieve the surround stereo effect of the audio signal in the earphone by using the head-related transmission model.

[0048] Embodiment 2: like Figure 2 , which is a functional module diagram of a headphone surround sound processing system based on audio signal processing according to the present invention.

[0049] The headphone surround sound processing system 200 based on audio signal processing of the present invention can be installed in an electronic device. According to the functions to be implemented, the headphone surround sound processing system based on audio signal processing can include an audio acquisition module 201, a coordinate recognition module 202, a parameter determination module 203, an audio reconstruction module 204 and a stereo processing module 205. The module of the present invention can also be called a unit, which refers to a series of computer program segments that can be executed by an electronic device processor and can complete fixed functions, which are stored in the memory of the electronic device.

[0050] In the embodiment of the present invention, the functions of each module / unit are as follows: The audio acquisition module 201 is used to measure the head coordinates of the user through the built-in positioning device of the headset after the user puts on the headset, prepare the head-related transmission model of the user, and respectively collect the left earphone audio and the right earphone audio of the headset; The coordinate identification module 202 is used to analyze the audio phase difference between the left earphone audio and the right earphone audio, determine the audio distance difference between the left earphone audio and the right earphone audio by using the audio phase difference, and identify the audio source coordinates of the audio in the earphone by using the audio distance difference; The parameter determination module 203 is used to determine the first model parameter of the head-related transfer model by using the left earphone audio and the right earphone audio, and to determine the second model parameter of the head-related transfer model by using the head coordinates and the audio source coordinates; The audio reconstruction module 204 is used to reconstruct the sound source of the audio in the earphone by using the first model parameter and the second model parameter to obtain a reconstructed sound source, and based on the reconstructed sound source, respectively reconstruct the left earphone audio and the right earphone audio to obtain a reconstructed left audio and a reconstructed right audio; The stereo processing module 205 is used to perform audio enhancement on the reconstructed left audio and the reconstructed right audio respectively to obtain enhanced left audio and enhanced right audio. After playing the enhanced left audio and the enhanced right audio in the earphone respectively, the surround stereo processing of the audio in the earphone is completed to obtain a surround stereo processing result.

[0051] In detail, each module in the headphone surround sound processing system 200 based on audio signal processing in the embodiment of the present invention is used in the same manner as described above. Figure 1 The same technical means are used as the headphone surround sound processing method based on audio signal processing described in, and can produce the same technical effects, so they will not be repeated here.

[0052] It is obvious to those skilled in the art that the present invention is not limited to the details of the above exemplary embodiments, and that the present invention can be implemented in other specific forms without departing from the spirit or essential characteristics of the present invention.

[0053] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solution of the present invention can be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present invention.

Claims

1. A method for processing headphone surround sound based on audio signal processing, characterized in that: The method comprises: After the user puts on the earphone, the head coordinates of the user are measured by a positioning device built into the earphone, a head-related transmission model of the user is prepared, and the left earphone audio and the right earphone audio of the earphone are respectively collected; Analyze the audio phase difference between the left earphone audio and the right earphone audio, determine the audio distance difference between the left earphone audio and the right earphone audio by using the audio phase difference, and identify the audio source coordinates of the audio in the earphone by using the audio distance difference; Determine a first model parameter of the head-related transfer model using the left earphone audio and the right earphone audio, and determine a second model parameter of the head-related transfer model using the head coordinates and the audio source coordinates; Reconstruct the sound source of the audio in the earphone by using the first model parameter and the second model parameter to obtain a reconstructed sound source, and reconstruct the left earphone audio and the right earphone audio based on the reconstructed sound source to obtain a reconstructed left audio and a reconstructed right audio; The reconstructed left audio and the reconstructed right audio are respectively enhanced to obtain enhanced left audio and enhanced right audio. After the enhanced left audio and the enhanced right audio are respectively played in the earphone, surround stereo processing of the audio in the earphone is completed to obtain a surround stereo processing result.

2. The headphone surround sound processing method based on audio signal processing according to claim 1, characterized in that: The measuring the head coordinates of the user by using a positioning device built into the headset includes: Acquire a left ear positioning device and a right ear positioning device in the positioning device; Locating the left ear coordinates of the user by using the left ear positioning device; Locating the coordinates of the user's right ear by using the right ear positioning device; The left ear coordinates and the right ear coordinates are used as the head coordinates.

3. The headphone surround sound processing method based on audio signal processing according to claim 1, characterized in that: The analyzing the audio phase difference between the left earphone audio and the right earphone audio includes: Calculating the left audio phase of the left earphone audio; Calculating the right audio phase of the right earphone audio; determining a first audio phase difference between the left audio phase and the right audio phase; Get the scene center point corresponding to the audio in the earphone; Taking the average audio phase between the left audio phase and the right audio phase as the central audio phase of the scene center point; determining a second audio phase difference between the left audio phase and the center audio phase; determining a third audio phase difference between the right audio phase and the center audio phase; The first audio phase difference, the second audio phase difference, and the third audio phase difference are used as the audio phase difference between the left earphone audio and the right earphone audio.

4. The headphone surround sound processing method based on audio signal processing according to claim 1, characterized in that: The step of determining the audio distance difference between the left earphone audio and the right earphone audio by using the audio phase difference includes: According to the first audio phase difference in the audio phase difference, the first audio time difference between the left earphone audio and the right earphone audio is calculated using the following formula: in, Indicates the first audio time difference, represents the first audio phase difference, Indicates the mean of the circular frequencies of the left earphone audio and the right earphone audio; Determine a first audio distance difference between the left earphone audio and the right earphone audio using a preset sound speed and the audio time difference; Respectively determining a second audio distance difference and a third audio distance difference corresponding to the second audio phase difference and the third audio phase difference in the audio phase difference; The first audio distance difference, the second audio distance difference, and the third audio distance difference are used as the audio distance difference between the left earphone audio and the right earphone audio.

5. The headphone surround sound processing method based on audio signal processing according to claim 1, characterized in that: The step of identifying the audio source coordinates of the audio in the earphone by using the audio distance difference comprises: Obtaining a first audio distance difference, a second audio distance difference, and a third audio distance difference from the audio distance differences; The audio source coordinates of the audio in the earphone are determined according to the first audio distance difference, the second audio distance difference and the third audio distance difference.

6. The headphone surround sound processing method based on audio signal processing according to claim 1, characterized in that: The determining a first model parameter of the head-related transmission model by using the left earphone audio and the right earphone audio includes: Obtaining individual symbols in the head-related transfer model; Adjust the individual symbol to the left value corresponding to the left earphone audio; Adjust the individual symbol to the right value corresponding to the right earphone audio; The left value and the right value are used as first model parameters of the head-related transfer model.

7. The headphone surround sound processing method based on audio signal processing according to claim 1, characterized in that: The determining the second model parameter of the head-related transfer model by using the head coordinates and the audio source coordinates includes: Obtaining left ear coordinates and right ear coordinates in the head coordinates; Calculating the coordinate distance between the left ear coordinate and the right ear coordinate; Obtain the on-site left-right distance, on-site left source distance, and on-site right source distance corresponding to the audio source coordinates; Identify the distance multiple between the coordinate distance and the left and right distance of the scene; Determine the left source coordinate distance and the right source coordinate distance corresponding to the on-site left source distance respectively by using the distance multiple; Constructing a left sphere of the left ear coordinates with the left ear coordinates as the center of the left sphere and the left source coordinate distance as the radius of the left sphere; Constructing a right sphere of the right ear coordinates with the right ear coordinates as the center of the right sphere and the right source coordinate distance as the radius of the right sphere; Using the sphere intersection point between the left sphere and the right sphere as the stereo source coordinates corresponding to the head coordinates; identifying a central source distance between the stereo source coordinates and a central coordinate of the coordinate distance; Obtain the horizontal azimuth, sound source elevation, angular frequency mean, left sound pressure, right sound pressure and sound pressure mean corresponding to the audio source coordinates; The mid-source distance, the horizontal azimuth, the sound source elevation, the angular frequency mean, the left sound pressure, the right sound pressure and the sound pressure mean are used as second model parameters.

8. The headphone surround sound processing method based on audio signal processing according to claim 1, characterized in that: The step of reconstructing the left earphone audio and the right earphone audio based on the reconstructed sound source to obtain the reconstructed left audio and the reconstructed right audio includes: Obtaining the left value, right value, horizontal azimuth, sound source elevation angle, angular frequency average, left sound pressure, right sound pressure and sound pressure average in the reconstructed sound source; Reconstruct the left earphone audio according to the left value, the horizontal azimuth, the sound source elevation angle, the angular frequency average, the left sound pressure and the sound pressure average to obtain a reconstructed left audio; The right earphone audio is reconstructed according to the right value, the horizontal azimuth, the sound source elevation angle, the angular frequency average, the right sound pressure and the sound pressure average to obtain the reconstructed right audio.

9. The headphone surround sound processing method based on audio signal processing according to claim 1, characterized in that: The step of performing audio enhancement on the reconstructed left audio and the reconstructed right audio respectively to obtain enhanced left audio and enhanced right audio includes: Performing audio enhancement on the reconstructed left audio to obtain enhanced left audio; The reconstructed right audio is subjected to audio enhancement to obtain enhanced right audio.

10. A headphone surround sound processing medium based on audio signal processing, characterized in that: The medium includes: An audio acquisition module, used for measuring the head coordinates of the user through a positioning device built into the earphone after the user puts on the earphone, preparing a head-related transmission model of the user, and respectively acquiring the left earphone audio and the right earphone audio of the earphone; a coordinate identification module, configured to analyze an audio phase difference between the left earphone audio and the right earphone audio, determine an audio distance difference between the left earphone audio and the right earphone audio using the audio phase difference, and identify an audio source coordinate of the audio in the earphone using the audio distance difference; a parameter determination module, configured to determine a first model parameter of the head-related transfer model using the left earphone audio and the right earphone audio, and to determine a second model parameter of the head-related transfer model using the head coordinates and the audio source coordinates; an audio reconstruction module, configured to reconstruct the sound source of the audio in the earphone by using the first model parameter and the second model parameter to obtain a reconstructed sound source, and to reconstruct the left earphone audio and the right earphone audio respectively based on the reconstructed sound source to obtain a reconstructed left audio and a reconstructed right audio; The stereo processing module is used to perform audio enhancement on the reconstructed left audio and the reconstructed right audio respectively to obtain enhanced left audio and enhanced right audio. After playing the enhanced left audio and the enhanced right audio in the earphone respectively, the surround stereo processing of the audio in the earphone is completed to obtain a surround stereo processing result.

Images