Headphone Surround Sound Processing Method and Medium Based on Audio Signal Processing

Abstract

The present invention relates to the technical field of voice signal processing, and discloses a headphone surround sound processing method and medium based on audio signal processing, including: measuring the head coordinates of a user; analyzing the audio phase difference between the audio of the left earphone and the audio of the right earphone to determine the audio distance difference between the audio of the left earphone and the audio of the right earphone, and identifying the audio source coordinates of the audio in the earphone through the audio distance difference; using the audio of the left earphone and the audio of the right earphone to determine the first model parameter of the head-related transfer model, and using the head coordinates and the audio source coordinates to determine the second model parameter of the head-related transfer model; performing sound source reconstruction on the audio in the earphone through the first model parameter and the second model parameter, and respectively performing audio reconstruction on the audio of the left earphone and the audio of the right earphone; respectively performing audio enhancement on the reconstructed left audio and the reconstructed right audio. The present invention can utilize the head-related transfer function in the earphone to achieve the surround sound effect of the voice signal.

Description

Technical Field

[0001] The present invention relates to a method and medium for processing headphone surround sound based on audio signal processing, and belongs to the technical field of speech signal processing. Background Art

[0002] Currently, headphone surround sound processing technology is to enable users to obtain a more realistic and immersive audio experience when using headphones. The human auditory system can judge the direction and position of sound by receiving information such as the time difference, intensity difference, and phase difference of sound through both ears. Headphone surround sound processing technology utilizes this principle to process audio signals and simulate the positions of different sound sources in space, making users have the illusion that the sound comes from different directions, so that users seem to be in different spatial environments. Everyone's head shape, auricle structure, etc. are different, which leads to differences in the spatial perception of sound among different people. The head-related transfer function (HRTF) is a function that describes the transfer characteristics from the sound source to both ears, and it contains the influence of individual differences on the spatial perception of sound. In headphone surround sound processing, using HRTF can provide a personalized surround sound experience for each user.

[0003] Currently, the ability to process the surround sound of signals in headphones is insufficient for the following reasons. The audio in headphones comes from terminal devices such as mobile phones and computers, and these audio signals are signals recorded in a recording studio. To achieve the surround sound effect of signals in headphones, it is necessary to restore the on-site environment when the audio signal was recorded as much as possible, that is, the signal obtained from the three-dimensional scene included when the audio signal was recorded in the recording studio. The existing technology often simulates the propagation scene when the voice signal is emitted and reflected in the real scene through the voice signal received by the sound sensor to achieve the surround sound playback of the voice signal, and the sound sensor and the sound source are in the same scene. For example, the sound sensor and the sound source are in the same recording studio. However, the headphone and the sound source are not in the same scene. For example, the sound source is in the recording studio, while the user listening to music with headphones is in the subway. Therefore, it is relatively difficult to use the head-related transfer function in the existing technology to achieve the surround sound effect of voice signals in headphones. Summary of the Invention

[0004] The present invention provides a method and medium for processing headphone surround sound based on audio signal processing, and its main purpose is to use the head-related transfer function in headphones to achieve the surround sound effect of voice signals.

[0005] To achieve the above object, a method for processing headphone surround sound based on audio signal processing provided by the present invention includes:

[0006] After the user wears the headphones, measure the head coordinates of the user through the positioning device built into the headphones, prepare the head-related transfer model of the user, and collect the left-headphone audio and the right-headphone audio of the headphones respectively;

[0007] Analyze the audio phase difference between the left-headphone audio and the right-headphone audio, use the audio phase difference to determine the audio distance difference between the left-headphone audio and the right-headphone audio, and identify the audio source coordinates of the audio in the headphones through the audio distance difference;

[0008] Use the left-headphone audio and the right-headphone audio to determine the first model parameter of the head-related transfer model, and use the head coordinates and the audio source coordinates to determine the second model parameter of the head-related transfer model;

[0009] Perform sound source reconstruction on the audio in the headphones through the first model parameter and the second model parameter to obtain a reconstructed sound source, and based on the reconstructed sound source, perform audio reconstruction on the left-headphone audio and the right-headphone audio respectively to obtain a reconstructed left audio and a reconstructed right audio;

[0010] Perform audio enhancement on the reconstructed left audio and the reconstructed right audio respectively to obtain an enhanced left audio and an enhanced right audio. After playing the enhanced left audio and the enhanced right audio in the headphones respectively, complete the surround sound processing of the audio in the headphones to obtain a surround sound processing result.

[0011] Optionally, the measuring the head coordinates of the user through the positioning device built into the headphones includes:

[0012] Obtain the left-ear positioning device and the right-ear positioning device in the positioning device;

[0013] Locate the left-ear coordinates of the user through the left-ear positioning device;

[0014] Locate the right-ear coordinates of the user through the right-ear positioning device;

[0015] Use the left-ear coordinates and the right-ear coordinates as the head coordinates.

[0016] Optionally, the analyzing the audio phase difference between the left-headphone audio and the right-headphone audio includes:

[0017] Calculate the left audio phase of the left-headphone audio;

[0018] Calculate the right audio phase of the right-headphone audio;

[0019] Determine the first audio phase difference between the left audio phase and the right audio phase;

[0020] Obtain the on-site center point corresponding to the audio in the earphone;

[0021] Take the average audio phase between the left audio phase and the right audio phase as the central audio phase of the on-site center point;

[0022] Determine the second audio phase difference between the left audio phase and the central audio phase;

[0023] Determine the third audio phase difference between the right audio phase and the central audio phase;

[0024] Take the first audio phase difference, the second audio phase difference, and the third audio phase difference as the audio phase difference between the left earphone audio and the right earphone audio.

[0025] Optionally, the using the audio phase difference to determine the audio distance difference between the left earphone audio and the right earphone audio includes:

[0026] According to the first audio phase difference in the audio phase difference, use the following formula to calculate the first audio time difference between the left earphone audio and the right earphone audio: Wherein, represents the first audio time difference, represents the first audio phase difference, represents the average value of the circular frequencies of the left earphone audio and the right earphone audio;

[0027] Use the preset sound speed and the audio time difference to determine the first audio distance difference between the left earphone audio and the right earphone audio;

[0028] Respectively determine the second audio distance difference and the third audio distance difference corresponding to the second audio phase difference and the third audio phase difference in the audio phase difference;

[0029] Take the first audio distance difference, the second audio distance difference, and the third audio distance difference as the audio distance difference between the left earphone audio and the right earphone audio.

[0030] Optionally, the identifying the audio source coordinates of the audio in the earphone through the audio distance difference includes:

[0031] Obtain the first audio distance difference, the second audio distance difference, and the third audio distance difference in the audio distance difference;

[0032] According to the first audio distance difference, the second audio distance difference, and the third audio distance difference, determine the audio source coordinates of the audio in the earphone.

[0033] Optionally, determining the first model parameter of the head-related transfer model using the left earphone audio and the right earphone audio includes:

[0034] Obtaining the individual symbols in the head-related transfer model;

[0035] Adjusting the individual symbols to the left values corresponding to the left earphone audio;

[0036] Adjusting the individual symbols to the right values corresponding to the right earphone audio;

[0037] Taking the left values and the right values as the first model parameter of the head-related transfer model.

[0038] Optionally, determining the second model parameter of the head-related transfer model using the head coordinates and the audio source coordinates includes:

[0039] Obtaining the left ear coordinate and the right ear coordinate in the head coordinates;

[0040] Calculating the coordinate distance between the left ear coordinate and the right ear coordinate;

[0041] Obtaining the on-site left-right distance, on-site left source distance, and on-site right source distance corresponding to the audio source coordinates;

[0042] Identifying the distance multiple between the coordinate distance and the on-site left-right distance;

[0043] Using the distance multiple to respectively determine the left source coordinate distance and the right source coordinate distance corresponding to the on-site left source distance;

[0044] Constructing a left sphere of the left ear coordinate with the left ear coordinate as the center of the left sphere and the left source coordinate distance as the radius of the left sphere;

[0045] Constructing a right sphere of the right ear coordinate with the right ear coordinate as the center of the right sphere and the right source coordinate distance as the radius of the right sphere;

[0046] Taking the sphere intersection point between the left sphere and the right sphere as the three-dimensional source coordinate corresponding to the head coordinates;

[0047] Identifying the middle source distance between the three-dimensional source coordinate and the center coordinate of the coordinate distance;

[0048] Obtaining the horizontal azimuth angle, sound source elevation angle, average angular frequency, left sound pressure, right sound pressure, and average sound pressure corresponding to the audio source coordinates;

[0049] Take the middle source distance, the horizontal azimuth angle, the sound source elevation angle, the average angular frequency, the left sound pressure, the right sound pressure, and the average sound pressure as the second model parameters.

[0050] Optionally, based on the reconstructed sound source, respectively perform audio reconstruction on the left earphone audio and the right earphone audio to obtain reconstructed left audio and reconstructed right audio, including:

[0051] Obtain the left value, right value, horizontal azimuth angle, sound source elevation angle, average angular frequency, left sound pressure, right sound pressure, and average sound pressure in the reconstructed sound source;

[0052] According to the left value, the horizontal azimuth angle, the sound source elevation angle, the average angular frequency, the left sound pressure, and the average sound pressure, perform audio reconstruction on the left earphone audio to obtain reconstructed left audio;

[0053] According to the right value, the horizontal azimuth angle, the sound source elevation angle, the average angular frequency, the right sound pressure, and the average sound pressure, perform audio reconstruction on the right earphone audio to obtain reconstructed right audio.

[0054] Optionally, respectively perform audio enhancement on the reconstructed left audio and the reconstructed right audio to obtain enhanced left audio and enhanced right audio, including:

[0055] Perform audio enhancement on the reconstructed left audio to obtain enhanced left audio;

[0056] Perform audio enhancement on the reconstructed right audio to obtain enhanced right audio.

[0057] To solve the above problems, the present invention also provides an earphone surround sound processing medium based on audio signal processing, and the medium includes:

[0058] An audio acquisition module, configured to, after the user wears the earphone, measure the head coordinates of the user through a positioning device built in the earphone, prepare the head-related transfer model of the user, and respectively acquire the left earphone audio and the right earphone audio of the earphone;

[0059] A coordinate recognition module, configured to analyze the audio phase difference between the left earphone audio and the right earphone audio, use the audio phase difference to determine the audio distance difference between the left earphone audio and the right earphone audio, and identify the audio source coordinates of the audio in the earphone through the audio distance difference;

[0060] A parameter determination module, configured to determine first model parameters of the head-related transfer function model by using the left earphone audio and the right earphone audio, and determine second model parameters of the head-related transfer function model by using the head coordinates and the audio source coordinates;

[0061] An audio reconstruction module, configured to perform sound source reconstruction on the audio in the earphones by using the first model parameters and the second model parameters to obtain a reconstructed sound source, and respectively perform audio reconstruction on the left earphone audio and the right earphone audio based on the reconstructed sound source to obtain reconstructed left audio and reconstructed right audio;

[0062] A stereo processing module, configured to respectively perform audio enhancement on the reconstructed left audio and the reconstructed right audio to obtain enhanced left audio and enhanced right audio, and after respectively playing the enhanced left audio and the enhanced right audio in the earphones, complete the surround stereo processing of the audio in the earphones to obtain a surround stereo processing result.

[0063] Compared with the problems in the background art, in the embodiments of the present invention, the positions of both ears are located by using the GPS positioning technology, and the distance difference contained in the audio is calculated through the difference between the two-ear audio, and further, based on the distance multiple between the distance between both ears and the distance of the sound collection device in the actual recording scene from the ears, the position of the sound source in the scene where the earphones are located relative to the earphones is determined. Further, the virtual position information of the sound source relative to the earphones obtained by calculation is applied to the head-related transfer function model, and the audio signal in the earphones is reconstructed by using the head-related transfer function model, so as to add a surround stereo effect to the earphone audio signal. Finally, the sound quality of the audio signal in the mid-low frequency range is enhanced, so as to achieve the surround stereo effect of the audio signal in the earphones by using the head-related transfer function model. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] Figure 1 It is a schematic flowchart of a method for processing surround stereo of earphones based on audio signal processing provided by an embodiment of the present invention;

[0065] Figure 2 It is a schematic diagram of a module for implementing the method for processing surround stereo of earphones based on audio signal processing provided by an embodiment of the present invention.

[0066] The implementation, functional features and advantages of the object of the present invention will be further described with reference to the embodiments and the accompanying drawings. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0067] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0068] An embodiment of the present application provides a method for processing headphone surround sound based on audio signal processing. The execution subject of the method for processing headphone surround sound based on audio signal processing includes at least one of electronic devices such as a server, a terminal, etc. that can be configured to execute the method provided by the embodiment of the present application. In other words, the method for processing headphone surround sound based on audio signal processing can be executed by software or hardware installed on a terminal device or a server device. The server includes but is not limited to: a single server, a server cluster, a cloud server, or a cloud server cluster, etc.

[0069] Embodiment 1:

[0070] Referring to Figure 1 As shown, it is a flowchart of a method for processing headphone surround sound based on audio signal processing provided by an embodiment of the present invention. In this embodiment, the method for processing headphone surround sound based on audio signal processing includes:

[0071] S1. After the user wears the headphones, measure the head coordinates of the user through the positioning device built in the headphones, prepare the head-related transfer function of the user, and respectively collect the left-ear headphone audio and the right-ear headphone audio of the headphones.

[0072] In an embodiment of the present invention, the measuring the head coordinates of the user through the positioning device built in the headphones includes: obtaining the left-ear positioning device and the right-ear positioning device in the positioning device; positioning the left-ear coordinates of the user through the left-ear positioning device; positioning the right-ear coordinates of the user through the right-ear positioning device; and taking the left-ear coordinates and the right-ear coordinates as the head coordinates.

[0073] Among them, the positioning device refers to a GPS positioning device. The left-ear positioning device is installed in the left headphone, and the right-ear positioning device is installed in the right headphone. The left-ear coordinates refer to the position where the left headphone is located when the user wears the headphones, and the same applies to the right-ear coordinates.

[0074] Further, in an embodiment of the present invention, the head-related transfer function refers to a mathematical model that describes the changes generated by the reflection and diffraction processes of sound passing through the head, ear canal, and torso before reaching the ear canal. Any symbol in the head-related transfer function has no specific value, and the specific value of each symbol needs to be determined through subsequent calculations.

[0075] S2. Analyze the audio phase difference between the left-ear headphone audio and the right-ear headphone audio, use the audio phase difference to determine the audio distance difference between the left-ear headphone audio and the right-ear headphone audio, and identify the audio source coordinates of the audio in the headphones through the audio distance difference.

[0076] In one embodiment of the present invention, analyzing the audio phase difference between the left earphone audio and the right earphone audio includes: calculating the left audio phase of the left earphone audio using the following formula: Wherein, represents the left audio phase, represents the left earphone audio at time t, represents the amplitude of the left earphone audio, represents the angular frequency of the left earphone audio, and t represents the serial number of the time;

[0077] Calculating the right audio phase of the right earphone audio; determining the first audio phase difference between the left audio phase and the right audio phase; obtaining the on-site center point corresponding to the audio in the earphone; taking the average audio phase between the left audio phase and the right audio phase as the center audio phase of the on-site center point; determining the second audio phase difference between the left audio phase and the center audio phase; determining the third audio phase difference between the right audio phase and the center audio phase; taking the first audio phase difference, the second audio phase difference, and the third audio phase difference as the audio phase difference between the left earphone audio and the right earphone audio.

[0078] Wherein, the first audio phase difference refers to the difference between the left audio phase and the right audio phase, and the on-site center point refers to the center point between the coordinates of the left sound collection device (on-site left receiving device) and the right sound collection device (on-site right receiving device) in the on-site environment when collecting the audio. The left sound collection device does not refer to the device on the left in terms of position, but refers to the device that transmits the audio to the left earphone, and the same applies to the right sound collection device.

[0079] Optionally, the principles of determining the second audio phase difference between the left audio phase and the center audio phase and determining the third audio phase difference between the right audio phase and the center audio phase are similar to the principle of determining the first audio phase difference between the left audio phase and the right audio phase described above, and will not be further elaborated here.

[0080] In one embodiment of the present invention, using the audio phase difference to determine the audio distance difference between the left earphone audio and the right earphone audio includes: according to the first audio phase difference in the audio phase difference, calculating the first audio time difference between the left earphone audio and the right earphone audio using the following formula:

[0081] Wherein, represents the first audio time difference, represents the first audio phase difference, represents the mean angular frequency of the audio of the left earphone and the audio of the right earphone;

[0082] Using the preset sound speed and the audio time difference to determine the first audio distance difference between the audio of the left earphone and the audio of the right earphone; respectively determining the second audio distance difference and the third audio distance difference corresponding to the second audio phase difference and the third audio phase difference in the audio phase difference; taking the first audio distance difference, the second audio distance difference and the third audio distance difference as the audio distance difference between the audio of the left earphone and the audio of the right earphone.

[0083] Wherein, the first audio distance difference refers to the product of the preset sound speed and the audio time difference.

[0084] Optionally, the principle of respectively determining the second audio distance difference and the third audio distance difference corresponding to the second audio phase difference and the third audio phase difference in the audio phase difference is similar to the principle of using the preset sound speed and the audio time difference to determine the first audio distance difference between the audio of the left earphone and the audio of the right earphone as described above, and will not be elaborated here.

[0085] Furthermore, in the embodiments of the present invention, the audio source coordinate refers to the position where the sound source is located in the real scene, such as the position of the sound source in a recording studio.

[0086] In an embodiment of the present invention, the identifying the audio source coordinate of the audio in the earphone through the audio distance difference includes: obtaining the first audio distance difference, the second audio distance difference and the third audio distance difference in the audio distance difference; according to the first audio distance difference, the second audio distance difference and the third audio distance difference, using the following formula to determine the audio source coordinate of the audio in the earphone: Wherein, represents the audio source coordinate, represents the least squares method, (1) represents Equation 1, (2) represents Equation 2, (3) represents Equation 3, represents the first audio distance difference, represents the second audio distance difference, represents the third audio distance difference, represents the coordinate of the on-site left receiving device corresponding to the audio in the earphone, represents the coordinate of the on-site right receiving device corresponding to the audio in the earphone, represents the coordinate of the on-site center point.

[0087] It should be noted that the specific value of can be solved through the above least squares method.

[0088] S3. Determine the first model parameter of the head-related transfer model using the left-earphone audio and the right-earphone audio, and determine the second model parameter of the head-related transfer model using the head coordinates and the audio source coordinates.

[0089] In an embodiment of the present invention, the determining the first model parameter of the head-related transfer model using the left-earphone audio and the right-earphone audio includes: obtaining the individual symbols in the head-related transfer model; adjusting the individual symbols to the left value corresponding to the left-earphone audio; adjusting the individual symbols to the right value corresponding to the right-earphone audio; using the left value and the right value as the first model parameter of the head-related transfer model.

[0090] Among them, the individual symbol refers to the subsequent in , which can use to represent the left value and to represent the right value. The left value and the right value only represent different calculation objects, and these calculation objects include the left earphone and the right earphone.

[0091] In an embodiment of the present invention, the determining the second model parameter of the head-related transfer model using the head coordinates and the audio source coordinates includes: obtaining the left-ear coordinate and the right-ear coordinate in the head coordinates; calculating the coordinate distance between the left-ear coordinate and the right-ear coordinate; obtaining the on-site left-right distance, on-site left-source distance, and on-site right-source distance corresponding to the audio source coordinates; identifying the distance multiple between the coordinate distance and the on-site left-right distance; using the distance multiple to respectively determine the left-source coordinate distance and the right-source coordinate distance corresponding to the on-site left-source distance; constructing a left sphere of the left-ear coordinate with the left-ear coordinate as the center of the left sphere and the left-source coordinate distance as the radius of the left sphere; constructing a right sphere of the right-ear coordinate with the right-ear coordinate as the center of the right sphere and the right-source coordinate distance as the radius of the right sphere; using the sphere intersection point between the left sphere and the right sphere as the three-dimensional source coordinate corresponding to the head coordinates; identifying the middle-source distance between the three-dimensional source coordinate and the center coordinate of the coordinate distance; obtaining the horizontal azimuth angle, sound source elevation angle, average angular frequency, left sound pressure, right sound pressure, and average sound pressure corresponding to the audio source coordinates; using the middle-source distance, the horizontal azimuth angle, the sound source elevation angle, the average angular frequency, the left sound pressure, the right sound pressure, and the average sound pressure as the second model parameter.

[0092] Among them, the on-site left-right distance refers to the distance between the receiving device on the left side of the site and the receiving device on the right side of the site. The on-site left-source distance refers to the distance between the receiving device on the left side of the site and the audio source coordinates. The on-site right-source distance refers to the distance between the receiving device on the right side of the site and the audio source coordinates. The distance multiple refers to the multiple by which the on-site left-right distance is magnified compared to the coordinate distance. The left-source coordinate distance refers to, for the earphone, the distance between the virtual sound source and the left ear coordinates. The left-source coordinate distance can be obtained by reducing the on-site left-source distance by the distance multiple. The right-source coordinate distance is the same as the left-source coordinate distance. The sphere intersection points can be one or more, and any one of them can be selected. The three-dimensional source coordinates refer to the virtual sound source coordinates relative to the earphone. The average angular frequency refers to the average between the angular frequency of the audio of the left earphone and the angular frequency of the audio of the right earphone. The left sound pressure is directly related to the amplitude of the audio of the left earphone, and there is a positive correlation between the left sound pressure and the amplitude of the audio of the left earphone. The right sound pressure is the same as the left sound pressure. The average sound pressure is the average between the left sound pressure and the right sound pressure. The horizontal azimuth angle and the sound source elevation angle are the angles of sound emission measured in the real scene, such as the angle of the sound-emitting device measured in the recording studio.

[0093] S4. Reconstruct the sound source of the audio in the earphone through the first model parameter and the second model parameter to obtain a reconstructed sound source. Based on the reconstructed sound source, perform audio reconstruction on the left earphone audio and the right earphone audio respectively to obtain reconstructed left audio and reconstructed right audio.

[0094] It should be noted that the process of reconstructing the sound source of the audio in the earphone through the first model parameter and the second model parameter to obtain a reconstructed sound source refers to using the first model parameter and the second model parameter to determine 、 and other parameters. The reconstructed sound source refers to the information related to the sound source described by the first model parameter and the second model parameter, rather than the sound source itself. For example 、 .

[0095] In an embodiment of the present invention, the performing audio reconstruction on the left earphone audio and the right earphone audio respectively based on the reconstructed sound source to obtain reconstructed left audio and reconstructed right audio includes: obtaining the left value, right value, horizontal azimuth angle, sound source elevation angle, average angular frequency, left sound pressure, right sound pressure and average sound pressure in the reconstructed sound source; according to the left value, the horizontal azimuth angle, the sound source elevation angle, the average angular frequency, the left sound pressure and the average sound pressure, using the following formula to perform audio reconstruction on the left earphone audio to obtain reconstructed left audio: Among them, represents the reconstructed left audio, Indicates the audio of the left earphone, Indicates the mid-source distance, Indicates the horizontal azimuth angle, Indicates the elevation angle of the sound source, Indicates the angular frequency of the audio of the left earphone, Indicates the average value of the angular frequency, Indicates the left value, Indicates the sound pressure of the left side, Indicates the average value of the sound pressure, Indicates the serial number of the moment;

[0096] According to the right value, the horizontal azimuth angle, the elevation angle of the sound source, the average value of the angular frequency, the right sound pressure and the average value of the sound pressure, perform audio reconstruction on the audio of the right earphone to obtain the reconstructed right audio.

[0097] Optionally, the calculation principle of performing audio reconstruction on the audio of the right earphone according to the right value, the horizontal azimuth angle, the elevation angle of the sound source, the average value of the angular frequency, the right sound pressure and the average value of the sound pressure to obtain the reconstructed right audio is similar to the principle of performing audio reconstruction on the audio of the left earphone according to the left value, the horizontal azimuth angle, the elevation angle of the sound source, the average value of the angular frequency, the left sound pressure and the average value of the sound pressure to obtain the reconstructed left audio, and will not be elaborated here.

[0098] S5. Perform audio enhancement on the reconstructed left audio and the reconstructed right audio respectively to obtain the enhanced left audio and the enhanced right audio. After playing the enhanced left audio and the enhanced right audio in the earphone respectively, complete the surround sound processing of the audio in the earphone to obtain the surround sound processing result.

[0099] In an embodiment of the present invention, the performing audio enhancement on the reconstructed left audio and the reconstructed right audio respectively to obtain the enhanced left audio and the enhanced right audio includes: performing audio enhancement on the reconstructed left audio by using the following formula to obtain the enhanced left audio: Wherein, Indicates the enhanced left audio, Indicates the mid-low frequency signal in the reconstructed left audio, Indicates the high frequency signal in the reconstructed left audio, Indicates the splicing function;

[0100] Perform audio enhancement on the reconstructed right audio to obtain the enhanced right audio.

[0101] It should be noted that by splicing and when, and From different moments, it is necessary to arrange the and audio signals into a series of consecutive moments in chronological order.

[0102] Compared with the problems described in the background art, in the embodiments of the present invention, the positions of the two ears are located through GPS positioning technology, and the distance difference contained in the audio is calculated through the difference between the two-ear audio. Furthermore, based on the distance multiple between the distance between the two ears and the distance of the sound collection device in the actual recording scene, the position of the sound source relative to the earphone in the scene where the earphone is located is determined. Further, the virtual position information of the sound source relative to the earphone obtained by calculation is applied to the head-related transfer model, and the audio signal in the earphone is reconstructed through the head-related transfer model, so as to add a surround stereo effect to the earphone audio signal. Finally, the sound quality of the mid-low frequency audio signal is enhanced, so as to achieve the surround stereo effect of the audio signal in the earphone by using the head-related transfer model.

[0103] Embodiment 2:

[0104] As Figure 2 shown, it is a functional module diagram of a headphone surround stereo processing system based on audio signal processing according to the present invention.

[0105] The headphone surround stereo processing system 200 based on audio signal processing according to the present invention can be installed in an electronic device. According to the functions achieved, the headphone surround stereo processing system based on audio signal processing may include an audio acquisition module 201, a coordinate recognition module 202, a parameter determination module 203, an audio reconstruction module 204, and a stereo processing module 205. The modules in the present invention may also be referred to as units, which refer to a series of computer program segments that can be executed by a processor of an electronic device and can complete fixed functions, and are stored in the memory of the electronic device.

[0106] In the embodiments of the present invention, the functions of each module / unit are as follows:

[0107] The audio acquisition module 201 is used to measure the head coordinates of the user through the positioning device built in the earphone after the user wears the earphone, prepare the head-related transfer model of the user, and respectively collect the left-ear audio and the right-ear audio of the earphone;

[0108] The coordinate recognition module 202 is used to analyze the audio phase difference between the left-ear audio and the right-ear audio, use the audio phase difference to determine the audio distance difference between the left-ear audio and the right-ear audio, and identify the audio source coordinates of the audio in the earphone through the audio distance difference;

[0109] The parameter determination module 203 is configured to determine first model parameters of the head-related transfer model by using the left earphone audio and the right earphone audio, and determine second model parameters of the head-related transfer model by using the head coordinates and the audio source coordinates;

[0110] The audio reconstruction module 204 is configured to perform sound source reconstruction on the audio in the earphone through the first model parameters and the second model parameters to obtain a reconstructed sound source, and respectively perform audio reconstruction on the left earphone audio and the right earphone audio based on the reconstructed sound source to obtain reconstructed left audio and reconstructed right audio;

[0111] The stereo processing module 205 is configured to respectively perform audio enhancement on the reconstructed left audio and the reconstructed right audio to obtain enhanced left audio and enhanced right audio, and after respectively playing the enhanced left audio and the enhanced right audio in the earphone, complete the surround sound processing of the audio in the earphone to obtain a surround sound processing result.

[0112] Specifically, each module in the headphone surround sound processing system 200 based on audio signal processing in the embodiments of the present invention adopts the same technical means as those in the above Figure 1 described headphone surround sound processing method based on audio signal processing, and can produce the same technical effects, which will not be elaborated here.

[0113] For those skilled in the art, it is obvious that the present invention is not limited to the details of the above exemplary embodiments, and without departing from the spirit or basic characteristics of the present invention, the present invention can be implemented in other specific forms.

[0114] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit them. Although the present invention has been described in detail with reference to the preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced without departing from the spirit and scope of the technical solutions of the present invention.

Claims

1. A headphone surround sound processing method based on audio signal processing, characterized in that, The method includes: After the user wears the earphone, measure the head coordinates of the user through the positioning device built in the earphone, prepare the head-related transfer model of the user, and collect the left-ear audio and right-ear audio of the earphone respectively; Analyze the audio phase difference between the left-ear audio and the right-ear audio, use the audio phase difference to determine the audio distance difference between the left-ear audio and the right-ear audio, and identify the audio source coordinates of the audio in the earphone through the audio distance difference; Use the left-ear audio and the right-ear audio to determine the first model parameter of the head-related transfer model, and use the head coordinates and the audio source coordinates to determine the second model parameter of the head-related transfer model. Among them, the step of using the head coordinates and the audio source coordinates to determine the second model parameter of the head-related transfer model includes: Obtain the left-ear coordinates and right-ear coordinates in the head coordinates; Calculate the coordinate distance between the left-ear coordinates and the right-ear coordinates; Obtain the on-site left-right distance, on-site left-source distance, and on-site right-source distance corresponding to the audio source coordinates; Identify the distance multiple between the coordinate distance and the on-site left-right distance; Use the distance multiple to determine the left-source coordinate distance and right-source coordinate distance corresponding to the on-site left-source distance respectively; Construct a left sphere with the left-ear coordinates as the center of the left sphere and the left-source coordinate distance as the radius of the left sphere; Construct a right sphere with the right-ear coordinates as the center of the right sphere and the right-source coordinate distance as the radius of the right sphere; Take the sphere intersection point between the left sphere and the right sphere as the three-dimensional source coordinates corresponding to the head coordinates; Identify the middle-source distance between the three-dimensional source coordinates and the center coordinates of the coordinate distance; Obtain the horizontal azimuth angle, sound source elevation angle, average angular frequency, left sound pressure, right sound pressure, and average sound pressure corresponding to the audio source coordinates; Take the middle-source distance, the horizontal azimuth angle, the sound source elevation angle, the average angular frequency, the left sound pressure, the right sound pressure, and the average sound pressure as the second model parameter; Perform sound source reconstruction on the audio in the earphone through the first model parameter and the second model parameter to obtain a reconstructed sound source. Based on the reconstructed sound source, perform audio reconstruction on the left-ear audio and the right-ear audio respectively to obtain reconstructed left audio and reconstructed right audio; Perform audio enhancement on the reconstructed left audio and the reconstructed right audio respectively to obtain enhanced left audio and enhanced right audio. After playing the enhanced left audio and the enhanced right audio in the earphone respectively, complete the surround sound processing of the audio in the earphone to obtain a surround sound processing result.

2. The method for processing headphone surround sound based on audio signal processing according to claim 1, characterized in that, The step of measuring the head coordinates of the user through the positioning device built in the earphone includes: Obtain the left-ear positioning device and the right-ear positioning device in the positioning device; Locate the left-ear coordinates of the user through the left-ear positioning device; Locate the right-ear coordinates of the user through the right-ear positioning device; Use the left ear coordinates and the right ear coordinates as the head coordinates.

3. The method for processing headphone surround sound based on audio signal processing according to claim 1, characterized in that, The analyzing the audio phase difference between the left earphone audio and the right earphone audio includes: Calculate the left audio phase of the left earphone audio; Calculate the right audio phase of the right earphone audio; Determine the first audio phase difference between the left audio phase and the right audio phase; Obtain the on-site center point corresponding to the audio in the earphone; Use the average audio phase between the left audio phase and the right audio phase as the center audio phase of the on-site center point; Determine the second audio phase difference between the left audio phase and the center audio phase; Determine the third audio phase difference between the right audio phase and the center audio phase; Use the first audio phase difference, the second audio phase difference, and the third audio phase difference as the audio phase difference between the left earphone audio and the right earphone audio.

4. The method for processing headphone surround sound based on audio signal processing according to claim 1, wherein The using the audio phase difference to determine the audio distance difference between the left earphone audio and the right earphone audio includes: Calculate the first audio time difference between the left earphone audio and the right earphone audio according to the first audio phase difference in the audio phase difference; Use the preset sound speed and the audio time difference to determine the first audio distance difference between the left earphone audio and the right earphone audio; Respectively determine the second audio distance difference and the third audio distance difference corresponding to the second audio phase difference and the third audio phase difference in the audio phase difference; Use the first audio distance difference, the second audio distance difference, and the third audio distance difference as the audio distance difference between the left earphone audio and the right earphone audio.

5. The method for processing headphone surround sound based on audio signal processing according to claim 1, characterized in that, The identifying the audio source coordinates of the audio in the earphone through the audio distance difference includes: Obtain the first audio distance difference, the second audio distance difference, and the third audio distance difference in the audio distance difference; Determine the audio source coordinates of the audio in the earphone according to the first audio distance difference, the second audio distance difference, and the third audio distance difference.

6. The method for processing headphone surround sound based on audio signal processing according to claim 1, characterized in that, The using the left earphone audio and the right earphone audio to determine the first model parameter of the head-related transfer model includes: Obtain the individual symbol in the head-related transfer model; Adjust the individual symbol to the left value corresponding to the left earphone audio; Adjust the individual symbol to the right value corresponding to the right earphone audio; Use the left value and the right value as the first model parameter of the head-related transfer model.

7. The method for processing headphone surround sound based on audio signal processing according to claim 1, characterized in that, The respectively performing audio reconstruction on the left earphone audio and the right earphone audio based on the reconstructed sound source to obtain the reconstructed left audio and the reconstructed right audio includes: Obtain the left value, the right value, the horizontal azimuth angle, the sound source elevation angle, the average angular frequency, the left sound pressure, the right sound pressure, and the average sound pressure in the reconstructed sound source; Perform audio reconstruction on the left earphone audio according to the left value, the horizontal azimuth angle, the sound source elevation angle, the average angular frequency, the left sound pressure, and the average sound pressure to obtain the reconstructed left audio; Perform audio reconstruction on the right earphone audio according to the right-side value, the horizontal azimuth angle, the sound source elevation angle, the average angular frequency, the right-side sound pressure, and the average sound pressure to obtain the reconstructed right-side audio.

8. The method for processing headphone surround sound based on audio signal processing according to claim 1, wherein Performing audio enhancement on the reconstructed left-side audio and the reconstructed right-side audio respectively to obtain the enhanced left-side audio and the enhanced right-side audio includes: Performing audio enhancement on the reconstructed left-side audio to obtain the enhanced left-side audio; Performing audio enhancement on the reconstructed right-side audio to obtain the enhanced right-side audio.

9. A headphone surround sound processing medium based on audio signal processing, characterized in that, The medium includes: An audio acquisition module, configured to measure the head coordinates of the user through a positioning device built in the earphone after the user wears the earphone, prepare the head-related transfer model of the user, and respectively acquire the left earphone audio and the right earphone audio of the earphone; A coordinate recognition module, configured to analyze the audio phase difference between the left earphone audio and the right earphone audio, use the audio phase difference to determine the audio distance difference between the left earphone audio and the right earphone audio, and identify the audio source coordinates of the audio in the earphone through the audio distance difference; A parameter determination module, configured to use the left earphone audio and the right earphone audio to determine the first model parameter of the head-related transfer model, and use the head coordinates and the audio source coordinates to determine the second model parameter of the head-related transfer model, where using the head coordinates and the audio source coordinates to determine the second model parameter of the head-related transfer model includes: Obtain the left ear coordinate and the right ear coordinate in the head coordinates; Calculate the coordinate distance between the left ear coordinate and the right ear coordinate; Obtain the on-site left-right distance, the on-site left source distance, and the on-site right source distance corresponding to the audio source coordinates; Identify the distance multiple between the coordinate distance and the on-site left-right distance; Use the distance multiple to respectively determine the left source coordinate distance and the right source coordinate distance corresponding to the on-site left source distance; Construct a left sphere of the left ear coordinate with the left ear coordinate as the center of the left sphere and the left source coordinate distance as the radius of the left sphere; Construct a right sphere of the right ear coordinate with the right ear coordinate as the center of the right sphere and the right source coordinate distance as the radius of the right sphere; Take the sphere intersection point between the left sphere and the right sphere as the three-dimensional source coordinate corresponding to the head coordinates; Identify the middle source distance between the three-dimensional source coordinate and the center coordinate of the coordinate distance; Obtain the horizontal azimuth angle, the sound source elevation angle, the average angular frequency, the left-side sound pressure, the right-side sound pressure, and the average sound pressure corresponding to the audio source coordinates; Take the middle source distance, the horizontal azimuth angle, the sound source elevation angle, the average angular frequency, the left-side sound pressure, the right-side sound pressure, and the average sound pressure as the second model parameter; An audio reconstruction module, configured to perform sound source reconstruction on the audio in the earphone through the first model parameter and the second model parameter to obtain a reconstructed sound source, and based on the reconstructed sound source, perform audio reconstruction on the left earphone audio and the right earphone audio respectively to obtain the reconstructed left-side audio and the reconstructed right-side audio; A stereo processing module is used to separately perform audio enhancement on the reconstructed left audio and the reconstructed right audio to obtain enhanced left audio and enhanced right audio. After playing the enhanced left audio and the enhanced right audio in the earphone respectively, the surround stereo processing of the audio in the earphone is completed to obtain a surround stereo processing result.

Images