Method for processing sound signal, terminal device and computer readable storage medium

CN117098033BActive Publication Date: 2026-10-27WEIFANG GOERDYNA TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311254752.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-09-26
Publication Date
2026-10-27
Estimated Expiration
2043-09-26

AI Technical Summary

Technical Problem

[0004]然而,在通过物理摆放的方式消除串扰现象的过程中,一旦在空间内存在多组处于不同位置的扬声器时,技术人员将难以模拟得到多组扬声器产生的声音信号,进而也就难以消除左右扬声器之间产生的串扰现象

Benefits of technology

[0044]如此,本申请通过计算多个不对称扬声器组各自与测试耳道之间的各传递函数,和与各传递函数对应的各逆传递函数,并通过各逆传递函数对多个不对称扬声器组各自产生的初始声音信号进行第一步反串扰处理以得到第一声音信号,进而在多个不对称扬声器组中确定能够向测试耳道发出声音信号的目标扬声器组,和目标扬声器组对应的目标传递函数,从而通过目标传递函数对目标扬声器组产生的第一声音信号进行渲染以得到具有反串扰效果的目标声音信号,从而解决了相关技术中技术人员在通过物理摆放的方式消除串扰现象的过程中,难以对空间内包含的多个扬声器组同时进行模拟以得到多个扬声器组产生的声音信号的技术问题,达到了能够消除多个扬声器组之间形成的串扰现象,形成经过反串扰处理的声音信号,进而能够对声音信号进行空间渲染处理,以生成具有空间渲染效果的目标声音信号的技术效果。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117098033B_ABST
    Figure CN117098033B_ABST
Patent Text Reader

Abstract

The application discloses a sound signal processing method, a terminal device and a computer readable storage medium, and relates to the technical field of sound signal processing. The method comprises the following steps: calculating each transfer function and each inverse transfer function corresponding to each of a plurality of asymmetric loudspeaker groups; processing initial sound signals corresponding to each of the plurality of asymmetric loudspeaker groups through the inverse transfer functions to obtain a plurality of first sound signals; determining a target loudspeaker group in the plurality of asymmetric loudspeaker groups, and determining a target transfer function corresponding to the target loudspeaker group in the plurality of transfer functions; and processing the first sound signal corresponding to the target loudspeaker group through the target transfer function to generate a target sound signal. The application can eliminate the crosstalk phenomenon formed between the plurality of loudspeaker groups, form a sound signal processed by anti-crosstalk, and then perform spatial rendering processing on the sound signal to generate a target sound signal with a spatial rendering effect.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of sound signal processing technology, and in particular to a sound signal processing method, terminal device, and computer-readable storage medium. Background Technology

[0002] If crosstalk occurs between the left and right speakers, it can easily lead to a smaller difference between the sound signals output by the left and right speakers, which in turn weakens the spatial effect of the generated sound signal.

[0003] In related technologies, in order to eliminate crosstalk between the left and right speakers, technicians often adjust the speakers by physically placing them and simulate the sound signals generated after the speakers are adjusted to determine the anti-crosstalk effect, thereby eliminating the crosstalk phenomenon.

[0004] However, in the process of eliminating crosstalk through physical placement, if there are multiple sets of speakers in different positions in the space, it will be difficult for technicians to simulate the sound signals produced by multiple sets of speakers, and thus it will be difficult to eliminate the crosstalk phenomenon between the left and right speakers. Summary of the Invention

[0005] The main objective of this application is to provide a sound signal processing method, terminal device, and computer-readable storage medium, which aims to eliminate crosstalk between multiple speaker groups, form a sound signal after anti-crosstalk processing, and then perform spatial rendering processing on the sound signal to generate a target sound signal with spatial rendering effect.

[0006] To achieve the above objectives, this application provides a method for processing sound signals, the method comprising the following steps:

[0007] Calculate the transfer function and inverse transfer function for each of the multiple asymmetric loudspeaker groups;

[0008] The initial sound signals corresponding to each of the multiple asymmetric loudspeaker groups are processed by the inverse transfer function to obtain multiple first sound signals;

[0009] A target loudspeaker group is determined among the plurality of asymmetric loudspeaker groups, and a target transfer function corresponding to the target loudspeaker group is determined among the plurality of transfer functions;

[0010] The first sound signal corresponding to the target speaker group is processed by the target transfer function to generate the target sound signal.

[0011] Furthermore, the step of calculating the transfer function and inverse transfer function corresponding to each of the multiple asymmetric loudspeaker groups includes:

[0012] Calculate the transfer functions for each of the multiple asymmetric loudspeaker groups;

[0013] Based on each of the transfer functions, the inverse transfer functions corresponding to each of the multiple asymmetric loudspeaker groups are calculated.

[0014] Furthermore, the asymmetric loudspeaker group includes a first loudspeaker, and the transfer function includes a first transfer function and a second transfer function;

[0015] The steps for calculating the transfer functions corresponding to each of the multiple asymmetric loudspeaker groups include:

[0016] Obtain the target radius parameter;

[0017] Detect the first distance information and the first angle information between each of the first speakers and the target first ear canal, and detect the second distance information and the second angle information between each of the first speakers and the target second ear canal;

[0018] The first transfer function between each of the first loudspeakers and the target first ear canal is calculated based on the target radius parameter, each of the first distance information and each of the first angle information.

[0019] The second transfer function between each of the first loudspeakers and the target second ear canal is calculated based on the target radius parameter, each of the second distance information and each of the second angle information.

[0020] Furthermore, the asymmetric loudspeaker assembly also includes a second loudspeaker, and the transfer function includes a third transfer function and a fourth transfer function;

[0021] The step of calculating the transfer functions corresponding to each of the multiple asymmetric loudspeaker groups further includes:

[0022] Obtain the target radius parameter;

[0023] Detecting third distance information and third angle information between each of the second speakers and the target first ear canal, and detecting fourth distance information and fourth angle information between each of the second speakers and the target second ear canal;

[0024] The third transfer function between each of the second loudspeakers and the target first ear canal is calculated based on the target radius parameter, each of the third distance information and each of the third angle information.

[0025] The fourth transfer function between each of the second loudspeakers and the target second ear canal is calculated based on the target radius parameter, each of the fourth distance information and each of the fourth angle information.

[0026] Further, the step of calculating the inverse transfer function corresponding to each of the multiple asymmetric loudspeaker groups based on each of the transfer functions includes:

[0027] Obtain the preset transmission matrix characteristics;

[0028] Based on the characteristics of the transfer matrix, the transfer functions corresponding to each of the multiple asymmetric loudspeaker groups are calculated to obtain the inverse transfer functions corresponding to each of the multiple asymmetric loudspeaker groups.

[0029] Further, the step of processing the initial sound signals corresponding to each of the plurality of asymmetric loudspeaker groups through the inverse transfer function to obtain a plurality of first sound signals includes:

[0030] Obtain the target space coordinates and determine the number of speaker groups corresponding to the multiple asymmetric speaker groups;

[0031] Based on the target spatial coordinates, the number of loudspeaker groups, and each of the inverse transfer functions, construct multiple anti-crosstalk arrays corresponding to the multiple asymmetric loudspeaker groups;

[0032] The initial sound signals corresponding to each of the multiple asymmetric loudspeaker groups are processed by multiple anti-crosstalk arrays to obtain multiple first sound signals.

[0033] Further, the step of processing the initial sound signals corresponding to each of the multiple asymmetric loudspeaker groups using multiple anti-crosstalk arrays to obtain multiple first sound signals includes:

[0034] Acquire the initial sound signals generated by each of the multiple asymmetric speaker groups;

[0035] Determine the target anti-crosstalk array corresponding to each of the multiple asymmetric loudspeaker groups from the multiple anti-crosstalk arrays;

[0036] Each of the initial audio signals is processed by multiple target anti-crosstalk arrays to obtain multiple first audio signals.

[0037] Further, the step of processing the first sound signal corresponding to the target speaker group through the target transfer function to generate the target sound signal includes:

[0038] Acquire the first sound signal generated by the target speaker group;

[0039] The target transfer function is convolved with the first sound signal to generate the target sound signal.

[0040] In addition, to achieve the above objectives, this application also provides a terminal device, the terminal device comprising: a memory and a processor, wherein the memory stores a sound signal processing program that can run on the processor, and the sound signal processing program, when executed by the processor, implements the steps of the sound signal processing method described above.

[0041] In addition, to achieve the above objectives, this application also provides a computer-readable storage medium storing a sound signal processing program, which, when executed by a processor, implements the steps of the sound signal processing method described above.

[0042] The sound signal processing method, terminal device, and computer-readable storage medium provided in this application embodiment calculate each transfer function and each inverse transfer function corresponding to a plurality of asymmetrical loudspeaker groups; process the initial sound signals corresponding to each of the plurality of asymmetrical loudspeaker groups using the inverse transfer functions to obtain a plurality of first sound signals; determine a target loudspeaker group among the plurality of asymmetrical loudspeaker groups, and determine a target transfer function corresponding to the target loudspeaker group among the plurality of transfer functions; process the first sound signal corresponding to the target loudspeaker group using the target transfer function to generate a target sound signal.

[0043] In this embodiment, when the terminal device needs to simulate the target sound signal generated by multiple asymmetric speaker groups contained in the target space, the terminal device first calculates the transfer function and inverse transfer function corresponding to each of the multiple asymmetric speaker groups. Then, the terminal device processes the initial sound signal generated by each asymmetric speaker group through the inverse transfer function corresponding to each asymmetric speaker group to obtain multiple first sound signals. Next, the terminal device filters the multiple asymmetric speaker groups contained in the target space to determine the target speaker group that can generate sound signals among the multiple asymmetric speaker groups, and filters each transfer function to determine the target transfer function corresponding to the target speaker group. Finally, the terminal device obtains the first sound signal corresponding to the target speaker group and renders the first sound signal based on the target transfer function to obtain the target sound signal.

[0044] Thus, this application calculates the transfer functions between each of the multiple asymmetrical speaker groups and the test ear canal, and the corresponding inverse transfer functions. It then uses these inverse transfer functions to perform a first-step anti-crosstalk processing on the initial sound signals generated by each of the multiple asymmetrical speaker groups to obtain a first sound signal. Next, it identifies the target speaker group among the multiple asymmetrical speaker groups that can emit sound signals to the test ear canal, and the target transfer function corresponding to the target speaker group. Finally, it renders the first sound signal generated by the target speaker group using the target transfer function to obtain a target sound signal with anti-crosstalk effect. This solves the technical problem in related technologies where it is difficult for technicians to simultaneously simulate multiple speaker groups within a space to obtain sound signals generated by multiple speaker groups when eliminating crosstalk through physical placement. It achieves the technical effect of eliminating crosstalk between multiple speaker groups, forming an anti-crosstalk processed sound signal, and then performing spatial rendering processing on the sound signal to generate a target sound signal with spatial rendering effect. Attached Figure Description

[0045] Figure 1 This is a schematic diagram of the structure of the terminal device in the hardware operating environment involved in the embodiments of this application;

[0046] Figure 2 This is a flowchart illustrating the first embodiment of the sound signal processing method of this application;

[0047] Figure 3 This is a schematic diagram of a test space scene involved in an embodiment of the sound signal processing method of this application;

[0048] Figure 4 This is a schematic diagram of a crosstalk cancellation network involved in an embodiment of the audio signal processing method of this application;

[0049] Figure 5 This is a schematic diagram of the transfer function corresponding to an asymmetrical loudspeaker in one embodiment of the sound signal processing method of this application;

[0050] Figure 6 This is a schematic diagram of the transfer function corresponding to a symmetrical loudspeaker in one embodiment of the sound signal processing method of this application;

[0051] Figure 7 This is a schematic diagram of the objective function set involved in an embodiment of the sound signal processing method of this application;

[0052] Figure 8 This is a schematic diagram illustrating the spatial rendering principle of an embodiment of the sound signal processing method of this application;

[0053] Figure 9This is a schematic diagram of a spatial rendering scene involved in an embodiment of the sound signal processing method of this application.

[0054] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0055] It should be understood that the specific embodiments described herein are merely illustrative of this application and are not intended to limit this application.

[0056] Reference Figure 1 , Figure 1 This is a schematic diagram of the terminal device structure of the hardware operating environment involved in the embodiments of this application.

[0057] It should be noted that the terminal device in this application embodiment can be a terminal device that executes the sound signal processing method of this application. Specifically, the terminal device can be a mobile terminal, data storage control terminal, PC, or other terminal device that can calculate the transfer function and inverse transfer function corresponding to each of the multiple asymmetric loudspeakers in space, obtain the first sound signal corresponding to each of the multiple asymmetric loudspeakers based on each inverse transfer function, determine the target loudspeaker group that can generate the sound signal among the multiple asymmetric loudspeaker groups, and process the first sound signal through the target transfer function corresponding to the target loudspeaker group to complete spatial rendering.

[0058] like Figure 1 As shown, the terminal device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen and an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed random access memory (RAM) or a stable non-volatile memory (NVM), such as a disk drive. The memory 1005 may also optionally be a storage device independent of the aforementioned processor 1001.

[0059] Those skilled in the art will understand that Figure 1The structure shown does not constitute a limitation on the terminal device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0060] like Figure 1 As shown, the memory 1005, which serves as a storage medium, may include an operating system, a data storage module, a network communication module, a user interface module, and a sound signal processing program.

[0061] exist Figure 1 In the terminal device shown, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the terminal device of this application can be set in the terminal device. The terminal device calls the sound signal processing program stored in the memory 1005 through the processor 1001 and executes the sound signal processing method provided in the embodiment of this application.

[0062] Based on the aforementioned terminal device, the overall concept of the sound signal processing method of this application is provided.

[0063] Crosstalk between the left and right speakers can reduce the difference between their respective output sound signals, thus weakening the spatial effect of the generated sound. To eliminate crosstalk, technicians often adjust the speakers' physical placement and simulate the resulting sound signals to determine the anti-crosstalk effect. However, when multiple speakers are located in different positions within a space, it becomes difficult to simulate the sound signals from all of them, making it challenging to eliminate crosstalk between the left and right speakers.

[0064] To address the aforementioned issues, this application proposes a sound signal processing method, comprising the following steps: calculating the transfer function and inverse transfer function corresponding to each of a plurality of asymmetrical loudspeaker groups; processing the initial sound signals corresponding to each of the plurality of asymmetrical loudspeaker groups using the inverse transfer functions to obtain a plurality of first sound signals; identifying a target loudspeaker group among the plurality of asymmetrical loudspeaker groups, and determining the target transfer function corresponding to the target loudspeaker group among the plurality of transfer functions; and processing the first sound signals corresponding to the target loudspeaker group using the target transfer function to generate a target sound signal.

[0065] Thus, this application calculates the transfer functions between each of the multiple asymmetrical speaker groups and the test ear canal, and the corresponding inverse transfer functions. It then uses these inverse transfer functions to perform a first-step anti-crosstalk processing on the initial sound signals generated by each of the multiple asymmetrical speaker groups to obtain a first sound signal. Next, it identifies the target speaker group among the multiple asymmetrical speaker groups that can emit sound signals to the test ear canal, and the target transfer function corresponding to the target speaker group. Finally, it renders the first sound signal generated by the target speaker group using the target transfer function to obtain a target sound signal with anti-crosstalk effect. This solves the technical problem in related technologies where it is difficult for technicians to simultaneously simulate multiple speaker groups within a space to obtain sound signals generated by multiple speaker groups when eliminating crosstalk through physical placement. It achieves the technical effect of eliminating crosstalk between multiple speaker groups, forming an anti-crosstalk processed sound signal, and then performing spatial rendering processing on the sound signal to generate a target sound signal with spatial rendering effect.

[0066] Based on the overall concept of the terminal device and the sound signal processing method of this application described above, various embodiments of the sound signal processing method of this application are further proposed.

[0067] Please refer to Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the sound signal processing method of this application.

[0068] It should be understood that although the logical order is shown in the flowchart, in some cases, the method for processing sound signals in this application may of course be performed in a different order than that shown or described here.

[0069] like Figure 2 As shown, in this embodiment, the sound signal processing method of this application may include the following steps:

[0070] Step S10: Calculate the transfer function and inverse transfer function for each of the multiple asymmetrical loudspeaker groups;

[0071] In this embodiment, when multiple asymmetrical speaker groups are configured in the target space, the terminal device performs calculations on the multiple asymmetrical speaker groups configured in the target space in sequence to determine the four frequency transfer functions and four inverse frequency transfer functions corresponding to each of the multiple asymmetrical speaker groups.

[0072] For example, please refer to Figure 3 , Figure 3 This is a schematic diagram of a test space scenario involved in an embodiment of the sound signal processing method of this application. When in such a situation... Figure 3When the test space inside the egg chamber is configured with a 7.1.4 immersive sound layout consisting of 12 speakers, the terminal device first identifies 5 asymmetrical speaker groups among the 12 speakers, and performs calculations on the 5 asymmetrical speaker groups in sequence to determine the 4 HRTF transfer functions and 4 inverse transfer functions A corresponding to each of the 5 asymmetrical speaker groups.

[0073] It should be noted that in the 7.1.4 immersive sound layout, "7" refers to the left front speaker, center speaker, and right front speaker positioned in front of the test subject's head within the target space, and four surround speakers positioned to the left, right, and rear of the test subject's head. Similarly, "1" refers to the subwoofer, and "4" refers to four overhead speakers positioned above the test subject's head. It is understood that in this embodiment and another embodiment, those skilled in the art can arbitrarily modify the channel layout within the test space according to actual needs. This application does not limit the placement or number of speakers within the target space.

[0074] Step S20: Process the initial sound signals corresponding to each of the multiple asymmetric loudspeaker groups using the inverse transfer function to obtain multiple first sound signals;

[0075] In this embodiment, the terminal device performs anti-crosstalk processing on the initial sound signals generated by multiple asymmetrical speakers through multiple inverse transfer functions, thereby generating multiple first sound signals.

[0076] For example, after acquiring the four HRTF transfer functions and four inverse transfer functions A corresponding to each of the five asymmetrical speaker groups, the terminal device determines the initial sound signal El generated by the left speaker L in each of the five asymmetrical speaker groups, and the initial sound signal Er emitted by the right speaker R in each of the five asymmetrical speaker groups. The terminal device then processes the initial sound signal El using the inverse transfer functions A11 and A12 corresponding to the left speaker L to generate the sound signal Lf1 between the left speaker L and the left ear canal, and the sound signal Lf1 between the left speaker L and the right ear canal. The terminal device then synthesizes the sound signals Lf1 and Rf1 to generate a first sound signal L corresponding to the left speaker L after preliminary anti-crosstalk processing. At the same time, the terminal device processes the initial sound signal Er through the inverse transfer functions A21 and A22 corresponding to the right speaker R to generate sound signals Lf2 between the right speaker R and the left ear canal, and sound signals Rf2 between the right speaker R and the right ear canal. The terminal device then synthesizes the sound signals Lf2 and Rf2 to generate a first sound signal R corresponding to the right speaker R after preliminary anti-crosstalk processing.

[0077] Furthermore, in a feasible embodiment, step S20 above may specifically include:

[0078] Step S201: Obtain the target space coordinates and determine the number of speaker groups corresponding to the multiple asymmetric speaker groups;

[0079] In this embodiment, the terminal device reads the target image to determine the position information of the test subject's head within the target control, and then determines the target spatial coordinates corresponding to the test subject's head based on the position information. At the same time, the terminal device determines the number of speaker groups corresponding to the multiple asymmetrical speaker groups.

[0080] Step S202: Based on the target spatial coordinates, the number of loudspeaker groups, and each of the inverse transfer functions, construct multiple anti-crosstalk arrays corresponding to the multiple asymmetric loudspeaker groups;

[0081] In this embodiment, the terminal device constructs multiple anti-crosstalk arrays corresponding to each of the multiple asymmetric speaker groups based on the acquired target spatial coordinates, the number of speaker groups, and each inverse transfer function.

[0082] Step S203: The initial sound signals corresponding to each of the multiple asymmetric loudspeaker groups are processed by the multiple anti-crosstalk arrays to obtain multiple first sound signals;

[0083] In this embodiment, the terminal device controls multiple asymmetric speaker groups to generate initial sound signals, and processes the initial sound signals generated by the multiple asymmetric speaker groups through the anti-crosstalk arrays corresponding to each of the multiple asymmetric speaker groups to generate a first sound signal.

[0084] For example, please refer to Figure 7 , Figure 7 This is a schematic diagram of the target function set involved in an embodiment of the sound signal processing method of this application. The terminal device first reads the target image to determine the position information of the test subject's head in the test space. The terminal device then determines the target space coordinates m corresponding to the test subject's head based on the position information. At the same time, the terminal device determines, based on the target image, that the number of asymmetrical speaker groups in the target space where the 7.1.4 immersive sound layout is located is 5. Then, the terminal device constructs multiple anti-crosstalk binary arrays CalTF based on the target space coordinates m, the number of speaker groups, and the inverse transfer functions A11, A12, A21, and A21 corresponding to the 5 asymmetrical speaker groups. And based on the multiple anti-crosstalk binary arrays CalTF, it constructs as follows: Figure 7The objective function set is shown. Then, the terminal device obtains the initial sound signal El emitted by the left speaker L and the initial sound signal Er emitted by the right speaker R in each of the five asymmetrical speaker groups. The terminal device then extracts the anti-crosstalk two-bit array CalTF corresponding to the left speaker L and the right speaker R in the objective function set, and processes the initial sound signal El and the initial sound signal Er through the anti-crosstalk two-bit array CalTF to obtain the first sound signal L corresponding to each left speaker L and the first sound signal R corresponding to each right speaker R.

[0085] Furthermore, in a feasible embodiment, step S203 above may specifically include:

[0086] Step S2031: Acquire the initial sound signals generated by each of the multiple asymmetrical speaker groups;

[0087] In this embodiment, the terminal device first acquires the initial sound signals generated by the left and right speakers of each of the multiple asymmetrical speaker groups.

[0088] Step S2032: Determine the target anti-crosstalk array corresponding to each of the multiple asymmetric loudspeaker groups from the multiple anti-crosstalk arrays;

[0089] In this embodiment, the terminal device determines the target anti-crosstalk array corresponding to each left speaker and the target anti-crosstalk array corresponding to each right speaker from multiple anti-crosstalk arrays.

[0090] Step S2033: Process each of the initial sound signals using multiple target anti-crosstalk arrays to obtain multiple first sound signals;

[0091] In this embodiment, the terminal device processes the initial sound signals generated by the left and right speakers respectively through the target anti-crosstalk arrays corresponding to the left and right speakers to obtain intermediate sound signals. The terminal device then integrates the intermediate sound signals generated by the left and right speakers respectively to obtain the first sound signal corresponding to the left and right speakers respectively.

[0092] For example, please refer to Figure 4 , Figure 4 This is a schematic diagram of a crosstalk cancellation network involved in an embodiment of the audio signal processing method of this application, as shown below. Figure 4As shown, if the initial sound signal El generated by the left speaker L and the initial sound signal Er generated by the right speaker R are not processed by anti-crosstalk, the spatial information contained in the initial sound signals El and Er will be destroyed. Therefore, the terminal device needs to perform anti-crosstalk cancellation on the initial sound signals El and Er through a crosstalk cancellation matrix composed of inverse transfer functions A11, A12, A21 and A22, so that the first sound signal L corresponding to the left speaker is the same as the initial sound signal El, and the first sound signal R corresponding to the right speaker R is the same as the initial sound signal Er.

[0093] The terminal device first acquires the initial sound signal El generated by the left speaker L in each of the five asymmetrical speaker groups, and the initial sound signal Er generated by each right speaker R. Then, the terminal device determines the target crosstalk binary array CalTF between each left speaker L and the left ear canal of the test subject's head from multiple anti-crosstalk binary arrays CalTF. The terminal device then processes the initial sound signal El based on the target crosstalk binary array CalTF between each left speaker L and the left ear canal of the test subject's head.

[0094] Lf1(i)=El(i)*CalTF->TF[i].A11;

[0095] Thus, the middle sound signal Lf1 corresponding to each left speaker L, after initial anti-crosstalk processing, is obtained and sent to the left ear canal of the test subject's head;

[0096] Simultaneously, the terminal device determines the target crosstalk binary array CalTF between each left speaker L and the right ear canal of the test subject's head from multiple anti-crosstalk binary arrays CalTF. The terminal device then processes the initial sound signal El based on the target crosstalk binary array CalTF between each left speaker L and the right ear canal of the test subject's head:

[0097] Rf1(i)=El(i)*CalTF->TF[i].A12;

[0098] Thus, the middle sound signal Rf1 corresponding to each left speaker L, after preliminary anti-crosstalk processing, is sent to the right ear canal of the test subject's head;

[0099] Then, the terminal device integrates the intermediate sound signal Lf1 corresponding to each left speaker L with the corresponding intermediate sound signal Rf1 to obtain the first sound signal L corresponding to each left speaker L.

[0100] Simultaneously, the terminal device determines the target crosstalk binary array CalTF between each speaker R and the left ear canal of the test subject's head from multiple anti-crosstalk binary arrays CalTF. The terminal device then processes the initial sound signal Er based on the target crosstalk binary array CalTF between each speaker R and the left ear canal of the test subject's head.

[0101] Lf2(i)=Er(i)*CalTF->TF[i].A21;

[0102] Thus, the middle sound signal Lf2 corresponding to each right speaker R, after preliminary anti-crosstalk processing, is sent to the left ear canal of the test subject's head;

[0103] Simultaneously, the terminal device determines the target crosstalk binary array CalTF between each speaker R and the right ear canal of the test subject's head from multiple anti-crosstalk binary arrays CalTF. The terminal device then processes the initial sound signal Er based on the target crosstalk binary array CalTF between each speaker R and the right ear canal of the test subject's head.

[0104] Rf2(i)=Er(i)*CalTF->TF[i].A22;

[0105] Thus, the mid-sound signal Rf2 corresponding to each right speaker R, after preliminary anti-crosstalk processing, is obtained and sent to the right ear canal of the test subject's head;

[0106] The terminal device integrates the middle sound signal Lf2 corresponding to each right speaker R with its corresponding middle sound signal Rf2 to obtain the first sound signal R corresponding to each right speaker R.

[0107] Step S30: Determine the target loudspeaker group among the plurality of asymmetric loudspeaker groups, and determine the target transfer function corresponding to the target loudspeaker group among the plurality of transfer functions;

[0108] In this embodiment, the terminal device first identifies multiple target asymmetric speaker groups capable of emitting sound signals from among the multiple asymmetric speaker groups contained in the target space, and then filters each transfer function based on the multiple target asymmetric speaker groups to determine each target transfer function corresponding to the multiple target asymmetric speaker groups among the multiple transfer functions.

[0109] For example, please refer to Figure 9 , Figure 9 This is a schematic diagram of a spatial rendering scene related to an embodiment of the sound signal processing method of this application, as shown below. Figure 9As shown, when only two of the five asymmetrical speaker groups in the 7.1.4 immersive sound layout send sound signals to the test subject's head, the terminal device first identifies asymmetrical speaker group LR and asymmetrical speaker group SL-SR as the target asymmetrical speaker groups among the five asymmetrical speaker groups in the target space. The terminal device then filters the aforementioned HRTF transfer functions based on these asymmetrical speaker groups LR and SL-SR to select the transfer function HLL corresponding to the left speaker L in the asymmetrical speaker group LR. The transfer function HRL is the target transfer function, and HLR is the transfer function corresponding to the right speaker R in the asymmetrical loudspeaker group LR. The transfer function HLR is the target transfer function, and HLSL is the transfer function corresponding to the left speaker SL in the asymmetrical loudspeaker group SL-SR. The transfer function HRSL is the target transfer function, and HLSR is the transfer function corresponding to the right speaker SR in the asymmetrical loudspeaker group SL-SR.

[0110] It should be noted that in this embodiment, the transfer functions HLSL and HLL mentioned above also represent the HRTF function between the left speaker in each asymmetrical speaker group and the left ear canal of the test subject's head. It can be understood that the transfer function HLSL is one of the HRTF functions among the transfer functions HLL calculated in step S10. Since the relative positions of the left speaker SL and left speaker L with the test subject's head are different, the specific values ​​corresponding to the transfer functions HLSL and HLL can be different. Similarly, the transfer functions HRSL and HLL mentioned above also represent the HRTF function between the left speaker in each asymmetrical speaker group and the right ear canal of the test subject's head. It can be understood that the transfer function HLL... RSL is one of the HRTF functions among the transfer functions HRL calculated in step S10 above; similarly, the transfer functions HLSR and HLR also represent the HRTF function between the right speaker in each asymmetrical speaker group and the left ear canal of the test subject's head. It can be understood that the transfer function HLSR is one of the HRTF functions among the transfer functions HLR calculated in step S10 above; similarly, the transfer functions HRSR and HRR also represent the HRTF function between the right speaker in each asymmetrical speaker group and the right ear canal of the test subject's head. It can be understood that the transfer function HRSR is one of the HRTF functions among the transfer functions HRR calculated in step S10 above.

[0111] Step S40: Process the first sound signal corresponding to the target speaker group through the target transfer function to generate a target sound signal;

[0112] In this embodiment, the terminal device renders the first sound signal generated by each of the target asymmetric loudspeakers by the selected target transfer functions to generate target sound signals corresponding to the left and right ear canals respectively.

[0113] For example, the terminal device renders the first sound signals generated by the left speaker L, right speaker R, left speaker SL, and right speaker SR respectively by filtering the target transfer functions HLL, HRL, HLSL, and HLSR, thereby obtaining a target sound signal L' that has undergone anti-crosstalk processing corresponding to the left ear canal of the test subject's head. At the same time, the terminal device renders the first sound signals generated by the left speaker L, right speaker R, left speaker SL, and right speaker SR respectively by filtering the target transfer functions HLR, HRR, HRSL, and HRSR, thereby obtaining a target sound signal R' that has undergone anti-crosstalk processing corresponding to the right ear canal of the test subject's head.

[0114] Furthermore, in a feasible embodiment, step S40 above may specifically include:

[0115] Step S401: Acquire the first sound signal generated by the target speaker group;

[0116] In this embodiment, the terminal device first acquires the first sound signal generated by each of the multiple target asymmetric speaker groups obtained through screening.

[0117] Step S402: Convolve the target transfer function with the first sound signal to generate the target sound signal;

[0118] In this embodiment, the terminal device classifies each target transfer function to obtain each first target transfer function corresponding to the left ear canal of the test subject's head and each second target transfer function corresponding to the right ear canal of the test subject's head. The terminal device then performs convolution processing on each first sound signal through each first target transfer function to generate a target sound signal corresponding to the left ear canal. At the same time, the terminal device performs convolution processing on each first sound signal through each second target transfer function to generate a target sound signal corresponding to the right ear canal.

[0119] For example, please refer to Figure 4 , Figure 8 and Figure 9 ,in, Figure 8 This is a schematic diagram of the spatial rendering principle involved in an embodiment of the sound signal processing method of this application, as shown in Figure 4. Figure 8As shown, considering that the process of sound source propagating through the air to the human ear is generally linear, spatial rendering only requires convolving the known sound source with the HRTF function between the speaker and the ear canal to complete the spatial rendering operation.

[0120] After the terminal device obtains the transfer function of each target and the asymmetric loudspeaker group of each target through screening, such as Figure 9 As shown, the terminal device first acquires the first sound signal L generated by the left speaker L in the target asymmetric speaker group LR, the first sound signal R generated by the right speaker R in the target asymmetric speaker group LR, the first sound signal SL generated by the left speaker SL in the target asymmetric speaker group SL-SR, and the first sound signal SR generated by the right speaker SR in the target asymmetric speaker group SL-SR. Then, the terminal device classifies the acquired target transfer functions HLL, HRL, HLSL, HLSR, HLR, HRR, HRSL, and HRSR, thereby assigning the left speaker L to the test... The transfer functions HLL between the left ear canal of the human head, HRL between the right speaker R and the left ear canal of the test subject, HLSL between the left speaker SL and the left ear canal of the test subject, and HLSR between the right speaker SR and the left ear canal of the test subject are determined as the first target HRTF functions. At the same time, the terminal device determines the transfer functions HLR between the left speaker L and the right ear canal of the test subject, HRR between the right speaker R and the right ear canal of the test subject, HRSL between the left speaker SL and the right ear canal of the test subject, and HRSR between the right speaker SR and the right ear canal of the test subject as the second target HRTF functions.

[0121] Finally, the terminal device performs convolution processing on each acquired first audio signal using each first target HRTF function:

[0122] L'=L*HLL+R*HLR+SL*HLSL+SR*HLSR;

[0123] This generates a target sound signal L' that has undergone anti-crosstalk processing and corresponds to the left ear canal;

[0124] Simultaneously, the terminal device performs convolution processing on each acquired first audio signal using each second target HRTF function:

[0125] R'=L*HRL+R*HRR+SL*HRSL+SR*HRSR;

[0126] This generates a target sound signal R' that has undergone anti-crosstalk processing and corresponds to the right ear canal.

[0127] In this embodiment, when multiple asymmetrical speaker groups are configured in the target space, the terminal device performs calculations on the multiple asymmetrical speaker groups configured in the target space in sequence to determine the four frequency transfer functions and four inverse frequency transfer functions corresponding to each of the multiple asymmetrical speaker groups. Then, the terminal device performs anti-crosstalk processing on the initial sound signals generated by the multiple asymmetrical speakers through the multiple inverse transfer functions to generate multiple first sound signals. Next, the terminal device first determines multiple target asymmetrical speaker groups that can emit sound signals from the multiple asymmetrical speaker groups contained in the target space, and then filters each transfer function based on the multiple target asymmetrical speaker groups to determine the target transfer functions corresponding to the multiple target asymmetrical speaker groups. Finally, the terminal device renders the first sound signals generated by each target asymmetrical speaker through the filtered target transfer functions to generate target sound signals corresponding to the left ear canal and the right ear canal, respectively.

[0128] Thus, this application calculates the transfer functions between each of the multiple asymmetrical speaker groups and the test ear canal, and the corresponding inverse transfer functions. It then uses these inverse transfer functions to perform a first-step anti-crosstalk processing on the initial sound signals generated by each of the multiple asymmetrical speaker groups to obtain a first sound signal. Next, it identifies the target speaker group among the multiple asymmetrical speaker groups that can emit sound signals to the test ear canal, and the target transfer function corresponding to the target speaker group. Finally, it renders the first sound signal generated by the target speaker group using the target transfer function to obtain a target sound signal with anti-crosstalk effect. This solves the technical problem in related technologies where it is difficult for technicians to simultaneously simulate multiple speaker groups within a space to obtain sound signals generated by multiple speaker groups when eliminating crosstalk through physical placement. It achieves the technical effect of eliminating crosstalk between multiple speaker groups, forming an anti-crosstalk processed sound signal, and then performing spatial rendering processing on the sound signal to generate a target sound signal with spatial rendering effect.

[0129] Furthermore, based on the first embodiment of the sound signal processing method of this application described above, a second embodiment of the sound signal processing method of this application is proposed herein.

[0130] In one feasible embodiment, step S10 above may specifically include:

[0131] Step S101: Calculate the transfer function corresponding to each of the multiple asymmetrical loudspeaker groups;

[0132] In this embodiment, when multiple asymmetric speaker groups are configured in the target space, the terminal first calls its own configured function calculation model to calculate the multiple asymmetric speaker groups in sequence to determine the four transfer functions corresponding to each of the multiple speaker groups.

[0133] Step S102: Calculate the inverse transfer function corresponding to each of the multiple asymmetric loudspeaker groups based on the transfer function;

[0134] In this embodiment, the function calculation model calculates each of the calculated transfer functions to determine the inverse transfer function corresponding to each transfer function, thereby obtaining the inverse transfer functions corresponding to each of the multiple asymmetric loudspeaker groups.

[0135] For example, when a 7.1.4 Dolby Atmos layout consisting of 12 speakers is configured in the test space, the terminal device first detects the test data between each of the five asymmetrical speaker groups in the Dolby Atmos layout and the test subject's head, and inputs each test data into its configured function calculation model. The function calculation model then calculates the five asymmetrical speaker groups sequentially based on each test data to obtain the four HRTF functions corresponding to each of the five asymmetrical speaker groups. After that, the function calculation model calculates based on the four HRTF functions corresponding to each of the five asymmetrical speaker groups to determine the inverse transfer function A corresponding to each of the four HRTF functions. Thus, the function calculation model determines the four HRTF functions and four inverse transfer functions A corresponding to each of the five asymmetrical speaker groups.

[0136] Furthermore, in a feasible embodiment, the asymmetric loudspeaker group includes a first loudspeaker, the transfer function includes a first transfer function and a second transfer function, and step S101 above may specifically include:

[0137] Step S1011: Obtain the target radius parameter;

[0138] In this embodiment, the terminal device first detects the test head used for testing, thereby obtaining the target radius parameter corresponding to the test head.

[0139] Step S1012: Detect the first distance information and the first angle information between each of the first speakers and the target first ear canal, and detect the second distance information and the second angle information between each of the first speakers and the target second ear canal;

[0140] In this embodiment, the terminal device calls its own camera device to capture images of the target space, thereby obtaining a target image containing multiple asymmetrical speaker groups and the test subject's head. The terminal device then uses the target image to determine the first distance information and the first angle information between each of the multiple left speakers and the left ear canal of the test subject's head, and the second distance information and the second angle information between each of the multiple left speakers and the right ear canal of the test subject's head.

[0141] Step S1013: Calculate the first transfer function between each of the first loudspeakers and the target first ear canal based on the target radius parameter, each of the first distance information and each of the first angle information;

[0142] In this embodiment, the terminal device inputs the acquired target radius parameter, each first distance information and each first angle information into the function calculation model configured by the terminal device itself. The function calculation model calculates the first transfer function between each left speaker and the left ear canal of the test subject's head based on the target head radius parameter, the first distance information corresponding to each left speaker and the first angle information corresponding to each left speaker.

[0143] Step S1014: Calculate the second transfer function between each of the first loudspeakers and the target second ear canal based on the target radius parameter, each of the second distance information and each of the second angle information;

[0144] In this embodiment, the terminal device inputs the acquired target radius parameter, each second distance information and each second angle information into the above-mentioned function calculation model. Based on the target radius parameter, the second distance information corresponding to each left speaker and the second angle information corresponding to each left speaker, the function calculation model calculates the second transfer function between each left speaker and the right ear canal of the test subject's head.

[0145] For example, please refer to Figure 5 , Figure 5 This is a schematic diagram of the transfer function corresponding to an asymmetrical loudspeaker in one embodiment of the sound signal processing method of this application, as shown below. Figure 5As shown, the terminal device first detects the test head in the 7.1.4 immersive sound layout to determine the target radius parameter corresponding to the test head. At the same time, the terminal device calls its own camera to take pictures of the test space where the 7.1.4 immersive sound layout is located, so as to capture a target image containing five asymmetrical speaker groups and the test head. Based on the target image, the terminal device determines the first distance information between each left speaker L in the five asymmetrical speaker groups and the left ear canal of the test head, and the first angle information between each left speaker L and the left ear canal of the test head. At the same time, based on the target image, the terminal device determines the second distance information between each left speaker L and the right ear canal of the test head, and the second angle information between each left speaker L and the right ear canal of the test head.

[0146] Subsequently, the terminal device inputs the acquired target radius parameters, first distance information, and first angle information into its own configured function calculation model. Based on the target radius parameters, the first distance information corresponding to each left speaker L, and the first angle information corresponding to each left speaker L, the function calculation model calculates the transfer function HLL between each left speaker L and the left ear canal of the test subject's head. At the same time, the terminal device inputs the acquired target radius parameters, second distance information, and second angle information into the function calculation model. Based on the target radius parameters, the second distance information corresponding to each left speaker L, and the second angle information corresponding to each left speaker L, the function calculation model calculates the transfer function HRL between each left speaker L and the right ear canal of the test subject's head.

[0147] Furthermore, in a feasible embodiment, the asymmetric loudspeaker group further includes a second loudspeaker, the transfer function includes a third transfer function and a fourth transfer function, and step S101 above may further include:

[0148] Step S1015: Obtain the target radius parameter;

[0149] In this embodiment, the terminal device first detects the test head used for testing, thereby obtaining the target radius parameter corresponding to the test head.

[0150] Step S1016: Detect the third distance information and the third angle information between each of the second speakers and the target first ear canal, and detect the fourth distance information and the fourth angle information between each of the second speakers and the target second ear canal;

[0151] In this embodiment, the terminal device calls its own camera device to capture images of the target space, thereby acquiring a target image containing multiple asymmetrical speaker groups and the test subject's head. The terminal device then uses the target image to determine the third distance information and the third angle information between each of the multiple right speakers and the left ear canal of the test subject's head, and the fourth distance information and the fourth angle information between each of the multiple right speakers and the right ear canal of the test subject's head.

[0152] Step S1017: Calculate the third transfer function between each of the second speakers and the target first ear canal based on the target radius parameter, each of the third distance information and each of the third angle information;

[0153] In this embodiment, the terminal device inputs the acquired target radius parameter, each third distance information and each third angle information into the above-mentioned function calculation model. Based on the target radius parameter, the third distance information corresponding to each right speaker and the third angle information corresponding to each right speaker, the function calculation model calculates the third transfer function between each right speaker and the left ear canal of the test subject's head.

[0154] Step S1018: Calculate the fourth transfer function between each of the second speakers and the target second ear canal based on the target radius parameter, each of the fourth distance information and each of the fourth angle information;

[0155] In this embodiment, the terminal device inputs the acquired target radius parameter, each fourth distance information and each fourth angle information into the above-mentioned function calculation model. Based on the target radius parameter, the fourth distance information corresponding to each right speaker and the fourth angle information corresponding to each right speaker, the function calculation model calculates the fourth transfer function between each right speaker and the right ear canal of the test subject's head.

[0156] For example, the terminal device first detects the test head in the 7.1.4 Dolby Atmos layout to determine the target radius parameter corresponding to the test head. At the same time, the terminal device calls its own camera to take pictures of the test space where the 7.1.4 Dolby Atmos layout is located, so as to capture a target image containing five asymmetrical speaker groups and the test head. The terminal device then determines the third distance information between each right speaker R in each of the five asymmetrical speaker groups and the left ear canal of the test head, and the third angle information between each right speaker R and the left ear canal of the test head, based on the target image. At the same time, the terminal device determines the fourth distance information between each right speaker R in each of the five asymmetrical speaker groups and the right ear canal of the test head, and the fourth angle information between each right speaker R and the right ear canal of the test head, based on the target image.

[0157] Subsequently, the terminal device inputs the acquired target radius parameters, third distance information, and third angle information into its own configured function calculation model. Based on the target radius parameters, the third distance information corresponding to each right speaker R, and the third angle information corresponding to each right speaker R, the function calculation model calculates the transfer function HLR between each right speaker R and the left ear canal of the test subject's head. At the same time, the terminal device inputs the acquired target radius parameters, fourth distance information, and fourth angle information into the function calculation model. Based on the target radius parameters, the fourth distance information corresponding to each right speaker R, and the fourth angle information corresponding to each right speaker R, the function calculation model calculates the transfer function HRR between each right speaker R and the right ear canal of the test subject's head.

[0158] It should be noted that in this embodiment and another embodiment, the transfer functions HLL mentioned above represent the HRTF functions between the left speaker L of each of the five asymmetrical speaker groups and the left ear canal of the test subject under the 7.1.4 immersive sound layout. It is understood that the specific values ​​of the transfer functions HLL corresponding to each left speaker L may differ depending on the relative position between each left speaker L and the test subject's head. Similarly, the transfer functions HRL mentioned above represent the HRTF functions between the left speaker L of each of the five asymmetrical speaker groups and the right ear canal of the test subject under the 7.1.4 immersive sound layout. The specific values ​​of the transfer functions HRL corresponding to each left speaker L may also differ depending on the relative position between each left speaker L and the test subject's head. Similarly, the HLR transfer functions mentioned above represent the HRTF functions between the right speaker R of each of the five asymmetrical speaker groups and the left ear canal of the test subject under the 7.1.4 immersive sound layout. It can be understood that the specific values ​​of the HLR transfer functions corresponding to each right speaker R can be different depending on the relative position between each right speaker R and the test subject's head. Likewise, the HRR transfer functions mentioned above represent the HRTF functions between the right speaker R of each of the five asymmetrical speaker groups and the right ear canal of the test subject under the 7.1.4 immersive sound layout. It can be understood that the specific values ​​of the HRR transfer functions corresponding to each right speaker R can be different depending on the relative position between each right speaker R and the test subject's head.

[0159] Furthermore, in a feasible embodiment, step S102 above may specifically include:

[0160] Step S1021: Obtain the preset transmission matrix characteristics;

[0161] Step S1022: Calculate the transfer function corresponding to each of the multiple asymmetric loudspeaker groups based on the characteristics of the transfer matrix to obtain the inverse transfer function corresponding to each of the multiple asymmetric loudspeaker groups;

[0162] In this embodiment, the terminal device first reads its own configured storage device to obtain the transfer matrix characteristics pre-stored by the technician, and inputs the transfer matrix characteristics into the aforementioned function calculation model. The function calculation model then calculates each first transfer function based on the obtained transfer matrix characteristics to determine the first inverse transfer function corresponding to each first transfer function. Simultaneously, the function calculation model calculates each second transfer function based on the obtained transfer matrix characteristics to determine the second inverse transfer function corresponding to each second transfer function. Furthermore, the function calculation model calculates each third transfer function based on the obtained transfer matrix characteristics to determine the third inverse transfer function corresponding to each third transfer function. Finally, the function calculation model calculates each fourth transfer function based on the obtained transfer matrix characteristics to determine the fourth inverse transfer function corresponding to each fourth transfer function. Afterwards, the function calculation model integrates the obtained first, second, third, and fourth inverse transfer functions to obtain four inverse transfer functions corresponding to each of the multiple asymmetrical speaker groups.

[0163] For example, the terminal device first reads its own configured storage device to obtain the transmission characteristics preset by the technician:

[0164]

[0165] The function computation model then determines the first inverse transfer function A11 corresponding to each transfer function HLR, the second inverse transfer function A12 corresponding to each transfer function HRL, the third inverse transfer function A21 corresponding to each transfer function HLR, and the fourth inverse transfer function A22 corresponding to each transfer function HRR based on this transfer characteristic.

[0166] It should be noted that in this embodiment and another embodiment, please refer to Figure 6 , Figure 6 This is a schematic diagram of the transfer function corresponding to a symmetrical loudspeaker in one embodiment of the sound signal processing method of this application, as shown below. Figure 6As shown, when the left speaker L and right speaker R in the speaker group are symmetrically arranged, it can be determined that the HRTF function between the left speaker L and the left ear canal is the same as the HRTF function between the right speaker R and the right ear canal, both set to α. Simultaneously, it is determined that the HRTF function between the left speaker L and the right ear canal is the same as the HRTF function between the right speaker R and the left ear canal, both set to β. Therefore, based on each HRTF function, it can be determined that under symmetrical deployment, the first inverse transfer function A11 and the fourth inverse transfer function A22 are equal, both being:

[0167]

[0168] And it is determined that the second inverse transfer function A12 and the third inverse transfer function A21 are equal, both being:

[0169]

[0170] Furthermore, it is understandable that the speaker group LR, composed of the left speaker L and the right speaker R in a symmetrical configuration, can be considered a special case of an asymmetrical speaker group. Therefore, only after understanding the process of calculating the transfer function and inverse transfer function corresponding to the asymmetrical speaker group can technicians deduce the transfer functions and inverse transfer functions corresponding to the speaker group LR when the left speaker L and the right speaker R in the symmetrical configuration are in a symmetrical configuration. In this way, the terminal device can calculate the HRTF function between each speaker and the left and right ear canals, and the corresponding inverse transfer function, based on the detection data between each speaker and the test subject's head using a function calculation model. This allows the device to eliminate crosstalk between asymmetrical speakers through the HRTF functions and inverse transfer functions.

[0171] In addition, this application also provides a terminal device having a sound signal processing program that can run on a processor. When the terminal device executes the sound signal processing program, it implements the steps of the sound signal processing method as described in any of the above embodiments.

[0172] The specific embodiments of the terminal device in this application are basically the same as the embodiments of the above-described sound signal processing method, and will not be described in detail here.

[0173] In addition, this application also provides a computer-readable storage medium storing a sound signal processing program, which, when executed by a processor, implements the steps of the sound signal processing method as described in any of the above embodiments.

[0174] The specific embodiments of the computer-readable storage medium of this invention are basically the same as the embodiments of the above-described sound signal processing method, and will not be described in detail here.

[0175] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0176] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0177] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0178] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent protection scope of this application.

Claims

1. A method for processing sound signals, characterized in that, The method for processing the sound signal includes the following steps: Calculate the transfer function and inverse transfer function for each of the multiple asymmetric loudspeaker groups; The initial sound signals corresponding to each of the multiple asymmetric loudspeaker groups are processed by the inverse transfer function to obtain multiple first sound signals; A target loudspeaker group is determined among the plurality of asymmetric loudspeaker groups, and a target transfer function corresponding to the target loudspeaker group is determined among the plurality of transfer functions; The first sound signal corresponding to the target speaker group is processed by the target transfer function to generate the target sound signal; The step of processing the initial sound signals corresponding to each of the multiple asymmetric loudspeaker groups through the inverse transfer function to obtain multiple first sound signals includes: Obtain the target space coordinates and determine the number of speaker groups corresponding to the multiple asymmetric speaker groups; Based on the target spatial coordinates, the number of loudspeaker groups, and each of the inverse transfer functions, construct multiple anti-crosstalk arrays corresponding to the multiple asymmetric loudspeaker groups; Acquire the initial sound signals generated by each of the multiple asymmetric speaker groups; Determine the target anti-crosstalk array corresponding to each of the multiple asymmetric loudspeaker groups from the multiple anti-crosstalk arrays; Each of the initial audio signals is processed by multiple target anti-crosstalk arrays to obtain multiple first audio signals.

2. The method for processing sound signals as described in claim 1, characterized in that, The steps of calculating the transfer function and inverse transfer function of each of the multiple asymmetric loudspeaker groups include: Calculate the transfer functions for each of the multiple asymmetric loudspeaker groups; Based on each of the transfer functions, the inverse transfer functions corresponding to each of the multiple asymmetric loudspeaker groups are calculated.

3. The sound signal processing method as described in claim 2, characterized in that, The asymmetric loudspeaker group includes a first loudspeaker, and the transfer function includes a first transfer function and a second transfer function; The steps for calculating the transfer functions corresponding to each of the multiple asymmetric loudspeaker groups include: Obtain the target radius parameter; Detect the first distance information and the first angle information between each of the first speakers and the target first ear canal, and detect the second distance information and the second angle information between each of the first speakers and the target second ear canal; The first transfer function between each of the first loudspeakers and the target first ear canal is calculated based on the target radius parameter, each of the first distance information and each of the first angle information. The second transfer function between each of the first loudspeakers and the target second ear canal is calculated based on the target radius parameter, each of the second distance information and each of the second angle information.

4. The sound signal processing method as described in claim 3, characterized in that, The asymmetric loudspeaker group further includes a second loudspeaker, and the transfer function includes a third transfer function and a fourth transfer function; The step of calculating the transfer functions corresponding to each of the multiple asymmetric loudspeaker groups further includes: Obtain the target radius parameter; Detecting third distance information and third angle information between each of the second speakers and the target first ear canal, and detecting fourth distance information and fourth angle information between each of the second speakers and the target second ear canal; The third transfer function between each of the second loudspeakers and the target first ear canal is calculated based on the target radius parameter, each of the third distance information and each of the third angle information. The fourth transfer function between each of the second loudspeakers and the target second ear canal is calculated based on the target radius parameter, each of the fourth distance information and each of the fourth angle information.

5. The sound signal processing method as described in claim 4, characterized in that, The step of calculating the inverse transfer function corresponding to each of the multiple asymmetric loudspeaker groups based on each of the transfer functions includes: Obtain the preset transmission matrix characteristics; Based on the characteristics of the transfer matrix, the transfer functions corresponding to each of the multiple asymmetric loudspeaker groups are calculated to obtain the inverse transfer functions corresponding to each of the multiple asymmetric loudspeaker groups.

6. The method for processing sound signals as described in claim 1, characterized in that, The step of processing the first sound signal corresponding to the target speaker group through the target transfer function to generate the target sound signal includes: Acquire the first sound signal generated by the target speaker group; The target transfer function is convolved with the first sound signal to generate the target sound signal.

7. A terminal device, characterized in that, The terminal device includes: a memory and a processor. The memory stores a sound signal processing program that can run on the processor. When the sound signal processing program is executed by the processor, it implements the steps of the sound signal processing method as described in any one of claims 1 to 6.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a sound signal processing program, which, when executed by a processor, implements the steps of the sound signal processing method as described in any one of claims 1 to 6.

Citation Information

Patent Citations

  • Cross sound elimination method and device, audio equipment and computer readable storage medium

    CN115278474A

  • Electronic apparatus, control method thereof, and recording medium

    US20210337340A1