Directional sound field playback method and device, terminal equipment and medium

Abstract

The invention relates to a directional sound field playback method and device, terminal equipment and a medium. The method comprises the following steps: acquiring and rendering a target sound field signal, obtaining track signals in one-to-one correspondence with N arranged loudspeakers, acquiring a target source direction angle needing sound field playback and direction angles of the loudspeakers in a specified space, and selecting n loudspeakers and Ngt according to an included angle between the direction angle of each loudspeaker and the target source direction angle; n is greater than or equal to 3, determining signal playing weight coefficients of the n loudspeakers, performing weighting processing on the n track signals corresponding to the loudspeakers to obtain optimized track signals of the n loudspeakers, and controlling the n loudspeakers to play respectively to realize sound field playback in the target source direction. According to the method, only part of loudspeakers are selected for sound field playback, so that the interference influence among a plurality of loudspeakers is avoided, the target sound field playback precision is improved, the operation process is simplified, and sound field playback in a specific direction is highly restored.

Description

Technical Field

[0001] The present invention is applicable to the fields of sound source identification and noise diagnosis, and in particular relates to a directional sound field playback method, device, terminal equipment and medium. Background Art

[0002] Sound is one of the media that humans use to perceive external information. People record sound through microphones and other devices, and play it through headphones, speakers and other playback devices. In the early days, people had certain requirements for the sound played by playback devices, mainly in terms of timbre, pitch, distortion and other subjective feelings. However, with the development of industries such as VR and 3D movies, people's requirements for playback devices are getting higher and higher. In addition to subjective feelings, they even require playback devices to reproduce the sound field at the time as much as possible to give users the highest degree of realism experience.

[0003] Sound field reconstruction generally involves collecting signals through a device, processing the collected signals, and distributing the processed signals to a playback system. The playback system plays the signals in a specific area to reproduce the measured sound field at the time to the greatest extent possible, so that the audience can get the most realistic experience. However, in some scenarios, people do not need information from all directions, but are more concerned about the performance of the sound field in certain directions, such as sound source identification, abnormal sound diagnosis, etc. At this time, the sound field in a specific direction needs to be reconstructed, and the reconstruction effect needs to highly restore the actual sound field.

[0004] In the existing technology, sound signals are collected by microphones in the target area as target sound signals, and the weights of each speaker of the playback device on the target sound signals are predicted based on the target sound signals and a pre-established weight prediction model. The sound source signals are allocated to the speakers for playback based on the predicted weights, thereby achieving omnidirectional sound field reconstruction in the target area. However, it is impossible to achieve sound field playback in a specific direction, and the sound field reconstructed using these speakers has poor accuracy in reproducing the target sound field. Summary of the invention

[0005] In view of this, the embodiments of the present invention provide a directional sound field playback method, apparatus, terminal device and medium to solve the problem in the prior art that the target sound field cannot be accurately reconstructed.

[0006] In a first aspect, a method for reproducing a directional sound field is provided, the method comprising:

[0007] Acquire a target sound field signal in a three-dimensional space within a target area; render the target sound field signal to obtain various track signals of the target sound field signal, wherein each track signal corresponds to each loudspeaker arranged in a specified space;

[0008] Obtain the target source direction angle of the sound field to be reproduced, the target source direction angle includes the target horizontal angle and the target elevation angle; obtain the direction angle of each loudspeaker in the specified space, and select n loudspeakers from N loudspeakers arranged in the specified space according to the angle between the direction angle of each loudspeaker and the target source direction angle, where N>n≥3;

[0009] Determine the signal playback weight coefficients of the n loudspeakers according to the target source direction angle and the direction angles of the n loudspeakers;

[0010] Using the signal playback weight coefficients of the n speakers, weighted processing is performed on the n track signals corresponding to the speakers to obtain optimized track signals of the n speakers;

[0011] According to the optimized track signals of the n speakers, the n speakers are controlled to play respectively to achieve the sound field playback in the target source direction.

[0012] In a second aspect, a directional sound field playback device is provided, the device comprising:

[0013] A track signal acquisition module is used to acquire a target sound field signal in a three-dimensional space within a target area; render the target sound field signal to obtain each track signal of the target sound field signal, each track signal corresponding to each loudspeaker arranged in a specified space;

[0014] A direction angle acquisition module is used to acquire the direction angle of the target source that needs to be reproduced in the sound field, where the target source direction angle includes the target horizontal angle and the target elevation angle; acquire the direction angle of each loudspeaker in the specified space, and select n loudspeakers from the N loudspeakers arranged in the specified space according to the angle between the direction angle of each loudspeaker and the direction angle of the target source, where N>n≥3;

[0015] A weight coefficient determination module, used to determine the signal playback weight coefficients of the n loudspeakers according to the target source direction angle and the direction angles of the n loudspeakers;

[0016] A track signal weighting processing module, used to perform weighted processing on n track signals corresponding to the speakers using signal playback weight coefficients of the n speakers, to obtain optimized track signals of the n speakers;

[0017] The sound field playback module controls the n speakers to play respectively according to the optimized track signals of the n speakers, so as to achieve the sound field playback in the target source direction.

[0018] In a third aspect, an embodiment of the present invention provides a terminal device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the directional sound field playback method of the first aspect when executing the computer program.

[0019] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the directional sound field playback method of the first aspect are implemented.

[0020] In a fifth aspect, an embodiment of the present invention provides a computer program product. When the computer program product is run on a terminal device, the terminal device executes the steps of the directional sound field playback method of the first aspect.

[0021] Compared with the prior art, the present invention has the following beneficial effects: by acquiring and rendering the target sound field signal, a track signal corresponding to the arranged N loudspeakers is obtained, the target source direction angle that needs to be reproduced in the sound field and the direction angle of the loudspeaker in the specified space are obtained, and according to the angle between the direction angle of each loudspeaker and the target source direction angle, n loudspeakers are selected, N>n≥3, and the signal playback weight coefficients of the n loudspeakers are determined, and the n track signals corresponding to the loudspeakers are weighted to obtain the optimized track signals of the n loudspeakers, and the n loudspeakers are controlled to play respectively to achieve the sound field playback in the target source direction. That is, the present invention only selects some loudspeakers for sound field playback, avoids the interference between multiple loudspeakers, calculates the weight coefficient of the loudspeaker signal playback, normalizes the track signal, improves the accuracy of the target sound field reproduction, selects loudspeakers through the direction angle information, simplifies the operation process, and highly restores the sound field in a specific direction. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0023] Figure 1 It is a schematic diagram of an application environment of a directional sound field playback method provided by an embodiment of the present invention;

[0024] Figure 2 is a schematic flow chart of a directional sound field playback method in one embodiment of the present invention;

[0025] Figure 3 is a schematic diagram of a process for selecting a playback speaker in one embodiment of the present invention;

[0026] Figure 4 is a schematic diagram of a process of weighted processing of track signals in one embodiment of the present invention;

[0027] Figure 5 is a schematic diagram of a process of normalizing weight coefficients in one embodiment of the present invention;

[0028] Figure 6 It is a structural schematic diagram of a directional sound field playback device of a directional sound field playback method in one embodiment of the present invention;

[0029] Figure 7 It is a structural schematic diagram of a terminal device of a directional sound field playback method in one embodiment of the present invention. DETAILED DESCRIPTION

[0030] In the following description, specific details such as specific system structures, technologies, etc. are provided for the purpose of illustration rather than limitation, so as to provide a thorough understanding of the embodiments of the present invention. However, it should be clear to those skilled in the art that the present invention may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to prevent unnecessary details from obstructing the description of the present invention.

[0031] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0032] It should also be understood that the term "and / or" used in the present description and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0033] As used in the present specification and the appended claims, the term "if" may be interpreted as "when" or "upon" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" may be interpreted as meaning "upon determination" or "in response to determining" or "upon detection of [described condition or event]" or "in response to detecting [described condition or event]", depending on the context.

[0034] In addition, in the description of the present specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0035] References to "one embodiment" or "some embodiments" etc. described in the present specification mean that one or more embodiments of the present invention include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0036] It should be understood that the order of execution of the steps in the following embodiments does not imply a precedence of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0037] In order to illustrate the technical solution of the present invention, specific embodiments are provided below for illustration.

[0038] A directional sound field playback method provided by an embodiment of the present invention can be applied in Figure 1 In an application environment, a client communicates with a server through a network. The client includes but is not limited to a PDA, a desktop computer, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a cloud terminal device, a personal digital assistant (PDA), and other terminal devices. The server can be implemented with an independent server or a server cluster consisting of multiple servers.

[0039] See also Figure 2 , is a flow chart of a directional sound field playback method provided by an embodiment of the present invention, and the directional sound field playback method can be applied to Figure 1 The client in the client, the terminal device corresponding to the client connects to the target database through a preset application programming interface (API). When the target data is driven to execute the corresponding task, a corresponding task log will be generated, and the above task log can be collected through the API. Figure 2 As shown, the directional sound field playback method may include the following steps:

[0040] Step S101 , obtaining a target sound field signal in a three-dimensional space within a target area; rendering the target sound field signal to obtain various track signals of the target sound field signal, wherein each track signal corresponds one-to-one to each loudspeaker arranged in a designated space.

[0041] Among them, the target sound field signal refers to the overall sound signal in a certain area that the user wants to obtain. After rendering the target sound field signal, multiple track signals can be obtained. Each track signal corresponds one-to-one to the arranged speakers, that is, one speaker corresponds to one track signal, and the designated space is a playback space with several speakers distributed.

[0042] In one embodiment, a user wants to analyze the source of noise inside a car while driving, and therefore needs to obtain a sound field signal inside the car, render the obtained sound field signal, and obtain 10 track signals corresponding to 10 speakers distributed in a simulated car interior space.

[0043] Step S102, obtaining the target source direction angle of the sound field to be reproduced, the target source direction angle including the target horizontal angle and the target elevation angle; obtaining the direction angle of each speaker in the specified space, and selecting n speakers from the N speakers arranged in the specified space according to the angle between the direction angle of each speaker and the target source direction angle, N>n≥3.

[0044] Among them, the target source direction angle refers to the angle used to indicate a certain direction that you want to obtain, including the horizontal angle and the elevation angle. Similarly, the direction angle of the speaker is also used to indicate the angle of the speaker's orientation. Through the direction angle of the speaker and the direction angle of the target source, the angle information of the speaker relative to the target source can be determined, and the speaker can be selected based on the angle information. The target source direction can be obtained by, including but not limited to, the gyroscope of the mobile phone, and the target source direction angle information is sent to the server for processing.

[0045] In one embodiment, the center of the playback space can be used as the origin, the direction to the right of the listener as the polar axis +x, and the vertically upward direction as the polar axis +y. The sound receiving device can be fixed in the center of the playback space and face a certain direction. To obtain the sound field directly in front, the target source direction angle can be expressed as (90°, 0°). If a speaker is located in the upper right front of the listener, the direction angle of the speaker can be expressed as (45°, 45°). The angle between the direction angle of the speaker and the direction angle of the target source is Similarly, the angle between the direction angle of each loudspeaker and the direction angle of the target source can be calculated, and then according to the sizes of the calculated angles, a small number of loudspeakers with smaller angles with the direction angle of the target source are selected from the 10 arranged loudspeakers.

[0046] Step S103: determining signal playback weight coefficients of the n loudspeakers according to the target source direction angle and the direction angles of the n loudspeakers.

[0047] For example, when n=3, the sound field in the direction of the target source needs to be played out by the three selected loudspeakers, and the playback weight coefficients of the three loudspeaker signals can be calculated to determine the playback signals of the three loudspeakers.

[0048] Step S104 , using the signal playback weight coefficients of the n speakers, weighted processing is performed on the n track signals corresponding to the speakers to obtain optimized track signals of the n speakers.

[0049] The track signals of the three selected speakers are weighted by using the playback weights of the three speaker signals calculated in step S103 to optimize the track signals of the speakers.

[0050] Step S105 , controlling the n speakers to play respectively according to the optimized track signals of the n speakers, so as to achieve the sound field playback in the target source direction.

[0051] Among them, when n=3, three speakers are used to play according to the optimized track signals respectively to achieve sound field playback in the desired direction; when n=4, four speakers are used to play according to the optimized track signals respectively to achieve sound field playback in the desired direction.

[0052] The directional sound field playback method of this embodiment obtains the sound field information in the target area, refines and renders the sound field information, obtains the track signal and associates it with each speaker in the playback space, selects several speakers near the target direction, avoids the interference between multiple speakers, calculates the weight coefficient of the speaker signal playback, normalizes the track signal, improves the accuracy of the target sound field reproduction, selects the speaker through the directional angle information, simplifies the operation process, and highly restores the sound field in a specific direction.

[0053] In other embodiments, a directional sound field playback method is provided, that is, in step S101, further comprising:

[0054] A microphone array is used to obtain the target sound field signal in the three-dimensional space of the target area.

[0055] In one embodiment, a ball array microphone can be placed in the vehicle to collect the sound field signal in the vehicle. The ball array microphone can collect three-dimensional sound field information in all directions through multiple channels, and the number of channels will affect the effect of sound field reconstruction.

[0056] The directional sound field playback method of this embodiment uses a multi-channel microphone to collect sound field information. The collected sound field information is more comprehensive and three-dimensional, which is conducive to the reproduction of the target sound field.

[0057] In other embodiments, a directional sound field playback method is provided, and in step S101, further includes:

[0058] The target sound field signal is rendered using a high-order reverberation algorithm to obtain each track signal of the target sound field signal.

[0059] Among them, the higher order ambisonics algorithm (HOA) is a method of fitting the sound field generated by the original sound source with the sound field generated by the sound source in different directions, and rendering the track signal corresponding to the speaker.

[0060] In one embodiment, a high-order reverberation algorithm is used to decompose the spherical harmonics of the acquired spatial sound field, and a set of sound field expansion coefficient vectors is used to represent the spatial sound field information. The higher the order of the expansion coefficients, the higher the spatial resolution.

[0061] The directional sound field playback method of this embodiment uses a high-order reverberation algorithm to process the target sound field signal to obtain a multi-track signal, each track signal corresponds to a loudspeaker, so that the sound field playback effect is better.

[0062] In other embodiments, a directional sound field playback method is provided, such as Figure 3 As shown, in step S102, that is, according to the angle between the direction angle of each speaker and the direction angle of the target source, n speakers are selected from N speakers arranged in the specified space, including the following steps:

[0063] Step S401 , comparing the angles between the directional angles of the N loudspeakers and the directional angle of the target source, and selecting the smallest n angles from the N angles.

[0064] In one embodiment, N=10 speakers may be distributed in the playback space, and the angles between their directional angles and the target source directional angle are 10°, 20°, 35°, 45°, 60°, 90°, 105°, 135°, 150°, and 180°, respectively, and the smallest n=3 angles of 10°, 20°, and 35° are selected.

[0065] In other embodiments, when the total number of arranged loudspeakers is large, multiple loudspeakers may be selected therefrom to play signals to achieve more accurate reproduction of the sound field in the target source direction, for example, n=3, 4, 5, 6, etc.

[0066] Step S402: select the loudspeakers corresponding to the n included angles as the loudspeakers for reproducing the sound field in the direction of the target source, and the remaining (Nn) loudspeakers do not work.

[0067] In the above implementation, three speakers whose directional angles are 10°, 20°, and 35° with the target source directional angle are selected, and only these three speakers are used to reproduce the sound field, while the remaining seven speakers do not work.

[0068] The directional sound field playback method of this embodiment selects only a number of loudspeakers whose direction angles are close to the target source direction for sound field playback, thereby narrowing the playback area and reducing the influence of other loudspeakers on the sound field playback in the target direction.

[0069] In other embodiments, a directional sound field playback method is provided, in step S103, the formula for determining the signal playback weight coefficients of the n speakers according to the target source direction angle and the direction angles of the n speakers is:

[0070]

[0071] Among them, g1 g2 … g n are the weight coefficients of n loudspeakers, θ1 θ2 … θ n are the horizontal angles of n loudspeakers, are the elevation angles of n loudspeakers, θ s is the horizontal angle from the target source direction, is the elevation angle in the direction of the target source.

[0072] In one embodiment, n=3 loudspeaker direction angles are selected. The target source direction angle is The weight coefficients of these three speakers are g1 g2 g3 respectively, and the weight coefficient calculation formula is:

[0073]

[0074] In another embodiment, n=4 loudspeaker direction angles are selected. The target source direction angle is The weight coefficients of these four speakers are g1 g2 g3 g4 respectively, and the weight coefficient calculation formula is:

[0075]

[0076] The directional sound field playback method of this embodiment calculates the weight coefficient of the selected speaker through the direction angle of the speaker and the target source to optimize the track signal corresponding to the speaker, so that the selected speaker can better present the sound field in the target direction when playing the signal.

[0077] In other embodiments, a directional sound field playback method is provided, such as Figure 4As shown, in step S104, that is, after determining the signal playback weight coefficients of the n loudspeakers, the following further includes:

[0078] Step S601: normalize the signal playback weight coefficients of n loudspeakers.

[0079] The purpose of normalization is to limit the playback weight coefficients of each signal to be processed within a certain range after processing. In one embodiment, each signal playback weight coefficient can be limited within the range between (0, 1).

[0080] Step S602: Using n normalized signal playback weight coefficients, weighted processing is performed on n track signals corresponding to the speakers.

[0081] In the above implementation, the track signal of each speaker is multiplied by the normalized weight coefficient and output as the final track signal.

[0082] The directional sound field playback method of this embodiment normalizes the weight coefficient, performs weighted processing on the track signal, clarifies the proportion of each track signal, and can better play back the target sound field.

[0083] In other embodiments, a directional sound field playback method is provided, such as Figure 5 As shown, in step S601, the signal playback weight coefficients of the n loudspeakers are normalized, including:

[0084] Step S701, calculate the normalized weight coefficient, the normalized weight coefficient formula is:

[0085]

[0086] Among them, τ is the normalized weight coefficient, g1 g2 … g n are the signal playback weight coefficients of n loudspeakers respectively;

[0087] In one embodiment, the weight coefficients of the selected n=3 loudspeakers are: g1=1, g2=2, g3=3, and the normalized weight coefficient is:

[0088]

[0089] Step S702: multiply the normalized weight coefficient by the signal playing weight coefficient of each loudspeaker to obtain the normalized signal playing weight coefficient.

[0090] In the above implementation, the normalized weight coefficients of the selected n=3 loudspeakers are respectively 0.2673, 0.5346, and 0.8019.

[0091] The directional sound field playback method of this embodiment calculates the weight coefficient of normalization processing, thereby increasing the comparability between signal data.

[0092] Corresponding to the method of the above embodiment, Figure 6 The structural block diagram of a directional sound field playback device provided by an embodiment of the present invention is shown. The directional sound field playback device is applied to a terminal device, and the terminal device is connected to a target database through a preset application program interface. When the target database is driven to execute a corresponding task, a corresponding task log is generated, and the task log can be collected through the API. For the convenience of explanation, only the part related to the embodiment of the present invention is shown.

[0093] See also Figure 6 The directional sound field playback device includes: a track signal acquisition module 81, a direction angle acquisition module 82, a weight coefficient determination module 83, a track signal weighted processing module 84, and a sound field playback module 85.

[0094] The track signal acquisition module 81 is used to acquire the target sound field signal in the three-dimensional space of the target area; render the target sound field signal to obtain each track signal of the target sound field signal, and each track signal corresponds to each loudspeaker arranged in the specified space;

[0095] The direction angle acquisition module 82 is used to acquire the direction angle of the target source that needs to be reproduced in the sound field, and the target source direction angle includes the target horizontal angle and the target elevation angle; acquire the direction angle of each speaker in the specified space, and select n speakers from the N speakers arranged in the specified space according to the angle between the direction angle of each speaker and the target source direction angle, where N>n≥3;

[0096] A weight coefficient determination module 83, used to determine the signal playback weight coefficients of the n speakers according to the target source direction angle and the direction angles of the n speakers;

[0097] The track signal weighting processing module 84 is used to perform weighted processing on the n track signals corresponding to the speakers using the signal playback weight coefficients of the n speakers to obtain optimized track signals of the n speakers;

[0098] The sound field playback module 85 is used to control the n speakers to play respectively according to the optimized track signals of the n speakers, so as to achieve the sound field playback in the target source direction.

[0099] Optionally, the track signal acquisition module 81 includes:

[0100] The target sound field signal acquisition unit is used to acquire the target sound field signal in the three-dimensional space of the target area using the microphone array.

[0101] Optionally, the track signal acquisition module 81 further includes:

[0102] The track signal acquisition unit is used to render the target sound field signal based on a high-order reverberation algorithm to obtain each track signal of the target sound field signal.

[0103] Optionally, the direction angle acquisition module 82 includes:

[0104] An angle comparison and selection unit, used for comparing the angles between the direction angles of the N loudspeakers and the direction angle of the target source, and selecting the smallest n angles from the N angles;

[0105] The loudspeaker selection unit is used to select loudspeakers corresponding to the n included angles as loudspeakers for reproducing the sound field in the direction of the target source, and the remaining (Nn) loudspeakers do not work.

[0106] Optionally, the weight coefficient determination module 83 includes:

[0107] A weight coefficient calculation unit is used to determine the signal playback weight coefficients of the n loudspeakers. The formula of the signal playback weight coefficient is:

[0108]

[0109] Among them, g1 g2 … g n are the weight coefficients of n loudspeakers, θ1 θ2 … θ n are the horizontal angles of the direction angles of the n loudspeakers, are the elevation angles of the n loudspeakers, θ s is the horizontal angle from the target source direction, is the elevation angle in the direction of the target source.

[0110] Optionally, the weight coefficient determination module 83 further includes:

[0111] A normalization processing unit, used for normalizing the signal playback weight coefficients of the n loudspeakers;

[0112] The weighted processing unit is used to perform weighted processing on n track signals corresponding to the speakers using n normalized signal playback weight coefficients.

[0113] Optionally, the normalization processing unit includes:

[0114] The weight coefficient calculation subunit calculates the normalized weight coefficient, and the normalized weight coefficient formula is:

[0115]

[0116] Among them, τ is the normalized weight coefficient, g1 g2 … g n are the signal playback weight coefficients of n loudspeakers respectively;

[0117] The normalization processing subunit multiplies the normalization weight coefficient by the signal playing weight coefficient of each of the loudspeakers to obtain the signal playing weight coefficient after normalization processing.

[0118] It should be noted that the information interaction, execution process and other contents between the above modules are based on the same concept as the embodiment of the method of the present invention. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0119] Figure 7 The following is a schematic diagram of the structure of a terminal device provided by an embodiment of the present invention. Figure 6 As shown, the terminal device of this embodiment includes: at least one processor ( Figure 7 Only one is shown), a memory, and a computer program stored in the memory and executable on at least one processor, wherein when the processor executes the computer program, the steps in any of the above-mentioned directional sound field playback method embodiments are implemented.

[0120] The terminal device may include, but is not limited to, a processor and a memory. Those skilled in the art will appreciate that Figure 7 It is only an example of a terminal device and does not constitute a limitation on the terminal device. The terminal device may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, it may also include a network interface, a display screen, and an input device.

[0121] The processor may be a CPU, or other general-purpose processors, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0122] The memory includes a readable storage medium, an internal memory, etc., wherein the internal memory may be the memory of the terminal device, and the internal memory provides an environment for the operation of the operating system and the computer-readable instructions in the readable storage medium. The readable storage medium may be the hard disk of the terminal device, and in other embodiments, it may also be an external storage device of the terminal device, for example, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the terminal device. Further, the memory may also include both an internal storage unit of the terminal device and an external storage device. The memory is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of a computer program, etc. The memory may also be used to temporarily store data that has been output or is to be output.

[0123] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention. The specific working process of the units and modules in the above-mentioned device can refer to the corresponding process in the above-mentioned method embodiment, which will not be repeated here. If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of the above-mentioned method embodiment can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying computer program code, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0124] The present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by a computer program product. When the computer program product runs on a terminal device, the terminal device can implement the steps in the above-mentioned method embodiment when executing it.

[0125] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0126] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0127] In the embodiments provided by the present invention, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0128] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0129] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention.

Claims

1. A directional sound field playback method, characterized in that: The method comprises: Acquire a target sound field signal in a three-dimensional space within a target area; render the target sound field signal to obtain various track signals of the target sound field signal, wherein each track signal corresponds to each loudspeaker arranged in a specified space; Obtaining a target source direction angle for sound field playback, wherein the target source direction angle includes a target horizontal angle and a target elevation angle; obtaining a direction angle of each of the loudspeakers in the designated space, and selecting n loudspeakers from N loudspeakers arranged in the designated space according to an angle between the direction angle of each of the loudspeakers and the target source direction angle, where N>n≥3; Determining signal playback weight coefficients of the n speakers according to the target source direction angle and the direction angles of the n speakers; Using the signal playback weight coefficients of the n speakers, weighted processing is performed on the n track signals corresponding to the speakers to obtain optimized track signals of the n speakers; According to the optimized track signals of the n speakers, the n speakers are controlled to play respectively to achieve the sound field playback in the target source direction.

2. The directional sound field playback method according to claim 1, characterized in that: A microphone array is used to acquire a target sound field signal in the three-dimensional space of the target area.

3. The directional sound field playback method according to claim 1, characterized in that: The target sound field signal is rendered using a high-order reverberation algorithm to obtain various track signals of the target sound field signal.

4. The directional sound field playback method according to claim 1, characterized in that: The selecting n loudspeakers from the N loudspeakers arranged in the designated space according to the angle between the direction angle of each loudspeaker and the direction angle of the target source comprises: Comparing the angles between the direction angles of the N loudspeakers and the direction angle of the target source, and selecting the smallest n angles from the N angles; The loudspeakers corresponding to the n included angles are selected as the loudspeakers for reproducing the sound field in the direction of the target source, and the remaining (Nn) loudspeakers are not working.

5. The directional sound field playback method according to claim 1, characterized in that: The step of determining the signal playback weight coefficients of the n loudspeakers according to the target source direction angle and the direction angles of the n loudspeakers comprises: Determine the signal playback weight coefficients of the n loudspeakers, the formula of the signal playback weight coefficient is: Among them, g1 g2 … g n are the weight coefficients of n loudspeakers, θ1 θ2 … θ n are the horizontal angles of the direction angles of the n loudspeakers, are the elevation angles of the n loudspeakers, θ s is the horizontal angle from the target source direction, is the elevation angle in the direction of the target source.

6. The directional sound field playback method according to claim 1, characterized in that: After determining the signal playback weight coefficients of the n loudspeakers, the method further includes: Normalizing the signal playback weight coefficients of the n loudspeakers; The n track signals corresponding to the loudspeakers are weighted by using the n normalized signal playback weight coefficients.

7. The weight coefficient according to claim 6, characterized in that: The normalizing of the signal playback weight coefficients of the n loudspeakers includes: Calculate the normalized weight coefficient, the normalized weight coefficient formula is: Among them, τ is the normalized weight coefficient, g1 g2 … g n are the signal playback weight coefficients of n loudspeakers respectively; The normalized weight coefficient is multiplied by the signal playing weight coefficient of each of the loudspeakers to obtain the normalized signal playing weight coefficient.

8. A directional sound field playback device, characterized in that: The directional sound field playback device comprises: A track signal acquisition module is used to acquire a target sound field signal in a three-dimensional space within a target area; render the target sound field signal to obtain each track signal of the target sound field signal, each track signal corresponding to each loudspeaker arranged in a specified space; A direction angle acquisition module is used to acquire the direction angle of the target source that needs to be reproduced in the sound field, wherein the target source direction angle includes a target horizontal angle and a target elevation angle; acquire the direction angle of each of the loudspeakers in the designated space, and select n loudspeakers from the N loudspeakers arranged in the designated space according to the angle between the direction angle of each of the loudspeakers and the target source direction angle, where N>n≥3; A weight coefficient determination module, used to determine the signal playback weight coefficients of the n speakers according to the target source direction angle and the direction angles of the n speakers; A track signal weighting processing module, used to perform weighted processing on the n track signals corresponding to the speakers using the signal playback weight coefficients of the n speakers, so as to obtain optimized track signals of the n speakers; The sound field playback module controls the n speakers to play respectively according to the optimized track signals of the n speakers, so as to achieve the sound field playback in the target source direction.

9. A terminal device, characterized in that: The terminal device comprises a processor, a memory, and a computer program stored in the memory and executable on the processor, and the processor implements the steps of the directional sound field playback method as claimed in any one of claims 1 to 7 when executing the computer program.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the directional sound field playback method according to any one of claims 1 to 7 are implemented.

Images