Audio data loudspeaker rendering method and device, equipment and storage medium

By acquiring the sound field configuration parameters of the terminal device to expand the sound field and render spatial effects, the problem of poor playback effect caused by the single audio processing algorithm in the existing technology is solved, the external playback effect of game sound effects is improved, and the user's immersive experience is enhanced.

CN118945587APending Publication Date: 2024-11-12TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202310519019.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-09
Publication Date
2024-11-12

AI Technical Summary

Technical Problem

Existing audio processing algorithms are relatively simple in external playback mode, resulting in poor audio data playback quality and failing to meet the needs of highly interactive and immersive experiences such as game sound effects.

Method used

By obtaining user-defined sound field configuration parameters, such as speaker distance and listening distance, the sound field expansion parameters are determined, the audio data is expanded, and combined with spatial effect rendering and frequency band adjustment, the external playback effect of the audio data is optimized.

Benefits of technology

It improves the external playback effect of audio data, making the audio data more suitable for the terminal device and the user's position, enhancing the auditory experience, especially the immersion and sense of space in game sound effects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118945587A_ABST
    Figure CN118945587A_ABST
Patent Text Reader

Abstract

The invention discloses a loudspeaker rendering method and device of audio data, equipment and a storage medium, and relates to the technical field of audio playing. The method comprises the steps that sound field configuration parameters set by a user of the terminal device in a user-defined mode are obtained, the sound field configuration parameters comprise the loudspeaker distance and the listening distance, the loudspeaker distance refers to the distance between two loudspeakers of the terminal device, and the listening distance refers to the distance between the user and the terminal device; according to the sound field configuration parameter, determining a sound field extension parameter which is a parameter used for performing sound field extension on the audio data of the first application program; performing sound field expansion on the audio data according to the sound field expansion parameter to obtain the audio data after sound field expansion; and according to the audio data after the sound field expansion, determining audio data played by a loudspeaker of the terminal equipment. The playing effect of the externally played audio data obtained based on the embodiment of the invention is relatively good.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present application relate to the field of audio playback technology, and in particular to a method, device, equipment and storage medium for external rendering of audio data. Background Art

[0002] For the audio in music or movies, users can choose to play it externally or non-externally. External playback means playing the audio directly through the speaker of the terminal device, while non-external playback means playing the audio through an audio playback device that is connected to the terminal device by wire or wirelessly.

[0003] In the related art, if the user chooses to play the audio externally, the audio data needs to be processed by a specific audio processing algorithm, and the processed audio data is played through the terminal device. In the above-mentioned related art, the audio processing algorithm for the audio data in the external playback mode is relatively fixed, or the processing flow is the same.

[0004] Therefore, since the audio processing algorithm in the related art has a relatively simple processing form for audio data, the external playback effect of the audio data is poor. Summary of the invention

[0005] The present application provides a method, device, equipment and storage medium for external rendering of audio data. The technical solution is as follows:

[0006] According to one aspect of an embodiment of the present application, a method for external rendering of audio data is provided, the method comprising:

[0007] Acquire a sound field configuration parameter customized by a user of the terminal device, wherein the sound field configuration parameter includes a speaker distance and a listening distance, wherein the speaker distance refers to the distance between two speakers of the terminal device, and the listening distance refers to the distance between the user and the terminal device;

[0008] Determining a sound field expansion parameter according to the sound field configuration parameter, wherein the sound field expansion parameter is a parameter used to expand the sound field of the audio data of the first application program;

[0009] Performing sound field expansion on the audio data according to the sound field expansion parameters to obtain audio data after sound field expansion;

[0010] The audio data played outwardly through the speaker of the terminal device is determined according to the audio data after the sound field expansion.

[0011] According to one aspect of an embodiment of the present application, a device for external rendering of audio data is provided, the device comprising:

[0012] a parameter acquisition module, used to acquire sound field configuration parameters customized by a user of the terminal device, wherein the sound field configuration parameters include a speaker distance and a listening distance, wherein the speaker distance refers to the distance between two speakers of the terminal device, and the listening distance refers to the distance between the user and the terminal device;

[0013] A parameter determination module, used to determine a sound field expansion parameter according to the sound field configuration parameter, wherein the sound field expansion parameter is a parameter used to expand the sound field of the audio data of the first application program;

[0014] A sound field expansion module, used for performing sound field expansion on the audio data according to the sound field expansion parameters to obtain audio data after sound field expansion;

[0015] The audio determination module is used to determine the audio data played outwardly through the speaker of the terminal device according to the audio data after the sound field expansion.

[0016] According to one aspect of an embodiment of the present application, a terminal device is provided, the terminal device comprising a processor and a memory, the memory storing a computer program, the computer program being loaded and executed by the processor to implement the above method.

[0017] According to one aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is loaded and executed by a processor to implement the above method.

[0018] According to one aspect of an embodiment of the present application, a computer program product is provided, the computer program product comprising a computer program, the computer program being stored in a computer-readable storage medium. A processor of a terminal device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the terminal device executes the above method.

[0019] The beneficial effects brought by the technical solution provided by the embodiment of the present application include at least:

[0020] When rendering the audio data externally, the embodiment of the present application incorporates the device parameters of the terminal device (speaker distance) and the listening distance customized by the user of the terminal device, so that the audio data after the sound field expansion not only fits the terminal device itself, but also can expand the sound field of the audio data according to different listening distances. For the user, it can realize the positioning of the sound, thereby improving the external playback effect of the audio data. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a schematic diagram of an implementation environment of a solution provided by an embodiment of the present application;

[0022] Figure 2 is a schematic diagram of an external rendering system for audio data provided by an embodiment of the present application;

[0023] Figure 3 is a schematic diagram of a method for external rendering of audio data provided by an embodiment of the present application;

[0024] Figure 4 is a flowchart of a method for external rendering of audio data provided by an embodiment of the present application;

[0025] Figure 5 is a flowchart of a method for external rendering of audio data provided by another embodiment of the present application;

[0026] Figure 6 is a schematic diagram of crosstalk elimination provided by an embodiment of the present application;

[0027] Figure 7 is a schematic diagram of single-channel audio spatial enhancement provided by an embodiment of the present application;

[0028] Figure 8 is a schematic diagram of a time domain constraint condition of an output signal provided by an embodiment of the present application;

[0029] Fig. 9 is a schematic diagram of a method for predicting sound field expansion parameters provided by an embodiment of the present application;

[0030] Fig.10 is a schematic diagram of sound field expansion provided by an embodiment of the present application;

[0031] Fig.11 is a schematic diagram of effect sound distribution provided by an embodiment of the present application;

[0032] Fig.12 is a schematic diagram of sound effect distribution provided by another embodiment of the present application;

[0033] Fig.13 is a schematic diagram of sound field expansion provided by another embodiment of the present application;

[0034] Fig.14 is a flowchart of a method for external rendering of audio data provided by another embodiment of the present application;

[0035] Fig.15 is a schematic diagram of frequency band adjustment provided by an embodiment of the present application;

[0036] Fig.16 is a schematic diagram of frequency response measurement of a terminal device provided by an embodiment of the present application;

[0037] Fig.17is a flowchart of a method for external rendering of audio data provided by another embodiment of the present application;

[0038] Fig.18 is a schematic diagram of a spatial effect processing provided by an embodiment of the present application;

[0039] Fig.19 is a flowchart of a method for external rendering of audio data provided by another embodiment of the present application;

[0040] Fig. 20 is a block diagram of a method for external rendering of audio data provided by another embodiment of the present application;

[0041] Fig.21 is a block diagram of an external rendering device for audio data provided by an embodiment of the present application;

[0042] Fig. 22 is a block diagram of an external rendering device for audio data provided by another embodiment of the present application;

[0043] Fig.23 This is a block diagram of a terminal device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0045] Please refer to Figure 1 , which shows a schematic diagram of a solution implementation environment provided by an embodiment of the present application. The solution implementation environment may include: a terminal device 10 and a server 20.

[0046] The terminal device 10 includes, but is not limited to, mobile phones, tablet computers, intelligent voice interaction devices, game consoles, wearable devices, multimedia playback devices, PCs (Personal Computers), vehicle-mounted terminals, smart home appliances and other electronic devices. The client of the target application (such as a game application) can be installed in the terminal device 10. Optionally, the target application can be an application that needs to be downloaded and installed, or it can be a click-to-use application, which is not limited in the embodiments of the present application.

[0047] In an embodiment of the present application, the target application may be a third-person shooting game (Third-Person Shooting Game, TPS for short), a music application, a broadcast application, a social application, a simulation program, a battle royale shooting game, a virtual reality (VR for short) application, an augmented reality (AR for short) program, a three-dimensional map program, a virtual reality game, an augmented reality game, a first-person shooting game (FPS for short), a multiplayer gunfight survival game, a multiplayer online tactical competition (MOBA for short) game, a strategy game (SLG for short), or any one of an interactive entertainment application. In addition, for different applications, the audio data generated is different. For example, if the target application is an FPS game, the audio data generated in the game game includes but is not limited to footsteps, voices, and the like. Optionally, a client of the above-mentioned target application is running in the terminal device 10. Therefore, when the playback mode of the terminal device 10 is external, it is necessary to render these audio data externally. Of course, the target application for rendering the audio data externally may be a first application providing the audio data, or a second application different from the first application. The clients corresponding to the first application and the second application are both installed on the terminal device 10.

[0048] The server 20 is used to provide background services for the client of the target application in the terminal device 10. For example, the server 20 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms, but is not limited to these.

[0049] The terminal device 10 and the server 20 can communicate with each other via a network, which can be a wired network or a wireless network.

[0050] Please refer to Figure 2 , which shows a schematic diagram of an external rendering system for audio data provided by an embodiment of the present application.

[0051] like Figure 2As shown, the external rendering system 210 receives audio data provided by the client 200 of the first application, processes the audio data, generates output audio, and provides the output audio to the terminal device 220, which plays the output audio through a speaker. In some embodiments, the client 200 of the first application is a client of a game application, and the terminal device 220 is a mobile device.

[0052] In some embodiments, according to whether spatial audio processing is performed, the rendering method is divided into traditional audio rendering and spatial object audio rendering. Traditional audio rendering directly processes the channel data and then outputs it, without converting the audio data into a spatial format. Spatial audio processing uses object audio technology to render the audio data according to the spatial information of the object, including information such as position, distance and spatial effects, and outputs audio data in an intermediate format (such as Ambisonics, or multi-channel formats such as 5.1 / 7.1) including 3D (Three-dimensional) effects. The system plays audio in a multi-channel format or a stereo dual-channel format. The current terminal device mainly outputs stereo sound. For the multi-channel rendering method, it needs to be converted into stereo audio through binauralization and then output. The system playback mode is divided into two types: non-external and external. Non-external generally refers to playing and listening through external devices such as wired headphones or wireless Bluetooth. The external mode refers to playing and listening through the terminal device's own speakers. The number of external speakers supported by different terminal devices is different, including single speaker, dual speaker, and multi-speaker configurations. At present, symmetrical dual speakers are gradually becoming the mainstream configuration. The present application embodiment is mainly explained by assuming that the number of speakers on the terminal device is two. Of course, it should be understood by those skilled in the art that when the number of speakers is multiple, the invention concept of the present application embodiment is also adopted. In some embodiments, Figure 2 The external speaker detection module is used to determine whether the current playback mode is external speaker. In non-external speaker mode, the audio is directly output. In external speaker mode, the audio needs to be played through the external speaker rendering method proposed in the embodiment of the present application.

[0053] Please refer to Figure 3 , which shows a schematic diagram of a method for external rendering of audio data provided by an embodiment of the present application.

[0054] In some embodiments, by Figure 2The external speaker rendering module in the external speaker rendering system 210 executes the inventive concept proposed in the embodiment of the present application. The embodiment of the present application does not limit the location of the external speaker rendering module. The external speaker rendering module can be set in the first application or in other applications different from the first application. Of course, the external speaker rendering module can also be directly set in a terminal device for different operating systems (android or ios), and provide audio external speaker rendering services for the clients of all applications that generate audio data installed on the terminal device.

[0055] In some embodiments, Figure 3 As shown, the external speaker rendering module 300 provides at least one of the following three external speaker rendering methods for the input audio: sound field expansion, spatial effect rendering and frequency band adjustment. Optionally, when the external speaker rendering module 300 implements the sound field expansion for the input audio, at least one of the following sound field configuration parameters is required: expansion intensity, listening distance and speaker width (or it can also be called speaker distance, referring to the distance between two speakers). Optionally, when the external speaker rendering module 300 implements the spatial effect rendering for the input audio, at least one of the following spatial configuration parameters is required: space size (or it can also be called space area), space strength (or it can also be called space effect value). Optionally, when the external speaker rendering module 300 implements the frequency band adjustment for the input audio, style configuration parameters are required: timbre style (or it can also be called space area), space strength (or it can also be called space effect value).

[0056] In some embodiments, the external rendering module 300 may provide one or more of the above three external rendering methods. Figure 5 The corresponding embodiment shows that the external speaker rendering module 300 expands the sound field of the input audio. Fig.14 The corresponding embodiment shows that the external speaker rendering module 300 performs sound field expansion and frequency band adjustment on the input audio. Fig.17 The corresponding embodiment shows that the external speaker rendering module 300 performs sound field expansion and spatial effect rendering on the input audio. Fig.19 The corresponding embodiment shows that the external speaker rendering module 300 performs sound field expansion, spatial effect rendering and frequency band adjustment on the input audio. The following embodiments of the present application only show three combinations. For other combinations, those skilled in the art should be able to understand and will not be described in detail.

[0057] In addition, the above-mentioned sound field configuration parameters, space configuration parameters and style configuration parameters can be customized by the user of the terminal device. Of course, they can also be partially customized by the user of the terminal device and partially obtained from the device parameters of the terminal device. This application does not limit this.

[0058] The solutions and algorithms in related technologies are aimed at general audio content, such as music or film and television content. Technically, they focus more on the effects achieved by the processing algorithm itself, without considering the differences between different devices, and at the same time, they allow users to have less room for adjustment. Game sound effects are different from music or film and television music. Their timbre style is strongly related to the game content, and they require strong interaction and high immersion. Existing audio processing algorithms are usually only for ordinary audio playback scenarios and cannot be applied to game sound effect playback scenarios.

[0059] The technical solution provided in the embodiment of the present application is used to implement audio rendering processing in the external playback scenario of the terminal device. The external rendering method includes sound field expansion, spatial effect and frequency band adjustment. Optionally, the three dimensions of the game sound effect experience: sound field width expansion, spatial hearing and timbre adjustment are used to optimize the playback performance of the game audio in the external playback scenario. At the same time, it supports users (users of the terminal device) to adjust and customize the effects according to actual conditions and preferences.

[0060] Please refer to Figure 4 , which shows a flowchart of a method for external rendering of audio data provided by an embodiment of the present application. The execution subject of each step of the method may be Figure 1 The terminal device 10 in the implementation environment of the scheme shown, for example, the execution subject of each step can be the client of the target application. In the following method embodiment, for the convenience of description, only the execution subject of each step is introduced as the "client". The method can include at least one of the following steps (410-440):

[0061] Step 410, obtaining the sound field configuration parameters customized by the user of the terminal device, the sound field configuration parameters including the speaker distance and the listening distance, the speaker distance refers to the distance between the two speakers of the terminal device, and the listening distance refers to the distance between the user and the terminal device.

[0062] Speaker distance: It can also be called speaker width, which refers to the distance between two speakers. The embodiment of the present application does not limit the number of speakers on the terminal device. When there are only two speakers on the terminal device, the shortest distance between the two speakers is taken as the speaker distance. When the terminal device includes at least three speakers, there is a speaker distance between every two speakers. In some embodiments, the speaker arrangement on the terminal device can be determined according to the speaker distance. The speaker mentioned in the embodiment of the present application should be understood as a speaker in a broad sense, that is, the speaker can be other independent external speaker devices for external playback in addition to the speaker assembly on the terminal device. Optionally, the speaker can also be considered as a speaker, a speaker, and the like. The embodiment of the present application does not limit the type of speaker. When the speaker is an independent external speaker device, the distance between the two independent devices is considered to be the speaker distance here. Taking a game application as a simple example, when the user of the mobile phone is playing a game, the user connects the mobile phone to a smart speaker, and plays the output audio that should be played by the terminal device through the smart speaker. If the number of smart speakers is two, the distance between the two speakers (that is, the above-mentioned speaker width) is customized by the user. Therefore, after executing subsequent steps such as sound field expansion according to the user-defined sound field configuration parameters, the audio is output through two smart speakers.

[0063] Listening distance: the distance between the user and the terminal device. The following explanation is given using the case where there are two speakers. In some embodiments, the distance from the middle of the user's ears to the middle of the two speakers is determined as the listening distance. In some embodiments, the distance from the middle of the user's ears to the two speakers is determined as the listening distance (that is, the listening distance includes two distances from the user to the two speakers). In some embodiments, the distance from the user's left ear to the two speakers, and the distance from the user's right ear to the two speakers, are determined as the listening distance. In some embodiments, when the speaker is an independent external speaker, the listening distance is the distance between the user of the terminal device and the independent external speaker.

[0064] In some embodiments, a parameter input interface is displayed on the terminal device. The user inputs the custom sound field configuration parameters on the parameter input interface. In some embodiments, the user determines the sound field configuration parameters by estimation or measurement. In other embodiments, the terminal device obtains the sound field configuration parameters by itself. Optionally, when the terminal device obtains the listening distance, the terminal device uses a camera to obtain the distance from the user to the terminal device with the authorization of the user. Optionally, the camera on the terminal device is a depth camera, and the distance from the user to the terminal device can be determined based on the picture taken by the camera. Optionally, when the terminal device obtains the speaker distance, it directly reads the device parameters to obtain the speaker distance. When the speaker is an independent external speaker device, the terminal device and the independent external speaker device are two independent terminal devices. At this time, the terminal device can use a camera to obtain the distance between the user and the independent external speaker device with the permission of the user.

[0065] Step 420: Determine sound field expansion parameters according to the sound field configuration parameters, where the sound field expansion parameters are parameters used to expand the sound field of the audio data of the first application.

[0066] First application: an application that can generate audio data. The embodiment of the present application does not limit the type of the first application, and the first application includes but is not limited to music applications, broadcast applications, game-type applications, and the like. Optionally, there are multiple audio files on the first application, corresponding to multiple audio data. Optionally, different audio data can be combined with each other to obtain new audio data. Optionally, the spatial type and audio type of different audio data are marked by the first application when generating the audio data. The embodiment of the present application does not limit the format type of the audio data and the size of the audio data.

[0067] In some embodiments, it is believed that the sound field configuration parameters do not change, and the sound field expansion parameters do not change. When the sound field configuration parameters change, the sound field expansion parameters also change accordingly. That is, the user can choose whether to re-customize the sound field configuration parameters. When the user chooses not to re-customize the sound field configuration parameters, it is believed that the sound field configuration parameters customized by the last user are continued to be used, that is, the sound field configuration parameters determined last time are continued to be used. For example, when the user is a handheld terminal device, it is generally believed that the distance from the user to the terminal device does not change, and the speaker distance does not change. Therefore, the sound field configuration parameters only need to be customized by the user once, and the determination of the sound field configuration parameters only needs to be done once. When the user chooses to re-customize the sound field configuration parameters, the user needs to re-customize the sound field configuration parameters and re-determine the sound field configuration parameters. Taking the speaker of the terminal device as an independent external speaker as an example, the speaker distance and the listening distance will also change accordingly depending on the placement of the independent external speaker. Optionally, the user walks from the living room to the kitchen with the mobile phone, but the mobile phone is always connected to an independent external speaker device in a fixed position. At this time, the speaker distance and the listening distance will also change accordingly, requiring the user to re-customize the sound field configuration parameters.

[0068] Specifically, how to determine the sound field expansion parameters according to the sound field configuration parameters can be found in the explanation of the following embodiment, which will not be repeated here.

[0069] Step 430 , performing sound field expansion on the audio data according to the sound field expansion parameters to obtain audio data after the sound field expansion.

[0070] In some embodiments, the sound field refers to an area in a medium where sound waves exist. The physical quantities describing the sound field may be sound pressure, particle vibration velocity, displacement or medium density, etc., which are generally functions of position and time. The relationship between the changes of these physical quantities in the sound field with spatial position and with time is described by the acoustic wave equation. Solving the sound wave equation that satisfies the boundary conditions can reveal the distribution of the sound field with space, the changes with time, and the energy relationship.

[0071] In some embodiments, the sound field expansion parameters can be used to change the distribution of the sound field with space, the change with time, and the energy relationship. To give a simple example, in the related art, the audio is played directly through the speaker of the terminal device. At this time, the sound field is a part of the space centered on the speaker, and the technical solution provided in the embodiment of the present application, through the user-defined sound field configuration parameters, can make the sound field after the sound field expansion a part of the space centered on the user. Still taking FPS games as an example, there are footsteps, attack sounds, etc. in FPS games. If the sound field is expanded to be centered on the user, the footsteps will have a three-dimensional sense. For example, the footsteps sound as if they are behind the user, which more realistically simulates the game sound effects, making the user feel as if they are personally on the scene, so the user's auditory experience can be better improved.

[0072] In some embodiments, the audio data is processed according to the number of speakers. Optionally, when the number of speakers is N, the audio data is processed to obtain audio data of N channels. The sound field is expanded for the data of each channel to obtain N audio data after the sound field expansion. In some embodiments, the N audio data after the sound field expansion are input into N speakers respectively, where N is a positive integer. For example, in the case of two speakers, the audio data is binauralized to obtain audio data of two channels. The sound field is expanded for the data of each channel to obtain two audio data after the sound field expansion. In some embodiments, the two audio data after the sound field expansion are input into two speakers respectively.

[0073] Step 440: determine the audio data to be played out through the speaker of the terminal device according to the audio data after the sound field expansion.

[0074] In some embodiments, the audio data after the sound field expansion is directly determined as the audio data played externally by the speaker of the terminal device. Optionally, the audio data after the sound field expansion includes audio data of N channels, which are respectively determined as the audio data played externally by the N speakers of the terminal device.

[0075] In other embodiments, the audio data after the sound field expansion needs to be rendered by spatial effect rendering, frequency band adjustment, etc. before the audio data played by the speaker of the terminal device can be determined. For specific spatial effect rendering and frequency band adjustment, please refer to the explanation of the following embodiment, which will not be repeated here.

[0076] When rendering the audio data externally, the embodiment of the present application incorporates the device parameters of the terminal device (speaker distance) and the listening distance customized by the user of the terminal device, so that the audio data after the sound field expansion not only fits the terminal device itself, but also can expand the sound field of the audio data according to different listening distances. For the user, it can realize the positioning of the sound, thereby improving the external playback effect of the audio data.

[0077] Please refer to Figure 5 , which shows a flowchart of a method for externally playing and rendering audio data provided by another embodiment of the present application. The execution subject of each step of the method may be Figure 1 The terminal device 10 in the implementation environment of the scheme shown, for example, the execution subject of each step can be the client of the target application. In the following method embodiment, for the convenience of description, only the execution subject of each step is introduced as the "client". The method can include at least one of the following steps (510-580):

[0078] Step 510, obtaining the sound field configuration parameters customized by the user of the terminal device, the sound field configuration parameters including the speaker distance and the listening distance, the speaker distance refers to the distance between the two speakers of the terminal device, and the listening distance refers to the distance between the user and the terminal device.

[0079] In some embodiments, the sound field expansion parameters are determined through the following steps 520 to 560. Before explaining the following steps, some theories are explained in conjunction with the accompanying drawings.

[0080] refer to Figure 6 , which shows a schematic diagram of crosstalk cancellation. Sound field expansion consists of crosstalk cancellation and space enhancement. Signal source S = [S 1 ; S 2 ] respectively through the pre-correction filter network C = [C 11 ,C 12 ; C 21 ,C 22 ] sent to two speakers (T 1 and T 2 ), the sound signal played by the loudspeaker propagates through space (assuming that the propagation system is linear, the transfer function H = [H 11 ,H 12 ;H 21 ,H 22 ]), H is superimposed and received at both ears, which is R = [R 1 ; R 2 ]. At this time, the above signal quantities have the following linear relationship:

[0081]

[0082] If the pre-correction filter network C satisfies the following relationship, it can ensure that the received R is consistent with the played S, achieve left-right ear crosstalk elimination, and expand the stereo sound field.

[0083]

[0084] The spatial sense of sound heard by the human ear is closely related to the time-frequency correlation spectrum of the binaural audio signal. The spatial enhancement part further enhances the spatial sense of the binaural audio signal by introducing binaural time-frequency correlation spatial reverberation. Figure 7 , which shows a schematic diagram of single-channel audio spatial enhancement. The single-channel signal is passed through two time-frequency correlation filters obtained by time-frequency processing of the noise signal, and the output is a spatially enhanced two-channel audio. Among them, U(z) and V(z) are time-frequency correlation filters, which can be determined by the time-frequency correlation spectrum Φ(ω), which can usually be selected as the binaural impulse response of the room or other time-frequency correlation spectra with good spatial sense:

[0085]

[0086]

[0087] In the external speaker scenario, assuming S 1 The corresponding spatial enhancement filter is E 11 and E 12 , S 2 The corresponding spatial enhancement filter is E 21 and E 22 , spatial enhancement processing results:

[0088]

[0089] Considering the transmission model, the signal heard by both ears is R' = [R 1 '; R 2 '], the results are as follows:

[0090]

[0091] A pre-correction filter network is introduced to eliminate crosstalk, and the results are as follows:

[0092]

[0093] The formula satisfied by the pre-correction filter network C is as follows:

[0094]

[0095] Directly solving formula 8 can obtain C. Using the obtained C, crosstalk elimination of the input audio can be achieved. Using a spatial enhancement filter, spatial enhancement of the input audio can be achieved. In other embodiments, C is calculated by an iterative algorithm, which has a lower implementation cost.

[0096] In some embodiments, the sound field expansion parameters include a spatial enhancement parameter and a correction parameter, the spatial enhancement parameter is used to perform spatial enhancement on the audio data, and the correction parameter is used to perform crosstalk elimination on the audio data. Optionally, the spatial enhancement parameter corresponds to the above-mentioned spatial enhancement filter E 11 and E 12 , and the spatial enhancement filter is E 21 and E 22 , that is Optionally, the correction parameters correspond to the parameters of the pre-correction filter network C, that is,

[0097] Step 520 , initializing the calibration parameters and acquiring a simulated input signal, where the simulated input signal is audio data provided by the first application program and simulated for determining the sound field expansion parameters.

[0098] In some embodiments, the correction parameters are initialized, that is, the parameters of the pre-correction filter network C are initialized to ensure that the energy of C is less than the set value G. Optionally, the analog input signal is a Dirac signal, and after binaural processing of the Dirac signal, the above S is obtained. 1 and S 2 .

[0099] Step 530, determining simulation transmission parameters according to the speaker distance, the listening distance and the head-related transfer function, wherein the simulation transmission parameters are used to simulate signal transmission parameters in the process of transmitting audio data played by the speaker of the terminal device to the user.

[0100] Head Related Transfer Function (HRTF): It is a sound localization processing technology. The signal transmitted to the human ear (in front of the eardrum) from any point in space can be described by a filtering system. The sound source + filter obtains the sound signal in front of the eardrums of both ears. This transmission system is a black box. You don’t have to worry about how the sound is transmitted to the two ears, but only the difference between the sound source and the binaural signal. If you get this set of filters (transfer functions) that describe the spatial information, that is, HRTF, you can restore the sound signal from this direction in the space (such as through binaural headphones). If there is a filter group from all directions in the space to the two ears, you can get a filter matrix to restore the sound signal from the entire spatial direction. In some embodiments, the speaker distance and listening distance are input into the HRTF function to obtain the transmission model H. In some embodiments, the signal transmission parameter is the transfer function H=[H 11 ,H 12 ;H 21 ,H 22 ].

[0101] Step 540, determining a simulated received signal according to the simulated input signal, the calibration parameter, the spatial enhancement parameter, and the simulated transmission parameter, wherein the simulated received signal refers to the audio data received by the simulated user.

[0102] In some embodiments, the spatial enhancement parameters may be pre-generated according to Formula 8. In some embodiments, when the simulated input signal, the correction parameters, the spatial enhancement parameters, and the simulated transmission parameters are known, the simulated received signal and are determined.

[0103] Step 550: When the analog received signal does not satisfy the first condition or the correction parameter does not satisfy the second condition, the correction parameter is adjusted, the adjusted correction parameter is updated as the correction parameter, and the analog received signal is recalculated.

[0104] In some embodiments, in order to enhance the causality of the system and reduce the coloration and echo problems introduced by spatial enhancement: the first condition is to simulate the time domain and frequency domain constraints of the received signal. On the one hand, the time domain constraint output signal (simulated received signal) requires that the reverberation part of the time domain curve should be below the reverberation masking threshold of the human ear, as shown in the following example: Figure 8 800. Direct sound pre-masking constraint: the waveform threshold reached before the direct sound is lower than -60dB; at the time t0 of the direct sound arrival, no constraints are set within the time range of 4ms; post-reverberation masking constraint: the direct sound is not higher than -10dB 4ms after t0 and not higher than -70dB after 200ms, and the range in between follows an exponential decay trend. On the other hand, the frequency domain constrains the output signal, requiring its spectrum to have a smooth and flat spectrum.

[0105] In some embodiments, the second condition is that the energy value of the pre-correction filter network corresponding to the correction parameter is lower than the threshold G. In some embodiments, the filter corresponds to a unit impulse response, and the energy corresponding to the filter can be calculated using the impulse response. The energy value is the sum of the squares of the signal amplitudes.

[0106] Step 560: When the simulated received signal satisfies the first condition and the correction parameter satisfies the second condition, stop adjusting the correction parameter and determine the space enhancement parameter and the correction parameter as the sound field expansion parameter.

[0107] In some embodiments, an optimization algorithm is used to iteratively search the pre-correction filter network C (correction parameters). When the simulated received signal meets the first condition and the correction parameters meet the second condition, the iteration is stopped and the spatial enhancement parameters and the correction parameters are determined as sound field expansion parameters.

[0108] like Fig. 9 900, which shows the process of parameter prediction. Fig.10 1000 shows the parameter iteration process. First, the sound field transmission model H is calculated according to the listening distance, speaker width, and HRTF function (which can be built-in or externally input) set by the user. The spatial enhancement filter E can be generated in advance. Using H and E, according to Formula 6, the optimization algorithm is used to iteratively search the filter C for setting the sound field expansion filter.

[0109] Step 570: Perform sound field expansion on the audio data according to the sound field expansion parameters to obtain audio data after the sound field expansion.

[0110] In some embodiments, when the spatial enhancement parameters and the correction parameters are known, Calculate the audio data after the sound field is expanded. Represents binauralized audio data.

[0111] The following explains how to perform sound field expansion on audio data according to the sound field expansion parameters to obtain the audio data after the sound field expansion.

[0112] In some embodiments, the spatial type of the audio data is determined; when the spatial type of the audio data is two-dimensional audio, the first type of audio data in the audio data is multiplied by the product of the correction parameters and the spatial enhancement parameters, and the second type of audio data in the audio data is added to obtain audio data with expanded sound field; when the spatial type of the audio data is three-dimensional audio, effect sounds are distributed to the audio data to obtain dry sound data and wet sound data; the wet sound data is multiplied by the product of the correction parameters and the spatial enhancement parameters, and the dry sound data is added to obtain audio data with expanded sound field.

[0113] In some embodiments, there are multiple groups of audio data in the audio, and the audio type of each group of audio data is determined, and different sound field expansion methods are used for different types of audio data.

[0114] In some embodiments, the spatial type of audio data includes a two-dimensional type and a three-dimensional type, wherein the two-dimensional type can be considered as an audio data type that does not require a sense of azimuth, and the three-dimensional type can be considered as an audio data type that requires a sense of azimuth.

[0115] In some embodiments, the first type of audio data in the 2D (Two-dimensional) audio data may be considered as conventional stereo, and the second type of audio data in the 2D audio data may be considered as stereo with a virtual space effect. Fig.11 As shown, 1100 shows that when the spatial type of the audio data is 2D audio data, the stereo with virtual spatial effect is multiplied by the correction parameters and the spatial enhancement parameters (that is, after spatial enhancement filtering and crosstalk elimination), and the conventional stereo in the 2D audio data is mixed to obtain audio data after sound field expansion. When the spatial type of the audio data is 3D audio data, the audio data is distributed with effect sound to obtain dry sound data and wet sound data; the wet sound data is multiplied by the correction parameters and the spatial enhancement parameters (that is, after spatial enhancement filtering and crosstalk elimination), and the dry sound data is added to obtain audio data after sound field expansion.

[0116] The following explains how to assign effect sounds to audio data.

[0117] In some embodiments, an expansion intensity is obtained, where the expansion intensity is a user-defined audio intensity that the user desires to hear; based on the expansion intensity, a distribution ratio of wet sound data in the audio data is determined, where the distribution ratio is the proportion of wet sound data in the audio data; the product of the audio data and the distribution ratio is determined as wet sound data; and data in the audio data other than the wet sound data is determined as dry sound data.

[0118] In some embodiments, the expansion intensity is also a parameter set by the user. For details on how to set it, please refer to the explanation of the above embodiments. In some embodiments, the effect sound distribution is to distribute the wet sound and participate in the sound field expansion. In some embodiments, the sound field expansion will cause a virtual sound image position offset for the 3D audio. In order to achieve a gradual change in the sound field expansion intensity effect at different distances, that is, the near field is small and gradually increases with the distance. The effect sound needs to be calculated according to the 3D audio distance, such as Fig.10As shown, the part of the audio participating in the sound field expansion filtering is wet sound (the audio with virtual space effect in 2D audio is directly input into the crosstalk cancellation model (sound field expansion processing model) for processing and does not participate in the distribution), and is mixed with the directly output dry sound part to output stereo audio. The dry-wet distribution ratio related to distance is 0-1. As Fig.12 shown, it shows a schematic diagram of the effect sound distribution. The closer the distance, the smaller the distribution coefficient. The greater the distance, the greater the distribution coefficient, and the maximum value is the expansion intensity A. The user can set the expansion intensity to determine the overall sound field expansion effect, and the maximum value is 1. Assuming the input signal is S and the dry sound ratio is r, 0 < r < 1, then the dry sound signal D = S * r, and the wet sound signal W = S * (1 - r). Optionally, the dry sound ratio is determined based on the above distribution ratio. Optionally, the dry sound ratio is equal to 1 - the distribution ratio.

[0119] Step 580, determine the audio data to be externally played through the speaker of the terminal device according to the audio data after sound field expansion.

[0120] As Fig.13 shown in 1300, the sound field expansion method provided by this application includes a sound field expansion model and a sound field expansion filtering. The sound field expansion model is responsible for calculating the model filtering parameters, and the user can input the listening distance and speaker width to adjust the model effect. The sound field expansion filtering is responsible for the effect processing. The wet sound part of the input audio enters the sound field expansion processing and is mixed with the dry sound part to form the output result. The input sound can be divided into two parts according to the distribution ratio, for example, each takes half. The dry sound part is understood as not requiring sound field expansion processing, while the wet sound part is understood as requiring sound field expansion processing. The output result is the dry sound part + the wet sound part.

[0121] The technical solution provided by the embodiments of this application expands the sound from inside the screen to the outside through external sound field expansion, with better layering and stronger overall positioning. The user can adjust the expansion effect according to the size of the external device, the listening distance, and the expansion intensity.

[0122] Please refer to Fig.14 , which shows a flowchart of an external rendering method for audio data provided by another embodiment of this application. The execution subject of each step of this method can be Figure 1 the terminal device 10 in the implementation environment of the solution shown, such as the execution subject of each step can be the client of the target application. In the following method embodiments, for the convenience of description, only the execution subject of each step being "client" is introduced and described. This method may include at least one of the following steps (1410~1470):

[0123] Step 1410, obtaining the sound field configuration parameters customized by the user of the terminal device, the sound field configuration parameters including the speaker distance and the listening distance, the speaker distance refers to the distance between the two speakers of the terminal device, and the listening distance refers to the distance between the user and the terminal device.

[0124] Step 1420: Determine sound field expansion parameters according to the sound field configuration parameters, where the sound field expansion parameters are parameters used to expand the sound field of the audio data of the first application.

[0125] Step 1430: Perform sound field expansion on the audio data according to the sound field expansion parameters to obtain audio data after the sound field expansion.

[0126] Step 1440: Acquire the style configuration parameters customized by the user, where the style configuration parameters are used to indicate the audio effects that the user expects to hear.

[0127] In some embodiments, the style configuration parameter may be a timbre style. Specifically, the timbre style includes but is not limited to bright, cheerful, heavy bass, and the like. Optionally, different timbre styles correspond to different frequency responses. In some embodiments, frequency response is used in electronics to describe the difference in an instrument's ability to process signals of different frequencies. Like distortion, this is also a very important parameter indicator. Frequency response, also known as a response curve, refers to the curve of gain variation with frequency. Any audio device or carrier (an object that records sound signals) has its frequency response curve. An ideal frequency response curve should be flat, and no distortion should be generated after the sound signal passes through.

[0128] Step 1450: Determine a frequency band adjustment parameter according to the style configuration parameter. The frequency band adjustment parameter refers to a parameter for adjusting the gain of audio data in different frequency bands.

[0129] The following explains how to configure parameters according to style and determine frequency band adjustment parameters.

[0130] In some embodiments, a device frequency response of a terminal device and a set frequency response corresponding to a style configuration parameter are obtained, where the device frequency response refers to the gains of the terminal device corresponding to audio data in different frequency bands, and the set frequency response is a pre-set gain corresponding to audio data in different frequency bands; and the difference between the set frequency response and the device frequency response is determined as a frequency band adjustment parameter.

[0131] For example, the gain of the target timbre style for the target frequency band is k1, and the gain of the terminal device for the target frequency band is k2, and k2 is different from k1, then the frequency band adjustment parameter of the terminal device is set to k1-k2. The frequency response of the terminal device plus the frequency band adjustment parameter is added to obtain the frequency response corresponding to the timbre style.

[0132] In some embodiments, two different sets of standard signals are obtained, and the output signals obtained by the standard signals passing through the speakers are the measurement signals; the measurement signals corresponding to the standard signals are collected through the microphone of the terminal device; the influence value of the speaker on the device frequency response is determined based on the difference between the measurement signals corresponding to the two different sets of standard signals and the difference between the two different sets of standard signals; the difference between the original device frequency response of the terminal device and the influence value is determined as the device frequency response of the terminal device.

[0133] The frequency response and audio content of the terminal device's external speaker will affect the actual listening effect of the external speaker. The goal of frequency band adjustment is to ensure that the listening effect of the played audio meets the sound design goal, and to support users to make adjustments by setting the tone style. This part includes external speaker frequency response measurement and frequency band adjustment. In order to simplify the frequency band representation and processing, the listening range can be divided into N frequency bands, where N is a positive integer.

[0134] Ideally, the frequency response curve of a speaker should be a straight line, but in reality, each speaker will have differences. The present application also proposes an automatic measurement method to estimate the frequency response curve of an external speaker. Fig.15 As shown in 1500, the system plays a standard audio signal through a signal generator, and then uses the mobile phone microphone to collect the played audio signal. The standard audio and the collected audio signal are input into the frequency response estimation model to estimate the frequency response curve of the external speaker, and calculate the frequency response corresponding to N frequency bands, which is expressed as D = [D 0 , …, D N-1 In some other embodiments, the original device frequency response of the terminal device may also be directly input to provide a default configuration.

[0135] like Fig.16 1600, which shows the measurement process of frequency response. The measurement process uses a swept frequency signal and is divided into two measurements. The first signal s1 has an amplitude of A1, and the segmented representation of the s1 amplitude spectrum is S1 = [S1 0 ,…,S1 N-1 The amplitude of the second measured signal s2 is A2, and the segmented representation of the s2 amplitude spectrum is S2 = [S2 0 , …, S2 N-1 Each signal playback process is continued for multiple times to ensure that the complete measurement signal is collected. The signals obtained from the two acquisitions are s1' and s2', and the frequency band corresponding to s1' is represented by S1' = [S1 0 ', ..., S1 N-1 '], the frequency band corresponding to s2' represents S2' = [S2 0 ', ..., S2 N-1 D' is the estimated normalized frequency response curve D' = [D 0 ', ..., D N-1 '], the variable value calculation formula is shown in formula 9:

[0136]

[0137] In some embodiments, considering the error in actual measurement, maximum and minimum value constraints are added to each frequency band to ensure that the result is within a reasonable range.

[0138] In some embodiments, the frequency response curve of the speaker directly in front of the screen can be considered as a standard curve, and thus the standard normalized frequency response curve at the speaker hole can be determined according to measurement as H = [H 0 , …, H N-1 Therefore, the device frequency response adjustment value H'=[H 0 -D 0 ', ..., H N-1 -D N-1 '].

[0139] In some embodiments, two different sets of standard signals (s1 and s2) are obtained, and the output signals obtained by the standard signals through the speakers are measurement signals (s1' and s2'); the measurement signals corresponding to the standard signals are collected through the microphone of the terminal device; the influence value (variable value) of the speaker on the device frequency response is determined according to the difference between the measurement signals corresponding to the two different sets of standard signals and the difference between the two different sets of standard signals; the difference between the original device frequency response of the terminal device and the influence value (device frequency response adjustment value H') is determined as the device frequency response of the terminal device. That is, the device frequency response of the terminal device is adjusted to minimize the frequency response error or frequency response loss caused by the speaker or other factors.

[0140] Step 1460: Determine the audio data after the frequency band is adjusted according to the frequency band adjustment parameter and the audio data after the sound field expansion.

[0141] In some embodiments, the audio data after the sound field expansion is processed according to the device frequency response and the frequency band adjustment parameters to obtain the audio data after the frequency band adjustment.

[0142] In some embodiments, the user can select different timbre styles, and each timbre style corresponds to a different preset normalized frequency response curve T=[T 0 ,…,T N-1 Considering the frequency response of the device, the equalizer frequency band is adjusted to P = [T 0 +H 0 ', ..., T N-1 +H N-1 ']. The input audio is processed by the equalizer to obtain the output audio.

[0143] Step 1470: Determine the audio data to be played out through the speaker of the terminal device according to the audio data after the frequency band is adjusted.

[0144] The technical solution provided by the embodiment of the present application supports automatic frequency response measurement and timbre type selection of external speakers, and optimizes the playback performance of different devices. Users can select the timbre type to adjust the audio playback performance.

[0145] Please refer to Fig.17 , which shows a flowchart of a method for externally playing and rendering audio data provided by another embodiment of the present application. The execution subject of each step of the method may be Figure 1 The terminal device 10 in the implementation environment of the scheme shown, for example, the execution subject of each step can be the client of the target application. In the following method embodiment, for the convenience of description, only the execution subject of each step is introduced as the "client". The method can include at least one of the following steps (1710-1770):

[0146] Step 1710, obtaining the sound field configuration parameters customized by the user of the terminal device, the sound field configuration parameters including the speaker distance and the listening distance, the speaker distance refers to the distance between the two speakers of the terminal device, and the listening distance refers to the distance between the user and the terminal device.

[0147] Step 1720: Determine sound field expansion parameters according to the sound field configuration parameters, where the sound field expansion parameters are parameters used to expand the sound field of the audio data of the first application.

[0148] Step 1730: Perform sound field expansion on the audio data according to the sound field expansion parameters to obtain audio data after the sound field expansion.

[0149] Step 1740, obtaining the space configuration parameters customized by the user, the space configuration parameters include the space area and the space effect value, the space area refers to the area of ​​the space where the terminal device is located, and the space effect value refers to the space effect that the user expects to hear.

[0150] In some embodiments, the space size (space area) is divided into multiple levels, and the level value is used to characterize the space area. Optionally, the value of the space size is a positive integer. Optionally, the space strength (space effect value) is within the range of 0.0-1.0.

[0151] Step 1750: Determine spatial effect rendering parameters according to the spatial configuration parameters, where the spatial effect rendering parameters are parameters used to perform spatial effect rendering on the audio data. In some embodiments, there is a corresponding relationship between the spatial configuration parameters and the spatial effect rendering parameters, and when the spatial configuration parameters are uniquely determined, the spatial effect rendering parameters are also uniquely determined.

[0152] In some embodiments, the spatial effect rendering parameters include the reverberation time (TR60) corresponding to each frequency band and the gain (frequency response) corresponding to each frequency band. In some embodiments, an analog signal satisfying the third condition is obtained, and the subband signals corresponding to each frequency band are determined based on the analog signal; the analog spectrum curve of the reverberation signal in the space is calculated according to the space area and the spatial effect value, and the attenuation curve of the analog signal in the space with distance and frequency, and the reverberation signal is a signal obtained by mixing the analog signal after being reflected in the space; according to the spectrum curve of the reverberation signal, the gain corresponding to each frequency band is adjusted to obtain the adjusted gain corresponding to each frequency band; according to the subband signals corresponding to each frequency band, the reverberation time corresponding to each frequency band is determined, and for a target frequency band, the difference between the gain corresponding to the target frequency band when the target frequency band reaches the reverberation time corresponding to the target frequency band and the gain corresponding to the target frequency band is greater than a threshold; the adjusted gain corresponding to each frequency band and the reverberation time corresponding to each frequency band are determined as the spatial effect rendering parameters, and the spectrum curve obtained after the analog signal is processed by the adjusted gain corresponding to each frequency band and the reverberation time corresponding to each frequency band is the same as the analog spectrum curve. Optionally, the third condition is a Gaussian noise signal corresponding to the maximum value of the multi-band RT60 (reverberation time).

[0153] The following is a specific explanation of the audio data being the game sound effects. In the design of game sound effects, dry sounds with less reverberation or reverberation that matches the scene in the game are more commonly used. When game players experience audio, the spatial reverberation effect they feel deviates from the reverberation scene in the real room they are in. When the game player's personal spatial listening preferences, or the spatial reverberation of the environment they are in, are consistent with the spatial effects of the game sound effects, the immersive experience of the game external rendering can be further enhanced.

[0154] The function of the spatial effect module allows users to customize the corresponding reverberation effect to improve the overall audio space performance. Fig.18 As shown in 1800, users can select the corresponding spatial intensity according to their own listening preferences or the space they are in, including the corresponding space size and effect strength. The module calculates the appropriate spatial reverberation parameter RT60 and frequency band EQ (Equalizer), and generates the corresponding spatial reverberation filter. The input audio signal is processed by the spatial effect filter to achieve the goal of adjusting the spatial reverberation.

[0155] Based on the given RT60 and frequency band EQ, the process of generating spatial reverberation filter parameters is as follows: 1) Adjust the adaptive multi-band RT60. Use a signal generator to generate a Gaussian noise signal corresponding to the maximum value in the multi-band RT60; pass this signal through the multi-band filter group to obtain its corresponding sub-band signal; for each sub-band signal, periodic repetition is performed in the time domain according to the overlap time t0 and the exponential decay gain curve to obtain the RT60 of the corresponding frequency band. The overlap time t0 is usually 1 / 2-1 / 4 of the frame length, and the exponential decay curve must ensure that the gain of the signal at the corresponding moment of RT60 in this frequency band is attenuated to -60dB. 2) Adjust the adaptive time-frequency equalization EQ. According to the preset space size, the spectrum curve of each frame in the reverberation in the air is calculated based on the attenuation curve of sound propagation in the air with distance and frequency; for each sub-band signal, the corresponding EQ is performed in each frame so that the frequency response of the reverberation in each frame matches the above spectrum curve.

[0156] Step 1760: Determine the audio data after spatial effect rendering according to the spatial effect rendering parameters and the audio data after the sound field expansion.

[0157] Step 1770: Determine the audio data to be played out through the speaker of the terminal device based on the audio data rendered with spatial effects.

[0158] In some embodiments, the audio data rendered with spatial effects is determined as audio data played outwardly through a speaker of a terminal device. In some embodiments, the audio data rendered with spatial effects is further determined as audio data played outwardly through a speaker of a terminal device through frequency band adjustment.

[0159] The embodiment of the present application adjusts the overall spatial effect of the sound on the basis of the sound field expansion to enhance the immersiveness of the audio atmosphere. Users can adjust the spatial hearing effect of the external sound according to their preferences, which reflects the flexibility and user participation of the external rendering.

[0160] Please refer to Fig.19 , which shows a flowchart of a method for externally playing and rendering audio data provided by another embodiment of the present application. The execution subject of each step of the method may be Figure 1 The terminal device 10 in the implementation environment of the scheme shown, for example, the execution subject of each step can be the client of the target application. In the following method embodiment, for the convenience of description, only the execution subject of each step is introduced as the "client". The method can include at least one of the following steps (1910-1999):

[0161] Step 1910, obtaining the sound field configuration parameters customized by the user of the terminal device, the sound field configuration parameters including the speaker distance and the listening distance, the speaker distance refers to the distance between the two speakers of the terminal device, and the listening distance refers to the distance between the user and the terminal device.

[0162] Step 1920: Determine sound field expansion parameters according to the sound field configuration parameters, where the sound field expansion parameters are parameters used to expand the sound field of the audio data of the first application.

[0163] Step 1930: Perform sound field expansion on the audio data according to the sound field expansion parameters to obtain audio data after the sound field expansion.

[0164] Step 1940, obtaining the space configuration parameters customized by the user, the space configuration parameters include the space area and the space effect value, the space area refers to the area of ​​the space where the terminal device is located, and the space effect value refers to the space effect that the user expects to hear.

[0165] Step 1950: Determine spatial effect rendering parameters according to the spatial configuration parameters. The spatial effect rendering parameters are parameters used to perform spatial effect rendering on the audio data.

[0166] Step 1960: Determine the audio data after spatial effect rendering according to the spatial effect rendering parameters and the audio data after sound field expansion.

[0167] Step 1970, obtaining the style configuration parameters customized by the user, where the style configuration parameters are used to indicate the audio effects that the user expects to hear.

[0168] Step 1980: Determine a frequency band adjustment parameter according to the style configuration parameter. The frequency band adjustment parameter refers to a parameter for adjusting the gain of audio data in different frequency bands.

[0169] Step 1990: Determine the audio data after the frequency band is adjusted according to the frequency band adjustment parameters and the audio data rendered with the spatial effect.

[0170] Step 1999: The audio data after the frequency band adjustment is used as the audio data to be played outwardly through the speaker of the terminal device.

[0171] like Fig. 202000, which shows an external rendering method provided by an embodiment of the present application. According to the spatial type corresponding to the audio object (audio data), the input audio data is processed: 3D audio uses the object audio for spatial rendering processing, converted into an intermediate format (such as Ambisonics, or 7.1 and other multi-channel formats), and outputs stereo after passing through the binaural module (converting multiple channel formats into a dual-channel format output, generally implemented by HRTF function). Non-3D audio is directly processed and output in stereo. The stereo after spatial rendering and direct stereo (2D audio does not require spatial rendering, directly skips the spatial rendering module, called direct stereo) enter the external rendering module, which includes three modules: sound field expansion, spatial effect and frequency response adjustment. First, part of the audio enters the sound field expansion module for processing, and the expanded audio is then mixed with the audio that does not need to be processed and output. The set listening distance, speaker width and the provided HRTF database (an existing database containing the transfer function of the sound source from different angles to the left and right of the person, generally stored in .wav format) are used together for the crosstalk elimination model calculation model parameters of the sound field expansion. After the sound field expansion and unprocessed audio are mixed, the spatial effect is superimposed according to the set spatial strength, including the size of the space and the strength of the effect. Finally, the frequency band is adjusted according to the set frequency band target. The frequency band target is determined by the frequency response of the device and the set timbre style. After processing, the target stereo audio is output.

[0172] The external speaker rendering system proposed in the embodiment of the present application includes three functions: sound field expansion, spatial effect and frequency band adjustment. It optimizes the performance of game audio playback in external speaker scenarios in terms of the three dimensions of sound field width expansion, spatial hearing and timbre adjustment for the game sound effect experience. This case also supports users to adjust and customize audio effects according to actual conditions and preferences. The embodiment of the present application improves the external listening and positioning experience of game audio through adjustable external sound field expansion effects, superimposes customized spatial effects to enhance the immersiveness of the game atmosphere, supports automatic measurement of the external frequency response of mobile devices and selection of timbre style rendering, and optimizes the performance of game audio on different mobile devices. Since the external speaker rendering system processes hardware differences and supports effect customization, game audio designers do not need to consider hardware differences too much, thereby improving the work efficiency of audio designers. For equipment manufacturers, there is no need to do too much audio processing for game external speaker scenarios, thereby reducing the production cost of equipment.

[0173] The following is an embodiment of the device of the present application, which can be used to execute the embodiment of the method of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the method of the present application.

[0174] Please refer to Fig.21, which shows a block diagram of an external rendering device for audio data provided by an embodiment of the present application. The device has the function of implementing the above method example, and the function can be implemented by hardware, or by hardware executing corresponding software. The device can be the terminal device described above, or it can be set in the terminal device. Fig.21 As shown, the device 2100 may include: a parameter acquisition module 2110 , a parameter determination module 2120 , a sound field expansion module 2130 and an audio determination module 2140 .

[0175] The parameter acquisition module 2110 is used to obtain the sound field configuration parameters customized by the user of the terminal device, and the sound field configuration parameters include speaker distance and listening distance. The speaker distance refers to the distance between the two speakers of the terminal device, and the listening distance refers to the distance between the user and the terminal device.

[0176] The parameter determination module 2120 is used to determine a sound field expansion parameter according to the sound field configuration parameter, where the sound field expansion parameter is a parameter used to expand the sound field of the audio data of the first application.

[0177] The sound field expansion module 2130 is used to perform sound field expansion on the audio data according to the sound field expansion parameters to obtain audio data after sound field expansion.

[0178] The audio determination module 2140 is used to determine the audio data played externally through the speaker of the terminal device according to the audio data after the sound field expansion.

[0179] In some embodiments, the sound field extension parameters include space enhancement parameters and correction parameters, the space enhancement parameters are used to perform spatial enhancement on the audio data, and the correction parameters are used to perform crosstalk elimination on the audio data.

[0180] In some embodiments, Fig. 22 As shown, the parameter determination module 2120 includes an initialization unit 2121 , a parameter determination unit 2122 , a signal simulation unit 2123 and a parameter adjustment unit 2124 .

[0181] The initialization unit 2121 is used to initialize the correction parameters and obtain a simulated input signal, where the simulated input signal is audio data provided by the first application program and simulated for determining the sound field expansion parameters.

[0182] The parameter determination unit 2122 is used to determine the simulation transmission parameters according to the speaker distance, the listening distance and the head-related transfer function, and the simulation transmission parameters are used to simulate the signal transmission parameters in the process of transmitting the audio data played by the speaker of the terminal device to the user.

[0183] The signal simulation unit 2123 is used to determine a simulated received signal according to the simulated input signal, the correction parameter, the spatial enhancement parameter and the simulated transmission parameter, wherein the simulated received signal refers to the simulated audio data received by the user.

[0184] The parameter adjustment unit 2124 is used to adjust the correction parameter when the analog received signal does not meet the first condition or the correction parameter does not meet the second condition, update the adjusted correction parameter to the correction parameter, and recalculate the analog received signal.

[0185] The parameter determination unit 2122 is further configured to stop adjusting the correction parameter and determine the space enhancement parameter and the correction parameter as the sound field expansion parameter when the analog received signal satisfies the first condition and the correction parameter satisfies the second condition.

[0186] In some embodiments, Fig. 22 As shown, the sound field extension module 2130 includes a type determination unit 2131 and a sound field extension unit 2132 .

[0187] The type determination unit 2131 is configured to determine the spatial type of the audio data.

[0188] The sound field expansion unit 2132 is used to add the product of the first type of audio data in the audio data, the correction parameter and the spatial enhancement parameter to the second type of audio data in the audio data, so as to obtain the audio data after the sound field expansion when the spatial type of the audio data is two-dimensional audio.

[0189] The sound field expansion unit 2132 is also used to, when the spatial type of the audio data is three-dimensional audio, perform effect sound on the audio data to obtain dry sound data and wet sound data; multiply the wet sound data by the correction parameter and the spatial enhancement parameter, and add the dry sound data to obtain the audio data after the sound field expansion.

[0190] In some embodiments, the sound field expansion unit 2132 is also used to obtain expansion intensity, where the expansion intensity is the audio intensity that the user customizes and expects to hear; based on the expansion intensity, determine the distribution ratio of the wet sound data in the audio data, where the distribution ratio is the proportion of the wet sound data in the audio data; multiply the audio data by the distribution ratio to determine the wet sound data; and determine the data in the audio data other than the wet sound data to be the dry sound data.

[0191] In some embodiments, the parameter acquisition module 2110 is further used to acquire style configuration parameters customized by the user, where the style configuration parameters are used to indicate the audio effects that the user expects to hear.

[0192] In some embodiments, Fig. 22 As shown, the audio determination module 2140 also includes a frequency band adjustment unit 2141 and an audio determination unit 2142 .

[0193] The parameter determination module 2120 is further configured to determine a frequency band adjustment parameter according to the style configuration parameter, wherein the frequency band adjustment parameter refers to a parameter for adjusting the gain of the audio data in different frequency bands.

[0194] The frequency band adjustment unit 2141 is used to determine the audio data after the frequency band is adjusted according to the frequency band adjustment parameters and the audio data after the sound field expansion.

[0195] The audio determination unit 2142 is used to determine the audio data played through the speaker of the terminal device according to the audio data after the frequency band is adjusted.

[0196] In some embodiments, the frequency band adjustment unit 2141 is used to obtain a device frequency response of the terminal device and a set frequency response corresponding to the style configuration parameter, the device frequency response refers to the gains of the terminal device corresponding to the audio data in different frequency bands, and the set frequency response is a pre-set gain corresponding to the audio data in different frequency bands; and the difference between the set frequency response and the device frequency response is determined as the frequency band adjustment parameter.

[0197] In some embodiments, the frequency band adjustment unit 2141 is also used to obtain two groups of different standard signals, and the output signal obtained by the standard signal after passing through the speaker is the measurement signal; the measurement signal corresponding to the standard signal is collected by the microphone of the terminal device; according to the difference between the measurement signals corresponding to the two groups of different standard signals and the difference between the two groups of different standard signals, the influence value of the speaker on the device frequency response is determined; the difference between the original device frequency response of the terminal device and the influence value is determined as the device frequency response of the terminal device.

[0198] In some embodiments, the parameter acquisition module 2110 is also used to obtain the space configuration parameters customized by the user, and the space configuration parameters include a space area and a space effect value. The space area refers to the area of ​​the space where the terminal device is located, and the space effect value refers to the space effect that the user expects to hear.

[0199] In some embodiments, Fig. 22As shown, the audio determination module 2140 also includes a spatial rendering unit 2143 .

[0200] The parameter determination module 2120 is further configured to determine a spatial effect rendering parameter according to the spatial configuration parameter, wherein the spatial effect rendering parameter is a parameter used for performing spatial effect rendering on the audio data.

[0201] The spatial rendering unit 2143 is used to determine the audio data after spatial effect rendering according to the spatial effect rendering parameters and the audio data after the sound field expansion.

[0202] The audio determination unit 2142 is further used to determine the audio data to be played through the speaker of the terminal device according to the audio data rendered with the spatial effect.

[0203] In some embodiments, the spatial effect rendering parameters include reverberation times corresponding to respective frequency bands and gains corresponding to respective frequency bands.

[0204] In some embodiments, the space rendering unit 2143 is used to obtain an analog signal that meets the third condition, and determine the sub-band signals corresponding to the respective frequency bands based on the analog signal; calculate the analog spectrum curve of the reverberation signal in the space according to the space area and the space effect value, and the attenuation curve of the analog signal in the space with distance and frequency, wherein the reverberation signal is a signal obtained by mixing the analog signal after being reflected in the space; adjust the gains corresponding to the respective frequency bands according to the spectrum curve of the reverberation signal to obtain the adjusted gains corresponding to the respective frequency bands; determine the reverberation time corresponding to the respective frequency bands according to the sub-band signals corresponding to the respective frequency bands, and for a target frequency band, the difference between the gain corresponding to the target frequency band when the reverberation time corresponding to the target frequency band is reached and the gain corresponding to the target frequency band is greater than a threshold; determine the adjusted gains corresponding to the respective frequency bands and the reverberation time corresponding to the respective frequency bands as the space effect rendering parameters, and the spectrum curve obtained after the analog signal is processed by the adjusted gains corresponding to the respective frequency bands and the reverberation time corresponding to the respective frequency bands is the same as the analog spectrum curve.

[0205] It should be noted that the device provided in the above embodiment, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0206] Please refer to Fig.23 , which shows a block diagram of a terminal device 2300 provided in one embodiment of the present application. The terminal device 2300 may be Figure 1 The terminal device 10 in the implementation environment shown is used to implement the external playback rendering method of audio data provided in the above embodiment. Specifically:

[0207] Typically, the terminal device 2300 includes: a processor 2301 and a memory 2302 .

[0208] The processor 2301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 2301 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field Programmable Gate Array), and PLA (Programmable Logic Array). The processor 2301 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 2301 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 2301 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0209] The memory 2302 may include one or more computer-readable storage media, which may be non-transitory. The memory 2302 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 2302 is used to store a computer program, which is configured to be executed by one or more processors to implement the above-mentioned external playback rendering method of audio data.

[0210] In some embodiments, the terminal device 2300 may further optionally include: a peripheral device interface 2303 and at least one peripheral device. The processor 2301, the memory 2302 and the peripheral device interface 2303 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 2303 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 2304, a display screen 2305, an audio circuit 2307 and a power supply 2308.

[0211] Those skilled in the art will understand that Fig.23 The structure shown in the figure does not constitute a limitation on the terminal device 2300, and may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

[0212] In an exemplary embodiment, a computer-readable storage medium is further provided, wherein a computer program is stored in the storage medium, and when the computer program is executed by a processor, the method for rendering the audio data externally is implemented.

[0213] Optionally, the computer-readable storage medium may include: ROM (Read-Only Memory), RAM (Random Access Memory), SSD (Solid State Drives) or an optical disk, etc. Among them, the random access memory may include ReRAM (Resistance Random Access Memory) and DRAM (Dynamic Random Access Memory).

[0214] In an exemplary embodiment, a computer program product is also provided, the computer program product comprising a computer program, the computer program being stored in a computer-readable storage medium. A processor of a terminal device reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the terminal device executes the above-mentioned method for external playback rendering of audio data.

[0215] It should be understood that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the order of the numbers, such as two steps with different numbers are executed at the same time, or two steps with different numbers are executed in the opposite order to the diagram. The embodiments of the present application are not limited to this.

[0216] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for external rendering of audio data, It is characterized in that The method is executed by a terminal device, a first application is running in the terminal device, and the method includes: Acquire a sound field configuration parameter customized by a user of the terminal device, wherein the sound field configuration parameter includes a speaker distance and a listening distance, wherein the speaker distance refers to the distance between two speakers of the terminal device, and the listening distance refers to the distance between the user and the terminal device; Determining a sound field expansion parameter according to the sound field configuration parameter, wherein the sound field expansion parameter is a parameter used to expand the sound field of the audio data of the first application program; Performing sound field expansion on the audio data according to the sound field expansion parameters to obtain audio data after sound field expansion; The audio data played outwardly through the speaker of the terminal device is determined according to the audio data after the sound field expansion.

2. The method according to claim 1, It is characterized in that The sound field expansion parameters include space enhancement parameters and correction parameters, the space enhancement parameters are used to perform space enhancement on the audio data, and the correction parameters are used to perform crosstalk elimination on the audio data; The step of determining the sound field expansion parameters according to the sound field configuration parameters includes: Initializing the correction parameters and acquiring a simulated input signal, where the simulated input signal is audio data provided by the first application and simulated for determining the sound field expansion parameters; Determine, according to the speaker distance, the listening distance and the head-related transfer function HRTF, a simulation transmission parameter, wherein the simulation transmission parameter is used to simulate a signal transmission parameter in a process in which the audio data played by the speaker of the terminal device is transmitted to the user; Determine a simulated received signal according to the simulated input signal, the correction parameter, the spatial enhancement parameter and the simulated transmission parameter, wherein the simulated received signal refers to simulated audio data received by the user; When the analog received signal does not satisfy the first condition, or the correction parameter does not satisfy the second condition, adjusting the correction parameter, updating the adjusted correction parameter to the correction parameter, and recalculating the analog received signal; When the simulated received signal satisfies the first condition and the correction parameter satisfies the second condition, the adjustment of the correction parameter is stopped, and the space enhancement parameter and the correction parameter are determined as the sound field expansion parameter.

3. The method according to claim 2, It is characterized in that The step of performing sound field expansion on the audio data according to the sound field expansion parameter to obtain the audio data after the sound field expansion comprises: Determining a spatial type of the audio data; When the spatial type of the audio data is two-dimensional audio, multiplying the product of the first type of audio data in the audio data, the correction parameter, and the spatial enhancement parameter, and adding the second type of audio data in the audio data to obtain the audio data after the sound field is expanded; When the spatial type of the audio data is three-dimensional audio, effect sound is allocated to the audio data to obtain dry sound data and wet sound data; the product of the wet sound data, the correction parameter and the spatial enhancement parameter is multiplied by the dry sound data to obtain the audio data after the sound field is expanded.

4. The method according to claim 3, It is characterized in that The step of performing effect sound distribution on the audio data to obtain dry sound data and wet sound data includes: Acquire an extended intensity, where the extended intensity is an audio intensity that the user desires to hear and that is set by the user; determining, according to the expansion strength, a distribution ratio of the wet sound data in the audio data, wherein the distribution ratio is a ratio of the wet sound data to the audio data; multiplying the audio data by the distribution ratio to determine the wet sound data; The data other than the wet sound data in the audio data is determined as the dry sound data.

5. The method according to claim 1, It is characterized in that The method further comprises: Acquire a style configuration parameter customized by the user, where the style configuration parameter is used to indicate an audio effect that the user expects to hear; The step of determining the audio data played outwardly through the speaker of the terminal device according to the audio data after the sound field expansion includes: Determining a frequency band adjustment parameter according to the style configuration parameter, wherein the frequency band adjustment parameter refers to a parameter for adjusting the gain of the audio data in different frequency bands respectively; Determining the audio data after the frequency band is adjusted according to the frequency band adjustment parameter and the audio data after the sound field is expanded; The audio data played outwardly through the speaker of the terminal device is determined according to the audio data after the frequency band is adjusted.

6. The method according to claim 5, It is characterized in that The determining of the frequency band adjustment parameters according to the style configuration parameters includes: Obtaining a device frequency response of the terminal device and a setting frequency response corresponding to the style configuration parameter, wherein the device frequency response refers to the gains of the terminal device corresponding to audio data in different frequency bands, and the setting frequency response is a pre-set gain corresponding to audio data in different frequency bands; The difference between the set frequency response and the device frequency response is determined as the frequency band adjustment parameter.

7. The method according to claim 6, It is characterized in that After obtaining the device frequency response of the terminal device and the setting frequency response corresponding to the style configuration parameter, the method further includes: Obtaining two sets of different standard signals, wherein output signals obtained by passing the standard signals through the loudspeaker are measurement signals; Collecting a measurement signal corresponding to the standard signal through a microphone of the terminal device; Determining the influence value of the speaker on the frequency response of the device according to the difference between the measurement signals corresponding to the two different groups of standard signals and the difference between the two different groups of standard signals; The difference between the original device frequency response of the terminal device and the impact value is determined as the device frequency response of the terminal device.

8. The method according to claim 1, It is characterized in that The method further comprises: Acquire a space configuration parameter customized by the user, wherein the space configuration parameter includes a space area and a space effect value, wherein the space area refers to the area of ​​the space where the terminal device is located, and the space effect value refers to the space effect that the user expects to hear; The step of determining the audio data played outwardly through the speaker of the terminal device according to the audio data after the sound field expansion includes: Determining a spatial effect rendering parameter according to the spatial configuration parameter, wherein the spatial effect rendering parameter is a parameter used for performing spatial effect rendering on the audio data; Determining audio data after spatial effect rendering according to the spatial effect rendering parameter and the audio data after the sound field expansion; The audio data played outwardly through the speaker of the terminal device is determined according to the audio data rendered with the spatial effect.

9. The method according to claim 8, It is characterized in that The spatial effect rendering parameters include the reverberation time corresponding to each frequency band and the gain corresponding to each frequency band; The step of determining the spatial effect rendering parameters according to the spatial configuration parameters includes: Acquire an analog signal that satisfies the third condition, and determine sub-band signals corresponding to each of the frequency bands based on the analog signal; Calculating a simulated frequency spectrum curve of a reverberation signal in the space according to the space area and the space effect value, and an attenuation curve of the simulated signal in the space with distance and frequency, wherein the reverberation signal is a signal obtained by mixing the simulated signal after being reflected in the space; According to the frequency spectrum curve of the reverberation signal, the gains corresponding to the respective frequency bands are adjusted to obtain the adjusted gains corresponding to the respective frequency bands; Determine, according to the subband signals corresponding to the respective frequency bands, the reverberation time corresponding to the respective frequency bands, wherein for a target frequency band, a difference between a gain corresponding to the target frequency band when the reverberation time corresponding to the target frequency band is reached and a gain corresponding to the target frequency band is greater than a threshold; The adjusted gains corresponding to the respective frequency bands and the reverberation times corresponding to the respective frequency bands are determined as the spatial effect rendering parameters, and a spectrum curve obtained after processing the analog signal with the adjusted gains corresponding to the respective frequency bands and the reverberation times corresponding to the respective frequency bands is the same as the analog spectrum curve.

10. An external rendering device for audio data, It is characterized in that The device comprises: a parameter acquisition module, used to acquire sound field configuration parameters customized by a user of the terminal device, wherein the sound field configuration parameters include a speaker distance and a listening distance, wherein the speaker distance refers to the distance between two speakers of the terminal device, and the listening distance refers to the distance between the user and the terminal device; A parameter determination module, used to determine a sound field expansion parameter according to the sound field configuration parameter, wherein the sound field expansion parameter is a parameter used to expand the sound field of the audio data of the first application program; A sound field expansion module, used for performing sound field expansion on the audio data according to the sound field expansion parameters to obtain audio data after sound field expansion; The audio determination module is used to determine the audio data played outwardly through the speaker of the terminal device according to the audio data after the sound field expansion.

11. A terminal device, It is characterized in that The terminal device comprises a processor and a memory, wherein a computer program is stored in the memory, and the computer program is loaded and executed by the processor to implement the method according to any one of claims 1 to 9.

12. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores a computer program, which is loaded and executed by a processor to implement the method according to any one of claims 1 to 9.

13. A computer program product, It is characterized in that The computer program product comprises a computer program, wherein the computer program is stored in a computer-readable storage medium, and a processor reads and executes the computer program from the computer-readable storage medium to implement the method according to any one of claims 1 to 9 above.

Citation Information

Cited By

  • Computer device and audio adjustment method

    TWI900375B