Sound playing method, device, apparatus and storage medium
Patent Information
- Application Number
- CN202210272427.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-18
- Publication Date
- 2026-09-22
- Estimated Expiration
- 2042-03-18
AI Technical Summary
但是一旦游戏终端设备通过其他音频播放设备(如耳机),则耳机播放的声音和游戏终端设备自身播放的声音的往往存在差异
[0009]另一方面,本申请实施例提供了一种计算机程序产品,该计算机程序产品包括计算机程序,上述计算机程序被处理器执行时实现本申请实施例提供的声音播放方法。
Smart Images

Figure CN116785710B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of audio processing technology, and in particular to a sound playback method, apparatus, device, and storage medium. Background Technology
[0002] In existing sound playback scenarios, it is often necessary to mix multiple sounds in advance before playback. For example, in game scenarios, it is necessary to mix multiple sounds such as the footsteps of virtual objects, environmental sounds, and skill release sounds so that the corresponding game device can play multiple sounds generated at the same time based on the mixed audio and video data.
[0003] Taking games as an example, such as Figure 1 As shown, in order to make the sound played on different gaming devices as consistent as possible, existing sound engines often employ different mixing strategies for different operating systems of gaming devices. However, once the gaming device is connected to other audio playback devices (such as headphones), the sound played through the headphones often differs from the sound played by the gaming device itself. Summary of the Invention
[0004] This application provides a sound playback method, apparatus, device, and storage medium, which can employ corresponding mixing strategies to mix audio data when the terminal device uses different sound playback methods, so that the sound played by the terminal device under different sound playback methods maintains a consistent listening experience and has high applicability.
[0005] On one hand, embodiments of this application provide a sound playback method, the method comprising: In response to the target terminal device accessing the sound playback scenario, the target performance configuration level of the target terminal device is determined. In response to the target performance configuration level being higher than the preset performance configuration level, the sound playback method of the target terminal device for the sound playback scenario is determined. The sound playback method includes playback based on the device speaker of the target terminal device or playback based on an audio playback device connected to the target terminal device. Based on the above sound playback method, the first mixing strategy parameters corresponding to the above target terminal device are determined, and the first mixing strategy corresponding to the above first mixing strategy parameters is determined. The above first mixing strategy is matched with the above sound playback method and the above target terminal device. Based on the first mixing strategy described above, the initial audio data of the sound playback scenario is mixed to obtain first audio data, and the first audio data is sent to the target terminal device so that the target terminal device plays the sound corresponding to the first audio data based on the sound playback method described above.
[0006] On the other hand, embodiments of this application provide a sound playback device, which includes: The method determination module is used to determine the target performance configuration level of the target terminal device in response to the target terminal device accessing the sound playback scenario, and to determine the sound playback method of the target terminal device for the sound playback scenario in response to the target performance configuration level being higher than the preset performance configuration level. The sound playback method includes playback based on the device speaker of the target terminal device or playback based on an audio playback device connected to the target terminal device. The parameter determination module is used to determine the first mixing strategy parameters corresponding to the target terminal device based on the above sound playback method, determine the first mixing strategy corresponding to the first mixing strategy parameters, and match the first mixing strategy with the above sound playback method and the target terminal device. The data processing module is used to mix the initial audio data of the sound playback scenario based on the first mixing strategy to obtain first audio data, and send the first audio data to the target terminal device so that the target terminal device plays the sound corresponding to the first audio data based on the sound playback method.
[0007] On the other hand, embodiments of this application provide an electronic device, including a processor and a memory, which are interconnected; The aforementioned memory is used to store computer programs; The processor described above is configured to execute the sound playback method provided in the embodiments of this application when the computer program described above is invoked.
[0008] On the other hand, embodiments of this application provide a computer-readable storage medium storing a computer program that is executed by a processor to implement the sound playback method provided in embodiments of this application.
[0009] On the other hand, this application provides a computer program product, which includes a computer program that, when executed by a processor, implements the sound playback method provided in this application.
[0010] Based on the sound playback method provided in this application, when the performance configuration level of the terminal device is higher than the preset performance configuration level, the mixing strategy corresponding to the terminal device playing sound through a speaker or through an audio player connected to it can be determined, and different mixing strategies can be adopted to mix the initial audio data of the same sound playback scenario. Based on this, the same mixing effect can be obtained when the target terminal device plays the sound corresponding to the same sound playback scenario through different sound playback methods, thereby ensuring that the sound of the same sound playback scenario played by the terminal device through different sound playback methods maintains a consistent listening experience and has high applicability. Attached Figure Description
[0011] To more clearly illustrate the technical solutions in the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0012] Figure 1 This is a schematic diagram illustrating an implementation of a prior art mixing strategy provided in this application. Figure 2 This is a schematic diagram of a sound playback scenario provided in an embodiment of this application; Figure 3 This is a schematic flowchart of the sound playback method provided in an embodiment of this application; Figure 4 This is a schematic diagram illustrating the correspondence between the terminal device and the audio playback device provided in the embodiments of this application; Figure 5 This is a schematic diagram of the mixing process based on the mobile phone mixing strategy provided in the embodiments of this application; Figure 6 This is a frequency response comparison diagram provided in the embodiments of this application; Figure 7 This is a schematic diagram of the mixing strategy configuration provided in the embodiments of this application; Figure 8 This is another schematic flowchart of the sound playback method provided in the embodiments of this application; Figure 9 This is a schematic diagram of a scenario for determining a mixing strategy provided in an embodiment of this application; Figure 10 This is a schematic diagram of the structure of the sound playback device provided in the embodiments of this application; Figure 11 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation
[0013] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.
[0014] See Figure 2 , Figure 2 This is a schematic diagram of a sound playback scenario provided in an embodiment of this application. For example... Figure 1 As shown, when the server 210 determines that the terminal device 220 has accessed a sound playback scene and needs to play the sound corresponding to the sound playback scene, it can determine the initial audio data corresponding to the various sounds of the current sound playback scene of the terminal device 220, and mix the initial audio data to obtain the first audio data.
[0015] Furthermore, the server 210 can send the first audio data obtained from mixing to the terminal device 220, so that the terminal device 220 can simultaneously play multiple sounds corresponding to the above-mentioned sound playback scenario based on the first audio data.
[0016] The server 210 can be a standalone physical server, a server cluster or distributed system consisting of multiple physical servers, or a cloud server providing cloud computing services. Optionally, the server 210 can also be a sound engine for mixing operations, such as the Wwise sound engine, or a cloud gaming server.
[0017] Cloud gaming, also known as gaming on demand, is an online gaming technology based on cloud computing. It enables thin clients with relatively limited graphics processing and data processing capabilities to run high-quality games. In cloud gaming, the game runs not on the terminal but on a cloud server. The cloud server renders the game scene and its corresponding mixed audio data into a video / audio stream, which is then transmitted to the terminal via the network. The terminal does not need powerful graphics processing and data processing capabilities; it only needs basic streaming media playback capabilities and the ability to receive game commands and send them to the cloud server.
[0018] The terminal device 220 may be a smartphone, tablet computer, laptop computer, desktop computer, intelligent voice interaction device (e.g., smart speaker), wearable electronic device (e.g., smartwatch), in-vehicle terminal, smart home appliance (e.g., smart TV), AR / VR device, etc., but is not limited thereto. The terminal device 220 and the server 210 may be directly or indirectly connected via wired or wireless communication, and this application does not impose any restrictions.
[0019] Taking cloud gaming as an example, server 210 can be a cloud gaming server, and terminal device 220 is a game terminal. After detecting that terminal device 220 has entered a game scene, server 210 can determine the initial audio data corresponding to the various sounds in the game scene, and mix the initial audio data to send the mixed first audio data to terminal device 220. For terminal device 220, terminal device 220 can play the sounds corresponding to the game scene based on the received first audio data, that is, it can play one or more game sounds at any given time.
[0020] For example, in a music synthesis scenario, server 210 can determine the initial audio data corresponding to various sounds that need to be synthesized, such as the initial audio data corresponding to different instruments and the initial audio data corresponding to harmony, and then mix the initial audio data and send the resulting first audio data to the music playback terminal, so that the music playback terminal can play the synthesized music based on the first audio data.
[0021] See Figure 3 , Figure 3 This is a flowchart illustrating a sound playback method provided in an embodiment of this application. Figure 3 As shown, the sound playback method provided in this application embodiment may specifically include the following steps: Step S31: In response to the target terminal device accessing the sound playback scenario, determine the target performance configuration level of the target terminal device; in response to the target performance configuration level being higher than the preset performance configuration level, determine the sound playback method of the target terminal device for the sound playback scenario.
[0022] Specifically, the target terminal devices include, but are not limited to, mobile phones, tablets, in-vehicle terminals, and laptops, etc., without any restrictions.
[0023] Among them, the sound playback method of the target terminal device for the sound playback scenario can be based on the device's speaker or based on the audio playback device connected to the target terminal device.
[0024] For example, for any sound playback scenario, the target terminal device can play the sound corresponding to the sound playback scenario through its own device speaker, or it can play the sound corresponding to the sound playback scenario through an audio playback device connected to it.
[0025] The audio playback devices connected to the target terminal device include, but are not limited to, devices with sound playback functions such as headphones and speakers, and are not restricted in this regard.
[0026] Due to the performance limitations of the target terminal device itself, parsing the mixed audio data corresponding to the sound playback scenario may increase the performance consumption of the target terminal device. Therefore, when the target terminal device accesses the sound playback scenario, the target performance configuration level of the target terminal device can be determined in advance.
[0027] A higher target performance configuration level indicates higher data processing performance of the target terminal device. This means that data processing will not consume excessive processor resources and will not affect the overall operation of the device. Conversely, a lower target performance configuration level indicates lower data processing performance. This means that data processing will consume more processor resources, potentially causing malfunctions in the device.
[0028] In determining the target performance configuration level of the target terminal device, the target performance configuration information of the target terminal device can be determined. Then, based on the preset correlation between the performance configuration information and the performance configuration level and the target performance configuration information of the target terminal device, the target performance configuration level of the target terminal device can be determined. That is, the performance configuration level corresponding to the target performance configuration information of the target terminal device can be determined, and the performance configuration level can be determined as the performance configuration level of the target terminal device.
[0029] The performance configuration information of any terminal device includes, but is not limited to, the processor information and running memory information of the terminal device, and is not restricted here.
[0030] If the target performance configuration level of the target terminal device is higher than the preset performance configuration level, it means that when mixing the initial audio data corresponding to the sound playback scenario, it is not necessary to disable mixing effects with low usage and / or high performance consumption for the target terminal device. In other words, it is not necessary to consider the impact of the high-quality audio data obtained from mixing on the device's operating performance. In this case, the sound playback method of the target terminal device for the sound playback scenario can be further determined.
[0031] In other words, when the target terminal device accesses a sound playback scenario, that is, when the target terminal needs to play the sound corresponding to the sound playback scenario, such as when the target terminal device starts a game, enters a game scene, or plays synthesized music, and the target performance configuration level of the target terminal device is higher than the preset performance configuration level, it can be determined whether the sound playback method adopted by the target terminal device when playing the sound corresponding to the sound playback scenario is through the device's speaker or based on the audio playback device connected to the target terminal device.
[0032] Specifically, if the target performance configuration level of the target terminal device is higher than the preset performance configuration level, it can be determined whether the target terminal device is connected to an audio playback device. If it is determined that the target terminal device is connected to an audio playback device, it can be determined that the target terminal device plays the sound corresponding to the sound playback scenario based on the audio device connected to the target terminal device. If it is determined that the target terminal device is not connected to an audio playback device, it can be determined that the target terminal device plays the sound corresponding to the sound playback scenario based on the device's speaker.
[0033] Specifically, when determining the sound playback method of the target terminal device for a sound playback scenario, the device connection information of the target terminal device can be obtained when the target terminal device needs to play sound. Then, based on the device connection information, it can be determined whether the target terminal device is connected to an audio playback device, and based on this, the sound playback method of the target terminal device for the sound playback scenario can be determined.
[0034] Optionally, after the target terminal device accesses sound playback, the indication information sent by the target terminal device can be determined. This indication information is used to instruct the target terminal device to play the sound corresponding to the sound playback scenario based on the device's speaker or to play the sound corresponding to the sound playback scenario through an audio playback device connected to the target terminal device. Then, the sound playback method of the target terminal device for audio data can be determined based on the indication information sent by the target terminal device.
[0035] It should be noted that the above process for determining the sound playback method of the target terminal device for the sound playback scenario is only an example, and the specific method can be determined based on the actual application scenario requirements, without any restrictions.
[0036] Step S32: Determine the first mixing strategy parameters corresponding to the target terminal device based on the sound playback method, and determine the first mixing strategy corresponding to the first mixing strategy parameters.
[0037] Specifically, when determining the first mixing strategy parameter corresponding to the target terminal device based on the sound playback method of the target terminal device for audio data, the mixing strategy parameter corresponding to each sound playback method can be pre-configured, and each mixing strategy parameter is associated with a different mixing strategy.
[0038] Based on this, after determining the sound playback method of the target terminal device for audio data, the first mixing strategy parameter corresponding to each sound playback method can be determined, and then the first mixing strategy corresponding to the first mixing strategy parameter can be determined.
[0039] Each sound playback method can correspond to different mixing strategy parameters, or different parameter values of the same type can be defined as different mixing strategy parameters to distinguish different sound playback methods.
[0040] The mixing strategy parameters may include at least one of the following: Real-time Parameter Control (RTPC) parameters, state parameters, or switch parameters in the sound engine.
[0041] For example, different parameter values can be pre-configured for RTPC parameters to correspond to different sound playback methods. For instance, when the RTPC parameter value is 0, it indicates that the sound is played based on the device's speaker, and when the RTPC parameter value is 1, it indicates that the sound is played based on the audio playback device.
[0042] Taking a game scenario as an example, if it is detected that the game terminal is not connected to headphones during the game, it can be determined that the RTPC parameter value of the game terminal is 0. Then, it can be determined that the first mixing strategy of the game terminal is the mixing strategy corresponding to the parameter value 0. Thus, the game device can play the sound corresponding to the audio data obtained based on the mixing strategy through the device speaker, thereby achieving the mixing effect of the speaker.
[0043] If headphones are detected being connected to the gaming terminal during gameplay, the RTPC parameter value corresponding to the gaming terminal can be determined to be 1. Therefore, the first mixing strategy corresponding to the gaming terminal is determined to be the mixing strategy corresponding to parameter value 1. Thus, the gaming device can play the sound corresponding to the audio data obtained based on this mixing strategy through the headphones, achieving the corresponding mixing effect for the headphones.
[0044] Optionally, when configuring the corresponding mixing strategy parameters for the sound playback method based on the device speaker, the corresponding mixing strategy parameters can also be configured for different types of terminal devices under the sound playback method, and each mixing strategy parameter is associated with a different mixing strategy.
[0045] The differences between terminal devices can be manifested in different brands, device names, device performance configurations, processors, or device models, etc. The specific differences can be determined based on the actual application scenario requirements and are not limited here.
[0046] For example, taking device models (Model A and Model B) as examples, the mixing strategy parameters corresponding to the sound playback based on the device speaker of terminal device model A and the sound playback based on the device speaker of terminal device model B can be pre-configured.
[0047] Based on this, when it is determined that the target terminal device plays sound based on the device speaker, the device-related information of the target terminal device can be further determined (hereinafter referred to as the first device-related information for ease of description). Then, the type of the target terminal device can be determined based on the first device-related information. Then, based on the type of the target terminal device, the first mixing strategy parameter corresponding to the target terminal device can be determined from the mixing strategy parameters corresponding to the device speaker of each type of terminal device.
[0048] Among them, the mixing strategy parameters corresponding to different types of terminal devices when playing sound based on the device's speaker can be determined by different parameter values of the same type of parameter.
[0049] For example, taking device models (model A and model B) as an example, if the mixing strategy parameter is an RTPC parameter, then when the RTPC parameter value is 3, it is used to instruct the terminal device of model A to play sound based on the device speaker, and when the RTPC parameter value is 4, it is used to instruct the terminal device of model B to play sound based on the device speaker.
[0050] Alternatively, the mixing strategy parameters corresponding to different types of terminal devices playing sound based on the device's speaker can be determined by combining parameter values of different types of parameters, without restriction. For example, the mixing strategy parameters are RTPC parameters and state parameters. When the RTPC parameter value is 1, it indicates that sound is played based on the device's speaker, and different values of the state parameter indicate different types of terminal devices.
[0051] For example, taking device models (model A and model B) as examples, if the mixing strategy parameters are RTPC parameters and state parameters, then when the RTPC parameter value is 1 and the state parameter value is 1, it is used to instruct the terminal device of model A to play sound based on the device speaker. When the RTPC parameter value is 1 and the state parameter value is 2, it is used to instruct the terminal device of model B to play sound based on the device speaker.
[0052] In addition to pre-configuring the corresponding mixing strategy parameters for a sound playback method based on the device's speaker, the corresponding mixing strategy parameters can also be pre-configured for a preset type of terminal device under that sound playback method. For terminal devices of other types besides the preset type, the mixing strategy parameters can be directly matched to the sound playback method, or the other types besides the preset type can be used as the default type, and the corresponding mixing strategy parameters can be configured for the default type of terminal device under that sound playback method.
[0053] Optionally, when configuring the corresponding mixing strategy parameters for the sound playback method based on the audio playback device, the corresponding mixing strategy parameters can also be configured in advance for different types of audio playback devices under the sound playback method, and each mixing strategy parameter is associated with a different mixing strategy.
[0054] The differences between audio playback devices can be manifested in different brands, names, performance configurations, processors, or device models, etc. The specific type can be determined based on the actual application scenario requirements, and no restrictions are imposed here.
[0055] For example, taking device models (model A and model B) as examples, the mixing strategy parameters corresponding to the audio playback device based on model A and the audio playback device based on model B can be pre-configured.
[0056] Based on this, when it is determined that the target terminal device plays sound based on the audio playback device, the device-related information of the audio playback device can be further determined (hereinafter referred to as the second device-related information for ease of description). Then, the type of the audio playback device can be determined based on the second device-related information. Then, based on the type of the audio playback device, the first mixing strategy parameter corresponding to the target terminal device can be determined from the mixing strategy parameters corresponding to the playback of sound based on each type of audio playback device.
[0057] Among them, the mixing strategy parameters corresponding to different types of audio playback devices can be determined by different parameter values of the same type of parameter.
[0058] For example, taking device models (model A and model B) as an example, if the mixing strategy parameter is an RTPC parameter, then when the RTPC parameter value is 5, it is used to instruct the audio playback device based on model A to play sound, and when the RTPC parameter value is 6, it is used to instruct the audio playback device based on model B to play sound.
[0059] Alternatively, the mixing strategy parameters corresponding to different types of audio playback devices can be determined by combining parameter values of different types of parameters, without restriction. For example, the mixing strategy parameters are RTPC parameters and state parameters. When the RTPC parameter value is 0, it indicates that the sound is played based on the audio playback device, and different values of the state parameter indicate different types of audio playback devices.
[0060] For example, taking device models (model A and model B) as an example, if the mixing strategy parameters are RTPC parameters and state parameters, then when the RTPC parameter value is 0 and the state parameter value is 1, it is used to instruct the audio playback device based on model A to play sound, and when the RTPC parameter value is 1 and the state parameter value is 2, it is used to instruct the audio playback device based on model B to play sound.
[0061] In addition to pre-configuring the corresponding mixing strategy parameters for a sound playback method based on an audio playback device, it is also possible to pre-configure the corresponding mixing strategy parameters for a preset type of audio playback device under that sound playback method. For audio playback devices of other types besides the preset type, the mixing strategy parameters can be directly matched to the mixing strategy parameters corresponding to that sound playback method, or other types besides the preset type can be used as the default type, and the corresponding mixing strategy parameters can be configured for the default type of audio playback device under that sound playback method.
[0062] Optionally, due to differences in the model and performance configuration of terminal devices, different playback effects may occur when the same audio playback device is connected to different terminal devices and plays the same audio data. Therefore, when configuring the corresponding mixing strategy parameters for the sound playback method based on the audio playback device, the corresponding mixing strategy parameters can also be configured in advance for the correspondence between different types of terminal devices and different types of audio playback devices under this sound playback method, and each mixing strategy parameter is associated with a different mixing strategy.
[0063] See Figure 4 , Figure 4 This is a schematic diagram illustrating the correspondence between the terminal device and the audio playback device provided in the embodiments of this application. For example... Figure 4 As shown, when a terminal device plays sound based on an audio playback device, if both the terminal device and the audio playback device have three types, then for the terminal device, the mixing strategy parameters corresponding to playing sound based on audio playback devices of types 1, 2, and 3 can be pre-configured when the terminal device is type 1. Similarly, the mixing strategy parameters corresponding to playing sound based on audio playback devices of types 1, 2, and 3 can be configured when the terminal device is type 2 and 3, respectively, thus obtaining 9 mixing strategy parameters.
[0064] The differences between audio playback devices and terminal devices can be manifested in different brands, names, performance configurations, processors, or device models. The specific differences can be determined based on the actual application scenario requirements and are not limited here.
[0065] For example, taking audio playback devices of models A and B, and terminal devices of models C and D as examples, the mixing strategy parameters corresponding to the playback of sound by the terminal device of model C based on the audio playback device of model A, the mixing strategy parameters corresponding to the playback of sound by the terminal device of model C based on the audio playback device of model B, the mixing strategy parameters corresponding to the playback of sound by the terminal device of model D based on the audio playback device of model A, and the mixing strategy parameters corresponding to the playback of sound by the terminal device of model D based on the audio playback device of model B can be pre-configured.
[0066] Based on this, when it is determined that the target terminal device plays sound based on the audio playback device, the first device-related information of the target terminal device and the second device-related information of the audio playback device can be further determined. Then, based on the first device-related information and the second device-related information, the type of the terminal device and the type of the audio playback device can be determined respectively. Then, based on the type of the terminal device and the type of the audio playback device, the first mixing strategy parameter corresponding to the target terminal device can be determined from the mixing strategy parameters corresponding to each type of terminal device playing sound based on each type of audio playback device.
[0067] Among them, the mixing strategy parameters corresponding to different types of terminal devices playing sound based on different types of audio playback devices can be determined by different parameter values of the same type of parameter.
[0068] For example, taking audio playback devices of models A and B, and terminal devices of models C and D as examples, if the mixing strategy parameter is an RTPC parameter, then the RTPC parameter value of 7 is used to indicate the mixing strategy parameter corresponding to the model C terminal device when playing sound based on the model A audio playback device; the RTPC parameter value of 8 is used to indicate the mixing strategy parameter corresponding to the model C terminal device when playing sound based on the model B audio playback device; the RTPC parameter value of 9 is used to indicate the mixing strategy parameter corresponding to the model D terminal device when playing sound based on the model A audio playback device; and the RTPC parameter value of 10 is used to indicate the mixing strategy parameter corresponding to the model D terminal device when playing sound based on the model B audio playback device.
[0069] Alternatively, the mixing strategy parameters corresponding to different types of terminal devices playing sound based on different types of audio playback devices can be determined by combining parameter values of different types of parameters, without restriction. For example, the mixing strategy parameters are RTPC parameters, state parameters, and switch parameters. When the RTPC parameter value is 0, it indicates that the sound is played based on the audio playback device. Different values of the state parameter indicate different types of audio playback devices, and different values of the switch parameter indicate different types of terminal devices.
[0070] For example, taking audio playback devices of models A and B, and terminal devices of models C and D as examples, if the mixing strategy parameters are RTPC parameters, state parameters, and switch parameters, then the following are the mixing strategy parameters used when the RTPC parameter is 0, the state parameter is 1, and the switch parameter is 1: RTPC parameters of model C are used to indicate the mixing strategy parameters when playing sound from the audio playback device of model A; state parameters of model C are used to indicate the mixing strategy parameters when playing sound from the audio playback device of model B; and switch parameters of model D are used to indicate the mixing strategy parameters when playing sound from the audio playback device of model B.
[0071] Specifically, when configuring the corresponding mixing strategy parameters for a sound playback method based on an audio playback device, the corresponding mixing strategy parameters can also be configured in advance for the correspondence between each preset type of terminal device and different types of audio playback devices under that sound playback method. For any terminal device of other types besides the preset types, the corresponding mixing strategy parameters for playing sound based on different types of audio playback devices can be configured in advance, or other types besides the preset types can be used as the default type, and the corresponding mixing strategy parameters can be configured in advance for the correspondence between the default type of terminal device and different types of audio playback devices under that sound playback method.
[0072] Alternatively, the corresponding mixing strategy parameters can be pre-configured for the correspondence between different types of terminal devices and preset types of audio playback devices under this sound playback mode. For any audio playback device of other types besides the preset types, the mixing strategy parameters corresponding to different types of terminal devices playing sound based on the audio playback device can be pre-configured, or other types besides the preset types can be used as the default types, and the mixing strategy parameters corresponding to different types of terminal devices playing sound based on the default type of audio playback device can be pre-configured.
[0073] For example, see Figure 5 , Figure 5 This is a schematic diagram illustrating the mixing process based on a mobile phone mixing strategy provided in an embodiment of this application. For example... Figure 5 As shown, before determining the first mixing strategy corresponding to the mobile phone for mixing, multiple mixing strategies can be pre-determined, and different mixing strategies can be associated with different mixing strategy parameters. This allows the mobile phone model to be associated with the strategy parameters in the code segment. Then, when the mobile phone starts the game and needs to play sound, the mobile phone model is detected to determine the first mixing strategy parameters matching the mobile phone model, and mixing is performed based on the first mixing strategy corresponding to the first mixing strategy parameters.
[0074] When the mixing strategy parameters are the RTPC parameters of the sound engine, the corresponding Application Programming Interface (API) can be accessed. This API can then be associated with the phone model (e.g., phone model A) in the corresponding script, and two RTPC parameter values (e.g., 0 and 1) can be added. A parameter value of 1 indicates that if the target terminal device is phone model A, the mixing strategy parameter corresponding to parameter value 1 will be determined as the first mixing strategy parameter, and the mixing strategy configured for phone model A will be adopted. A parameter value of 0 indicates that if the target terminal device is not phone model A, the default mixing strategy parameter corresponding to parameter value 0 will be used as the target strategy parameter, and the default mixing strategy will be adopted.
[0075] In this application embodiment, the pre-configured mixing strategy parameters and corresponding mixing strategies can be stored in servers, databases, cloud storage spaces, or blockchains, depending on the specific application scenario requirements, and are not limited here. A database can be simply viewed as an electronic filing cabinet—a place to store electronic files, and in this application, it can be used to store the pre-configured mixing strategy parameters and corresponding mixing strategies. Blockchain is a new application model of computer technologies such as distributed data storage, peer-to-peer transmission, consensus mechanisms, and encryption algorithms. Essentially, a blockchain is a decentralized database, a chain of data blocks linked using cryptographic methods. In this application, each data block in the blockchain can store the pre-configured mixing strategy parameters and corresponding mixing strategies. Cloud storage is a new concept extended and developed from cloud computing. It refers to the use of cluster applications, grid technology, and distributed storage file systems to aggregate a large number of various types of storage devices (also called storage nodes) in a network through application software or application interfaces to collaboratively store the pre-configured mixing strategy parameters and corresponding mixing strategies.
[0076] Step S33: Mix the initial audio data of the sound playback scene based on the first mixing strategy to obtain the first audio data, and send the first audio data to the target terminal device so that the target terminal device plays the sound corresponding to the first audio data based on the sound playback method.
[0077] Specifically, the initial audio data for a sound playback scene is the audio data of each sound corresponding to the sound playback scene, that is, the audio data corresponding to at least one sound that the target terminal device needs to play at present, such as the audio data corresponding to the action sound effects of virtual objects in a game scene, background music, water flow sounds, etc., or the audio data corresponding to the performance music of different instruments used to synthesize music, etc., without any restrictions.
[0078] For any mixing strategy parameter in step S32, the corresponding mixing strategy can be used to directly adjust the timbre, loudness (volume), frequency, and other sound parameters of the sound corresponding to each initial audio data during the mixing process. Alternatively, it can be used to adjust the parameters of at least one mixing effect to adjust the sound effects of the final played sound based on the mixing of each mixing effect. For example, it can be used to adjust the relevant parameters of the equalizer (EQ) to adjust the intensity ratio of the frequency bands corresponding to different initial audio data, or it can be used to adjust the relevant parameters of the reverb effect to adjust the spatial representation of the sound of different initial audio data.
[0079] For example, see Figure 6 , Figure 6This is a frequency response comparison diagram provided in the embodiments of this application. Figure 6 The diagram shows an audio track for a certain piece of music A, and terminal devices of type A and type B corresponding to that audio track. If it is determined that the sound played by terminal device B at high frequencies is harsher than that played by terminal device A at high frequencies, then the mixing strategy corresponding to terminal device B can attenuate the high-frequency audio data using appropriate mixing effects, and enhance the high-frequency audio data using appropriate mixing effects, so that the mixed sound played through terminal devices of type A and type B remains consistent in terms of listening experience.
[0080] The mixing strategy corresponding to each mixing strategy parameter can also be used to disable at least one mixing effect, such as disabling the reverb effect so that the spatial representation of the sound of each initial audio data is not adjusted when mixing based on the mixing strategy.
[0081] Furthermore, after determining the final first mixing strategy based on the sound playback method of the target terminal device for the audio data, at least one initial audio data can be mixed based on the first mixing strategy to obtain the final first audio data. The first audio data can then be sent to the target terminal device, so that the target terminal device can play the sound corresponding to the first audio data according to the corresponding sound playback method.
[0082] For example, when the target terminal device plays sound through its device speaker, the first audio data can be sent to the target terminal device so that the target terminal device can parse the first audio data and play the sound corresponding to the first audio data through its own device speaker.
[0083] When the target terminal device plays sound based on the audio playback device connected to it, the first audio data can be sent to the target terminal device so that the target terminal device can parse the first audio data and play the sound corresponding to the first audio data through the audio playback device (such as headphones) connected to it.
[0084] See Figure 7 , Figure 7 This is a schematic diagram of the mixing strategy configuration provided in an embodiment of this application. For example... Figure 7 As shown, the sound engine can obtain multiple mixing strategies by adjusting the relevant parameters of each mixing effect in the mixing effects set and / or disabling different mixing effects. Furthermore, different mixing strategy parameters are associated with different mixing strategies, and can be configured through... Figure 5The method shown associates the mixing strategy parameters with the terminal device, thereby enabling the use of different mixing strategies to mix the initial audio data under different sound playback conditions. For example, different mixing strategies are used when playing audio through a speaker on a phone of model A, through a speaker on a phone of model B, and through headphones.
[0085] See Figure 8 , Figure 8 This is another schematic flowchart of the sound playback method provided in the embodiments of this application. For example... Figure 8 As shown, the sound playback method provided in this application embodiment may include the following steps: Step S81: In response to the target performance configuration level being lower than or equal to the preset performance configuration level, determine the second mixing strategy corresponding to the target terminal device based on the preset mixing strategy parameters.
[0086] For high-quality audio data obtained by mixing the initial audio data corresponding to a sound playback scenario, the target terminal device may experience increased performance consumption when parsing the mixed audio data due to its own performance limitations, thus affecting its normal operation. Therefore, when pre-configuring the mixing strategy parameters corresponding to different sound playback modes, preset mixing strategy parameters can be pre-configured for terminal devices with lower performance configurations. The mixing strategy corresponding to these preset parameters can be used to shield mixing effects with low usage and / or high performance consumption, thereby reducing the performance consumption of terminal devices with lower performance configurations when playing the sound corresponding to the mixed audio data.
[0087] Based on this, if the target performance configuration level of the target terminal device is lower than or equal to the preset performance configuration level, it indicates that the performance configuration of the target terminal device itself is poor. It is necessary to adopt a mixing strategy that shields mixing effects with low utilization and / or high performance consumption for the target terminal device. Therefore, the pre-configured preset mixing strategy can be determined as the second mixing strategy corresponding to the target terminal device.
[0088] Among them, the pre-configured preset mixing strategy can be associated with the preset mixing strategy parameters. When the target performance configuration level of the target mid-to-high-end device is lower than or equal to the preset performance configuration level, the preset mixing strategy corresponding to the preset mixing strategy parameters will be determined as the second mixing strategy corresponding to the target terminal device.
[0089] Specifically, a specified mixing strategy parameter or a specified parameter value of a specified type of parameter can be determined as a preset mixing strategy parameter, and then associated with the corresponding preset mixing strategy.
[0090] Optionally, when configuring a preset mixing strategy for a terminal device with lower performance, different predictive mixing strategies can also be configured for different types of terminal devices with lower performance. Thus, if the target performance configuration level of the target terminal device is determined to be lower than or equal to the preset performance configuration level, first device-related information of the target terminal device is determined, and based on this first device-related information, a first mixing strategy corresponding to the device type of the target terminal device is determined from the preset mixing strategies corresponding to each type.
[0091] For example, in first-person shooter (FPS) games, there are numerous scenes and different types of rooms within those scenes. Therefore, different reverb effects are needed for different rooms and scenes to enhance the realism of the game audio. However, this also leads to significant memory and performance consumption. Therefore, pre-defined mixing strategy parameters can be configured for lower-performance devices to disable the reverb effect, thereby optimizing game memory usage.
[0092] Optionally, different parameter values can be configured for terminal devices with lower performance configurations, in descending or ascending order of performance configuration level, so that the parameter values are positively or negatively correlated with the performance configuration level. For example, parameter values can be configured sequentially from high to low performance configuration level, or from low to high performance configuration level, and different parameter value ranges correspond to different mixing strategies.
[0093] Among them, the mixing strategies corresponding to different parameter value ranges can be used to disable different mixing effects or disable different numbers of mixing effects, thereby reducing the performance consumption of the target terminal device when parsing the audio data obtained from the mixing to varying degrees.
[0094] Based on this, when the performance configuration level of the target terminal is lower than or equal to the preset performance configuration level, the target parameter value range corresponding to the performance configuration level of the target terminal can be determined, and the corresponding mixing strategy can then be determined as the second mixing strategy corresponding to the target terminal. For example... Figure 9 As shown, Figure 9 This is a schematic diagram of a scenario for determining a mixing strategy provided in an embodiment of this application. For example... Figure 9 As shown, the mixing strategy can turn off the reverb effect when the parameter value is in the range of 0-5, and does not need to turn it off when it is in the range of 6-10.
[0095] Optionally, when configuring a corresponding preset mixing strategy for a terminal device with lower performance, different preset predictive mixing strategies can also be configured for different sound playback methods of the terminal device with lower performance. Thus, when the target performance level of the target terminal device is determined to be lower than or equal to the preset performance level, the sound playback method of the target terminal device is determined, and the corresponding preset mixing strategy parameters are determined based on the sound playback method of the target terminal device. Finally, the corresponding second mixing strategy for the target terminal device is determined based on the preset mixing strategy parameters.
[0096] Step S82: Mix the initial audio data corresponding to the sound playback scenario based on the second mixing strategy to obtain the second audio data, and send the second audio data to the target terminal device so that the target terminal device plays the sound corresponding to the second audio data in the sound playback mode.
[0097] For a detailed implementation of step S82, please refer to [link to relevant documentation]. Figure 2 The implementation method shown in step S33 will not be described again here.
[0098] In this embodiment, for terminal devices that do not connect to other audio playback devices to play sound, or terminal devices in scenarios where there is no distinction based on the audio playback device or the device's speaker playing music, different mixing strategy parameters can be pre-configured for each type of terminal device, or different mixing strategy parameters can be configured for a preset type of terminal device, and default mixing strategy parameters can be configured for the remaining types of terminal devices. Each mixing strategy parameter also corresponds to a mixing strategy, and the default mixing classification parameter corresponds to the default mixing strategy.
[0099] Based on this, when the target terminal device needs to play the mixed music, the device type of the target terminal can be determined based on the first device-related information of the target terminal device. Then, the corresponding third mixing strategy parameters can be determined based on the device type of the target terminal device. Based on the mixing strategy corresponding to the third mixing strategy parameters, each initial audio data is mixed to obtain the third audio data. The third audio data is then sent to the target terminal device so that the target terminal device can play the sound corresponding to the third audio data.
[0100] As an example, when the mixing strategy parameter is an RTPC parameter, the RTPC parameter corresponding to type A terminal device can be pre-configured with a value of 1 to indicate the mixing strategy parameter corresponding to type A terminal device, the RTPC parameter corresponding to type B terminal device with a value of 2 to indicate the mixing strategy parameter corresponding to type B terminal device, and the RTPC parameter corresponding to other types of terminal devices with a value of 0 to indicate the default mixing strategy parameter corresponding to other types of terminal devices besides type A and type B.
[0101] When the target user experiences the game through a terminal device of a type other than type A and type B, the corresponding RTPC parameter value can be determined to be 0, and then the audio data corresponding to various music in the game scene can be mixed based on the default mixing strategy.
[0102] When the target user experiences the game through a terminal device of type A or type B, the parameter value of the corresponding RTPC parameter can be determined to be 1 or 1. Then, the audio data corresponding to each piece of music in the game scene can be mixed based on the corresponding mixing strategy.
[0103] In this embodiment of the application, when determining the mixing strategy parameters corresponding to the target terminal device, it is necessary to predetermine the association between the sound playback scene and the corresponding mixing strategy parameters. Thus, after determining the sound playback scene of the target terminal device, the mixing strategy parameters corresponding to the target terminal device are determined from the mixing strategy parameters corresponding to the sound playback scene.
[0104] Based on the sound playback method provided in this application, a mixing strategy that saves performance consumption of the target terminal device can be used when the performance configuration of the target terminal device is low. Simultaneously, when the performance configuration level of the terminal device is higher than a preset performance configuration level, the mixing strategy corresponding to whether the terminal device plays sound through a speaker or through an audio player connected to it can be determined, and different mixing strategies can be applied to mix the initial audio data of the same sound playback scenario. Therefore, the same mixing effect can be obtained when the target terminal device plays the sound corresponding to the same sound playback scenario through different sound playback methods, thus maintaining a consistent auditory experience for the sound of the same sound playback scenario played by the terminal device through different sound playback methods.
[0105] For example, for servers in Intelligent Traffic Systems (ITS) or Intelligent Vehicle Infrastructure Cooperative Systems (IVICS), different mixing schemes can be adopted when the driver's mobile phone has a higher performance configuration level than the preset performance configuration level, and when the driver plays traffic voice information through the mobile phone or through the vehicle speaker connected to the mobile phone, so as to keep the traffic voice heard by the driver through the mobile phone speaker and the vehicle speaker consistent in sound.
[0106] Intelligent Transportation Systems (ITS), also known as Intelligent Transportation Systems, effectively integrate advanced science and technology (information technology, computer technology, data communication technology, sensor technology, electronic control technology, automatic control theory, operations research, artificial intelligence, etc.) into transportation, service control, and vehicle manufacturing. This strengthens the connection between vehicles, roads, and users, thereby forming a comprehensive transportation system that ensures safety, improves efficiency, enhances the environment, and saves energy.
[0107] Intelligent vehicle-road cooperative systems, or vehicle-road cooperative systems for short, represent a development direction for Intelligent Transportation Systems (ITS). These systems utilize advanced wireless communication and next-generation internet technologies to implement comprehensive, real-time dynamic information exchange between vehicles and infrastructure. Based on the collection and fusion of dynamic traffic information across all times and spaces, they enable proactive vehicle safety control and collaborative road management, fully realizing effective coordination between people, vehicles, and roads. This ensures traffic safety, improves traffic efficiency, and ultimately forms a safe, efficient, and environmentally friendly road traffic system.
[0108] See Figure 10 , Figure 10 This is a schematic diagram of the structure of the sound playback device provided in an embodiment of this application. The device provided in this embodiment includes: The method determination module 101 is used to determine the target performance configuration level of the target terminal device in response to the target terminal device accessing the sound playback scenario, and to determine the sound playback method of the target terminal device for the sound playback scenario in response to the target performance configuration level being higher than the preset performance configuration level. The sound playback method includes playback based on the device speaker of the target terminal device or playback based on an audio playback device connected to the target terminal device. The parameter determination module 102 is used to determine the first mixing strategy parameters corresponding to the target terminal device based on the above sound playback method, determine the first mixing strategy corresponding to the first mixing strategy parameters, and the first mixing strategy is matched with the above sound playback method and the target terminal device. The data processing module 103 is used to mix the initial audio data of the sound playback scenario based on the first mixing strategy to obtain first audio data, and send the first audio data to the target terminal device so that the target terminal device plays the sound corresponding to the first audio data based on the sound playback method.
[0109] In some feasible implementations, the parameter determination module 102 described above is used for: In response to the target terminal device playing audio data based on the device speaker of the target terminal device, the first device-related information of the target terminal device is determined; Based on the aforementioned information about the first device, the first mixing strategy parameters corresponding to the target terminal device are determined.
[0110] In some feasible implementations, the parameter determination module 102 is further configured to: In response to the aforementioned target terminal device playing audio data based on the aforementioned audio playback device connected to the aforementioned target terminal device, second device-related information of the aforementioned audio playback device is determined; Based on the aforementioned information about the second device, the first mixing strategy parameters corresponding to the target terminal device are determined.
[0111] In some feasible implementations, the parameter determination module 102 described above is used for: Determine the first device-related information of the aforementioned target terminal device; Based on the aforementioned first device information and the aforementioned second device information, the first mixing strategy parameters corresponding to the aforementioned target terminal device are determined.
[0112] In some feasible implementations, the above-described method determines module 101, which is used for: Determine the target performance configuration information of the aforementioned target terminal devices; Based on the correlation between performance configuration information and performance configuration level, and the aforementioned target performance configuration information, the performance configuration level of the aforementioned target terminal device is determined.
[0113] In some feasible implementations, the parameter determination module 102 is further configured to: In response to the target performance configuration level being lower than or equal to the preset performance configuration level, a second mixing strategy corresponding to the target terminal device is determined based on the preset mixing strategy parameters. Based on the second mixing strategy described above, the initial audio data corresponding to the sound playback scenario is mixed to obtain the second audio data, and the second audio data is sent to the target terminal device so that the target terminal device plays the sound corresponding to the second audio data in the sound playback mode.
[0114] In some feasible implementations, the first mixing strategy parameter or the preset mixing strategy parameter mentioned above includes at least one of real-time parameter control (RTPC) parameters, state parameters, or switch parameters.
[0115] In specific implementation, the above-mentioned device can perform the above-described actions through its built-in functional modules. Figure 3 and / or Figure 8 The implementation methods provided for each step are detailed in the above-mentioned implementation methods, and will not be repeated here.
[0116] See Figure 11 , Figure 11 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. For example... Figure 11 As shown, the electronic device 1100 in this embodiment may include: a processor 1101, a network interface 1104, and a memory 1105. Furthermore, the electronic device 1100 may also include: an object interface 1103, and at least one communication bus 1102. The communication bus 1102 is used to implement communication between these components. The object interface 1103 may include a display screen and a keyboard; optionally, the object interface 1103 may also include a standard wired interface or a wireless interface. The network interface 1104 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1104 may be a high-speed RAM or non-volatile memory (NVM), such as at least one disk storage device. The memory 1105 may optionally be at least one storage device located remotely from the aforementioned processor 1101. Figure 11 As shown, the memory 1105, which is a computer-readable storage medium, may include an operating system, a network communication module, an object interface module, and a device control application.
[0117] exist Figure 11 In the illustrated electronic device 1100, the network interface 1104 provides network communication functionality; the object interface 1103 is primarily used to provide an input interface for the user; and the processor 1101 can be used to call the device control application stored in the memory 1105 to achieve: In response to the target terminal device accessing the sound playback scenario, the target performance configuration level of the target terminal device is determined. In response to the target performance configuration level being higher than the preset performance configuration level, the sound playback method of the target terminal device for the sound playback scenario is determined. The sound playback method includes playback based on the device speaker of the target terminal device or playback based on an audio playback device connected to the target terminal device. Based on the above sound playback method, the first mixing strategy parameters corresponding to the above target terminal device are determined, and the first mixing strategy corresponding to the above first mixing strategy parameters is determined. The above first mixing strategy is matched with the above sound playback method and the above target terminal device. Based on the first mixing strategy described above, the initial audio data of the sound playback scenario is mixed to obtain first audio data, and the first audio data is sent to the target terminal device so that the target terminal device plays the sound corresponding to the first audio data based on the sound playback method described above.
[0118] In some feasible implementations, the processor 1101 described above is used for: In response to the target terminal device playing audio data based on the device speaker of the target terminal device, the first device-related information of the target terminal device is determined; Based on the aforementioned information about the first device, the first mixing strategy parameters corresponding to the target terminal device are determined.
[0119] In some feasible implementations, the processor 1101 is further configured to: In response to the aforementioned target terminal device playing audio data based on the aforementioned audio playback device connected to the aforementioned target terminal device, second device-related information of the aforementioned audio playback device is determined; Based on the aforementioned information about the second device, the first mixing strategy parameters corresponding to the target terminal device are determined.
[0120] In some feasible implementations, the processor 1101 described above is used for: Determine the first device-related information of the aforementioned target terminal device; Based on the aforementioned first device information and the aforementioned second device information, the first mixing strategy parameters corresponding to the aforementioned target terminal device are determined.
[0121] In some feasible implementations, the processor 1101 described above is used for: Determine the target performance configuration information of the aforementioned target terminal devices; Based on the correlation between performance configuration information and performance configuration level, and the aforementioned target performance configuration information, the performance configuration level of the aforementioned target terminal device is determined.
[0122] In some feasible implementations, the processor 1101 is further configured to: In response to the target performance configuration level being lower than or equal to the preset performance configuration level, a second mixing strategy corresponding to the target terminal device is determined based on the preset mixing strategy parameters. Based on the second mixing strategy described above, the initial audio data corresponding to the sound playback scenario is mixed to obtain the second audio data, and the second audio data is sent to the target terminal device so that the target terminal device plays the sound corresponding to the second audio data in the sound playback mode.
[0123] In some feasible implementations, the first mixing strategy parameter or the preset mixing strategy parameter mentioned above includes at least one of real-time parameter control (RTPC) parameters, state parameters, or switch parameters.
[0124] It should be understood that in some feasible implementations, the processor 1101 described above may be a central processing unit (CPU), which may also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor. The memory may include read-only memory and random access memory, and provides instructions and data to the processor. A portion of the memory may also include non-volatile random access memory. For example, the memory may also store device type information.
[0125] In specific implementation, the aforementioned electronic device 1100 can perform the above-described actions through its built-in functional modules. Figure 3 and / or Figure 8 The implementation methods provided for each step are detailed in the above-mentioned implementation methods, and will not be repeated here.
[0126] This application also provides a computer-readable storage medium storing a computer program that is executed by a processor to implement... Figure 3 and / or Figure 8 The methods provided in each step are detailed in the implementation methods provided in the above steps, and will not be repeated here.
[0127] The aforementioned computer-readable storage medium can be an internal storage unit of the apparatus or electronic device provided in any of the foregoing embodiments, such as a hard disk or memory of the electronic device. The computer-readable storage medium can also be an external storage device of the electronic device, such as a plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc., equipped on the electronic device. The aforementioned computer-readable storage medium can also include magnetic disks, optical disks, read-only memory (ROM), or random access memory (RAM), etc. Furthermore, the computer-readable storage medium can include both internal storage units and external storage devices of the electronic device. The computer-readable storage medium is used to store the computer program and other programs and data required by the electronic device. The computer-readable storage medium can also be used to temporarily store data that has been output or will be output.
[0128] This application provides a computer program product, which includes a computer program that is executed by a processor. Figure 3 and / or Figure 8 The methods provided for each step in the process.
[0129] The terms "first," "second," etc., used in the claims, description, and drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or electronic device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or electronic devices. References to "embodiment" herein mean that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The presentation of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments. The term "and / or" as used in this application's description and appended claims refers to any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.
[0130] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Those skilled in the art can implement the described functions using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.
[0131] The above-disclosed embodiments are merely preferred embodiments of this application and should not be construed as limiting the scope of this application. Therefore, any equivalent variations made in accordance with the claims of this application shall still fall within the scope of this application.
Claims
1. A sound playback method, characterized in that, The method includes: In response to a target terminal device accessing a sound playback scenario, a target performance configuration level of the target terminal device is determined. In response to the target performance configuration level being higher than a preset performance configuration level, a sound playback method for the target terminal device in the sound playback scenario is determined. The sound playback method includes playback based on the device speaker of the target terminal device or playback based on an audio playback device connected to the target terminal device. Based on the sound playback method, a first mixing strategy parameter corresponding to the target terminal device is determined, and a first mixing strategy corresponding to the first mixing strategy parameter is determined. The first mixing strategy is matched with the sound playback method and the target terminal device. Each sound playback method corresponds to a different mixing strategy parameter. The first mixing strategy is used to adjust the sound indicators of the sound corresponding to the initial audio data or to adjust the parameters of at least one mixing effect, so that the sound of the same sound playback scene played by the target terminal device through different sound playback methods remains consistent in terms of listening experience. Based on the first mixing strategy, the initial audio data of the sound playback scenario is mixed to obtain first audio data, and the first audio data is sent to the target terminal device so that the target terminal device plays the sound corresponding to the first audio data based on the sound playback method.
2. The method according to claim 1, characterized in that, The step of determining the first mixing strategy parameters corresponding to the target terminal device based on the sound playback method includes: In response to the target terminal device playing audio data based on the device speaker of the target terminal device, a first device-related information of the target terminal device is determined; Based on the information related to the first device, the first mixing strategy parameters corresponding to the target terminal device are determined.
3. The method according to claim 1, characterized in that, The step of determining the first mixing strategy parameters corresponding to the target terminal device based on the sound playback method includes: In response to the target terminal device playing audio data based on the audio playback device connected to the target terminal device, a second device-related information of the audio playback device is determined; Based on the information related to the second device, the first mixing strategy parameters corresponding to the target terminal device are determined.
4. The method according to claim 3, characterized in that, The step of determining the first mixing strategy parameters corresponding to the target terminal device based on the information related to the second device includes: Determine the first device-related information of the target terminal device; Based on the first device-related information and the second device-related information, a first mixing strategy parameter corresponding to the combination of the target terminal device and the audio playback device is determined.
5. The method according to claim 1, characterized in that, Determining the performance configuration level of the target terminal device includes: Determine the target performance configuration information of the target terminal device; Based on the correlation between performance configuration information and performance configuration level, and the target performance configuration information, the performance configuration level of the target terminal device is determined.
6. The method according to claim 1, characterized in that, The method further includes: In response to the target performance configuration level being lower than or equal to the preset performance configuration level, a second mixing strategy corresponding to the target terminal device is determined based on preset mixing strategy parameters; Based on the second mixing strategy, the initial audio data corresponding to the sound playback scenario is mixed to obtain the second audio data, and the second audio data is sent to the target terminal device so that the target terminal device plays the sound corresponding to the second audio data based on the sound playback method.
7. The method according to claim 1, characterized in that, The first mixing strategy parameter or preset mixing strategy parameter includes at least one of real-time parameter control (RTPC) parameters, state parameters, or switch parameters.
8. A sound playback device, characterized in that, The device includes: The method determination module is used to determine the target performance configuration level of the target terminal device in response to the target terminal device accessing the sound playback scenario, and to determine the sound playback method of the target terminal device for the sound playback scenario in response to the target performance configuration level being higher than the preset performance configuration level. The sound playback method includes playback based on the device speaker of the target terminal device or playback based on an audio playback device connected to the target terminal device. The parameter determination module is used to determine the first mixing strategy parameters corresponding to the target terminal device based on the sound playback method, and to determine the first mixing strategy corresponding to the first mixing strategy parameters. The first mixing strategy matches the sound playback method and the target terminal device. Each sound playback method corresponds to a different mixing strategy parameter. The first mixing strategy is used to adjust the sound indicators of the sound corresponding to the initial audio data or to adjust the parameters of at least one mixing effect, so that the sound of the same sound playback scene played by the target terminal device through different sound playback methods remains consistent in terms of listening experience. The data processing module is used to mix the initial audio data of the sound playback scenario based on the first mixing strategy to obtain first audio data, and send the first audio data to the target terminal device so that the target terminal device plays the sound corresponding to the first audio data based on the sound playback method.
9. An electronic device, characterized in that, It includes a processor and a memory, which are interconnected; The memory is used to store computer programs; The processor is configured to perform the method as described in any one of claims 1 to 7 when the computer program is invoked.
10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that is executed by a processor to implement the method of any one of claims 1 to 7.
11. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Audio processing method and device
CN111045635A