Audio playing method and device

Abstract

The embodiment of the invention provides an audio playing method and device. The audio playing method comprises the following steps: acquiring an audio to be played and playing equipment information; first playing attribute adjustment information is generated based on the playing device information, and the first playing attribute adjustment information is used for adjusting sound quality performance of the to-be-played audio when the to-be-played audio is played in different devices; and playing the audio to be played according to the first playing attribute adjustment information. By detecting the equipment information, the audio playing effect is adjusted in a targeted manner, so that a user can obtain better audio experience on any equipment.

Description

Technical Field

[0001] The embodiments of the present specification relate to the field of computer technology, and in particular to an audio playback method. Background Art

[0002] With the diversification of audio playback device types and usage environments, the differences in audio effects experienced by users on different devices are becoming increasingly obvious, resulting in the problem that mobile devices or low-end speakers with weaker output capabilities have deficiencies in low and high frequencies, significantly affecting users' auditory experience.

[0003] Currently, audio optimization methods are mainly based on a single device or preset scenario for adjustment, which solves the need to improve sound quality under specific conditions. However, there is a lack of intelligent adaptation mechanism for device differences and audio output environment, making it difficult to provide consistent and high-quality audio effects on multiple devices. Therefore, in order to solve the above shortcomings, an audio playback method is needed. Summary of the invention

[0004] In view of this, an embodiment of the present specification provides an audio playback method. One or more embodiments of the present specification also relate to an audio playback device, a computing device, a computer-readable storage medium and a computer program product to solve the technical defects existing in the prior art.

[0005] According to a first aspect of an embodiment of this specification, there is provided an audio playback method, including: Get the audio to be played and the playback device information; generating first playback attribute adjustment information based on the playback device information, wherein the first playback attribute adjustment information is used to adjust the sound quality performance of the audio to be played when played on different devices; The to-be-played audio is played according to the first play attribute adjustment information.

[0006] According to a second aspect of the embodiments of this specification, there is provided an audio playback device, including: An acquisition module, configured to acquire information of the audio to be played and the playback device; A second generating module is configured to generate first playback attribute adjustment information based on the playback device information, wherein the first playback attribute adjustment information is used to adjust the sound quality performance of the audio to be played when it is played on different devices; The playing module is configured to play the audio to be played according to the first playing attribute adjustment information.

[0007] According to a third aspect of an embodiment of this specification, a computing device is provided, including: Memory and processor; The memory is used to store computer executable instructions, and the processor is used to execute the computer executable instructions. When the computer executable instructions are executed by the processor, the steps of the above-mentioned audio playback method are implemented.

[0008] According to a fourth aspect of the embodiments of this specification, a computer-readable storage medium is provided, which stores computer-executable instructions, and when the instructions are executed by a processor, the steps of the above-mentioned audio playback method are implemented.

[0009] According to a fifth aspect of the embodiments of this specification, a computer program product is provided, including a computer program / instruction, which implements the steps of the above-mentioned audio playback method when executed by a processor.

[0010] By applying the solution of the embodiments of this specification, by simultaneously obtaining the playback environment information and the playback device information and generating the first playback attribute adjustment information, dynamic adaptation and optimization of the audio output in the case of multiple devices is achieved, thereby effectively solving the problem that as the types of audio playback devices diversify, the audio effects experienced by users on different devices are increasingly different, especially the problem that mobile devices or low-end speakers have weak output capabilities, resulting in insufficient low and high frequencies, affecting the auditory experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 is a flow chart of an audio playback method provided by an embodiment of this specification; Figure 2 is a process flow chart of a game audio playback method provided by an embodiment of this specification; Figure 3 is a structural diagram of an audio playback device provided by an embodiment of this specification; Figure 4 It is a structural block diagram of a computing device provided by an embodiment of this specification. DETAILED DESCRIPTION

[0012] Many specific details are described in the following description to facilitate a full understanding of this specification. However, this specification can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of this specification, so this specification is not limited to the specific implementation disclosed below.

[0013] The terms used in one or more embodiments of this specification are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of this specification. The singular forms of "a", "said" and "the" used in one or more embodiments of this specification and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used in one or more embodiments of this specification refers to and includes any or all possible combinations of one or more associated listed items.

[0014] It should be understood that although the terms first, second, etc. may be used to describe various information in one or more embodiments of this specification, this information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of this specification, the first may also be referred to as the second, and similarly, the second may also be referred to as the first. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0015] In addition, it should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in one or more embodiments of this specification are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0016] First, the terms involved in one or more embodiments of this specification are explained.

[0017] Equalization (EQ) curve: By adjusting the gain in different frequency ranges, the timbre balance can be modified or compensated. It can enhance the vocal area and finely refine the sound of each instrument. Combined with a multi-band filter structure, it can create the desired listening experience in a variety of audio scenarios.

[0018] Infinite Impulse Response (IIR): It mainly filters the signal recursively and retains the impact of historical data on the output. It often uses a small number of orders to achieve complex filtering and is suitable for use under conditions where computing resources are limited.

[0019] Finite Impulse Response (FIR): It only relies on the current and known input to generate output, without involving recursive accumulation effects. It exhibits significant characteristics in terms of stability and linear phase, and is suitable for a wider range of audio and signal processing applications.

[0020] Bandpass filter: It is used to pass a specific frequency band and attenuate or block the components below and above the frequency band. After selecting the appropriate center frequency and bandwidth, it can filter out clutter and better highlight the key frequency bands in voice, musical instruments or general audio scenes.

[0021] High-pass filter: allows high-frequency signals to pass through while attenuating low-frequency components. Suitable for removing low-frequency noise in voice or instrument processing, and can be used with other filtering methods to refine the timbre. By setting the cutoff frequency, high-frequency details can be enhanced in a targeted manner.

[0022] Low-pass filter: Allows low-frequency signals to pass while attenuating high-frequency components. It can reduce high-frequency noise and is suitable for creating smooth tonal transitions in music or speech processing. By setting the cutoff frequency, high-frequency sharp parts can be suppressed while retaining energy.

[0023] In this specification, an audio playback method is provided. This specification also relates to an audio playback device, a computing device, a computer-readable storage medium, and a computer program product, which are described in detail one by one in the following embodiments.

[0024] See also Figure 1 , Figure 1 A flowchart of an audio playback method provided according to an embodiment of the present specification is shown, which specifically includes the following steps.

[0025] Step 102: Obtain the audio to be played and the playback device information.

[0026] In actual applications, the audio to be played is the audio content that the user is about to play, which may include music, voice or other types of audio data; the playback device information is parameter information that describes the performance and characteristics of the audio output device, such as device type, frequency response range, etc.

[0027] Exemplarily, the audio to be played can be understood as the original audio data to be played, which usually contains formatted digital audio files or real-time audio streams. These audio contents may include music, podcasts, voice prompts, etc. In different application scenarios, such as mobile phone external speakers, headphone listening, or car audio playback, the audio to be played needs to be decoded and presented to the user through the playback device to ensure the integrity and fidelity of the content. The playback device information can be understood as the technical parameters and usage status information related to the output device currently used to play audio. For example, the type of device (headphones, speakers, mobile phone external speakers, etc.), frequency response range, maximum output power, and audio interface characteristics.

[0028] It should be noted that obtaining playback device information can be understood as collecting the environment and device-related data required for audio playback through a variety of technical means to provide support for subsequent audio optimization, thereby achieving dynamic adaptation and optimization of audio output. The specific method is to obtain the basic information of the device (such as device model, operating system, etc.) through the hardware interface or system function call interface to determine the audio processing capabilities and hardware characteristics of the device; the type of the current audio output device and its sound quality characteristics (such as frequency response curve) can also be identified through the audio output interface (such as the headphone jack or Bluetooth connection). In addition, it can also be combined with the built-in detection module in the user's device to automatically identify the model and specifications of the external device, thereby further accurately providing the data support required for optimization. This manual does not impose any restrictions on this.

[0029] By obtaining playback device information and subsequently analyzing the playback device information, the audio playback system can identify the advantages and disadvantages of the device and perform targeted optimization of the audio, such as compensating for high and low frequencies, or dynamically adjusting the volume, etc. to adapt to the output capabilities of the device, thereby improving the user's auditory experience.

[0030] Considering that the playback environment may also affect the audio experience of the user, the above audio playback method further includes: Get the playback environment information.

[0031] In actual applications, the playback environment information is information that reflects the characteristics of the environment in which the audio is played, such as noise level, environmental reflection, etc.; illustratively, the playback environment information can be understood as information that describes external factors that affect audio perception in the audio playback environment, such as environmental noise intensity, reverberation level, and background sound characteristics. After obtaining this information through hardware devices such as sensors or microphones, the system can analyze potential noise interference in the environment and adjust the frequency distribution and loudness of the audio according to the actual playback environment, so that the audio can maintain a high level of clarity and listening experience in noisy or quiet environments.

[0032] It should be noted that the way to obtain the playback environment information is to monitor the ambient noise in real time through an ambient microphone or other sensors to provide environmental characteristic information; it is also possible to obtain the physical parameters of the playback environment as a reference through interaction with smart devices or Internet of Things systems, etc. This manual does not impose any restrictions on this.

[0033] By receiving and playing environment information and playback device information and subsequently parsing this information, the audio playback system can identify the advantages and disadvantages of the device and information about the current playback environment, and perform targeted optimization of the audio, such as compensating for high and low frequencies, or dynamically adjusting the volume, etc. to adapt to the output capabilities of the device and changes in the current playback environment, thereby enhancing the user's auditory experience.

[0034] Correspondingly, after obtaining the playback environment information, it is necessary to use the above playback environment information to adjust the audio to be played, so after obtaining the playback environment information, it includes: generating second playback attribute adjustment information according to the playback environment information, wherein the second playback attribute adjustment information is used to adjust the sound quality performance of the audio to be played under different external environments.

[0035] In actual applications, the second playback attribute adjustment information is a parameter set generated based on the playback environment information for optimizing audio clarity and sound quality balance to improve the sound quality performance of the audio to be played. The second playback attribute adjustment information can be understood as a set of dynamic adjustment parameters generated based on the playback environment information for optimizing the audio playback effect. This information may include frequency band compensation parameters, loudness adjustment values, and dynamic adjustment data of the EQ (Equalization) curve. For example, when a high noise level is detected in the external environment, the system can increase the gain of the mid-frequency band (1-4 kHz) where the voice is located in the second playback attribute adjustment information, and reduce the dynamic range to ensure clarity. In another scenario, if the ambient noise is low, the second playback attribute adjustment information may include dynamic EQ adjustment of the balanced frequency band to retain more details in the audio.

[0036] It should be noted that generating the second playback attribute adjustment information according to the playback environment information can be understood as dynamically adjusting the audio playback parameters using the key information in the playback environment, so as to optimize the balance between audio clarity and sound quality in different environments. The specific method can be to obtain environmental feature information (such as environmental noise level and frequency band energy distribution) and generate frequency band gain or attenuation parameters based on these feature information, such as enhancing the mid-high frequency band in a high-noise environment to improve voice clarity; it can also generate loudness adjustment information by analyzing the environmental volume information to ensure that the audio remains natural and dynamic in a quiet environment and increase the volume of key frequency bands in a noisy environment; it can also dynamically update the playback parameters to adapt to environmental changes by monitoring the changing trend of environmental noise in real time, such as quickly reducing unnecessary background audio intensity in the event of sudden noise. In addition, the playback audio can be delayed or filtered in combination with the environmental echo detection data to optimize the overall sound quality. This manual does not impose any restrictions on this.

[0037] It should be noted that since the type of playback device and environmental conditions will change over time, resulting in significant differences in audio playback effects at different times, the playback device information and / or playback environment information can be obtained by setting intervals to achieve real-time monitoring of changes in the playback device information and / or playback environment information, and then the playback attribute adjustment information corresponding to the audio to be played can be adjusted in a timely manner, and then the playback attribute adjustment information can be used to make real-time adjustments to the audio to be played, so as to further improve the user's playback experience.

[0038] Acquiring the second playback attribute adjustment information through the playback environment information ensures that the audio output always has high adaptability and stability in a variety of environments.

[0039] Further, generating second playback attribute adjustment information according to the playback environment information includes: Determining ambient sound characteristic information based on the playback environment information; Second playback attribute adjustment information is generated based on the environmental sound feature information.

[0040] In practical applications, environmental sound feature information is key information that describes audio-related characteristics in the playback environment. Environmental sound feature information can be understood as a core data set that records and describes the audio playback environment that may affect the audio quality. These data include the intensity of environmental noise, frequency band distribution, and time-varying characteristics of sound. For example, in a high-noise environment, the feature information may show that the noise in the low-frequency and mid-frequency parts is higher.

[0041] It should be noted that generating the second playback attribute adjustment information based on the environmental sound feature information can be understood as providing dynamic adjustment parameters for audio playback by analyzing the audio characteristic data in the environment, so as to optimize the sound quality performance in different environments. The specific method can be based on the environmental frequency band energy distribution information to determine the frequency band that needs to be enhanced or weakened and its corresponding playback frequency band adjustment information, such as reducing low-frequency energy in an environment with high traffic noise; it can also generate loudness adjustment information by analyzing the environmental volume information, such as increasing the loudness of key frequency bands in a noisy environment to improve voice clarity; it can also dynamically adjust the audio playback parameters in combination with the changing trend of the environmental noise, such as quickly increasing the voice gain when the background noise suddenly changes to ensure auditory discernibility. In addition, the reverberation parameters in the audio playback can be adjusted to improve the sound quality by real-time monitoring of the environmental echo information. This manual does not impose any restrictions on this.

[0042] By acquiring the ambient sound feature information in the playback environment information, the audio playback parameters can be adjusted to enhance the speech clarity or reduce the interference of background noise on the listening experience.

[0043] Considering that the playback audio can be adjusted specifically for different environmental sounds, thereby effectively improving the user's auditory experience, the environmental sound feature information includes environmental frequency band energy distribution information; Further, generating second playback attribute adjustment information based on the environmental sound feature information includes: Determine at least one frequency band to be adjusted and playback frequency band adjustment information corresponding to each frequency band to be adjusted based on the environmental frequency band energy distribution information; The second playback attribute adjustment information is generated according to each playback frequency band adjustment information.

[0044] In actual applications, the environmental frequency band energy distribution information is data that describes the sound energy distribution in each frequency range in the environment; the frequency band to be adjusted is the frequency range that needs to be enhanced or attenuated based on the environmental sound characteristic information, and the playback frequency band adjustment information is the specific gain or attenuation parameters set for each frequency band to be adjusted, which is used to optimize the audio playback effect.

[0045] The energy distribution information of the environmental frequency band can be understood as a key data set reflecting the characteristics of the environmental sound obtained by analyzing the sound energy intensity in different frequency ranges in the environment. For example, in a scene with heavy traffic noise, the energy distribution information of the environmental frequency band may show that the energy of the low-frequency part is too high, while the energy of the high-frequency part is low. This information provides a basis for adjusting the parameters of audio playback and can be used to design targeted frequency band compensation solutions to make speech clearer in noisy environments.

[0046] The frequency band to be adjusted can be understood as the target frequency range for audio processing extracted from the energy distribution of the ambient frequency band. These frequency bands usually correspond to areas with greater interference in the ambient sound or areas that need to be enhanced in audio playback. For example, in an environment dominated by indoor air conditioning sound, the low frequency band may need to be suppressed, while the mid-frequency band (1-4 kHz) can be enhanced to highlight the clarity of speech.

[0047] The playback frequency band adjustment information can be understood as a set of gain or attenuation parameters set for the frequency band to be adjusted and their specific implementation methods. For example, in an environment with strong low-frequency interference, the playback frequency band adjustment information may include using a low-pass filter to attenuate the frequency band below 80 Hz, and in the case of insufficient high frequency, it may include using a high-pass filter to increase the frequency range above 8kHz.

[0048] Considering that the ambient sound has different noise levels, the audio to be played needs to be optimized according to different noise levels, so the ambient sound feature information includes the ambient volume information; Further, generating second playback attribute adjustment information based on the environmental sound feature information includes: Audio loudness adjustment information is determined based on the environmental volume information, and second playback attribute adjustment information is generated based on the audio loudness adjustment information.

[0049] In practical applications, the environmental volume information is a parameter that describes the loudness level of background noise in the environment; the audio loudness adjustment information is an adjustment parameter generated based on the environmental volume information for optimizing the audio playback loudness, helping the audio to achieve adaptive optimization in different environments.

[0050] Ambient volume information can be understood as a data set that reflects the noise loudness level in the playback environment. This information directly affects the audibility and clarity of the audio. For example, in a quiet indoor environment, the ambient volume information may show that the background noise is close to 0 dB, while in a noisy outdoor scene, this value may reach 60 dB or higher. By monitoring the ambient volume information, it can provide a basis for audio optimization to ensure that the voice content is still clearly audible in noisy scenes.

[0051] Audio loudness adjustment information can be understood as a set of parameters for dynamically adjusting the audio playback loudness based on the ambient volume information. These adjustment information may include specific implementations such as gain control and dynamic range compression. For example, in a high-noise environment, the loudness adjustment information can increase the gain of the speech band (1-4 kHz) to improve the clarity of the human voice; in a quiet environment, the intensity of the dynamic range compression can be reduced to retain more timbre details. These adjustment parameters ensure the adaptability and consistency of audio in different environments, allowing users to obtain a high-quality listening experience regardless of the environment.

[0052] Step 104: Generate first playback attribute adjustment information based on the playback device information, wherein the first playback attribute adjustment information is used to adjust the sound quality performance of the audio to be played when it is played on different devices.

[0053] In actual applications, the first playback attribute adjustment information is an adjustment parameter generated based on the playback device information for optimizing the sound quality performance. The first playback attribute adjustment information can be understood as a set of adjustment parameters generated by analyzing the specific audio characteristics of the device, which is intended to optimize the audio output effect of the device. It includes frequency response compensation, dynamic gain adjustment, and equalization curve correction. For example, in low-end audio equipment, it may be necessary to enhance the performance of the low-frequency band to make up for the shortcomings of the hardware, while in high-fidelity headphones, more attention may be paid to the balance of the tone and the restoration of high-frequency details.

[0054] It should be noted that generating the first playback attribute adjustment information based on the playback device information can be understood as optimizing and adjusting the playback parameters using the device type and audio characteristic information to compensate for the hardware differences of the device, thereby improving the consistency and quality of the audio output. The specific method can be to obtain the type information of the device (such as mobile phone external speaker, small speaker, headphone playback, large speaker), and generate an adjustment strategy based on this type information, such as enhancing low frequency or mid-frequency to adapt to low-end devices; or by analyzing the device frequency band playback information (such as EQ curve), adjust the gain or attenuation of a specific frequency band, such as balancing the frequency area that is overly prominent or attenuated; or through the frequency response curve of the device, adjust the high frequency and low frequency parts in a targeted manner, such as refining high frequency details in high-fidelity devices and improving low frequency performance in low-end devices. In addition, the output power and dynamic range characteristics of the device can be combined to generate loudness control or dynamic compression parameters to further optimize the adaptability of the audio. This manual does not impose any restrictions on this.

[0055] By dynamically adapting to the audio characteristics of a specific device, the first playback attribute adjustment information can achieve optimal sound quality under different hardware conditions.

[0056] Further, generating first playback attribute adjustment information based on the playback device information includes: Parsing the playback device information to obtain device type information; Device type adaptation information is determined based on the device type information, and first playback attribute adjustment information is generated based on the device type adaptation information.

[0057] In actual applications, the device type information is the parameters that describe the type of playback device and its basic characteristics; the device type adaptation information is a set of adjustment parameters generated based on the device type information to optimize the audio playback effect to adapt to the characteristics and limitations of different devices.

[0058] Device type information can be understood as key information used to characterize the type of playback device and its hardware characteristics. For example, device type information may include whether the device is a mobile phone external speaker, a small speaker, a headphone player, or a large speaker. This information is usually obtained through system interface, hardware interface, or audio output port detection, and can provide characteristics such as the device's frequency response capability, dynamic range, and output power.

[0059] Device type adaptation information can be understood as optimization strategies and parameter sets designed based on device type information to adapt to the audio output requirements of different devices. This information may include gain adjustment, frequency band compensation, and dynamic range settings for specific devices. For example, in the headphone playback scenario, the device type adaptation information may include a strategy to enhance the mid-frequency band (1-4 kHz) to highlight voice clarity; while for large speakers, the adaptation information may focus more on the balance optimization of high-frequency and low-frequency details.

[0060] The acquisition of device type information and the generation of device type adaptation information provide an important basis for the subsequent optimization of audio playback effects, ensuring that a nearly consistent and high-quality listening experience can be obtained when playing audio on different devices.

[0061] Further, determining the device type adaptation information based on the device type information includes: In a case where the device type information is a first type of device, the device type adaptation information is determined to be voice enhancement adjustment information.

[0062] In actual applications, the first type of device refers to the type of device with limited audio output capabilities, such as a mobile phone speaker or a small speaker; the voice enhancement adjustment information is the optimization parameters generated for the first type of device for improving the clarity of speech and voice.

[0063] The first type of device can be understood as a device that has poor frequency response due to hardware limitations in audio playback scenarios, especially in terms of low-frequency and mid-frequency performance. This type of device usually includes mobile phone speakers and small speakers, which have low output power and are difficult to highlight voice content in noisy environments. For example, mobile phone speakers are often used for calls or simple audio playback scenarios, but the clarity of the frequency band may be limited by the device power and speaker unit. Identifying this type of device is the basis for developing targeted optimization strategies.

[0064] The vocal enhancement adjustment information can be understood as mid-frequency band enhancement optimization parameters designed specifically for the first type of device to make up for the device's lack of voice clarity. These parameters may dynamically adjust the gain of the 1-4 kHz frequency band through digital filters (such as equalizer filters) to ensure that the voice and vocal parts are clearer in the audio output. For example, when the phone is playing a call, the vocal enhancement adjustment information will increase the volume of the mid-frequency band, while appropriately compressing other frequency bands to highlight the recognizability of the voice in scenes dominated by human voices. Such adjustments can significantly improve the user's listening experience under limited hardware conditions.

[0065] Further, generating first playback attribute adjustment information based on the playback device information includes: Parsing the playback device information to obtain device frequency band playback information; The audio device adaptation information is determined based on the device frequency band playback information, and the first playback attribute adjustment information is generated based on the audio device adaptation information.

[0066] In actual applications, the device frequency band playback information is the parameters that describe the audio output characteristics of the playback device in each frequency range, such as the device's EQ curve and frequency response; the audio device adaptation information is the optimization adjustment parameters generated based on the device frequency band playback information, which is used to adapt to the device characteristics and improve the audio output quality.

[0067] Device frequency band playback information can be understood as a key data set used to characterize the audio performance of playback devices in different frequency ranges. This information is usually obtained by analyzing the default EQ curve of the device or measuring its frequency response characteristics, and can reflect the output capabilities of the device in the low, medium and high frequency bands. For example, some low-end audio equipment may show attenuation characteristics in the high frequency part, while high-end headphones may have better performance in the low and high frequency parts. Device frequency band playback information provides basic data support for subsequent audio optimization strategies.

[0068] Audio device adaptation information can be understood as the optimization adjustment strategies and parameters formulated based on the device frequency band playback information, which are used to make up for the shortcomings of the device characteristics and maximize its sound quality performance. For example, when it is found in the frequency band playback information that the device has a weak response in the low-frequency range (60-200 Hz), the low-frequency part can be enhanced through a low-pass filter; if the high-frequency part of the device is too strong and causes distortion, a high-pass filter can be used to weaken the frequency band above 16 kHz. In addition, for the default EQ curve of different devices, the frequency band gain and attenuation values ​​are dynamically adjusted, such as boosting the mid-frequency band (1-4 kHz) to enhance voice clarity. The generation of audio device adaptation information can ensure that the audio output on a variety of devices is more balanced and high-quality.

[0069] Further, determining the audio device adaptation information based on the device frequency band playback information includes: Parsing the device frequency band playback information to obtain the device high frequency playback information and the device low frequency playback information; In a case where the high-frequency playback information of the device meets the high-frequency adjustment condition, generating high-frequency adjustment information based on the high-frequency playback information of the device, and acquiring audio device adaptation information according to the high-frequency adjustment information; In a case where the low-frequency playing information of the device meets the low-frequency adjustment condition, low-frequency adjustment information is generated based on the low-frequency playing information of the device, and audio device adaptation information is acquired according to the low-frequency adjustment information.

[0070] In actual applications, the high-frequency playback information of the device is a parameter describing the audio output characteristics of the device in the high-frequency range; the high-frequency adjustment condition is the basis for judging whether the high-frequency part of the device needs to be optimized; the high-frequency adjustment information is a specific adjustment parameter generated based on the high-frequency playback information of the device. The low-frequency playback information of the device is a parameter describing the audio output characteristics of the device in the low-frequency range; the low-frequency adjustment condition is the basis for judging whether the low-frequency part of the device needs to be optimized; the low-frequency adjustment information is a specific adjustment parameter generated based on the low-frequency playback information of the device.

[0071] Exemplarily, the high-frequency playback information of the device can be understood as a data set describing the performance of the playback device in the high-frequency range, such as the output characteristics of the part above 8 kHz in the frequency response curve. This information generally reflects the device's ability to restore high-frequency details. For example, high-end headphones may provide better clarity in the high-frequency range, while low-end speakers may have high-frequency attenuation. The high-frequency adjustment condition can be understood as a standard for determining whether the high-frequency playback of the device needs to be adjusted. For example, when the frequency response curve of the high-frequency part of the device is lower than a preset threshold, a high-frequency adjustment operation can be triggered. This condition is usually set based on the needs of the device type or audio scene. For example, when playing music, a device with insufficient high-frequency response may need to trigger an adjustment to enhance high-frequency details. The high-frequency adjustment information can be understood as specific optimization parameters generated based on the high-frequency playback information of the device, such as the cutoff frequency or high-frequency gain value of the high-pass filter. For example, when the high-frequency part of the device performs weakly, the frequency gain above 8 kHz can be increased by a dynamic equalization algorithm to enhance the detail performance of the audio, thereby improving the overall sound quality.

[0072] Accordingly, the low-frequency playback information of the device can be understood as a data set describing the performance of the playback device in the low-frequency range, such as the output characteristics of the 60-200 Hz part of the frequency response curve. This information generally reflects the device's ability to restore the low-frequency shock and depth. For example, a small speaker may perform poorly in the low-frequency range and need to compensate for the low-frequency part. The low-frequency adjustment condition can be understood as a standard for determining whether the low-frequency playback of the device needs to be optimized. For example, when the frequency response curve of the low-frequency part of the device is lower than the expected target, the low-frequency enhancement operation can be triggered. This condition is particularly important in the scene of playing movies or music with a high proportion of low frequencies. The low-frequency adjustment information can be understood as specific optimization parameters generated based on the low-frequency playback information of the device, such as the cutoff frequency or low-frequency gain value of the low-pass filter. For example, when the device does not respond sufficiently in the 60-200 Hz range, the energy of this frequency band can be enhanced through a low-pass filter to compensate for the lack of low frequency and enhance the immersion of audio playback.

[0073] By dynamically adjusting the high and low frequencies, the audio playback effect of the device can be significantly improved to adapt to more scenario requirements.

[0074] Step 106: Play the audio to be played according to the first playback attribute adjustment information.

[0075] In practical applications, playing the audio to be played according to the first playback attribute adjustment information is intended to dynamically adjust the attributes of the audio to be played according to the device characteristics, and provide dynamic adaptation capabilities for audio output. By comprehensively analyzing multi-dimensional data such as device frequency response characteristics and output power, the output characteristics of the audio signal can be adjusted for different devices and environments, thereby improving the sound quality performance and meeting the needs of multiple scenarios. This operation not only makes up for the limitations of a single optimization method, but also enhances the adaptability of audio playback.

[0076] Further, considering the influence of the playing environment information during the audio playing on the audio playing, playing the audio to be played according to the first playing attribute adjustment information includes: The to-be-played audio is played according to the second play attribute adjustment information and the first play attribute adjustment information.

[0077] In actual applications, the process of playing the audio to be played according to the second playback attribute adjustment information and the first playback attribute adjustment information is intended to organically combine the environment and device characteristics to provide dynamic adaptation capabilities for audio output. By comprehensively analyzing multi-dimensional data such as environmental noise, frequency distribution, device frequency response characteristics, and output power, the output characteristics of the audio signal can be adjusted for different devices and environments, thereby improving the sound quality and meeting the needs of multiple scenarios. This operation not only makes up for the limitations of a single optimization method, but also enhances the adaptability of audio playback.

[0078] In one embodiment provided in this specification, data from the second playback attribute adjustment information and the first playback attribute adjustment information are first integrated. For example, the frequency band distribution of the ambient noise is combined with the device frequency response curve, which can be used to determine the parameters of the frequency band gain or attenuation, and generate playback strategies such as the dynamic range compression ratio. On this basis, different filters such as IIR (Infinite Impulse Response), FIR (Finite Impulse Response), bandpass filter, high-pass filter, low-pass filter, etc. are applied to optimize the audio frequency range to adapt it to different device hardware characteristics and playback environments. In addition, combined with dynamic gain control and dynamic range compression algorithms, the volume output is balanced to ensure clear voice in a noisy environment and retain natural timbre dynamics in a quiet environment. This process also adapts to different device characteristics through real-time adjustment of the equalization curve (EQ). For example, high-frequency details are optimized in high-fidelity speakers, while intermediate frequencies are enhanced in portable devices to highlight voice effects. During audio playback, the playback parameters are continuously updated by real-time monitoring of device status and environmental changes to ensure that the audio effect is always in the best state.

[0079] This combined operation achieves consistency and high quality of audio playback in multiple devices and multiple scenarios, solving the key problems of insufficient frequency response of low-end devices and complex environments affecting sound quality. It not only improves the user's listening experience on multiple devices, but also significantly enhances the applicability and flexibility of audio playback technology in complex environments.

[0080] It should be noted that, in order to further improve the playback effect of the audio to be played, low-frequency noise can be removed by a low-pass filter before playing the audio to be played, for example, by selecting a low-frequency cut-off point below a specific frequency, and by adjusting the specified parameters to ensure that the filter effectively removes unnecessary low-frequency components; the high-frequency part can also be compensated by a high-pass filter, and the frequency band above the specific frequency can be enhanced to make the audio details richer; the loudness range can also be adjusted by a preset algorithm to ensure that the sound quality is balanced at low volume, while avoiding distortion caused by excessive volume. This manual does not impose any restrictions on this.

[0081] Further, playing the audio to be played according to the second playback attribute adjustment information and the first playback attribute adjustment information includes: Obtaining audio type information corresponding to the audio to be played; generating third playback attribute adjustment information based on the audio type information; The to-be-played audio is played according to the second play attribute adjustment information, the first play attribute adjustment information, and the third play attribute adjustment information.

[0082] In actual applications, the audio type information is a parameter that describes the characteristics of the audio content to be played, such as whether the audio is voice, music or ambient sound; the third playback attribute adjustment information is an adjustment parameter generated based on the audio type information for optimizing the audio playback effect, which helps to make adaptive adjustments for different types of audio.

[0083] Audio type information can be understood as key information that characterizes the category of audio content to be played and its characteristics. This information can be obtained through metadata or signal analysis of audio files, such as by parsing the audio format or spectrum characteristics to determine whether the audio is speech, background music, or natural environment sound effects. For example, speech content is usually dominated by the mid-frequency band (1-4 kHz), while music may cover a wider frequency range. The acquisition of audio type information provides targeted guidance for subsequent optimization strategies to ensure that audio of different content types can achieve the best playback effect.

[0084] The third playback attribute adjustment information can be understood as a set of optimized parameters designed according to the audio type information, which is used to adapt to the playback requirements of different types of audio. These parameters may include dynamic equalization adjustment, frequency band compensation, and dynamic range optimization. For example, when playing voice, the third playback attribute adjustment information may contain parameters for enhancing the mid-frequency band to improve the clarity and intelligibility of the voice; when playing music, it may increase the energy of the low-frequency band (such as enhancing the 60-200 Hz range) to enhance the bass effect while balancing the details of the high-frequency band (such as optimizing frequencies above 8 kHz). By combining the second playback attribute adjustment information with the first playback attribute adjustment information, the third playback attribute adjustment information ensures that the audio playback effect can meet the requirements of both the content type and the device environment, thereby providing users with a richer auditory experience.

[0085] The scheme of the embodiment of this specification is applied, by collecting environmental data and device data respectively under multiple scenarios and multiple types of device conditions, and converting them into second playback attribute adjustment information and first playback attribute adjustment information, so as to realize multi-dimensional adaptive adjustment of the same audio content, and greatly reduce the problem of inconsistent listening effects caused by differences between devices and environments. Especially in scenarios where the output capacity of hardware such as mobile terminals or low-end speakers is limited, the sound quality loss caused by the inherent deficiencies of the equipment is alleviated by targeted compensation and optimization of the low-frequency and high-frequency parts, while also avoiding the embarrassment of not being able to achieve voice clarity and frequency band balance in noisy occasions due to the lack of environmental adaptive mechanism. With the help of dual information at the environmental and device levels, this scheme can automatically adjust the audio playback parameters according to the real-time noise level or device type differences, which is suitable for high-fidelity audio systems and can also provide users with a more consistent high-quality listening experience on weak output devices.

[0086] The following combination Figure 2 , taking the application of the audio playing method provided in this specification in the game audio playing method as an example, the audio playing method is further described. Figure 2 A flowchart of a processing process of a game audio playback method provided by an embodiment of the present specification is shown, which specifically includes the following steps.

[0087] Step 202: Obtain the audio to be played.

[0088] Step 204: Obtain playback environment information and playback device information.

[0089] Step 206: parse the playback environment information to extract environmental sound feature information, and generate second playback attribute adjustment information based on the environmental sound feature information.

[0090] Step 208: Parse the playback device information, extract the device type information or the device frequency band playback information, and generate first playback attribute adjustment information based on the device type information and the device frequency band playback information.

[0091] Step 210: using a digital filter (IIR, FIR, bandpass, highpass, lowpass, etc.) and combining the second playback attribute adjustment information and the first playback attribute adjustment information to adjust the frequency band of the audio to be played and perform high and low cut filtering.

[0092] Step 212: Correct the EQ curve of the audio to be played by combining the second playback attribute adjustment information and the first playback attribute adjustment information through a dynamic equalization algorithm.

[0093] Step 214: using a dynamic gain control and dynamic range compression algorithm, combined with the second playback attribute adjustment information and the first playback attribute adjustment information, to adjust the loudness and dynamic range of the audio to be played.

[0094] Step 216: Play the audio to be played after the above adjustment.

[0095] Step 218: Monitor the status information of the device.

[0096] Step 220: Determine whether the status information of the device has changed. If so, execute step 204; if not, execute step 218.

[0097] The scheme of the embodiment of the present specification is applied, with the help of dual analysis of environmental sound feature information and device type information or device frequency band playback information, and after obtaining the audio to be played, digital filtering, dynamic gain control and dynamic equalization correction are successively performed, which can be flexibly adapted to various device types and complex external environments. For the low-frequency and high-frequency deficiencies caused by mobile terminals or low-end output devices, the frequency band compensation and loudness optimization brought by the second playback attribute adjustment information and the first playback attribute adjustment information can significantly improve the listening experience and avoid the trouble of inconsistent sound quality between different devices and usage scenarios. When a change in device status is detected, the environment and device information is obtained and analyzed again, and the playback attribute adjustment parameters are updated in time, so as to achieve continuous dynamic optimization of the audio, highlight the voice details in noisy scenes, and retain richer timbre levels in quiet environments, so that the audio can maintain a stable and high-quality playback effect in various occasions and devices.

[0098] Corresponding to the above method embodiment, this specification also provides an audio playback device embodiment, Figure 3 FIG. 1 shows a schematic diagram of the structure of an audio playback device provided by an embodiment of the present specification. Figure 3 As shown, the device comprises: The acquisition module 302 is configured to acquire the audio to be played and the playback device information; The first generating module 304 is configured to generate first playback attribute adjustment information based on the playback device information, wherein the first playback attribute adjustment information is used to adjust the sound quality performance of the audio to be played when it is played on different devices; The playing module 306 is configured to play the audio to be played according to the first playing attribute adjustment information.

[0099] Optionally, the audio playback device further includes a second generating module configured to: Get playback environment information; generating second playback attribute adjustment information according to the playback environment information, wherein the second playback attribute adjustment information is used to adjust the sound quality performance of the audio to be played when being played under different external environments; Accordingly, the playing module 306 is further configured to: The to-be-played audio is played according to the second play attribute adjustment information and the first play attribute adjustment information.

[0100] Optionally, the second generating module is further configured to: Determining ambient sound characteristic information based on the playback environment information; Second playback attribute adjustment information is generated based on the environmental sound feature information.

[0101] Optionally, the environmental sound characteristic information includes environmental frequency band energy distribution information; The second generating module is further configured to: Determine at least one frequency band to be adjusted and playback frequency band adjustment information corresponding to each frequency band to be adjusted based on the environmental frequency band energy distribution information; The second playback attribute adjustment information is generated according to each playback frequency band adjustment information.

[0102] Optionally, the environmental sound characteristic information includes environmental volume information; The second generating module is further configured to: Audio loudness adjustment information is determined based on the environmental volume information, and second playback attribute adjustment information is generated based on the audio loudness adjustment information.

[0103] Optionally, the first generating module 304 is further configured to: Parsing the playback device information to obtain device type information; Device type adaptation information is determined based on the device type information, and first playback attribute adjustment information is generated based on the device type adaptation information.

[0104] Optionally, the first generating module 304 is further configured to: In a case where the device type information is a first type of device, the device type adaptation information is determined to be voice enhancement adjustment information.

[0105] Optionally, the first generating module 304 is further configured to: Parsing the playback device information to obtain device frequency band playback information; The audio device adaptation information is determined based on the device frequency band playback information, and the first playback attribute adjustment information is generated based on the audio device adaptation information.

[0106] Optionally, the first generating module 304 is further configured to: Parsing the device frequency band playback information to obtain the device high frequency playback information and the device low frequency playback information; In a case where the high-frequency playback information of the device meets the high-frequency adjustment condition, generating high-frequency adjustment information based on the high-frequency playback information of the device, and acquiring audio device adaptation information according to the high-frequency adjustment information; In a case where the low-frequency playing information of the device meets the low-frequency adjustment condition, low-frequency adjustment information is generated based on the low-frequency playing information of the device, and audio device adaptation information is acquired according to the low-frequency adjustment information.

[0107] Optionally, the playing module 306 is further configured to: Obtaining audio type information corresponding to the audio to be played; generating third playback attribute adjustment information based on the audio type information; The to-be-played audio is played according to the second play attribute adjustment information, the first play attribute adjustment information, and the third play attribute adjustment information.

[0108] By applying the solution of the embodiment of this specification, by synchronously collecting environmental data and device data in the acquisition module, and using the first generation module and the second generation module to perform in-depth analysis of environmental characteristics and device characteristics, low frequency, high frequency and loudness and other dimensions can be dynamically compensated and optimized. Especially on mobile devices or speakers with limited output capacity, the listening gap caused by insufficient low frequency and high frequency can be significantly improved through accurate analysis of frequency band distribution and volume information, while maintaining voice clarity and sound quality balance in different external environments. After integrating these compensation information, the playback module allows the audience to feel stable sound quality performance even in a noisy environment on the one hand, and achieves higher consistency between multiple output devices such as headphones and speakers on the other hand. When the audio type information is added to the generation process of the third playback attribute adjustment parameter, it can further differentiate music, voice or other audio content, thereby reducing the impact of hardware performance and environmental differences on sound quality.

[0109] The above is a schematic scheme of an audio playback device of this embodiment. It should be noted that the technical scheme of the audio playback device and the technical scheme of the above audio playback method belong to the same concept, and the details not described in detail in the technical scheme of the audio playback device can be referred to the description of the technical scheme of the above audio playback method.

[0110] Figure 4 The block diagram of a computing device 400 according to one embodiment of the present specification is shown. The components of the computing device 400 include but are not limited to a memory 410 and a processor 420. The processor 420 is connected to the memory 410 via a bus 430, and the database 450 is used to store data.

[0111] The computing device 400 also includes an access device 440 that enables the computing device 400 to communicate via one or more networks 460. Examples of these networks include a public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or a combination of communication networks such as the Internet. The access device 440 may include one or more of any type of network interface (e.g., a network interface card (NIC)) that is wired or wireless, such as an IEEE 802.11 wireless local area network (WLAN) wireless interface, a world-wide interoperability for microwave access (Wi-MAX) interface, an Ethernet interface, a universal serial bus (USB) interface, a cellular network interface, a Bluetooth interface, and a near field communication (NFC).

[0112] In one embodiment of the present specification, the above components of the computing device 400 and Figure 4 Other components not shown in the figure may also be connected to each other, for example, via a bus. It should be understood that Figure 4 The computing device structure block diagram shown is only for the purpose of illustration, and is not intended to limit the scope of this specification. Those skilled in the art can add or replace other components as needed.

[0113] The computing device 400 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., a tablet computer, a personal digital assistant, a laptop computer, a notebook computer, a netbook, etc.), a mobile phone (e.g., a smart phone), a wearable computing device (e.g., a smart watch, smart glasses, etc.), or other types of mobile devices, or a stationary computing device such as a desktop computer or a personal computer (PC). The computing device 400 may also be a mobile or stationary server.

[0114] The processor 420 is used to execute the following computer executable instructions, which implement the steps of the above-mentioned audio playback method when executed by the processor.

[0115] The above is a schematic scheme of a computing device of this embodiment. It should be noted that the technical scheme of the computing device and the technical scheme of the above audio playback method belong to the same concept, and the details not described in detail in the technical scheme of the computing device can be referred to the description of the technical scheme of the above audio playback method.

[0116] An embodiment of the present specification further provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the steps of the above-mentioned audio playback method.

[0117] The above is a schematic scheme of a computer-readable storage medium of this embodiment. It should be noted that the technical scheme of the storage medium and the technical scheme of the above-mentioned audio playback method belong to the same concept, and the details not described in detail in the technical scheme of the storage medium can be referred to the description of the technical scheme of the above-mentioned audio playback method.

[0118] An embodiment of the present specification also provides a computer program product, including a computer program / instruction, which implements the steps of the above-mentioned audio playback method when executed by a processor.

[0119] The above is an illustrative solution of a computer program of this embodiment. It should be noted that the technical solution of the computer program and the technical solution of the above audio playback method belong to the same concept, and the details not described in detail in the technical solution of the computer program can be found in the description of the technical solution of the above audio playback method.

[0120] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0121] The computer instructions include computer program codes, which may be in source code form, object code form, executable files or some intermediate forms, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable medium may be appropriately increased or decreased according to the requirements of patent practice. For example, in some regions, according to patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0122] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of this specification are not limited by the order of the actions described, because according to the embodiments of this specification, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the embodiments of this specification.

[0123] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0124] The preferred embodiments of this specification disclosed above are only used to help explain this specification. The optional embodiments do not describe all the details in detail, nor do they limit the invention to only the specific implementation methods described. Obviously, many modifications and changes can be made according to the content of the embodiments of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the embodiments of this specification, so that technicians in the relevant technical field can well understand and use this specification. This specification is only limited by the claims and their full scope and equivalents.

Claims

1. An audio playback method, characterized in that: include: Get the audio to be played and the playback device information; generating first playback attribute adjustment information based on the playback device information, wherein the first playback attribute adjustment information is used to adjust the sound quality performance of the audio to be played when played on different devices; The to-be-played audio is played according to the first play attribute adjustment information.

2. The method according to claim 1, characterized in that Also includes: Get playback environment information; generating second playback attribute adjustment information according to the playback environment information, wherein the second playback attribute adjustment information is used to adjust the sound quality performance of the audio to be played when being played under different external environments; Correspondingly, playing the audio to be played according to the first playback attribute adjustment information includes: The to-be-played audio is played according to the second play attribute adjustment information and the first play attribute adjustment information.

3. The method according to claim 2, characterized in that Generating second playback attribute adjustment information according to the playback environment information includes: Determining ambient sound characteristic information based on the playback environment information; Second playback attribute adjustment information is generated based on the environmental sound feature information.

4. The method according to claim 3, characterized in that The environmental sound characteristic information includes environmental frequency band energy distribution information; Generating second playback attribute adjustment information based on the environmental sound feature information includes: Determine at least one frequency band to be adjusted and playback frequency band adjustment information corresponding to each frequency band to be adjusted based on the environmental frequency band energy distribution information; The second playback attribute adjustment information is generated according to each playback frequency band adjustment information.

5. The method according to claim 3, characterized in that The environmental sound characteristic information includes environmental volume information; Generating second playback attribute adjustment information based on the environmental sound feature information includes: Audio loudness adjustment information is determined based on the environmental volume information, and second playback attribute adjustment information is generated based on the audio loudness adjustment information.

6. The method according to claim 1, characterized in that Generating first playback attribute adjustment information based on the playback device information includes: Parsing the playback device information to obtain device type information; Device type adaptation information is determined based on the device type information, and first playback attribute adjustment information is generated based on the device type adaptation information.

7. The method according to claim 6, characterized in that Determining device type adaptation information based on the device type information includes: In a case where the device type information is a first type of device, the device type adaptation information is determined to be voice enhancement adjustment information.

8. The method according to claim 1, characterized in that Generating first playback attribute adjustment information based on the playback device information includes: Parsing the playback device information to obtain device frequency band playback information; The audio device adaptation information is determined based on the device frequency band playback information, and the first playback attribute adjustment information is generated based on the audio device adaptation information.

9. The method according to claim 8, characterized in that Determining audio device adaptation information based on the device frequency band playback information includes: Parsing the device frequency band playback information to obtain the device high frequency playback information and the device low frequency playback information; In a case where the high-frequency playback information of the device meets the high-frequency adjustment condition, generating high-frequency adjustment information based on the high-frequency playback information of the device, and acquiring audio device adaptation information according to the high-frequency adjustment information; In a case where the low-frequency playing information of the device meets the low-frequency adjustment condition, low-frequency adjustment information is generated based on the low-frequency playing information of the device, and audio device adaptation information is acquired according to the low-frequency adjustment information.

10. The method according to claim 2, characterized in that Playing the to-be-played audio according to the second playback attribute adjustment information and the first playback attribute adjustment information includes: Obtaining audio type information corresponding to the audio to be played; generating third playback attribute adjustment information based on the audio type information; The to-be-played audio is played according to the second play attribute adjustment information, the first play attribute adjustment information, and the third play attribute adjustment information.

11. An audio playback device, characterized in that: include: An acquisition module, configured to acquire information of the audio to be played and the playback device; A second generating module is configured to generate first playback attribute adjustment information based on the playback device information, wherein the first playback attribute adjustment information is used to adjust the sound quality performance of the audio to be played when it is played on different devices; The playing module is configured to play the audio to be played according to the first playing attribute adjustment information.

12. A computing device, characterized in that: include: Memory and processor; The memory is used to store computer programs / instructions, and the processor is used to execute the computer programs / instructions. When the computer programs / instructions are executed by the processor, the steps of the method according to any one of claims 1 to 10 are implemented.

13. A computer-readable storage medium storing a computer program / instruction, characterized in that: When the computer program / instructions are executed by a processor, the steps of the method according to any one of claims 1 to 10 are implemented.

14. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instructions are executed by a processor, the steps of the method according to any one of claims 1 to 10 are implemented.

Images