Audio processing method and device and storage medium

Abstract

The invention discloses an audio processing method and device and a storage medium, and the method comprises the steps: obtaining multi-channel audio data of multimedia data, searching for an external audio device supporting each channel of audio data from a plurality of external audio devices of a multimedia playing device, and carrying out the searching of the external audio devices, and if a certain path of audio data is supported by at least two external audio devices in the plurality of external audio devices, sending the audio data to the external audio device in the at least two external audio devices for playing, wherein the distance between the external audio device and the sound source corresponding to the audio data meets a distance condition. Therefore, the sound quality effect can be improved by adaptively selecting the external audio equipment for playing the audio data.

Description

Technical Field

[0001] The present application relates to the field of smart home technology, and in particular to an audio processing method, device and storage medium. Background Art

[0002] Since high-end smart screens support a large number of audio channels, have good sound quality and are expensive, while mid- and low-end smart screens support a small number of audio channels, have poor sound quality and are low in price, most users choose low-priced mid- and low-end smart screens. However, due to the limited number of audio channels supported by mid- and low-end smart screens, the sound quality is poor when playing multimedia data with multiple audio channels. Summary of the invention

[0003] In order to solve the problem of poor sound quality when playing multimedia data of multiple audio channels due to the limited number of audio channels supported by mid- and low-end smart screens, the embodiments of the present application provide an audio processing method, device and storage medium.

[0004] A first aspect provides an audio processing method, which is applied to a device, comprising: obtaining multimedia data to be played, the multimedia data to be played comprising N channels of audio data; determining that, among M external audio devices of the device, there is an external audio device that supports a first channel of audio data among the N channels of audio data; selecting a first external audio device from the M external audio devices, whose distance to a first sound source corresponding to the first channel of audio data meets a distance condition, to play the first channel of audio data; wherein M and N are integers greater than 2.

[0005] Based on the above solution, when at least two of the multiple external audio devices of the device support one channel of audio data in the multimedia data, the sound quality effect can be improved by adaptively selecting the external audio device that plays the audio data.

[0006] It is understood that the device may be a multimedia playback device. In some specific implementations, the device may be a device such as a smart screen, a television, etc. that can play video and audio, or the device may be a device that can only play audio. For example, the device includes the multimedia playback device in the embodiment.

[0007] It can be understood that the multimedia data can be data with multiple audio data such as movies. For example, the multimedia data can include 8 audio data consisting of 3 human voices, 1 bass, 2 surround sound and 2 sky sound. Each audio data can also be called audio channel data.

[0008] In some optional instances, the first channel of audio data may be sky sound audio data, surround sound audio data, or other types of audio data, which is not specifically limited in the embodiments of the present application.

[0009] It can be understood that the types of audio data may include left channel, right channel, bass, surround sound, sky sound, etc.

[0010] In a possible implementation of the first aspect above, the distance condition includes: the distance between the sound sources corresponding to the audio data is the shortest.

[0011] It can be understood that the sound source (i.e., the sound position) corresponding to the audio data in the device may be changeable. For example, a horse runs from the right side of the smart screen to the left side of the smart screen, and the neighing sound of the horse (sound source) continuously changes and moves from the right side of the smart screen to the left side of the smart screen, that is, the sound source corresponding to the audio data is changing.

[0012] In some optional instances, the distance condition may also include that the distance between the sound sources corresponding to the audio data is within a distance threshold range.

[0013] In a possible implementation of the first aspect, a supported audio data type is set for each of the M external audio devices.

[0014] It can be understood that the type of audio data may include at least one of a left channel, a right channel, bass, sky sound, and surround sound.

[0015] It can be understood that a first ranging module can be installed on the device, and a second ranging module can be installed on each external audio device. A three-dimensional spatial rectangular coordinate system can be constructed with the first ranging module on the device as the origin, wherein the three-dimensional spatial rectangular coordinate system can have a first direction X, a second direction Y and a third direction Z, and the first direction X, the second direction Y and the third direction Z are perpendicular to each other. Then, the relative position information of each external audio device relative to the device can be obtained based on the first ranging module on the device and the second ranging module on each external audio device. Among them, the relative position information of each external audio device relative to the device can be expressed in the form of (x, y, z), wherein x can represent the coordinates of the second ranging module on the external audio device in the first direction X of the spatial rectangular coordinate system, y can represent the coordinates of the second ranging module on the external audio device in the second direction Y of the spatial rectangular coordinate system, and z can represent the coordinates of the second ranging module on the external audio device in the third direction Z of the spatial rectangular coordinate system.

[0016] In some optional instances, the device can intelligently generate an adaptive solution, i.e., an audio data tag for each external audio device based on the distance between each of the M external audio devices and the device, wherein the audio data tag indicates the type of audio data supported by the external audio device.

[0017] In the embodiment of the present application, by intelligently determining the type of audio data supported by each external audio device based on the distance between each external audio device and the device in the M external audio devices, the type of audio data supported by the external audio device can be adaptively adjusted based on the positions of the M external audio devices, thereby reducing the situation where the external audio device still supports a fixed type of audio data at different positions, resulting in poor sound quality, and improving the sound quality.

[0018] In a possible implementation of the first aspect, setting a type of audio data supported for each of the M external audio devices includes: setting a type of audio data supported by each of the M external audio devices based on a distance between each of the M external audio devices and the device.

[0019] In some optional examples, the type of audio data supported can be set for each of the M external audio devices based on user selection, so as to meet the personalized needs of the user.

[0020] In a possible implementation of the first aspect above, based on the distance between each of the M external audio devices and the device, setting the type of audio data supported by each external audio device includes: setting the type of audio data supported by the second external audio device among the M external audio devices to sky sound, and setting the type of audio data supported by the third external audio device among the M external audio devices to surround sound, wherein the distance between the second external audio device and the device is greater than the distance between the third external audio device and the device.

[0021] In a possible implementation of the first aspect above, the type of audio data supported by each external audio device is set based on the distance between each of the M external audio devices and the device, including: constructing a spatial rectangular coordinate system with the device as the origin, wherein the spatial rectangular coordinate system includes multiple subspaces, and different subspaces correspond to different audio data types; determining the type of audio data supported by each external audio device according to the subspace in which each of the M external audio devices is located in the spatial rectangular coordinate system.

[0022] In some optional instances, classification criteria for audio data labels of external audio devices can be set in the user interface (UI) of the smart screen. The classification criteria need to weigh the position of the external audio device relative to the smart screen and take into account the support of multiple audio data, such as supporting surround sound audio data and sky sound audio data.

[0023] For example, in the first step, an external audio device whose coordinate x in the first direction X is within the interval [-5m, 5m], whose coordinate y in the second direction Y is within the interval [-5m, 5m], and whose coordinate in the third direction Z is within the interval [-0.3m, 0.5m] can be set to support surround sound audio data. The space in which the coordinate x in the first direction X is within the interval [-5m, 5m], the coordinate y in the second direction Y is within the interval [-5m, 5m], and the coordinate in the third direction Z is within the interval [-0.3m, 0.5m] can be called the first subspace.

[0024] In the second step, the external audio device whose coordinate x in the first direction X is within the interval [-5m, 5m], whose coordinate y in the second direction Y is within the interval [-5m, 5m], and whose coordinate in the third direction Z is within the interval [1m, 5m] can be set to support sky sound audio data. The space in which the coordinate x in the first direction X is within the interval [-5m, 5m], the coordinate y in the second direction Y is within the interval [-5m, 5m], and the coordinate in the third direction Z is within the interval [1m, 5m] can be called the second subspace.

[0025] When the multiple external audio devices of the device do not include an external audio device that supports surround sound audio data, that is, the type of audio data supported by the external audio device is set in the first and second steps, and the external audio device is not set to support surround sound, the device sets the external audio devices that meet the conditions to support surround sound to ensure that there are external audio devices that support both surround sound and sky sound audio data types.

[0026] For example, an external audio device whose coordinate x in the first direction X is in the interval [-5m, 5m], whose coordinate y in the second direction Y is in the interval [-5m, 5m], and whose coordinate in the third direction Z is in the interval (0.5m, 1m) is set to support surround sound audio data. The space in which the coordinate x in the first direction X is in the interval [-5m, 5m], the coordinate y in the second direction Y is in the interval [-5m, 5m], and the coordinate in the third direction Z is in the interval (0.5m, 1m) can be called a third subspace.

[0027] When the multiple external audio devices of the device do not include an external audio device that supports sky audio data, that is, the device sets the type of audio data supported by the external audio device in the first and second steps, and does not set the external audio device to support sky audio, the multimedia playback device sets the external audio device that meets the conditions to support sky audio to ensure that there are external audio devices that support both surround sound and sky audio audio data types.

[0028] For example, an external audio device whose coordinate x in the first direction X is in the interval [-5m, 5m], whose coordinate y in the second direction Y is in the interval [-5m, 5m], and whose coordinate in the third direction Z is in the interval (0.5m, 1m) is set to support sky sound audio data.

[0029] In a possible implementation of the first aspect above, it also includes: determining that among the M external audio devices of the device, there is an external audio device that supports the second audio data and the third audio data among the N audio data; the external audio device corresponding to the second sound source corresponding to the second audio data satisfies the distance condition as a fourth external audio device, and the external audio device corresponding to the third sound source corresponding to the third audio data satisfies the distance condition as a fourth external audio device, mixing the second audio data and the third audio data, and sending them to the fourth external audio device for playback.

[0030] In a possible implementation of the first aspect above, it also includes: determining that among the M external audio devices of the device, there is an external audio device that supports the second channel of audio data and the third channel of audio data among the N channels of audio data; the external audio devices corresponding to the second sound source corresponding to the second channel of audio data satisfying the distance condition are the fifth external audio device and the sixth external audio device, and the external audio devices corresponding to the third sound source corresponding to the third channel of audio data satisfying the distance condition are the fifth external audio device and the sixth external audio device, sending the second channel of audio data to the fifth external audio device for playback, and sending the third channel of audio data to the sixth external audio device for playback.

[0031] The second aspect provides a device, including: one or more processors; one or more memories; one or more memories storing one or more programs, when the one or more programs are executed by one or more processors, the device executes the audio processing method mentioned in this application.

[0032] A third aspect provides a readable storage medium, on which a program is stored. When the program is executed on a device, the device executes the audio processing method mentioned in the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 According to some examples of the present application, a schematic diagram of an application scenario is shown;

[0034] Figure 2 According to some examples of the present application, a schematic diagram of an application scenario is shown;

[0035] Figure 3 According to some examples of the present application, a schematic diagram of an application scenario is shown;

[0036] Figure 4 According to some examples of the present application, a flowchart of an audio processing method is shown;

[0037] Figure 5 According to some examples of the present application, a schematic diagram of establishing a spatial rectangular coordinate system is shown;

[0038] Figure 6 According to some examples of the present application, a flow chart of a method for classifying audio data labels of an external audio device is shown;

[0039] Figure 7 According to some examples of the present application, a schematic diagram of detecting position information of a sound source in a spatial rectangular coordinate system is shown;

[0040] Figure 8 According to some examples of the present application, a schematic diagram of determining a target audio device is shown;

[0041] Fig. 9 According to some examples of the present application, a schematic diagram of a process of playing a video on a smart screen is shown;

[0042] Fig.10 According to some examples of the present application, a structural schematic diagram of an audio processing system is shown;

[0043] Fig.11 According to some examples of the present application, a schematic diagram of a framework of an audio processing method is shown.

[0044] Fig.12 According to some examples of the present application, a schematic diagram of the hardware structure of a device is shown. DETAILED DESCRIPTION

[0045] The illustrative embodiments of the present application include but are not limited to an audio processing method, device and storage medium. It can be understood that the audio processing method provided in the embodiments of the present application can be applied to the scenario where a mid-to-low-end smart screen is connected to multiple audio devices to play multimedia data of multiple audio channels.

[0046] The following is an introduction to the methods of audio processing for mid- and low-end smart screens mentioned in some embodiments.

[0047] In some embodiments, Figure 1As shown, the smart screen comes with a left speaker 110, a right speaker 120 and a bass speaker 130, that is, the smart screen supports 2.1 audio channels. When playing multimedia data with multiple audio data of left channel audio data, right channel audio data, bass audio data, surround sound audio data and sky sound audio data, since the speakers of the smart screen do not support surround sound audio data and sky sound audio data, a common processing method is to mix the left channel audio data, the right channel audio data, the surround sound audio data and the sky sound audio data into one channel of audio data, and copy the audio data into two copies, one of which is sent to the left channel speaker 110 for playback, and the other is sent to the right channel speaker 120 for playback, and the bass audio data is sent to the bass speaker 130 for playback. In this way, the surround sound and sky sound are not obvious, and the sound quality effect is poor.

[0048] In other embodiments, the user can choose to use the smart screen with an external audio device to play multimedia data with multiple audio data. However, when the external audio device is located at a different position, only one fixed type of audio data is supported, and the fixed type of audio data in the multimedia data can only be sent to a fixed external audio device for playback, resulting in poor sound quality.

[0049] For example, Figure 2 As shown, a smart screen 210 is used in combination with an external audio device 220 and an external audio device 230 to play multimedia data having multiple audio data including left channel audio data, right channel audio data, bass audio data, surround sound audio data and sky sound audio data. The user can pre-set the type of audio data that each external audio device supports, such as setting the external audio device 220 to support surround sound and the external audio device 230 to support sky sound audio data, that is, the external audio device 220 supports surround sound audio data when it is in the first position (the position corresponding to the solid line), and the external audio device 220 still supports surround sound when it is in the second position (the position corresponding to the dotted line), and the surround sound audio data can only be sent to the external audio device 220 for playback. In this way, the sound quality effect is poor.

[0050] In order to solve the problem of poor sound quality mentioned above, an embodiment of the present application provides an audio processing method. In the audio processing method, multiple channels of audio data of multimedia data are obtained, and an external audio device that supports each channel of audio data is searched from multiple external audio devices of the multimedia playback device. If a channel of audio data is supported by at least two external audio devices among the multiple external audio devices, the audio data is sent to an external audio device among the at least two external audio devices whose distance to the sound source corresponding to the channel of audio data meets the distance condition for playback. In this way, the sound quality effect can be improved by adaptively selecting an external audio device that plays audio data.

[0051] It can be understood that multimedia playback devices include but are not limited to smart screens, televisions, and other devices that can play video and audio, or only play audio, and external audio devices include but are not limited to speakers and other devices with audio playback functions.

[0052] It can be understood that the types of audio data may include left channel, right channel, bass, surround sound, sky sound, etc.

[0053] In some optional examples, the type of audio data supported by each of the multiple external audio devices of the multimedia playback device can be set based on the position of each external audio device relative to the multimedia playback device.

[0054] For example, in the first step, the multimedia playback device can construct a three-dimensional spatial rectangular coordinate system with the multimedia playback device as the origin, wherein the three-dimensional spatial rectangular coordinate system can have a first direction X, a second direction Y and a third direction Z, and the first direction X, the second direction Y and the third direction Z are perpendicular to each other.

[0055] In the second step, the multimedia playback device can set the external audio device whose coordinate x in the first direction X is within the interval [-5m, 5m], whose coordinate y in the second direction Y is within the interval [-5m, 5m], and whose coordinate in the third direction Z is within the interval [-0.3m, 0.5m] to support surround sound audio data. The space whose coordinate x in the first direction X is within the interval [-5m, 5m], whose coordinate y in the second direction Y is within the interval [-5m, 5m], and whose coordinate in the third direction Z is within the interval [-0.3m, 0.5m] can be called the first subspace

[0056] In the third step, the multimedia playback device can set the external audio device whose coordinate x in the first direction X is within the interval [-5m, 5m], whose coordinate y in the second direction Y is within the interval [-5m, 5m], and whose coordinate in the third direction Z is within the interval [1m, 5m] to support sky sound audio data. The space where the coordinate x in the first direction X is within the interval [-5m, 5m], the coordinate y in the second direction Y is within the interval [-5m, 5m], and the coordinate in the third direction Z is within the interval [1m, 5m] can be called the second subspace.

[0057] In the fourth step, when the multiple external audio devices of the multimedia playback device do not include an external audio device that supports surround sound audio data, that is, the multimedia playback device sets the type of audio data supported by the external audio device in the second and third steps, and does not set the external audio device to support surround sound, the multimedia playback device sets the external audio device that meets the conditions to support surround sound, so as to ensure that there are external audio devices that support both surround sound and sky sound audio data types. For example, the external audio device whose coordinate x in the first direction X is within the interval [-5m, 5m], the coordinate y in the second direction Y is within the interval [-5m, 5m], and the coordinate in the third direction Z is within the interval (0.5m, 1m) is set to support surround sound audio data. Among them, the space whose coordinate x in the first direction X is within the interval [-5m, 5m], the coordinate y in the second direction Y is within the interval [-5m, 5m], and the coordinate in the third direction Z is within the interval (0.5m, 1m) can be called the third subspace.

[0058] When the multiple external audio devices of the multimedia playback device do not include an external audio device that supports sky sound audio data, that is, the multimedia playback device sets the type of audio data supported by the external audio device in the second and third steps, and does not set the external audio device to support sky sound, the multimedia playback device sets the external audio device that meets the conditions to support sky sound, so as to ensure that there are external audio devices that support both surround sound and sky sound audio data types. Set the external audio device whose coordinate x in the first direction X is in the interval [-5m, 5m], whose coordinate y in the second direction Y is in the interval [-5m, 5m], and whose coordinate in the third direction Z is in the interval (0.5m, 1m) to support sky sound audio data. In this way, by adaptively adjusting the audio data supported by each external audio device of the multimedia playback device based on the position of each external audio device of the multimedia playback device, the sound quality effect can be improved.

[0059] In some optional examples, each channel of audio data in the multimedia data may be sent in the following manner:

[0060] When there is only one external audio device supporting audio data among the multiple external audio devices of the multimedia playback device, the audio data is sent to the external audio device supporting the audio data for playback.

[0061] When there are multiple external audio devices supporting audio data among the multiple external audio devices of the multimedia playback device, the audio data is sent to the external audio device whose distance to the sound source corresponding to the audio data meets the distance condition for playback. In this way, the sound quality effect can be improved by adaptively adjusting the external audio device playing the audio data.

[0062] When there is no audio device supporting the audio data among the multiple external audio devices of the multimedia playback device, the audio data is mixed with the audio data of other external audio devices that do not support it into one channel of audio data, and the one channel of audio data is copied into two copies, one of which is sent to the left speaker of the multimedia playback device for playback, and the other is sent to the right speaker of the multimedia playback device for playback.

[0063] For example, Figure 3 As shown, the multimedia playback device can set the type of audio data supported by each external audio device based on the method mentioned above.

[0064] Specifically, the multimedia playback device can set the external audio device 320 and the external audio device 330 of the multimedia playback device 310 to support sky sound audio data, and set the external audio device 340 and the external audio device 350 to support surround sound audio data.

[0065] When playing multimedia data, since both the external audio device 320 and the external audio device 330 support skytone audio data, and the distance between the external audio device 320 and the multimedia playback device 310 is smaller than the distance between the external audio device 330 and the multimedia playback device 310, the skytone audio data in the multimedia data can be sent to the external audio device 320 for playback.

[0066] When playing multimedia data, since the external audio device 320, the external audio device 330, the external audio device 340 and the external audio device 350 do not support bass audio data, the left channel audio data, the right channel audio data and the bass audio data can be processed into one channel of audio data, and the one channel of audio data is copied into two copies, one of which is sent to the left channel speaker 110 for playback, and the other is sent to the right channel speaker 120 for playback.

[0067] The audio processing method mentioned in the embodiment of the present application is introduced below. Figure 4 A schematic diagram of a flow chart of an audio processing method is shown, such as Figure 4 As shown, the audio processing method may include:

[0068] 401: The multimedia playback device constructs a spatial rectangular coordinate system with the multimedia playback device as the origin.

[0069] It is understood that the multimedia playback device may be a smart screen, the smart screen may be equipped with a first ranging module (ultra wide band, UWB), and each external audio device of the smart screen may be equipped with a second ranging module. Figure 5As shown, a three-dimensional spatial rectangular coordinate system can be constructed with the first ranging module on the smart screen as the origin, wherein the three-dimensional spatial rectangular coordinate system can have a first direction X, a second direction Y and a third direction Z, and the first direction X, the second direction Y and the third direction Z are perpendicular to each other.

[0070] 402: The multimedia playback device determines the audio data tag of each external audio device based on the position of each external audio device in the spatial rectangular coordinate system.

[0071] It can be understood that the audio data tag of each external audio device can indicate the type of audio data supported by each external audio device.

[0072] It can be understood that the speakers of the smart screen have preset audio data labels, such as left channel, right channel and bass, and the coordinates of the speakers of the smart screen in the spatial rectangular coordinate system, that is, the position relative to the origin of the spatial rectangular coordinate system can be set in advance.

[0073] It can be understood that the relative position information of each external audio device relative to the smart screen can be obtained based on the first ranging module on the smart screen and the second ranging module on each external audio device. The relative position information of each external audio device relative to the smart screen can be expressed in the form of (x, y, z), where x can represent the coordinates of the second ranging module on the external audio device in the first direction X of the spatial rectangular coordinate system, y can represent the coordinates of the second ranging module on the external audio device in the second direction Y of the spatial rectangular coordinate system, and z can represent the coordinates of the second ranging module on the external audio device in the third direction Z of the spatial rectangular coordinate system.

[0074] In some optional instances, the classification criteria for the audio data labels of the external audio device can be set in the user interface (UI) of the smart screen. The classification criteria need to balance the position of the external audio device relative to the smart screen and support multiple audio data (i.e., multiple sound effect modes), such as supporting surround sound audio data and sky sound audio data. Specifically, the classification criteria for the audio data labels of the external audio device shown in Table 1 below can be set in the UI, which can also be called spatial boundaries, horizontal distance ranges, and vertical distance ranges.

[0075] Table 1

[0076] X Y Z Surround Sound [-5m, 5m] [-5m, 5m] [-0.3m, 0.5m] Sky Sound [-5m, 5m] [-5m, 5m] [1m, 5m]

[0077] In the classification criteria of the audio data labels of external audio devices shown in Table 1, the audio data labels of external audio devices that are within -5m to 5m relative to the smart screen in the first and second directions and within -0.3m to 0.5m relative to the smart screen in the third direction can be set to surround sound.

[0078] The audio data tag of an external audio device that is within -5m to 5m relative to the smart screen in the first direction and the second direction and within 1m to 5m relative to the smart screen in the third direction can be set to sky sound.

[0079] For an external audio device that is within -5m to 5m relative to the smart screen in the first and second directions and within 0.5m to 1m relative to the smart screen in the third direction, and there is no external audio device with an audio data tag as surround sound among the multiple external audio devices of the smart screen, the audio data tag of the external audio device that is within -5m to 5m relative to the smart screen in the first and second directions and within 0.5m to 1m relative to the smart screen in the third direction is set to surround sound.

[0080] For an external audio device that is within -5m to 5m relative to the smart screen in the first and second directions and within 0.5m to 1m relative to the smart screen in the third direction, and there is no external audio device with an audio data label as sky sound among the multiple external audio devices of the smart screen, the audio data label of the external audio device that is within -5m to 5m relative to the smart screen in the first and second directions and within 0.5m to 1m relative to the smart screen in the third direction is set to sky sound.

[0081] The specific classification method of audio data labels of external audio devices will be described in Figure 6 Described in detail in.

[0082] 403: The multimedia playback device determines a candidate audio device set from multiple external audio devices based on the audio data in the multimedia data and the audio data tag of each external audio device.

[0083] It can be understood that multimedia data can be a movie, and the movie can have multi-channel audio data, which can also be called multi-channel audio path data, such as left channel audio data, right channel audio data, bass audio data, surround sound audio data, sky sound audio data, and heavy bass audio data. The sound source (i.e., the sound position) of the movie in the smart screen can be variable. For example, a horse runs from the right side of the smart screen to the left side of the smart screen, and the neighing sound of the horse (the sound source) keeps changing and moving from the right side of the smart screen to the left side of the smart screen, that is, the sound source corresponding to the audio data is changing.

[0084] In some optional instances, when the multiple audio devices of the smart screen include multiple speakers built into the smart screen and multiple external audio devices, and there is an external audio device among the multiple audio devices of the smart screen that supports audio data corresponding to the sound source, the external audio device among the multiple audio devices that supports audio data corresponding to the sound source is determined as a candidate audio device set.

[0085] For example, if the audio data corresponding to the sound source is left-channel audio data, the speaker with the audio data label of the left channel in the speaker of the smart screen is determined as a set of candidate audio devices. If the audio data corresponding to the sound source is right-channel audio data, the speaker with the audio data label of the right channel in the speaker of the smart screen can be determined as a set of candidate audio devices. If the audio data corresponding to the sound source is bass audio data, the speaker with the audio data label of the bass label in the speaker of the smart screen can be determined as a set of candidate audio devices. If the audio data corresponding to the sound source is sky sound audio data, the external audio device with the audio data label of sky sound in the external audio device can be determined as a set of candidate audio devices. If the audio data corresponding to the sound source is surround sound audio data, the external audio device with the audio data label of surround sound in the external audio device can be determined as a set of candidate audio devices.

[0086] In some optional instances, when the multiple audio devices of the smart screen include the smart screen's own speakers and external audio devices, and there is no external audio device among the multiple audio devices of the smart screen that supports the audio data corresponding to the sound source, the left speaker and the right speaker of the smart screen are determined as the candidate audio device set.

[0087] 404: The multimedia playback device detects position information of a sound source corresponding to the multimedia data in a spatial rectangular coordinate system.

[0088] It can be understood that in order to prevent the smart screen system from freezing and causing detection abnormalities, some continuous video frames and audio frames can be selected from the video data and audio data stored in the buffer of the smart screen playback system to determine the position information of the sound source in the spatial rectangular coordinate system.

[0089] In some optional embodiments, such as Figure 7 As shown, for video data in a film, the i+10th frame to the i+15th frame can be selected from the current frame (i.e., frame i) as the first cache frame for determining the position information of the sound source in the spatial rectangular coordinate system, and for audio data in a film, the i+10th frame to the i+15th frame can be selected from the current frame (i.e., frame i) as the second cache frame for determining the position information of the sound source in the spatial rectangular coordinate system. The first cache frame and the second cache frame are input into a neural network model capable of detecting the position information of the sound source, and the neural network model is used to perform sound source detection.

[0090] 405: The multimedia playback device determines a target audio device from a set of candidate audio devices based on the position information of the sound source in the spatial rectangular coordinate system.

[0091] It can be understood that since the sound quality of the external audio device is better than that of the built-in speaker of the smart screen, when the built-in speaker of the smart screen and the external audio device exist at the same time, the external audio device can be selected as the target audio device.

[0092] In some optional instances, when there is an external audio device in the candidate audio device set that supports audio data corresponding to the sound source, that is, when there are at least two external audio devices among multiple external audio devices whose audio data tags match the audio data corresponding to the sound source, the external audio device that is closest to the sound source can be selected as the target audio device.

[0093] For example, when there is an external audio device that supports audio data corresponding to the sound source among multiple external audio devices of the smart screen, the external audio device can be determined as the target audio device. Figure 8 As shown, when only the audio data tag of the external audio device A matches the audio data corresponding to the sound source, the external audio device A can be used as the target audio device.

[0094] For example, when there are at least two external audio devices that support audio data corresponding to the sound source among the multiple external audio devices of the smart screen, the external audio device closest to the sound source among the at least two external audio devices can be determined as the target audio device. Figure 8 As shown, when the audio data tags of the external audio device A and the external audio device B match the audio data corresponding to the sound source, the distance between the external audio device A and the sound source is S A , the distance between the external audio device B and the sound source is S B , and S A <S B , you can use external audio device A as the target audio device.

[0095] In some optional instances, when there is no speaker or external audio device that supports the audio data corresponding to the sound source, the left speaker and right speaker of the smart screen can be selected as the target audio device.

[0096] like Figure 8 As shown, when the audio data tags of external audio device A, external audio device B, external audio device C, external audio device D, external audio device E, and external audio device F do not match the audio data corresponding to the sound source, the left speaker G and the right speaker H can be used as target audio devices.

[0097] 406: The multimedia playback device sends the audio data corresponding to the sound source to the target audio device.

[0098] In some optional instances, the target audio device can play the audio data corresponding to the sound source. The specific process of playing videos on the smart screen will be described in Fig. 9 Described in detail in.

[0099] In some optional instances, if the distance between the two sound sources corresponding to the two channels of audio data in the multimedia data satisfies the distance condition of the same external audio device, for example, the distance between the two sound sources corresponding to the two channels of audio data in the multimedia data satisfies the distance condition of the same external audio device, the two channels of audio data can be mixed into one channel of audio data and sent to the external audio device. For example, if the distance between the two sound sources corresponding to the two channels of audio data in the multimedia data satisfies the distance condition of the same two external audio devices, the two channels of audio data can be sent to any one of the same two external audio devices.

[0100] The following is a detailed description of the classification method of audio data tags for external audio devices. Figure 6 A schematic diagram of a method for classifying audio data labels of an external audio device is shown. Figure 6 As shown, the classification method of the audio data label of the external audio device may include:

[0101] 601: The smart screen prompts the user of the expected horizontal range in the user interface of the smart screen.

[0102] It can be understood that the classification criteria for audio data labels of external audio devices can be set in the user interface (UI) of the smart screen. The classification criteria need to weigh the position of the external audio device relative to the smart screen and take into account multiple audio data (i.e., multiple sound effect modes), such as surround sound and sky sound.

[0103] In some optional instances, the UI may prompt by default: the coordinates in the first direction X and the coordinates in the second direction Y of the spatial rectangular coordinate system are both within the expected horizontal range of the interval [-5m, 5m]. When the user determines the expected horizontal range, the expected horizontal range can be used to measure whether the horizontal position of the external audio device meets the requirements, that is, when the coordinate x of the external audio device in the first direction X and the coordinate y of the second direction Y of the spatial rectangular coordinate system are both within the interval [-5m, 5m], it can be determined that the horizontal position of the external audio device meets the requirements. Among them, the user can adaptively adjust the expected horizontal range prompted by the UI, and the UI can also prompt other expected ranges by default, which is not specifically limited in the embodiments of the present application.

[0104] 602: The smart screen determines whether the horizontal position of the external audio device meets the requirements.

[0105] It can be understood that it is possible to determine whether the horizontal position of the external audio device meets the requirements. If it meets the requirements, go to step 603; if it does not meet the requirements, go to step 604.

[0106] In some optional examples, when the UI default prompts: the coordinates in the first direction X and the coordinates in the second direction Y of the spatial rectangular coordinate system are both within the expected horizontal range of the interval [-5m, 5m], and the user determines the expected horizontal range, if the coordinates x in the first direction X and the coordinates y in the second direction Y of the external audio device in the spatial rectangular coordinate system are both within the interval [-5m, 5m], it can be determined that the horizontal position of the external audio device meets the requirements, and the process can be turned to step 603, that is, to determine whether the horizontal height of the external audio device is less than 50cm. If any one of the coordinates x in the first direction X and the coordinates y in the second direction Y of the external audio device in the spatial rectangular coordinate system is not within the interval [-5m, 5m], it can be determined that the horizontal position of the external audio device does not meet the requirements, and the process can be turned to step 604, that is, to discard the external audio device.

[0107] In some optional instances, the UI may also provide a default prompt: a first expected horizontal height range in which the coordinates in the third direction Z of the spatial rectangular coordinate system are in the interval [-0.3m, 0.5m] and a second expected horizontal height range in which the coordinates in the third direction Z of the spatial rectangular coordinate system are in the interval [1m, 5m]. When the user determines the first expected horizontal height range, the first expected horizontal height range can be used to measure whether the horizontal height of the external audio device meets the requirements for outputting surround sound, and the second expected horizontal height range can be used to measure whether the horizontal height of the external audio device meets the requirements for outputting sky sound.

[0108] 603: The smart screen determines whether the horizontal height of the external audio device is less than 50 cm.

[0109] It can be understood that it is possible to determine whether the horizontal height of the external audio device is less than 50 cm. If the determination result is no, the process goes to step 605 , otherwise, the process goes to step 608 .

[0110] In some optional instances, when the UI prompts by default that the coordinates in the third direction Z of the spatial rectangular coordinate system are in the first expected horizontal height range of the interval [-0.3m, 0.5m], and the user determines the first expected horizontal height range, if the coordinate z of the external audio device in the third direction Z of the spatial rectangular coordinate system is greater than or equal to 0.5m, it can be determined that the horizontal height of the external audio device does not meet the requirement for outputting surround sound, and the process can be turned to step 605, that is, determining whether the horizontal height of the external audio device is greater than 100cm. If the coordinate z of the external audio device in the third direction Z of the spatial rectangular coordinate system is less than 0.5m, it can be determined that the horizontal height of the external audio device meets the requirement for outputting surround sound, and the process can be turned to step 608, that is, setting the audio device to output surround sound.

[0111] 604: Smart screen abandons external audio devices.

[0112] It can be understood that abandoning the external audio device may mean that the smart screen does not use the external audio device to output the audio during watching movies.

[0113] 605: The smart screen determines whether the horizontal height of the external audio device is greater than 100 cm.

[0114] It can be understood that it is possible to determine whether the horizontal height of the external audio device is greater than 100 cm. If the determination result is no, the process goes to step 606 , otherwise, the process goes to step 609 .

[0115] In some optional instances, when the UI default prompts: the coordinates in the third direction Z of the spatial rectangular coordinate system are in the second expected horizontal height range of the interval [1m, 5m], and the user determines the second expected horizontal height range, if the coordinate z of the external audio device in the third direction Z of the spatial rectangular coordinate system is less than or equal to 1m, it can be determined that the horizontal height of the external audio device does not meet the requirements for outputting the sky sound, and it can be transferred to step 606, that is, to determine whether the external audio device is within 50cm to 100cm in the first direction X and the second direction Y of the spatial rectangular coordinate system. If the coordinate z of the external audio device in the third direction Z of the spatial rectangular coordinate system is greater than 1m, it can be determined that the horizontal height of the external audio device meets the requirements for outputting the sky sound, and it can be transferred to step 609, that is, to set the audio device to output the sky sound.

[0116] 606: The smart screen determines whether the horizontal height of the external audio device is within 50 cm to 100 cm.

[0117] It can be understood that it is possible to determine whether the horizontal height of the external audio device is within a range of 50 cm to 100 cm. If the determination result is yes, the process goes to step 607 , otherwise, the process goes to step 602 .

[0118] In some optional examples, when the UI default prompts: the coordinates in the third direction Z of the spatial rectangular coordinate system are in the first expected horizontal height range of the interval [-0.3m, 0.5m], and the coordinates in the third direction Z of the spatial rectangular coordinate system are in the second expected horizontal height range of the interval [1m, 5m], and the user determines the first expected horizontal height range and the second expected horizontal height range, if the coordinates of the external audio device in the third direction Z of the spatial rectangular coordinate system are within 0.5m to 1m, it can go to step 607, that is, to determine whether the external audio device is a sky sound device. That is, the external audio device is adaptively set to output surround sound or sky sound.

[0119] 607: The smart screen determines whether there is a sky audio device.

[0120] It can be understood that it is possible to determine whether there is a sky sound device in the external audio device for which the audio data tag has been set. If the determination result is yes, go to step 608, otherwise go to step 609.

[0121] In some optional examples, when the external audio device has a sky sound device, the process may proceed to step 608, i.e., setting the external audio device to output surround sound, and when the external audio device is not a sky sound device, the process may proceed to step 609, i.e., setting the external audio device to output sky sound. It can be understood that when the external audio device has a sky sound device, the process may proceed to step 609, i.e., setting the external audio device to output sky sound, and when the external audio device is not a sky sound device, the process may proceed to step 608, i.e., setting the external audio device to output surround sound.

[0122] 608: The Smart Screen sets up an external audio device to output surround sound.

[0123] It can be understood that the external audio device can be set to output surround sound by setting the audio data tag of the external audio device as a surround sound tag.

[0124] 609: Smart screen sets up external audio equipment to output sky sound.

[0125] It can be understood that the external audio device can be set to output sky sound by setting the audio data tag of the external audio device to a sky sound tag.

[0126] The following is a detailed description of the audio processing method mentioned above based on the specific process of playing videos on a smart screen. Fig. 9 A schematic diagram of a process of playing a video on a smart screen is shown. Fig. 9 As shown, the process of playing a video on the smart screen may include:

[0127] 901: The smart screen plays the video source.

[0128] It can be understood that when a source is played, audio data corresponding to the source to be played can be obtained, and the audio data includes left surround sound audio data.

[0129] It can be understood that the video source to be played can be 5.1.2, that is, the video to be played can include 8 audio data, and the 8 audio data can include surround sound audio data.

[0130] 902: The smart screen determines whether there is a left surround sound audio device among multiple external audio devices of the smart screen.

[0131] It can be understood that the audio data tag can be used to determine whether there is a left surround sound speaker among the multiple external audio devices of the smart screen, that is, to determine whether the multiple external audio devices of the smart screen are spatially located on the left side of the smart screen and the audio data tag is an external audio device for surround sound.

[0132] It can be understood that each external audio device of the smart screen can be determined based on the position of each external audio device relative to the smart screen. The specific determination method is as shown in step 402 above and will not be repeated here.

[0133] 903: The smart screen determines whether there are multiple external audio devices with audio data labels as left surround sound.

[0134] It can be understood that when there are multiple external audio devices with audio data tags as surround sound, you can go to step 904, that is, dynamically detect the location of the sound source. When there is only one external audio device with audio data tags as surround sound, you can go to step 905, that is, send the surround sound audio data to the target audio device.

[0135] 904: The smart screen dynamically detects the location of the sound source.

[0136] It can be understood that the specific method of dynamically detecting the position of the sound source is as shown in the above step 404, which will not be repeated here.

[0137] 905: The smart screen sends the audio data corresponding to the sound source to the left surround sound device.

[0138] In some optional instances, there is a left surround sound audio device among the multiple external audio devices of the smart screen, and the audio data corresponding to the sound source can be sent to the left surround sound device. The left surround sound device can play the audio data corresponding to the sound source and emit sound effects corresponding to the audio data, such as sky sound and surround sound.

[0139] In some optional instances, there are multiple left surround sound audio devices among the multiple external audio devices of the smart screen. The audio data corresponding to the sound source can be sent to the left surround sound device closest to the sound source. The left surround sound device can play the audio data corresponding to the sound source and emit sound effects corresponding to the audio data, such as sky sound and surround sound.

[0140] The following is an introduction to the audio processing system used in the audio processing method mentioned in the embodiment of the present application. Fig.10 A schematic diagram of the structure of an audio processing system is shown. Fig.10 The audio processing system may include a spatial rectangular coordinate system construction module 1010 , an audio tag construction module 1020 , a sound source and audio device virtual tag mapping module 1030 , a sound source dynamic detection module 1040 and a multi-channel audio data processing module 1050 .

[0141] Among them, the spatial rectangular coordinate system construction module 1010 can be used to construct a three-dimensional spatial rectangular coordinate system with the first ranging module on the multimedia playback device (such as a smart screen) as the origin, wherein the three-dimensional spatial rectangular coordinate system can have a first direction X, a second direction Y and a third direction Z, and the first direction X, the second direction Y and the third direction Z are perpendicular to each other.

[0142] The audio tag building module 1020 may be used to determine the audio data tag of each external audio device based on the position of each external audio device in the spatial rectangular coordinate system.

[0143] In some optional instances, the audio data tags may include left channel, right channel, bass, overhead sound, and surround sound.

[0144] The sound source and audio device virtual label mapping module 1030 can be used to determine a candidate audio device set from multiple external audio devices based on the audio data corresponding to the multimedia data and the audio data label of each external audio device.

[0145] In some optional instances, when there are at least two external audio devices among the multiple external audio devices of the smart screen that support audio data corresponding to the sound source, the external audio device among the at least two external audio devices that is closest to the sound source corresponding to the audio data is determined as a candidate audio device set.

[0146] In some optional instances, when there is no external audio device that supports audio data corresponding to the sound source among the multiple external audio devices of the smart screen, the left speaker and right speaker of the smart screen are determined as the candidate audio device set.

[0147] The sound source dynamic detection module 1040 can be used to detect the position information of the sound source in the spatial rectangular coordinate system.

[0148] In some optional instances, in order to prevent the smart screen system from freezing and causing detection abnormalities, some continuous video frames and audio frames can be selected from the video data and audio data stored in the buffer of the smart screen playback system to determine the position information of the sound source in the spatial rectangular coordinate system.

[0149] The multi-channel audio data processing module 1050 can be used to send the audio data corresponding to the sound source to the target audio device.

[0150] The following is an introduction to the audio processing method submitted above using a specific example. Fig.11 A schematic diagram of the framework of an audio processing method is shown. Fig.11 As shown, the framework of the audio processing method may include a validation mode and an update mode.

[0151] In the effective mode, after the smart screen is powered on, the adaptive mapping of the smart screen audio path begins. The smart screen detects the currently available sound device and prompts the user through the UI that "an external sound device is currently available and intelligent adaptation can be provided". When receiving the user's confirmation instruction, the user is prompted through the UI to set the default "horizontal distance range" and "vertical distance range".

[0152] After the user sets the horizontal distance range and vertical distance range, the smart screen can establish a spatial rectangular coordinate system to obtain the spatial position information of all available external sound devices.

[0153] In some optional examples, a three-dimensional spatial rectangular coordinate system can be constructed with the smart screen as the origin, wherein the three-dimensional spatial rectangular coordinate system can have a first direction X, a second direction Y and a third direction Z, and the first direction X, the second direction Y and the third direction Z are perpendicular to each other. The smart screen can be installed with a first ranging module (ultra wide band, UWB), and each external sound device of the smart screen can be installed with a second ranging module. Based on the first ranging module on the smart screen and the second ranging module on each external sound device, the relative position information of each external sound device relative to the smart screen can be obtained.

[0154] Then, the UI can prompt the user whether to adjust the position of the external sound device to achieve the best effect. After the user adjusts, the spatial position information of all available external sound devices is re-acquired based on the user's voice or trigger command. And the "sky sound" and "surround sound" adaptive solutions are intelligently output, that is, the audio data label of each audio device.

[0155] Then, the user can be prompted with the "current solution" through the UI, and asked whether DIY adjustment is required. When the user chooses to adjust, a UI page is provided for the user to choose, and the user is prompted with the current solution through the UI, such as displaying a three-dimensional stereo image of the smart screen and each external sound device in the UI, and displaying the audio data label of each external sound device, and the solution takes effect as the final solution.

[0156] Furthermore, the user can be prompted through the UI and the external sound device adjustment can be completed, and other functions can be used normally.

[0157] When the user plays a video, the smart screen can parse the video source data information, dynamically detect the location of the sound source, pair the location information of the external sound device, and remap the sound method according to the final plan.

[0158] In the update mode, after the smart screen is powered on, the spatial location information of all available external sound devices is re-acquired. When the spatial location information of the available external sound devices is significantly different from the spatial location information stored last time, the user is reminded to re-trigger, that is, to regenerate the adaptive solution.

[0159] The following is an introduction to the hardware structure of the device. Fig.12 As shown, the device 1200 may include a processor 1211 , a memory 1212 , and a first ranging module 1213 .

[0160] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the device. In other embodiments of the present application, the device 1200 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0161] The processor 1211 may include one or more processing units, for example, the processor 1211 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural network processor (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. For example, the processor 1211 can execute the audio processing method mentioned in the embodiment of the present application.

[0162] The memory 1212 is used to store instructions and data. In some embodiments, the memory 1212 can store instructions or data that the processor 1211 has just used or cyclically used. If the processor 1211 needs to use the instruction or data again, it can be directly called from the memory 1212. Repeated access is avoided, the waiting time of the processor 1211 is reduced, and the efficiency of the system is improved. For example, the memory can store instructions or data for executing the audio processing method mentioned in the embodiment of the present application.

[0163] The first ranging module 1213 can obtain the relative position information of each external audio device relative to the device to construct a spatial rectangular coordinate system, and then send the relative position information of each external audio device relative to the device to the processor 1211. The processor 1211 can determine the type of audio data supported by each external audio device based on the position of each external audio device of the device in the spatial rectangular coordinate system.

[0164] The above describes the hardware structure that the device may have. It is understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the device. In other embodiments of the present application, the device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0165] In the accompanying drawings, some structural or method features may be shown in a specific arrangement and / or order. However, it should be understood that such a specific arrangement and / or order may not be required. Instead, in some embodiments, these features may be arranged in a manner and / or order different from that shown in the illustrative drawings. In addition, the inclusion of structural or method features in a particular figure does not mean that such features are required in all embodiments, and in some embodiments, these features may not be included or may be combined with other features.

[0166] The various embodiments of the mechanism disclosed in the present application can be implemented in hardware, software, firmware or a combination of these implementation methods. The embodiments of the present application can be implemented as a program or program code executed on a programmable system, which includes at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device and at least one output device.

[0167] In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments may also be implemented as instructions carried or stored on one or more temporary or non-temporary machine-readable (e.g., computer-readable) storage media, which may be read and executed by one or more processors. Therefore, machine-readable media may include any mechanism for storing or transmitting information in a machine (e.g., computer) readable form, including, but not limited to, floppy disks, optical disks, optical discs, read-only memories (CD-ROMs), magneto-optical disks, read-only memories (ROMs), random access memories (RAMs), erasable programmable read-only memories (EPROMs), electrically erasable programmable read-only memories (EEPROMs), magnetic or optical cards, flash memory, or a tangible machine-readable memory for transmitting information (e.g., carrier waves, infrared signals, digital signals, etc.) using the Internet in electrical, optical, acoustic, or other forms of propagation signals. Therefore, machine-readable media include any type of machine-readable media suitable for storing or transmitting electronic instructions or information in a machine (e.g., computer) readable form.

[0168] It should be noted that in the examples and description of this patent, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "including one" do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0169] Although the present application has been illustrated and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the present application.

Claims

1. An audio processing method, applied to a device, characterized in that: include: Acquire multimedia data to be played, where the multimedia data to be played includes N channels of audio data; Determining that, among the M external audio devices of the device, there is an external audio device that supports the first channel of audio data among the N channels of audio data; Selecting a first external audio device from the M external audio devices, the first external audio device having a distance satisfying a distance condition with a first sound source corresponding to the first audio data, to play the first audio data; Wherein M and N are integers greater than 2.

2. The method according to claim 1, characterized in that The distance conditions include: The distance between the sound sources corresponding to the audio data is the shortest.

3. The method according to claim 1, characterized in that Also includes: A supported audio data type is set for each of the M external audio devices.

4. The method according to claim 3, characterized in that The step of setting a supported audio data type for each of the M external audio devices includes: Based on the distance between each of the M external audio devices and the device, the type of audio data supported by each external audio device is set.

5. The method according to claim 4, characterized in that The step of setting the type of audio data supported by each of the M external audio devices based on the distance between each of the M external audio devices and the device includes: The audio data type supported by the second external audio device among the M external audio devices is set to sky sound, and the audio data type supported by the third external audio device among the M external audio devices is set to surround sound, wherein The distance between the second external audio device and the device is greater than the distance between the third external audio device and the device.

6. The method according to claim 4, characterized in that The step of setting the type of audio data supported by each of the M external audio devices based on the distance between each of the M external audio devices and the device includes: Taking the device as the origin, constructing a spatial rectangular coordinate system, wherein the spatial rectangular coordinate system includes a plurality of subspaces, and different subspaces correspond to different audio data types; According to the subspace where each of the M external audio devices is located in the spatial rectangular coordinate system, the type of audio data supported by each external audio device is determined.

7. The method according to claim 1, characterized in that Also includes: Determining that among the M external audio devices of the device, there is an external audio device that supports the second channel of audio data and the third channel of audio data among the N channels of audio data; The external audio device corresponding to the second sound source corresponding to the second audio data satisfies the distance condition as a fourth external audio device, and the external audio device corresponding to the third sound source corresponding to the third audio data satisfies the distance condition as the fourth external audio device, The second channel audio data and the third channel audio data are mixed and processed, and sent to the fourth external audio device for playing.

8. The method according to claim 1, characterized in that Also includes: Determining that among the M external audio devices of the device, there is an external audio device that supports the second channel of audio data and the third channel of audio data among the N channels of audio data; The external audio devices corresponding to the second sound source corresponding to the second audio data satisfying the distance condition are the fifth external audio device and the sixth external audio device, and the external audio devices corresponding to the third sound source corresponding to the third audio data satisfying the distance condition are the fifth external audio device and the sixth external audio device, The second channel of audio data is sent to the fifth external audio device for playing, and the third channel of audio data is sent to the sixth external audio device for playing.

9. A device, characterized in that: include: one or more processors; One or more memories; the one or more memories store one or more programs, and when the one or more programs are executed by one or more processors, the device executes the audio processing method according to any one of claims 1 to 8.

10. A readable storage medium, characterized in that: The readable medium stores a program, and when the program is executed on a device, the device executes the audio processing method according to any one of claims 1 to 8.

Images