Audio signal processing method and device, electronic equipment and storage medium

Abstract

The invention relates to an audio signal processing method and device, electronic equipment and a storage medium. The method comprises the following steps: extracting first signals of a plurality of sound source objects from a first audio signal; based on a preset distribution array, target parameters, corresponding to a target sound channel, of the multiple first signals are adjusted, a second audio signal is obtained, the preset distribution array comprises distribution positions of multiple sound source objects, the target sound channel comprises at least one of a left sound channel and a right sound channel, and the target parameters comprise at least one of loudness and phase; the second audio signal comprises an audio signal corresponding to the left channel and an audio signal corresponding to the right channel. According to the method, the first signals of the plurality of sound source objects are spatially arranged again, so that the adjusted second audio signal has a sense of space, the generated sound image can be accurately positioned when the second audio signal is played in two channels, and the sound effect sense of space during playing is improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of audio processing, and in particular to a method, device, electronic device and storage medium for processing an audio signal. Background Art

[0002] In recent years, spatial audio has attracted much attention, and people are paying more and more attention to the spatial information of sound. For example, in order to make the played audio signal have a sense of space, two-channel playback can be used. However, in the related art, the audio signals of different sound source objects are downmixed to two-channel playback, resulting in chaotic or overlapping spatial distribution of the audio signals of each sound source object, resulting in the played audio signal having no sense of space. Summary of the invention

[0003] In order to overcome the problems existing in the related art, the present disclosure provides a method, device, electronic device and storage medium for processing an audio signal.

[0004] According to a first aspect of an embodiment of the present disclosure, a method for processing an audio signal is provided, which is performed by an electronic device, and the method includes:

[0005] Extracting a first signal of a plurality of sound source objects from a first audio signal;

[0006] Based on a preset distribution array, target parameters of the target channels corresponding to the multiple first signals are adjusted to obtain a second audio signal, the preset distribution array includes the distribution positions of the multiple sound source objects, the target channel includes at least one of a left channel and a right channel, the target parameter includes at least one of loudness and phase, and the second audio signal includes an audio signal corresponding to the left channel and an audio signal corresponding to the right channel.

[0007] In some embodiments, adjusting the target parameters of the target channels of the plurality of first signals based on a preset distribution array to obtain the second audio signal includes:

[0008] Based on the preset distribution array, adjusting the target parameter of each of the first signals corresponding to the target channel to obtain a second signal corresponding to each of the first signals, wherein the second signal includes a first sub-signal corresponding to the left channel and a second sub-signal corresponding to the right channel;

[0009] Perform audio mixing processing on the plurality of second signals to obtain the second audio signal.

[0010] In some embodiments, adjusting the target parameter of each first signal corresponding to the target channel based on the preset distribution array to obtain the second signal corresponding to each first signal includes:

[0011] For each sound source object, taking the preset position in the preset distribution array as a reference, when the distribution position of the sound source object is located to the left of the preset position, at least one of the following operations is performed:

[0012] Adjusting the loudness of the first signal of the sound source object corresponding to the target channel so that the loudness of the first sub-signal in the adjusted second signal is greater than the loudness of the second sub-signal;

[0013] Adjusting the phase of the first signal of the sound source object corresponding to the target channel so that the phase of the first sub-signal in the adjusted second signal is smaller than the phase of the second sub-signal;

[0014] The preset location indicates the location of the user.

[0015] In some embodiments, adjusting the target parameter of each of the first signals in the target channel based on the preset distribution array to obtain the second signal corresponding to each of the first signals further includes:

[0016] For each sound source object, taking the preset position in the preset distribution array as a reference, when the distribution position of the sound source object is located to the right of the preset position, at least one of the following operations is performed:

[0017] Adjusting the loudness of the first signal of the sound source object corresponding to the target channel so that the loudness of the second sub-signal in the adjusted second signal is greater than the loudness of the first sub-signal;

[0018] Adjusting the phase of the first signal of the sound source object corresponding to the target channel so that the phase of the second sub-signal in the adjusted second signal is smaller than the phase of the first sub-signal;

[0019] The preset location indicates the location of the user.

[0020] In some embodiments, adjusting the target parameter of each first signal corresponding to the target channel based on the preset distribution array to obtain the second signal corresponding to each first signal includes:

[0021] For each sound source object, obtaining an adjustment parameter corresponding to a distribution position of the sound source object, the adjustment parameter including at least one of a loudness adjustment parameter and a phase adjustment parameter;

[0022] The target parameter of the target channel corresponding to the first signal of the sound source object is adjusted according to the adjustment parameter to obtain a second signal corresponding to the first signal.

[0023] In some embodiments, the method further comprises:

[0024] Acquire a head movement of the user, wherein the head movement indicates a relative volume audible to the left ear and the right ear;

[0025] The step of adjusting the target parameters of the target channels of the plurality of first signals based on the preset distribution array to obtain the second audio signal comprises:

[0026] Based on the head movement and the preset distribution array, target parameters of the first signals corresponding to the target channels are adjusted to obtain the second audio signal.

[0027] In some embodiments, the method further comprises:

[0028] Displaying controls corresponding to the multiple sound source objects in a preset interface;

[0029] Adjusting the position of the control corresponding to each of the sound source objects to obtain the distribution position of each of the sound source objects;

[0030] The distribution positions of the multiple sound source objects are combined to obtain the preset distribution array.

[0031] In some embodiments, the method further comprises:

[0032] When a plurality of the preset distribution arrays are configured, establishing a corresponding relationship between each of the preset distribution arrays and a corresponding user identifier;

[0033] The step of adjusting the target parameters of the target channels of the plurality of first signals based on the preset distribution array to obtain the second audio signal comprises:

[0034] Determine a target user identifier of the current user, search for a target preset distribution array corresponding to the target user identifier from the corresponding relationship, and adjust target parameters of the plurality of first signals corresponding to the target channels based on the target preset distribution array to obtain the second audio signal.

[0035] In some embodiments, before extracting the first signal corresponding to the plurality of sound source objects from the first audio signal, the method further includes:

[0036] extracting a plurality of the first signals from the first audio signal;

[0037] Based on the signal feature corresponding to each of the sound source objects, a first signal of each of the sound source objects is determined, wherein the signal feature of the first signal of the sound source object conforms to the signal feature corresponding to the sound source object.

[0038] In some embodiments, the method further comprises:

[0039] When the electronic device is a device connected to a headphone device, sending the second audio signal to the headphone device so that the headphone device plays the second audio signal; or

[0040] When the electronic device is a headphone device, the second audio signal is played.

[0041] According to a second aspect of an embodiment of the present disclosure, there is provided an audio signal processing device, which is configured in an electronic device, and the device includes:

[0042] A signal extraction module, configured to extract a first signal of a plurality of sound source objects from a first audio signal;

[0043] The signal adjustment module is configured to adjust the target parameters of the target channels corresponding to the multiple first signals based on a preset distribution array to obtain a second audio signal, wherein the preset distribution array includes the distribution positions of the multiple sound source objects, the target channel includes at least one of a left channel and a right channel, the target parameter includes at least one of loudness and phase, and the second audio signal includes an audio signal corresponding to the left channel and an audio signal corresponding to the right channel.

[0044] In some embodiments, the signal conditioning module is configured to:

[0045] Based on the preset distribution array, adjusting the target parameter of each of the first signals corresponding to the target channel to obtain a second signal corresponding to each of the first signals, wherein the second signal includes a first sub-signal corresponding to the left channel and a second sub-signal corresponding to the right channel;

[0046] Perform audio mixing processing on the plurality of second signals to obtain the second audio signal.

[0047] In some embodiments, the signal conditioning module is configured to:

[0048] For each sound source object, taking the preset position in the preset distribution array as a reference, when the distribution position of the sound source object is located to the left of the preset position, at least one of the following operations is performed:

[0049] Adjusting the loudness of the first signal of the sound source object corresponding to the target channel so that the loudness of the first sub-signal in the adjusted second signal is greater than the loudness of the second sub-signal;

[0050] Adjusting the phase of the first signal of the sound source object corresponding to the target channel so that the phase of the first sub-signal in the adjusted second signal is smaller than the phase of the second sub-signal;

[0051] The preset location indicates the location of the user.

[0052] In some embodiments, the signal conditioning module is configured to:

[0053] For each sound source object, taking the preset position in the preset distribution array as a reference, when the distribution position of the sound source object is located to the right of the preset position, at least one of the following operations is performed:

[0054] Adjusting the loudness of the first signal of the sound source object corresponding to the target channel so that the loudness of the second sub-signal in the adjusted second signal is greater than the loudness of the first sub-signal;

[0055] Adjusting the phase of the first signal of the sound source object corresponding to the target channel so that the phase of the second sub-signal in the adjusted second signal is smaller than the phase of the first sub-signal;

[0056] The preset location indicates the location of the user.

[0057] In some embodiments, the signal conditioning module is configured to:

[0058] For each sound source object, obtaining an adjustment parameter corresponding to a distribution position of the sound source object, the adjustment parameter including at least one of a loudness adjustment parameter and a phase adjustment parameter;

[0059] The target parameter of the target channel corresponding to the first signal of the sound source object is adjusted according to the adjustment parameter to obtain a second signal corresponding to the first signal.

[0060] In some embodiments, the apparatus further comprises:

[0061] A head movement acquisition module is configured to acquire the user's head movement, wherein the head movement indicates the relative volume audible to the left ear and the right ear;

[0062] The signal adjustment module is configured to adjust target parameters of the first signals corresponding to target channels based on the head movement and the preset distribution array to obtain the second audio signal.

[0063] In some embodiments, the apparatus further comprises:

[0064] A control display module, configured to display controls corresponding to the plurality of audio source objects in a preset interface;

[0065] A distribution position acquisition module is configured to adjust the position of the control corresponding to each of the sound source objects to obtain the distribution position of each of the sound source objects;

[0066] The distribution array acquisition module is configured to combine the distribution positions of the multiple sound source objects to obtain the preset distribution array.

[0067] In some embodiments, the apparatus further comprises:

[0068] a corresponding relationship establishing module, configured to establish a corresponding relationship between each of the preset distribution arrays and a corresponding user identifier when a plurality of the preset distribution arrays are configured;

[0069] The signal adjustment module is configured to determine a target user identifier of a current user, search a target preset distribution array corresponding to the target user identifier from the corresponding relationship, and adjust target parameters of the plurality of first signals corresponding to target channels based on the target preset distribution array to obtain the second audio signal.

[0070] In some embodiments, the signal extraction module is further configured to:

[0071] extracting a plurality of the first signals from the first audio signal;

[0072] Based on the signal feature corresponding to each of the sound source objects, a first signal of each of the sound source objects is determined, wherein the signal feature of the first signal of the sound source object conforms to the signal feature corresponding to the sound source object.

[0073] In some embodiments, the apparatus further comprises:

[0074] a signal playing module, configured to, when the electronic device is a device connected to a headphone device, send the second audio signal to the headphone device so that the headphone device plays the second audio signal; or

[0075] The signal playing module is further configured to play the second audio signal when the electronic device is a headphone device.

[0076] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0077] processor;

[0078] a memory for storing processor-executable instructions;

[0079] The processor is configured to execute the method as described in the first aspect of the embodiment of the present disclosure.

[0080] According to a fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method described in the first aspect of the embodiment of the present disclosure.

[0081] The above method of the present disclosure has the following beneficial effects:

[0082] The method provided by the embodiment of the present disclosure extracts first signals of multiple sound source objects from a first audio signal, and then adjusts target parameters of the multiple first signals corresponding to target channels based on the distribution positions of the multiple sound source objects to obtain a second audio signal. Since the audio signal corresponding to the left channel and the audio signal corresponding to the right channel in the second audio signal are obtained by adjusting the distribution positions of the multiple sound source objects, it is equivalent to spatially rearranging the first signals of the multiple sound source objects. Therefore, the adjusted second audio signal has a stronger sense of space, so that when the second audio signal is played in two channels, the sound and image generated can be accurately positioned, thereby improving the sense of space of the sound effect during playback.

[0083] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0084] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0085] Figure 1 is a flowchart of a method for processing an audio signal according to an exemplary embodiment;

[0086] Figure 2 is a flowchart of another method for processing an audio signal according to an exemplary embodiment;

[0087] Figure 3 is a schematic diagram showing a fundamental wave and a harmonic wave according to an exemplary embodiment;

[0088] Figure 4 is a schematic diagram showing a preset distribution array according to an exemplary embodiment;

[0089] Figure 5 is a block diagram of a device for processing an audio signal according to an exemplary embodiment;

[0090] Figure 6 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0091] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present invention. Instead, they are merely examples of devices and methods consistent with some aspects of the present invention as detailed in the appended claims.

[0092] The method provided by the embodiment of the present disclosure is executed by an electronic device, which may be a terminal such as a mobile phone, a tablet computer, a laptop computer, a wearable device, etc. that can be connected to a headphone device, or the electronic device may also be a headphone device with a dual-channel playback function, for example, the headphone device may be a wired headphone, a Bluetooth headphone, a TWS (True Wireless Stereo) headphone, etc.

[0093] The method provided by the embodiments of the present disclosure can be applied in a variety of scenarios. For example, in a music playback scenario, when it is necessary to play an audio signal including signals of multiple sound source objects, the audio signal processing method provided by the embodiments of the present disclosure can be adopted to process the audio signal to be played to obtain a processed audio signal, in which the signals corresponding to the left channel and the right channel of different sound source objects are different. Therefore, when the processed audio signal is played through a dual-channel headphone device, the user can feel the spatial sense of the sound effect of the processed audio signal.

[0094] Figure 1 is a flowchart of a method for processing an audio signal according to an exemplary embodiment, which is executed by an electronic device, see Figure 1 , the method comprises the following steps:

[0095] Step S101: extracting first signals of multiple sound source objects from a first audio signal.

[0096] The first audio signal is an audio signal to be processed, and the first audio signal may be a signal collected by an electronic device, or a signal sent to the electronic device by other devices. The first audio signal is mixed with audio signals of multiple sound source objects, and the sound source objects may be musical instruments, people, or other objects that can make sounds.

[0097] Since the harmonics of the sounds emitted by different sound source objects are different, for example, the harmonics of the sounds emitted by different musical instruments are different, and the harmonics of the sounds emitted by musical instruments and people are different, that is, the sounds emitted by different sound source objects have their own characteristics, the first signals of different sound source objects can be identified from the first audio signal, and the first signal of each sound source object can be extracted from the first audio signal. Wherein, when the first signal is not processed, the playback effects of the left channel and the right channel are the same.

[0098] Step S102: Based on a preset distribution array, target parameters of the target channels of the plurality of first signals are adjusted to obtain a second audio signal, wherein the preset distribution array includes distribution positions of the plurality of sound source objects.

[0099] Based on the distribution positions of multiple sound source objects, target parameters of multiple first signals corresponding to target channels are adjusted, the target channel includes at least one of the left channel and the right channel, and the target parameters include at least one of the loudness and the phase, that is, during the adjustment, the loudness and / or the phase of the left channel and / or the right channel of each first signal are adjusted to obtain a second audio signal, the second audio signal includes an audio signal corresponding to the left channel and an audio signal corresponding to the right channel. The distribution positions of multiple sound source objects refer to the relative positions between the multiple sound source objects. For example, there are sound source objects 1-3, and the distribution positions of these three sound source objects can be sound source object 1, sound source object 2, and sound source object 3 from left to right.

[0100] Adjustment is performed based on the distribution positions of multiple sound source objects so that the loudness and / or phase of the signal of each sound source object in the second audio signal corresponding to the left channel and / or the right channel conforms to the characteristics of the position distribution of the multiple sound source objects. For example, if the distribution position of a certain sound source object is biased to the left, then after adjustment, the loudness of the signal of the sound source object corresponding to the left channel is greater than the loudness corresponding to the right channel, and / or, after adjustment, the phase of the signal of the sound source object corresponding to the left channel is smaller than the phase corresponding to the right channel. For another example, if the distribution position of a certain sound source object is biased to the right, then after adjustment, the loudness of the signal of the sound source object corresponding to the right channel is greater than the loudness corresponding to the left channel, and / or, after adjustment, the phase of the signal of the sound source object corresponding to the right channel is smaller than the phase corresponding to the left channel.

[0101] The louder the loudness corresponding to a certain channel is, the louder the sound played by the channel is during playback, and the smaller the loudness corresponding to a certain channel is, the smaller the sound played by the channel is during playback. For dual-channel playback, the user hears that the loudness of the audio signal played by one channel is greater than the loudness of the audio signal played by the other channel, which can make the user feel that the audio signal has a sense of space. Similarly, the larger the phase corresponding to a certain channel is, the later the sound is played by the channel during playback, and the smaller the phase corresponding to a certain channel is, the earlier the sound is played by the channel during playback. For dual-channel playback, the user hears that the audio signal played by one channel is earlier than the sound played by the other channel, which can also make the user feel that the audio signal has a sense of space.

[0102] The method provided by the embodiment of the present disclosure extracts first signals of multiple sound source objects from a first audio signal, and then adjusts target parameters of the multiple first signals corresponding to target channels based on the distribution positions of the multiple sound source objects to obtain a second audio signal. Since the audio signal corresponding to the left channel and the audio signal corresponding to the right channel in the second audio signal are obtained by adjusting the distribution positions of the multiple sound source objects, it is equivalent to spatially rearranging the first signals of the multiple sound source objects. Therefore, the adjusted second audio signal has a stronger sense of space, so that when the second audio signal is played in two channels, the sound and image generated can be accurately positioned, thereby improving the sense of space of the sound effect during playback.

[0103] Figure 2 is a flowchart of another method for processing an audio signal according to an exemplary embodiment, which is executed by a device connected to a headphone device, see Figure 2 , the method comprises the following steps:

[0104] Step S201: extracting multiple first signals from a first audio signal.

[0105] The first audio signal is an audio signal to be processed, and the first audio signal may be a signal collected by an electronic device, or a signal sent to the electronic device by other devices. The first audio signal is mixed with audio signals of multiple sound source objects, and the sound source objects may be musical instruments, people, or other objects that can make sounds.

[0106] In some embodiments, for example, see Figure 3, curve 1 represents the fundamental wave in the first audio signal, curve 2 represents the harmonics of the piano in the first audio signal, and curve 3 represents the harmonics of the viola in the first audio signal. The harmonics of the sounds emitted by different sound source objects are different. Therefore, the harmonics of different sound source objects in the first audio signal can be identified, and based on the identified harmonics, the first signals corresponding to different harmonics are extracted from the first audio signal. Alternatively, other implementations can be used to extract multiple first signals from the first audio signal.

[0107] Step S202: determining a first signal of each sound source object based on a signal feature corresponding to each sound source object, wherein the signal feature of the first signal of the sound source object conforms to the signal feature corresponding to the sound source object.

[0108] Among them, the signal feature corresponding to the sound source object represents the feature of the sound emitted by the sound source object, and different sound source objects correspond to different signal features, which can be harmonic features or other features. In the embodiment of the present disclosure, after extracting multiple first signals, the signal feature of each first signal can be extracted, and then according to the signal feature corresponding to each sound source object and the signal feature of each first signal, it is determined to which sound source object the extracted first signal corresponds, so as to ensure that the signal feature of the first signal of the sound source object meets the signal feature corresponding to the sound source object.

[0109] In the disclosed embodiment, for each sound source object, a corresponding first signal is extracted to ensure that the first signal of each sound source object can be adjusted later, so that the audio signal of each sound source object has a sense of space when being played.

[0110] It should be noted that the embodiment of the present disclosure is only explained by taking the example of first extracting multiple first signals and then determining the first signal of each sound source object based on the signal characteristics corresponding to each sound source object. In another embodiment, other methods can be used to identify and extract the first signal of each sound source object from the first audio signal. For example, an audio extraction model is called to identify and extract multiple first signals from the first audio signal. The audio extraction model is used to identify and extract signals of different sound source objects in an audio signal.

[0111] Step S203: Based on the preset distribution array, adjust the target parameter of each first signal corresponding to the target channel to obtain a second signal corresponding to each first signal.

[0112] In the embodiment of the present disclosure, after extracting the first signal of each sound source object from the first audio signal, the first signal is processed. The preset distribution array includes the distribution positions of multiple sound source objects, and the distribution positions of multiple sound source objects refer to the relative positions between the multiple sound source objects.

[0113] For the preset distribution array, the preset distribution array needs to be a distribution array corresponding to the first audio signal. In some embodiments, after determining the sound source object corresponding to each first signal in the first audio signal, it is necessary to obtain the preset distribution array corresponding to multiple sound source objects, that is, the multiple sound source objects included in the obtained preset distribution array are the same as the multiple sound source objects corresponding to the multiple audio signals in the first audio signal, or the multiple sound source objects included in the obtained preset distribution array include all the sound source objects corresponding to the multiple audio signals in the first audio signal.

[0114] In some embodiments, the first audio signal is stored in correspondence with a preset distribution array, and after the first audio signal to be processed is determined, the preset distribution array corresponding to the first audio signal is obtained.

[0115] In some embodiments, the preset distribution array can be set by the user, that is, a plurality of controls corresponding to the sound source objects are displayed in the preset interface, each control represents a sound source object; the position of the control corresponding to each sound source object is adjusted to obtain the distribution position of each sound source object, that is, the position where the control is located is the position where the sound source object is located; the distribution positions of the plurality of sound source objects are combined to obtain the preset distribution array. For example, see Figure 4 , respectively set the positions of the sound source objects such as shakers, cymbals, violin group, violin group trumpet, viola group French horn, piano, cello group trombone, electric guitar, guitar, bronze drum, snare drum, double bass group tuba, bass drum, and human voice, and get Figure 4 The preset distribution array shown. In the embodiment of the present disclosure, the user can set the preset distribution array in the preset interface, which improves the flexibility of the preset distribution array.

[0116] Optionally, a first application is installed in the electronic device, and the first application is used to set the distribution array, and the preset interface is an interface in the first application.

[0117] In some embodiments, when multiple preset distribution arrays are configured, a correspondence is established between each preset distribution array and the corresponding user identifier; the target user identifier of the current user is determined, and the target preset distribution array corresponding to the target user identifier is searched from the correspondence, and the target preset arrays are respectively arrayed as preset distribution arrays corresponding to the user identifier, and then based on the target preset distribution array, the target parameters of the multiple first signals corresponding to the target channels are adjusted to obtain the second audio signal, that is, based on the target preset distribution array, the target parameters of each first signal corresponding to the target channel are adjusted to obtain the second signal corresponding to each first signal.

[0118] Optionally, determining the target user identifier of the current user includes: using the user identifier of a user who logs into a second application as the target user identifier of the current user, wherein the second application is an application for playing audio signals. Alternatively, when the first audio signal needs to be played, multiple candidate user identifiers are displayed for the user to select, and the candidate user identifier selected by the user is used as the target user identifier of the current user, wherein each candidate user identifier has a corresponding preset distribution array.

[0119] In the disclosed embodiment, a correspondence is established between each preset distribution array and the corresponding user identification. When the first audio signal needs to be played, the target preset distribution array corresponding to the user can be determined according to the user performing the operation at this time, and then adjustment is performed based on the target preset distribution array, so that the adjusted second audio signal is more in line with the user's preference, thereby improving the user experience.

[0120] The second signal includes a first sub-signal corresponding to the left channel and a second sub-signal corresponding to the right channel.

[0121] In some embodiments, a preset position in a preset distribution array indicates the position of the user. For each sound source object, with the preset position in the preset distribution array as a reference, when the distribution position of the sound source object is located to the left of the preset position, perform at least one of the following operations: adjust the loudness of the first signal of the sound source object corresponding to the target channel so that the loudness of the first sub-signal in the adjusted second signal is greater than the loudness of the second sub-signal; adjust the phase of the first signal of the sound source object corresponding to the target channel so that the phase of the first sub-signal in the adjusted second signal is less than the phase of the second sub-signal. Among them, the loudness of the first signal corresponding to the left channel and / or the right channel can be adjusted, and the phase of the first signal corresponding to the left channel and / or the right channel can be adjusted, as long as the conditions that the loudness of the first sub-signal is greater than the loudness of the second sub-signal and the phase of the first sub-signal is less than the phase of the second sub-signal are satisfied after the adjustment.

[0122] For each sound source object, with the preset position in the preset distribution array as a reference, when the distribution position of the sound source object is located to the right of the preset position, at least one of the following operations is performed: adjusting the loudness of the first signal of the sound source object corresponding to the target channel so that the loudness of the second sub-signal in the adjusted second signal is greater than the loudness of the first sub-signal; adjusting the phase of the first signal of the sound source object corresponding to the target channel so that the phase of the second sub-signal in the adjusted second signal is less than the phase of the first sub-signal. Among them, the loudness of the first signal corresponding to the left channel and / or the right channel can be adjusted, and the phase of the first signal corresponding to the left channel and / or the right channel can be adjusted, as long as the conditions that the loudness of the second sub-signal is greater than the loudness of the first sub-signal and the phase of the second sub-signal is less than the phase of the first sub-signal are satisfied after the adjustment.

[0123] In the above-mentioned method of adjusting loudness and / or phase, if the distribution position of a certain sound source object is biased to the left, then after adjustment, the loudness of the signal of the sound source object corresponding to the left channel is greater than that corresponding to the right channel, and / or, after adjustment, the phase of the signal of the sound source object corresponding to the left channel is smaller than that corresponding to the right channel; if the distribution position of a certain sound source object is biased to the right, then after adjustment, the loudness of the signal of the sound source object corresponding to the right channel is greater than that corresponding to the left channel, and / or, after adjustment, the phase of the signal of the sound source object corresponding to the right channel is smaller than that corresponding to the left channel. Since the first sub-signal and the second sub-signal in the second signal have different loudness and / or phase in the left channel and the right channel, when the second signal is played, the second signal heard by the left ear and the right ear of the user is not exactly the same, so that the user can feel the spatial sense of the sound effect when the second signal is played.

[0124] In the above implementation manner, the adjustment of the first signal of each sound source object is taken as an example for explanation. In some embodiments, in order to achieve a better overall playback effect, when adjusting the loudness of multiple first signals corresponding to the target channel, the loudness cannot be adjusted too small or too large, thereby affecting the overall harmony. For example, a preset amplitude is set, and when adjusting the loudness, the amplitude of the reduction and the amplitude of the increase cannot exceed the preset amplitude.

[0125] In some embodiments, for each sound source object, an adjustment parameter corresponding to the distribution position of the sound source object is obtained, the adjustment parameter including at least one of a loudness adjustment parameter and a phase adjustment parameter; a first signal of the sound source object is adjusted according to the adjustment parameter to correspond to a target parameter of a target channel, to obtain a second signal corresponding to the first signal. The loudness adjustment parameter is used to adjust the loudness, and the phase adjustment parameter is used to adjust the phase.

[0126] Optionally, the loudness adjustment parameter is used to adjust the loudness of the first signal corresponding to the left channel, or the loudness adjustment parameter is used to adjust the loudness of the first signal corresponding to the right channel, or the loudness adjustment parameter includes a first loudness adjustment parameter and a second loudness adjustment parameter, the first loudness adjustment parameter is used to adjust the loudness of the first signal corresponding to the left channel, and the second loudness adjustment parameter is used to adjust the loudness of the first signal corresponding to the right channel. The loudness adjustment parameter may be a ratio, and when adjusting the loudness, the original loudness of the first signal is multiplied by the ratio to obtain the adjusted loudness, or the loudness adjustment parameter may be a loudness value, and when adjusting the loudness, the original loudness of the first signal is added to the loudness value to obtain the adjusted loudness.

[0127] Optionally, the phase adjustment parameter is used to adjust the phase of the first signal corresponding to the left channel, or the phase adjustment parameter is used to adjust the phase of the first signal corresponding to the right channel, or the phase adjustment parameter includes a first phase adjustment parameter and a second phase adjustment parameter, the first phase adjustment parameter is used to adjust the phase of the first signal corresponding to the left channel, and the second phase adjustment parameter is used to adjust the phase of the first signal corresponding to the right channel. The phase adjustment parameter can be a ratio, and when adjusting the phase, the original phase of the first signal is multiplied by the ratio to obtain the adjusted phase, or the phase adjustment parameter can be a phase value, and when adjusting the phase, the original phase of the first signal is added to the phase value to obtain the adjusted phase.

[0128] It should be noted that, in the above adjustment method, for each first signal, if only the target parameters of the first signal corresponding to the left channel are adjusted, the first sub-signal is determined to be the signal after the first signal is adjusted, and the second sub-signal is the first signal; if only the target parameters of the first signal corresponding to the right channel are adjusted, the first sub-signal is determined to be the first signal, and the second sub-signal is the signal after the first signal is adjusted; if the target parameters of the first signal corresponding to the left channel and the right channel are adjusted, the first sub-signal is determined to be the signal obtained by adjusting the target parameters of the first signal corresponding to the left channel, and the second sub-signal is the signal obtained by adjusting the target parameters of the first signal corresponding to the right channel.

[0129] Step S204: Perform audio mixing processing on the multiple second signals to obtain a second audio signal.

[0130] Since multiple second signals need to be played simultaneously during playback, multiple second signals also need to be processed by audio mixing, that is, multiple second signals are mixed together to obtain a second audio signal. Since each second signal includes a first sub-signal corresponding to a left channel and a second sub-signal corresponding to a right channel, the mixed second audio signal includes an audio signal corresponding to the left channel and an audio signal corresponding to the right channel, the audio signal corresponding to the left channel is a signal obtained by mixing multiple first sub-signals, and the audio signal corresponding to the right channel is a signal obtained by mixing multiple second sub-signals.

[0131] Step S205: Send a second audio signal to the earphone device so that the earphone device plays the second audio signal.

[0132] It should be noted that when the headphone device executes the above steps S201-S204, after obtaining the second audio signal, the headphone device plays the second audio signal. That is, if the second audio signal is processed by the headphone device, the headphone device directly plays the second audio signal after the processing is completed. If the second audio signal is not processed by the headphone device, the electronic device sends it to the headphone device after the processing is completed, so that the headphone device plays the second audio signal. It should be noted that when the headphone device plays the second audio signal, it plays the second audio signal through dual channels.

[0133] In another embodiment, the method further includes: obtaining the user's head movement, and adjusting the target parameters of the target channel corresponding to the multiple first signals based on the head movement and the preset distribution array to obtain the second audio signal. The head movement indicates the relative size of the volume that can be heard by the left ear and the right ear, and the head movement includes a leftward shift or a rightward shift. When the head movement is a leftward shift, it means that the user wants to make the right ear hear more clearly. At this time, on the basis of adjusting the first signal based on the above embodiment, the loudness of the first signal corresponding to the right channel is further adjusted to make the loudness of the right channel louder; when the head movement is a rightward shift, it means that the user wants to make the left ear hear more clearly. At this time, on the basis of adjusting the first signal based on the above embodiment, the loudness of the first signal corresponding to the left channel is further adjusted to make the loudness of the left channel louder. This method of adjusting based on the head movement and the preset distribution array allows the adjusted second audio signal to have a sense of space while also taking into account the needs of the user.

[0134] It should be noted that, when executed by the headphone device, the headphone device can detect the user's head movement, and then adjust according to the head movement and the preset distribution array. When executed by a device connected to the headphone device, the headphone device can detect the user's head movement, and then the headphone device sends the detected head movement to the device.

[0135] The method provided by the embodiment of the present disclosure extracts first signals of multiple sound source objects from a first audio signal, and then adjusts target parameters of the multiple first signals corresponding to target channels based on the distribution positions of the multiple sound source objects to obtain a second audio signal. Since the audio signal corresponding to the left channel and the audio signal corresponding to the right channel in the second audio signal are obtained by adjusting the distribution positions of the multiple sound source objects, it is equivalent to spatially rearranging the first signals of the multiple sound source objects. Therefore, the adjusted second audio signal has a stronger sense of space, so that when the second audio signal is played in two channels, the sound and image generated can be accurately positioned, thereby improving the sense of space of the sound effect during playback.

[0136] Figure 5is a block diagram of an audio signal processing device according to an exemplary embodiment, which is configured in an electronic device, see Figure 5 , the device comprises:

[0137] The signal extraction module 501 is configured to extract a first signal of a plurality of sound source objects from a first audio signal;

[0138] The signal adjustment module 502 is configured to adjust the target parameters of the target channels corresponding to the multiple first signals based on a preset distribution array to obtain a second audio signal. The preset distribution array includes the distribution positions of multiple sound source objects, the target channels include at least one of the left channel and the right channel, the target parameters include at least one of loudness and phase, and the second audio signal includes an audio signal corresponding to the left channel and an audio signal corresponding to the right channel.

[0139] The device provided by the embodiment of the present disclosure extracts first signals of multiple sound source objects from a first audio signal, and then adjusts target parameters of the multiple first signals corresponding to target channels based on the distribution positions of the multiple sound source objects to obtain a second audio signal. Since the audio signal corresponding to the left channel and the audio signal corresponding to the right channel in the second audio signal are obtained by adjusting the distribution positions of the multiple sound source objects, it is equivalent to spatially rearranging the first signals of the multiple sound source objects. Therefore, the adjusted second audio signal has a stronger sense of space, so that when the second audio signal is played in two channels, the sound and image generated can be accurately positioned, thereby improving the sense of space of the sound effect during playback.

[0140] In some embodiments, the signal conditioning module 502 is configured to:

[0141] Based on the preset distribution array, adjusting the target parameter of each first signal corresponding to the target channel to obtain a second signal corresponding to each first signal, wherein the second signal includes a first sub-signal corresponding to the left channel and a second sub-signal corresponding to the right channel;

[0142] The multiple second signals are subjected to audio mixing processing to obtain a second audio signal.

[0143] In some embodiments, the signal conditioning module 502 is configured to:

[0144] For each sound source object, taking the preset position in the preset distribution array as a reference, when the distribution position of the sound source object is located to the left of the preset position, perform at least one of the following operations:

[0145] Adjusting the loudness of the first signal of the sound source object corresponding to the target channel so that the loudness of the first sub-signal in the adjusted second signal is greater than the loudness of the second sub-signal;

[0146] Adjusting the phase of the first signal of the sound source object corresponding to the target channel so that the phase of the first sub-signal in the adjusted second signal is smaller than the phase of the second sub-signal;

[0147] The preset location indicates the location of the user.

[0148] In some embodiments, the signal conditioning module 502 is configured to:

[0149] For each sound source object, taking the preset position in the preset distribution array as a reference, when the distribution position of the sound source object is located to the right of the preset position, perform at least one of the following operations:

[0150] Adjusting the loudness of the first signal of the sound source object corresponding to the target channel so that the loudness of the second sub-signal in the adjusted second signal is greater than the loudness of the first sub-signal;

[0151] Adjusting the phase of the first signal of the sound source object corresponding to the target channel so that the phase of the second sub-signal in the adjusted second signal is smaller than the phase of the first sub-signal;

[0152] The preset location indicates the location of the user.

[0153] In some embodiments, the signal conditioning module 502 is configured to:

[0154] For each sound source object, obtaining an adjustment parameter corresponding to a distribution position of the sound source object, where the adjustment parameter includes at least one of a loudness adjustment parameter and a phase adjustment parameter;

[0155] The target parameter of the target channel corresponding to the first signal of the sound source object is adjusted according to the adjustment parameter to obtain a second signal corresponding to the first signal.

[0156] In some embodiments, the apparatus further comprises:

[0157] A head movement acquisition module is configured to acquire the user's head movement, where the head movement indicates the relative volume audible to the left ear and the right ear;

[0158] The signal adjustment module 502 is configured to adjust the target parameters of the target channels of the plurality of first signals based on the head movement and the preset distribution array to obtain a second audio signal.

[0159] In some embodiments, the apparatus further comprises:

[0160] A control display module, configured to display controls corresponding to multiple sound source objects in a preset interface;

[0161] A distribution position acquisition module is configured to adjust the position of the control corresponding to each sound source object to obtain the distribution position of each sound source object;

[0162] The distribution array acquisition module is configured to combine the distribution positions of multiple sound source objects to obtain a preset distribution array.

[0163] In some embodiments, the apparatus further comprises:

[0164] A corresponding relationship establishing module, configured to establish a corresponding relationship between each preset distribution array and a corresponding user identifier when multiple preset distribution arrays are configured;

[0165] The signal adjustment module 502 is configured to determine the target user identifier of the current user, search for the target preset distribution array corresponding to the target user identifier from the corresponding relationship, and adjust the target parameters of the multiple first signals corresponding to the target channel based on the target preset distribution array to obtain the second audio signal.

[0166] In some embodiments, the signal extraction module 501 is further configured to:

[0167] extracting a plurality of first signals from the first audio signal;

[0168] Based on the signal feature corresponding to each sound source object, a first signal of each sound source object is determined, wherein the signal feature of the first signal of the sound source object conforms to the signal feature corresponding to the sound source object.

[0169] In some embodiments, the apparatus further comprises:

[0170] a signal playing module, configured to, when the electronic device is a device connected to a headphone device, send a second audio signal to the headphone device so that the headphone device plays the second audio signal; or

[0171] The signal playing module is further configured to play the second audio signal when the electronic device is a headphone device.

[0172] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0173] An embodiment of the present disclosure further provides an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to execute the audio signal processing method in the above embodiment.

[0174] Figure 6 is a block diagram of an electronic device 600 according to an exemplary embodiment.

[0175] Reference Figure 6, the electronic device 600 may include one or more of the following components: a processing component 602 , a memory 604 , a power component 606 , a multimedia component 608 , an audio component 610 , an input / output (I / O) interface 612 , a sensor component 614 , and a communication component 616 .

[0176] The processing component 602 generally controls the overall operation of the electronic device 600, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 602 may include one or more processors 620 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 602 may include one or more modules to facilitate the interaction between the processing component 602 and other components. For example, the processing component 602 may include a multimedia module to facilitate the interaction between the multimedia component 608 and the processing component 602.

[0177] The memory 604 is configured to store various types of data to support operations on the electronic device 600. Examples of such data include instructions for any application or method operating on the electronic device 600, contact data, phone book data, messages, pictures, videos, etc. The memory 604 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0178] The power supply component 606 provides power to the various components of the electronic device 600. The power supply component 606 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 600.

[0179] The multimedia component 608 includes a screen that provides an output interface between the electronic device 600 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 608 includes a front camera and / or a rear camera. When the electronic device 600 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0180] The audio component 610 is configured to output and / or input audio signals. For example, the audio component 610 includes a microphone (MIC), and when the electronic device 600 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 604 or sent via the communication component 616. In some embodiments, the audio component 610 also includes a speaker for outputting audio signals.

[0181] I / O interface 612 provides an interface between processing component 602 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0182] The sensor assembly 614 includes one or more sensors for providing various aspects of status assessment for the electronic device 600. For example, the sensor assembly 614 can detect the open / closed state of the electronic device 600, the relative positioning of the components, such as the display and keypad of the electronic device 600, and the sensor assembly 614 can also detect the position change of the electronic device 600 or a component of the electronic device 600, the presence or absence of contact between the user and the electronic device 600, the orientation or acceleration / deceleration of the electronic device 600, and the temperature change of the electronic device 600. The sensor assembly 614 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 614 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 614 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0183] The communication component 616 is configured to facilitate wired or wireless communication between the electronic device 600 and other devices. The electronic device 600 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 616 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 616 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0184] In an exemplary embodiment, the electronic device 600 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0185] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 604 including instructions, and the instructions can be executed by a processor 620 of an electronic device 600 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0186] The embodiments of the present disclosure also provide a non-transitory computer-readable storage medium. When instructions in the storage medium are executed by a processor of an electronic device, the electronic device can execute the audio signal processing method in the above embodiment.

[0187] Those skilled in the art will readily appreciate other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses or adaptations of the present invention that follow the general principles of the present invention and include common knowledge or customary techniques in the art that are not disclosed in this disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present invention are indicated by the following claims.

[0188] It should be understood that the present invention is not limited to the exact construction that has been described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A method for processing an audio signal, characterized in that: Executed by an electronic device, the method includes: Extracting a first signal of a plurality of sound source objects from a first audio signal; Based on a preset distribution array, target parameters of the target channels corresponding to the multiple first signals are adjusted to obtain a second audio signal, the preset distribution array includes the distribution positions of the multiple sound source objects, the target channel includes at least one of a left channel and a right channel, the target parameter includes at least one of loudness and phase, and the second audio signal includes an audio signal corresponding to the left channel and an audio signal corresponding to the right channel.

2. The processing method according to claim 1, characterized in that: The step of adjusting the target parameters of the target channels of the plurality of first signals based on the preset distribution array to obtain the second audio signal comprises: Based on the preset distribution array, adjusting the target parameter of each of the first signals corresponding to the target channel to obtain a second signal corresponding to each of the first signals, wherein the second signal includes a first sub-signal corresponding to the left channel and a second sub-signal corresponding to the right channel; Perform audio mixing processing on the plurality of second signals to obtain the second audio signal.

3. The processing method according to claim 2, characterized in that: The step of adjusting the target parameter of each of the first signals corresponding to the target channel based on the preset distribution array to obtain a second signal corresponding to each of the first signals includes: For each sound source object, taking the preset position in the preset distribution array as a reference, when the distribution position of the sound source object is located to the left of the preset position, at least one of the following operations is performed: Adjusting the loudness of the first signal of the sound source object corresponding to the target channel so that the loudness of the first sub-signal in the adjusted second signal is greater than the loudness of the second sub-signal; Adjusting the phase of the first signal of the sound source object corresponding to the target channel so that the phase of the first sub-signal in the adjusted second signal is smaller than the phase of the second sub-signal; The preset location indicates the location of the user.

4. The processing method according to claim 2, characterized in that: The step of adjusting the target parameter of each of the first signals in the target channel based on the preset distribution array to obtain a second signal corresponding to each of the first signals further includes: For each sound source object, taking the preset position in the preset distribution array as a reference, when the distribution position of the sound source object is located to the right of the preset position, at least one of the following operations is performed: Adjusting the loudness of the first signal of the sound source object corresponding to the target channel so that the loudness of the second sub-signal in the adjusted second signal is greater than the loudness of the first sub-signal; Adjusting the phase of the first signal of the sound source object corresponding to the target channel so that the phase of the second sub-signal in the adjusted second signal is smaller than the phase of the first sub-signal; The preset location indicates the location of the user.

5. The processing method according to claim 2, characterized in that: The step of adjusting the target parameter of each of the first signals corresponding to the target channel based on the preset distribution array to obtain a second signal corresponding to each of the first signals includes: For each sound source object, obtaining an adjustment parameter corresponding to a distribution position of the sound source object, the adjustment parameter including at least one of a loudness adjustment parameter and a phase adjustment parameter; The target parameter of the target channel corresponding to the first signal of the sound source object is adjusted according to the adjustment parameter to obtain a second signal corresponding to the first signal.

6. The processing method according to claim 2, characterized in that: The method further comprises: Acquire a head movement of the user, wherein the head movement indicates a relative volume audible to the left ear and the right ear; The step of adjusting the target parameters of the target channels of the plurality of first signals based on the preset distribution array to obtain the second audio signal comprises: Based on the head movement and the preset distribution array, target parameters of the first signals corresponding to the target channels are adjusted to obtain the second audio signal.

7. The processing method according to any one of claims 1 to 6, characterized in that: The method further comprises: Displaying controls corresponding to the multiple sound source objects in a preset interface; Adjusting the position of the control corresponding to each of the sound source objects to obtain the distribution position of each of the sound source objects; The distribution positions of the multiple sound source objects are combined to obtain the preset distribution array.

8. The processing method according to claim 7, characterized in that: The method further comprises: When a plurality of the preset distribution arrays are configured, establishing a corresponding relationship between each of the preset distribution arrays and a corresponding user identifier; The step of adjusting the target parameters of the target channels of the plurality of first signals based on the preset distribution array to obtain the second audio signal comprises: Determine a target user identifier of the current user, search for a target preset distribution array corresponding to the target user identifier from the corresponding relationship, and adjust target parameters of the plurality of first signals corresponding to the target channels based on the target preset distribution array to obtain the second audio signal.

9. The processing method according to any one of claims 1 to 6, characterized in that: Before extracting the first signal corresponding to the plurality of sound source objects from the first audio signal, the method further includes: extracting a plurality of the first signals from the first audio signal; Based on the signal feature corresponding to each of the sound source objects, a first signal of each of the sound source objects is determined, wherein the signal feature of the first signal of the sound source object conforms to the signal feature corresponding to the sound source object.

10. The processing method according to any one of claims 1 to 6, characterized in that: The method further comprises: When the electronic device is a device connected to a headphone device, sending the second audio signal to the headphone device so that the headphone device plays the second audio signal; or When the electronic device is a headphone device, the second audio signal is played.

11. An audio signal processing device, characterized in that: The device is configured in an electronic device, and comprises: A signal extraction module, configured to extract a first signal of a plurality of sound source objects from a first audio signal; The signal adjustment module is configured to adjust the target parameters of the target channels corresponding to the multiple first signals based on a preset distribution array to obtain a second audio signal, wherein the preset distribution array includes the distribution positions of the multiple sound source objects, the target channel includes at least one of a left channel and a right channel, the target parameter includes at least one of loudness and phase, and the second audio signal includes an audio signal corresponding to the left channel and an audio signal corresponding to the right channel.

12. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the method according to any one of claims 1 to 10.

13. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method as claimed in any one of claims 1 to 10.

Images