Sound output method and device, electronic equipment and storage medium

Abstract

The invention relates to a sound output method and device, electronic equipment and a storage medium, and the method comprises the steps: determining the priority of each sound signal under the condition that multiple sound signals are received; adjusting the received sound signals according to the priority of each path of sound signals; and outputting the adjusted sound signal. Through the method, the output quality of the sound signal can be improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of electronic devices, and in particular to a sound output method and device, an electronic device, and a storage medium. Background Art

[0002] Based on the new generation of communication technology, wireless headphones can connect to more than two terminal devices at the same time. The terminal devices can send sound signals to the headphones through wireless transmission technology, and then the headphones play the sound.

[0003] However, when multiple terminal devices send sound signals to the headset at the same time, or when the headset is playing the sound of one terminal device and another terminal device suddenly transmits a signal to the headset, the signal being played is often interrupted or even lost. For example, when a user is talking to someone and suddenly receives a prompt tone or music from another terminal device, it is very likely that the user's call information will be lost. Therefore, it can be seen that it is worth paying attention to improve the sound output quality of the headset when receiving multiple sound signals. Summary of the invention

[0004] The present invention provides a sound output method and device, an electronic device, and a storage medium.

[0005] According to a first aspect of an embodiment of the present disclosure, a sound output method is provided, the method comprising:

[0006] When receiving multiple audio signals, determine the priority of each audio signal;

[0007] Adjust the received sound signals according to the priorities of the sound signals of each channel;

[0008] Outputs the adjusted sound signal.

[0009] In some embodiments, adjusting the received sound signal according to the priority of each sound signal includes:

[0010] For sound signals of different priorities, adjusting the sound characteristics of the sound signals of different priorities; wherein the sound characteristics of the sound signals of different priorities are different after the adjustment;

[0011] For sound signals with the same priority, the output time or the number of output paths of the sound signals with the same priority are adjusted.

[0012] In some embodiments, adjusting the sound characteristics of the sound signals of different priorities includes:

[0013] The sound intensity of the sound signals of different priorities is positively correlated with the priority.

[0014] In some embodiments, adjusting the sound characteristics of the sound signals of different priorities includes:

[0015] The sound intensities of sound signals with different priorities are adjusted differently, and the sound intensity of the sound signal with a predetermined priority is adjusted to be within a target sound intensity range.

[0016] In some embodiments, adjusting the sound characteristics of the sound signals of different priorities includes:

[0017] The sound intensity and / or frequency of the sound signals of different priorities are adjusted so that the sound signals of different priorities are distributed in different scales; wherein the scales of the sound signals of different priorities are positively correlated with the priorities.

[0018] In some embodiments, adjusting the sound characteristics of the sound signals of different priorities includes:

[0019] Adjust sound signals of different priorities to different sound frequencies.

[0020] In some embodiments, adjusting sound signals of different priorities to different sound frequencies includes:

[0021] The sound frequency of the sound signal of a predetermined priority is maintained unchanged, and the sound frequencies of the sound signals of different priorities are adjusted differently.

[0022] In some embodiments, adjusting the output time or the number of output paths of the sound signals with the same priority level includes:

[0023] For sound signals of the same priority, in response to the type of the sound signal being a sound signal of fixed frame length, adjusting the output time of the sound signals of the same priority to be different; and / or,

[0024] In response to the type of the sound signal being a sound signal with a non-fixed frame length, different channels of sound signals with the same priority are merged into one channel or a predetermined number of channels of sound signals are suspended.

[0025] In some embodiments, determining the priority of each sound signal includes:

[0026] The priority of each sound signal is determined according to the sound type of each sound signal.

[0027] In some embodiments, determining the priority of each sound signal according to the sound type of each sound signal includes:

[0028] In response to at least two sound signals of inconsistent sound types among the multiple sound signals, determining the priority corresponding to each of the at least two sound signals based on the sound types of the at least two sound signals and the correspondence between the sound types and the priorities;

[0029] In response to at least two sound signals having the same sound type among the multiple sound signals, the priority of each sound signal among the at least two sound signals is determined according to sound source devices of the at least two sound signals.

[0030] In some embodiments, determining the priority of each sound signal in the at least two sound signals according to the sound source device of the at least two sound signals includes:

[0031] In response to the at least two sound signals coming from different sound source devices, determining the priority of each sound signal in the at least two sound signals according to the priority of the sound source devices corresponding to the at least two sound signals; wherein the priority of the sound signal is positively correlated with the priority of the sound source device;

[0032] In response to the sound source devices of the at least two sound signals being consistent, it is determined that the priorities of the sound signals in the at least two sound signals with consistent sound types are consistent.

[0033] According to a second aspect of an embodiment of the present disclosure, there is provided a sound output device, the device comprising:

[0034] A determination module, configured to determine the priority of each sound signal when receiving multiple sound signals;

[0035] An adjustment module, configured to adjust the received sound signals according to the priorities of the sound signals of each channel;

[0036] The output module is configured to output the conditioned sound signal.

[0037] In some embodiments, the adjustment module is further configured to adjust the sound characteristics of sound signals of different priorities for sound signals of different priorities; wherein the sound characteristics of sound signals of different priorities are different after adjustment; and for sound signals of the same priority, adjust the output time or output path of the sound signals of the same priority.

[0038] In some embodiments, the adjustment module is further configured to adjust the sound intensity of sound signals of different priorities in a positive correlation with the priority.

[0039] In some embodiments, the adjustment module is further configured to adjust the sound intensity of sound signals of different priorities to be different, and adjust the sound intensity of sound signals of predetermined priority to be within the target sound intensity range. In some embodiments, the adjustment module is further configured to adjust the sound intensity and / or frequency of sound signals of different priorities so that sound signals of different priorities are distributed in different scales; wherein the scales of sound signals of different priorities are positively correlated with the priority.

[0040] In some embodiments, the adjustment module is further configured to adjust sound signals of different priorities to different sound frequencies.

[0041] In some embodiments, the adjustment module is further configured to maintain the sound frequency of the sound signal of a predetermined priority level unchanged, and adjust the sound frequencies of the sound signals of different priorities to be different.

[0042] In some embodiments, the adjustment module is further configured to, for sound signals of the same priority, adjust the output time of the sound signals of the same priority to be different in response to the sound signal type being a sound signal of fixed frame length; and / or, in response to the sound signal type being a sound signal of non-fixed frame length, merge sound signals of the same priority on different paths into one path or suspend a predetermined number of sound signals.

[0043] In some embodiments, the determination module is further configured to determine the priority of each sound signal according to the sound type of each sound signal.

[0044] In some embodiments, the determination module is further configured to, in response to the presence of at least two sound signals of inconsistent sound types among the multiple sound signals, determine the priority corresponding to each of the at least two sound signals based on the sound types of the at least two sound signals and the correspondence between the sound types and the priorities; in response to the presence of at least two sound signals of consistent sound types among the multiple sound signals, determine the priority of each of the at least two sound signals according to the sound source devices of the at least two sound signals.

[0045] In some embodiments, the determination module is further configured to, in response to the at least two sound signals coming from different sound source devices, determine the priority of each sound signal in the at least two sound signals according to the priority of the sound source devices corresponding to the at least two sound signals; wherein the priority of the sound signal is positively correlated with the priority of the sound source device; and in response to the sound source devices of the at least two sound signals being consistent, determine that the priority of each sound signal in the at least two sound signals with the same sound type is consistent.

[0046] According to a third aspect of an embodiment of the present disclosure, there is provided an electronic device, including:

[0047] processor;

[0048] a memory for storing processor-executable instructions;

[0049] Wherein, the processor is configured to execute the sound output method as described in the first aspect above.

[0050] According to a fourth aspect of an embodiment of the present disclosure, there is provided a storage medium, including:

[0051] When the instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the sound output method as described in the first aspect above.

[0052] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0053] In an embodiment of the present disclosure, the electronic device adjusts the sound signal according to the priority of each sound signal, and can perform targeted adjustments based on the priority, as opposed to ignoring the priority and only pausing the media stream being played and outputting the newly received media stream. The priority-based adjustment of the present disclosure makes the adjustment more intelligent, can improve the output quality of the sound signal, and enhance the user experience.

[0054] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0055] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0056] Figure 1 It is a flow chart of a sound output method shown in an embodiment of the present disclosure.

[0057] Figure 2 This is an example of a sound output method process in an embodiment of the present disclosure. Figure 1 .

[0058] Figure 3 The figure is a flowchart of a method for determining the priority of a sound signal in an embodiment of the present disclosure.

[0059] Figure 4 This is an example of a sound output method process in the embodiment of the present disclosure. Figure 2 .

[0060] Figure 5 The figure shows a sound output device according to an exemplary embodiment.

[0061] Figure 6The present invention is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0062] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0063] Figure 1 is a flow chart of a sound output method shown in an embodiment of the present disclosure, such as Figure 1 As shown, the sound output method applied to the electronic device comprises the following steps:

[0064] S11, when receiving multiple sound signals, determining the priority of each sound signal;

[0065] S12, adjusting the received sound signal according to the priority of each sound signal;

[0066] S13: Output the adjusted sound signal.

[0067] In the embodiments of the present disclosure, the electronic device is a device with an audio output function, for example, the electronic device may be a smart speaker, an in-ear headset, a head-mounted acoustic device such as AR, VR glasses or a head-mounted headset, etc., and the embodiments of the present disclosure are not limited. The electronic device can receive a sound signal sent by a terminal device connected wirelessly or by wire, and then play it through a speaker so that the user carrying the electronic device can listen to it.

[0068] In step S11, when receiving multiple sound signals, the electronic device determines the priority of each sound signal. The electronic device itself can be a sound source device, and the multiple sound signals can be signals to be output by the electronic device itself; in addition, the multiple sound signals can also be multiple signals from the same sound source device outside the electronic device, or multiple signals from different sound source devices. The multiple sound signals can include voice signals, media signals such as video or audio, and can also include prompt sound signals issued by the sound source device system.

[0069] It should be noted that when receiving multiple sound signals, electronic devices can achieve rapid reception response to sound signals with ultra-low latency through hardware pathways such as circuits / chips.

[0070] In the embodiment of the present disclosure, the electronic device determines the priority of each sound signal, and the priority is used to characterize the importance of the sound signal. Among them, the priority can be determined based on a combination of one or more of the following, for example, based on the sound source device corresponding to the sound signal, based on the sound type of the sound signal, based on the application type to which the sound signal belongs, etc. In addition, the priority can be a level defined by the developer of the electronic device before it leaves the factory, or it can be a level customized by the user of the electronic device after it leaves the factory, and the embodiment of the present disclosure does not limit this.

[0071] It should be noted that, in the embodiments of the present disclosure, the priorities of multiple channels of sound signals may be completely the same or completely different; the priorities of multiple channels of sound signals may also be partially the same and partially different.

[0072] In step S12, the electronic device adjusts the received sound signals according to the priorities of the sound signals, including: adjusting the output time, output number or sound characteristics of the sound signals according to the priorities. For example, the sound signal with the highest priority may be output first, the sound signals with the same priority may be combined and output, and the sound characteristics of the sound signals with different priorities may be adjusted.

[0073] In step S13, the electronic device outputs the adjusted sound signal, for example, outputs the sound signal in time-sharing according to the output time of the sound signal; synchronously outputs the sound signal after the number of paths is adjusted or the sound characteristics are adjusted, etc.

[0074] It should be noted that in the embodiment of the present disclosure, the adjusted sound signal is a digital signal, and the electronic device can convert the digital signal into an analog signal and then output it. For example, for multiple digital signals, the electronic device can mix the multiple digital signals into one analog signal and then output them synchronously. In addition, in the embodiment of the present disclosure, after receiving multiple sound signals, the electronic device will trigger the execution of the path switching mechanism to achieve the determination and adjustment of the priority of the sound signal of the corresponding path through path switching, wherein the path switching, the determination of the priority, and the adjustment of the sound signal can all be set to low latency to improve the immediacy of the electronic device's output of multiple sound signals.

[0075] The related technology has the problem of information loss when controlling the output of multiple sound signals: first, because the volume of another sound being played is louder, the sound being played is drowned out by the masking effect, or when the volume of the two sound signals is similar, the user cannot hear the two sounds clearly due to the masking effect, resulting in information loss. Second, in the scheme of pausing the sound being played to prevent information loss, when another terminal transmits the media stream to the headset, the media stream being played is paused first and the newly received media stream is played. However, the media being played may not be paused (for example, the voice signal cannot be paused), resulting in the loss of part of the information during the playback of the newly received media stream.

[0076] In contrast, in the embodiment of the present disclosure, the electronic device adjusts the received sound signals according to the priority of each sound signal, and can perform targeted adjustments based on the priority, as opposed to ignoring the priority and simply pausing the media stream being played and outputting the newly received media stream. The priority-based adjustment of the present disclosure makes the adjustment more intelligent and can improve the user experience when the sound signal is output.

[0077] In some embodiments, adjusting the received sound signal according to the priority of each sound signal includes:

[0078] For sound signals of different priorities, adjusting the sound characteristics of the sound signals of different priorities; wherein the sound characteristics of the sound signals of different priorities are different after the adjustment;

[0079] For sound signals with the same priority, the output time or the number of output paths of the sound signals with the same priority are adjusted.

[0080] In an embodiment of the present disclosure, when there are sound signals of different priorities in multiple sound signals, the sound characteristics of the sound signals are adjusted. Since the sound characteristics of the sound signals of different priorities are different, the adjusted multiple sound signals can be output synchronously during output. The sound characteristics may include at least one of the following: sound frequency, sound intensity (volume), timbre, scale, etc. In an embodiment of the present disclosure, the sound characteristics of the sound signals of different priorities are different after adjustment. For example, the volume of the sound signal of the highest priority can be adjusted to a volume range that is comfortable for the human ear, while the volume of the sound signals of other priorities can be positively correlated according to the priority; for example, the sound frequency of the sound signal of the highest priority can remain unchanged, while the sound frequencies of the sound signals of other priorities are appropriately adjusted, but the sound frequencies of the sound signals of different priorities are different; for another example, the timbre of the sound signals of different priorities can be set according to the preference of the user of the electronic device for different timbres; for another example, the sound signals of different priorities can be distributed in different scales.

[0081] It should be noted that in the embodiments of the present disclosure, the scale in the sound characteristics refers to the volume perceived by the user, which can be understood as a relative volume; and the sound intensity in the sound characteristics refers to the actual playback volume, which can be understood as an absolute volume.

[0082] In the embodiments of the present disclosure, for sound signals of the same priority, the electronic device adjusts the output time or the number of output paths of the sound signals of the same priority. For example, the electronic device may maintain the original sound characteristics of the sound signals of the same priority but output them in time-sharing, or may merge the sound signals of the same priority into several output paths, or ignore some sound signals, etc. The embodiments of the present disclosure do not impose any restrictions.

[0083] It can be understood that in the embodiments of the present disclosure, the electronic device performs targeted adjustments according to the priority of each sound signal, and for sound signals with different priorities, the sound characteristics of the sound signals with different priorities are adjusted differently. Then, when outputting the adjusted multi-channel sound signals, on the one hand, since the sound characteristics of the sound signals with different priorities are different, when the multi-channel sound signals are output synchronously, the user can perceive different sounds based on different sound characteristics, which can effectively reduce the occurrence of sound loss caused by masking effect or pausing the playback of a certain sound signal; on the other hand, the embodiments of the present disclosure adjust the output time or the number of output channels for sound signals with the same priority. For example, time-sharing output can improve the user's perceived distinction of each sound signal, and combined output can improve the real-time output of the sound signal.

[0084] In some embodiments, adjusting the sound characteristics of the sound signals of different priorities includes:

[0085] The sound intensity of the sound signals of different priorities is positively correlated with the priority.

[0086] In the disclosed embodiment, the sound intensity of sound signals of different priorities is positively correlated with the priority, that is, the higher the priority, the greater the sound intensity of the sound signal, so the low-priority sound signal will not drown out the high-priority sound signal.

[0087] It can be understood that by adjusting the sound intensity of sound signals of different priorities to be positively correlated with the priorities, the occurrence of sound loss can be effectively reduced.

[0088] In some embodiments, adjusting the sound characteristics of the sound signals of different priorities includes:

[0089] The sound intensities of sound signals with different priorities are adjusted differently, and the sound intensity of the sound signal with a predetermined priority is adjusted to be within a target sound intensity range.

[0090] In the disclosed embodiment, the sound signal of the predetermined priority is, for example, the sound signal of the highest priority, and the corresponding target sound intensity range may be a preset comfortable volume range perceivable by the user, for example, between 40 decibels and 60 decibels. By adjusting the sound signal of the highest priority to the target sound intensity range, the user can better perceive the important sound signal, which is highly intelligent.

[0091] In addition, the sound signal of the predetermined priority may also be the sound signal of the lowest priority, and the corresponding target sound intensity range may be the volume range in which the user can just feel the sound. By adjusting the sound intensity of the sound signal of the lowest priority to the volume range in which the user can just feel the sound, the sound intensity of the sound signals of other priorities may be adjusted to be different and higher than the volume range in which the user can just feel the sound.

[0092] It should be noted that, in the embodiment of the present disclosure, while adjusting the sound intensity of a sound signal of a predetermined priority to within a target sound intensity range, the sound intensity of sound signals of different priorities can be positively correlated with the priority.

[0093] In some embodiments, adjusting the sound characteristics of the sound signals of different priorities includes:

[0094] The sound intensity and / or frequency of the sound signals of different priorities are adjusted so that the sound signals of different priorities are distributed in different scales; wherein the scales of the sound signals of different priorities are positively correlated with the priorities.

[0095] In the disclosed embodiments, the musical scale can be represented by an equal loudness curve, where the horizontal axis is frequency and the vertical axis is sound intensity. The equal loudness curve reflects the influence of sound intensity and sound frequency on the loudness perception, and the curve as a whole reflects the loudness perception, that is, it reflects the subjective feeling of the human ear to the sound. Therefore, by distributing sound signals of different priorities in different musical scales, the human ear can perceive different volumes.

[0096] In the disclosed embodiment, since the scales of sound signals of different priorities are positively correlated with the priorities, based on the above-mentioned adjustment method according to the equal loudness curve, the user will be more sensitive to the loudness of the sound signals with higher priorities, thereby effectively reducing the occurrence of sound loss. In addition, in this embodiment, the sound characteristics of each sound signal are adjusted from the perspective of the user's actual perceived volume, which can make the sound adjustment more consistent with the user's actual perception, thereby improving the output quality of the multi-channel sound signals of different priorities after adjustment, and having better intelligence.

[0097] In some embodiments, adjusting the sound characteristics of the sound signals of different priorities includes:

[0098] Adjust sound signals of different priorities to different sound frequencies.

[0099] In the embodiment of the present disclosure, the sound frequencies of sound signals of different priorities are adjusted differently, so that users can have different perceptions of sound signals of different priorities, and signal loss due to masking effects can be reduced, which is highly intelligent.

[0100] It should be noted that, in the embodiment of the present disclosure, when adjusting the sound frequency, the sound frequencies of sound signals of different priorities are different, but the sound frequencies of sound signals of each priority level can be within the frequency range perceivable by the user.

[0101] In some embodiments, adjusting sound signals of different priorities to different sound frequencies includes:

[0102] The sound frequency of the sound signal of a predetermined priority is maintained unchanged, and the sound frequencies of the sound signals of different priorities are adjusted differently.

[0103] In the embodiment of the present disclosure, the sound signal of predetermined priority may be the sound signal of highest priority. Maintaining the sound frequency of the sound signal of highest priority unchanged can make the sound signal of highest priority as undistorted as possible. In this way, users can better perceive important sound signals.

[0104] In some embodiments, adjusting the output time or the number of output paths of the sound signals with the same priority level includes:

[0105] For sound signals of the same priority, in response to the type of the sound signal being a sound signal of fixed frame length, adjusting the output time of the sound signals of the same priority to be different; and / or,

[0106] In response to the type of the sound signal being a sound signal with a non-fixed frame length, different channels of sound signals with the same priority are merged into one channel or a predetermined number of channels of sound signals are suspended.

[0107] In the disclosed embodiments, different adjustment strategies are adopted for sound signals of the same priority. Since the cache duration of the sound signal can be predicted for a sound signal with a fixed frame length, it can be cached and played in sequence, so that the output time of sound signals with the same priority is different. For example, the prompt sound signal is a sound signal with a fixed frame length, and the cache duration of the prompt sound can be predicted, so the prompt sound can be cached, so that different prompt sounds can be played in sequence to alleviate the occurrence of signal loss. For sound signals with non-fixed frame lengths, such as voice signals or media signals such as audio and video, since the frame length is not fixed and it is not convenient to cache, they can be merged and output synchronously to improve real-time performance, or one or more sound signals can be paused so that the currently playing sound signal can be more clearly perceived by the user.

[0108] It can be understood that in the embodiments of the present disclosure, for sound signals of the same priority, the sound signals are adjusted in a manner corresponding to the type of the sound signals, rather than adopting a fixed adjustment method. This can be adjusted more intelligently in combination with the characteristics of the sound signals, thereby improving the quality of the sound signal output.

[0109] It should be noted that in the embodiments of the present disclosure, the method of adjusting the sound signals according to the priority of each sound signal is not limited to any one of the above-mentioned methods, but can also be a combination of multiple adjustment methods in the above-mentioned examples, or any other adjustment method, and the embodiments of the present disclosure are not limited thereto.

[0110] In some embodiments, determining the priority of each sound signal includes:

[0111] The priority of each sound signal is determined according to the sound type of each sound signal.

[0112] In the embodiments of the present disclosure, sound types include media signals such as voice signals, video or audio, and may also include prompt sound signals emitted by the system of the sound source device. Since the characteristics of different types of sound signals may be inconsistent, for example, the output of voice signals is usually determined by the user, has a certain real-time nature and cannot be paused, which may be more important to the user, while video and audio are paused signals and may not be so important to the user. Prompt sounds are device-controllable signals. Therefore, different sound types will also affect the priority to a certain extent. On this basis, the embodiments of the present disclosure determine the priority of sound signals according to the sound type, which can more accurately reflect the importance of each sound signal to the user.

[0113] When determining the sound type of a sound signal, the embodiments of the present disclosure may determine the sound type according to the protocol, encoding and decoding method or frame length adopted to receive the corresponding sound signal. For example, Bluetooth voice signals are usually based on the Bluetooth HFP protocol, while Bluetooth video or audio signals are usually based on the Bluetooth A2DP protocol. In addition, the formats of video signals and audio signals are different, and the corresponding encoding and decoding methods are also different. The electronic device can determine whether it is a video signal or an audio signal based on the decoding method. In addition, the frame length of the prompt sound is fixed, and the electronic device can also distinguish whether it is a prompt sound signal based on the frame length. It should be noted that the embodiments of the present disclosure are not limited to determining the sound type of the sound signal in the above manner. For example, it can also be determined based on the energy spectrum of the sound signal, or based on a deep learning model.

[0114] In some embodiments, determining the priority of each sound signal according to the sound type of each sound signal includes:

[0115] In response to at least two sound signals of inconsistent sound types among the multiple sound signals, determining the priority corresponding to each of the at least two sound signals based on the sound types of the at least two sound signals and the correspondence between the sound types and the priorities;

[0116] In response to at least two sound signals having the same sound type among the multiple sound signals, the priority of each sound signal among the at least two sound signals is determined according to sound source devices of the at least two sound signals.

[0117] In the disclosed embodiments, different methods are used to determine the priority based on whether the sound types of the sound signals are consistent. Among them, when there are at least two sound signals with inconsistent sound types among the multiple sound signals, the priority corresponding to each of the at least two sound signals is determined based on the corresponding relationship between the sound type and the priority. The corresponding relationship can be defined by the developer of the electronic device before it leaves the factory, or it can be customized by the user of the electronic device after it leaves the factory. Exemplarily, in the corresponding relationship, the voice signal has the highest priority, the prompt sound has the second highest priority, the video sound has the third highest priority, and the music sound has the last highest priority.

[0118] In an embodiment of the present disclosure, when there are at least two sound signals of the same sound type among multiple sound signals, the priority of each sound signal in the at least two sound signals is determined based on the sound source device of the at least two sound signals. The importance of different sound source devices to users is also different. For example, a mobile phone is basically an essential device in daily life, and its importance may be higher than that of devices such as televisions and tablets. Therefore, an embodiment of the present disclosure may also determine the priority according to the sound source device.

[0119] It can be understood that the embodiments of the present disclosure use the above different methods to determine the priority based on whether the sound types of the sound signals of various channels are consistent, and the solution is simple and effective.

[0120] In some embodiments, determining the priority of each sound signal in the at least two sound signals according to the sound source device of the at least two sound signals includes:

[0121] In response to the at least two sound signals coming from different sound source devices, determining the priority of each sound signal in the at least two sound signals according to the priority of the sound source devices corresponding to the at least two sound signals; wherein the priority of the sound signal is positively correlated with the priority of the sound source device;

[0122] In response to the sound source devices of the at least two sound signals being consistent, it is determined that the priorities of the sound signals in the at least two sound signals with consistent sound types are consistent.

[0123] In an embodiment of the present disclosure, when there are at least two sound signals of the same sound type among multiple sound signals, when determining the priority according to the sound source device, a distinction is made based on whether they come from the same sound source device. When at least two sound signals come from different sound source devices, the priority of the sound signal is determined in a positive correlation manner according to the priority of the sound source device. As mentioned above, different sound source devices have different importance to the user, and thus the priority of the sound signal determined based on the priority of the sound source device can also reflect the importance of the sound signal to the user. In an embodiment of the present disclosure, if the sound type and sound source device of at least two sound signals are consistent, it is determined that the priority of each sound signal in the at least two sound signals is consistent.

[0124] Of course, in the disclosed embodiment, when the sound type and sound source device of at least two sound signals are consistent, the priority of the sound signal can be further determined in combination with the application type to which the sound signal belongs. For example, the priority of the video sound sent by the same device through the photo album can be lower than the priority of the video sound sent by the WeChat application.

[0125] It should be noted that in the embodiment of the present disclosure, the priority determined based on the sound type can also be set higher than the priority determined based on the sound source device, so as to give different priorities to each sound signal in the multiple sound signals as much as possible, so as to improve the distinction of each sound signal.

[0126] It can be understood that in the embodiments of the present disclosure, the priority scheme of the sound signal determined based on the priority of the sound source device is simple and effective.

[0127] Take the example of an electronic device being a headset. Figure 2 This is an example of a sound output method process in the embodiment of the present disclosure. Figure 1 ,like Figure 2 As shown, the sound output method applied to the earphone includes the following steps:

[0128] S21, waiting state after two devices are connected.

[0129] In the disclosed embodiment, the dual devices, i.e., the devices connected to the earphone, such as a tablet computer and a mobile phone, wait for the sound signal and trigger it to be sent to the earphone.

[0130] S22: Are multiple signals transmitted to the headset at the same time? If so, execute step S23; if not, return to execute step S21.

[0131] In the embodiment of the present disclosure, the earphone detects whether multiple sound signals are received and executes corresponding steps.

[0132] S23, determining the types of the multiple signals.

[0133] In the embodiment of the present disclosure, if the earphone receives multiple sound signals, the types of the multiple signals are judged to determine the priorities.

[0134] S24. Perform gain adjustment on the two signals based on the masking effect gain adjustment strategy.

[0135] In the embodiment of the present disclosure, if the earphone acquires two sound signals, the gains of the two signals are adjusted based on the masking effect gain adjustment strategy, that is, the sound characteristics of the two sound signals are adjusted based on the determined priority.

[0136] S25. The adjusted signals are mixed and output to the earphone speaker for playing to the user.

[0137] In the embodiment of the present disclosure, the adjusted signals are mixed and output to the earphone speaker to be played to the user, that is, the two sound signals with adjusted sound characteristics are synchronously output through the earphone speaker.

[0138] Figure 3 FIG. 1 is a flowchart of a method for determining the priority of a sound signal in an embodiment of the present disclosure, such as Figure 3 As shown, the following steps are included:

[0139] S31. Two or more sound signals are connected.

[0140] In the disclosed embodiment, two or more sound signals are connected to an electronic device such as headphones.

[0141] S32, making a major classification judgment on each signal.

[0142] In the embodiment of the present disclosure, sound signals can be divided into two categories, one is a media signal and the other is a voice signal. The classification method of these two signals can be determined by the Bluetooth audio transmission protocol or by the energy spectrum.

[0143] S33: Is it a voice signal? If so, go to step S34; if not, go to step S35.

[0144] In the embodiment of the present disclosure, if it is determined that the sound signal is a speech signal, step S34 is executed, otherwise step S35 is executed.

[0145] S34: Confirm the signal priority.

[0146] In the embodiment of the present disclosure, if it is a voice signal, the priority of the voice signal can be determined according to the corresponding relationship between the sound type and the priority.

[0147] S35, classify again.

[0148] In the disclosed embodiment, if the media signal is other than a voice signal, the sound type of the sound signal is further subdivided, for example, the music signal, video signal, prompt sound signal, etc. can be subdivided according to the decoding method or frame length.

[0149] S36. Determine the priority of the signal.

[0150] In the embodiment of the present disclosure, after determining the specific sound type of a media signal other than a voice signal, the priority of the media signal can be confirmed according to the corresponding relationship between the sound type and the priority.

[0151] S37: Determine the priority of each signal currently being transmitted.

[0152] In the embodiment of the present disclosure, for each sound signal currently being transmitted, the priority corresponding to the sound signal may be determined by using the above-mentioned method.

[0153] Figure 4 This is an example of a sound output method process in the embodiment of the present disclosure. Figure 2 ,like Figure 4 As shown, the sound output method includes the following steps:

[0154] S41, multiple signal inputs.

[0155] In the embodiment of the present disclosure, the multi-channel signal input means that the electronic device obtains the multi-channel sound signals.

[0156] S42: Confirm the signal type.

[0157] In the embodiment of the present disclosure, the signal type confirmation means that the electronic device determines the sound type of each sound signal.

[0158] S43, multi-channel signal priority division.

[0159] In the disclosed embodiment, the electronic device determines the priority of each sound signal according to the sound type of each sound signal. In the process of determining the priority, steps S43a to 43c are included, wherein in step S43a, the electronic device determines whether the user has a customized priority strategy, if so, step S43b is executed to determine the priority of each signal using the user customized priority strategy, if not, step S43c is executed to determine the priority of each signal based on the default priority strategy.

[0160] S44, adjusting the signals of each priority channel.

[0161] In this embodiment, after the electronic device determines the priority of each sound signal, it can adjust the sound signal according to the priority of each sound signal. For example, for sound signals of different priorities, the sound signals of different priorities are adjusted to different sound characteristics, and for sound signals of the same priority, the output time or the number of output channels is adjusted. Taking the adjustment of sound characteristics as an example, when adjusting the signal, any one or more methods of S44a, S44b and S44c can be used. In S44a, the maximum sound pressure level is limited, that is, the sound intensity of the highest priority sound signal is adjusted to within the target sound intensity range; in S44b, the masking effect scale transformation strategy is used, that is, sound signals of different priorities are distributed in different scales; in S44c, the frequency shift execution strategy is used, that is, the sound frequency of the highest priority sound signal is maintained unchanged, and the sound frequencies of sound signals of different priorities are made different.

[0162] S45, multi-channel signal mixing.

[0163] In the disclosed embodiment, multi-channel signal mixing is to mix multiple regulated digital signals into analog signals. For example, for sound signals of different priorities, the signals after sound characteristic adjustment are mixed into one channel; for sound signals of the same priority, they are directly merged into one channel.

[0164] S46, output signal.

[0165] In the disclosed embodiment, the electronic device can output the mixed analog signal, which is essentially to synchronously output the adjusted multi-channel sound signals. It should be noted that for the sound signals with the same priority adjusted in output time, they can also be output in time-sharing according to the adjusted output time.

[0166] It is understandable that in the above Figures 2 to 4In an embodiment of the present invention, the electronic device adjusts the sound signal according to the priority of each sound signal. For example, for sound signals of different priorities, the sound characteristics of the sound signals of different priorities are different by adjusting the sound intensity, sound frequency and scale. Then, when the adjusted multiple sound signals are synchronously output, on the one hand, due to the different sound characteristics of the sound signals of different priorities, when the multiple sound signals including different priorities are synchronously output, the user can perceive different sounds based on different sound characteristics, which can effectively reduce the occurrence of sound loss caused by masking effect or pausing the playback of a certain sound signal. On the other hand, adjusting the sound signal based on the priority can make the adjusted sound signals adapt to the priority, that is, the adjustment is more targeted, which can enhance the user's perception and distinction of the sound and the sense of hearing, and is therefore more intelligent.

[0167] Figure 5 FIG. 1 is a diagram showing a sound output device according to an exemplary embodiment. Figure 5 , the sound output device comprises:

[0168] The determination module 101 is configured to determine the priority of each sound signal when receiving multiple sound signals;

[0169] The adjustment module 102 is configured to adjust the received sound signal according to the priority of each sound signal;

[0170] The output module 103 is configured to output the adjusted sound signal.

[0171] In some embodiments, the adjustment module 102 is further configured to adjust the sound characteristics of sound signals of different priorities for sound signals of different priorities; wherein the sound characteristics of sound signals of different priorities are different after adjustment; and for sound signals of the same priority, adjust the output time or output path of the sound signals of the same priority.

[0172] In some embodiments, the adjustment module 102 is further configured to adjust the sound intensity of sound signals of different priorities in a positive correlation with the priority.

[0173] In some embodiments, the adjustment module 102 is further configured to adjust the sound intensities of sound signals of different priorities to be different, and adjust the sound intensity of the sound signal of a predetermined priority to be within a target sound intensity range.

[0174] In some embodiments, the adjustment module 102 is further configured to adjust the sound intensity and / or frequency of sound signals of different priorities so that the sound signals of different priorities are distributed in different scales; wherein the scales of the sound signals of different priorities are positively correlated with the priorities.

[0175] In some embodiments, the adjustment module 102 is further configured to maintain the sound frequency of the sound signal of a predetermined priority level unchanged, and adjust the sound frequencies of the sound signals of different priorities to be different.

[0176] In some embodiments, the adjustment module 102 is further configured to, for sound signals of the same priority, adjust the output time of the sound signals of the same priority to be different in response to the sound signal type being a sound signal of fixed frame length; and / or, in response to the sound signal type being a sound signal of non-fixed frame length, merge sound signals of the same priority on different paths into one path or suspend a predetermined number of sound signals.

[0177] In some embodiments, the determination module 101 is further configured to determine the priority of each sound signal according to the sound type of each sound signal.

[0178] In some embodiments, the determination module 101 is further configured to, in response to the presence of at least two sound signals of inconsistent sound types among the multiple sound signals, determine the priority corresponding to each of the at least two sound signals based on the sound types of the at least two sound signals and the correspondence between the sound types and the priorities; in response to the presence of at least two sound signals of consistent sound types among the multiple sound signals, determine the priority of each of the at least two sound signals according to the sound source devices of the at least two sound signals.

[0179] In some embodiments, the determination module 101 is further configured to, in response to the at least two sound signals coming from different sound source devices, determine the priority of each sound signal in the at least two sound signals according to the priority of the sound source devices corresponding to the at least two sound signals; wherein the priority of the sound signal is positively correlated with the priority of the sound source device; and in response to the sound source devices of the at least two sound signals being consistent, determine that the priority of each sound signal in the at least two sound signals with the same sound type is consistent.

[0180] Regarding the device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0181] Figure 6 800 is a block diagram of an electronic device according to an exemplary embodiment. For example, the device 800 may be a wireless headset, a headphone, or a smart speaker.

[0182] Reference Figure 6, the device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0183] The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0184] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0185] The power supply component 806 provides power to the various components of the device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 800.

[0186] The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0187] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device 800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0188] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: home button, volume button, start button, and lock button.

[0189] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800, and the sensor assembly 814 can also detect the position change of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration / deceleration of the device 800, and the temperature change of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an infrared light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0190] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0191] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0192] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by the processor 820 of the device 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0193] A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform a sound output method, the method comprising:

[0194] When receiving multiple audio signals, determine the priority of each audio signal;

[0195] Adjust the received sound signals according to the priorities of the sound signals of each channel;

[0196] Outputs the adjusted sound signal.

[0197] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0198] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A sound output method, characterized in that: The method comprises: When receiving multiple audio signals, determine the priority of each audio signal; Adjust the received sound signals according to the priorities of the sound signals of each channel; Outputs the adjusted sound signal.

2. The method according to claim 1, characterized in that The step of adjusting the received sound signals according to the priorities of the sound signals of each channel includes: For sound signals of different priorities, adjusting the sound characteristics of the sound signals of different priorities; wherein the sound characteristics of the sound signals of different priorities are different after the adjustment; For sound signals with the same priority, the output time or the number of output paths of the sound signals with the same priority are adjusted.

3. The method according to claim 2, characterized in that The step of adjusting the sound characteristics of the sound signals of different priorities includes: The sound intensity of the sound signals of different priorities is positively correlated with the priority.

4. The method according to claim 2, characterized in that: The step of adjusting the sound characteristics of the sound signals of different priorities includes: The sound intensities of sound signals with different priorities are adjusted differently, and the sound intensity of the sound signal with a predetermined priority is adjusted to be within a target sound intensity range.

5. The method according to claim 2, characterized in that: The step of adjusting the sound characteristics of the sound signals of different priorities includes: The sound intensity and / or frequency of the sound signals of different priorities are adjusted so that the sound signals of different priorities are distributed in different scales; wherein the scales of the sound signals of different priorities are positively correlated with the priorities.

6. The method according to claim 2, characterized in that The step of adjusting the sound characteristics of the sound signals of different priorities includes: Adjust sound signals of different priorities to different sound frequencies.

7. The method according to claim 6, characterized in that The step of adjusting sound signals of different priorities to different sound frequencies includes: The sound frequency of the sound signal of a predetermined priority is maintained unchanged, and the sound frequencies of the sound signals of different priorities are adjusted differently.

8. The method according to claim 2, characterized in that: The step of adjusting the output time or the number of output paths of the sound signals with the same priority level comprises: For sound signals of the same priority, in response to the type of the sound signal being a sound signal of fixed frame length, adjusting the output time of the sound signals of the same priority to be different; and / or, In response to the type of the sound signal being a sound signal with a non-fixed frame length, different channels of sound signals with the same priority are merged into one channel or a predetermined number of channels of sound signals are suspended.

9. The method according to claim 1, characterized in that: Determining the priority of each sound signal includes: The priority of each sound signal is determined according to the sound type of each sound signal.

10. The method according to claim 9, characterized in that Determining the priority of each sound signal according to the sound type of each sound signal includes: In response to at least two sound signals of inconsistent sound types among the multiple sound signals, determining the priority corresponding to each of the at least two sound signals based on the sound types of the at least two sound signals and the correspondence between the sound types and the priorities; In response to at least two sound signals having the same sound type among the multiple sound signals, the priority of each sound signal among the at least two sound signals is determined according to sound source devices of the at least two sound signals.

11. The method according to claim 10, characterized in that The determining the priority of each sound signal in the at least two sound signals according to the sound source device of the at least two sound signals comprises: In response to the at least two sound signals coming from different sound source devices, determining the priority of each sound signal in the at least two sound signals according to the priority of the sound source devices corresponding to the at least two sound signals; wherein the priority of the sound signal is positively correlated with the priority of the sound source device; In response to the sound source devices of the at least two sound signals being consistent, it is determined that the priorities of the sound signals in the at least two sound signals with consistent sound types are consistent.

12. A sound output device, characterized in that: The device comprises: A determination module, configured to determine the priority of each sound signal when receiving multiple sound signals; An adjustment module, configured to adjust the received sound signals according to the priorities of the sound signals of each channel; The output module is configured to output the conditioned sound signal.

13. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the sound output method as described in any one of claims 1 to 11.

14. A non-transitory computer-readable storage medium, characterized in that: When the instructions in the storage medium are executed by a processor in an electronic device, the electronic device is enabled to execute the sound output method according to any one of claims 1 to 11.

Images