Sound output method and device, electronic device, and storage medium
By determining the corresponding sound processing parameters based on the original sound quality of the multimedia resource and optimizing the original sound of the multimedia resource, the problem of inability to effectively restore the original sound details or low power consumption utilization rate when sound output in the prior art is solved, and efficient sound output and power consumption management are achieved.
Patent Information
- Application Number
- CN202110328631.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-03-26
- Publication Date
- 2025-04-22
- Estimated Expiration
- 2041-03-26
AI Technical Summary
In the sound output, the prior art cannot effectively restore the original sound details or the power consumption utilization rate is low due to the uniform sound processing parameters that do not match the original sound quality of the multimedia resource.
According to the different sound quality of the multimedia resources, the corresponding sound processing parameters are determined, and the original sound of the multimedia resources is processed by optimizing the sound processing parameters to restore the original sound details and reduce power consumption.
On the premise of ensuring that the original sound of multimedia resources is restored and output, the power consumption of sound output is reduced, the power consumption utilization rate is improved, and the user's audio-visual experience is improved.
Smart Images

Figure CN115134675B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of multimedia, and in particular to a sound output method and device, an electronic device, and a storage medium. Background Art
[0002] In the Internet age, users can obtain various types of multimedia resources from the Internet for various purposes. For example, these multimedia resources may include movies, short videos, music, etc.
[0003] In the related art, when a user opens any type of multimedia resource for viewing or listening, the electronic device uses a unified sound processing parameter to process and output the multimedia resource. However, the original sound quality of different multimedia materials is actually different, which makes it very easy to fail to show the original sound details or have low power consumption when outputting the sound of multimedia resources through the sound output method in the related art. Summary of the invention
[0004] The present disclosure provides a sound output method and device, an electronic device, and a storage medium, which can perform targeted processing on the sound of multimedia resources according to the original sound quality of the multimedia resources, thereby allowing the output sound to restore the original sound quality while avoiding the problem of too low power consumption utilization.
[0005] According to a first aspect of the present disclosure, there is provided a sound output method, comprising:
[0006] When a play instruction for a first target multimedia resource is detected, determining a first target multimedia type to which the first target multimedia resource belongs, wherein original sound qualities of different multimedia types are different;
[0007] Determining a first target sound processing parameter corresponding to the first target multimedia type according to a preset correspondence between the multimedia type and the sound processing parameter, wherein the degree of optimization of the sound processing parameter corresponding to any multimedia type on the original sound is positively correlated with the sound quality of the original sound of any multimedia type;
[0008] The original sound of the first target multimedia resource is optimized using the first target sound processing parameter, and the optimized sound is output.
[0009] According to a second aspect of the present disclosure, there is provided a sound output device, comprising:
[0010] A first determining unit, when detecting a play instruction for a first target multimedia resource, determines a first target multimedia type to which the first target multimedia resource belongs, wherein original sound qualities of different multimedia types are different;
[0011] a second determination unit, determining a first target sound processing parameter corresponding to the first target multimedia type according to a preset correspondence between the multimedia type and the sound processing parameter, wherein the degree of optimization of the sound processing parameter corresponding to any multimedia type for the original sound is positively correlated with the sound quality of the original sound of any multimedia type;
[0012] The output unit optimizes the original sound of the first target multimedia resource by using the first target sound processing parameter, and outputs the optimized sound.
[0013] According to a third aspect of the present disclosure, there is provided an electronic device, including:
[0014] processor;
[0015] a memory for storing processor-executable instructions;
[0016] The processor implements the method as described in the first aspect by running the executable instructions.
[0017] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which computer instructions are stored, and when the instructions are executed by a processor, the steps of the method described in the first aspect are implemented.
[0018] In the technical solution disclosed in the present invention, when a play instruction for any multimedia resource is detected, the multimedia type to which the multimedia resource belongs is determined first, and the corresponding sound processing parameters are determined according to the multimedia type to process the original sound of the multimedia resource. The original sound quality of different multimedia types is different, and the degree of optimization of the original sound by the sound processing parameters corresponding to different multimedia types is positively correlated with the original sound quality of the multimedia type.
[0019] It should be understood that the present disclosure is equivalent to grading the sound quality of the original sound of different multimedia types, wherein the higher the sound quality level of the multimedia type, the better the optimization effect of the corresponding sound processing parameters on the original sound. Obviously, through the technical solution of the present disclosure, corresponding sound processing parameters can be configured for multimedia resources with different sound quality, so that when the original sound quality of the played multimedia resources is good, it can be ensured that its original sound can be restored well; and when the original sound quality of the multimedia resources is poor, it will not cause the problem of high power consumption in the process of processing the sound of the multimedia resources due to the high sound processing parameters configured for it. In other words, the technical solution of the present disclosure enables electronic devices to process the original sound of multimedia resources in a targeted manner with sound quality priority or power consumption priority according to the original sound quality of the multimedia resources, which can not only ensure that the original sound of the multimedia resources is restored and output, but also ensure that the utilization rate of power consumption is not reduced due to excessively high output parameters. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0021] Figure 1 is a flow chart of a sound output method shown in an exemplary embodiment of the present disclosure;
[0022] Figure 2 is a flow chart of another sound output method shown in an exemplary embodiment of the present disclosure;
[0023] Figure 3 is a flowchart of another sound output method shown in an exemplary embodiment of the present disclosure;
[0024] Figure 4 is a block diagram of a sound output device shown in an exemplary embodiment of the present disclosure;
[0025] Figure 5 It is a schematic structural diagram of an electronic device in an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION
[0026] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0027] The terms used in this disclosure are for the purpose of describing specific embodiments only and are not intended to limit the disclosure. The singular forms of "a", "said" and "the" used in this disclosure and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" used herein refers to and includes any or all possible combinations of one or more associated listed items.
[0028] It should be understood that although the terms first, second, third, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".
[0029] In the Internet age, users can obtain various types of multimedia resources from the Internet for various purposes. For example, these multimedia resources may include movies, short videos, music, etc.
[0030] In the related art, when a user opens any type of multimedia resource for viewing or listening, the electronic device uses a unified sound processing parameter to process and output the multimedia resource. However, the original sound quality of different multimedia resources is actually different, which makes it very easy to fail to show the original sound details or have too low power consumption when the sound of the multimedia resource is output in real time through the sound output method in the related art.
[0031] For example, assuming that the original sound quality of multimedia resource A is good, then when multimedia resource A is played under the user's instructions, if the original sound of multimedia resource A is output using sound processing parameters with poor sound quality optimization or general sound processing parameters, the processing process may not be able to effectively restore the original sound of the multimedia resource. For example, problems such as loss of bass details and harsh treble may easily occur, reducing the user's audio-visual experience.
[0032] On the contrary, assuming that the original sound quality of multimedia resource B is poor, then when multimedia resource B is played under the user's instructions, if the original sound of multimedia resource B is output using sound processing parameters with a better degree of sound quality optimization or general sound processing parameters, since the original sound quality of multimedia resource B itself is poor, there are not many sound details that need to be restored, and the sound processing parameters with a higher degree of sound quality optimization also consume relatively more power. It can be seen that the power consumption of the sound processing parameters used at this time is greater than the power consumption required to restore the original sound of multimedia resource B. In other words, there is a part of invalid power consumption, which reduces the power consumption utilization rate.
[0033] It can be seen that through the sound output method in the relevant technology, the sound processing parameters used often do not match the original sound quality of the multimedia resources, making it difficult to reduce the power consumption used to output the sound while ensuring that the original sound of the multimedia resources is restored.
[0034] To this end, the present disclosure proposes a sound output method to avoid the problem in the related art that the original sound of multimedia resources is output using unified sound processing parameters, which leads to the inability to reduce power consumption while ensuring the original sound quality.
[0035] Figure 1 A sound output method is shown as an exemplary embodiment of the present disclosure. Figure 1 As shown, the method may include the following steps:
[0036] Step 102: When a play instruction for a first target multimedia resource is detected, a first target multimedia type to which the first target multimedia resource belongs is determined, wherein original sound qualities of different multimedia types are different.
[0037] It can be seen from the above technical solution that the related technology outputs the sound of multimedia resources through unified sound processing parameters when playing multimedia resources. This sound output method cannot reduce the power consumption of sound output while ensuring that the original sound of the multimedia resources is restored.
[0038] It should be understood that the reason why the above problems exist in the related art is that the degree of optimization of the original sound by the adopted sound processing parameters does not match the original sound quality of the multimedia resources.
[0039] In view of this, the present disclosure no longer processes the original sound of different multimedia resources through unified sound processing parameters, but configures corresponding sound processing parameters for multimedia types with different original sound quality, so that when any multimedia resource is played, the sound processing parameters to be adopted are determined according to the original sound quality of the multimedia type to which the any multimedia resource belongs. Among them, the degree of optimization of the original sound by the sound processing parameters corresponding to each multimedia type is positively correlated with the original sound quality of the corresponding multimedia type. In other words, when playing a multimedia resource, the better the original sound quality of the multimedia resource, the sound processing parameters with relatively higher optimization effect are used to process its original sound and then output; conversely, the worse the original sound quality of the multimedia resource, the sound processing parameters with relatively worse optimization effect are used to process its original sound and then output. It can be seen that compared with the sound output method in the related art, the present disclosure can reduce the power consumption used for sound output while restoring the original sound of the multimedia resource as much as possible.
[0040] It is not difficult to understand that the technical solution disclosed in the present invention is equivalent to classifying multimedia resources according to the quality of the original sound, and configuring corresponding sound processing parameters for each multimedia type, so that when each multimedia type is played, the sound can be processed and output using the sound processing parameters that match it. When configuring the sound processing parameters for each multimedia type, the sound processing parameters should be optimized as much as possible for the original sound of the corresponding type of multimedia resource, so that the sound quality can be restored better with the lowest power consumption.
[0041] It should be stated that although the multimedia resources commonly obtained by users today are usually not divided according to the quality of sound, even so, the original sound quality of different multimedia types obtained by the division is mostly different. For example, short videos, movies, TV series, etc. are divided according to the type of video, but most short videos played on short video platforms are usually shot and uploaded to the Internet by users themselves, and most of them do not use professional sound recording equipment, and their sound quality is usually poor; correspondingly, movies and TV series are usually recorded by professional sound recording equipment during shooting, or even recorded by professional recording equipment after shooting, and their original sound quality is usually good. In this scenario, you only need to configure a sound processing parameter with a relatively low degree of sound optimization for the short video, so that its original sound can be restored better when playing the short video; correspondingly, you need to configure a sound processing parameter with a relatively high degree of sound optimization for multimedia resources such as movies and TV series to ensure that their good original sound quality can be restored. It is understandable that if the sound processing parameters for processing short video multimedia resources are recorded as short video processing parameters, and the sound processing parameters for processing film and television multimedia resources are recorded as film and television processing parameters, then the degree of optimization of the original sound of short video multimedia resources by the short video processing parameters is lower than the degree of optimization of the original sound of film and television multimedia resources by the film and television processing parameters. Furthermore, multimedia resources such as music recorded in a recording studio not only have good original sound quality, but also contain a lot of high and low bass details and involve a wider range of sounds. Therefore, it is necessary to configure sound processing parameters with a higher degree of sound optimization to restore its high and low bass details, as well as the details of each range.
[0042] Of course, the above examples are only illustrative. In addition to directly configuring sound processing parameters for different types based on different commonly used multimedia types, technicians or users can also classify multimedia types according to sound quality for different multimedia resources, and then configure corresponding sound processing parameters for the multiple types obtained by classification. How to configure specifically can be divided by those skilled in the art according to actual conditions, and this disclosure does not limit this.
[0043] In the present disclosure, no matter which type of multimedia resource is configured for the sound processing parameters, the sound processing parameters corresponding to each multimedia type are obtained by adjusting the parameter values related to each sound dimension. For example, the sound processing parameters include but are not limited to the range, sound intensity, sound frequency, and sound amplitude. In other words, the parameter values related to the range, timbre, sound intensity, pitch, etc. set in the sound processing parameters corresponding to different multimedia types are different, so the sound quality of the original sound can be adjusted to different degrees.
[0044] In actual operation, the sound processing parameters need to be added to the relevant sound processing code, and then the original sound of the multimedia resource is processed by executing the sound processing code with the sound processing parameters added. In the sound processing code, in addition to the above-mentioned code for adjusting the parameter values of each dimension of the sound, it can also further include code for other processing of the sound. For example, it can also include code related to noise reduction. Correspondingly, the set sound processing parameters can also include noise reduction parameters, wherein the noise reduction parameters configured for different multimedia types are usually different, so as to perform different degrees of noise reduction on the corresponding multimedia resources. For example, the noise reduction parameters corresponding to music and film and television multimedia resources are usually higher. When the noise reduction parameters are used for noise reduction, the noise reduction effect is better, but the power consumption is also higher; and the noise reduction parameters corresponding to short video multimedia resources are usually lower. When the noise reduction parameters are used for noise reduction, the noise reduction effect is general, but the power consumption is relatively lower. For another example, the sound processing code may also include a code for identifying the sound range, through which the high and low tones in the sound can be identified and the high and low tones can be restored in detail. Accordingly, the configured sound processing parameters may include a parameter value for indicating "whether to execute this part of the code". For example, the sound processing parameters corresponding to music multimedia resources may be configured with an indication parameter for indicating "execute this part of the code", so that when processing music multimedia resources, the code can be used to restore the high and low tones of the music multimedia resources in detail; and the sound processing parameters corresponding to short video multimedia resources may be configured with an indication parameter for indicating "do not execute this part of the code", so that when processing short video multimedia resources, the above code is not executed, thereby achieving the purpose of reducing power consumption.
[0045] Of course, the above examples are only illustrative, and how to configure the sound processing code and configure the corresponding sound processing parameters for different types of multimedia resources can be set by those skilled in the art according to actual conditions, and the present disclosure does not limit this. For example, the code for creating environmental sound effects can also be configured.
[0046] In the present disclosure, the multimedia type to which the multimedia resource belongs may be determined in a variety of ways.
[0047] In one embodiment, if sound processing parameters are configured for each multimedia type directly on the basis of the common multimedia types nowadays, since different multimedia types are usually played on different applications, for example, movies and TV series are usually played on the film and television APP, short videos are usually played on the short video APP, and music is played on the music APP. Therefore, when any multimedia resource is played, the application that calls the audio module can be determined first, and then the multimedia type to which the any multimedia resource belongs can be determined according to the multimedia service that the application is responsible for. For example, when a user triggers any TV series in the film and television APP, the film and television APP will call the audio module of the device to output the sound of the series while the TV series is playing. At this time, it can be determined that the film and television APP calls the audio module. Obviously, the multimedia service it is responsible for is to play TV series, movies and other film and television resources. Therefore, it can be determined that any multimedia resource belongs to the film and television multimedia resource, and then the sound of the series is processed and output by the sound processing parameters corresponding to the film and television class. Of course, in actual applications, it is also possible to directly establish a corresponding relationship between the application and the sound processing parameters to directly determine the sound processing parameters used according to the application that calls the audio module. Among them, the application that calls the audio module is usually determined according to the package name of the received data packet.
[0048] It should be noted that the above method requires the use of an application to determine the type of multimedia resources, and therefore is mostly used for streaming media playback.
[0049] In another embodiment, when any multimedia resource is played, the file suffix of the multimedia resource can be obtained to determine the multimedia type to which the multimedia resource belongs based on the file suffix. For example, the suffixes of the music multimedia resources mentioned above may include: MIDI, MP3, etc.; and the suffixes of video multimedia resources may include: MOV, MP4, AVI, etc. Therefore, when the file suffix of any of the above multimedia resources is one of MIDI, MP3, and other music file suffixes, it can be determined that the multimedia resource belongs to a music multimedia resource; correspondingly, when the file suffix of any of the above multimedia resources is one of MOV, MP4, AVI, and other video file suffixes, it can be determined that the multimedia resource belongs to a video multimedia resource.
[0050] It should be noted that since this method needs to determine the type of multimedia resources based on the file suffix, it is mostly used for playing local multimedia resources. In addition, it is essentially to divide multimedia resources according to file types. From the division results, the multimedia resources contained in each multimedia type obtained by division usually cover a wider range of original sound quality. For example, the original sound quality of the above-mentioned short video and film and television categories is different, but they may be classified as the same type of multimedia resources.
[0051] Step 104, based on the correspondence between the preset multimedia type and the sound processing parameter, determine the first target sound processing parameter corresponding to the first target multimedia type, and the degree of optimization of the sound processing parameter corresponding to any multimedia type for the original sound is positively correlated with the sound quality of the original sound of any multimedia type.
[0052] In the present disclosure, there may also be a situation where multiple multimedia resources are played simultaneously. It should be understood that, for the audio module, only one sound processing parameter can be used at the same time to process and output the received sound. Therefore, in this case, the sound processing parameter used to process the sound can be determined according to actual needs.
[0053] In one embodiment, the sound processing parameters used can be determined according to the sound quality requirements. Specifically, during the playback of the first target multimedia resource, if a playback instruction for the second multimedia resource is received, the second target multimedia type to which the second multimedia resource belongs can be determined; and the second target sound processing parameters corresponding to the second target multimedia type can be further determined. On this basis, the first target sound processing parameters corresponding to the first multimedia resource can be compared with the second target sound processing parameters, and the original sound received by the audio module can be processed using the party with a higher or lower degree of optimization. In other words, the audio module uses a unified sound processing parameter to process the original sound of the first target multimedia resource and the second target multimedia resource. Among them, when the sound received by the audio module is processed using the party with a higher degree of optimization, it is equivalent to giving priority to ensuring the sound quality during the playback process, which can be called a sound quality priority mode; correspondingly, when the sound received by the audio module is processed using the party with a lower degree of optimization, it is equivalent to giving priority to reducing the power consumption during the playback process, which can be called a power consumption priority mode. In actual operation, a mode selection control can be set so that the user can select the currently used playback mode; or, the user can determine which mode to use according to the current state of the device. For example, when the device power is higher than a preset value, the sound quality priority mode is used, and when the device power is lower than a preset value, the power consumption priority mode is used. Of course, this example is only illustrative, and the specific setting can be determined by those skilled in the art according to actual needs.
[0054] In another embodiment, the sound processing parameters can be determined according to the playback order. Specifically, during the playback of the first target multimedia resource, if a playback instruction for the third target multimedia resource is received, the third target multimedia type to which the third target multimedia resource belongs can be determined; and the third target sound processing parameters corresponding to the third target multimedia type can be further determined. On this basis, the original sound received by the audio module can be processed by the third target sound processing parameters, and the processed sound can be output by the audio module. In other words, the audio module uses the third sound processing parameters to process the original sounds of the first target multimedia resource and the third target multimedia resource and then output them.
[0055] It is not difficult to understand that, in most cases, the multimedia resources played by the user later are usually the objects of their current focus. Therefore, in this case, the sound received by the audio module is processed according to the sound processing parameters corresponding to the multimedia resources played later, which can more accurately meet the user's playback needs. Of course, in this embodiment, the sound received by the audio module can also be processed according to the sound processing parameters corresponding to the multimedia resources played first. Similar to the previous embodiment, in this embodiment, a mode selection control can also be set so that the user can choose whether to process the sound according to the sound processing parameters of the multimedia resources played first, or to process the sound according to the sound processing parameters of the multimedia resources played later. Specifically, it can be determined by those skilled in the art according to actual needs, and the present disclosure is not limited here.
[0056] Step 106: optimize the original sound of the first target multimedia resource using the first target sound processing parameters, and output the optimized sound.
[0057] As mentioned above, when the original sound of multimedia resources is processed by different sound processing parameters, the power consumption required for sound output is different. Specifically, the degree of optimization of the original sound by any sound processing parameter is positively correlated with the power consumption when the optimization is performed by the sound processing parameter. In other words, the higher the degree of optimization of the original sound by any sound processing parameter, the higher the power consumption when the sound is processed by the sound processing parameter.
[0058] Although only short video, film and television, and music types of multimedia resources appear in the above examples, in actual applications, other types of multimedia resources are also included, for example, live broadcast, radio, etc. The first target multimedia resource determined in the present disclosure can be any of them.
[0059] In the present disclosure, the audio module can process the original sound of the multimedia resource in a variety of ways. For example, the original sound of the multimedia resource can be correspondingly gained according to the determined sound processing parameters; for another example, the mid-high frequency signals that cannot be heard by the human ear in the original sound of the multimedia resource being played can be down-converted so that after the multimedia resource is processed, the user can hear the sound corresponding to the mid-high frequency signals; for another example, when the sound intensity is too high, the human ear will have a masking effect and cannot hear this part of the sound. Therefore, when the sound intensity of a part of the original sound of the multimedia resource being played is higher than the preset masking value, the part of the sound signal is eliminated to avoid power consumption loss caused by outputting this part of invalid sound.
[0060] It should be noted that the technical solution of the present disclosure can be applied to any type of electronic device, for example, the electronic device can be a mobile terminal such as a smart phone, a tablet computer, or a fixed terminal such as a smart TV, a PC (personal computer). The specific type of electronic device to which the technical solution of the present disclosure is applied can be determined by those skilled in the art according to actual needs, and the present disclosure does not limit this.
[0061] It can be seen from the above technical solution that when the present disclosure detects a play instruction for any multimedia resource, it will first determine the multimedia type to which the multimedia resource belongs, and determine the corresponding sound processing parameters according to the multimedia type to process the original sound of the multimedia resource. Among them, the original sound quality of different multimedia types is different, and the degree of optimization of the original sound by the sound processing parameters corresponding to different multimedia types is positively correlated with the original sound quality of the multimedia type.
[0062] It should be understood that the present disclosure is equivalent to grading the sound quality of the original sound of different multimedia types, wherein the higher the sound quality level of the multimedia type, the better the optimization effect of the corresponding sound processing parameters on the original sound. Obviously, through the technical solution of the present disclosure, corresponding sound processing parameters can be configured for multimedia resources with different sound quality, so that when the original sound quality of the multimedia resource is good, it can be ensured that its original sound can be restored well; and when the original sound quality of the multimedia resource is poor, it will not cause the problem of low power consumption utilization due to the high sound processing parameters configured for it. In other words, the technical solution of the present disclosure enables electronic devices to process the original sound of multimedia resources in a targeted manner with sound quality priority or power consumption priority according to the original sound quality of the multimedia resources, which can not only ensure that the original sound of the multimedia resources is restored and output, but also ensure that the power consumption utilization is not reduced due to the excessively high setting of the output parameters.
[0063] Furthermore, the present disclosure can determine which multimedia resource's corresponding sound processing parameters are used to output the sound according to the needs when playing multiple multimedia resources at the same time. In practical applications, the sound processing parameters used can be determined according to the playback order of multiple multimedia resources, or according to the user's demand for sound quality. It can be seen that the technical solution of the present disclosure can meet the user's needs to play multiple multimedia materials at the same time in multiple different scenarios.
[0064] Below, the technical solution of the present disclosure is introduced by taking the playing of streaming media in a smart phone as an example.
[0065] Figure 2 FIG. 1 is a flow chart of another sound output method according to an exemplary embodiment of the present disclosure. Figure 2 As shown, the method comprises the following steps:
[0066] Step 201: receiving a user's instruction to play a target streaming media.
[0067] The common way of playing streaming media nowadays is to play it on the relevant APP. Therefore, in this embodiment, when receiving a playback request for any streaming media, it is possible to preferentially determine on which target APP the target streaming media is played, and then determine the type of streaming media to which the target streaming media belongs based on the target APP. Since in actual operation, after receiving the user's playback instruction, the target APP will request to call the audio module, therefore, the type of streaming media to which the target streaming media belongs can be directly determined based on the APP that requests to call the audio module.
[0068] For example, this embodiment can determine the type of streaming media to which the streaming media played on each APP belongs in advance according to the business that each APP installed on the smartphone is responsible for. Assume that there are 5 playback APPs installed on the smartphone, namely: XX Film and Television, XX Video, XX Short Video, XX Music, and XXmusic. It is not difficult to see that the business that XX Film and Television and XX Video are responsible for is: playing film and television streaming media, which obviously belongs to the film and television APP, so the corresponding relationship of "XX Film and Television-Film and Television; XX Video-Film and Television" can be established; and the business that XX Short Video is responsible for is: playing short videos shot by users themselves, which belongs to the short video APP, and the corresponding relationship of "XX Short Video-Short Video" can be established; and the business that XX Music and XXmusic are responsible for is: playing music, which belongs to the music APP, and the corresponding relationship of "XX Music-Music; XXmusic-Music" can be established. For details, see Table 1 below:
[0069]
[0070] Table 1
[0071] Furthermore, among the three types of streaming media, namely, film and television, short video, and music, music should have the highest requirements for sound quality, followed by film and television, and then short video, that is, the degree of optimization of the original sound of music streaming media by the sound processing parameters corresponding to the music type is higher than the degree of optimization of the original sound of film and television streaming media by the sound processing parameters corresponding to the film and television type, and the degree of optimization of the original sound of film and television streaming media by the sound processing parameters corresponding to the film and television type is higher than the degree of optimization of the original sound of short video streaming media by the sound processing parameters corresponding to the short video type. Therefore, it can be preset to configure the corresponding sound processing parameters for the three respectively, and the parameter objects configured by the sound processing parameters corresponding to the three can be the same or different. For example, in multiple sound dimensions such as sound intensity and sound frequency, according to the parts that each of the three needs to adjust, several of them can be selected as the parameter objects to be configured. In the sound processing parameters of different streaming media types, if the same parameter object is involved, then the parameter values corresponding to the same parameter object are usually different, and the size of the parameter value corresponding to the same sound processing parameter is determined by the requirements of the multimedia resources for sound quality.
[0072] Furthermore, the audio segments to be processed corresponding to different streaming media types may also be different. In the process of optimizing the original sound of multimedia resources by using sound processing parameters, the audio segments to be processed in the original sound of the streaming media may be processed by using sound processing parameters. For example, the audio segments to be processed corresponding to music streaming media may be human voice bass segments and human voice treble segments, the audio segments to be processed corresponding to film and television streaming media may be human voice segments and environmental sound segments, and the audio segments to be processed corresponding to short video streaming media may be only human voice segments. For ease of understanding, the following examples are given: the sound processing parameters configured for music have the highest degree of optimization for the sound. For example, the bass part in the original sound can be restored in detail, and sound effects such as live and vocal optimization can be added to the original sound as a whole. Since the sound processing parameters focus on optimizing the sound quality, this embodiment can be named as the sound quality priority processing parameter; and the sound processing parameters configured for film and television should also have a good degree of optimization for the sound, but slightly worse than that of music. Specifically, the original sound of this type of streaming media resources is mostly human voice, or part of the environmental sound, and the range of sound involved is not as wide as that of music. Therefore, it is sufficient to focus on optimizing the sound range where human voices are located and the sound range where conventional ambient sounds are located, without optimizing the details of the bass and treble parts. In this embodiment, the sound processing parameters can be referred to as conventional processing parameters; and the sound processing parameters configured for short videos have the worst degree of sound optimization among the three. Short video streaming media is mostly recorded by users themselves, and the original sound quality is not high. Only simple sound quality optimization is required to restore the original sound, without investing too much power consumption for optimization. In this embodiment, the sound processing parameters can be referred to as power consumption priority processing parameters. After configuring the corresponding sound processing parameters for each streaming media type, the following Table 2 can be obtained based on Table 1:
[0073]
[0074] Table 2
[0075] Step 202: determine a target APP for playing the target streaming media.
[0076] Continuing with the above example, assuming that the user selects short video A to play on the above XX short video interface, the smartphone can determine that the target APP corresponding to short video A is XX short video based on the received playback instruction.
[0077] In actual operation, the smartphone can determine that the target APP is XX short video based on the package name of the received short video A streaming media.
[0078] Step 203: determine the target streaming media type to which the target streaming media belongs according to the target APP.
[0079] Continuing with the above example, after determining that the target APP is XX short video, it can be determined that short video A belongs to short video streaming media, and then according to the corresponding relationship shown in Table 2, the target sound processing parameters that should be currently adopted can be determined as power consumption priority processing parameters.
[0080] Step 204, determining target sound processing parameters corresponding to the target streaming media type.
[0081] Step 205, instructing the audio module to process the original sound of the target streaming media using the target sound processing parameters and output the processed sound.
[0082] Following the above example, the audio module can be instructed to process the received original sound of short video A through the power consumption priority processing parameter, and output it after the processing is completed.
[0083] It should be noted that the above examples are only introduced by taking the playing of short video streaming media as an example. When playing movie and television streaming media or music streaming media, a similar processing flow can be used to output the sound, and this embodiment will not repeat the examples.
[0084] It can be seen from the above technical solutions that, through the technical solutions disclosed in the present invention, when a user plays any streaming media, the smart phone can determine the streaming media type of any streaming media according to the APP that calls the audio module, and then use the corresponding sound processing parameters to process the original sound of any streaming media and then output it. Among them, the sound processing parameters corresponding to any streaming media type are related to the sound quality of its original sound, which avoids the problem of low power consumption or poor sound quality caused by the use of unified sound processing parameters in the related art.
[0085] Next, the technical solution of the present disclosure is introduced by taking the playing of local multimedia resources in a PC as an example.
[0086] Figure 3 FIG. 1 is a flowchart of another sound output method according to an exemplary embodiment of the present disclosure. Figure 3 As shown, the method comprises the following steps:
[0087] Step 301: receiving a user's instruction to play a target local multimedia resource.
[0088] In this embodiment, the user instructs to play local multimedia resources, and local multimedia resources are saved in the form of files. Therefore, the multimedia type to which the target multimedia resource belongs can be directly determined based on the file suffix, and then the target sound processing parameters to be used can be determined based on the determined multimedia type.
[0089] Similar to the previous embodiment, this embodiment also has a pre-configuration process. In this embodiment, the pre-configuration into two multimedia types of music and video is taken as an example for introduction. The specific configuration process can refer to the introduction of the previous embodiment, and the corresponding relationship obtained by the configuration can refer to the following Table 3:
[0090]
[0091] Table 3
[0092] It should be noted that since this embodiment only performs a relatively superficial classification, although the naming of the sound processing parameters is similar to that of the previous embodiment, the actual sound processing parameters used may be inconsistent. In comparison, the power consumption priority processing parameters in this embodiment should be better than the power consumption priority processing parameters in the previous embodiment in terms of the degree of optimization of the original sound; and the sound quality priority processing parameters are all for music multimedia resources, so their actual parameters can be consistent with those of the previous embodiment.
[0093] Step 302: determine the target file suffix of the target local multimedia resource.
[0094] For example, assuming that the target local multimedia resource instructed to be played by the user is music B, whose file suffix is MIDI, then it can be determined that the multimedia type to which the target local multimedia resource belongs is music.
[0095] Step 303, determining target sound processing parameters according to the determined target file suffix.
[0096] Following the above example, after determining that the target local multimedia resource belongs to the music category, the target sound processing parameter can be determined as a sound quality priority processing parameter.
[0097] Step 304: instruct the audio module to process and output the original sound of the target multimedia resource using the target sound processing parameters.
[0098] Following the above example, the audio module can be instructed to process the received original sound of music B using the sound quality priority processing parameters and output it after the processing is completed.
[0099] It can be seen from the above technical solution that through the technical solution disclosed in the present invention, when a user plays any local multimedia resource, the PC can determine the multimedia type to which the any local multimedia resource belongs according to the suffix of the any local multimedia resource, and then use the corresponding sound processing parameters to process the original sound of the any local multimedia resource and then output it. Among them, the sound processing parameters corresponding to any multimedia type are related to the sound quality of its original sound, which also avoids the problem of low power consumption or poor sound quality caused by using unified sound processing parameters to process the original sound of local multimedia resources in the related art.
[0100] Figure 4 is a block diagram of a sound output device according to an exemplary embodiment of the present disclosure. Figure 4 , the device includes a first determining unit 401, a second determining unit 402 and an output unit.
[0101] The first determining unit 401, when detecting a play instruction for a first target multimedia resource, determines a first target multimedia type to which the first target multimedia resource belongs, wherein original sound qualities of different multimedia types are different;
[0102] The second determining unit 402 determines the first target sound processing parameter corresponding to the first target multimedia type according to the correspondence between the preset multimedia type and the sound processing parameter, wherein the degree of optimization of the sound processing parameter corresponding to any multimedia type for the original sound is positively correlated with the sound quality of the original sound of any multimedia type;
[0103] The output unit 403 optimizes the original sound of the first target multimedia resource by using the first target sound processing parameter, and outputs the optimized sound.
[0104] Optionally, the first determining unit 401 is further used to:
[0105] A target application for calling an audio module is determined to determine a first target multimedia type to which the first target multimedia resource belongs according to a multimedia service that the target application is responsible for.
[0106] Optionally, the first determining unit 401 is further used to:
[0107] The file suffix name of the first target multimedia resource is obtained to determine the first target multimedia type to which the first target multimedia resource belongs according to the file suffix name.
[0108] Optional,
[0109] The first determination unit 401 is further used to: when receiving a playback instruction for a second multimedia resource during the playback of the first target multimedia resource, determine the second target multimedia type to which the second target multimedia resource belongs;
[0110] The second determining unit 402 is further used to: determine a second target sound processing parameter corresponding to the second target multimedia type according to a preset correspondence relationship between the multimedia type and the sound processing parameter;
[0111] The output unit 403 is also used to compare the optimization degree of the first target sound processing parameter and the second target sound processing parameter for the original sound, so as to use the one with higher or lower optimization degree to process the original sound received by the audio module, and output the processed sound through the audio module.
[0112] Optional,
[0113] The first determining unit 401 is further used to: when receiving a playback instruction for a third multimedia resource during the playback of the first target multimedia resource, determine a third target multimedia type to which the third target multimedia resource belongs;
[0114] The second determining unit 402 is further used to: determine a third target sound processing parameter corresponding to the third target multimedia type according to a preset correspondence relationship between the multimedia type and the sound processing parameter;
[0115] The output unit 403 is further used to: process the original sound received by the audio module using the third target sound processing parameter, and output the processed sound through the audio module.
[0116] Optionally, the degree of optimization of the original sound by any sound processing parameter is positively correlated with the power consumption when the optimization is performed using the any sound processing parameter.
[0117] Optionally, the first target multimedia type includes one of the following:
[0118] Music, short videos, movies and TV, live broadcasts, and radio.
[0119] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can refer to the partial description of the method embodiments. The device embodiments described above are only schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the disclosed solution. A person of ordinary skill in the art can understand and implement it without paying any creative work.
[0120] Correspondingly, the present disclosure also provides a sound output device, comprising: a processor; a memory for storing processor executable instructions; wherein the processor is configured to implement a sound output method as described in any of the above embodiments, for example, the method may include: when a play instruction for a first target multimedia resource is detected, determining a first target multimedia type to which the first target multimedia resource belongs, wherein the original sound quality of different multimedia types is different; determining a first target sound processing parameter corresponding to the first target multimedia type according to a correspondence between preset multimedia types and sound processing parameters, wherein the degree of optimization of the original sound by the sound processing parameters corresponding to any multimedia type is positively correlated with the original sound quality of any multimedia type; optimizing the original sound of the first target multimedia resource using the first target sound processing parameters, and outputting the optimized sound.
[0121] Accordingly, the present disclosure also provides an electronic device, which includes a memory and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by one or more processors. The one or more programs include instructions for implementing the sound output method as described in any of the above embodiments. For example, the method may include: when a play instruction for a first target multimedia resource is detected, determining a first target multimedia type to which the first target multimedia resource belongs, wherein the original sound quality of different multimedia types is different; determining a first target sound processing parameter corresponding to the first target multimedia type according to a correspondence between a preset multimedia type and a sound processing parameter, wherein the degree of optimization of the original sound by the sound processing parameter corresponding to any multimedia type is positively correlated with the original sound quality of any multimedia type; optimizing the original sound of the first target multimedia resource using the first target sound processing parameter, and outputting the optimized sound.
[0122] Figure 51 is a block diagram of a device 500 for implementing a sound output method according to an exemplary embodiment. For example, the device 500 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
[0123] Reference Figure 5 , the device 500 may include one or more of the following components: a processing component 502 , a memory 504 , a power component 506 , a multimedia component 508 , an audio component 510 , an input / output (I / O) interface 512 , a sensor component 514 , and a communication component 516 .
[0124] The processing component 502 generally controls the overall operation of the device 500, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 502 may include one or more processors 520 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 502 may include one or more modules to facilitate the interaction between the processing component 502 and other components. For example, the processing component 502 may include a multimedia module to facilitate the interaction between the multimedia component 508 and the processing component 502.
[0125] The memory 504 is configured to store various types of data to support operations on the device 500. Examples of such data include instructions for any application or method operating on the device 500, contact data, phone book data, messages, pictures, videos, etc. The memory 504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.
[0126] The power supply component 506 provides power to the various components of the device 500. The power supply component 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 500.
[0127] The multimedia component 508 includes a screen that provides an output interface between the device 500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front camera and / or a rear camera. When the device 500 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
[0128] The audio component 510 is configured to output and / or input audio signals. For example, the audio component 510 includes a microphone (MIC), and when the device 500 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 504 or sent via the communication component 516. In some embodiments, the audio component 510 also includes a speaker for outputting audio signals.
[0129] I / O interface 512 provides an interface between processing component 502 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.
[0130] The sensor assembly 514 includes one or more sensors for providing various aspects of status assessment for the device 500. For example, the sensor assembly 514 can detect the open / closed state of the device 500, the relative positioning of components, such as the display and keypad of the device 500, the sensor assembly 514 can also detect the position change of the device 500 or a component of the device 500, the presence or absence of user contact with the device 500, the orientation or acceleration / deceleration of the device 500, and the temperature change of the device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 514 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
[0131] The communication component 516 is configured to facilitate wired or wireless communication between the device 500 and other devices. The device 500 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G LTE, 5G NR (New Radio) or a combination thereof. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
[0132] In an exemplary embodiment, the apparatus 500 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above methods.
[0133] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 504 including instructions, and the instructions can be executed by the processor 520 of the device 500 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0134] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the disclosure disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.
[0135] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
[0136] The above description is only a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present disclosure shall be included in the scope of protection of the present disclosure.
Claims
1. A sound output method, characterized in that: include: When a play instruction for a first target multimedia resource is detected, determining a first target multimedia type to which the first target multimedia resource belongs, wherein original sound qualities of different multimedia types are different; Determining a first target sound processing parameter corresponding to the first target multimedia type according to a preset correspondence between the multimedia type and the sound processing parameter, wherein the degree of optimization of the sound processing parameter corresponding to any multimedia type on the original sound is positively correlated with the sound quality of the original sound of any multimedia type; optimizing the original sound of the first target multimedia resource using the first target sound processing parameter, and outputting the optimized sound; When a playback instruction for a second target multimedia resource is received during the playback of the first target multimedia resource, determining a second target multimedia type to which the second target multimedia resource belongs; Determining a second target sound processing parameter corresponding to the second target multimedia type according to a preset correspondence relationship between the multimedia type and the sound processing parameter; Compare the optimization degree of the first target sound processing parameter and the second target sound processing parameter for the original sound; when the power of the device is higher than a preset value, use the one with a higher optimization degree to process the original sound received by the audio module, and output the processed sound through the audio module; when the power of the device is lower than a preset value, use the one with a lower optimization degree to process the original sound received by the audio module, and output the processed sound through the audio module.
2. The method according to claim 1, characterized in that: The determining the first target multimedia type to which the first target multimedia resource belongs includes: A target application for calling an audio module is determined to determine a first target multimedia type to which the first target multimedia resource belongs according to a multimedia service that the target application is responsible for.
3. The method according to claim 1, characterized in that The determining the first target multimedia type to which the first target multimedia resource belongs includes: The file suffix name of the first target multimedia resource is obtained to determine the first target multimedia type to which the first target multimedia resource belongs according to the file suffix name.
4. The method according to claim 1, characterized in that The degree of optimization of the original sound by any sound processing parameter is positively correlated with the power consumption when the optimization is performed by using the any sound processing parameter.
5. A sound output device, characterized in that: include: A first determining unit, when detecting a play instruction for a first target multimedia resource, determines a first target multimedia type to which the first target multimedia resource belongs, wherein original sound qualities of different multimedia types are different; a second determination unit, determining a first target sound processing parameter corresponding to the first target multimedia type according to a preset correspondence between the multimedia type and the sound processing parameter, wherein the degree of optimization of the sound processing parameter corresponding to any multimedia type for the original sound is positively correlated with the sound quality of the original sound of any multimedia type; an output unit, which optimizes the original sound of the first target multimedia resource by using the first target sound processing parameter, and outputs the optimized sound; The first determination unit is further used to: when receiving a playback instruction for a second target multimedia resource during the playback of the first target multimedia resource, determine a second target multimedia type to which the second target multimedia resource belongs; The second determination unit is further used to: determine a second target sound processing parameter corresponding to the second target multimedia type according to a preset correspondence relationship between the multimedia type and the sound processing parameter; The output unit is further used to: compare the optimization degree of the first target sound processing parameter and the second target sound processing parameter for the original sound; when the device power is higher than a preset value, use the one with a higher optimization degree to process the original sound received by the audio module, and output the processed sound through the audio module; when the device power is lower than a preset value, use the one with a lower optimization degree to process the original sound received by the audio module, and output the processed sound through the audio module.
6. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor implements the method according to any one of claims 1 to 4 by running the executable instructions.
7. A computer-readable storage medium having computer instructions stored thereon, characterized in that: When the instruction is executed by a processor, the steps of the method according to any one of claims 1 to 4 are implemented.
Citation Information
Patent Citations
Method and device for adjusting voice frequency parameters
CN103841495A