Playing control method and device, equipment and storage medium

Abstract

The invention provides a playing control method and device, equipment and a storage medium, and is applied to the multimedia field, and the playing control method in the application comprises the following steps: responding to a playing control request for target multimedia data, and obtaining film source information data and / or multimedia feature data of the target multimedia data; determining target film source loudness of the target multimedia data according to the film source information data and / or the multimedia feature data; and carrying out loudness adjustment on the target multimedia data by using the target film source loudness to obtain a play control result. According to the invention, the loudness consistency and listening sense coherence can be kept when the player plays the mixed multimedia data of the film source type, the watching experience of a user is improved, and the operation burden of the user is reduced.

Description

Technical Field

[0001] This application relates to the field of multimedia technology, specifically to a playback control method, apparatus, device, and storage medium. Background Technology

[0002] Currently, with the rapid development of multimedia technologies such as streaming media, more and more users are watching TV, online videos, and audiobooks through TV or streaming media applications. However, existing audio and video multimedia resources usually insert audio and video advertisements during playback, resulting in large differences in loudness between different audio and video playback processes. This causes the sound volume to fluctuate, requiring users to frequently adjust the playback loudness manually, which affects the viewing or listening experience. Summary of the Invention

[0003] This application provides a playback control method, apparatus, device, and storage medium, aiming to solve the technical problem in the prior art where the loudness of different audio and video data varies greatly during playback.

[0004] On one hand, embodiments of this application provide a playback control method, which includes the following steps: In response to a playback control request for target multimedia data, the source information data and / or multimedia feature data of the target multimedia data are obtained; The target source loudness of the target multimedia data is determined based on the source information data and / or multimedia feature data. The loudness of the target multimedia data is adjusted using the loudness of the target source material to obtain the playback control result.

[0005] In one possible implementation of this application, determining the target source loudness of the target multimedia data based on the source information data and / or multimedia feature data includes: The target source type of the target multimedia data is determined based on the source information data and / or multimedia feature data, wherein the target source type includes either the main video source type or the advertisement source type. Access a preset multimedia database to obtain the target video source loudness associated with the target video source type.

[0006] In one possible implementation of this application, determining the target source type of the target multimedia data based on the source information data and / or multimedia feature data includes: The target multimedia data is parsed based on the program list data and / or the source metadata in the source information data to obtain the target source type of the target multimedia data. And / or, identify the target source type of the target multimedia data based on the multimedia feature data and the source classification model.

[0007] In one possible implementation of this application, the step of adjusting the loudness of the target multimedia data using the loudness of the target source material to obtain a playback control result includes: Audio features are extracted from the target audio data of the target multimedia data to obtain the target audio features corresponding to the target multimedia data. The audio variation data of the target multimedia data is determined based on the target audio features and associated audio features; If the audio change data meets the loudness control conditions, then the target multimedia data is subjected to loudness gain according to the target loudness amplitude and the target source loudness to obtain the playback control result.

[0008] In one possible implementation of this application, the step of adjusting the loudness of the target multimedia data using the loudness of the target source material to obtain a playback control result includes: Obtain the target source type of the target multimedia data, and determine that the target source type is an advertising source type; The target audio data corresponding to the target multimedia data is dynamically compressed according to the dynamic optimization strategy corresponding to the type of the advertisement source and the loudness of the target source, so as to obtain the playback control result.

[0009] In one possible implementation of this application, the step of dynamically compressing the target audio data corresponding to the target multimedia data according to the dynamic optimization strategy corresponding to the advertising source type and the target source loudness to obtain the playback control result includes: According to the dynamic optimization strategy, the target audio data corresponding to the target multimedia data is divided into frequencies to obtain frequency-divided audio data. The frequency-divided audio data is compressed according to the interval compression parameters corresponding to the loudness of the target source to obtain frequency-divided compressed data. Merge the compressed data from each frequency division to obtain the target compressed data, play the target compressed data, and obtain the playback control result.

[0010] In one possible implementation of this application, the method further includes: In response to a volume adjustment request, obtain the volume adjustment parameters corresponding to the volume adjustment request; The volume adjustment parameters are used to update the loudness of the target source corresponding to the target multimedia data to obtain updated loudness data; The target multimedia data is then subjected to loudness adjustment using the updated loudness data to obtain a loudness adjustment result.

[0011] On the other hand, this application provides a playback control device, the playback control device comprising: The data acquisition module is configured to respond to a playback control request for target multimedia data and acquire source information data and / or multimedia feature data of the target multimedia data. A loudness mapping module is configured to determine the target source loudness of the target multimedia data based on the source information data and / or multimedia feature data. The playback control module is configured to adjust the loudness of the target multimedia data using the loudness of the target source material, thereby obtaining a playback control result.

[0012] On the other hand, this application also provides a playback control device, the playback control device comprising: One or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the playback control method.

[0013] On the other hand, this application also provides a computer-readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to execute the steps in the playback control method.

[0014] This application, in response to a playback control request for target multimedia data, acquires the source information data and / or multimedia feature data of the target multimedia data; determines the target source loudness of the target multimedia data based on the source information data and / or multimedia feature data; and adjusts the loudness of the target multimedia data using the target source loudness to obtain a playback control result. This enables the acquisition of source data information and / or multimedia feature data of the target multimedia data when playing target multimedia data containing multiple target source types (e.g., mixing advertisements with main content), identifying the target source type corresponding to the target multimedia data using the source data information and / or multimedia feature data, mapping the corresponding target source loudness, and dynamically adjusting the loudness of the target multimedia data according to the target source loudness. This eliminates the need for manual volume adjustment by the user, ensuring consistent loudness and a smooth listening experience when playing mixed multimedia data of different source types, improving the user's viewing experience and reducing operational burden. Attached Figure Description

[0015] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0016] Figure 1 This is a schematic diagram of a scenario illustrating the playback control method according to an embodiment of this application; Figure 2 This is a flowchart illustrating one embodiment of the playback control method in this application. Figure 3 A flowchart illustrating an embodiment of dynamic compression in the playback control method provided in this application; Figure 4 A flowchart illustrating an embodiment of the playback control method for updating the loudness of a target source video in this application; Figure 5 A schematic diagram of the structure of one embodiment of the playback control device provided in this application; Figure 6 This is a schematic diagram of one embodiment of the playback control device provided in this application. Detailed Implementation

[0017] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0018] In the description of this invention, it should be understood that the terms "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicating orientation or positional relationships based on the orientation or positional relationships shown in the accompanying drawings, are only for the convenience of describing the invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the invention. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include one or more of the stated features. In the description of this invention, "a plurality of" means two or more, unless otherwise explicitly specified.

[0019] In this application, the term "exemplary" is used to mean "serving as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use the invention. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that the invention can be made without using these specific details. In other instances, well-known structures and processes will not be described in detail to avoid obscuring the description of the invention with unnecessary detail. Therefore, the invention is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0020] Currently, with the rapid development of multimedia technologies such as streaming media, more and more users are watching TV, online videos, and audiobooks through TV or streaming media applications. However, existing audio and video multimedia resources usually insert audio and video advertisements during playback, resulting in large differences in loudness between different audio and video content. This forces users to frequently adjust the loudness manually, affecting the viewing or listening experience.

[0021] Based on this, this application proposes a playback control method, apparatus, device, and computer-readable storage medium to solve the technical problem in the prior art where the loudness of different audio and video data containing different audio and video varies greatly during playback.

[0022] The playback control method in this embodiment of the invention is applied to a playback control device, which is disposed in a playback control equipment. The playback control equipment is provided with one or more processors, a memory, and one or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the playback control method; wherein the playback control equipment can be one or more smart playback terminals, such as mobile phones, tablet computers, smart TVs, smart wearable devices, and smart computers.

[0023] like Figure 1 As shown, Figure 1 This is a schematic diagram of a playback control method according to an embodiment of the present application. The playback control scenario in this embodiment includes a playback control device 100 (the playback control device 100 integrates a playback control unit), and the playback control device 100 has a computer-readable storage medium corresponding to the playback control method running in order to execute the steps of the playback control method.

[0024] Understandable Figure 1The playback control device in the playback control method scenario shown, or the device included in the playback control device, does not constitute a limitation on the embodiments of the present invention. That is, the number or type of the playback control device included in the playback control method scenario, or the number or type of the device included in each device, does not affect the overall implementation of the technical solution in the embodiments of the present invention, and can all be considered as equivalent substitutions or derivatives of the technical solutions claimed in the embodiments of the present invention.

[0025] In this embodiment of the invention, the playback control device 100 is mainly used to: respond to a playback control request for target multimedia data, and obtain the source information data and / or multimedia feature data of the target multimedia data; The target source loudness of the target multimedia data is determined based on the source information data and / or multimedia feature data. The loudness of the target multimedia data is adjusted using the loudness of the target source material to obtain the playback control result.

[0026] The playback control device 100 in this embodiment of the invention can be an independent playback control device, such as a mobile phone, tablet computer, smart TV, smart wearable device and smart computer, or a playback control network or playback control cluster composed of multiple playback control devices.

[0027] This application provides a playback control method, apparatus, device, and computer-readable storage medium, which will be described in detail below.

[0028] It will be understood by those skilled in the art that Figure 1 The application environment shown is only one application scenario related to the solution of this application and does not constitute a limitation on the application scenario of this application. Other application environments may include more than one application scenario. Figure 1 The number of playback control devices shown, or the playback control network connections, for example... Figure 1 Only one playback control device is shown in the diagram. It is understood that the scenario of this playback control method may also include one or more playback control devices, which are not specifically limited here. The playback control device 100 may also include a memory for storing source information data, multimedia feature data, target source loudness and other data.

[0029] It should be noted that, Figure 1 The schematic diagram of the playback control method shown is merely an example. The scenarios of the playback control method described in the embodiments of the present invention are intended to more clearly illustrate the technical solutions of the embodiments of the present invention and do not constitute a limitation on the technical solutions provided in the embodiments of the present invention.

[0030] Based on the scenarios described above for playback control methods, various embodiments of the playback control method disclosed in this invention are proposed.

[0031] like Figure 2 As shown, Figure 2 This is a flowchart illustrating one embodiment of the playback control method in this application. The playback control method includes the following steps 201 to 203: 201. In response to a playback control request for target multimedia data, obtain the source information data and / or multimedia feature data of the target multimedia data; The playback control method in this embodiment is applied to a playback control device. The type and number of playback control devices are not specifically limited. That is, the playback control device can be one or more smart playback terminals or servers. In a specific embodiment, the playback control device is a smart TV.

[0032] Optionally, target multimedia data refers to multimedia data that is playing or about to be played in a multimedia player application. Target multimedia data can be mixed multimedia data comprising multiple multimedia sources. For example, in one specific embodiment, target multimedia data includes any one or more of the main video source data and advertising video source data. That is, the content distribution platform can insert advertising video source data into main video source data such as TV series, movies, short videos, and long videos to obtain target multimedia data. Optionally, in other embodiments, target multimedia data can also be different main video source data played consecutively. For example, during playback in a multimedia player application, after setting automatic continuous playback, the next main video source data can be automatically played after the current main video source data finishes playing, and this main video source data can be identified as the target multimedia data.

[0033] Optionally, the source information data is descriptive information corresponding to the target multimedia data, describing data such as the video content of the target multimedia data. Optionally, in one specific embodiment, the source information data includes source metadata and program guide data. The source metadata is additional data information used to describe the target multimedia data. Optionally, the source metadata includes any one or more of the metadata information corresponding to the target multimedia data, such as title, author, abstract, and tags. Optionally, in other embodiments, the source metadata may also be other metadata. The program guide data is the Electronic Program Guide (EPG) corresponding to the target multimedia data, providing information about current and future television programs.

[0034] Optionally, multimedia feature data refers to playback feature information corresponding to the target multimedia data. Optionally, in a specific embodiment, the multimedia feature data includes any one or more of the following: spectral feature data, voiceprint feature data, speech rate feature data, and keyword feature data.

[0035] Optionally, a playback control request is a control event that drives the playback control device to dynamically adjust the loudness of the target multimedia data during playback to smooth the playback loudness of the target multimedia data. The triggering method for this playback control request is not specifically limited here. That is, the playback control request can be triggered actively by the user or automatically by the playback control device.

[0036] Optionally, after acquiring source information data and / or multimedia feature data, the playback control device can determine the target source type of the target multimedia data being played or about to be played in subsequent steps using the source information data and / or multimedia feature data of the target multimedia data. This allows for corresponding loudness adjustments for different target source types, ensuring a consistent listening experience during playback and preventing sudden loudness changes when switching between target multimedia data of different source types.

[0037] Optionally, during the playback of the target multimedia data, the playback control device can also sample the target multimedia data in real time within the playback link, calculate the short-term loudness of the target multimedia data using a preset acquisition window, generate a loudness trend curve corresponding to the short-term loudness, and determine the loudness trend curve as the associated audio feature of the target multimedia data. Optionally, in a specific embodiment, the preset acquisition window is 200ms. The associated audio feature is feature information characterizing the loudness trend of the target multimedia data in past playback.

[0038] 202. Determine the target source loudness of the target multimedia data based on the source information data and / or multimedia feature data; Optionally, after acquiring the source information data and / or multimedia feature data of the target multimedia data, the playback control device may also determine the target source loudness of the target multimedia data based on the source information data and / or multimedia data.

[0039] Optionally, the target source loudness is the ideal playback loudness of the target multimedia data. That is, when playing the target multimedia data, the playback control device needs to dynamically adjust the loudness of the target multimedia data so that target multimedia data of different source types can be played according to the target source loudness, thereby reducing loudness fluctuations and ensuring a consistent listening experience.

[0040] Optionally, the playback control device can set the corresponding target source loudness according to different source types, map the target source loudness to the corresponding target source type, and store it in a designated multimedia database. For example, in one specific embodiment, the target source types include feature film source types and advertisement source types, wherein the target source loudness for the feature film source type is -23 LUFS, and the target source loudness for the advertisement source type is -27 LUFS.

[0041] Optionally, in other embodiments, the playback control device can also collect the user's volume adjustment request to update the loudness of the target source, obtain updated loudness data, and use the updated loudness data to adjust the loudness in subsequent steps.

[0042] Optionally, after acquiring source information data and / or multimedia feature data, the playback control device performs content recognition on the target multimedia data based on the source information data and / or multimedia feature data to determine the target source type of the target multimedia data. The target source type includes either a main feature source type or an advertisement source type. Here, the target source type is a classification category representing the multimedia content category of the target multimedia data. The main feature source type is a classification tag representing the main content of multimedia such as movies, TV series, or videos. The advertisement source type is a classification tag representing the advertisement category of the target multimedia data.

[0043] Optionally, in one specific embodiment, the playback control device can determine the target source type of the target multimedia data through the source information data of the target multimedia data. That is, after obtaining the source information data of the target multimedia data, the playback control device parses the program guide data and / or source metadata in the source information data to obtain the multimedia content type in the program guide data and / or source metadata, thereby determining the target source type of the target multimedia data.

[0044] Optionally, in another specific embodiment, if the target multimedia data does not contain source information data, the playback control device performs feature extraction on the target multimedia data to obtain multimedia feature data corresponding to the target multimedia data, and inputs the multimedia feature data into a pre-trained source classification model for source identification to obtain the target source type of the target multimedia data. The source classification model is a lightweight neural network model or other artificial intelligence model.

[0045] Optionally, in other embodiments, the playback control device can also determine the target source type of the target multimedia data by jointly using source information data and multimedia feature data. That is, the playback control device determines the first source type of the target multimedia data by using the source information data and the second source type of the target multimedia data by using the multimedia feature data, and then determines the target source type of the target multimedia data by using the first source type and the second source type. Optionally, if the first source type and the second source type are different, the first source type is determined as the target source type, and the source classification model is trained using the first source type to obtain the trained source classification model, thereby improving the recognition accuracy of the source classification model.

[0046] Optionally, after obtaining the target source type corresponding to the target multimedia data, the playback control device accesses a preset multimedia database to obtain the target source loudness associated with that target source type in the multimedia database. That is, after obtaining the target source type, the playback control device inputs the target source type into the multimedia database and obtains the target source loudness mapped to the target source type in the multimedia database.

[0047] 203. Adjust the loudness of the target multimedia data using the loudness of the target source material to obtain the playback control result.

[0048] Optionally, after determining the target source loudness as the target multimedia data loudness correction target, the playback control device uses the target source loudness to adjust the loudness of the target multimedia data to obtain the playback control result.

[0049] Optionally, the playback control device extracts audio features from the target audio data of the target multimedia data to obtain the target audio features corresponding to the target multimedia data. The target audio data represents the audio data to be output from the target multimedia data. In one specific embodiment, the target audio data can be the first frame of audio data (50~100ms) of the target multimedia data. The target audio features are the loudness and spectral features representing the target audio data. That is, the playback control device extracts the loudness and spectral features from the target audio data as the target audio features.

[0050] Optionally, after acquiring the target audio features, the playback control device further determines the audio variation data of the target multimedia data based on the target audio features and associated audio features. That is, the playback control device calculates the difference between the target audio features and associated audio features to determine the loudness variation difference between the target audio data to be played and the already played audio data, thus obtaining the audio variation data. The audio variation data is an index representing the loudness variation difference between the target audio data to be played and the already played audio data.

[0051] Optionally, if the playback control device determines that the audio change data meets the loudness control conditions, it performs loudness reduction on the target multimedia data according to the target loudness amplitude and the target source loudness to obtain the playback control result. The loudness control adjustment is defined as the audio change data exceeding a preset audio change threshold. That is, when the playback control device determines that the audio change data exceeds the preset audio change threshold, it determines that loudness adjustment of the target multimedia data is needed to smooth the playback loudness of the target multimedia data. Therefore, the playback control device performs loudness reduction on the target multimedia data according to the target loudness amplitude and the target source loudness to obtain the playback control result. The playback control result represents the control result of loudness control on the target multimedia data.

[0052] Optionally, in one specific embodiment, after determining that loudness adjustment of the target multimedia data is necessary, the playback control device quickly adjusts the current playback loudness of the target multimedia data to the target source loudness according to the target loudness amplitude and a preset correction window, thereby avoiding a decrease in listening experience. Furthermore, during playback, the device continuously detects and dynamically corrects the audio characteristics (e.g., short-term loudness characteristics) of the target multimedia data according to a preset detection window. The target loudness amplitude is the loudness adjustment amplitude for adjusting the target multimedia data. In one specific embodiment, this target loudness amplitude is -2 dB. The preset correction window refers to the adjustment time for adjusting the loudness of the target multimedia data. In one specific embodiment, this preset correction window is 0.51 seconds. That is, the playback control device rapidly and gradually adjusts the playback loudness to the target source loudness within 0.51 seconds according to an adjustment amplitude of -2 dB.

[0053] Optionally, in another specific embodiment, the playback control device also performs multi-band dynamic compression on the target multimedia data whose target source type is an advertisement source, thereby smoothly reducing the loudness data of the target multimedia data while ensuring speech clarity.

[0054] In this embodiment, the playback control device, in response to a playback control request for target multimedia data, acquires the source information data and / or multimedia feature data of the target multimedia data; determines the target source loudness of the target multimedia data based on the source information data and / or multimedia feature data; and adjusts the loudness of the target multimedia data using the target source loudness to obtain a playback control result. This enables the acquisition of source data information and / or multimedia feature data of the target multimedia data when playing target multimedia data containing multiple target source types (e.g., mixing advertisements with main content), identifying the target source type of the target multimedia data and mapping the corresponding target source loudness using this source data information and / or multimedia feature data, and dynamically adjusting the loudness of the target multimedia data according to the target source loudness. This eliminates the need for manual volume adjustment by the user, ensuring consistent loudness and a smooth listening experience when playing mixed multimedia data of different source types, improving the user's viewing experience and reducing operational burden.

[0055] like Figure 3 As shown, Figure 3 This is a flowchart illustrating an embodiment of dynamic compression in the playback control method provided in this application. Figure 3 In the illustrated embodiment, the playback control method further includes steps 301 to 302: 301. Obtain the target source type of the target multimedia data, and determine that the target source type is an advertising source type; 302. Dynamically compress the target audio data corresponding to the target multimedia data according to the dynamic optimization strategy corresponding to the type of the advertising source and the loudness of the target source, and obtain the playback control result.

[0056] Based on the above embodiments, in this embodiment, after determining that the loudness of the target multimedia data needs to be adjusted, the playback control device performs frequency band dynamic compression on the target multimedia data, thereby reducing the loudness peak of the target multimedia data and effectively maintaining the clarity of speech, avoiding weakening the main frequency range of human voice, and ensuring the integrity of information.

[0057] Optionally, the playback control device acquires the target source type of the target multimedia data. After determining that the target source type is an advertisement source type, it acquires the target audio data corresponding to the target multimedia data. It then dynamically compresses the target audio data according to the dynamic optimization strategy corresponding to the advertisement source type and the loudness of the target source, obtaining the playback control result. The dynamic optimization strategy is an optimization strategy for frequency-band dynamic compression of the target multimedia data. The target audio data is the audio modal data to be played within the target multimedia data.

[0058] Optionally, the playback control device performs frequency division processing on the target audio data of the target multimedia data according to a dynamic optimization strategy to obtain frequency-divided audio data. That is, the dynamic optimization strategy pre-sets several audio frequency band intervals and divides the target audio data into frequency bands according to the start and end frequencies corresponding to each audio frequency band interval, thereby obtaining frequency-divided audio data corresponding to each audio frequency band interval. Here, an audio frequency band interval is a frequency range range distinguished by start and end frequencies. Frequency-divided audio data is an audio data segment located within the corresponding audio frequency band interval. Optionally, in a specific embodiment, the audio frequency band interval includes any one or more of a low-frequency band interval (start and end frequencies of 20~500Hz), a mid-frequency band interval (start and end frequencies of 500-6kHz), and a high-frequency band interval (start and end frequencies of 6kHz-20kHz). Optionally, in other embodiments, the playback control device can also set different audio frequency band intervals according to actual adjustment needs.

[0059] Optionally, after acquiring the frequency-division audio data, the playback control device further compresses the frequency-division audio data according to the interval compression parameters corresponding to the loudness of the target source material, obtaining compressed frequency-division data. Specifically, the playback control device pre-sets interval compression parameters for each audio frequency band interval according to the loudness of the target source material, and compresses the corresponding frequency-division audio data according to these interval compression parameters to obtain compressed frequency-division data. The interval compression parameters are the compression volume threshold and audio compression ratio corresponding to different audio frequency band intervals. That is, the playback control device compresses frequency-division audio data exceeding the interval compression parameters to obtain compressed frequency-division data. This reduces loudness peaks while maintaining speech clarity, avoiding sudden changes in volume.

[0060] Optionally, after acquiring the frequency-division compressed data corresponding to each audio frequency band interval, the playback control device merges the frequency-division compressed data to obtain the target compressed data, plays the target compressed data, and obtains the playback control result.

[0061] Optionally, in other embodiments, in order to improve the playback effect, highlight human voices and reduce background noise, the playback control device can also use a dynamic optimization strategy to dynamically compress the target multimedia data in frequency bands when it determines that the target source is a full-length movie source, thereby improving the playback effect.

[0062] In this embodiment, the playback control device determines that the target source type of the target multimedia data is an advertisement source type by acquiring the target source type of the target multimedia data; it then dynamically compresses the target audio data corresponding to the target multimedia data according to the dynamic optimization strategy corresponding to the advertisement source type and the loudness of the target source, thereby obtaining the playback control result. This achieves dynamic range optimization of the target multimedia data, thereby reducing the loudness peak of the target multimedia data while effectively maintaining speech clarity, avoiding weakening the main frequency range of human voice, and ensuring information integrity.

[0063] like Figure 4 As shown, Figure 4 This is a flowchart illustrating an embodiment of the playback control method for updating the loudness of a target video source provided in this application. Figure 4 In the illustrated embodiment, the playback control method further includes steps 401 to 403: 401. Respond to the volume adjustment request and obtain the volume adjustment parameters corresponding to the volume adjustment request; 402. Update the loudness of the target source corresponding to the target multimedia data using the volume adjustment parameters to obtain updated loudness data; 403. Use the updated loudness data to adjust the loudness of the target multimedia data to obtain the loudness adjustment result.

[0064] Based on the above embodiments, in this embodiment, after the playback control device performs loudness control on the target multimedia data, it can further update the loudness of the target source material according to the user's volume adjustment request, so that the loudness adjustment is more in line with the user's usage habits.

[0065] Optionally, the playback control device responds to a volume adjustment request, parses the request, and obtains the corresponding volume adjustment parameters. The volume adjustment request is a control event that drives the playback control device to adjust the volume settings parameters of the multimedia player application. The volume adjustment parameters are the adjustment parameters used to adjust the volume settings parameters.

[0066] Optionally, after acquiring the volume adjustment parameters, the playback control device updates the loudness of the target source material corresponding to the target multimedia data using these parameters to obtain updated loudness data. That is, the playback control device can use the volume adjustment parameters to increase or decrease the loudness of the target source material accordingly to obtain updated loudness data. Optionally, the playback control device can also calculate an adjustment ratio using the volume adjustment parameters and adjust the loudness of the target source material accordingly to obtain updated loudness data.

[0067] Optionally, after obtaining the updated loudness data, the playback control device also uses the updated loudness data to adjust the loudness of the target multimedia data, thereby obtaining the loudness adjustment result, thus realizing personalized loudness adjustment and improving the accuracy of loudness adjustment.

[0068] In this embodiment, the playback control device responds to a volume adjustment request and obtains the volume adjustment parameters corresponding to the request; it then uses these parameters to update the loudness of the target source corresponding to the target multimedia data, obtaining updated loudness data; finally, it uses the updated loudness data to adjust the loudness of the target multimedia data, obtaining a loudness adjustment result. This achieves personalized loudness adjustment and improves the accuracy of loudness adjustment.

[0069] To better implement the playback control method in the embodiments of this application, a playback control device is also provided in the embodiments of this application, such as... Figure 5 As shown, Figure 5 This is a schematic diagram of one embodiment of the playback control device provided in this application. Specifically, the playback control device 500 includes: The data acquisition module 501 is configured to respond to a playback control request for target multimedia data and acquire source information data and / or multimedia feature data of the target multimedia data. Loudness mapping module 502 is configured to determine the target source loudness of the target multimedia data based on the source information data and / or multimedia feature data. The playback control module 503 is configured to adjust the loudness of the target multimedia data using the loudness of the target source material, thereby obtaining a playback control result.

[0070] In one possible implementation of this embodiment, the playback control device determines the target source loudness of the target multimedia data based on the source information data and / or multimedia feature data, including: The target source type of the target multimedia data is determined based on the source information data and / or multimedia feature data, wherein the target source type includes either the main video source type or the advertisement source type. Access a preset multimedia database to obtain the target video source loudness associated with the target video source type.

[0071] In one possible implementation of this embodiment, the playback control device determines the target source type of the target multimedia data based on the source information data and / or multimedia feature data, including: The target multimedia data is parsed based on the program list data and / or the source metadata in the source information data to obtain the target source type of the target multimedia data. And / or, identify the target source type of the target multimedia data based on the multimedia feature data and the source classification model.

[0072] In one possible implementation of this embodiment, the playback control device uses the loudness of the target source material to adjust the loudness of the target multimedia data to obtain a playback control result, including: Audio features are extracted from the target audio data of the target multimedia data to obtain the target audio features corresponding to the target multimedia data. The audio variation data of the target multimedia data is determined based on the target audio features and associated audio features; If the audio change data meets the loudness control conditions, then the target multimedia data is subjected to loudness gain according to the target loudness amplitude and the target source loudness to obtain the playback control result.

[0073] In one possible implementation of this embodiment, the playback control device uses the loudness of the target source material to adjust the loudness of the target multimedia data to obtain a playback control result, including: Obtain the target source type of the target multimedia data, and determine that the target source type is an advertising source type; The target audio data corresponding to the target multimedia data is dynamically compressed according to the dynamic optimization strategy corresponding to the type of the advertisement source and the loudness of the target source, so as to obtain the playback control result.

[0074] In one possible implementation of this embodiment, the playback control device dynamically compresses the target audio data corresponding to the target multimedia data according to the dynamic optimization strategy corresponding to the advertising source type and the target source loudness, to obtain the playback control result, including: According to the dynamic optimization strategy, the target audio data corresponding to the target multimedia data is divided into frequencies to obtain frequency-divided audio data. The frequency-divided audio data is compressed according to the interval compression parameters corresponding to the loudness of the target source to obtain frequency-divided compressed data. Merge the compressed data from each frequency division to obtain the target compressed data, play the target compressed data, and obtain the playback control result.

[0075] In one possible implementation of this embodiment, the playback control device is further configured to respond to a volume adjustment request and obtain the volume adjustment parameters corresponding to the volume adjustment request; The volume adjustment parameters are used to update the loudness of the target source corresponding to the target multimedia data to obtain updated loudness data; The target multimedia data is then subjected to loudness adjustment using the updated loudness data to obtain a loudness adjustment result.

[0076] In this embodiment, the playback control device, in response to a playback control request for target multimedia data, acquires the source information data and / or multimedia feature data of the target multimedia data; determines the target source loudness of the target multimedia data based on the source information data and / or multimedia feature data; and adjusts the loudness of the target multimedia data using the target source loudness to obtain a playback control result. This enables the acquisition of source data information and / or multimedia feature data of the target multimedia data when playing target multimedia data containing a mixture of multiple target source types (e.g., advertising content mixed with main content), identifying the target source type of the target multimedia data and mapping the corresponding target source loudness using this source data information and / or multimedia feature data, and dynamically adjusting the loudness of the target multimedia data according to the target source loudness. This eliminates the need for manual volume adjustment by the user, ensuring consistent loudness and a smooth listening experience when playing mixed multimedia data of different source types, improving the user's viewing experience and reducing operational burden.

[0077] This invention also provides a playback control device, such as... Figure 6 As shown, Figure 6 This is a schematic diagram of one embodiment of the playback control device provided in this application.

[0078] The playback control device integrates any of the playback control devices provided in the embodiments of the present invention, and the playback control device includes: One or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor in the steps of the playback control method described in any of the above-described playback control method embodiments.

[0079] Specifically, the playback control device may include components such as a processor 601 with one or more processing cores, a memory 602 with one or more computer-readable storage media, a power supply 603, and an input unit 604. Those skilled in the art will understand that... Figure 6 The playback control device structure shown does not constitute a limitation on the playback control device. It may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The processor 601 is the control center of the playback control device. It connects various parts of the playback control device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 602, and by calling data stored in the memory 602, it performs various functions and processes data, thereby providing overall monitoring of the playback control device. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 601.

[0080] The memory 602 can be used to store software programs and modules. The processor 601 executes various functional applications and playback control by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created based on the use of the playback control device, etc. In addition, the memory 602 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 602 may also include a memory controller to provide the processor 601 with access to the memory 602.

[0081] The playback control device also includes a power supply 603 that supplies power to the various components. Preferably, the power supply 603 can be logically connected to the processor 601 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 603 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0082] The playback control device may also include an input unit 604, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0083] Although not shown, the playback control device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 601 in the playback control device loads the executable files corresponding to the processes of one or more applications into the memory 602 according to the following instructions, and the processor 601 runs the applications stored in the memory 602 to realize various functions, as follows: In response to a playback control request for target multimedia data, the source information data and / or multimedia feature data of the target multimedia data are obtained; The target source loudness of the target multimedia data is determined based on the source information data and / or multimedia feature data. The loudness of the target multimedia data is adjusted using the loudness of the target source material to obtain the playback control result.

[0084] Therefore, embodiments of the present invention provide a computer-readable storage medium, which may include: read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk, etc. A computer program is stored thereon, which is loaded by a processor to execute the steps in any of the playback control methods provided in the embodiments of the present invention. For example, the computer program loaded by the processor can execute the following steps: In response to a playback control request for target multimedia data, the source information data and / or multimedia feature data of the target multimedia data are obtained; The target source loudness of the target multimedia data is determined based on the source information data and / or multimedia feature data. The loudness of the target multimedia data is adjusted using the loudness of the target source material to obtain the playback control result.

[0085] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the detailed descriptions of other embodiments above, which will not be repeated here.

[0086] In practice, each of the above units or structures can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units or structures, please refer to the previous method embodiments, which will not be repeated here.

[0087] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0088] The above provides a detailed description of a playback control method provided by the embodiments of this application. Specific embodiments have been used to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A playback control method, characterized in that, The playback control method includes: In response to a playback control request for target multimedia data, the source information data and / or multimedia feature data of the target multimedia data are obtained; The target source loudness of the target multimedia data is determined based on the source information data and / or multimedia feature data. The loudness of the target multimedia data is adjusted using the loudness of the target source material to obtain the playback control result.

2. The playback control method according to claim 1, characterized in that, Determining the target source loudness of the target multimedia data based on the source information data and / or multimedia feature data includes: The target source type of the target multimedia data is determined based on the source information data and / or multimedia feature data, wherein the target source type includes either the main video source type or the advertisement source type. Access a preset multimedia database to obtain the target video source loudness associated with the target video source type.

3. The playback control method according to claim 2, characterized in that, Determining the target source type of the target multimedia data based on the source information data and / or multimedia feature data includes: The target multimedia data is parsed based on the program list data and / or source metadata in the source information data to obtain the target source type of the target multimedia data. And / or, identify the target source type of the target multimedia data based on the multimedia feature data and the source classification model.

4. The playback control method according to claim 1, characterized in that, The step of adjusting the loudness of the target multimedia data using the loudness of the target source material to obtain a playback control result includes: Audio features are extracted from the target audio data of the target multimedia data to obtain the target audio features corresponding to the target multimedia data. The audio variation data of the target multimedia data is determined based on the target audio features and associated audio features; If the audio change data meets the loudness control conditions, then the target multimedia data is subjected to loudness gain according to the target loudness amplitude and the target source loudness to obtain the playback control result.

5. The playback control method according to claim 1, characterized in that, The step of adjusting the loudness of the target multimedia data using the loudness of the target source material to obtain a playback control result includes: Obtain the target source type of the target multimedia data, and determine that the target source type is an advertising source type; The target audio data corresponding to the target multimedia data is dynamically compressed according to the dynamic optimization strategy corresponding to the type of the advertisement source and the loudness of the target source, so as to obtain the playback control result.

6. The playback control method according to claim 5, characterized in that, The step of dynamically compressing the target audio data corresponding to the target multimedia data according to the dynamic optimization strategy corresponding to the advertising source type and the target source loudness to obtain the playback control result includes: According to the dynamic optimization strategy, the target audio data corresponding to the target multimedia data is divided into frequencies to obtain frequency-divided audio data. The frequency-divided audio data is compressed according to the interval compression parameters corresponding to the loudness of the target source to obtain frequency-divided compressed data. Merge the compressed data from each frequency division to obtain the target compressed data, play the target compressed data, and obtain the playback control result.

7. The playback control method according to any one of claims 1-6, characterized in that, The method further includes: In response to a volume adjustment request, obtain the volume adjustment parameters corresponding to the volume adjustment request; The volume adjustment parameters are used to update the loudness of the target source corresponding to the target multimedia data to obtain updated loudness data; The target multimedia data is then subjected to loudness adjustment using the updated loudness data to obtain a loudness adjustment result.

8. A playback control device, characterized in that, The playback control device includes: The data acquisition module is configured to respond to a playback control request for target multimedia data and acquire source information data and / or multimedia feature data of the target multimedia data. A loudness mapping module is configured to determine the target source loudness of the target multimedia data based on the source information data and / or multimedia feature data. The playback control module is configured to adjust the loudness of the target multimedia data using the loudness of the target source material, thereby obtaining a playback control result.

9. A playback control device, characterized in that, The playback control device includes: One or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the playback control method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, It stores a computer program, which is loaded by a processor to execute the steps of the playback control method according to any one of claims 1 to 7.

Images