Audio and video playback control method, device, electronic device and storage medium

Abstract

The embodiments of the present application disclose an audio and video playback control method, device, electronic device, and storage medium. The method includes: constructing an audio and video service level evaluation model; obtaining current user feedback data on the target application, wherein the user feedback data is user feedback data on the target application generated by the target application of the electronic device when the target application performs audio and video playback; inputting the user feedback data into the audio and video service level evaluation model to obtain the audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model; and adjusting the playback parameters of the target application when performing audio and video playback based on the audio and video service level. The playback parameters of the target application when performing audio and video playback are adjusted by the audio and video service level output by the audio and video service level evaluation model, so that the target application can perform audio and video playback operations based on the adjusted playback parameters, thereby improving the user experience.

Description

Technical Field

[0001] The present application relates to the field of communication technology, and more specifically, to an audio and video playback control method, device, electronic device and storage medium. Background Art

[0002] Audio and video are one of the main services of streaming media on the Internet. Good audio and video experience quality assurance is a key technical factor for service providers to win customers and occupy the market. The complexity, diversity and fragility of network systems make experience quality assurance and optimization face many uncertain factors, which will lead to poor user experience. Summary of the invention

[0003] In view of the above problems, the embodiments of the present application propose an audio and video playback control method, device, electronic device and storage medium to improve the above problems.

[0004] In a first aspect, an embodiment of the present application provides an audio and video playback control method, which is applied to an electronic device, and the method includes: constructing an audio and video service level evaluation model; obtaining current user feedback data on a target application, wherein the user feedback data is user feedback data on the target application generated by the target application of the electronic device when the target application performs audio and video playback; inputting the user feedback data into the audio and video service level evaluation model to obtain an audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model; and adjusting playback parameters of the target application when performing audio and video playback based on the audio and video service level.

[0005] In a second aspect, an embodiment of the present application provides an audio and video playback control device that runs on an electronic device, the device comprising: a model building unit, used to build an audio and video service level evaluation model; a data acquisition unit, used to obtain current user feedback data on a target application, wherein the user feedback data is user feedback data on the target application generated by the target application of the electronic device when the target application performs audio and video playback; a level acquisition unit, used to input the user feedback data into the audio and video service level evaluation model, and obtain the audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model; a parameter adjustment unit, used to adjust the playback parameters of the target application when performing audio and video playback based on the audio and video service level.

[0006] In a third aspect, an embodiment of the present application provides an electronic device, comprising one or more processors and a memory; one or more programs are stored in the memory and configured to be executed by the one or more processors to implement the above method.

[0007] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a program code is stored, wherein the above method is executed when the program code is executed by a processor.

[0008] An audio and video playback control method, device, electronic device, and storage medium provided in an embodiment of the present application first construct an audio and video service level evaluation model, then obtain user feedback data of the target application generated by the user when the target application of the electronic device that currently represents the target application plays audio and video, input the obtained user feedback data into the constructed audio and video service level evaluation model, obtain the output audio and video service level corresponding to the user feedback data, and finally adjust the playback parameters of the target application when playing audio and video based on the audio and video service level. Through the above method, different user feedback data can correspond to different audio and video service levels, and different audio and video service levels can correspond to different playback parameters. The playback parameters of the target application when playing audio and video are adjusted according to the audio and video service level output by the audio and video service level evaluation model, so that the target application can perform audio and video playback operations based on the adjusted playback parameters, thereby making the target application more flexible for audio and video playback of various audio and video levels, meeting different audio and video playback needs of users, thereby allowing users to get a suitable application experience and improving user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0010] Figure 1 A flowchart of an audio and video playback control method proposed in an embodiment of the present application is shown;

[0011] Figure 2 A schematic diagram of an evaluation pop-up window proposed in an embodiment of the present application is shown;

[0012] Figure 3 A flowchart of an audio and video playback control method proposed in another embodiment of the present application is shown;

[0013] Figure 4 A schematic diagram of a display screen proposed in another embodiment of the present application is shown;

[0014] Figure 5 A schematic diagram showing another display screen proposed in another embodiment of the present application is shown;

[0015] Figure 6 A flowchart of an audio and video playback control method proposed in another embodiment of the present application is shown;

[0016] Figure 7 A flowchart of an audio and video playback control method proposed in another embodiment of the present application is shown;

[0017] Figure 8 A structural block diagram of an audio and video playback control device proposed in an embodiment of the present application is shown;

[0018] Fig. 9 A structural block diagram of another audio and video playback control device proposed in an embodiment of the present application is shown;

[0019] Fig.10 A structural block diagram of an electronic device used to execute the audio and video playback control method according to an embodiment of the present application is shown in the present application in real time;

[0020] Fig.11 A storage unit in real time of the present application is shown for storing or carrying program codes for implementing the audio and video playback control method according to an embodiment of the present application. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0022] Audio and video are one of the main services of streaming media on the Internet. Good audio and video experience quality assurance is a key technical factor for service providers to win customers and occupy the market. Among them, audio and video can include audio and video in video conferences, audio and video when video playback devices are playing videos, etc.

[0023] The inventors found in their research on the relevant audio and video playback control methods that the complexity, diversity and fragility of the network system make the quality assurance and optimization of the user's audio and video experience face many uncertain factors, which will lead to a poor user experience. For example, in video conferencing, due to the complex and changeable network environment, video conferencing often has problems such as delay, freeze, and jitter, and even interruption when the bandwidth deteriorates sharply.

[0024] Therefore, the inventor proposed the embodiment of the present application, which first constructs an audio and video service level evaluation model, then obtains user feedback data of the target application generated by the user when the target application of the electronic device that currently represents the target application plays audio and video, inputs the obtained user feedback data into the constructed audio and video service level evaluation model, obtains the output audio and video service level corresponding to the user feedback data, and finally adjusts the playback parameters of the target application when playing audio and video based on the audio and video service level. Different user feedback data can correspond to different audio and video service levels, and different audio and video service levels can correspond to different playback parameters. The audio and video service level output by the audio and video service level evaluation model adjusts the playback parameters of the target application when playing audio and video, so that the target application can perform audio and video playback operations based on the adjusted playback parameters, thereby making the target application more flexibly applicable to audio and video playback of various audio and video levels, meeting different audio and video playback needs of users, thereby allowing users to obtain a suitable application experience, thereby improving the user experience of the audio and video playback control method, device, electronic device and storage medium.

[0025] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0026] See also Figure 1 , an audio and video playback control method provided in an embodiment of the present application, the method comprising:

[0027] S110: Construct an audio and video service level evaluation model.

[0028] As a method, the audio and video service level evaluation model is used to evaluate the audio and video quality of each audio and video application in the audio and video playback of the electronic device. The electronic device may include a smart phone, a computer, a tablet computer, and a smart TV. The audio and video application includes a conference video application, a live broadcast application, a video playback application, and a game application, etc., again without specific limitation.

[0029] In an embodiment of the present application, the constructed audio and video service level evaluation model is stored in a cloud server.

[0030] S120: Acquire current user feedback data on the target application, wherein the user feedback data is user feedback data on the target application generated by the target application of the electronic device when the target application plays audio or video.

[0031] As one approach, the target application is an application program that is playing audio or video in the electronic device. The feedback data is a suggestion or feeling generated by the user when the audio or video application program is playing audio or video.

[0032] In the embodiment of the present application, the current user feedback data for the target application can be obtained in a variety of ways. As one of the ways, the user feedback data can be obtained by reading a log file from a storage area. Specifically, the electronic device can store the generated user feedback data in real time. When storing the user feedback data, the user feedback data can be stored in the storage area of ​​the electronic device in the form of a log file, and then the current user feedback data for the target application can be obtained by reading the stored log from the storage area of ​​the electronic device. Further, when storing the user feedback data in the form of a log file, the time when the user feedback data is generated can also be stored together with the corresponding user feedback data, and then the corresponding user feedback data can be obtained by querying the time. Exemplarily, if the current user feedback data for the target application is to be obtained, the current time can be read, and then the log file corresponding to the current time can be queried from the storage area of ​​the electronic device according to the current time to obtain the current user feedback data for the target application. Optionally, when storing the user feedback data for the target application in a log file, the identification of the application and the time when the user feedback data is generated and the generated user feedback data can be stored together, and then the current user feedback data for the target application can be obtained by querying the identification of the application and the time when the feedback data is generated.

[0033] Optionally, when storing the user feedback data in a storage area of ​​an electronic device, a storage area may be specifically allocated in the storage area of ​​the electronic device to specifically store the generated user feedback data, and then when the user feedback data needs to be obtained, the user feedback data may be directly read from the storage area.

[0034] As another method, user feedback data generated by the user when the user uses the audio and video application to play audio and video can also be obtained in real time. Specifically, when it is detected that user feedback data is generated, the user feedback data is obtained as the current user feedback data for the target application.

[0035] For example, the target application may be a video conference software that is currently in progress. When the video conference is detected to be over, an evaluation pop-up window may immediately pop up on the display screen of the electronic device, such as Figure 2 As shown, the evaluation box may include "Please rate the quality of this meeting" and star-shaped evaluation indicators, as well as evaluation check boxes such as "sound freezes, unclear hearing, echo, etc.", "system drops or automatically exits", "cannot receive video, unclear images, freezes, etc." and "other issues", and further includes a user evaluation box. Figure 2After the evaluation window is displayed, the user can check or fill in the evaluation according to the experience when using the conference video software to generate user feedback data, which can then be used as the current user feedback data for the conference video software.

[0036] S130: Input the user feedback data into the audio and video service level evaluation model, and obtain the audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model.

[0037] As a method, after obtaining user feedback data through the above method, the user feedback data is used as the input of the audio and video service level evaluation model, and the audio and video service level corresponding to the input user feedback data is calculated and output by the audio and video service level evaluation model. Optionally, in an embodiment of the present application, the correspondence between different user feedback data and different audio and video service levels can be pre-stored, and then the corresponding audio and video service level can be output according to the input user feedback data. Exemplarily, the correspondence between the pre-set user feedback data and the audio and video service level can be shown in the following table:

[0038] Audio and video service level User feedback data 1 Excellent, high definition and smooth 2 Good, clear and smooth 3 Medium, average image quality, smooth 4 Poor, blurry image quality, lag 5 Very bad, no picture, lag

[0039] It can be seen from the above table that if the user feedback data indicates that the audio and video quality is "excellent, high-definition and smooth", it can be determined that the audio and video service level corresponding to the user feedback data is level 1; if the user feedback data indicates that the audio and video quality is "extremely poor, no picture, and stuck", it can be determined that the audio and video service level corresponding to the user feedback data is level 5.

[0040] S140: Based on the audio and video service level, adjusting playback parameters of the target application when playing audio and video.

[0041] As a method, the playback parameters are quality parameters that characterize the target application program when playing audio and video, and the playback parameters may include refresh rate, frame rate, packet loss rate, delay, clarity, and fluency.

[0042] After the audio and video service level corresponding to the user feedback data is determined by the above method, the current playback parameters of the target application can be adjusted according to the preset playback parameters corresponding to the audio and video service level. For example, when the audio and video service level is determined to be level 1, the definition of the target application can be adjusted to high definition, etc.

[0043] The present embodiment provides an audio and video playback control method, which first constructs an audio and video service level evaluation model, then obtains user feedback data generated by users on the target application when the target application of the electronic device that currently represents the target application plays audio and video, inputs the obtained user feedback data into the constructed audio and video service level evaluation model, obtains the output audio and video service level corresponding to the user feedback data, and finally adjusts the playback parameters of the target application when playing audio and video based on the audio and video service level. Through the above method, different user feedback data can correspond to different audio and video service levels, and different audio and video service levels can correspond to different playback parameters. The audio and video service level output by the audio and video service level evaluation model adjusts the playback parameters of the target application when playing audio and video, so that the target application can perform audio and video playback operations based on the adjusted playback parameters, thereby making the target application more flexible for audio and video playback of various audio and video levels, meeting different audio and video playback needs of users, thereby allowing users to get a suitable application experience and improving user experience.

[0044] See also Figure 3 , an audio and video playback control method provided in an embodiment of the present application, the method comprising:

[0045] S210: Obtain user feedback data on the target application.

[0046] As one approach, the user feedback data is user feedback data generated by all electronic devices installed with the target application.

[0047] Specifically, when an electronic device installed with a target application generates corresponding user feedback data, the user feedback data can be uploaded to a cloud server or a designated database for storage. Then, when user feedback data on the target application needs to be obtained, the corresponding user feedback data can be directly obtained from the cloud server or the designated database.

[0048] Furthermore, the electronic device can obtain user feedback data for the target application based on the received control instruction. In an embodiment of the present application, the control instruction may include an application identifier. When the electronic device receives the control instruction, the application corresponding to the application identifier carried in the control instruction can be used as the target application, and the user feedback data of the target application can be obtained from the cloud server or the designated database.

[0049] S220: Acquire industry standard data corresponding to the user feedback data.

[0050] The industry standard data are corresponding evaluation standard values ​​that can measure audio and video quality or definitions of relevant audio and video playback parameters.

[0051] As a method, the industry standard data may include at least one of a voice quality standard, a video quality standard, a shared file fluency standard, and an audio and video live broadcast quality standard.

[0052] The video quality standard may include a video fluency standard, and the evaluation standard for video fluency is frame rate and refresh rate. It should be noted that the screen refresh rate of conventional electronic devices is fixed.

[0053] The frame rate is defined as the frequency (rate) at which a bitmap image in frames appears continuously on a display. Generally speaking, the higher the frame rate, the smoother the video is, which means that the frame rate and smoothness are closely related.

[0054] Furthermore, the refresh rate refers to the number of times the electron beam repeatedly scans the image on the screen, and the unit is Hertz (Hz). Generally speaking, the higher the refresh rate, the better the stability of the image (picture) displayed by the video. For example, Figure 4 He Ru Figure 5 As shown, Figure 4 For a display with a refresh rate of 60Hz, Figure 5 This is a display with a refresh rate of 120Hz. It can be clearly seen through observation that the display with a refresh rate of 120Hz is clearer and smoother than the display with a refresh rate of 60Hz.

[0055] Optionally, in different audio and video playback types, the industry standard data corresponding to the user feedback data obtained is different. Specifically, the audio and video playback types may include movies, TV series, online videos, and high frame rate games, etc., which are not specifically limited here.

[0056] For example, different audio and video playback types have different frame rate evaluation criteria, as shown in the following table:

[0057]

[0058] From the above table, we can see that when the audio and video playback type is "movie", the frame rate evaluation standard is 24fps; when the audio and video playback type is "TV series", the frame rate evaluation standard is 25fps.

[0059] It should be noted that frame rates that are usually higher than the refresh rate are invalid frames, which do not improve the display effect and may cause abnormal images. Therefore, when designing the frame rate of audio and video playback applications, the frame rate of audio and video applications is set to a maximum frame rate. For example, if more than 200 frames can be obtained in the video, but because the display refresh rate is only 30Hz, only 30 frames can be captured for display. The final user sees the 30 captured frames, and the remaining 170 frames are invalid frames.

[0060] Furthermore, when user feedback data is obtained, the audio and video playback type corresponding to the user feedback data can be pre-determined, and then the industry standard data corresponding to the audio and video playback type can be obtained.

[0061] Optionally, when the target application is playing audio or video, the frame rate of the target application can be detected in real time. When it is detected that the frame rate of the target application is lower than the standard frame rate, the current frame rate of the target application is adjusted to the standard frame rate.

[0062] For example, assuming that the device of user "Youme_01_001" is "BenQ VZ24A0H", and starts to share a movie with a frame rate of 24fps as a sharing party, then the following associated data can be obtained:

[0063]

[0064] According to the above frame rate evaluation criteria, it can be known that if the uplink frame rate is 9fps, the movie will be stuck. Therefore, the uplink frame rate can be adjusted to 24fps, and the following data can be obtained:

[0065]

[0066] In an embodiment of the present application, the industry standard data can be stored in a cloud server or a designated database. When it is necessary to obtain the industry standard data corresponding to the user feedback data, it can be directly obtained from the cloud server or the designated database. Specifically, the correspondence between the type of user feedback data and the industry standard data can be pre-set. When the user feedback data is obtained, the type of user feedback data can be determined first, and then the industry standard data corresponding to the card type can be searched from the cloud server or the designated database. Among them, the division of user feedback data types can be divided according to the keywords in the user feedback data, and the keywords are pre-set keywords that can find the corresponding industry standards. Exemplarily, if the user feedback data is "sound is stuck, and it is not clear to hear clearly", it can be determined that the keywords are "stuck" and "clear", so it can be determined that the type of user feedback data is fluency, and then the industry standard data corresponding to fluency can be obtained from the cloud server or the designated database.

[0067] S230: Acquire bottom-level detection data of the electronic device.

[0068] The bottom layer detection data is detection data obtained after detecting the bottom layer software, bottom layer hardware and network environment of the electronic device.

[0069] As a way, the bottom layer detection data may include at least one of frame rate detection data, bit rate detection data, broadband detection data, delay detection data, latency detection data and hardware detection data.

[0070] Specifically, the electronic device may start to acquire the underlying detection data of the electronic device upon receiving the data acquisition instruction. Optionally, the electronic device may store the underlying detection data of the electronic device in real time. When storing the underlying detection data, the underlying detection data may be stored in a certain storage format. Exemplarily, the storage format may be as shown in the following table:

[0071]

[0072] As shown in the above table, the storage format of the underlying detection data may include "user ID", "time", "module", "uplink frame rate" and "downlink frame rate". Among them, "user ID" is the ID of the user logging into the target application, "time" is the time of the underlying detection, and "module" is the type of video playback. The storage format of the underlying detection data may also include other formats, which are not specifically limited here.

[0073] S240: Based on the user feedback data, the industry standard data and the underlying detection data, the audio and video service level evaluation model is obtained through machine learning.

[0074] As a method, after obtaining user feedback data, industry standard data and underlying detection data through the above method, machine learning is used to build a model to obtain an audio and video service level evaluation model. The process of machine learning modeling can be carried out in a cloud server, and big data calculations are performed in the cloud server to establish an audio and video service level evaluation model.

[0075] When the electronic device obtains user feedback data, industry standard data and underlying detection data, it sends the obtained user feedback data, industry standard data and underlying detection data as a piece of data to the cloud server. When the cloud server receives the data, it only takes a few milliseconds or seconds to calculate the audio and video service level, and then sends the audio and video service level as an output result to the electronic device.

[0076] S250: Acquire current user feedback data on the target application, wherein the user feedback data is user feedback data on the target application generated when the target application of the electronic device plays audio or video.

[0077] S260: Input the user feedback data into the audio and video service level evaluation model, and obtain the audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model.

[0078] S270: Based on the audio and video service level, adjust the playback parameters of the target application when playing audio and video.

[0079] The detailed explanation of the steps included in S250, S260 and S270 can refer to the corresponding steps in the aforementioned embodiments, which will not be repeated here.

[0080] The present embodiment provides an audio and video playback control method, which first obtains user feedback data on a target application, obtains industry standard data corresponding to the user feedback data and underlying detection data of the electronic device, and then obtains an audio and video service level evaluation model through machine learning based on the user feedback data, industry standard data and underlying detection data, and then obtains user feedback data on the target application generated by the target application of the current electronic device when performing audio and video playback, inputs the obtained user feedback data into the audio and video service level evaluation model, obtains the audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model, and finally adjusts the playback parameters of the target application when performing audio and video playback based on the audio and video service level. Through the above method, the playback parameters of the target application when performing audio and video playback are adjusted through the audio and video service level output by the audio and video service level evaluation model, so that the target application can perform audio and video playback operations based on the adjusted playback parameters, thereby allowing users to obtain a suitable application experience, thereby improving user experience.

[0081] See also Figure 6 , an audio and video playback control method provided in an embodiment of the present application, the method comprising:

[0082] S310: Obtaining full user feedback data on the target application.

[0083] As a method, the full amount of user feedback data is the feedback data of all users who have installed the target application stored in the cloud server or the designated database, as well as the test data generated by the tester after testing the target application during the testing phase.

[0084] In an embodiment of the present application, when obtaining the full amount of user feedback data on the target application, user feedback data of all electronic devices installed with the target application will be obtained, which may include test data fed back by testers.

[0085] S320: Perform a data cleaning operation on the full amount of user feedback data, and use the cleaned full amount of user feedback data as user feedback data for the target application.

[0086] As a method, after obtaining the full amount of user feedback data, the full amount of user feedback data is cleaned to remove test data, noise data, etc., wherein the test data is the test data fed back by the testers obtained above, and the noise data is the contradictory user evaluations in the user feedback data. For example, the user's rating is a positive "5 stars", but the feedback problem is an option or comment of poor use, then this user feedback data is noise data.

[0087] After the above operations, the cleaned full amount of user feedback data is obtained, and the full amount of user feedback data is used as user feedback data for the target application for subsequent data modeling.

[0088] S330: Acquire industry standard data corresponding to the user feedback data.

[0089] S340: Acquire bottom-level detection data of the electronic device.

[0090] S350: Based on the user feedback data, the industry standard data and the underlying detection data, the audio and video service level evaluation model is obtained through machine learning.

[0091] S360: Acquire current user feedback data on the target application, wherein the user feedback data is user feedback data on the target application generated when the target application of the electronic device plays audio or video.

[0092] S370: Input the user feedback data into the audio and video service level evaluation model, and obtain the audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model.

[0093] The detailed explanation of the steps included in S330, S340, S350, S360 and S370 can refer to the corresponding steps in the aforementioned embodiments, which will not be repeated here.

[0094] S380: Adjusting the playback parameters of the target application when performing audio and video playback to preset playback parameters, wherein the preset playback parameters are preset playback parameters corresponding to the audio and video service level when the target application performs audio and video playback.

[0095] As a method, the corresponding relationship between the audio and video service level and the preset playback parameters can be pre-stored in the cloud server or the designated database. After the audio and video service level of the target application is determined by the above method, the preset playback parameters corresponding to the audio and video service level can be directly obtained from the cloud server or the designated database, and the playback parameters of the target application currently playing audio and video can be adjusted to the preset playback parameters.

[0096] In the embodiment of the present application, different audio and video service levels correspond to different preset playback parameters. Specifically, the audio and video service levels can be pre-set from high to low as "S-level", "A-level", "B-level", "C-level" and "D-level", where the preset playback parameters corresponding to "S-level" are "excellent, high-definition and smooth", the preset playback parameters corresponding to "A-level" are "good, clear and smooth", the preset playback parameters corresponding to "B-level" are "medium, ordinary image quality, smooth", the preset playback parameters corresponding to "C-level" are "poor, lossy service, partial delay allowed", and the preset playback parameters corresponding to "D-level" are "extremely poor, suspending some services". When the audio and video service level of the target application is determined to be S-level through the above method, the current playback parameters of the target application are adjusted to "excellent, high-definition and smooth".

[0097] Optionally, for the same target application, due to different user feedback data, the audio and video service level corresponding to the target application may be different, and the corresponding playback parameters of the target application may also change. For example, if the target application is a screen sharing service application, and the current audio and video service level output according to the user feedback data is S-level, then the preset playback parameters of "excellent, high-definition and smooth" can be used. If the audio and video service level of the target application is reduced to C-level, only the preset playback parameters of "poor, lossy service, partial delay allowed" can be used.

[0098] Through the above method, different audio and video service levels can provide different experiences for different applications.

[0099] The present embodiment provides an audio and video playback control method, which first obtains the full amount of user feedback data for the target application, and performs a data cleaning operation on the full amount of user feedback data, and uses the cleaned full amount of user feedback data as the user feedback data for the target application, and then obtains the industry standard data corresponding to the user feedback data and the underlying detection data of the electronic device, and then obtains the audio and video service level evaluation model through machine learning based on the obtained user feedback data, industry standard data and underlying detection data, obtains the current user feedback data for the target application, inputs the user feedback data into the audio and video service level evaluation model, obtains the audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model, and adjusts the playback parameters of the target application when performing audio and video playback to the preset playback parameters according to the obtained audio and video service level. Through the above method, the playback parameters of the target application when performing audio and video playback are adjusted by the audio and video service level output by the audio and video service level evaluation model, so that the target application can perform audio and video playback operations based on the adjusted playback parameters, thereby allowing users to obtain a suitable application experience, thereby improving user experience.

[0100] See also Figure 7 , an audio and video playback control method provided in an embodiment of the present application, the method comprising:

[0101] S410: Construct an audio and video service level evaluation model.

[0102] S420: Acquire current user feedback data on the target application, wherein the user feedback data is user feedback data on the target application generated by the target application of the electronic device when the target application is playing audio or video.

[0103] S430: Input the user feedback data into the audio and video service level evaluation model, and obtain the audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model.

[0104] S440: Adjusting the playback parameters of the target application when performing audio and video playback to preset playback parameters, wherein the preset playback parameters are preset playback parameters corresponding to the audio and video service level when the target application performs audio and video playback.

[0105] The detailed explanation of the steps included in S410, S420, S430 and S440 can refer to the corresponding steps in the aforementioned embodiments, which will not be repeated here.

[0106] S450: Obtaining policy feedback data after playing the audio and video of the target application based on the playback parameters.

[0107] In the embodiment of the present application, the audio and video service level evaluation model can be verified, corrected and re-learned in combination with user feedback data, and the competent user experience can be used as the ultimate basis for the detection effect to guide the optimization of the audio and video service level evaluation model.

[0108] As a method, the policy feedback data represents the playback effect of the target application after the audio and video playback is performed based on the adjusted playback parameters. When the playback parameters of the target application during audio and video playback are adjusted to the preset playback parameters, the target application can perform audio and video playback based on the adjusted playback parameters. During the audio and video playback process of the target application, the user can provide real-time feedback on the current playback effect, or the background program of the electronic device can actively detect the playback effect of the target application during audio and video playback and feedback to the cloud server.

[0109] S460: If the policy feedback data does not meet a preset condition, input the policy feedback data as user feedback data into the audio and video service level evaluation model.

[0110] As a method, the preset condition represents that the playback effect after the target application plays the audio and video based on the adjusted playback parameters meets the preset playback effect. When the policy feedback data is obtained, the playback effect represented by the policy feedback data is compared with the preset playback effect in the preset condition. If the playback effect represented by the policy feedback data is lower than the preset playback effect, the policy feedback data is input into the audio and video service level evaluation model as user feedback data.

[0111] S470: Adjusting the evaluation parameters of the audio and video service level evaluation model based on the strategy feedback data to obtain an optimized audio and video service level evaluation model.

[0112] As a method, the audio and video service level evaluation model adjusts and optimizes the evaluation parameters of the model according to the input strategy feedback data, and continuously adjusts and learns to obtain an optimized audio and video service level evaluation model, wherein the evaluation parameters are audio and video quality parameters.

[0113] The present embodiment provides an audio and video playback control method, firstly constructing an audio and video service level evaluation model, then obtaining the current user feedback data of the target application, inputting the obtained user feedback data into the audio and video service level evaluation model, obtaining the audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model, and adjusting the playback parameters of the target application when playing audio and video to the preset playback parameters according to the audio and video service level, and then obtaining the policy feedback data after the target application plays audio and video based on the playback parameters, if the policy feedback data does not meet the preset conditions, inputting the policy feedback data as the user feedback data into the audio and video service level evaluation model, adjusting the evaluation parameters of the audio and video service level evaluation model based on the policy feedback data, and obtaining the optimized audio and video service level evaluation model. Through the above method, the playback parameters of the target application when playing audio and video are adjusted by the audio and video service level output by the audio and video service level evaluation model, so that the target application can perform audio and video playback operations based on the adjusted playback parameters, thereby enabling the user to obtain a suitable application experience, improving the user experience, and further, adjusting the audio and video service level evaluation model according to the policy feedback data can make the evaluation of the feedback data of the current target application more accurate, thereby providing the user with a better video playback experience.

[0114] See also Figure 8 , the present application provides an audio and video playback control device 500, the device 500 includes a model building unit 510, a data acquisition unit 520, a level acquisition unit 530 and a parameter adjustment unit 540;

[0115] The model building unit 510 is used to build an audio and video service level evaluation model.

[0116] Specifically, the model building unit 510 is used to obtain user feedback data on the target application; obtain industry standard data corresponding to the user feedback data; obtain underlying detection data of the electronic device; and obtain the audio and video service level evaluation model through machine learning based on the user feedback data, the industry standard data and the underlying detection data.

[0117] The model building unit 510 is further configured to obtain full user feedback data on the target application; perform data cleaning operations on the full user feedback data, and use the cleaned full user feedback data as the user feedback data on the target application.

[0118] The data acquisition unit 520 is used to acquire current user feedback data on the target application, wherein the user feedback data is user feedback data on the target application generated when the target application of the electronic device plays audio or video.

[0119] The level acquisition unit 530 is used to input the user feedback data into the audio and video service level evaluation model, and acquire the audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model.

[0120] The parameter adjustment unit 540 is used to adjust the playback parameters of the target application when playing audio and video based on the audio and video service level.

[0121] As a method, the parameter adjustment unit 540 is specifically used to adjust the playback parameters of the target application when playing audio and video to preset playback parameters, wherein the preset playback parameters are playback parameters corresponding to the audio and video service level when the target application plays audio and video in advance.

[0122] See also Fig. 9 , the audio and video playback control device 500 also includes:

[0123] The model optimization unit 550 is used to obtain the policy feedback data after the audio and video playback of the target application based on the playback parameters; if the policy feedback data does not meet the preset conditions, the policy feedback data is input into the audio and video service level evaluation model as user feedback data; based on the policy feedback data, the evaluation parameters of the audio and video service level evaluation model are adjusted to obtain the optimized audio and video service level evaluation model.

[0124] It should be noted that the device embodiment in the present application corresponds to the aforementioned method embodiment. The specific principles in the device embodiment can be found in the contents of the aforementioned method embodiment and will not be repeated here.

[0125] The following will be combined Fig.10 An electronic device provided by the present application is described.

[0126] See also Fig.10 Based on the above-mentioned audio and video playback control method and device, the embodiment of the present application also provides another electronic device 100 that can execute the above-mentioned audio and video playback control method. The electronic device 100 includes one or more (only one is shown in the figure) processors 102, a memory 104 and a network module 106 that are coupled to each other. Among them, the memory 104 stores a program that can execute the content of the above-mentioned embodiment, and the processor 102 can execute the program stored in the memory 104.

[0127] Among them, the processor 102 may include one or more processing cores. The processor 102 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 104, and calling data stored in the memory 104. Optionally, the processor 102 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 102 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 102, but may be implemented separately through a communication chip.

[0128] The memory 104 may include a random access memory (RAM) or a read-only memory (ROM). The memory 104 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 104 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as a phone book, audio and video data, chat record data) created by the electronic device 100 during use.

[0129] The network module 106 is used to receive and send electromagnetic waves, realize the mutual conversion between electromagnetic waves and electrical signals, so as to communicate with a communication network or other devices, such as communicating with an audio playback device. The network module 106 may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption / decryption chips, user identity modules (SIM) cards, memories, etc. The network module 106 may communicate with various networks such as the Internet, corporate intranets, wireless networks, or communicate with other devices via wireless networks. The above-mentioned wireless networks may include cellular telephone networks, wireless local area networks, or metropolitan area networks. For example, the network module 106 may exchange information with a base station.

[0130] Please refer to Fig.11 , which shows a structural block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable medium 800 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0131] The computer readable storage medium 800 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable storage medium 800 includes a non-transitory computer-readable storage medium. The computer readable storage medium 800 has storage space for program code 810 that performs any method step in the above method. These program codes can be read from or written to one or more computer program products. The program code 810 can be compressed, for example, in an appropriate form.

[0132] The present embodiment provides an audio and video playback control method, device, electronic device and storage medium, which first constructs an audio and video service level evaluation model, then obtains user feedback data of the target application generated by the target application when the target application of the electronic device that currently represents the target application plays audio and video, inputs the obtained user feedback data into the constructed audio and video service level evaluation model, obtains the output audio and video service level corresponding to the user feedback data, and finally adjusts the playback parameters of the target application when playing audio and video based on the audio and video service level. Through the above method, different user feedback data can correspond to different audio and video service levels, and different audio and video service levels can correspond to different playback parameters. The audio and video service level output by the audio and video service level evaluation model adjusts the playback parameters of the target application when playing audio and video, so that the target application can perform audio and video playback operations based on the adjusted playback parameters, thereby making the target application more flexible to various audio and video playbacks of different audio and video levels, meeting different audio and video playback needs of users, thereby allowing users to get a suitable application experience, improving user experience.

[0133] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for controlling audio and video playback, characterized in that: Applied to electronic equipment, the method comprises: Obtain user feedback data on the target application; Acquire industry standard data corresponding to the user feedback data, wherein the industry standard data includes at least one of a voice quality standard, a video quality standard, a shared file fluency standard, and an audio and video live broadcast quality standard; Acquire bottom-level detection data of the electronic device, wherein the bottom-level detection data includes at least one of frame rate detection data, bit rate detection data, delay detection data, and hardware detection data; Based on the user feedback data, the industry standard data and the underlying detection data, an audio and video service level evaluation model is obtained through machine learning; Acquire current user feedback data on the target application, wherein the user feedback data is user feedback data on the target application generated by the target application of the electronic device when the target application plays audio or video, and the feedback data represents suggestions or feelings generated by the user when the audio or video application is used to play audio or video; Inputting the user feedback data into the audio and video service level evaluation model, and obtaining the audio and video service level corresponding to the user feedback data output by the audio and video service level evaluation model; Based on the audio and video service level, the playback parameters of the target application when playing audio and video are adjusted.

2. The method according to claim 1, characterized in that The adjusting, based on the audio and video service level, playback parameters of the target application when playing audio and video, includes: The playback parameters of the target application when playing audio and video are adjusted to preset playback parameters, wherein the preset playback parameters are preset playback parameters corresponding to the audio and video service level when the target application plays audio and video.

3. The method according to claim 1, characterized in that The obtaining of user feedback data on the target application includes: Obtaining full user feedback data on the target application; A data cleaning operation is performed on the full amount of user feedback data, and the cleaned full amount of user feedback data is used as user feedback data for the target application.

4. The method according to claim 1, characterized in that: The bottom layer detection data includes at least one of frame rate detection data, bit rate detection data, broadband detection data, delay detection data and hardware detection data.

5. The method according to any one of claims 1 to 4, characterized in that: After adjusting the playback parameters of the target application for audio and video playback based on the audio and video service level, the method further includes: Obtaining policy feedback data after audio and video playback of the target application based on the playback parameters; If the policy feedback data does not meet the preset conditions, inputting the policy feedback data as user feedback data into the audio and video service level evaluation model; The evaluation parameters of the audio and video service level evaluation model are adjusted based on the strategy feedback data to obtain an optimized audio and video service level evaluation model.

6. The method according to any one of claims 1 to 4, characterized in that: In different audio and video playback types, the industry standard data obtained corresponding to the user feedback data is different.

7. An audio and video playback control device, characterized in that: Running on an electronic device, the device comprises: A model building unit is used to obtain user feedback data on a target application; obtain industry standard data corresponding to the user feedback data, wherein the industry standard data includes at least one of a voice quality standard, a video quality standard, a shared file fluency standard, and an audio and video live broadcast quality standard; obtain underlying detection data of the electronic device, wherein the underlying detection data includes at least one of frame rate detection data, bit rate detection data, delay detection data, and hardware detection data; based on the user feedback data, the industry standard data, and the underlying detection data, obtain an audio and video service level evaluation model through machine learning; a data acquisition unit, configured to acquire current user feedback data on the target application, wherein the user feedback data is user feedback data on the target application generated when the target application of the electronic device plays audio or video, and the feedback data represents suggestions or feelings generated by the user when the audio or video application is used to play audio or video; a level acquisition unit, configured to input the user feedback data into the audio and video service level evaluation model, and acquire the audio and video service level output by the audio and video service level evaluation model and corresponding to the user feedback data; The parameter adjustment unit is used to adjust the playback parameters of the target application when playing audio and video based on the audio and video service level.

8. An electronic device, characterized in that: The method comprises one or more processors and a memory; one or more programs are stored in the memory and are configured so that the one or more processors execute the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program code, wherein when the program code is executed by a processor, the method according to any one of claims 1 to 6 is executed.

Images