Video transcoding method and device, equipment and medium

Abstract

The invention relates to the technical field of video processing, in particular to a video transcoding method, device, equipment and medium, and the method comprises the steps: obtaining user feedback information of a video to be transcoded, and obtaining the user feedback information of the video to be transcoded based on the user feedback information, the weights of various types of information contained in the user feedback information and the content type impact factor of the video to be transcoded; and calculating a comprehensive user experience quality score value, determining a transcoding parameter according to the comprehensive user experience quality score value and a preset score grade standard, and transcoding the to-be-transcoded video based on the transcoding parameter to generate a target transcoded video. Visibly, the comprehensive user experience quality score value is calculated based on the user feedback information, the weight of each type of information contained in the user feedback information and the content type influence factor of the to-be-transcoded video, and then the transcoding parameter is determined according to the preset score grade standard; therefore, the video transcoding can be accurately and dynamically adjusted according to the network fluctuation environment in which the playing equipment is located, and the watching experience of a user is improved.

Description

Technical Field

[0001] The present invention relates to the field of video processing technology, and in particular to a video transcoding method, device, equipment and medium. Background Art

[0002] With the development of information technology, various video applications or video websites have emerged, and more and more users watch videos through video applications or video websites. However, due to differences in network environment, terminal type, and uploaded video content format, real-time transcoding is required during video playback to achieve better compatibility.

[0003] At present, existing technologies usually use static transcoding strategies, adaptive bitrate streaming, and hardware-accelerated real-time transcoding to achieve video transcoding. These traditional transcoding methods usually set a series of fixed parameters during the transcoding process and cannot dynamically adjust video transcoding according to the network environment in which the playback device is located. This results in that when the network fluctuates or user needs change, the transcoded output content may not be able to adapt to the current playback environment, thereby causing a decline in user viewing experience. Summary of the invention

[0004] Based on this, it is necessary to address the above technical problems. The embodiments of the present invention provide a video transcoding method, device, equipment and medium to solve the problem that the prior art cannot dynamically adjust video transcoding according to the network fluctuation environment in which the playback device is located, thereby resulting in a decrease in user viewing experience.

[0005] A first aspect of an embodiment of the present application provides a video transcoding method, the video transcoding method comprising: Obtaining user feedback information of the video to be transcoded, wherein the user feedback information includes user playback device information, user playback experience information, and user network status information; Calculate a comprehensive user experience quality score based on the user feedback information, the weights of various types of information included in the user feedback information, and the content type influencing factor of the video to be transcoded; Determine transcoding parameters according to the comprehensive user experience quality score value and a preset score level standard, wherein the transcoding parameters include encoding format, bit rate, resolution and / or frame rate; The video to be transcoded is transcoded based on the transcoding parameters to generate a target transcoded video.

[0006] A second aspect of an embodiment of the present application provides a video transcoding device, the video transcoding device comprising: An acquisition module, used to acquire user feedback information of the video to be transcoded, wherein the user feedback information includes user playback device information, user playback experience information and user network status information; A calculation module, configured to calculate a comprehensive user experience quality score value based on the user feedback information, the weights of various types of information included in the user feedback information, and the content type influencing factor of the video to be transcoded; A determination module, configured to determine transcoding parameters according to the comprehensive user experience quality score value and a preset scoring level standard, wherein the transcoding parameters include encoding format, bit rate, resolution and / or frame rate; A generating module is used to transcode the to-be-transcoded video based on the transcoding parameters to generate a target transcoded video.

[0007] In a third aspect, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the video transcoding method as described in the first aspect when executing the computer program.

[0008] According to a fourth aspect, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the video transcoding method according to the first aspect is implemented.

[0009] In summary, the present invention provides a video transcoding method, apparatus, device and medium, which obtains user feedback information of a video to be transcoded, wherein the user feedback information includes user playback device information, user playback experience information and user network status information, and calculates a comprehensive user experience quality score value based on the user feedback information, the weights of various types of information contained in the user feedback information and the content type influencing factor of the video to be transcoded, and determines transcoding parameters according to the comprehensive user experience quality score value according to a preset scoring level standard, wherein the transcoding parameters include encoding format, bit rate, resolution and / or frame rate, and transcodes the video to be transcoded based on the transcoding parameters to generate a target transcoded video. It can be seen that the present application calculates the comprehensive user experience quality score value based on the user feedback information, the weights of various types of information contained in the user feedback information and the content type influencing factor of the video to be transcoded, and then determines the transcoding parameters according to the preset scoring level standard, so that the video transcoding can be accurately and dynamically adjusted according to the network fluctuation environment in which the playback device is located, thereby improving the user viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0011] Figure 1 This is an application environment diagram of a video transcoding method provided by an embodiment of the present invention; Figure 2 It is a flowchart of a video transcoding method provided by an embodiment of the present invention; Figure 3 is a structural schematic diagram of a video transcoding device provided by an embodiment of the present invention; Figure 4 It is a structural schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0012] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technical personnel in this field without creative work are within the scope of protection of the present invention.

[0013] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or combinations thereof.

[0014] It should also be understood that the term "and / or" used in the present description and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

[0015] As used in the present specification and the appended claims, the term “if” may be interpreted as “when” or “uponce” or “in response to determining”, depending on the context. Similarly, the phrases “if it is determined” or “if matched to [described condition or event]” may be interpreted as meaning “upon determination” or “in response to determination” or “uponce matched to [described condition or event]” or “in response to matching to [described condition or event]”, depending on the context.

[0016] In addition, in the description of the present specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0017] References to "one embodiment" or "some embodiments" etc. described in the present specification mean that one or more embodiments of the present invention include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0018] It should be understood that the order of execution of the steps in the following embodiments does not imply a precedence of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0019] In order to illustrate the technical solution of the present invention, specific embodiments are provided below for illustration.

[0020] See also Figure 1 , is an application environment diagram of a video transcoding method provided by an embodiment of the present invention. A video transcoding method provided by an embodiment of the present invention can be applied in Figure 1 In the application environment, the client communicates with the server. The client includes but is not limited to PDAs, desktop computers, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs) and other electronic devices. The client here is replaced by a business system. The server can be implemented with an independent server or a server cluster composed of multiple servers. Video transcoding is performed through the server to achieve the best user viewing experience.

[0021] See also Figure 2 , is a flow chart of a video transcoding method provided by an embodiment of the present invention, such as Figure 2 As shown, the video transcoding method can be implemented by the following steps.

[0022] S201: Obtain user feedback information of the video to be transcoded, wherein the user feedback information includes user playback device information, user playback experience information, and user network status information.

[0023] In step S201, when the user plays the video, the user feedback information of the video to be transcoded can be obtained through the built-in feedback system of the video playback platform. For example, when the user plays the video on platforms such as Tencent Video and iQiyi, the platform will set a feedback entrance on the playback interface, such as a "Feedback and Help" button, so that the user can obtain it through this entrance; or for some custom video players or video playback components within the website, a JavaScript script can be embedded in the player code to obtain user feedback information of the video to be transcoded. For example, in an internal training video player of an enterprise, the script can collect information at various stages of video playback; or a user survey window can be popped up after the video playback is finished to obtain user feedback information of the video to be transcoded. For example, in some newly launched videos or specific video channels of Bilibili, a short questionnaire may pop up after the playback is finished. The specific setting can be made according to the actual situation, and this application does not impose any limitation on this.

[0024] Specifically, user feedback information includes user playback device information, user playback experience information and user network status information, among which user playback device information refers to relevant data of the device used by the user to play videos, including the type of user playback device, the resolution of the user playback device, the decoding capability of the user playback device and / or the performance of the user playback device, etc., and the types of user playback devices are diverse, and the common ones include: hard disk player: can be divided into RM player, quasi-HD player, full HD (FULL HD) player, etc. according to the decoding capability; smart TV: built-in smart operating system, support network connection and streaming media playback; personal computer: including desktop and laptop computers, play videos through browsers or video applications; smart phones and tablets: portable devices, support video playback and streaming services; Blu-ray player: HD playback device dedicated to playing Blu-ray discs; network playback box: such as TV box, etc., connected to streaming media services or locally stored video files through the network. The resolution of the user's playback device determines the display clarity of the video. Common resolutions include: 720p: 1280×720 pixels, suitable for quasi-HD playback devices; 1080p: 1920×1080 pixels, full HD resolution, widely used in HDTVs and players; 2K: 2560×1440 pixels, providing a more delicate display effect; 4K: 3840×2160 pixels, ultra-high-definition resolution, supporting finer image details and larger screen sizes; 8K: 7680×4320 pixels, higher resolution, providing a more shocking visual experience. The decoding capability of the user's playback device is the ability of the playback device to process and decode video files, and is one of the important indicators to measure its performance. Decoding capabilities include: supported video formats and encoding standards: such as RealVideo, MPEG, H.264, AV1, AVS3, H.266, etc.; decoding efficiency and speed: efficient decoding speed and smooth playback experience; decoding methods: hard decoding (decoding through a dedicated decoding chip) and soft decoding (decoding through the device's CPU). Hardware decoding usually has higher decoding efficiency and lower power consumption, but the compatibility with video formats may be affected by the technical strength of chip manufacturers; soft decoding has better compatibility with streaming formats, but the decoding efficiency and clarity may be slightly inferior to hardware decoding. The performance of the user's playback device, such as: CPU and GPU performance: affects the decoding speed and fluency of the video; memory and storage space: affects the running speed and storage capacity of the device; network connection capability: determines the speed and stability of the device's connection to the network, which in turn affects the transmission speed and playback quality of the video; operating system and application support: the device's operating system and the number and quality of video applications provided by the application store will also affect the user's playback experience.

[0025] User playback experience information refers to the quality of experience felt by users during video playback, including the number of freezes, buffering time, playback interruptions, initial buffering time, playback duration ratio, and / or resolution change times. The number of freezes refers to the number of freezes during video playback; the buffering time refers to the time spent on each buffer; the number of playback interruptions refers to the number of interruptions caused by various reasons during playback; the initial buffering time refers to the time required from clicking play to starting playback; the playback duration ratio refers to the ratio of actual playback duration to the total video duration; the number of resolution changes refers to the number of resolution switches during playback. User network status information refers to the status of the user's device connecting to the network, which will affect the transmission speed and playback quality of the video, including bandwidth, jitter, and / or packet loss rate. Bandwidth refers to the upload and download speed of the current network; jitter refers to the degree of change in the delay of network data packets during transmission; and the packet loss rate refers to the proportion of network data packets lost during transmission.

[0026] In the embodiment of the present application, by obtaining user feedback information of the video to be transcoded, it is possible to more comprehensively understand user needs and service quality, and to more accurately analyze user problems during video playback, thereby optimizing the transcoding and playback strategy of the video.

[0027] S202: Calculate a comprehensive user experience quality score based on the user feedback information, the weights of various types of information included in the user feedback information, and the content type influencing factor of the video to be transcoded.

[0028] In step S202, after obtaining user feedback information, the comprehensive user experience quality score is calculated based on the user feedback information, the weights of various types of information contained in the user feedback information, and the content type influencing factor of the video to be transcoded, wherein the content type of the video to be transcoded includes movies, TV series, sports events, documentaries, etc. The content type of the transcoded video is identified by scraping or metadata tags, so as to define specific weights for different playback contents. For example, action movies may have high frame rate requirements, while documentaries may pay more attention to picture quality details. An adjustment factor is set for each content type to influence the weight of device performance, playback experience, and network conditions. The content type influencing factor can be set to be greater than 1 and less than 2, thereby amplifying the contribution of other factors to the user experience quality and improving the overall score, so as to improve the accuracy and satisfaction of the user's viewing experience under the specific environment of device performance, playback experience, and network conditions. For example, sports events have extremely high requirements for real-time and smoothness, and the frame rate of the original bitstream needs to be guaranteed as much as possible. In this case, the impact factor of this content type is set between 1.3 and 1.6. Documentaries have high requirements for picture clarity, and the clarity and bitrate of the original bitstream need to be guaranteed. In this case, the impact factor of this content type is set between 1.1 and 1.3.

[0029] In an embodiment of the invention, the calculating of the comprehensive user experience quality score based on the user feedback information, the weights of various types of information included in the user feedback information, and the content type influencing factor of the video to be transcoded includes: Based on the continuous function of each type of information in the user feedback information and the weights of each type of information contained in the user feedback information, respectively calculate a first user experience quality score value of the user playback device information, a second user experience quality score value of the user playback experience information, and a third user experience quality score value of the user network status information; A comprehensive user experience quality score value is calculated based on the first user experience quality score value of the user playback device information, the second user experience quality score value of the user playback experience information, the third user experience quality score value of the user network status information, and the content type influencing factor of the video to be transcoded.

[0030] In one embodiment of the invention, the comprehensive user experience quality score is calculated using the following formula: in, Represents the comprehensive user experience quality score. Indicates the first user experience quality score value of the user's playback device information. A second user experience quality score value representing user playback experience information, A third user experience quality score value representing user network status information, Indicates the influencing factor of the content type of the video to be transcoded, Indicates the weight of the user's playback device information. Indicates the weight of the user's playback experience information. Indicates the weight of the user's network status information.

[0031] Specifically, since the user feedback information includes user playback device information, user playback experience information and user network status information, and the user playback device information, user playback experience information and user network status information respectively also include a lot of parameter information, that is, the user playback device information includes the type of user playback device, the resolution of the user playback device, the decoding capability of the user playback device and / or the performance of the user playback device, and the performance of the user playback device mainly affects the user playback device information, which includes three main parameters: CPU, memory and GPU. The user playback experience information includes the number of freezes, buffering time, number of playback interruptions, initial buffering time, playback duration ratio and / or number of resolution changes. The user network status information includes bandwidth, jitter and / or packet loss rate. Therefore, based on the continuous function of various types of information in the user feedback information and the weights of various types of information contained in the user feedback information, the first user experience quality score value of the user playback device information, the second user experience quality score value of the user playback experience information and the third user experience quality score value of the user network status information are calculated respectively.

[0032] It is calculated by the following formula: in, Indicates the first user experience quality score value of the user's playback device information. A second user experience quality score value representing user playback experience information, A third user experience quality score value representing user network status information, Indicates the weight of the CPU. represents the weight of memory, Represents the weight of the GPU, represents the continuous function of the CPU, represents a continuous function of memory, represents the continuous function of GPU, Indicates the weight of the number of jams, represents the weight of the buffer time, Indicates the weight of the number of playback interruptions, represents the weight of the initial buffer time, Indicates the weight of the playback duration ratio. represents the weight of the number of resolution changes, A continuous function representing the number of freezes, represents a continuous function of the buffer time, A continuous function representing the number of playback interruptions, represents a continuous function of the initial buffer time, A continuous function representing the playback duration ratio, A continuous function representing the number of resolution changes, represents the bandwidth weight, represents the weight of the jitter, represents the weight of the packet loss rate, represents a continuous function of bandwidth, represents a continuous function of jitter, A continuous function representing the packet loss rate. After calculating the first user experience quality score of the user playback device information, the second user experience quality score of the user playback experience information, and the third user experience quality score of the user network status information, a comprehensive user experience quality score is calculated based on the first user experience quality score of the user playback device information, the second user experience quality score of the user playback experience information, the third user experience quality score of the user network status information, the weight of the user playback device information, the weight of the user playback experience information, the weight of the user network status information, and the content type influencing factor of the video to be transcoded.

[0033] The specific calculation is as follows: in, Represents the comprehensive user experience quality score. Indicates the first user experience quality score value of the user's playback device information. A second user experience quality score value representing user playback experience information, A third user experience quality score value representing user network status information, Indicates the influencing factor of the content type of the video to be transcoded, Indicates the weight of the user's playback device information. Indicates the weight of the user's playback experience information. It can be seen that through the above steps, by introducing the content type influencing factor of the video to be transcoded, the scoring is more in line with the characteristics of different types of videos, improving the accuracy and pertinence of the scoring, and thus being able to fully reflect the quality of user experience.

[0034] For example, if the user playback device information score is 60, the weight is 0.3; the user playback experience information score is 50, the weight is 0.4; the user network status information score is 40, the weight is 0.3. For an ordinary video content, the content type impact factor is 0.6, and the comprehensive user experience quality score is 30. And every time the content type impact factor in this application changes, the user playback device information changes, the user playback experience information is interrupted, and the bandwidth of the user network status information changes by more than 50%, the comprehensive user experience quality score will be recalculated. By recalculating the score value, deviations in the judgment of the user experience are avoided, so that a dynamic evaluation of the user experience quality can be achieved, ensuring that the score can accurately reflect the current user experience status.

[0035] In this embodiment, the three key factors of user playback device information, user playback experience information and user network status information are comprehensively considered to avoid the one-sidedness of relying on only a single factor to evaluate the user experience. By introducing the content type influencing factor of the video to be transcoded, the focus of the score can be adjusted according to the characteristics of the video content, so that the comprehensive user experience quality score value can be calculated quickly and accurately, so as to more comprehensively reflect the user's comprehensive experience and optimize the user's viewing experience. .

[0036] S203: Determine transcoding parameters according to the comprehensive user experience quality score value and a preset score level standard, wherein the transcoding parameters include encoding format, bit rate, resolution and / or frame rate.

[0037] In step S203, after obtaining the comprehensive user experience quality score value, the transcoding parameters can be determined according to the preset score level standard based on the comprehensive user experience quality score value, so as to optimize the transcoding strategy to adapt to the current network conditions and user equipment requirements. Among them, the coding format refers to the way in which the video data is compressed and encoded into a specific format. Common video coding formats include video coding formats: H.264, H.265 (HEVC), VP9, ​​AV1, etc., which are used to compress and decompress video; audio coding formats MP3, AAC, WAV, FLAC, etc., which are used for audio compression, etc. Different coding formats differ in compression efficiency, image quality, decoding complexity, etc. The choice of coding format will affect the storage requirements and playback performance of the video. The bit rate refers to the number of bits transmitted per second in the video data stream, usually in bps (bits per second) or kbps (kilobits per second), Mbps (megabits per second). The higher the bit rate, the better the quality of the video is usually, but the required storage space and network bandwidth are also larger. Conversely, reducing the bit rate can reduce the file size, but may sacrifice a certain image quality. Resolution refers to the number of pixels in a video image, usually expressed in the form of horizontal pixels × vertical pixels (such as 1920×1080). The higher the resolution, the clearer the video image and the richer the details. However, high-resolution videos require more storage space and network bandwidth to transmit. Common video resolutions include 720p (1280×720), 1080p (1920×1080), 4K (3840×2160), etc. Frame rate refers to the number of frames per second (FPS) displayed in the video. The higher the frame rate, the smoother the motion performance of the video. Common frame rates include 24fps (commonly used in movies), 30fps (commonly used in TV broadcasts), 60fps (high frame rate videos), etc. The choice of frame rate will affect the smoothness and motion performance of the video, but it will also increase the storage requirements and bandwidth requirements of the video. These four parameters are interrelated in the video transcoding process and jointly determine the quality and performance of the video. In actual applications, it is necessary to select the appropriate encoding format, bit rate, resolution and frame rate according to specific needs and usage scenarios. For example, for videos that require high definition and smoothness (such as movies and game videos), you can choose a higher resolution and frame rate, as well as an appropriate encoding format and bit rate; for videos that need to save storage space or network bandwidth (such as online videos and mobile videos), you may need to lower the resolution and frame rate, and choose an encoding format with higher compression efficiency and a lower bit rate.

[0038] In an embodiment of the invention, the transcoding parameters are determined according to the comprehensive user experience quality score value and a preset score level standard, including: Predetermining the evaluation score ranges corresponding to the multiple scoring levels included in the scoring standard; Comparing the comprehensive user experience quality score value with each of the evaluation score ranges; Determine the transcoding parameters according to the score level corresponding to the evaluation score range to which the comprehensive user experience quality score value belongs.

[0039] Specifically, the evaluation score ranges corresponding to the multiple rating levels included in the rating level standard are predetermined, and the method for dividing the evaluation score ranges for the above multiple rating levels is not limited. Under normal circumstances, the evaluation score ranges corresponding to continuous rating levels are connected, and the higher the rating level, the larger the range of the corresponding evaluation score, indicating that the user experience quality is better. The multiple rating levels of this application take five rating levels as an example. For example, the rating level is divided into 5 levels, and then the evaluation scores from low to high are divided into ranges of each stage in the order of A, B, C, D and E stages to obtain the evaluation score ranges corresponding to the multiple rating levels. In practical applications, the division process can be specifically divided according to actual conditions, and this application does not make any restrictions on this. Then, combined with the comprehensive user experience quality score value, the comprehensive user experience quality score value is compared one by one with each evaluation score range to determine which evaluation score range the comprehensive user experience quality score value falls into. When the rating level corresponding to the evaluation score range to which the comprehensive user experience quality score value belongs is determined, the transcoding parameters such as the resolution and bit rate of the video are dynamically selected.

[0040] It should be noted that the transcoding parameters can be flexibly adjusted according to actual needs to meet the playback requirements in different scenarios, and this application does not impose any restrictions on this.

[0041] For example, when the preset scoring level standard includes five scoring levels, namely L5 (90-100); L4 (90-80); L3 (80-75); L2 (75-60); L1 (below 60), if the QoE score is L5, the current user scenario can be directly output with the original picture, and the audio and video specifications retain all the characteristics of the original bitstream output; if the QoE score is L4, the encoding format is h265, maintaining 4K clarity, if the user's current content type is a scene with high requirements for smoothness, such as sports events, the bit rate remains unchanged, the original frame rate is kept at least 30fps, and the audio is transcoded to aac; if If the QoE score is L3, the encoding format is h265, maintaining a maximum clarity of 1080p, a maximum bit rate of 20 Mbps, a frame rate of at least 25 fps, and audio is transcoded to aac; if the QoE score is L2, change the encoding format to h264, maintain a maximum clarity of 1080p, a medium bit rate of up to 10 Mbps, a frame rate of at least 25 fps, and audio is transcoded to aac; if the QoE score is L1, change the encoding format to h264, low resolution (720p clarity), a maximum bit rate of more than 5 Mbps, a frame rate of at least 25 fps, and audio is transcoded to aac.

[0042] In this embodiment, by comparing the comprehensive user experience quality score value with each evaluation score range, the score level corresponding to the evaluation score range to which the comprehensive user experience quality score value belongs is determined to be more accurate, so that transcoding parameters are dynamically selected according to the score level corresponding to the evaluation score range to which the comprehensive user experience quality score value belongs, so as to subsequently realize automated and intelligent video transcoding, ensure the playback quality of videos in different network environments and devices, improve user satisfaction and loyalty, save resources such as bandwidth and storage space, and reduce operating costs.

[0043] S204: Transcode the to-be-transcoded video based on the transcoding parameters to generate a target transcoded video.

[0044] In step S204, after dynamically selecting transcoding parameters such as bit rate, frame rate and resolution suitable for the video to be transcoded according to the score level corresponding to the evaluation score range to which the comprehensive user experience quality score value belongs, the video transcoding is dynamically adjusted in the network fluctuation environment using a preset transcoding tool for the video to be transcoded according to the transcoding parameters, thereby generating a target transcoded video.

[0045] It should be noted that the preset transcoding tool can be set according to actual needs, and this implementation does not specifically limit this.

[0046] In this embodiment, by dynamically selecting transcoding parameters suitable for the video to be transcoded according to the score level corresponding to the evaluation score range to which the comprehensive user experience quality score value belongs, it is possible to dynamically adjust the video transcoding by using relatively reasonable transcoding parameters for the video to be transcoded, thereby saving bandwidth during network transmission, increasing the loading speed, and improving the clarity and smoothness of the target transcoded video, ensuring the best effect when playing on a specific device, which is conducive to improving the user's viewing experience.

[0047] In summary, the present invention provides a video transcoding method, apparatus, device and medium, which obtains user feedback information of a video to be transcoded, wherein the user feedback information includes user playback device information, user playback experience information and user network status information, and calculates a comprehensive user experience quality score value based on the user feedback information, the weights of various types of information contained in the user feedback information and the content type influencing factor of the video to be transcoded, and determines transcoding parameters according to the comprehensive user experience quality score value according to a preset scoring level standard, wherein the transcoding parameters include encoding format, bit rate, resolution and / or frame rate, and transcodes the video to be transcoded based on the transcoding parameters to generate a target transcoded video. It can be seen that the present application calculates the comprehensive user experience quality score value based on the user feedback information, the weights of various types of information contained in the user feedback information and the content type influencing factor of the video to be transcoded, and then determines the transcoding parameters according to the preset scoring level standard, so that the video transcoding can be accurately and dynamically adjusted according to the network fluctuation environment in which the playback device is located, thereby improving the user viewing experience.

[0048] See also Figure 3 , Figure 3 is a schematic diagram of the structure of a video transcoding device provided in an embodiment of the present invention. The video transcoding device corresponds to the video transcoding method in the above embodiment. Figure 2 as well as Figure 2 For the convenience of explanation, only the parts related to this embodiment are shown. Figure 3 The video transcoding device 30 includes: an acquisition module 31, a calculation module 32, a determination module 33, and a generation module 34.

[0049] An acquisition module 31 is used to acquire user feedback information of the video to be transcoded, wherein the user feedback information includes user playback device information, user playback experience information and user network status information; A calculation module 32, configured to calculate a comprehensive user experience quality score value based on the user feedback information, the weights of various types of information included in the user feedback information, and the content type influencing factor of the video to be transcoded; A determination module 33 is used to determine transcoding parameters according to the comprehensive user experience quality score value and a preset score level standard, wherein the transcoding parameters include encoding format, bit rate, resolution and / or frame rate; The generating module 34 is used to transcode the to-be-transcoded video based on the transcoding parameters to generate a target transcoded video.

[0050] Optionally, the acquisition module 31 is specifically used for: The user playback device information includes the type of the user playback device, the resolution of the user playback device, the decoding capability of the user playback device and / or the performance of the user playback device.

[0051] Optionally, the acquisition module 31 is further used for: The user playback experience information includes the number of freezes, buffering time, number of playback interruptions, initial buffering time, playback duration ratio and / or number of resolution changes.

[0052] Optionally, the acquisition module 31 is further used for: The user network status information includes bandwidth, jitter and / or packet loss rate.

[0053] Optionally, the calculation module 32 is specifically used for: Based on the continuous function of each type of information in the user feedback information and the weights of each type of information contained in the user feedback information, respectively calculate a first user experience quality score value of the user playback device information, a second user experience quality score value of the user playback experience information, and a third user experience quality score value of the user network status information; A comprehensive user experience quality score value is calculated based on the first user experience quality score value of the user playback device information, the second user experience quality score value of the user playback experience information, the third user experience quality score value of the user network status information, and the content type influencing factor of the video to be transcoded.

[0054] Optionally, the calculation module 32 is further used for: The comprehensive user experience quality score is calculated using the following formula: in, Represents the comprehensive user experience quality score. Indicates the first user experience quality score value of the user's playback device information. A second user experience quality score value representing user playback experience information, A third user experience quality score value representing user network status information, Indicates the influencing factor of the content type of the video to be transcoded, Indicates the weight of the user's playback device information. Indicates the weight of the user's playback experience information. Indicates the weight of the user's network status information.

[0055] Optionally, the determination module 33 is specifically used for: Predetermining the evaluation score ranges corresponding to the multiple scoring levels included in the scoring standard; Comparing the comprehensive user experience quality score value with each of the evaluation score ranges; Determine the transcoding parameters according to the score level corresponding to the evaluation score range to which the comprehensive user experience quality score value belongs.

[0056] It should be noted that the information interaction, execution process and other contents between the above-mentioned units are based on the same concept as the embodiment of the method of the present invention. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0057] Figure 4 Schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. Figure 4 As shown, the electronic device of this embodiment includes: at least one processor ( Figure 4 Only one is shown in the figure), a memory, and a computer program stored in the memory and executable on at least one processor, wherein when the processor executes the computer program, the steps in any of the above-mentioned video transcoding method embodiments are implemented.

[0058] The electronic device may include, but is not limited to, a processor and a memory. It can be understood by those skilled in the art that Figure 4 These are merely examples of electronic devices and do not constitute limitations on the electronic devices. The electronic devices may include more or fewer components than those shown in the figures, or a combination of certain components, or different components. For example, they may also include a network interface, a display screen, and an input system.

[0059] In one embodiment, a computer-readable storage medium is provided. When the instructions in the computer-readable storage medium are executed by a processor in an electronic device, the electronic device can perform the steps of any embodiment of a video transcoding method disclosed in the present invention, which will not be repeated here. The computer-readable storage medium can be non-volatile or volatile.

[0060] The processor may be a CPU, or other general-purpose processors, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0061] The memory includes a readable storage medium, an internal memory, etc., wherein the internal memory may be the memory of an electronic device, and the internal memory provides an environment for the operation of the operating system and computer-readable instructions in the readable storage medium. The readable storage medium may be a hard disk of an electronic device, and in other embodiments, it may also be an external storage device of the electronic device, for example, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (SecureDigital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device. Further, the memory may also include both an internal storage unit of the electronic device and an external storage device. The memory is used to store an operating system, a cooperative application, a boot loader (BootLoader), data, and other programs, such as the program code of a computer program, etc. The memory may also be used to temporarily store data that has been output or is to be output.

[0062] It can be understood by those skilled in the art that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0063] The technical business in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the system is divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here. If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.

[0064] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, it should be understood by those skilled in the art that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features thereof may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.

Claims

1. A video transcoding method, characterized in that: include: Obtaining user feedback information of the video to be transcoded, wherein the user feedback information includes user playback device information, user playback experience information, and user network status information; Calculate a comprehensive user experience quality score based on the user feedback information, the weights of various types of information included in the user feedback information, and the content type influencing factor of the video to be transcoded; Determine transcoding parameters according to the comprehensive user experience quality score value and a preset score level standard, wherein the transcoding parameters include encoding format, bit rate, resolution and / or frame rate; The video to be transcoded is transcoded based on the transcoding parameters to generate a target transcoded video.

2. The video transcoding method according to claim 1, wherein: The user playback device information includes the type of the user playback device, the resolution of the user playback device, the decoding capability of the user playback device and / or the performance of the user playback device.

3. The video transcoding method according to claim 1, wherein: The user playback experience information includes the number of freezes, buffering time, number of playback interruptions, initial buffering time, playback duration ratio and / or number of resolution changes.

4. The video transcoding method according to claim 1, wherein: The user network status information includes bandwidth, jitter and / or packet loss rate.

5. The video transcoding method according to claim 1, wherein: The calculating of a comprehensive user experience quality score value based on the user feedback information, the weights of various types of information included in the user feedback information, and the content type influencing factor of the video to be transcoded includes: Based on the continuous function of each type of information in the user feedback information and the weights of each type of information contained in the user feedback information, respectively calculate a first user experience quality score value of the user playback device information, a second user experience quality score value of the user playback experience information, and a third user experience quality score value of the user network status information; A comprehensive user experience quality score value is calculated based on the first user experience quality score value of the user playback device information, the second user experience quality score value of the user playback experience information, the third user experience quality score value of the user network status information, and the content type influencing factor of the video to be transcoded.

6. The video transcoding method according to claim 5, characterized in that: The comprehensive user experience quality score is calculated using the following formula: in, Represents the comprehensive user experience quality score. Indicates the first user experience quality score value of the user's playback device information. A second user experience quality score value representing user playback experience information, A third user experience quality score value representing user network status information, Indicates the influencing factor of the content type of the video to be transcoded, Indicates the weight of the user's playback device information. Indicates the weight of the user's playback experience information. Indicates the weight of the user's network status information.

7. The video transcoding method according to claim 1, wherein: The step of determining the transcoding parameters according to the comprehensive user experience quality score value and a preset score level standard includes: Predetermining the evaluation score ranges corresponding to the multiple scoring levels included in the scoring standard; Comparing the comprehensive user experience quality score value with each of the evaluation score ranges; Determine the transcoding parameters according to the score level corresponding to the evaluation score range to which the comprehensive user experience quality score value belongs.

8. A video transcoding device, characterized in that: include: An acquisition module, used to acquire user feedback information of the video to be transcoded, wherein the user feedback information includes user playback device information, user playback experience information and user network status information; A calculation module, configured to calculate a comprehensive user experience quality score value based on the user feedback information, the weights of various types of information included in the user feedback information, and the content type influencing factor of the video to be transcoded; A determination module, configured to determine transcoding parameters according to the comprehensive user experience quality score value and a preset scoring level standard, wherein the transcoding parameters include encoding format, bit rate, resolution and / or frame rate; A generating module is used to transcode the to-be-transcoded video based on the transcoding parameters to generate a target transcoded video.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the video transcoding method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the video transcoding method according to any one of claims 1 to 7 is implemented.

Images