Transcoding parameter configuration method and system based on data stream analysis

Abstract

The embodiment of the invention discloses a transcoding parameter configuration method and system based on data stream analysis. According to the technical scheme provided by the embodiment of the invention, the historical watching data of the anchor end is acquired under the condition that the broadcasting of the anchor end is detected, and the initial transcoding parameter of the video source stream of the anchor end is configured according to the historical watching data, so that the video source stream is coded based on the initial transcoding parameter; in the live broadcast process of the anchor side, obtaining real-time watching data corresponding to the anchor side, and performing specified state judgment based on the real-time watching data; and under the condition of determining that the real-time watching data is in the specified state, adjusting a transcoding gear and / or a transcoding operator of the video source stream, and updating a transcoding parameter of the video source stream based on the adjusted transcoding gear and / or transcoding operator, so as to encode the video source stream based on the updated transcoding parameter. By adopting the technical means, the transcoding resources can be saved and the utilization rate of the transcoding resources can be improved while the watching experience of the audience side is ensured, so that the transcoding cost is reduced.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of video encoding technology, and in particular to a method and system for configuring transcoding parameters based on data stream analysis. Background Art

[0002] Currently, in live video streaming scenarios, the original stream (i.e., the video source stream) pushed out by the live broadcast needs to be converted on the server into transcoded streams of different formats, resolutions, and bit rates, and pushed to the viewer end to meet the needs of viewers with different network conditions and different devices. To optimize the user's viewing experience, it is necessary to provide higher-quality transcoded content. However, higher-quality transcoded content will consume more server-side transcoding resources. To conserve server-side transcoding resources, video transcoding will not be performed until the viewer begins watching the live video, reducing invalid transcoding data and thus conserving server-side transcoding resources.

[0003] However, a transcoding mechanism that simply transcodes the video when the audience starts watching the live video is difficult to adapt to the transcoding requirements in different types of scenarios. In the case of a large number of viewers pouring in instantly in the live broadcast scene, transcoding the video at this time will lead to a large transcoding delay, and the transcoding delay will cause a lot of lag, thus affecting the audience's viewing experience. Summary of the Invention

[0004] The embodiments of the present application provide a transcoding parameter configuration method and system based on data stream analysis, which can configure transcoding parameters in combination with real-time viewing data of the audience end. While ensuring the viewing experience of the audience end, it saves transcoding resources, improves the utilization rate of transcoding resources, and solves the technical problem of the incompatibility between video transcoding and the real-time viewing scene of the audience end.

[0005] In a first aspect, an embodiment of the present application provides a method for configuring transcoding parameters based on data stream analysis, comprising:

[0006] When the host side starts broadcasting, the host side obtains the corresponding historical viewer side viewing data, configures the initial transcoding parameters of the host side's video source stream based on the historical viewer side viewing data, and encodes the video source stream based on the initial transcoding parameters;

[0007] During the live broadcast of the anchor, obtain the real-time viewing data of the corresponding audience, and make a specified status judgment based on the real-time viewing data of the audience;

[0008] When it is determined that the real-time audience viewing data is in a specified state, the transcoding gear and / or transcoding operator of the video source stream is adjusted, and the transcoding parameters of the video source stream are updated based on the adjusted transcoding gear and / or transcoding operator to encode the video source stream based on the updated transcoding parameters.

[0009] In a second aspect, an embodiment of the present application provides a transcoding parameter configuration system based on data stream analysis, including:

[0010] An initial configuration module is configured to, upon detecting that a host has started broadcasting, obtain historical viewer viewing data corresponding to the host, configure initial transcoding parameters for the host's video source stream based on the historical viewer viewing data, and encode the video source stream based on the initial transcoding parameters;

[0011] The judgment module is configured to obtain the real-time viewing data of the corresponding audience end during the live broadcast of the anchor end, and perform a specified status judgment based on the real-time viewing data of the audience end;

[0012] The update module is configured to adjust the transcoding gear and / or transcoding operator of the video source stream when it is determined that the real-time audience viewing data is in a specified state, and update the transcoding parameters of the video source stream based on the adjusted transcoding gear and / or transcoding operator to encode the video source stream based on the updated transcoding parameters.

[0013] In a third aspect, an embodiment of the present application provides a transcoding parameter configuration device based on data stream analysis, including:

[0014] memory and one or more processors;

[0015] The memory is configured to store one or more programs;

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the transcoding parameter configuration method based on data stream analysis as described in the first aspect.

[0017] In a fourth aspect, an embodiment of the present application provides a non-volatile computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are executed by a computer processor, they are configured to execute the transcoding parameter configuration method based on data stream analysis as described in the first aspect.

[0018] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes instructions. When the instructions are executed on a computer or processor, the computer or processor executes the transcoding parameter configuration method based on data stream analysis as described in the first aspect.

[0019] The embodiment of the present application detects that the host end has started broadcasting, obtains the historical viewer end viewing data corresponding to the host end, configures the initial transcoding parameters of the video source stream of the host end according to the historical viewer end viewing data, and encodes the video source stream based on the initial transcoding parameters; during the live broadcast process of the host end, obtains the real-time viewer end viewing data of the corresponding host end, and makes a specified state judgment based on the real-time viewer end viewing data; when it is determined that the real-time viewer end viewing data is in a specified state, adjusts the transcoding gear and / or transcoding operator of the video source stream, updates the transcoding parameters of the video source stream based on the adjusted transcoding gear and / or transcoding operator, and encodes the video source stream based on the updated transcoding parameters. By adopting the above-mentioned technical means, the transcoding gear and / or transcoding operator of the video source stream is adjusted in combination with the real-time viewer end viewing data of the host end, so that the transcoding parameters adapt to the real-time viewing state of the host end, while ensuring the viewing experience of the viewer end, saving transcoding resources, improving the utilization rate of transcoding resources, and thus reducing the transcoding cost. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 This is a flow chart of a method for configuring transcoding parameters based on data stream analysis provided by an embodiment of the present application;

[0021] Figure 2 is a flow chart of transcoding parameter configuration in an embodiment of the present application;

[0022] Figure 3 This is a flowchart of initial transcoding parameter configuration in an embodiment of the present application;

[0023] Figure 4 is a flow chart of updating transcoding parameters in an embodiment of the present application;

[0024] Figure 5 This is a flow chart of adjusting the transcoding gear in an embodiment of the present application;

[0025] Figure 6 This is a structural diagram of a transcoding parameter configuration system based on data stream analysis provided by an embodiment of the present application;

[0026] Figure 7 This is a structural diagram of a transcoding parameter configuration device based on data stream analysis provided in an embodiment of the present application. DETAILED DESCRIPTION

[0027] In order to make the purpose, technical solutions and advantages of the present application clearer, the specific embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. It is understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. It should also be noted that, for ease of description, only parts related to the present application, not all of the contents, are shown in the accompanying drawings. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flow charts. Although the flow charts describe each operation (or step) as a sequential process, many of the operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. The process can be terminated when its operation is completed, but can also have additional steps not included in the accompanying drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0028] The transcoding parameter configuration method based on data stream analysis provided in this application aims to adjust the transcoding gear and / or transcoding operator of the video source stream by combining the real-time viewing data of the audience on the host side, so that the transcoding parameters adapt to the real-time viewing status of the host side, while ensuring the viewing experience of the audience side and saving transcoding resources.

[0029] With the development of network technology, live streaming has become more and more popular, attracting more and more users. Providing viewers with smoother, higher-quality content has become a key focus for live streaming application operators. Consequently, higher-quality transcoded content consumes more server-side transcoding resources. Improving transcoded stream quality while conserving server-side resources and increasing cluster resource utilization has become a challenge.

[0030] In relevant transcoding scenarios, a dynamic transcoding mechanism is generally used, that is, transcoding is performed only when the audience starts watching, reducing invalid transcoding data to save server-side transcoding resources. However, in the case of a large influx of viewers in a live broadcast scene, performing video transcoding at this time will result in a large transcoding delay. In addition, special processing may be required for different types of live streams, such as background noise reduction, image sharpening, etc., which will increase the consumption of transcoding resources. Based on this, a transcoding parameter configuration method based on data stream analysis is provided in an embodiment of the present application to solve the technical problem that video transcoding is not compatible with the real-time viewing scene of the audience.

[0031] Example:

[0032] Figure 1A flowchart of a method for configuring transcoding parameters based on data stream analysis, provided in an embodiment of the present application, is provided. The method for configuring transcoding parameters based on data stream analysis provided in this embodiment can be performed by a transcoding parameter configuration device based on data stream analysis. The transcoding parameter configuration device based on data stream analysis can be implemented via software and / or hardware. The transcoding parameter configuration device based on data stream analysis can be composed of two or more physical entities, or a single physical entity. Generally speaking, the transcoding parameter configuration device based on data stream analysis can be a processing device such as a server-side transcoding decision center or a video encoding server.

[0033] The following description is made by taking the transcoding decision center as an example to describe the method for configuring transcoding parameters based on data flow analysis. Figure 1 The transcoding parameter configuration method based on data stream analysis specifically includes:

[0034] S110: When it is detected that the host end has started broadcasting, the historical viewer end viewing data corresponding to the host end is obtained, and the initial transcoding parameters of the video source stream of the host end are configured according to the historical viewer end viewing data, so as to encode the video source stream based on the initial transcoding parameters.

[0035] During the transcoding parameter configuration process, this application implements refined transcoding control based on the viewer's viewing data stream to maximize the utilization of transcoding cluster resources. Specifically, when the host begins a live broadcast, the host's initial transcoding parameters are determined by analyzing historical data. Furthermore, through real-time analysis of the viewer's viewing data during the broadcast, the transcoding parameters are accurately adjusted in real time to ensure a superior viewing experience and more efficient utilization of transcoding cluster resources.

[0036] Reference Figure 2 , a flow chart of the transcoding parameter configuration of this application is provided. For the viewing data generated between the live broadcast end and the audience end, the server collects data through the transcoding decision center. A viewing data analysis module is designed in the transcoding decision center. When the anchor starts broadcasting, the module will pull the anchor's historical broadcast data details from the historical audience viewing data in real time, such as the audience's historical average bandwidth, the average number of viewers at the start of the broadcast, the average viewing popularity at the start of the broadcast, etc. The transcoding parameter decision module receives the parameter information and decides to initialize the transcoding parameters. The event processor will send the transcoding parameters to the transcoding control center. When the anchor end is already in the broadcast state, the viewing data analysis module of the transcoding decision center will analyze the real-time audience viewing data of the live broadcast room and send it to the transcoding control center along the same link.

[0037] The transcoding control center consists of two main modules. The transcoding allocation module is responsible for allocating transcoding services, assigning appropriate transcoding services to broadcasters based on their transcoding request types. The transcoding parameter delivery module is primarily responsible for receiving transcoding parameters from the transcoding decision center and distributing them to the corresponding broadcaster's transcoding service in real time. These parameters are initially delivered when the broadcaster begins broadcasting; as the viewing scene changes, the transcoding parameter delivery module will deliver the corresponding transcoding information to the corresponding transcoding service each time the decision center updates its policy.

[0038] The transcoding service is the actual processor of video transcoding and transcoding decisions. The transcoding task control module is responsible for maintaining basic transcoding task information and scheduling transcoding tasks. It also receives and updates transcoding parameter information transmitted by the transcoding control center. The transcoding module is the actual working module for video stream transcoding, responsible for receiving raw video stream data and dynamically adjusting transcoding based on transcoding parameters. The transmission module is primarily responsible for outputting the transcoded stream and distributing it to the video stream forwarding processing module.

[0039] The video stream transcoding processing module is used to receive the transcoded stream output by the transcoding service and distribute the transcoded stream to the audience on demand.

[0040] Based on the above transcoding parameter configuration process, you can configure corresponding transcoding parameters for video transcoding according to the historical audience viewing data and real-time audience viewing data corresponding to the anchor end, and then make decisions on different transcoding strategies.

[0041] Specifically, refer to Figure 3 When the host begins broadcasting, their device has not yet begun collecting video information or uploading the source stream; it only sends a signaling message to the server. The transcoding decision center receives this notification, and the viewing data analysis module pulls the host's live broadcast data from historical viewer data. The transcoding parameter decision module outputs initial transcoding parameters based on this historical viewer data. These parameters may include information such as the gear to be transcoded and the operator to be transcoded. This information is processed along with the transcoding request by the transcoding control center, which then allocates the transcoding service and issues the transcoding task. The transcoding service begins transcoding based on the gear and operator information in the transcoding parameters.

[0042] Among them, historical audience viewing data includes historical audience numbers and historical viewing popularity;

[0043] Obtain the host's historical viewer viewing data and configure the initial transcoding parameters of the host's video source stream based on the historical viewer viewing data, including:

[0044] Obtain the host's historical audience count. If the historical audience count reaches a set threshold, configure the initial transcoding gear based on the host's historical average downlink bandwidth. If the historical audience count falls below the set threshold, configure the initial transcoding gear based on the basic transcoding gear.

[0045] Get the host's historical viewing popularity. If the historical viewing popularity reaches the set popularity threshold, configure the initial transcoding operator based on the historical viewing popularity. If the historical viewing popularity is lower than the set popularity threshold, set the initial transcoding operator to be empty.

[0046] Configure the initial transcoding parameters of the host's video source stream based on the initial transcoding gear and initial transcoding operator.

[0047] The transcoding parameter configuration of this application mainly includes transcoding gears and transcoding operators. Among them, the transcoding gears are distributed as follows:

[0048] 1. Origin: Source stream position, the original image uploaded by the host;

[0049] 2.UHD: Transcode to ultra-high definition, with a resolution of generally 1080P and a high bit rate;

[0050] 3.FHD: Transcode to ultra-high definition, with a resolution of generally 720P and a high bit rate;

[0051] 4.HD: Transcodes to high-definition mode, with a resolution of 720P / 540P and a medium bit rate.

[0052] 5.SAVE: Transcode to low-definition mode, with a resolution of 540P / 360P and low bit rate.

[0053] 6.Ni_H264: The transcoding reserved position, the resolution is generally 540P / 360P, reserved for users whose devices only support the h264 format.

[0054] The transcoding gear is determined by the uplink conditions of the anchor end. The higher the uplink resolution of the anchor and the higher the bit rate, the more transcoding gears can be switched out. For example: the anchor end with an uplink resolution of 1080P and a bit rate of more than 3M can switch out all transcoding gears; if the uplink resolution of the anchor end is only 540P, it can only switch out transcoding streams of HD and below. The Ni_h264 transcoding gear is a special gear. It transcodes an h264 transcoding stream for the anchor with the uplink hevc encoding format, and is reserved for viewers whose equipment only supports the h264 format. The Ni_H264 and SAVE gears are the transcoding gears required for the audience end to switch gears. The initial transcoding gear can be set to the above two gears. On the basis of the above, this application further combines the historical number of viewers to perform initial transcoding gear settings.

[0055] The transcoding operators include:

[0056] 1. Color operator: Through color evaluation, single-dimensional and multi-dimensional color adjustments are made to the foreground, making the audience's color perception more vivid and the overall picture more three-dimensional, thereby improving the audience's viewing experience.

[0057] 2. Sharpening operator: Adaptively enhances the intensity of different picture contents in a frame of an image through blur estimation, increasing the sharpening intensity of texture areas rich in high-frequency information to make the high-frequency details of the picture clearer, reducing the sharpening intensity of background noise areas, and suppressing noise enhancement.

[0058] 3. Noise reduction operator: removes image noise and enhances image details.

[0059] The transcoding operator evaluates the image through a built-in evaluator and then enables the corresponding feature, which is effective for all users.

[0060] Based on the aforementioned transcoding gears and transcoding operator distribution, when determining initial transcoding parameters in the livestreaming scenario, the server detects whether the livestreamer has started broadcasting. Upon receiving the broadcast notification, the transcoding decision center initiates the initial decision. First, the historical number of viewers in the livestreamer's studio is evaluated. If the number of viewers exceeds a set threshold A, the initial transcoding gear is determined based on the historical average bandwidth of the audience. If the number is below threshold A, only basic transcoding gears, such as Ni_H264 and SAVE, are configured as the initial gears. If the number of viewers exceeds threshold A, additional transcoding gears can be added to the basic Ni_H264 and SAVE gears to ensure a better viewing experience. The initial transcoding gear is determined based on the historical average bandwidth. A mapping between different bandwidth ranges and corresponding transcoding gears is pre-set. Larger bandwidth ranges correspond to more transcoding gears. According to the corresponding number of transcoding gears configured in different bandwidth intervals, the transcoding gear that adapts to the initial state of the anchor end can be queried through the historical average bandwidth, thereby making full use of transcoding resources.

[0061] On the other hand, the historical viewing popularity of the host's live broadcast room is determined. If the historical viewing popularity exceeds the set popularity threshold B, the transcoding operator is evaluated and selected. If it is lower than the set popularity threshold B, the transcoding operator is not used. When evaluating and selecting the transcoding operator, an appropriate transcoding operator can be selected according to the relevant parameters of the live video stream for transcoding parameter configuration, or the transcoding operator can be classified according to revenue evaluation. According to different intervals of historical viewing popularity, the corresponding number of transcoding operators can be selected from them for transcoding parameter configuration. For example, if the viewing popularity at the host side is b, and B1 ≤ b < B2, the noise reduction operator is enabled; if B2 ≤ b < B3, the sharpening operator is additionally enabled; if B3 ≤ b, the color operator is additionally enabled. B1, B2, and B3 correspond to different boundary values of the viewing popularity interval.

[0062] Based on the above operations, the initial transcoding gear and transcoding operator can be jointly determined according to the historical viewing number, historical bandwidth, and historical viewing popularity at the host side, and the initial transcoding parameter configuration of the video stream source at the host side can be completed.

[0063] S120. During the live broadcast at the host side, obtain the real-time viewing data of the audience at the corresponding host side, and perform a specified status judgment based on the real-time viewing data of the audience at the host side.

[0064] Furthermore, after completing the above initial transcoding parameter configuration, the present application obtains the real-time viewing data of the audience at the host side in real time, and performs a specified status judgment according to the real-time viewing data of the audience at the host side. Among them, the specified status indicates that the real-time viewing data of the audience at the host side has changed, and the initial transcoding parameters do not match the current real-time viewing data of the audience at the host side. In order to ensure the user viewing experience while making full use of the transcoding resources, it is necessary to adaptively update the transcoding parameters.

[0065] Among them, referring to Figure 4 , during the live broadcast, the audience at the client has already received the transcoded stream at this time, and the server can collect the bandwidth data of the audience, the number of audience in the live broadcast room, etc. in real time as the real-time viewing data of the audience at the host side.

[0066] Obtain the real-time viewing data of the audience at the live broadcast room through the viewing data analysis module and output it to the transcoding parameter decision module. The transcoding parameter decision module stores the transcoding gear and operator information configured for the current host side, and performs a specified status judgment according to the real-time viewing data of the audience at the host side. When it is determined that the specified status is reached, the transcoding parameter update configuration is triggered. Otherwise, if it is determined that the specified status is not reached, there is no need to update the transcoding parameters.

[0067] It is understandable that when the real-time audience viewing data (such as the real-time number of viewers, the audience downstream bandwidth or the real-time viewing popularity) grows to a certain value, the currently configured transcoding gears and transcoding operators no longer match the user's needs. In order to meet the viewing experience, it is necessary to adaptively increase the transcoding gears and transcoding operators. On the contrary, when the real-time audience viewing data drops to a certain value, the currently configured transcoding gears and transcoding operators may not need to be used, and there may be vacant transcoding resources. At this time, it is necessary to adaptively reduce the transcoding gears and transcoding operators to avoid wasting transcoding resources and reduce transcoding costs. Based on this feature, by setting the corresponding specified state, when the real-time audience viewing data is in the specified state, the update of the transcoding parameters can be triggered.

[0068] S130. When it is determined that the real-time audience viewing data is in a specified state, adjust the transcoding gear and / or transcoding operator of the video source stream, and update the transcoding parameters of the video source stream based on the adjusted transcoding gear and / or transcoding operator to encode the video source stream based on the updated transcoding parameters.

[0069] Furthermore, upon determining that the real-time viewer viewing data is in a specified state, the transcoding parameter decision module updates the transcoding parameters and outputs the updated transcoding parameters. After the transcoding parameters are updated, the control center receives them and distributes them to the transcoding service. The transcoding service receives these transcoding parameters and makes real-time adjustments, increasing or decreasing transcoding gears and transcoding operators, and outputs the transcoded stream. The video stream transcoding module receives the transcoded stream output by the transcoding service and distributes it to viewers, meeting their real-time needs and fully utilizing transcoding resources.

[0070] Optionally, the real-time viewer-end viewing data includes the viewer-end downlink bandwidth and viewing popularity information corresponding to the anchor end;

[0071] When it is determined that the real-time viewer viewing data is in a specified state, the transcoding gear and / or transcoding operator of the video source stream is adjusted, including:

[0072] When it is determined that the downstream bandwidth of the viewer end is in the first specified state, adjusting the transcoding gear of the video source stream; and / or,

[0073] When it is determined that the viewing popularity information is in the second specified state, a transcoding operator of the video source stream is adjusted.

[0074] During the live stream, the transcoding decision center will enter different transcoding gear decision processes based on the increase or decrease in the viewer's downstream bandwidth. If the viewer's downstream bandwidth increases or decreases and reaches the first designated state, the transcoding gear of the video source stream will be adjusted based on the real-time viewer's downstream bandwidth.

[0075] On the other hand, the transcoding decision center enters different decision processes for the transcoding operator based on the increase or decrease in the viewer's viewing interest information. If the viewer's viewing interest information increases or decreases and enters the second specified state, the transcoding operator of the video source stream is adjusted based on the real-time viewer's viewing interest information.

[0076] According to actual needs, the first specified state and the second specified state can be corresponding interval ranges. This application does not impose fixed restrictions on the specified states and will not be elaborated here.

[0077] Optionally, the first specified state includes a bandwidth increase state and a bandwidth decrease state;

[0078] When it is determined that the downstream bandwidth of the viewer end is in the first specified state, adjusting the transcoding gear of the video source stream includes:

[0079] When it is determined that the downstream bandwidth of the viewer end has increased and the selectable transcoding gear in the current transcoding parameters does not match the downstream bandwidth of the viewer end, it is determined that the downstream bandwidth of the viewer end is in a bandwidth increase state, and the transcoding gear corresponding to the downstream bandwidth of the viewer end is increased;

[0080] When it is determined that the downstream bandwidth of the audience end is reduced and reaches the set standard for switching the transcoding gear, it is determined that the downstream bandwidth of the audience end is in a bandwidth reduction state, the transcoding gear of the current video source stream is switched to a lower gear, and when it is determined that the audience end is not using the original transcoding gear of the video source stream, the original transcoding gear is deleted.

[0081] Reference Figure 5 When the viewer's downlink bandwidth increases, the system determines whether the transcoding information contains a viewer-selectable gear that matches the downlink bandwidth. If not, the system determines whether a higher gear is available for transcoding. If not, the system maintains the original transcoding information. If so, the system determines that the bandwidth has increased and increases the transcoding gear accordingly.

[0082] When the viewer's downstream bandwidth decreases and reaches the transcoding gear corresponding to another bandwidth range, that is, when the set transcoding gear switching criteria are met, the viewer's downstream bandwidth is determined to be in a bandwidth reduction state. At this time, the viewer's viewing gear is switched to a lower gear that matches the current bandwidth and a check is made to see if there are still users watching at the original gear. If so, the gear is retained; if not, the gear is deleted and the transcoding gear is changed to reduce the transcoding load.

[0083] On the other hand, when it is determined that the viewing popularity information is in the second specified state, adjusting the transcoding operator of the video source stream includes:

[0084] When the viewing popularity information switches to the corresponding popularity interval, the transcoding operator of the video source stream is configured according to the corresponding popularity interval, and the transcoding operator corresponds to different popularity interval settings.

[0085] By configuring corresponding transcoding operators for different intervals, the viewing needs of each popularity range are met. It is understandable that when viewers enter or exit the live broadcast room, in addition to changes in bandwidth, the viewing popularity of the live broadcast room will also change. During the broadcast process, the transcoding decision center will continuously query the viewing popularity of the current live broadcast room through time polling. When the popularity changes to the corresponding popularity range, the transcoding operator configured according to the popularity range is used, and the transcoding parameters are updated to provide viewers with a better viewing experience.

[0086] Among them, the transcoding operators include noise reduction operators, sharpening operators and color operators;

[0087] Configure the transcoding operator of the video source stream according to the corresponding popularity interval, including:

[0088] At least one transcoding operator for configuring the video source stream is selected from the noise reduction operator, the sharpening operator, and the color operator according to the corresponding heat interval. The larger the heat interval, the more transcoding operators can be configured.

[0089] Referring to the above-mentioned method of initially configuring the transcoding operator, one or more of the noise reduction operator, sharpening operator, and color operator are configured for different heat intervals. The larger the heat interval, the more types of transcoding operators are configured, so as to achieve the effect of adaptively improving the user viewing experience.

[0090] At least one transcoding operator for configuring the video source stream is selected from a noise reduction operator, a sharpening operator, and a color operator according to the corresponding heat interval, including:

[0091] When the heat interval is within the first set heat interval, configuring the noise reduction operator as a transcoding operator of the video source stream;

[0092] When the heat interval is within the second set heat interval, configuring a noise reduction operator and a sharpening operator as transcoding operators of the video source stream;

[0093] When the heat interval is within the third set heat interval, configuring a noise reduction operator, a sharpening operator, and a color operator as transcoding operators of the video source stream;

[0094] The first set heat interval, the second set heat interval and the third set heat interval increase in sequence.

[0095] Referring to the above initial transcoding operator configuration method, it is also assumed that the real-time viewing popularity is b. The first set popularity range is set as B1 ≤ b < B2, the second set popularity range is set as B2 ≤ b < B3, and the third set popularity range is set as B3 ≤ b, where B1, B2, and B3 correspond to different boundary values of the viewing popularity range. If the viewing popularity at the host side satisfies B1 ≤ b < B2, the noise reduction operator is enabled; if the viewing popularity at the host side satisfies B2 ≤ b < B3, on the basis of enabling the noise reduction operator, the sharpening operator is additionally enabled; if the viewing popularity at the host side satisfies B3 ≤ b, on the basis of enabling the noise reduction operator and the sharpening operator, the color operator is additionally enabled.

[0096] In this way, by introducing a dynamic transcoding gear increase / decrease mechanism and a method of evaluating transcoding operators based on popularity, it is possible to effectively control the transcoding delay while providing a high-quality transcoding stream, ensuring the viewing experience and smoothness at the viewer side. Thus, in a live broadcast scenario, it is possible to make full use of the transcoding cluster resources while effectively ensuring the viewer side experience, ensuring that the transcoding service cluster always provides the most efficient transcoding service.

[0097] Exemplarily, based on the above live broadcast transcoding parameter configuration strategy, in a live broadcast scenario, the transcoding decision center at the server side will pre-collect historical viewer-side viewing data of the host, such as the average number of viewers at the start of the broadcast, the popularity at the start of the broadcast, and the average downstream bandwidth of the viewers. When the host starts a live broadcast, the transcoding decision center issues transcoding parameters to the transcoding control center based on historical data, and the transcoding control center allocates live broadcast transcoding tasks to start transcoding. After the official start of the broadcast, when viewers enter the live broadcast room, various transcoding gears are available for selection, which can effectively ensure the viewing smoothness and quality. At the same time, the transcoding decision center will analyze the viewing data in the live broadcast room in real time. When the viewer's network bandwidth increases enough to support a higher bitrate transcoding gear, a transcoding service decision command will be issued to dynamically increase the transcoding gear. Similarly, when a viewer exits the live broadcast room and there is no one watching a certain gear of the live broadcast, after the message is issued by the decision center, it will notify the transcoding service to stop transcoding.

[0098] It can be understood that in a live broadcast scenario, due to the high real-time nature of viewing, generally, a single upstream video stream of the host will be transcoded into multiple video streams to adapt to users with different network conditions and different devices; and in order to provide a higher-quality transcoding stream, different transcoding operators are often used to perform real-time processing on the picture to achieve a better viewing experience. Based on this, the transcoding decision center determines the initial transcoding parameters through the analysis of historical data. Then, through the analysis of real-time viewer data, the transcoding gears and transcoding operators are dynamically increased or decreased, which not only ensures the viewing experience at the viewer side but also maximally saves transcoding resources, improves the resource utilization rate at the server side, and reduces the transcoding cost.

[0099] In the above, when it is detected that the host end has started broadcasting, the historical viewer end viewing data corresponding to the host end is obtained, and the initial transcoding parameters of the video source stream of the host end are configured according to the historical viewer end viewing data, so as to encode the video source stream based on the initial transcoding parameters; during the live broadcast of the host end, the real-time viewer end viewing data of the corresponding host end is obtained, and a specified state judgment is made based on the real-time viewer end viewing data; when it is determined that the real-time viewer end viewing data is in a specified state, the transcoding gear and / or transcoding operator of the video source stream is adjusted, and the transcoding parameters of the video source stream are updated based on the adjusted transcoding gear and / or transcoding operator, so as to encode the video source stream based on the updated transcoding parameters. By adopting the above technical means, the transcoding gear and / or transcoding operator of the video source stream are adjusted in combination with the real-time viewer end viewing data of the host end, so that the transcoding parameters adapt to the real-time viewing state of the host end, while ensuring the viewing experience of the viewer end, transcoding resources are saved, the utilization rate of transcoding resources is improved, and the transcoding cost is reduced.

[0100] Based on the above embodiments, Figure 6 This is a schematic diagram of the structure of a transcoding parameter configuration system based on data stream analysis provided by this application. Figure 6 The transcoding parameter configuration system based on data stream analysis provided in this embodiment specifically includes: an initial configuration module 21, a judgment module 22 and an update module 23.

[0101] The initial configuration module 21 is configured to, when detecting that the host terminal has started broadcasting, obtain the historical viewer terminal viewing data corresponding to the host terminal, configure the initial transcoding parameters of the video source stream of the host terminal according to the historical viewer terminal viewing data, and encode the video source stream based on the initial transcoding parameters;

[0102] The judgment module 22 is configured to obtain the real-time viewer viewing data of the corresponding anchor terminal during the live broadcast of the anchor terminal, and perform a specified status judgment based on the real-time viewer viewing data;

[0103] The update module 23 is configured to adjust the transcoding gear and / or transcoding operator of the video source stream when it is determined that the real-time audience viewing data is in a specified state, and update the transcoding parameters of the video source stream based on the adjusted transcoding gear and / or transcoding operator to encode the video source stream based on the updated transcoding parameters.

[0104] Specifically, the historical audience viewing data includes the number of historical viewers and the historical viewing popularity;

[0105] Obtain the host's historical viewer viewing data and configure the initial transcoding parameters of the host's video source stream based on the historical viewer viewing data, including:

[0106] Obtain the host's historical audience count. If the historical audience count reaches a set threshold, configure the initial transcoding gear based on the host's historical average downlink bandwidth. If the historical audience count falls below the set threshold, configure the initial transcoding gear based on the basic transcoding gear.

[0107] Get the host's historical viewing popularity. If the historical viewing popularity reaches the set popularity threshold, configure the initial transcoding operator based on the historical viewing popularity. If the historical viewing popularity is lower than the set popularity threshold, set the initial transcoding operator to be empty.

[0108] Configure the initial transcoding parameters of the host's video source stream based on the initial transcoding gear and initial transcoding operator.

[0109] Specifically, real-time viewer-side viewing data includes the viewer-side downlink bandwidth and viewing popularity information corresponding to the host side;

[0110] When it is determined that the real-time viewer viewing data is in a specified state, the transcoding gear and / or transcoding operator of the video source stream is adjusted, including:

[0111] When it is determined that the downstream bandwidth of the viewer end is in the first specified state, adjusting the transcoding gear of the video source stream; and / or,

[0112] When it is determined that the viewing popularity information is in the second specified state, a transcoding operator of the video source stream is adjusted.

[0113] The first designated state includes a bandwidth increase state and a bandwidth decrease state;

[0114] When it is determined that the downstream bandwidth of the viewer end is in the first specified state, adjusting the transcoding gear of the video source stream includes:

[0115] When it is determined that the downstream bandwidth of the viewer end has increased and the selectable transcoding gear in the current transcoding parameters does not match the downstream bandwidth of the viewer end, it is determined that the downstream bandwidth of the viewer end is in a bandwidth increase state, and the transcoding gear corresponding to the downstream bandwidth of the viewer end is increased;

[0116] When it is determined that the downstream bandwidth of the audience end is reduced and reaches the set standard for switching the transcoding gear, it is determined that the downstream bandwidth of the audience end is in a bandwidth reduction state, the transcoding gear of the current video source stream is switched to a lower gear, and when it is determined that the audience end is not using the original transcoding gear of the video source stream, the original transcoding gear is deleted.

[0117] When it is determined that the viewing popularity information is in the second specified state, adjusting the transcoding operator of the video source stream includes:

[0118] When the viewing popularity information switches to the corresponding popularity interval, the transcoding operator of the video source stream is configured according to the corresponding popularity interval, and the transcoding operator corresponds to different popularity interval settings.

[0119] Transcoding operators include noise reduction operators, sharpening operators, and color operators;

[0120] Configure the transcoding operator of the video source stream according to the corresponding popularity interval, including:

[0121] At least one transcoding operator for configuring the video source stream is selected from the noise reduction operator, the sharpening operator, and the color operator according to the corresponding heat interval. The larger the heat interval, the more transcoding operators can be configured.

[0122] At least one transcoding operator configured for the video source stream is selected from a noise reduction operator, a sharpening operator, and a color operator according to the corresponding heat interval, including:

[0123] When the heat interval is within the first set heat interval, configuring the noise reduction operator as a transcoding operator of the video source stream;

[0124] When the heat interval is within the second set heat interval, configuring a noise reduction operator and a sharpening operator as transcoding operators of the video source stream;

[0125] When the heat interval is within the third set heat interval, configuring a noise reduction operator, a sharpening operator, and a color operator as transcoding operators of the video source stream;

[0126] The first set heat interval, the second set heat interval and the third set heat interval increase in sequence.

[0127] In the above, when it is detected that the host end has started broadcasting, the historical viewer end viewing data corresponding to the host end is obtained, and the initial transcoding parameters of the video source stream of the host end are configured according to the historical viewer end viewing data, so as to encode the video source stream based on the initial transcoding parameters; during the live broadcast of the host end, the real-time viewer end viewing data of the corresponding host end is obtained, and a specified state judgment is made based on the real-time viewer end viewing data; when it is determined that the real-time viewer end viewing data is in a specified state, the transcoding gear and / or transcoding operator of the video source stream is adjusted, and the transcoding parameters of the video source stream are updated based on the adjusted transcoding gear and / or transcoding operator, so as to encode the video source stream based on the updated transcoding parameters. By adopting the above technical means, the transcoding gear and / or transcoding operator of the video source stream are adjusted in combination with the real-time viewer end viewing data of the host end, so that the transcoding parameters adapt to the real-time viewing state of the host end, while ensuring the viewing experience of the viewer end, transcoding resources are saved, the utilization rate of transcoding resources is improved, and the transcoding cost is reduced.

[0128] The transcoding parameter configuration system based on data stream analysis provided in the embodiment of the present application can be configured to execute the transcoding parameter configuration method based on data stream analysis provided in the above embodiment, and has corresponding functions and beneficial effects.

[0129] Based on the above practical example, the embodiment of the present application also provides a transcoding parameter configuration device based on data flow analysis, referring to Figure 7 The transcoding parameter configuration device based on data stream analysis includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The memory, as a computer-readable storage medium, can be configured to store software programs, computer executable programs, and modules, such as program instructions / modules corresponding to the transcoding parameter configuration method based on data stream analysis described in any embodiment of the present application (for example, the initial configuration module, judgment module, and update module in the transcoding parameter configuration system based on data stream analysis). The communication module is configured to transmit data. The processor executes the software programs, instructions, and modules stored in the memory to execute various functional applications and data processing of the device, thereby implementing the above-mentioned transcoding parameter configuration method based on data stream analysis. The input device can be configured to receive input digital or character information and generate key signal input related to user settings and function control of the device. The output device can include a display device such as a display screen. The transcoding parameter configuration device based on data stream analysis provided above can be configured to execute the transcoding parameter configuration method based on data stream analysis provided in the above-mentioned embodiments, and has corresponding functions and beneficial effects.

[0130] Based on the above embodiments, an embodiment of the present application further provides a non-volatile computer-readable storage medium, wherein the non-volatile computer-readable storage medium stores computer-executable instructions. When the computer-executable instructions are executed by a computer processor, the computer-executable instructions are configured to execute a transcoding parameter configuration method based on data stream analysis. The storage medium can be any of various types of memory devices or storage devices. Of course, the non-volatile computer-readable storage medium provided in an embodiment of the present application, whose computer-executable instructions are not limited to the transcoding parameter configuration method based on data stream analysis as described above, can also execute related operations in the transcoding parameter configuration method based on data stream analysis provided in any embodiment of the present application.

[0131] Based on the above embodiments, the embodiments of the present application also provide a computer program product. The essence of the technical solution of the present application or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product. The computer program product is stored in a storage medium and includes a number of instructions for enabling a computer device, a mobile terminal or a processor therein to execute all or part of the steps of the transcoding parameter configuration method based on data stream analysis described in each embodiment of the present application.

Claims

1. A transcoding parameter configuration method based on data stream analysis, characterized in that: include: When it is detected that the host end has started broadcasting, the historical viewer end viewing data corresponding to the host end is obtained, and the initial transcoding parameters of the video source stream of the host end are configured according to the historical viewer end viewing data, so as to encode the video source stream based on the initial transcoding parameters; During the live broadcast of the anchor terminal, real-time viewing data of the audience terminal corresponding to the anchor terminal is obtained, and a specified state judgment is performed based on the real-time viewing data of the audience terminal; When it is determined that the real-time audience viewing data is in a specified state, the transcoding gear and / or transcoding operator of the video source stream is adjusted, and the transcoding parameters of the video source stream are updated based on the adjusted transcoding gear and / or the transcoding operator, so as to encode the video source stream based on the updated transcoding parameters.

2. The method for configuring transcoding parameters based on data stream analysis according to claim 1, characterized in that: The real-time audience viewing data includes the audience downlink bandwidth and viewing popularity information corresponding to the anchor end; When determining that the real-time audience viewing data is in a specified state, adjusting the transcoding gear and / or transcoding operator of the video source stream includes: When determining that the downlink bandwidth of the viewer end is in the first specified state, adjusting the transcoding gear of the video source stream; and / or, When it is determined that the viewing popularity information is in a second specified state, a transcoding operator of the video source stream is adjusted.

3. The method for configuring transcoding parameters based on data stream analysis according to claim 2, characterized in that: The first specified state includes a bandwidth increase state and a bandwidth decrease state; When determining that the downstream bandwidth of the viewer end is in the first specified state, adjusting the transcoding gear of the video source stream includes: When it is determined that the downstream bandwidth of the viewer end increases and the optional transcoding gear in the current transcoding parameters does not match the downstream bandwidth of the viewer end, it is determined that the downstream bandwidth of the viewer end is in a bandwidth increase state, and the transcoding gear corresponding to the downstream bandwidth of the viewer end is increased; When it is determined that the downstream bandwidth of the audience end is reduced and reaches the set standard for switching the transcoding gear, it is determined that the downstream bandwidth of the audience end is in a bandwidth reduction state, the transcoding gear of the current video source stream is switched to a lower gear, and when it is determined that the audience end is not using the original transcoding gear of the video source stream, the original transcoding gear is deleted.

4. The method for configuring transcoding parameters based on data stream analysis according to claim 2, characterized in that: When it is determined that the viewing popularity information is in the second specified state, adjusting the transcoding operator of the video source stream includes: When the viewing heat information is switched to a corresponding heat interval, a transcoding operator of the video source stream is configured according to the corresponding heat interval, and the transcoding operator is set corresponding to different heat intervals.

5. The method for configuring transcoding parameters based on data stream analysis according to claim 4, characterized in that: The transcoding operator includes a noise reduction operator, a sharpening operator and a color operator; The configuring the transcoding operator of the video source stream according to the corresponding heat interval includes: At least one transcoding operator for configuring the video source stream is selected from the denoising operator, the sharpening operator and the color operator according to the corresponding heat interval, and the larger the heat interval is, the more the number of configurations of the transcoding operator is.

6. The method for configuring transcoding parameters based on data stream analysis according to claim 5, characterized in that: The selecting at least one transcoding operator for configuring the video source stream from the noise reduction operator, the sharpening operator and the color operator according to the corresponding heat interval includes: When the heat interval is in a first set heat interval, configuring the noise reduction operator as a transcoding operator of the video source stream; When the heat interval is in a second set heat interval, configuring the noise reduction operator and the sharpening operator as transcoding operators of the video source stream; When the heat interval is in a third set heat interval, configuring the noise reduction operator, the sharpening operator and the color operator as transcoding operators of the video source stream; The first set heat interval, the second set heat interval and the third set heat interval increase in sequence.

7. The method for configuring transcoding parameters based on data stream analysis according to any one of claims 1 to 6, characterized in that: The historical audience viewing data includes the historical audience number and historical viewing popularity; The acquiring of historical viewer-end viewing data corresponding to the host end, and configuring initial transcoding parameters of the video source stream of the host end according to the historical viewer-end viewing data, includes: Acquire the historical number of viewers of the anchor end, and when the historical number of viewers reaches a set number threshold, configure the initial transcoding gear based on the historical average downlink bandwidth corresponding to the anchor end; when the historical number of viewers is lower than the set number threshold, configure the initial transcoding gear based on the basic transcoding gear; Obtain the historical viewing popularity of the anchor, and when the historical viewing popularity reaches a set popularity threshold, configure an initial transcoding operator based on the historical viewing popularity, and when the historical viewing popularity is lower than the set popularity threshold, configure the initial transcoding operator to be empty; The initial transcoding parameters of the video source stream of the anchor end are configured based on the initial transcoding gear and the initial transcoding operator.

8. A transcoding parameter configuration system based on data stream analysis, characterized in that: include: The initial configuration module is configured to obtain historical viewer viewing data corresponding to the host end when detecting that the host end has started broadcasting, and configure the initial transcoding parameters of the video source stream of the host end according to the historical viewer viewing data, so as to encode the video source stream based on the initial transcoding parameters; A judgment module, configured to obtain real-time viewer viewing data corresponding to the anchor terminal during the live broadcast of the anchor terminal, and perform a specified state judgment based on the real-time viewer viewing data; The update module is configured to adjust the transcoding gear and / or transcoding operator of the video source stream when determining that the real-time audience viewing data is in a specified state, and update the transcoding parameters of the video source stream based on the adjusted transcoding gear and / or the transcoding operator to encode the video source stream based on the updated transcoding parameters.

9. A transcoding parameter configuration device based on data stream analysis, characterized in that: include: memory and one or more processors; The memory is configured to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the transcoding parameter configuration method based on data stream analysis as described in any one of claims 1-7.

10. A non-volatile computer-readable storage medium, characterized in that: The non-volatile computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed by a computer processor, they are configured to execute the transcoding parameter configuration method based on data stream analysis according to any one of claims 1-7.

11. A computer program product, characterized in that The computer program product includes instructions, and when the instructions are executed on a computer or a processor, the computer or the processor executes the transcoding parameter configuration method based on data stream analysis as described in any one of claims 1-7.

Images