Video dynamic transmission code rate adjustment method based on soft terminal bandwidth perception

Abstract

The invention discloses a video dynamic transmission code rate adjustment method based on soft terminal bandwidth perception, and the method comprises the steps: obtaining the transmission bandwidth, the packet loss rate and the delay jitter of a detection data packet in real time during transmission, carrying out the transmission abnormality recognition according to the transmission bandwidth, the packet loss rate and the delay jitter, and carrying out the transmission abnormality recognition. The method comprises the steps of obtaining a bandwidth state level, carrying out code rate matching according to the bandwidth state level and a multi-dimensional key factor to obtain a target code rate, and completing seamless switching of the code rate in cooperation with a server according to the target code rate. According to the invention, the video lagging rate can be reduced, and the bandwidth utilization rate can be improved, so that the bandwidth can be matched with the optimal image quality in different use scenes.

Description

Technical Field

[0001] This invention relates to the technical field of transmission bitrate adjustment, and in particular to a method for dynamic video transmission bitrate adjustment based on soft terminal bandwidth awareness. Background Technology

[0002] Currently, during peak evening hours, many households use multiple devices simultaneously on the internet, such as watching videos on mobile phones, downloading files on computers, and syncing data with smart home devices. This leads to competition for bandwidth resources, causing excessive load on base stations, which in turn results in slower actual network speeds and negatively impacts the user experience. Summary of the Invention

[0003] This invention aims to address at least one of the technical problems existing in the prior art. To this end, this invention proposes a video dynamic transmission bitrate adjustment method based on soft terminal bandwidth awareness, which can reduce video stuttering rate, improve bandwidth utilization, and ensure that bandwidth can match optimal image quality under different usage scenarios.

[0004] The present invention also proposes a video dynamic transmission bitrate adjustment device based on soft terminal bandwidth awareness.

[0005] This invention also proposes a video dynamic transmission bitrate adjustment device based on soft terminal bandwidth awareness.

[0006] The present invention also proposes a computer-readable storage medium.

[0007] In a first aspect, one embodiment of the present invention provides a method for adjusting the dynamic transmission bitrate of video based on soft terminal bandwidth awareness, including:

[0008] Real-time acquisition of transmission bandwidth, packet loss rate, and latency jitter of detection data packets during transmission;

[0009] Based on the transmission bandwidth, the packet loss rate, and the latency jitter, transmission anomalies are identified to obtain the bandwidth status level.

[0010] The target bitrate is obtained by matching the bitrate based on the bandwidth status level and multi-dimensional key factors.

[0011] The server will work in conjunction with the target bitrate to achieve seamless bitrate switching.

[0012] The video dynamic transmission bitrate adjustment method of this invention has at least the following beneficial effects: After the soft terminal sends a detection data packet to the gateway, it receives the data returned by the gateway and calculates the transmission bandwidth, packet loss rate, and latency jitter corresponding to the transmission of the detection data packet based on the data. This provides accurate and stable basic data for bitrate decision-making, which is a prerequisite for decision-making. Transmission anomaly identification is performed based on transmission bandwidth, packet loss rate, and latency jitter to obtain the bandwidth status level. "Semantic interpretation" of transmission bandwidth, packet loss rate, and latency jitter is achieved, defining the decision framework for subsequent bitrate matching. After calculating the optimal scheme based on the bandwidth status level and multi-dimensional key factors, the target bitrate is obtained, achieving a stable and suitable target bitrate selection that combines network status and scenario requirements. The target bitrate is transmitted to the server, and seamless bitrate switching is completed with the server's assistance, thereby improving the user experience. The overall solution consists of a full-link design of "bandwidth awareness - hierarchical classification - multi-dimensional matching - seamless switching," adapting to the core requirements of 4K / 8K ultra-high-definition transmission and complex network environments. It can reduce video stuttering rate, improve bandwidth utilization, and ensure that bandwidth can match optimal image quality in different usage scenarios.

[0013] According to other embodiments of the video dynamic transmission bitrate adjustment method of the present invention, the real-time acquisition of the transmission bandwidth, packet loss rate and latency jitter of the detected data packets during transmission includes:

[0014] The transmission bandwidth is obtained by calculating the bandwidth based on the total size of the data packets received by the gateway and the reception time of the data packets received by the gateway;

[0015] The packet loss rate is obtained by calculating the total number of data packets sent by the soft terminal and the total number of data packets received by the gateway.

[0016] The delay jitter is obtained by calculating the delay based on the sending time and receiving time of the data packet sent by the soft terminal.

[0017] According to other embodiments of the video dynamic transmission bitrate adjustment method of the present invention, the step of identifying transmission anomalies based on the transmission bandwidth, the packet loss rate, and the latency jitter to obtain a bandwidth status level includes:

[0018] The transmission bandwidth level is obtained by comparing the transmission bandwidth with the transmission bandwidth threshold.

[0019] The packet loss rate is compared with the packet loss rate threshold to obtain the packet loss rate level;

[0020] The delay jitter level is obtained by comparing the delay jitter with the delay jitter threshold.

[0021] The bandwidth status level is determined based on the transmission bandwidth level, the packet loss rate level, and the latency jitter level.

[0022] According to other embodiments of the video dynamic transmission bitrate adjustment method of the present invention, the step of performing bitrate matching based on the bandwidth status level and multi-dimensional key factors to obtain the target bitrate includes:

[0023] The weights of the key factors in each dimension are determined based on the bandwidth status level, thus obtaining the key factor weights.

[0024] The score corresponding to the key factor is calculated based on the weight of the key factor to obtain the key factor score;

[0025] The target bitrate is obtained by selecting the corresponding bitrate based on the key factor score and the bandwidth status level.

[0026] According to other embodiments of the video dynamic transmission bitrate adjustment method of the present invention, the step of selecting the corresponding bitrate based on the key factor score and the bandwidth status level to obtain the target bitrate includes:

[0027] The total score of each key factor is calculated based on the scores of the key factors to obtain the total score of the key factors.

[0028] The target bitrate is determined by comparing the total score of the key factors, the bandwidth status level, and the preset filtering rules.

[0029] According to other embodiments of the video dynamic transmission bitrate adjustment method of the present invention, the step of seamlessly switching bitrates in coordination with the server based on the target bitrate includes:

[0030] After the server receives the switching request, it receives the target bitrate stream corresponding to the target bitrate pushed by the server and caches the target bitrate stream;

[0031] After the server synchronizes the target bitrate in real time, and when it detects that the current bitrate stream is playing to the preset frame of the target bitrate, the decoding channel is switched to the preset frame corresponding to the target bitrate stream.

[0032] According to other embodiments of the video dynamic transmission bitrate adjustment method of the present invention, after the bitrate switching is completed, the video dynamic transmission bitrate adjustment method further includes:

[0033] Real-time detection and reporting of playback status; wherein, the playback status includes frame error rate and number of stutters;

[0034] If the frame error rate is greater than the error rate threshold or the number of stutters is greater than the number of stutters threshold, a switching failure notification is sent to the server, and the decoding channel is reverted to the original bitrate stream for playback;

[0035] If the frame error rate is less than the error rate threshold and the number of stutters is less than the stutter count threshold within a preset time, a handover success notification is sent to the server.

[0036] Secondly, one embodiment of the present invention provides a video dynamic transmission bitrate adjustment device based on soft terminal bandwidth awareness, comprising:

[0037] The data acquisition module is used to acquire the transmission bandwidth, packet loss rate, and latency jitter of the detection data packets in real time during transmission.

[0038] A transmission anomaly identification module is used to identify transmission anomalies based on the transmission bandwidth, the packet loss rate, and the latency jitter, and to obtain the bandwidth status level.

[0039] The bitrate matching module is used to perform bitrate matching based on the bandwidth status level and multi-dimensional key factors to obtain the target bitrate.

[0040] The bitrate switching module is used to work with the server to seamlessly switch bitrates according to the target bitrate.

[0041] Thirdly, one embodiment of the present invention provides a video dynamic transmission bitrate adjustment device based on soft terminal bandwidth awareness, comprising:

[0042] At least one processor, and,

[0043] A memory communicatively connected to the at least one processor; wherein,

[0044] The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform the video dynamic transmission bitrate adjustment method as described in the first aspect.

[0045] Fourthly, one embodiment of the present invention provides a computer-readable storage medium storing computer-executable instructions for causing a computer to perform the video dynamic transmission bitrate adjustment method as described in the first aspect.

[0046] Other features and advantages of this application will be set forth in the following description and will be apparent in part from the description or may be learned by practicing the application. The objectives and other advantages of this application may be realized and obtained by means of the structures particularly pointed out in the description and the accompanying drawings. Attached Figure Description

[0047] Figure 1 This is a schematic flowchart of a specific embodiment of the video dynamic transmission bitrate adjustment method in this invention.

[0048] Figure 2 yes Figure 1 A schematic diagram of a specific embodiment of step 101;

[0049] Figure 3 yes Figure 1 A schematic diagram of a specific embodiment of step 102;

[0050] Figure 4 yes Figure 1 A schematic diagram of a specific embodiment of step 103;

[0051] Figure 5 yes Figure 4 A schematic flowchart of a specific embodiment of step 403;

[0052] Figure 6 yes Figure 1 A schematic diagram of a specific embodiment of step 104;

[0053] Figure 7 This is a schematic flowchart of another specific embodiment of the video dynamic transmission bitrate adjustment method in this invention;

[0054] Figure 8 This is a block diagram of a specific embodiment of the video dynamic transmission bitrate adjustment device in this invention.

[0055] Explanation of reference numerals in the attached figures:

[0056] Data acquisition module 801, transmission anomaly identification module 802, bitrate matching module 803, bitrate switching module 804. Detailed Implementation

[0057] The following will describe the concept and technical effects of the present invention clearly and completely with reference to the embodiments, so as to fully understand the purpose, features and effects of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative effort are all within the scope of protection of the present invention.

[0058] In the description of this invention, if directional descriptions are involved, such as "up," "down," "front," "back," "left," "right," etc., indicating the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, it is only for the convenience of describing the invention and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the invention. If a feature is referred to as "set," "fixed," "connected," or "installed" on another feature, it can be directly set, fixed, or connected to the other feature, or it can be indirectly set, fixed, connected, or installed on the other feature.

[0059] In the description of the embodiments of the present invention, the term "several" means one or more, and the term "multiple" means two or more. The terms "greater than," "less than," and "exceeding" should be understood as excluding the stated number, while the terms "above," "below," and "within" should be understood as including the stated number. The terms "first" and "second" should be understood as distinguishing technical features, and not as indicating or implying relative importance, the number of indicated technical features, or the order of the indicated technical features.

[0060] Currently, during peak evening hours, many households use multiple devices simultaneously on the internet, such as watching videos on mobile phones, downloading files on computers, and syncing data with smart home devices. This leads to competition for bandwidth resources, causing excessive load on base stations, which in turn results in slower actual network speeds and negatively impacts the user experience.

[0061] This invention aims to address at least one of the technical problems existing in the prior art. To this end, this invention proposes a video dynamic transmission bitrate adjustment method based on soft terminal bandwidth awareness, which can reduce video stuttering rate, improve bandwidth utilization, and ensure that bandwidth can match optimal image quality under different usage scenarios.

[0062] Reference Figure 1 , Figure 1 A flowchart illustrating a video dynamic transmission bitrate adjustment method according to an embodiment of the present invention is shown. In some embodiments, the video dynamic transmission bitrate adjustment method may include, but is not limited to, steps 101 to 104:

[0063] Step 101: Real-time acquisition of the transmission bandwidth, packet loss rate, and latency jitter of the detection data packets during transmission.

[0064] In step 101, the current stable available bandwidth and link quality are obtained to provide data support for subsequent classification. Specifically, detection data packets are sent according to a state-adaptive sampling strategy. For example: Normal state—no lag, packet loss rate <2%, one set of detection data packets is sent every 100ms, each set including 5 consecutive detection data packets. Abnormal state—packet loss rate 2%-5% or jitter >20ms, one set of detection data packets is sent every 50ms, each set including 8 consecutive detection data packets, improving detection sensitivity and responding to bandwidth fluctuations. The data packet identifier carries three types of key information: sending timestamp, soft terminal ID, video stream identifier, and also includes a data packet sequence number to avoid duplicate statistics and a checksum to verify data integrity. The detection data packet type uses the UDP protocol, eliminating TCP three-way handshake time, resulting in low detection latency. The detection data packet size is a lightweight 1KB, and the transmission time of a single packet is negligible, not affecting the video stream.

[0065] Step 102: Identify transmission anomalies based on transmission bandwidth, packet loss rate, and latency jitter to obtain the bandwidth status level.

[0066] In step 102, the bandwidth status level is classified according to a preset threshold, including stable availability, fluctuating availability, and unavailable status. The stable availability state uses low-frequency, low-number-sample-per-second approach, with the sampling bandwidth ≤ 5% of the current bit rate, avoiding the occupation of core transmission resources. The fluctuating availability state uses medium-frequency, medium-number-sample-per-second approach, ensuring tracking of bandwidth fluctuations without excessive bandwidth consumption. The unavailable state uses high-frequency, high-number-sample-per-second approach, improving detection sensitivity, quickly capturing bandwidth recovery signals, and avoiding prolonged stagnation at low bit rates. This upgrades bandwidth detection from a fixed strategy to an adaptive strategy, eliminating the need for continuously maintaining high-frequency sampling to cope with extreme situations and preventing the loss of critical bandwidth changes due to sparse sampling. It is particularly suitable for complex network environments such as peak-hour bandwidth congestion and sudden signal changes in outdoor scenarios.

[0067] Step 103: Perform bitrate matching based on bandwidth status level and multi-dimensional key factors to obtain the target bitrate.

[0068] In step 103, the weights of key factors across multiple dimensions are dynamically adjusted based on the bandwidth status level.

[0069] Step 104: Work with the server to seamlessly switch bitrates according to the target bitrate.

[0070] In steps 101 to 104 of this embodiment, after the soft terminal sends a detection data packet to the gateway, it receives the data returned by the gateway and calculates the transmission bandwidth, packet loss rate, and latency jitter corresponding to the transmission of the detection data packet based on the data. This provides accurate and stable basic data for bitrate decision-making and is a prerequisite for the decision. Transmission anomaly identification is performed based on transmission bandwidth, packet loss rate, and latency jitter to obtain the bandwidth status level. "Semantic interpretation" of transmission bandwidth, packet loss rate, and latency jitter is achieved, defining the decision framework for subsequent bitrate matching. After calculating the optimal scheme based on the bandwidth status level and multi-dimensional key factors, the target bitrate is obtained, achieving a stable and suitable target bitrate selection that combines network status and scenario requirements. The target bitrate is transmitted to the server, and seamless bitrate switching is completed with the server's assistance, thereby improving the user experience. The overall solution consists of a full-link design of "bandwidth awareness - hierarchical classification - multi-dimensional matching - seamless switching," adapting to the core requirements of 4K / 8K ultra-high-definition transmission and complex network environments. It can reduce video stuttering rate, improve bandwidth utilization, and ensure that bandwidth can match optimal image quality in different usage scenarios.

[0071] Reference Figure 2 , Figure 2 A flowchart illustrating the video dynamic transmission bitrate adjustment method in an embodiment of the present invention is shown. In some embodiments, the real-time acquisition of the transmission bandwidth, packet loss rate, and latency jitter of the detection data packets during transmission includes, but is not limited to, steps 201 to 203:

[0072] Step 201: Calculate the bandwidth based on the total size of the data packets received by the gateway and the reception time of the data packets received by the gateway, and obtain the transmission bandwidth.

[0073] In step 201, the receiver receives the timestamp and packet loss flag returned by the gateway. Only valid packets are counted, and the instantaneous bandwidth is calculated using the following formula: Instantaneous bandwidth = (Total size of valid packets × 8) ÷ (Reception time of the last valid packet - Transmission time of the first valid packet); where valid packets include data packets that are not lost, have a timeout ≤ 100ms, and have correct checksums. Finally, a 2-second sliding window filter is used to buffer 20 sets of instantaneous bandwidth. After removing the maximum and minimum values, the average is calculated to obtain a stable transmission bandwidth.

[0074] Step 202: Calculate the packet loss rate based on the total number of data packets sent by the soft terminal and the total number of data packets received by the gateway.

[0075] In step 202, the packet loss rate is calculated using the following formula: Packet loss rate = (Total number of packets sent - Total number of valid packets received) ÷ Total number of packets sent × 100%.

[0076] Step 203: Calculate the delay based on the sending and receiving times of the data packets sent by the soft terminal to obtain the delay jitter.

[0077] In step 203, the delay jitter is calculated using the following formula: Delay jitter = "Maximum transmission delay - Minimum transmission delay in the same packet group".

[0078] Reference Figure 3 , Figure 3 A flowchart illustrating the video dynamic transmission bitrate adjustment method in an embodiment of the present invention is shown. In some embodiments, transmission anomaly identification is performed based on transmission bandwidth, packet loss rate, and latency jitter to obtain the bandwidth status level, specifically including but not limited to steps 301 to 304:

[0079] Step 301: Compare the transmission bandwidth with the transmission bandwidth threshold to obtain the transmission bandwidth level.

[0080] In step 301, the transmission bandwidth thresholds include 10% and 20%. When the transmission bandwidth is less than 10%, it is the first transmission bandwidth level; when the transmission bandwidth is between 10% and 20%, it is the second transmission bandwidth level; and when the transmission bandwidth is greater than 20%, it is the third transmission bandwidth level.

[0081] Step 302: Compare the packet loss rate with the packet loss rate threshold to obtain the packet loss rate level.

[0082] In step 302, the packet loss rate thresholds include 3% and 5%. A packet loss rate of less than 3% is the first packet loss rate level, a packet loss rate between 3% and 5% is the second packet loss rate level, and a packet loss rate greater than 5% is the third packet loss rate level.

[0083] Step 303: The delay jitter level is obtained by comparing the delay jitter with the delay jitter threshold.

[0084] In step 303, the delay jitter thresholds include 20ms and 30ms. When the delay jitter is less than 20ms, it is the first delay jitter level; when the delay jitter is in the range of 20ms to 30ms, it is the second delay jitter level; and when the delay jitter is greater than 30ms, it is the third delay jitter level.

[0085] Step 304: Determine the bandwidth status level based on the transmission bandwidth level, packet loss rate level, and delay jitter level.

[0086] In step 304, for example: when the bandwidth status level is stable and available, the stable transmission bandwidth fluctuation is ≤10%, the packet loss rate is ≤3%, and the latency jitter is ≤20ms. When the bandwidth status level is fluctuating and available, the stable transmission bandwidth fluctuation is 10%-20%, the packet loss rate is 3%-5%, and the latency jitter is 20ms-30ms. When the bandwidth status level is unavailable, the stable transmission bandwidth fluctuation is >20%, the packet loss rate is >5%, and the jitter is >30ms, or there is a sudden drop in bandwidth or network outage.

[0087] Reference Figure 4 , Figure 4 A flowchart illustrating the video dynamic transmission bitrate adjustment method in an embodiment of the present invention is shown. In some embodiments, bitrate matching is performed based on bandwidth status level and multi-dimensional key factors to obtain the target bitrate, specifically including but not limited to steps 401 to 403:

[0088] Step 401: Determine the weights of the key factors for each dimension based on the bandwidth status level to obtain the key factor weights.

[0089] In step 401, the key factors include bandwidth matching score, content type, terminal type, and region quality. For example: when the bandwidth status level is stable and available, the key factor weight for bandwidth matching score is 30%, the key factor weight for content type is 40%, the key factor weight for terminal type is 30%, and the key factor weight for region quality is 20%. When the bandwidth status level is fluctuating and available, the key factor weight for bandwidth matching score is 60%, the key factor weight for content type is 20%, the key factor weight for terminal type is 10%, and the key factor weight for region quality is 10%. When the bandwidth status level is unavailable, only the key factor weight for bandwidth matching score is retained (100%), and the key factors for other dimensions are invalid.

[0090] For example, bandwidth matching scores include: 100 points for stable transmission bandwidth falling within a certain threshold range; points are deducted proportionally for exceeding this range. For instance, 12Mbps within the 4K range would receive 100 points. Content type scores include: 100 points for on-demand movies prioritizing picture quality, and 80 points for live sports events prioritizing smoothness. Terminal type scores include: 100 points for large-screen TVs and 70 points for small-screen mobile devices. Regional quality scores include: 100 points for stable areas, 60 points for congested areas, and 40 points for weak network areas. Furthermore, this application does not specifically limit the corresponding scores for key factors.

[0091] Step 402: Calculate the score corresponding to the key factor based on the key factor weight to obtain the key factor score.

[0092] In step 402, the key factor score for a stable availability state is calculated as follows: 30% bandwidth matching score + 40% content type + 30% terminal type + 20% region quality. The key factor score for a fluctuating availability state is calculated as follows: 60% bandwidth matching score + 20% content type + 10% terminal type + 10% region quality. The key factor score for an unavailable state is calculated as follows: bandwidth matching score.

[0093] Step 403: Select the appropriate bitrate based on the key factor score and bandwidth status level to obtain the target bitrate.

[0094] It should be noted that, specifically, the soft terminal sends the target bitrate tier request to the server. The server verifies whether the tier has been pre-generated and whether the current CDN node supports push, and responds with "support" or "second-best recommendation".

[0095] Reference Figure 5 , Figure 5 A flowchart illustrating the video dynamic transmission bitrate adjustment method in an embodiment of the present invention is shown. In some embodiments, the corresponding bitrate is selected based on key factor scores and bandwidth status levels to obtain the target bitrate, specifically including but not limited to steps 501 to 502:

[0096] Step 501: Calculate the total score for each key factor based on the key factor scores to obtain the total key factor score.

[0097] In step 501, the total score of key factors = (key factor scores of each dimension × corresponding weights) ÷ total weights, thus achieving normalization.

[0098] Step 502: Compare the total score of key factors and bandwidth status level with the preset screening rules to determine the target bit rate.

[0099] In step 502, the filtering rules include: if the bandwidth status level is stable and available, the target bitrate is selected from the tier with the highest total score of key factors. If the bandwidth status level is fluctuating and available, the target bitrate is selected from the tier with the highest total score of key factors and adjacent to the current tier. If the bandwidth status level is unavailable, the target bitrate is selected from the tier with the lowest total score of key factors or a tier one level lower than the current tier.

[0100] Reference Figure 6 , Figure 6 This diagram illustrates a flow chart of a video dynamic transmission bitrate adjustment method according to an embodiment of the present invention. In some embodiments, the seamless bitrate switching in coordination with the server based on the target bitrate includes, but is not limited to, steps 601 to 602:

[0101] Step 601: After the server receives the switching request, it receives the target bitrate stream corresponding to the target bitrate pushed by the server and caches the target bitrate stream.

[0102] In step 601, specifically, the soft terminal requests the server to push the first 3 frames (e.g., I-frame + 2 P-frames) according to the target bitrate, and stores them in the local cache. The soft terminal maintains the current bitrate playback until the amount of data in the local cache is greater than or equal to a safety threshold to avoid buffer exhaustion during switching.

[0103] Step 602: After synchronizing the target bitrate in real time through the server, and when it is detected that the current bitrate stream has played to the preset frame of the target bitrate, the decoding channel is switched to the preset frame corresponding to the target bitrate stream.

[0104] In step 602, the server synchronizes the position and timestamp of the next I-frame of the target bitrate stream to the soft terminal through the RTSP extended field; when the current bitrate stream finishes playing up to the end of the most recent I-frame, the soft terminal seamlessly switches the decoding channel to the I-frame of the target bitrate, so that the timestamp error is ≤10ms.

[0105] In some embodiments, specifically, for example, the soft terminal encapsulates an HTTP / 3 protocol request data packet. This request data packet includes: the target bitrate tier (e.g., 8K@30, tier 4), the current bitrate tier, the current playback frame timestamp (e.g., T=12345678μs), the remaining local cache duration (e.g., 3.2 seconds), and the terminal's decoding capability (e.g., maximum support of 8K@60). Furthermore, if the amount of locally cached data is less than a safety threshold, a "preload priority" flag is appended to the request, informing the server to push the target bitrate stream first and postpone the confirmation of the switching instruction.

[0106] After receiving the request data packet, the server completes the following verification steps within 10ms: ① Whether the target bitrate stream has been pre-generated; ② Whether the current CDN node has push resources for the target bitrate stream; ③ Detecting whether the user's regional bandwidth supports the target bitrate by combining the regional network quality database. If the verification passes, a "Switch Permission" response is returned, along with the "Next I-Frame Position" of the target bitrate stream, the I-frame timestamp, and the push bandwidth limit; if the verification fails, and there is no target bitrate stream, a "Second-Best Recommendation" response is returned, along with the recommended bitrate tier and the reason, allowing the soft terminal to reconsider its decision.

[0107] The server prioritizes pushing the first 3 frames of critical data (I-frames + 2 P-frames) of the target bitrate according to the parameters in the "Switch License" response, ensuring that the soft terminal can quickly decode the cache. Furthermore, it controls the push rate to avoid excessive bandwidth consumption that could cause stuttering in the current bitrate stream, while simultaneously quickly filling the soft terminal's cache.

[0108] After receiving the target bitrate stream, the soft terminal stores it in an independent cache partition without affecting the playback of the current bitrate stream. It monitors the remaining cache duration in real time, and sends a "cache ready" notification to the server when the cache is greater than or equal to a preset safety threshold. If the cache duration is less than 3 seconds within 1 second, it sends a "slowdown push" notification to the server to prevent the current bitrate stream from being interrupted due to bandwidth contention.

[0109] After receiving the "Cache Ready" notification, the server synchronizes the "Current Playback Frame Timestamp" of the target bitrate stream in real time through the RTSP extended field, ensuring that the error between the timestamp and the current frame timestamp of the soft terminal is ≤10μs. When the I-frame of the target bitrate stream is about to be pushed, a "Switching Trigger Signal" is sent to the soft terminal, informing it to "Start Switching in 30ms".

[0110] After receiving the "switching trigger signal", the soft terminal continues to play the current bitrate stream and monitors the current frame type: the switching is initiated only when the current bitrate stream reaches the "end of the most recent I-frame"; during the switching, the decoding channel is switched from the "current bitrate stream" to the "target bitrate stream buffer" to directly decode the I-frame of the target bitrate, ensuring that the frame timestamps are aligned and that there is no black screen or screen tearing during the switching process.

[0111] Reference Figure 7 , Figure 7 A flowchart illustrating a video dynamic transmission bitrate adjustment method according to an embodiment of the present invention is shown. In some embodiments, after the bitrate switching is completed, the video dynamic transmission bitrate adjustment method may further include, but is not limited to, steps 701 to 703:

[0112] Step 701: Real-time detection and reporting of playback status; whereby playback status includes frame error rate and number of stutters.

[0113] Step 702: If the frame error rate is greater than the error rate threshold or the number of stutters is greater than the number of stutters threshold, a switching failure notification is sent to the server, and the decoding channel is reverted to the original bitrate stream for playback.

[0114] In step 702, for example: if the loading delay of the target bitrate is greater than 1 second or the frame error rate after switching is greater than 3%, immediately revert to the original bitrate and extend the lock period to 60 seconds.

[0115] Step 703: If the frame error rate is less than the error rate threshold and the number of stutters is less than the stutter count threshold within a preset time, a handover success notification is sent to the server.

[0116] After the bitrate switch is complete, the server adjusts the push rate to a preset multiple of the target bitrate to balance smoothness and bandwidth usage. Furthermore, it receives real-time playback status feedback from the client, such as frame error rate and stuttering indicators. If a "stuttering" message is received, the push rate is temporarily reduced, and the link quality is investigated.

[0117] After the bitrate switch is completed, the soft terminal continuously decodes the target bitrate stream, reporting the playback status to the server every 100ms: frame error rate, number of stutters, and current buffer duration. A buffer of ≥1 second is considered a stutter. If the frame error rate is >3% or two consecutive frames fail to decode after the switch, a "switching failed" notification is immediately sent to the server, and playback reverts to the original bitrate stream. If the switch is successful and playback is stable, the current weight and lock period are maintained. Stable playback means ≤1 stutter per minute. If the switch fails or playback stutters, the suboptimal bitrate is recalculated, and the lock period is extended.

[0118] In some embodiments, for common abnormal scenarios in cable television networks, such as sudden bandwidth drops, packet loss, and network outages, the server and the soft terminal collaboratively initiate the following emergency logic:

[0119] Bandwidth drop: The soft client immediately sends an "emergency downgrade" notification to the server and simultaneously initiates local caching for continued playback. Server: Upon receiving the notification, it switches to the second-lowest bitrate stream within 10ms and reduces the push rate to 12Mbps to avoid cache exhaustion.

[0120] Packet loss rate exceeds the limit: The soft terminal reports a "severe packet loss" status and requests the server to retransmit the lost P-frames. The server prioritizes retransmitting critical P-frames and temporarily enables the FEC mechanism to reduce the impact of packet loss on playback. If the packet loss rate continues to increase, the soft terminal is notified to downgrade the playback quality.

[0121] Brief network outage: The soft terminal resumes playback using local caching. During the outage, it stops sending requests and immediately sends a "network restored" notification to the server upon network recovery, requesting synchronization of the latest frame timestamp. After the server recovers, it quickly pushes the missing frame data from the outage, ensuring seamless playback for the soft terminal without having to start playback from the beginning.

[0122] In addition, this application also discloses a video dynamic transmission bitrate adjustment device based on soft terminal bandwidth awareness, please refer to... Figure 7 , Figure 7 This invention discloses a module block diagram of a video dynamic transmission bitrate adjustment device according to an embodiment of the present invention. The video dynamic transmission bitrate adjustment device can implement the above-described video dynamic transmission bitrate adjustment method. The video dynamic transmission bitrate adjustment device includes: a data acquisition module 801, a transmission anomaly identification module 802, a bitrate matching module 803, and a bitrate switching module 804. The data acquisition module 801, the transmission anomaly identification module 802, the bitrate matching module 803, and the bitrate switching module 804 are all communicatively connected.

[0123] The data acquisition module 801 acquires the transmission bandwidth, packet loss rate, and latency jitter of the detection data packets in real time. The transmission anomaly identification module 802 identifies transmission anomalies based on the transmission bandwidth, packet loss rate, and latency jitter to obtain the bandwidth status level. The bitrate matching module 803 performs bitrate matching based on the bandwidth status level and multi-dimensional key factors to obtain the target bitrate. The bitrate switching module 804 works with the server to seamlessly switch bitrates according to the target bitrate.

[0124] After the soft terminal sends a detection data packet to the gateway, the data acquisition module 801 receives the data returned by the gateway and calculates the transmission bandwidth, packet loss rate, and latency jitter corresponding to the transmission of the detection data packet based on the data. This provides accurate and stable basic data for bitrate decision-making, which is a prerequisite for the decision. The transmission anomaly identification module 802 identifies transmission anomalies based on the transmission bandwidth, packet loss rate, and latency jitter, obtains the bandwidth status level, and performs "semantic interpretation" of the transmission bandwidth, packet loss rate, and latency jitter, defining the decision framework for subsequent bitrate matching. The bitrate matching module 803 calculates the optimal solution based on the bandwidth status level and multi-dimensional key factors, obtaining the target bitrate. This achieves the selection of a stable and suitable target bitrate based on network status and scenario requirements. The bitrate switching module 804 transmits the target bitrate to the server and works with the server to complete a seamless bitrate switching, thereby improving the user experience. The overall solution is designed with a full-link approach of "bandwidth awareness, hierarchical classification, multi-dimensional matching, and seamless switching". It adapts to the core requirements of 4K / 8K ultra-high-definition transmission and complex network environments, reduces video stuttering, improves bandwidth utilization, and ensures that bandwidth can match the optimal image quality in different usage scenarios.

[0125] The operation process of the video dynamic transmission bitrate adjustment device in this embodiment is specifically described above. Figure 1 , Figure 2 , Figure 3 , Figure 4 , Figure 5 , Figure 6 The steps S101 to S104, S201 to S203, S301 to S304, S401 to S403, S501 and S502, S601 and S602, and S701 to S703 of the video dynamic transmission bitrate adjustment method are not described in detail here.

[0126] Another embodiment of the present invention discloses a video dynamic transmission bitrate adjustment device based on infrared thermal imaging, comprising: at least one processor, and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, the instructions being executed by the at least one processor to enable the at least one processor to perform, for example... Figure 1 Control method steps S101 to S104 Figure 2 Control method steps S201 to S203 Figure 3 Control method steps S301 to S304 Figure 4 Control method steps S401 to S403 Figure 5 Control method steps S501 and S502 Figure 6 The control method steps S601 and S602 and Figure 7 The video dynamic transmission bitrate adjustment method in steps S701 to S703 of the control method.

[0127] Another embodiment of the present invention discloses a computer-readable storage medium, the storage medium comprising: storing computer-executable instructions for causing a computer to perform... Figure 1 Control method steps S101 to S104 Figure 2 Control method steps S201 to S203 Figure 3 Control method steps S301 to S304 Figure 4 Control method steps S401 to S403 Figure 5 Control method steps S501 and S502 Figure 6 The control method steps S601 and S602 and Figure 7 The video dynamic transmission bitrate adjustment method in steps S701 to S703 of the control method.

[0128] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs.

[0129] It will be understood by those skilled in the art that all or some of the steps and systems in the methods disclosed above can be implemented as software, firmware, hardware, and suitable combinations thereof. Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable medium, which can include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and is accessible to a computer. Furthermore, as is known to those skilled in the art, communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0130] The embodiments of the present invention have been described in detail above with reference to the accompanying drawings. However, the present invention is not limited to the above embodiments, and various changes can be made within the scope of knowledge possessed by those skilled in the art without departing from the spirit of the present invention. Furthermore, the embodiments of the present invention and the features thereof can be combined with each other unless otherwise specified.

Claims

1. A method for adjusting the dynamic transmission bitrate of video based on soft terminal bandwidth awareness, characterized in that, include: Real-time acquisition of transmission bandwidth, packet loss rate, and latency jitter of detection data packets during transmission; Based on the transmission bandwidth, the packet loss rate, and the latency jitter, transmission anomalies are identified to obtain the bandwidth status level. The target bitrate is obtained by matching the bitrate based on the bandwidth status level and multi-dimensional key factors. The server will work in conjunction with the target bitrate to achieve seamless bitrate switching.

2. The video dynamic transmission bitrate adjustment method according to claim 1, characterized in that, The real-time acquisition of the transmission bandwidth, packet loss rate, and latency jitter of the detection data packets during transmission includes: The transmission bandwidth is obtained by calculating the bandwidth based on the total size of the data packets received by the gateway and the reception time of the data packets received by the gateway; The packet loss rate is obtained by calculating the total number of data packets sent by the soft terminal and the total number of data packets received by the gateway. The delay jitter is obtained by calculating the delay based on the sending time and receiving time of the data packet sent by the soft terminal.

3. The video dynamic transmission bitrate adjustment method according to claim 2, characterized in that, The step of identifying transmission anomalies based on the transmission bandwidth, the packet loss rate, and the latency jitter to obtain the bandwidth status level includes: The transmission bandwidth level is obtained by comparing the transmission bandwidth with the transmission bandwidth threshold. The packet loss rate is compared with the packet loss rate threshold to obtain the packet loss rate level; The delay jitter level is obtained by comparing the delay jitter with the delay jitter threshold. The bandwidth status level is determined based on the transmission bandwidth level, the packet loss rate level, and the latency jitter level.

4. The video dynamic transmission bitrate adjustment method according to claim 1, characterized in that, The step of performing bitrate matching based on the bandwidth status level and multi-dimensional key factors to obtain the target bitrate includes: The weights of the key factors in each dimension are determined based on the bandwidth status level, thus obtaining the key factor weights. The score corresponding to the key factor is calculated based on the weight of the key factor to obtain the key factor score; The target bitrate is obtained by selecting the corresponding bitrate based on the key factor score and the bandwidth status level.

5. The video dynamic transmission bitrate adjustment method according to claim 4, characterized in that, The step of filtering the corresponding bitrate based on the key factor score and the bandwidth status level to obtain the target bitrate includes: The total score of each key factor is calculated based on the scores of the key factors to obtain the total score of the key factors. The target bitrate is determined by comparing the total score of the key factors, the bandwidth status level, and the preset filtering rules.

6. The video dynamic transmission bitrate adjustment method according to claim 1, characterized in that, The seamless switching of bitrates according to the target bitrate in coordination with the server includes: After the server receives the switching request, it receives the target bitrate stream corresponding to the target bitrate pushed by the server and caches the target bitrate stream; After the server synchronizes the target bitrate in real time, and when it detects that the current bitrate stream is playing to the preset frame of the target bitrate, the decoding channel is switched to the preset frame corresponding to the target bitrate stream.

7. The video dynamic transmission bitrate adjustment method according to claim 6, characterized in that, After completing the bitrate switching, the video dynamic transmission bitrate adjustment method further includes: Real-time detection and reporting of playback status; wherein, the playback status includes frame error rate and number of stutters; If the frame error rate is greater than the error rate threshold or the number of stutters is greater than the number of stutters threshold, a switching failure notification is sent to the server, and the decoding channel is reverted to the original bitrate stream for playback; If the frame error rate is less than the error rate threshold and the number of stutters is less than the stutter count threshold within a preset time, a handover success notification is sent to the server.

8. A video dynamic transmission bitrate adjustment device based on soft terminal bandwidth awareness, characterized in that, include: The data acquisition module is used to acquire the transmission bandwidth, packet loss rate, and latency jitter of the detection data packets in real time during transmission. A transmission anomaly identification module is used to identify transmission anomalies based on the transmission bandwidth, the packet loss rate, and the latency jitter, and to obtain the bandwidth status level. The bitrate matching module is used to perform bitrate matching based on the bandwidth status level and multi-dimensional key factors to obtain the target bitrate. The bitrate switching module is used to work with the server to seamlessly switch bitrates according to the target bitrate.

9. A video dynamic transmission bitrate adjustment device based on soft terminal bandwidth awareness, characterized in that, include: At least one processor, and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, which, when executed by the at least one processor, enables the at least one processor to perform the video dynamic transmission bitrate adjustment method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions for causing a computer to perform the video dynamic transmission bitrate adjustment method as described in any one of claims 1 to 7.

Images