Panoramic video streaming parameter adjustment methods, devices, storage media, and electronic equipment

By dynamically adjusting the panoramic video streaming parameters through multi-dimensional network status data evaluation and comprehensive scoring, the problem of poor wireless network adaptability in existing technologies is solved, and more stable video transmission quality is achieved.

CN123123706APending Publication Date: 2026-11-17SHENZHEN WEIZHU TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202611355194.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-09-03
Publication Date
2026-11-17

AI Technical Summary

Technical Problem

Existing panoramic video streaming technologies rely solely on network bandwidth for bitrate adjustment, failing to respond promptly to complex changes in wireless networks, resulting in video quality issues such as screen tearing and stuttering, and poor adaptability.

Method used

The network quality of panoramic video terminals is evaluated by multi-dimensional network status data, a comprehensive score is generated, and the streaming parameters are dynamically adjusted to adapt to the wireless network environment, including the evaluation and adjustment of multiple indicators such as packet loss rate, signal-to-noise ratio, and bandwidth.

Benefits of technology

It improves the quality of panoramic video streaming, avoids video flickering and stuttering, enhances user experience, and adapts to changing wireless network environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN123123706A_ABST
    Figure CN123123706A_ABST
Patent Text Reader

Abstract

This invention provides a method, apparatus, storage medium, and electronic device for adjusting panoramic video streaming parameters, applied in the field of computer technology. It includes using multi-dimensional network status data containing multiple indicators to evaluate network quality, and then adjusting video streaming parameters. Thus, video streaming can be dynamically adjusted according to network status, adapting to changing wireless network environments. Furthermore, by applying multiple indicators to evaluate network quality from multiple dimensions, the accuracy of the evaluation is improved, resulting in higher video streaming quality and avoiding problems such as screen tearing and stuttering.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to a method and apparatus for adjusting panoramic video streaming parameters, a storage medium, and an electronic device. Background Technology

[0002] Panoramic video streaming technology mainly relies on wireless networks for real-time transmission. In order to ensure smooth playback of panoramic videos, existing panoramic video streaming generally adopts an adaptive bitrate adjustment mechanism based on network bandwidth detection, that is, by detecting network bandwidth, the corresponding streaming bitrate is dynamically matched.

[0003] However, the available bandwidth of a wireless network is not the only factor affecting the quality of panoramic video transmission. In actual transmission, the network is not static. Traditional technologies adjust the bitrate based solely on bandwidth, ignoring the complex and ever-changing wireless network environment. When network congestion or sudden changes in channel quality occur, bandwidth detection lags, and the bitrate adjustment strategy cannot respond in time. This leads to a mismatch between the streaming bitrate and the actual transmission conditions, resulting in quality issues such as video distortion, stuttering, and screen tearing in the streamed panoramic video, severely impacting the user experience. Summary of the Invention

[0004] In view of this, embodiments of this application provide a method and apparatus for adjusting panoramic video streaming parameters, a storage medium, and an electronic device. The solution provided in this application uses multi-dimensional network status data containing multiple indicators for evaluating the network quality of panoramic video terminals to evaluate the network quality of the panoramic video terminals. The obtained comprehensive network quality score is used to generate a video streaming parameter adjustment scheme. Finally, the video streaming parameter adjustment scheme is used to adjust the video streaming parameters of the panoramic video terminal. Thus, video streaming can be dynamically adjusted according to the network status, adapting to the changing wireless network environment, improving the quality of streaming video, and enhancing the user experience.

[0005] To achieve the above objectives, the embodiments of this application provide the following technical solutions: A method for adjusting panoramic video streaming parameters includes: The network status multidimensional data of the panoramic video terminal in the current acquisition period is obtained. The network status multidimensional data includes multiple indicators for evaluating the network quality of the panoramic video terminal. The network quality of the panoramic video terminal is evaluated using the multidimensional network status data, and a comprehensive network quality score corresponding to the current acquisition cycle is generated. A video streaming parameter adjustment scheme is generated based on the comprehensive network quality score. The video streaming parameter adjustment scheme is applied to adjust the video streaming parameters of the panoramic video terminal.

[0006] Optionally, in the above method, the step of using the multi-dimensional network state data to evaluate the network quality of the panoramic video terminal and generating a comprehensive network quality score corresponding to the current acquisition cycle includes: The basic evaluation indicators in the multidimensional network state data are calculated to obtain the basic network quality score. The comprehensive network quality score is obtained by calculating the basic network quality score and the various comprehensive evaluation indicators in the multidimensional network status data.

[0007] Optionally, in the above method, generating a video streaming parameter adjustment scheme based on the comprehensive network quality score includes: The network quality level of the panoramic video terminal is determined based on the comprehensive network quality score. Determine the target values ​​for each streaming parameter of the panoramic video terminal at the network quality level; A video streaming parameter adjustment scheme is generated by applying the target values ​​of each of the streaming parameters.

[0008] Optionally, the above method, in which the video streaming parameter adjustment scheme is applied to adjust the video streaming parameters of the panoramic video terminal, includes: Obtain the current value of each streaming parameter of the panoramic video terminal; When the current value of each streaming parameter of the panoramic video terminal is the same as the target value, the value of each streaming parameter of the panoramic video terminal remains unchanged. When there is a streaming parameter whose current value is different from the target value, the historical network quality record of the panoramic video terminal is obtained. The historical network quality record contains the historical network quality level of the panoramic video terminal in each consecutive historical acquisition cycle. Based on the historical network quality records and the network quality level, the network change type of the panoramic video terminal is determined; Based on the video streaming parameter adjustment scheme and the parameter adjustment rules for the network change type, the streaming parameters of the panoramic video terminal are adjusted.

[0009] Optionally, in the above method, determining the network change type of the panoramic video terminal based on the historical network quality records and the network quality level includes: Determine a target historical network quality level from the historical network quality records. The target historical network quality level is the most recent historical network quality level in the historical network quality records that is different from the target network quality level. When the network quality level is higher than the target historical network quality level, the network change type of the panoramic video terminal is determined to be the network recovery type; When the network quality level is lower than the target historical network quality level, the network change type of the panoramic video terminal is determined to be the network degradation type.

[0010] Optionally, in the above method, adjusting the streaming parameters of the panoramic video terminal according to the video streaming parameter adjustment scheme and the parameter adjustment rules for the network change type includes: When the network change type is network recovery type, the parameter adjustment rules of the network recovery type are applied to determine whether the network of the panoramic video terminal is stable; When the network of the panoramic video terminal is determined to be stable, a target streaming parameter is determined among the various streaming parameters, and the value of the target streaming parameter is adjusted based on the target value of the target streaming parameter; when the network of the panoramic video terminal is unstable, the value of each streaming parameter of the panoramic video terminal remains unchanged. When the network change type is network degradation, the parameter adjustment rules for the network degradation type are applied to determine whether the network of the panoramic video terminal is stable. When the network of the panoramic video terminal is determined to be stable, the value of each streaming parameter is adjusted according to the adjustment strategy of each streaming parameter; when the network of the panoramic video terminal is unstable, the value of each streaming parameter of the panoramic video terminal remains unchanged.

[0011] A panoramic video streaming parameter adjustment device, comprising: The data acquisition module is used to acquire multi-dimensional network status data of the panoramic video terminal in the current acquisition period. The multi-dimensional network status data includes multiple indicators for evaluating the network quality of the panoramic video terminal. The network quality assessment module is used to assess the network quality of the panoramic video terminal using the multi-dimensional network status data, and generate a comprehensive network quality score corresponding to the current acquisition cycle. The streaming parameter scheme generation module is used to generate a video streaming parameter adjustment scheme based on the network quality comprehensive score. The streaming parameter adjustment module is used to apply the video streaming parameter adjustment scheme to adjust the streaming parameters of the panoramic video terminal.

[0012] Optionally, the network quality assessment module in the aforementioned apparatus includes: The first calculation submodule is used to calculate the various basic evaluation indicators in the multidimensional data of network status to obtain the basic network quality score. The second calculation submodule is used to calculate the network quality basic score and the various comprehensive evaluation indicators in the network status multidimensional data to obtain the network quality comprehensive score.

[0013] Optionally, the above-mentioned apparatus includes a streaming parameter scheme generation module comprising: The first determining submodule is used to determine the network quality level of the panoramic video terminal based on the comprehensive network quality score. The second determining submodule is used to determine the target values ​​of each streaming parameter of the panoramic video terminal at the network quality level; The generation submodule is used to generate a video streaming parameter adjustment scheme by applying the target values ​​of each of the streaming parameters.

[0014] Optionally, the above-described apparatus includes a jetting parameter adjustment module comprising: The first acquisition submodule is used to acquire the current value of each streaming parameter of the panoramic video terminal; The holding submodule is used to keep the value of each streaming parameter of the panoramic video terminal unchanged when the current value of each streaming parameter of the panoramic video terminal is the same as the target value; The second acquisition submodule is used to acquire the historical network quality record of the panoramic video terminal when there is a push parameter whose current value is different from the target value. The historical network quality record contains the historical network quality level of the panoramic video terminal in each consecutive historical acquisition cycle. The third determining submodule is used to determine the network change type of the panoramic video terminal based on the historical network quality records and the network quality level; The adjustment submodule is used to adjust the streaming parameters of the panoramic video terminal according to the video streaming parameter adjustment scheme and the parameter adjustment rules of the network change type.

[0015] Optionally, the third determining submodule of the aforementioned apparatus includes: The first determining unit is configured to determine a target historical network quality level in the historical network quality record, wherein the target historical network quality level is the most recent historical network quality level in the historical network quality record that is different from the network quality level; The second determining unit is configured to determine the network change type of the panoramic video terminal as a network recovery type when the network quality level is higher than the target historical network quality level; and to determine the network change type of the panoramic video terminal as a network degradation type when the network quality level is lower than the target historical network quality level.

[0016] Optionally, the adjustment submodule of the aforementioned device includes: The first adjustment unit is used to determine whether the network of the panoramic video terminal is stable when the network change type is network recovery type, by applying the parameter adjustment rules of the network recovery type; when the network of the panoramic video terminal is determined to be stable, a target streaming parameter is determined among the streaming parameters, and the value of the target streaming parameter is adjusted based on the target value of the target streaming parameter; when the network of the panoramic video terminal is unstable, the value of each streaming parameter of the panoramic video terminal remains unchanged. The second adjustment unit is used to determine whether the network of the panoramic video terminal is stable when the network change type is network degradation, by applying the parameter adjustment rules of the network degradation type; when the network of the panoramic video terminal is determined to be stable, the value of each streaming parameter is adjusted according to the adjustment strategy of each streaming parameter; when the network of the panoramic video terminal is unstable, the value of each streaming parameter of the panoramic video terminal is kept unchanged.

[0017] A storage medium comprising stored instructions, wherein, when the instructions are executed, the device containing the storage medium is controlled to perform the panoramic video streaming parameter adjustment method as described in any of the preceding claims.

[0018] An electronic device includes a memory and one or more instructions, wherein one or more instructions are stored in the memory and configured to be executed by one or more processors to implement the panoramic video streaming parameter adjustment method as described above.

[0019] Based on the panoramic video streaming parameter adjustment method, apparatus, storage medium, and electronic device provided in the embodiments of this application, network quality is evaluated using multi-dimensional network status data containing multiple indicators, and then video streaming parameters are adjusted. Thus, video streaming can be dynamically adjusted according to network status, thereby adapting to the ever-changing wireless network environment. Furthermore, by applying multiple indicators to evaluate network quality from multiple dimensions, the accuracy of the evaluation is improved, the quality of video streaming is improved, and problems such as screen tearing and stuttering are avoided, thereby improving the user experience. Attached Figure Description

[0020] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0021] Figure 1A flowchart of a panoramic video streaming parameter adjustment method provided in this application embodiment; Figure 2 A flowchart illustrating the generation of a video streaming parameter adjustment scheme in a panoramic video streaming parameter adjustment method provided in this application embodiment; Figure 3 This is a flowchart illustrating the process of adjusting video streaming parameters on a panoramic video terminal, as provided in another embodiment of this application. Figure 4 A diagram of a multi-pull parameter joint adaptive control architecture based on a comprehensive network quality score is provided in another embodiment of this application. Figure 5 A flowchart of adaptive push stream parameter adjustment based on network quality comprehensive score grading response is provided for another embodiment of this application; Figure 6 A schematic diagram of a panoramic video streaming parameter adjustment device provided in another embodiment of this application; Figure 7 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0022] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0023] In this application, the terms "comprising," "including," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0024] Currently, panoramic video streaming technology primarily relies on wireless network environments for transmission. The core control logic of traditional video streaming systems is to adjust the bitrate based solely on network bandwidth monitoring results. In wireless network transmission scenarios, panoramic video, due to its ultra-high definition, high bitrate, and panoramic view characteristics, has much higher requirements for network transmission stability than ordinary video. However, existing streaming systems only focus on bandwidth as a single indicator, failing to incorporate core factors that play a crucial role in wireless network transmission quality, such as packet loss rate, signal-to-noise ratio (SNR), and network jitter, and also lacking corresponding perception and analysis modules.

[0025] Existing panoramic video streaming technologies rely solely on bandwidth for bitrate adjustment, neglecting the critical impact of packet loss rate and signal-to-noise ratio (SNR) on panoramic video transmission. This results in a limited network evaluation dimension and low accuracy in bitrate adjustment. For example, in low SNR wireless network environments, even with sufficient bandwidth, signal attenuation can lead to video data transmission errors. Adjusting the bitrate alone cannot solve the transmission quality problem, easily causing video artifacts and stuttering. Existing streaming technologies passively respond to real-time bandwidth data without analyzing or predicting network quality trends. When sudden packet loss or a sharp drop in SNR occurs in the wireless network, the system cannot adjust parameters in advance, leading to significant quality fluctuations in panoramic video streaming. Furthermore, existing panoramic video streaming methods limit adjustment to bitrate, failing to cover core panoramic video encoding parameters such as frame rate, resolution, and GOP structure. Parameter adjustments are based on fixed threshold matching, unable to provide fine-grained, tiered adjustments according to gradient changes in network quality. This results in insufficient flexibility and poor adaptability, making traditional streaming methods ill-suited for the transmission needs of panoramic video under varying network quality conditions.

[0026] To address the aforementioned issues, this application provides a method and apparatus for adjusting panoramic video streaming parameters, a storage medium, and an electronic device. The method involves periodically collecting multi-dimensional network status data from a panoramic video terminal. This multi-dimensional network status data includes multiple indicators for evaluating the network quality of the panoramic video terminal. The network quality of the panoramic video terminal is evaluated using the multi-dimensional network status data from the current collection period. A comprehensive network quality score is then used to generate a video streaming parameter adjustment scheme. Finally, the video streaming parameter adjustment scheme is applied to adjust the video streaming parameters of the panoramic video terminal. This scheme uses multi-dimensional network status data containing multiple indicators to evaluate network quality during panoramic video streaming, and then adjusts the video streaming parameters accordingly. This allows the video streaming to be dynamically adjusted based on the network status, adapting to changing wireless network environments. Furthermore, by applying multiple indicators for network quality evaluation, the accuracy of the evaluation is improved, thus enhancing the quality of video streaming and preventing issues such as screen tearing and stuttering.

[0027] This application applies to real-time streaming scenarios of panoramic video in wireless network environments, including but not limited to: (1) outdoor panoramic live streaming scenarios, such as sports events and scenic spot live streaming; this scenario relies on 4G / 5G wireless networks to realize mobile streaming of panoramic video; (2) indoor panoramic monitoring scenarios, this scenario relies on Wi-Fi wireless networks to realize real-time streaming of panoramic monitoring video; (3) embedded panoramic device streaming scenarios, such as panoramic cameras and panoramic drones; this scenario adapts to the hardware characteristics of embedded devices to realize lightweight parameter adjustment.

[0028] See Figure 1 The diagram shows a flowchart of a panoramic video streaming parameter adjustment method provided in an embodiment of this application. The method is applied in a computing device environment or configuration for streaming panoramic video. Further, the computing device environment or configuration is equipped with a streaming device for streaming to a streaming media server. For example, the computing device environment or configuration can be a personal computer, a server computer, etc.

[0029] like Figure 1 As shown, the method includes: S101. Obtain multi-dimensional network status data of the panoramic video terminal in the current acquisition period. The multi-dimensional network status data includes multiple indicators used to evaluate the network quality of the panoramic video terminal.

[0030] The panoramic video terminal of this application can be a device for playing panoramic video, a device for receiving panoramic video pushed by a streamer, or a streaming device.

[0031] In the solution provided in this application, the panoramic video terminal is in a streaming state. The solution periodically collects multi-dimensional network status data from the panoramic video terminal. The collection period can be set according to the device configuration of the streaming panoramic video terminal. For example, for low-performance embedded devices, the collection period can be set to 1000ms / time, which reduces the device's computational load without affecting the core evaluation and adjustment effects. By setting the collection period according to the panoramic video terminal's device configuration, the solution ensures that the processing resources required for subsequent data processing are within the device's supported processing resources, thereby avoiding computational overload and allowing the device to maintain a good operating state for an extended period.

[0032] In one embodiment provided in this application, a data acquisition module is used to acquire multi-dimensional network status data of the panoramic video terminal. The data acquisition module periodically and continuously acquires multi-dimensional network status data of the panoramic video terminal.

[0033] Furthermore, the data acquisition module includes a network status acquisition module and a signal-to-noise ratio (SNR) detection module. The network status acquisition module and the SNR detection module acquire data synchronously. During the data acquisition process, both modules filter out abnormal data, such as sudden abnormal values ​​with an instantaneous packet loss rate of 100%, thereby ensuring the validity of the data.

[0034] The network status acquisition module serves as the data source for systems applying the solution provided in this application. It connects to the wireless network card driver and RTP statistics module at the physical layer / link layer to collect network transmission indicators of the wireless network in real time, including but not limited to packet loss rate, network latency, and real-time bandwidth. Preferably, the acquisition frequency can be 500ms / time to ensure the real-time nature of the data.

[0035] The signal-to-noise ratio (SNR) detection module is an independent low-level signal acquisition module that connects directly to the wireless network card driver. It provides low-level adaptation for different systems such as Android (based on the WifiInfo interface) and iOS (based on CoreWLAN extension), collecting wireless signal indicators in real time, including but not limited to SNR and Received Signal Strength Indicator (RSSI). It also performs noise reduction processing on the signal data to ensure accuracy. It's important to note that RSSI reflects the received signal strength of the wireless link. A continuously decreasing RSSI, even with a low current packet loss rate, can indicate an impending deterioration of the wireless link. Therefore, RSSI is used in the network quality assessment of the panoramic video terminal and serves as an important reference indicator for the dynamic adjustment of streaming parameters.

[0036] The network status multidimensional data includes multiple metrics for evaluating the network quality of panoramic video terminals. Furthermore, the metrics in the network status multidimensional data include, but are not limited to, packet loss rate, network latency, real-time bandwidth, signal-to-noise ratio (SNR), and received signal strength indication (RSSI).

[0037] S102. Use multi-dimensional network status data to evaluate the network quality of the panoramic video terminal and generate a comprehensive network quality score corresponding to the current acquisition cycle.

[0038] In another embodiment provided in this application, the network quality assessment module assesses the network quality of the panoramic video terminal and generates a comprehensive network quality score. The process includes: calculating each basic assessment indicator in the multi-dimensional network status data to obtain a basic network quality score; and calculating the basic network quality score and each comprehensive assessment indicator in the multi-dimensional network status data to obtain a comprehensive network quality score.

[0039] Furthermore, the basic evaluation indicators include, but are not limited to, packet loss rate, signal-to-noise ratio, and real-time bandwidth. Based on the wireless network type of the panoramic video terminal, a weight coefficient for each basic evaluation indicator is matched, and calculations are performed on each basic evaluation indicator and its weight coefficient to obtain a basic network quality score.

[0040] Furthermore, the specific calculation method is as follows: NQI=a×(1−LossRate)+b×SNR+c×Bandwidth ,in, LossRate This represents the packet loss rate, with a value ranging from 0 to 1. SNR The signal-to-noise ratio is normalized, with a value ranging from 0 to 1; Bandwidth The real-time bandwidth is normalized, and the value ranges from 0 to 1. NQI A basic network quality score is assigned, ranging from 0 to 1, with higher values ​​indicating better network quality. 'a' represents the weighting coefficient for packet loss rate, 'b' for signal-to-noise ratio, and 'c' for real-time bandwidth; where a + b + c = 1. Preferably, the default values ​​are a = 0.4, b = 0.3, and c = 0.3. Preferably, different wireless network types have different weighting coefficients. Wireless network types include, but are not limited to, Wi-Fi, 4G, and 5G. For example, for 4G / 5G mobile networks, the weighting coefficient can be adjusted. NQI The weighting coefficients in the calculation formula are adjusted to increase the weight of packet loss rate. The weighting coefficients can be set as follows: a=0.5, b=0.2, c=0.3. For indoor Wi-Fi networks, the weight of signal-to-noise ratio is increased. The weighting coefficients can be set as follows: a=0.3, b=0.4, c=0.3. The weighting coefficients are dynamically adapted according to the wireless network type to adapt to the characteristics of different wireless networks, improve the adaptability of the solution to different wireless network types, and improve the streaming quality.

[0041] The comprehensive evaluation metrics include, but are not limited to, Received Signal Strength Indicator (RSSI), network delay, network jitter, network retransmission rate, and ACK response time. One or more comprehensive evaluation metrics can be set according to the actual needs of different application scenarios.

[0042] In another embodiment provided in this application, before calculating the network quality basic score and each comprehensive evaluation index in the network status multidimensional data, score weights are assigned to the network quality basic score and each comprehensive evaluation index. Preferably, the sum of each score weight is 100. Further, the score weight of the network basic score can be fixed at 70, and the sum of the score weights of each comprehensive evaluation index is 30.

[0043] Preferably, each comprehensive evaluation indicator is scored to obtain a score for each comprehensive evaluation indicator. Then, the network quality baseline score and its weight, as well as the score and weight of each comprehensive evaluation indicator, are calculated to obtain the comprehensive network quality score. The calculation method is as follows: ,in, Q-Score For the overall network quality score, NQI Assess the basic network quality score; For the comprehensive evaluation index score, j takes the value of a positive integer, and different values ​​can represent different comprehensive evaluation indexes; Weighting of scores for basic network quality assessment; Scoring of comprehensive evaluation indicators The score weights.

[0044] In another embodiment provided in this application, an example of generating a comprehensive network quality score is provided, the details of which are as follows: The comprehensive evaluation indicators are Received Signal Strength Indicator (RSSI), network delay, and network jitter.

[0045] The processing methods for each comprehensive evaluation indicator are as follows: RSSI normalization is as follows: RSSI ≥ −55dBm, score is 1; −65dBm≤RSSI<−55dBm, score is 0.8; -75dBm≤RSSI<−65dBm, score is 0.5; RSSI<−75dBm, score is 0.2.

[0046] Network latency normalization is as follows: Delay ≤ 100ms, score 1; 100ms < Delay ≤ 200ms, score 0.8; 200ms < Delay ≤ 300ms, score 0.5; Delay > 300ms, score 0.2.

[0047] Network jitter is normalized in the same way, which will not be elaborated here.

[0048] The multidimensional network status data collected in the current collection period includes the following: LossRate=5%; SNR after normalization=0.82; Bandwidth after normalization=0.90; RSSI=-60dBm; Delay=120ms; Jitter=15ms.

[0049] According to the above calculation method of NQI: NQI=0.4×(1−0.05)+0.3×0.82+0.3×0.90=0.896.

[0050] RSSI score = 0.8; Delay score = 0.8; Jitter score = 0.9, then: Q-Score = 70 × 0.896 + 10 × 0.8 + 10 × 0.8 + 10 × 0.9 = 62.72 + 8 + 8 + 9 = 87.72.

[0051] At this point, a comprehensive network quality score can be obtained. By using network status data containing multiple dimensions to evaluate the network quality of the panoramic video terminal, a comprehensive and accurate analysis of the terminal's network quality can be achieved. This provides a stronger basis for subsequent video streaming adjustments, allowing for adjustments to video streaming in response to dynamic changes in the wireless network, resulting in higher video streaming quality.

[0052] S103. Generate a video streaming parameter adjustment plan based on the comprehensive network quality score.

[0053] In the solution provided in this application, the streaming parameter generation module generates a video streaming parameter adjustment scheme based on the comprehensive network quality score. For details, please refer to [link to relevant documentation]. Figure 2 .

[0054] See Figure 2 The flowchart illustrating the generation of a video streaming parameter adjustment scheme in a panoramic video streaming parameter adjustment method according to an embodiment of this application is shown below: S201. Determine the network quality level of the panoramic video terminal based on the comprehensive network quality score.

[0055] In another embodiment provided in this application, a network classification scheme is determined based on the video resolution of the streaming video corresponding to the panoramic video terminal. The network classification scheme includes a comprehensive network quality score range, network quality level, adjustment strategy, and core adjustment actions. Different comprehensive network quality score ranges correspond to different network quality levels, adjustment strategies, and core adjustment actions. The content of the comprehensive network quality score range, network quality level, adjustment strategy, and core adjustment actions varies in different network classification schemes.

[0056] Another embodiment of this application provides an example of a network hierarchical scheme, as detailed in Table 1.

[0057] Table 1 Examples of Network Hierarchy Schemes Network quality comprehensive score range Network quality level Regulation strategy Core adjustment actions Q-Score > 80 excellent Fully configured and running with all parameters High frame rate (60FPS), high motion search accuracy, fixed-length GOP structure, highest resolution 60 < Q-Score ≤ 80 Slight deterioration First-level fine-tuning Only the QP is slightly adjusted to reduce the bitrate (by 10%~20%), while keeping the frame rate, resolution, and GOP structure unchanged. 40 < Q-Score ≤ 60 moderate deterioration Secondary regulation Reduce frame rate (60FPS → 30~24FPS), narrow motion search range, and slightly reduce bit rate (20%~40%). Q-Score ≤ 40 Serious deterioration Three-level depth adjustment Shorten GOP length, enable ROI (Region of Interest) encoding, significantly reduce resolution (≥50%), and significantly reduce bitrate (≥50%). It should be noted that the contents of different network classification schemes are different. Different video resolutions correspond to different network classification schemes, and the video resolutions include but are not limited to ultra-high definition panoramic video (8K) and high definition panoramic video (4K). For example, for ultra-high definition panoramic video (8K), the Q-Score classification threshold can be increased (e.g., Excellent: Q-Score>85, Slight Deterioration: 65<Q-Score≤85); for high definition panoramic video (4K), the classification threshold can be appropriately reduced.

[0058] The comprehensive network quality score is matched with the corresponding comprehensive network quality score range in the network classification scheme, and then the network quality level is determined according to the matched comprehensive network quality score range. For example, when the comprehensive network quality score is 87.72, according to the content shown in Table 1, it can be known that Q-Score>80, so it can be determined that the network quality level of the panoramic video terminal in the current collection cycle is Excellent.

[0059] S202. Determine the target value of each streaming parameter of the panoramic video terminal at the network quality level.

[0060] In another embodiment provided by the present application, each streaming parameter includes but is not limited to target bitrate, target frame rate, target GOP length, and target resolution. Each streaming parameter has different streaming values at different network quality levels. When determining the target value of each streaming parameter at the network quality level, it can be determined according to the adjustment strategy and core adjustment action corresponding to the network quality level.

[0061] S203. Apply the target values of each streaming parameter to generate a video streaming parameter adjustment scheme.

[0062] The target values of each streaming parameter form a parameter adjustment matrix, and the video streaming parameter adjustment scheme is generated by using the parameter adjustment matrix, the network quality level of the panoramic video terminal in the current collection cycle, and the adjustment strategy and core adjustment action corresponding to the network quality level; that is, the video streaming parameter adjustment scheme includes the target value of each streaming parameter, the network quality level of the panoramic video terminal in the current collection cycle, and the adjustment strategy and core adjustment action corresponding to the network quality level.

[0063] The generated video streaming adjustment scheme contains the target values of multiple streaming parameters. When the video streaming parameter adjustment scheme is subsequently applied for streaming adjustment, adjustments can be made from multiple parameters, so that the transmission stability of video streaming can be comprehensively improved, and the probability of problems such as stuttering and screen blurring during the streaming process can be reduced.

[0064] In another embodiment provided in this application, when generating a video streaming parameter adjustment scheme, a joint analysis of signal-to-noise ratio (SNR) and packet loss rate can be performed to effectively distinguish between two types of packet loss in the wireless network: congestion-type packet loss and error-type packet loss. Different packet loss types have different coping strategies. After distinguishing the packet loss types, a video streaming adjustment scheme can be generated based on the identified packet loss type, so that the generated video streaming scheme also includes coping strategies for the packet loss type. Furthermore, when identifying packet loss types, they can be identified based on their characteristics. Congestion-type packet loss is characterized by high SNR, high packet loss rate, and low bandwidth. The cause of congestion-type packet loss is insufficient network bandwidth resources. The coping strategy for this type of packet loss is to significantly reduce the bit rate and shorten the GOP length. Error-type packet loss is characterized by low SNR, high packet loss rate, and sufficient bandwidth. The cause of error-type packet loss is wireless signal attenuation leading to transmission errors. The coping strategy is to enable ROI encoding, narrow the motion search range, and avoid blindly reducing the bit rate.

[0065] By integrating packet loss rate, signal-to-noise ratio, and bandwidth analysis, a multi-dimensional network quality assessment mechanism is constructed to achieve quantitative evaluation of wireless network transmission quality. This mechanism can effectively distinguish between congestion-related packet loss and error-related packet loss, accurately locate network quality problems, and include strategies to address these network quality issues in the generated video streaming parameter adjustment scheme. This makes video streaming applicable to various wireless network environments and improves video streaming quality.

[0066] S104. Apply the video streaming parameter adjustment scheme to adjust the video streaming parameters of the panoramic video terminal.

[0067] See Figure 3 The following is a flowchart illustrating the process of adjusting video streaming parameters on a panoramic video terminal, as provided in another embodiment of this application: S301. Obtain the current value of each streaming parameter of the panoramic video terminal.

[0068] Obtain the current values ​​of each streaming parameter in the current streaming state of the panoramic video terminal.

[0069] S302. Determine if there is a streaming parameter whose current value is different from the target value. If there is a streaming parameter whose current value is different from the target value, then execute S303. If there is no streaming parameter whose current value is different from the target value, then execute S304.

[0070] For each streaming parameter, the current value of the streaming parameter is compared with the target value to obtain the comparison result of whether the values ​​are consistent. When all comparison results are consistent, it is determined that there is no streaming parameter whose current value is different from the target value, and then S303 is executed; when there are comparison results that are inconsistent, it is determined that there is a streaming parameter whose current value is different from the target value, and then S304 is executed.

[0071] It should be noted that when all comparison results are consistent, it means that the streaming parameters of the panoramic video terminal are already at the optimal level of the current network quality. At this time, there is no need to adjust the streaming parameters. It can be understood that the various streaming parameters of the panoramic video terminal have reached the target values ​​of the current network quality level. At this time, the streaming method of the panoramic video terminal is most compatible with the network where the panoramic video terminal is located. It is sufficient to maintain the panoramic video terminal in the current streaming state. At this time, S303 needs to be executed.

[0072] When there are inconsistent comparison results, it indicates that some push parameters need to be adjusted. At this time, the subsequent steps need to be performed, namely, S304.

[0073] S303. Keep the value of each streaming parameter of the panoramic video terminal unchanged.

[0074] Keeping the values ​​of each streaming parameter of the panoramic video terminal unchanged, that is, not adjusting the values ​​of each streaming parameter, can be understood as maintaining the current streaming state of the panoramic video terminal.

[0075] S304. Obtain the historical network quality records of the panoramic video terminal. The historical network quality records contain the historical network quality levels of the panoramic video terminal in each consecutive historical acquisition period.

[0076] The historical network quality record contains the historical network quality level of the panoramic video terminal in each historical acquisition period. That is, each historical network quality level in the historical network quality record corresponds to each historical acquisition period, and the historical acquisition periods are continuous, meaning that the historical network quality levels are also continuous.

[0077] In another embodiment provided in this application, after completing the process of adjusting the video streaming parameters of the panoramic video terminal in the current acquisition cycle, the network quality level of the panoramic video terminal in the current acquisition cycle is stored as the historical network quality level in the historical network quality record, and then the next acquisition cycle is entered and the corresponding streaming parameter adjustment process is executed.

[0078] After obtaining the historical network quality records of the panoramic video terminal, the network change type of the panoramic video terminal is determined based on the historical network quality records and network quality level. The process for determining the network change type of the panoramic video terminal is as described in S305-S308.

[0079] Furthermore, after obtaining the historical network quality records of the panoramic video terminal, S305 is executed.

[0080] S305. Determine the target historical network quality level in the historical network quality record. The target historical network quality level is the most recent historical network quality level that is different from the network quality level in the historical network quality record.

[0081] The target historical network quality level is determined from among the various historical network quality levels in the historical network quality records. The determination process is as follows: the historical network quality level that differs from the current network quality level is designated as the first historical network quality level; the first historical network quality level of the historical acquisition period closest to the current acquisition period is designated as the target historical network quality level. In other words, the target historical network quality level is the historical network quality level that is different from the current network quality level and is closest to the current network quality level. Alternatively, it can be understood as using the historical network quality level that has changed most recently from the current network quality level as the target historical network quality level.

[0082] Furthermore, the historical network quality level located after the target historical network quality level in the historical network quality record is the same as the network quality level of the current collection period.

[0083] S306. Determine whether the network quality level is higher than the target historical network quality level. If the network quality level is higher than the target historical network quality level, execute S307; if the network quality level is lower than the target historical network quality level, execute S308.

[0084] The network quality level is compared with the target historical network quality level to determine whether the network quality level is higher than the target historical network quality level.

[0085] S307. Determine the network change type of the panoramic video terminal as the network recovery type.

[0086] S308. The network change type of the panoramic video terminal is determined to be the network degradation type.

[0087] By using the target historical network quality level and network quality level, the network changes of the panoramic video terminal can be quickly determined, i.e., whether the network is recovering or deteriorating. Subsequently, the streaming can be adjusted according to the network changes, thereby adapting to the dynamically changing network and improving the streaming quality.

[0088] After determining the network change type of the panoramic video terminal, adjust the streaming parameters of the panoramic video terminal according to the video streaming parameter adjustment scheme and the parameter adjustment rules for the network change type. The specific process is as follows: S309-S312.

[0089] S309. Apply the parameter adjustment rules of the network recovery type to determine whether the network of the panoramic video terminal is stable; when the network of the panoramic video terminal is determined to be stable, execute S310; when the network of the panoramic video terminal is unstable, execute S303.

[0090] When the network change type is network recovery, the parameter adjustment rules for network recovery type are used to determine whether the network of the panoramic video terminal is stable. The specific process is as follows: the number of each historical network quality level after the target historical network quality level in the network quality level and historical network quality records is summed to obtain a first number. When the first number is greater than or equal to the first threshold in the parameter adjustment rules, the network of the panoramic video terminal is determined to be stable; otherwise, the network of the panoramic video terminal is unstable. The first threshold can be set according to the actual situation.

[0091] It should be noted that each historical network quality level following the target historical network quality level in the historical network quality record is the same as the network quality level of the current acquisition period. By performing a summation operation, the number of times the network status of the panoramic video terminal remains at the network quality level of the current acquisition period can be obtained. This number can be used to determine whether the network of the panoramic video terminal is stable. When the network of the panoramic video terminal is stable, S310 is executed.

[0092] Adjusting streaming parameters under stable network conditions allows for smooth and rapid adjustments, avoiding frequent parameter fluctuations caused by instantaneous network volatility. It also prevents sudden parameter changes that can lead to video clipping when adjusting streaming parameters under unstable network conditions, thus reducing the probability of stuttering in panoramic video streaming.

[0093] When the network of the panoramic video terminal is unstable, execute S303, which maintains the panoramic video terminal in the current streaming state, avoids frequent parameter fluctuations caused by instantaneous network fluctuations, and improves the quality of video streaming.

[0094] S310. Determine the target push parameter among the various push parameters, and adjust the value of the target push parameter based on the target value of the target push parameter.

[0095] The target streaming parameter can be determined from among the various streaming parameters based on the core adjustment actions in the video streaming parameter adjustment scheme. Furthermore, the target streaming parameter can be one or multiple.

[0096] For example, when determining the network stability recovery of the panoramic video terminal, the target streaming parameters can be selected in descending order of parameter recovery priority. For instance, streaming parameters whose current values ​​differ from the target values ​​are first identified as first-class parameters, and then the target streaming parameter is determined from among these first-class parameters based on their priority.

[0097] In another embodiment provided in this application, when the panoramic video terminal is in a network recovery state, the streaming parameters will recover along with the network. To ensure stable streaming, only one target streaming parameter is selected for adjustment when adjusting the streaming parameters. Continuing from the above description, the highest priority first-class parameter is determined as the target streaming parameter. The example of the target streaming parameter determination process here is only one case provided by this application, and the target streaming parameter determination process of other derivative methods is also within the protection scope of this application.

[0098] After determining the target streaming parameters, the values ​​of the target streaming parameters are adjusted based on the adjustment strategy for the target streaming parameters. Preferably, the adjustment strategy here can be the same as or different from the adjustment strategy in S312 below. When adjusting the values ​​of the target streaming parameters, a gradient smoothing adjustment method can be used to ensure the stability of the recovery of the target streaming parameters, thereby avoiding sudden changes in values.

[0099] S311. Apply the parameter adjustment rules for network degradation types to determine whether the network of the panoramic video terminal is stable; when the network of the panoramic video terminal is determined to be stable, execute S312; when the network of the panoramic video terminal is unstable, execute S303.

[0100] It should be noted that the historical network quality levels following the target historical network quality level in the historical network quality record are the same as the network quality level in the current collection period.

[0101] By summing the number of network quality levels in the current acquisition period and the historical network quality records that are located after the target historical network quality level, the number of times the network status of the panoramic video terminal remains at the current acquisition period's network quality level can be obtained. This number is then compared with the second threshold in the parameter adjustment rules to determine whether the panoramic video terminal's network is stable.

[0102] Preferably, the first threshold can be greater than the second threshold, and the first and second thresholds can be configured according to the actual application. This application uses the first and second thresholds to filter out misjudgments caused by instantaneous fluctuations in the wireless network, thereby ensuring the real-time performance of parameter responses.

[0103] When the network of the panoramic video terminal is unstable, the value of each streaming parameter of the panoramic video terminal remains unchanged. That is, the panoramic video terminal maintains the current streaming state to avoid adjusting the streaming parameters when the network is unstable, which would cause the parameters to fluctuate frequently due to instantaneous network fluctuations.

[0104] S312. Adjust the value of each push parameter according to the adjustment strategy of each push parameter.

[0105] The value of each streaming parameter is adjusted based on an adjustment strategy for each streaming parameter. The adjustment strategies differ for different streaming parameters. Preferably, the adjustment strategy includes, but is not limited to, the adjustment priority and adjustment range of the streaming parameters.

[0106] For example, streaming parameters include, but are not limited to, bitrate (QP), frame rate (FPS), GOP structure, resolution, and motion search range.

[0107] For example, bitrate adjustment strategies include, but are not limited to: after determining the target value, not directly switching to the target value, but gradually approaching the target value using a gradient smoothing adjustment method. Frame rate adjustment strategies include, but are not limited to: adjusting when the network is moderately or severely degraded, prioritizing the smoothness of the panoramic video during adjustment. GOP structure adjustment strategies include, but are not limited to: adjusting the GOP length when the network is severely degraded, such as shortening the GOP length to reduce screen tearing caused by inter-frame prediction errors. Resolution adjustment strategies include, but are not limited to: adjusting when the network is severely degraded, prioritizing the core viewpoint resolution of the panoramic video. Motion search range adjustment strategies include, but are not limited to: reducing the motion search range when the network is degraded to reduce encoding computation and improve real-time streaming performance.

[0108] When the network of the panoramic video terminal deteriorates, the streaming parameters need to be lowered. Preferably, in order to stabilize the changes in the streaming parameters of the panoramic video terminal, a gradient smoothing adjustment method is used to adjust the values ​​of the streaming parameters, so that the values ​​of the streaming parameters can gradually converge to the target values, avoiding a sudden drop in the values ​​of the streaming parameters caused by abrupt changes in the network state.

[0109] It should be noted that the streaming parameters with the same current value and the target value do not need to be adjusted; only the streaming parameters with different current values ​​and target values ​​need to be adjusted.

[0110] In another embodiment provided in this application, the value of the streaming parameter decreases as the network deteriorates. This step involves adjusting the streaming parameter when the network deteriorates. Therefore, the target value of the streaming parameter to be adjusted is smaller than the current value.

[0111] Furthermore, when adjusting the values ​​of the streaming parameters using gradient smoothing adjustment, the adjustment range of the streaming parameter values ​​shall not exceed a preset range. When the difference between the current value and the target value of the streaming parameter is greater than the preset range, the change range of the adjusted parameter shall not exceed the preset range. Preferably, the preset ranges for different streaming parameters can be different, and the adjustment rules for different streaming parameters can also be different.

[0112] For example, the streaming parameter that needs to be adjusted is the bitrate. The preset range of the bitrate is 10%, meaning that when adjusting the bitrate, it can only be adjusted by a maximum of 10%. The bitrate adjustment rule is as follows: Bitrate_new = Bitrate_old + λ ×(TargetBitrate − Bitrate_old), where Bitrate_new is the value of the bitrate after adjustment, Bitrate_old is the current value of the bitrate, TargetBitrate is the target value of the bitrate, and λ is the adjustment coefficient, which ranges from 0.1 to 0.3, preferably 0.2.

[0113] For example, the current bitrate is 10Mbps, the target bitrate is 5Mbps, and after adjustment in the current acquisition cycle, it becomes 9Mbps. If the adjustment conditions are still met in the next acquisition cycle, it is adjusted to 8.2Mbps, and if they are met again, it is adjusted to 7.56Mbps. As long as the adjustment conditions are met, the adjustment continues until the bitrate gradually converges to the target value. In this way, the values ​​of the streaming parameters can be adjusted smoothly in a gradient, avoiding sudden changes in the values.

[0114] The panoramic video streaming parameter adjustment method provided in this application involves periodically collecting multi-dimensional network status data of the panoramic video terminal. This multi-dimensional network status data includes multiple indicators for evaluating the network quality of the panoramic video terminal. The network quality of the panoramic video terminal is evaluated using the multi-dimensional network status data of the panoramic video terminal in the current collection period. The resulting comprehensive network quality score is used to generate a video streaming parameter adjustment scheme. Finally, the video streaming parameter adjustment scheme is used to adjust the video streaming parameters of the panoramic video terminal. The scheme provided in this application uses multi-dimensional network status data containing multiple indicators to evaluate network quality and then adjusts the video streaming parameters. Therefore, video streaming can be dynamically adjusted according to network status, adapting to changing wireless network environments. Furthermore, by applying multiple indicators to evaluate network quality from multiple dimensions, the accuracy of the evaluation is improved, the quality of video streaming is enhanced, and problems such as screen tearing and stuttering are avoided.

[0115] Reference Figure 4 The following is a diagram of a multi-pull parameter joint adaptive control architecture based on network quality comprehensive scoring, provided in another embodiment of this application.

[0116] In another embodiment provided in this application, a multi-pull parameter joint adaptive control architecture based on network quality comprehensive score is applied to a system that applies the solution provided in this application. The architecture is divided into a data acquisition layer and a data processing and parameter adjustment layer. The data acquisition layer is used to collect multi-dimensional data of the network status of the wireless network. For example, it collects the signal-to-noise ratio, received signal strength indication (RSSI) and other indicators through the wireless network card driver in the physical layer / link layer, and collects the packet loss rate, network latency and real-time bandwidth of the wireless network through the Real-time Transport Protocol (RTP) statistics module. Furthermore, the data acquisition layer can collect multi-dimensional network status data from mobile / embedded devices using different operating systems, including but not limited to Android and iOS. When collecting multi-dimensional network status data from Android mobile / embedded devices, the received signal strength can be obtained through the `getRssi()` method of the `WifiInfo` class, and the signal-to-noise ratio (SNR) can be calculated based on the wireless channel bandwidth. Packet loss rate and network latency can be statistically analyzed using `NetworkStatsManager` and the RTP protocol. When collecting multi-dimensional network status data from iOS mobile / embedded devices, RSSI and SNR can be obtained through the `CWInterface` class extended by `CoreWLAN`. Packet loss rate and latency in network transmission can be statistically analyzed using the `CFNetwork` framework. The data acquisition methods differ for different operating systems, thus making it applicable to multiple operating systems and improving compatibility with various operating systems.

[0117] The data processing and parameter tuning layer includes an RTP statistics module, a comprehensive quality assessment engine, and a multi-parameter joint controller. The RTP statistics module performs statistical analysis on the transmission status of the streaming data to obtain information such as packet loss rate, network jitter, and real-time bandwidth.

[0118] The comprehensive quality assessment engine processes the collected multi-dimensional network state data using a data fusion and weighting algorithm, outputting a comprehensive network quality score. For details on the processing procedure of the comprehensive quality assessment engine using the data fusion and weighting algorithm for the collected multi-dimensional network state data, please refer to [link to previous section]. Figure 1 The explanation of S102 in the previous section will not be repeated here. The multi-parameter joint controller, based on the comprehensive network quality score, coordinates the video encoding and streaming parameters through a parameter adjustment matrix. Further details on the adjustment process can be found in [link to previous section]. Figure 1 The explanations of S103 and S104 are not repeated here. The parameters that are adjusted include, but are not limited to, bitrate (QP), frame rate (FPS), motion search range, and GOP structure.

[0119] By incorporating the aforementioned multi-parameter joint adaptive control architecture, the streaming system can dynamically adjust streaming parameters as the wireless network changes during video streaming. This allows the video streaming process to adapt to changes in the wireless network, making the streamed video more compatible with the wireless network conditions and improving streaming quality.

[0120] Reference Figure 5 The following is a flowchart of adaptive push stream parameter adjustment based on network quality comprehensive score grading response, which is provided in another embodiment of this application. The details are as follows.

[0121] The streaming parameter adjustment process provided in this application includes a dual response mechanism for network degradation and network recovery. As shown in the figure, the network quality level is determined by a comprehensive network quality score. The network quality level can be divided into three levels: slight, moderate and severe during the degradation process. The adjustment methods are different for different degradation levels. Preferably, the parameter adjustment is only performed when the wireless network is in a stable state.

[0122] When the overall network quality score is greater than 80, the network quality level is determined to be excellent. At this time, the highest values ​​of each streaming parameter are used for streaming, such as high frame rate, high motion search accuracy, fixed long GOP structure, and highest resolution. This allows high-quality video data to be pushed when the network quality is optimal.

[0123] When the network quality is at different levels of degradation, the corresponding adjustment operations are performed.

[0124] Taking the gradual degradation of network quality from excellent to severely deteriorated as an example, when the overall network quality score is greater than 80, the network quality level is determined to be excellent. At this time, all streaming parameters are pushed at their highest values, such as high frame rate, high motion search accuracy, fixed long GOP structure, and highest resolution, thus pushing high-quality video data when the network quality is optimal. When the overall network quality score is greater than 60 and less than or equal to 80, the network quality level is slightly deteriorated. When the network deteriorates from excellent to slightly deteriorated, a first-level adjustment of various streaming parameters is required after the network stabilizes. At this time, only the bitrate is fine-tuned, while the frame rate, resolution, and GOP structure remain unchanged. When the overall network quality score is greater than 40 and less than or equal to 60, the network quality level is moderately deteriorated. When the network deteriorates from slightly deteriorated to moderately deteriorated, a second-level adjustment of various streaming parameters is required after the network stabilizes. The adjustments include reducing the frame rate, narrowing the motion search range, and slightly reducing the bitrate (the reduction range can be 20%~40%). When the overall network quality score is less than 40, the network quality level is severely degraded. When the network degrades from moderately degraded to severely degraded, it is necessary to adjust the various streaming parameters in three levels after the network stabilizes. The adjustment includes shortening the GOP length, enabling ROI (Region of Interest) encoding, significantly reducing the resolution (the reduction can be ≥50%), and significantly reducing the bitrate (the reduction can be ≥50%).

[0125] Another embodiment provided in this application describes network recovery and the adjustment of streaming parameters, illustrating the process of the network gradually recovering from severe degradation to excellent. When the network level recovers from severe degradation to moderate degradation, the values ​​of various streaming parameters at the severe degradation level are adjusted to the values ​​corresponding to moderate degradation; when the network level recovers from moderate degradation to slight degradation, the values ​​of various streaming parameters at the moderate degradation level are adjusted to the values ​​corresponding to slight degradation; when the network level recovers from slight degradation to excellent, the values ​​of various streaming parameters at the slight degradation level are adjusted to the values ​​corresponding to excellent.

[0126] It should be noted that network degradation or recovery can occur not only in a gradual manner but also across different network quality levels. For example, a network might suddenly degrade from excellent to moderately degraded, or vice versa. In the embodiments provided in this application, the streaming parameters are adjusted using a gradient-smooth adjustment method. This ensures that the streaming parameters change gradually in a step-like manner, avoiding sudden parameter changes. Preferably, the adjustment range for different streaming parameters varies depending on the network quality level, allowing for rapid adjustment of the streaming parameters to values ​​that match the network quality level.

[0127] For example, regarding the streaming parameter bitrate, when the network quality level is slightly deteriorated, the bitrate adjustment range is 10%. Specifically, when the network shows a deteriorating trend, the maximum bitrate reduction is 10%, and when the network shows a recovery trend, the maximum bitrate increase is 10%. When the network quality level is severely deteriorated, the bitrate reduction range is 50%. Specifically, when the network shows a deteriorating trend, the maximum bitrate reduction is 50%, and when the network shows a recovery trend, the maximum bitrate increase is 50%, and so on. The bitrate adjustment at other network quality levels and the adjustment of other streaming parameters at various network quality levels will not be elaborated here.

[0128] Furthermore, when adjusting the streaming parameters, adjustments should be made only when the network is stable. After a change in network quality level, the streaming parameters should only be adjusted if the duration of the changed network quality level meets preset conditions. For example, when the wireless network recovers from moderate degradation to slight degradation, it needs to remain at a slightly degraded state for N consecutive acquisition cycles to confirm a stable recovery from moderate degradation to slight degradation. The streaming parameters are then adjusted using a gradient smoothing method. After adjusting the streaming parameters in the current acquisition cycle, if the adjustment conditions are still met in the next acquisition cycle, the gradient smoothing method is continued. Thus, the streaming parameters gradually converge to the target value. This application adjusts the streaming parameters when the network is stable, filtering out misjudgments caused by sudden network changes, thereby ensuring streaming stability.

[0129] The solution provided in this application establishes a tiered parameter adjustment strategy, which coordinates the adjustment of multiple parameters such as bitrate, frame rate, and resolution according to the gradient changes in network quality. This adapts to the transmission characteristics of panoramic video and effectively solves video quality problems caused by signal attenuation and sudden packet loss in wireless networks. Furthermore, by designing a two-way response mechanism of "degradation" due to network deterioration and "slow recovery" due to network recovery, the solution makes rapid and stable parameter adjustments to changes in network quality, avoiding video clipping caused by sudden parameter changes and reducing the probability of stuttering during panoramic video streaming.

[0130] Although the present invention describes the operations in a specific order, this should not be construed as requiring these operations to be performed in the specific order shown or in a sequential order. In certain circumstances, multitasking and parallel processing may be advantageous.

[0131] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0132] Reference Figure 6The diagram below illustrates the structure of a panoramic video streaming parameter adjustment device according to another embodiment of this application, specifically including: The data acquisition module 601 is used to acquire multi-dimensional network status data of the panoramic video terminal in the current acquisition period. The multi-dimensional network status data includes multiple indicators for evaluating the network quality of the panoramic video terminal. The network quality assessment module 602 is used to assess the network quality of the panoramic video terminal using the multi-dimensional network status data, and generate a comprehensive network quality score corresponding to the current acquisition cycle. The streaming parameter scheme generation module 603 is used to generate a video streaming parameter adjustment scheme based on the network quality comprehensive score. The streaming parameter adjustment module 604 is used to apply the video streaming parameter adjustment scheme to adjust the streaming parameters of the panoramic video terminal.

[0133] The panoramic video streaming parameter adjustment device provided in this application periodically collects multi-dimensional network status data of the panoramic video terminal. This multi-dimensional network status data includes multiple indicators for evaluating the network quality of the panoramic video terminal. The device uses the multi-dimensional network status data of the panoramic video terminal in the current collection period to evaluate the network quality of the panoramic video terminal. The resulting comprehensive network quality score is used to generate a video streaming parameter adjustment scheme. Finally, the video streaming parameter adjustment scheme is used to adjust the video streaming parameters of the panoramic video terminal. The solution provided in this application uses multi-dimensional network status data containing multiple indicators to evaluate network quality and then adjusts the video streaming parameters. Therefore, video streaming can be dynamically adjusted according to network status, adapting to changing wireless network environments. Furthermore, by applying multiple indicators to evaluate network quality from multiple dimensions, the accuracy of the evaluation is improved, the quality of video streaming is enhanced, and problems such as screen tearing and stuttering are avoided.

[0134] In another embodiment of the apparatus provided in this application, the network quality assessment module includes: The first calculation submodule is used to calculate the various basic evaluation indicators in the multidimensional data of network status to obtain the basic network quality score. The second calculation submodule is used to calculate the network quality basic score and the various comprehensive evaluation indicators in the network status multidimensional data to obtain the network quality comprehensive score.

[0135] In another embodiment of the apparatus provided in this application, the push flow parameter scheme generation module includes: The first determining submodule is used to determine the network quality level of the panoramic video terminal based on the comprehensive network quality score. The second determining submodule is used to determine the target values ​​of each streaming parameter of the panoramic video terminal at the network quality level; The generation submodule is used to generate a video streaming parameter adjustment scheme by applying the target values ​​of each of the streaming parameters.

[0136] In another embodiment of the apparatus provided in this application, the push flow parameter adjustment module includes: The first acquisition submodule is used to acquire the current value of each streaming parameter of the panoramic video terminal; The holding submodule is used to keep the value of each streaming parameter of the panoramic video terminal unchanged when the current value of each streaming parameter of the panoramic video terminal is the same as the target value; The second acquisition submodule is used to acquire the historical network quality record of the panoramic video terminal when there is a push parameter whose current value is different from the target value. The historical network quality record contains the historical network quality level of the panoramic video terminal in each consecutive historical acquisition cycle. The third determining submodule is used to determine the network change type of the panoramic video terminal based on the historical network quality records and the network quality level; The adjustment submodule is used to adjust the streaming parameters of the panoramic video terminal according to the video streaming parameter adjustment scheme and the parameter adjustment rules of the network change type.

[0137] In another embodiment of the apparatus provided in this application, the third determining submodule includes: The first determining unit is configured to determine a target historical network quality level in the historical network quality record, wherein the target historical network quality level is the most recent historical network quality level in the historical network quality record that is different from the network quality level; The second determining unit is configured to determine the network change type of the panoramic video terminal as a network recovery type when the network quality level is higher than the target historical network quality level; and to determine the network change type of the panoramic video terminal as a network degradation type when the network quality level is lower than the target historical network quality level.

[0138] In another embodiment of the apparatus provided in this application, the adjustment submodule includes: The first adjustment unit is used to determine whether the network of the panoramic video terminal is stable when the network change type is network recovery type, by applying the parameter adjustment rules of the network recovery type; when the network of the panoramic video terminal is determined to be stable, a target streaming parameter is determined among the streaming parameters, and the value of the target streaming parameter is adjusted based on the target value of the target streaming parameter; when the network of the panoramic video terminal is unstable, the value of each streaming parameter of the panoramic video terminal remains unchanged. The second adjustment unit is used to determine whether the network of the panoramic video terminal is stable when the network change type is network degradation, by applying the parameter adjustment rules of the network degradation type; when the network of the panoramic video terminal is determined to be stable, the value of each streaming parameter is adjusted according to the adjustment strategy of each streaming parameter; when the network of the panoramic video terminal is unstable, the value of each streaming parameter of the panoramic video terminal is kept unchanged.

[0139] This application embodiment also provides a storage medium, the storage medium including stored instructions, wherein, when the instructions are executed, the device where the storage medium is located is controlled to execute the above-described panoramic video streaming parameter adjustment method.

[0140] This application also provides an electronic device, the structural schematic diagram of which is shown below. Figure 7 As shown, it specifically includes a memory 701 and one or more instructions 702, wherein one or more instructions 702 are stored in the memory 701 and configured to be executed by one or more processors 703 to perform the following operations: The network status multidimensional data of the panoramic video terminal in the current acquisition period is obtained. The network status multidimensional data includes multiple indicators for evaluating the network quality of the panoramic video terminal. The network quality of the panoramic video terminal is evaluated using the multidimensional network status data, and a comprehensive network quality score corresponding to the current acquisition cycle is generated. A video streaming parameter adjustment scheme is generated based on the comprehensive network quality score. The video streaming parameter adjustment scheme is applied to adjust the video streaming parameters of the panoramic video terminal.

[0141] It should be noted that the information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, data stored, data displayed, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of related data shall comply with the relevant laws, regulations and standards of the relevant regions.

[0142] The specific implementation processes and derivative methods of the above embodiments are all within the protection scope of this invention.

[0143] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to mutually. Each embodiment focuses on describing the differences from other embodiments. In particular, for system or system embodiments, since they are basically similar to method embodiments, the description is relatively simple, and relevant parts can be referred to the descriptions in the method embodiments. The systems and system embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without creative effort.

[0144] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the components and steps of the various examples have been generally described in terms of functionality in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0145] The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for adjusting panoramic video streaming parameters, characterized in that, include: The network status multidimensional data of the panoramic video terminal in the current acquisition period is obtained. The network status multidimensional data includes multiple indicators for evaluating the network quality of the panoramic video terminal. The network quality of the panoramic video terminal is evaluated using the multidimensional network status data, and a comprehensive network quality score corresponding to the current acquisition cycle is generated. A video streaming parameter adjustment scheme is generated based on the comprehensive network quality score. The video streaming parameter adjustment scheme is applied to adjust the video streaming parameters of the panoramic video terminal.

2. The method according to claim 1, characterized in that, The process of evaluating the network quality of the panoramic video terminal using the multidimensional network status data and generating a comprehensive network quality score corresponding to the current acquisition cycle includes: The basic evaluation indicators in the multidimensional network state data are calculated to obtain the basic network quality score. The comprehensive network quality score is obtained by calculating the basic network quality score and the comprehensive evaluation indicators in the multidimensional network status data.

3. The method according to claim 1, characterized in that, The video streaming parameter adjustment scheme generated based on the comprehensive network quality score includes: The network quality level of the panoramic video terminal is determined based on the comprehensive network quality score. Determine the target values ​​for each streaming parameter of the panoramic video terminal at the network quality level; A video streaming parameter adjustment scheme is generated by applying the target values ​​of each of the streaming parameters.

4. The method according to claim 3, characterized in that, The application of the video streaming parameter adjustment scheme to adjust the video streaming parameters of the panoramic video terminal includes: Obtain the current value of each streaming parameter of the panoramic video terminal; When the current value of each streaming parameter of the panoramic video terminal is the same as the target value, the value of each streaming parameter of the panoramic video terminal remains unchanged. When there is a streaming parameter whose current value is different from the target value, the historical network quality record of the panoramic video terminal is obtained. The historical network quality record contains the historical network quality level of the panoramic video terminal in each consecutive historical acquisition cycle. Based on the historical network quality records and the network quality level, the network change type of the panoramic video terminal is determined; Based on the video streaming parameter adjustment scheme and the parameter adjustment rules for the network change type, the streaming parameters of the panoramic video terminal are adjusted.

5. The method according to claim 4, characterized in that, Determining the network change type of the panoramic video terminal based on the historical network quality records and the network quality level includes: Determine a target historical network quality level from the historical network quality records. The target historical network quality level is the most recent historical network quality level in the historical network quality records that is different from the target network quality level. When the network quality level is higher than the target historical network quality level, the network change type of the panoramic video terminal is determined to be the network recovery type. When the network quality level is lower than the target historical network quality level, the network change type of the panoramic video terminal is determined to be the network degradation type.

6. The method according to claim 5, characterized in that, The step of adjusting the streaming parameters of the panoramic video terminal according to the video streaming parameter adjustment scheme and the parameter adjustment rules of the network change type includes: When the network change type is network recovery type, the parameter adjustment rules of the network recovery type are applied to determine whether the network of the panoramic video terminal is stable; When the network of the panoramic video terminal is determined to be stable, a target streaming parameter is determined among the various streaming parameters, and the value of the target streaming parameter is adjusted based on the target value of the target streaming parameter; when the network of the panoramic video terminal is unstable, the value of each streaming parameter of the panoramic video terminal remains unchanged. When the network change type is network degradation, the parameter adjustment rules for the network degradation type are applied to determine whether the network of the panoramic video terminal is stable. When the network of the panoramic video terminal is determined to be stable, the value of each streaming parameter is adjusted according to the adjustment strategy of each streaming parameter; when the network of the panoramic video terminal is unstable, the value of each streaming parameter of the panoramic video terminal remains unchanged.

7. A panoramic video streaming parameter adjustment device, characterized in that, include: The data acquisition module is used to acquire multi-dimensional network status data of the panoramic video terminal in the current acquisition period. The multi-dimensional network status data includes multiple indicators for evaluating the network quality of the panoramic video terminal. The network quality assessment module is used to assess the network quality of the panoramic video terminal using the multi-dimensional network status data, and generate a comprehensive network quality score corresponding to the current acquisition cycle. The streaming parameter scheme generation module is used to generate a video streaming parameter adjustment scheme based on the network quality comprehensive score. The streaming parameter adjustment module is used to apply the video streaming parameter adjustment scheme to adjust the streaming parameters of the panoramic video terminal.

8. The apparatus according to claim 7, characterized in that, The network quality assessment module includes: The first calculation submodule is used to calculate the various basic evaluation indicators in the multidimensional data of network status to obtain the basic network quality score. The second calculation submodule is used to calculate the network quality basic score and the various comprehensive evaluation indicators in the network status multidimensional data to obtain the network quality comprehensive score.

9. A storage medium, characterized in that, The storage medium includes stored instructions, wherein, when the instructions are executed, the device containing the storage medium is controlled to perform the panoramic video streaming parameter adjustment method as described in any one of claims 1-6.

10. An electronic device, characterized in that, It includes a memory and one or more instructions, wherein one or more instructions are stored in the memory and configured to be executed by one or more processors to implement the panoramic video streaming parameter adjustment method as described in any one of claims 1-6.