A method for ultra-high-definition video transmission based on multiplexing communication

Abstract

The present invention discloses an ultra-high-definition video transmission method based on multiplexed communication, and relates to the technical field of video transmission. The ultra-high-definition video transmission method based on multiplexed communication includes the following steps: obtaining a first video signal; obtaining a transmission-related index; obtaining a first composite stream; decoding and integration. The present invention obtains a first video signal by performing signal processing on an initial video signal, then obtains a second video signal according to the first video signal, and performs composite stream transmission to obtain a transmission-related index, and then performs a comprehensive evaluation according to the transmission-related index to obtain a transmission quality index, thereby obtaining a first composite stream, and finally performing decoding and integration processing on the first composite stream, thereby achieving the effect of improving the transmission quality during video data transmission, and solving the problem of low transmission quality during video data transmission in the prior art.

Description

Technical Field

[0001] The present invention relates to the technical field of video transmission, and in particular to an ultra-high definition video transmission method based on multiplexed communication. Background Art

[0002] With the rapid development of network communication technology, video transmission technology has also been significantly improved. Ultra-high-definition video transmission has extremely high requirements for bandwidth and transmission efficiency, and multiplexing technology can effectively utilize network resources and improve transmission efficiency through reasonable data segmentation and merging. Multiplexing technology is a technology that combines multiple low-speed channels into a high-speed channel, aiming to improve the utilization of data links. It allows a high-speed backbone link to provide services for multiple low-speed access links at the same time, so that the network backbone can carry a large amount of voice and data transmission at the same time. Multiplexing technology is usually divided into frequency division multiplexing, time division multiplexing, wavelength division multiplexing, code division multiple access and space division multiple access. Each type has its specific application scenarios and technical characteristics. With the continuous development of video technology, ultra-high-definition video (such as 4K, 8K, etc.) has gradually become mainstream. These video contents have higher resolution and frame rate, but also bring greater data transmission volume and bandwidth requirements. In order to achieve smooth transmission of ultra-high-definition video, efficient data compression, encoding and transmission technology is needed to reduce transmission bandwidth requirements and improve transmission efficiency. With the continuous development and commercial deployment of new generation mobile communication technologies such as 5G and 6G, network bandwidth and transmission speed have been significantly improved. This provides a more solid network infrastructure support for ultra-high-definition video transmission. At the same time, the widespread application of optical fiber communication technology has further improved the reliability and stability of network transmission, providing a better transmission environment for ultra-high-definition video transmission.

[0003] Existing methods use network transmission technologies such as local area networks and the Internet to achieve online streaming media playback and transmission, allowing ultra-high-definition video content to be watched over the Internet anytime and anywhere, but require stable and fast network environment support.

[0004] For example, the invention patent with announcement number CN103024366B announces an ultra-high-definition video signal remote transmission system, including: a signal source interface end, a single optical fiber, and a display interface end; the signal source interface end separates the second optical signal sent by the display interface end from the optical fiber; converts it into a second serial signal, deserializes it to obtain ED ID information, outputs the video signal according to the display resolution, decodes and serially converts it to obtain several first serial signals; converts each signal into a first optical signal, and sends each first optical signal to the display interface end via the optical fiber after wavelength division multiplexing; the display interface end converts the EDID information into a second serial signal, and then converts it into a second optical signal, and sends it to the signal source interface end via the optical fiber; separates the first optical signal from the optical fiber; after converting it into several first serial signals, deserializes and encodes them to obtain the video signal.

[0005] For example, the invention patent with announcement number CN112672223B discloses a highly reliable distribution method for satellite transmission of ultra-high-definition video, including: receiving equal packets of ultra-high-definition video from a satellite transmission channel; sorting the received equal packets according to the packet sequence numbers of the equal packets, and determining the packet sequence number of the retransmitted data packet from the sorting sequence result; sending the packet sequence number of the retransmitted data packet to a data retransmission device via a TCP reliable connection, so that the data retransmission device returns the retransmitted data packet found from a first data storage device via the reliable connection; receiving the returned retransmitted data packet, and splicing the retransmitted data packet with the equal packets received from the satellite transmission channel to obtain a complete ultra-high-definition video.

[0006] However, in the process of implementing the technical solution of the invention in the embodiments of the present application, the present application found that the above technology has at least the following technical problems:

[0007] In the prior art, limited bandwidth resources often cannot meet the demand for rapid transmission of large amounts of data, resulting in a decrease in data transmission speed and low transmission quality during video data transmission. Summary of the invention

[0008] The embodiment of the present application solves the problem of low transmission quality during video data transmission in the prior art by providing an ultra-high-definition video transmission method based on multiplexed communication, thereby improving the transmission quality during video data transmission.

[0009] The embodiment of the present application provides an ultra-high-definition video transmission method based on multiplexed communication, comprising the following steps: S1, performing signal processing on the acquired initial video signal to obtain a first video signal, wherein the signal processing includes decoding, caching and segmentation; S2, performing multiplexing processing on the first video signal to obtain a second video signal, and performing composite stream transmission on the second video signal to obtain a transmission-related index, wherein the transmission-related index includes a transmission rate index, a transmission efficiency index and a transmission accuracy index, wherein the transmission rate index is used to evaluate the transmission rate change during the composite stream transmission, and the transmission efficiency index is used to evaluate the transmission accuracy during the composite stream transmission. Efficiency, the transmission accuracy index is used to measure the accuracy of the composite stream transmission process, the multiplexing process is used to merge the first video signal into a composite stream, the second video signal is the first video signal after multiplexing, and the composite stream transmission is used to reduce the delay in the second video signal transmission process; S3, a transmission quality index is obtained by comprehensive evaluation based on the transmission related index, and the first composite stream is obtained according to the transmission quality index, and the transmission quality index is used to evaluate the quality of composite stream transmission; S4, the first composite stream is decoded and integrated, and the decoding integration process is used to decode and split the first composite stream into sub-streams and then recombine them into a high-definition video stream.

[0010] Furthermore, the specific acquisition process of the first video signal is as follows: an initial video signal is acquired through an acquisition device during a preset data collection time period, and the acquisition device is used to ensure that the acquired video signal meets the ultra-high-definition standard; the acquired initial video signal is decoded to obtain a decoded signal, and the decoding is used to convert the initial video signal; the cached decoded signal is segmented to obtain a first video signal, and the segmentation is used to improve the efficiency of multiplexing processing.

[0011] Furthermore, the specific acquisition process of the transmission rate index is as follows: measuring first transmission data through a first transmission device in a preset time period during the composite stream transmission process, the first transmission device including a spectrum analyzer, a signal-to-noise ratio tester, a network tester and a timer, the first transmission data including a first channel width, a first signal-to-noise ratio, a first transmission data volume and a first transmission time; obtaining a first rate measurement value according to the first channel width and the first signal-to-noise ratio, and obtaining a first effective rate measurement value according to the first transmission data volume and the first transmission time; obtaining a preset first rate threshold, a preset first effective rate threshold, a preset first rate weight and a preset second rate weight from a database, and obtaining the transmission rate index in combination with the first rate measurement value and the first effective rate measurement value.

[0012] Furthermore, the transmission rate index is calculated using the following formula:

[0013]

[0014] In the formula, represents the transmission rate index of the i-th preset time period during the composite stream transmission process, i=1,2,...,f, i represents the number of the preset time period, f represents the total number of preset time periods, R i1 represents the first rate measurement value of the i-th preset time period during the composite flow transmission process, R i2 represents the first effective rate measurement value of the i-th preset time period during the composite stream transmission process, R 1 Represents the preset first rate threshold, R 2 Indicates the preset first effective rate threshold, μ 1 Represents the preset first rate weight, μ 2 represents the preset second rate weight, and e represents a natural constant.

[0015] Furthermore, the specific process of obtaining the transmission efficiency index is as follows: measuring second transmission data through a second transmission device in a preset time period during the composite stream transmission process, the second transmission device includes a network tester and a timer, and the second transmission data includes a first segment length, a first round-trip time, and a first packet loss rate; obtaining a preset segment length threshold, a preset round-trip time threshold, and a preset packet loss rate threshold from a database, and obtaining a preset throughput threshold based on the obtained data; obtaining a first throughput measurement value based on the measured second transmission data, and obtaining the transmission efficiency index in combination with the preset throughput threshold.

[0016] Furthermore, the transmission efficiency index is calculated using the following formula:

[0017]

[0018] In the formula, represents the transmission efficiency index of the i-th preset time period during the composite flow transmission process, i=1,2,...,f, i represents the number of the preset time period, f represents the total number of preset time periods, T i represents the first throughput measurement value of the i-th preset time period during the composite stream transmission process, T 0 represents a preset throughput threshold value in the i-th preset time period during the composite flow transmission process, and e represents a natural constant.

[0019] Furthermore, the specific acquisition process of the transmission accuracy index is as follows: measuring the third transmission data through the third transmission equipment in a preset time period during the composite stream transmission process, the third transmission equipment includes a bit error tester and a high-speed digital oscilloscope, and the third transmission data includes the number of error code elements, the first total number of code elements, the number of error bits and the first total number of bits; obtaining a first bit error rate measurement value based on the number of error code elements and the first total number of code elements, and obtaining a first bit error rate measurement value based on the number of error bits and the first total number of bits; obtaining a preset first bit error rate threshold, a preset second bit error rate threshold, a preset first bit error weight and a preset second bit error weight from the database, and obtaining the transmission accuracy index in combination with the first bit error rate measurement value and the first bit error rate measurement value.

[0020] Furthermore, the transmission accuracy index is calculated using the following formula:

[0021]

[0022] In the formula, represents the transmission accuracy index of the i-th preset time period during the composite stream transmission process, i=1,2,...,f, i represents the number of the preset time period, f represents the total number of preset times, M i1 represents the first bit error rate measurement value of the i-th preset time period during the composite stream transmission process, M i2 represents the first bit error rate measurement value of the i-th preset time period during the composite stream transmission process, M 1 Indicates the preset first bit error rate threshold, M 2 Indicates the preset second bit error rate threshold, δ 1 represents the preset first error weight, δ 2 represents a preset second bit error weight, and e represents a natural constant.

[0023] Furthermore, the specific acquisition process of the first composite stream is as follows: obtain a preset first quality weight, a preset second quality weight and a preset third quality weight from a database, and obtain a transmission quality index in combination with a transmission-related index; compare the transmission quality index with a preset transmission range to determine whether the transmission quality index is within the preset transmission range, and if so, obtain the first composite stream within the corresponding preset transmission range; otherwise, re-multiplex the first video signal until the transmission quality index is within the preset transmission range.

[0024] Furthermore, the specific process of decoding and integrating the first composite stream is as follows: performing separation processing on the first composite stream to obtain separated sub-streams, and the separation processing is used to separate the sub-streams in the composite stream; performing secondary decoding processing on the separated sub-streams to obtain decoded sub-streams, and the secondary decoding means decoding the separated sub-streams through a decoder; recombining the decoded sub-streams to obtain a combined sub-stream, and the recombining means combining the decoded sub-streams through a preset encapsulation format; and performing high-definition processing on the combined sub-stream.

[0025] One or more technical solutions provided in the embodiments of the present application have at least the following technical effects or advantages:

[0026] 1. The first video signal is obtained by performing signal processing on the obtained initial video signal, and then the first video signal is multiplexed to obtain the second video signal, and the second video signal is composited and transmitted to obtain a transmission related index, and then a comprehensive evaluation is performed based on the transmission related index to obtain a transmission quality index, and a first composite stream is obtained based on the transmission quality index. Finally, the first composite stream is decoded and integrated, thereby realizing multi-angle evaluation of data transmission quality, and then realizing improvement of transmission quality in the process of video data transmission, and effectively solving the problem of low transmission quality in the process of video data transmission in the prior art.

[0027] 2. By comparing the transmission quality index with the preset transmission range, it is determined whether the transmission quality index is within the preset transmission range. If it is within the preset transmission range, the first composite stream corresponding to the preset transmission range is obtained, otherwise the first video signal is re-multiplexed until the transmission quality index is within the preset transmission range, thereby realizing the screening of qualified transmission quality indexes and further improving the accuracy of evaluating transmission quality.

[0028] 3. The process of generating data stream is optimized by separating the first composite stream to obtain separated sub-streams, then performing secondary decoding on the separated sub-streams to obtain decoded sub-streams, then recombining the decoded sub-streams to obtain combined sub-streams, and finally performing high-definition processing on the combined sub-streams, thereby achieving improvement in the quality of generated data streams. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] Figure 1 A flow chart of an ultra-high-definition video transmission method based on multiplexed communication provided in an embodiment of the present application;

[0030] Figure 2 A statistical chart of changes in the transmission efficiency index provided in an embodiment of the present application. DETAILED DESCRIPTION

[0031] The embodiment of the present application solves the problem of low transmission quality in the process of video data transmission in the prior art by providing an ultra-high-definition video transmission method and device based on multiplexed communication, by performing signal processing on the acquired initial video signal to obtain the first video signal, then multiplexing the first video signal to obtain the second video signal, and performing composite stream transmission on the second video signal to obtain a transmission related index, and then performing comprehensive evaluation based on the transmission related index to obtain a transmission quality index, and obtaining a first composite stream based on the transmission quality index, and finally decoding and integrating the first composite stream, thereby achieving improved transmission quality in the process of video data transmission.

[0032] The technical solution in the embodiment of the present application is to solve the problem of low transmission quality during the above-mentioned video data transmission process, and the overall idea is as follows:

[0033] The first video signal is obtained by processing the initial video signal, and then the second video signal is obtained based on the first video signal. Composite stream transmission is performed to obtain a transmission related index, and then a comprehensive evaluation is performed based on the transmission related index to obtain a transmission quality index, based on which the first composite stream is obtained, and finally the first composite stream is decoded and integrated, thereby improving the transmission quality during video data transmission.

[0034] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0035] like Figure 1As shown, it is a flow chart of an ultra-high-definition video transmission method based on multiplexed communication provided by an embodiment of the present application, the method comprising the following steps: S1, performing signal processing on the acquired initial video signal to obtain a first video signal, the signal processing comprising decoding, caching and segmentation, the first video signal representing the initial video signal after signal processing; S2, performing multiplexing processing on the first video signal to obtain a second video signal, and performing composite stream transmission on the second video signal to obtain transmission related indexes, the transmission related indexes comprising a transmission rate index, a transmission efficiency index and a transmission accuracy index, the transmission rate index is used to evaluate the transmission rate change during the composite stream transmission, and the transmission efficiency index is used to evaluate the composite stream transmission accuracy. The transmission efficiency during the transmission process, the transmission accuracy index is used to measure the accuracy of the composite stream transmission process, the multiplexing process is used to merge the first video signal into a composite stream, the second video signal is the first video signal after the multiplexing process, and the composite stream transmission is used to reduce the delay in the second video signal transmission process; S3, a comprehensive evaluation is performed based on the transmission-related index to obtain a transmission quality index, and a first composite stream is obtained based on the transmission quality index. The first composite stream represents a composite stream that meets the preset transmission range, and the transmission quality index is used to evaluate the quality of composite stream transmission; S4, the first composite stream is decoded and integrated, and the decoding integration process is used to decode and split the first composite stream into sub-streams and then recombine them into a high-definition video stream.

[0036] In this embodiment, signal processing is performed on signals sent by multiple transmission parties to obtain a first video signal of a small unit, and the first video signal is multiplexed to merge the first video signals of the small unit into a composite stream to obtain a second video signal. Then, based on the second video signal, a first composite stream that meets a preset transmission range is obtained, composite streams with unqualified quality are screened out, and finally, the first composite stream is decoded and integrated to obtain split sub-streams, which are then synchronously transmitted to multiple receiving parties, thereby improving the transmission quality during video data transmission.

[0037] Furthermore, the specific acquisition process of the first video signal is as follows: an initial video signal is acquired through an acquisition device during a preset data collection time period, the acquisition device is used to ensure that the acquired video signal meets the ultra-high-definition standard, and the initial video signal represents a video signal that meets the ultra-high-definition standard; the acquired initial video signal is decoded to obtain a decoded signal, and the decoding is used to convert the initial video signal, and the decoded signal represents the decoded initial video signal, and the conversion includes parsing the bit stream, entropy decoding, inverse quantization and inverse transformation, frame reconstruction and post-processing; the cached decoded signal is segmented to obtain the first video signal, and the segmentation is used to improve the efficiency of the multiplexing processing, and the cache is used to smooth the data stream and reduce playback jams.

[0038] In this embodiment, an ultra-high-definition image acquisition sensor (such as an ultra-high-definition camera) is used to acquire the original video signal to ensure that the quality of the acquired video signal meets the ultra-high-definition standard (such as 4K, 8K, etc.), and the code stream is parsed to divide the received initial video signal into manageable units, such as frames, slices or macroblocks, etc. Entropy decoding is a lossless decoding technology used to recover the original symbols from the compressed bit stream to reduce redundancy and save storage space. After entropy decoding, quantized transform coefficients are obtained. The inverse quantization process is to restore these coefficients to the state before quantization, and the inverse transform is to convert these frequency domain coefficients back to the time domain (i.e., the pixel domain) to reconstruct the pixel values ​​of the video frame. Frame reconstruction is to use the decoded pixel values, motion vectors and possible other auxiliary information (such as prediction residuals) to reconstruct the complete video frame. Post-processing is an optional step in the decoding process, which is used to improve the visual quality of the reconstructed video frame; the transmission quality is improved during the video data transmission process.

[0039] Furthermore, a specific process of obtaining the transmission rate index is as follows: first transmission data is measured by a first transmission device in a preset time period during the composite stream transmission process, the first transmission device includes a spectrum analyzer, a signal-to-noise ratio tester, a network tester and a timer, the first transmission data includes a first channel width, a first signal-to-noise ratio, a first transmission data volume and a first transmission time, the first channel width represents the channel width of the second video signal in the preset time period during the composite stream transmission process, the first signal-to-noise ratio represents the signal-to-noise ratio of the second video signal in the preset time period during the composite stream transmission process, the first transmission data volume represents the data volume of the second video signal transmitted in the preset time period during the composite stream transmission process, and the first transmission time represents the time required for the second video signal to be transmitted in the preset time period during the composite stream transmission process; according to the first channel A first rate measurement value is obtained according to a first transmission data volume and a first signal-to-noise ratio, and a first effective rate measurement value is obtained according to the first transmission data volume and the first transmission time, the first rate measurement value represents a measurement value of the transmission rate of the second video signal in a preset time period during the composite stream transmission, and the first effective rate measurement value represents a measurement value of the effective rate of the second video signal in a preset time period during the composite stream transmission; a preset first rate threshold, a preset first effective rate threshold, a preset first rate weight and a preset second rate weight are obtained from a database, and a transmission rate index is obtained in combination with the first rate measurement value and the first effective rate measurement value, the preset first rate weight is used to evaluate the influence of the first rate measurement value on the transmission rate index, and the preset second rate weight is used to evaluate the influence of the first effective rate measurement value on the transmission rate index.

[0040] In this embodiment, a spectrum analyzer is an electronic instrument for measuring the spectrum content of a signal. It can display the distribution of a signal in the frequency domain, i.e., the individual frequency components of the signal and their power or amplitude. A signal-to-noise ratio tester is specifically used to measure the ratio between a signal and noise, i.e., the signal-to-noise ratio. It helps evaluate the quality of a signal and determines whether the signal can be effectively received and processed in a noisy environment. A network tester is an instrument for diagnosing, testing, and verifying the performance of a computer network. It can simulate various network traffic and conditions to evaluate key performance indicators such as network throughput, delay, and packet loss rate. A timer is a device for measuring time, which can be accurate to seconds, milliseconds, or even shorter time units. The preset first rate threshold is represented by calculating the mean of the first rate data in the database, and the preset first effective rate threshold is represented by calculating the mean of the first effective rate data in the database; the transmission quality during video data transmission is improved.

[0041] Specifically, the preset first rate weight is obtained from a database; in a specific embodiment, a fitting curve is obtained by fitting the relationship between the first rate measurement value and the corresponding transmission rate index within a historical period, and the first rate measurement value is input according to the fitting curve to obtain the preset first rate weight corresponding to the first rate measurement value.

[0042] Specifically, the preset second rate weight is obtained from a database; in a specific embodiment, a fitting curve is obtained by fitting the relationship between the first effective rate measurement value and the corresponding transmission rate index within a historical period, and the first effective rate measurement value is input according to the fitting curve to obtain the preset second rate weight corresponding to the first effective rate measurement value.

[0043] Furthermore, the transmission rate index is calculated using the following formula:

[0044]

[0045] In the formula, represents the transmission rate index of the i-th preset time period during the composite stream transmission process, i=1,2,...,f, i represents the number of the preset time period, f represents the total number of preset time periods, R i1 represents the first rate measurement value of the i-th preset time period during the composite flow transmission process, R i2 represents the first effective rate measurement value of the i-th preset time period during the composite stream transmission process, R 1 Represents the preset first rate threshold, R 2 Indicates the preset first effective rate threshold, μ 1 Represents the preset first rate weight, μ 2represents the preset second rate weight, and e represents a natural constant.

[0046] In this embodiment, the algorithm of this embodiment combines the first rate measurement value R i1 and the first effective rate measurement value R i2 , the transmission rate index of the i-th preset time period in the composite flow transmission process is obtained by comprehensive analysis, and the definition is ΔR 1 is the first deviation, ΔR 2 is the second deviation; the first rate measurement value R in this formula i1 and the first effective rate measurement value R i2 There is a common regulatory association between i1 and the first effective rate measurement value R i2 When R 1 and R 2 When ΔR is small enough 1 and ΔR 2 The transmission rate index gradually increases. At this time, the first rate measurement value R i1 and the first effective rate measurement value R i2 It is positively correlated with the transmission rate index, but when R 1 and R 2 When ΔR is large enough, 1 and ΔR 2 The transmission rate index gradually decreases. At this time, the first rate measurement value R i1 and the first effective rate measurement value R i2 It is negatively correlated with the transmission rate index, so it can be accurately analyzed by establishing a mathematical form.

[0047] Specifically, R i1 =B i *log 2 (1+S i ), Among them, B i represents the first channel width of the i-th preset time period during the composite stream transmission process, S i represents the first signal-to-noise ratio of the i-th preset time period during the composite stream transmission process, L i represents the first transmission data volume in the i-th preset time period during the composite stream transmission process, T i Indicates the first transmission time of the i-th preset time period during the composite stream transmission process.

[0048] It should be explained that the first channel width B i The expression is: Among them, B i' represents the first channel width data of the i-th preset time period during the composite stream transmission process, B i 0 represents the reference first channel width data of the i-th preset time period during the composite stream transmission process, ΔB i represents the first channel width reference deviation, the first signal-to-noise ratio S i The expression is: Among them, S i ' represents the first signal-to-noise ratio data of the i-th preset time period during the composite stream transmission process, S i 0 represents the reference first signal-to-noise ratio data of the i-th preset time period during the composite flow transmission process, ΔS i represents the first signal-to-noise ratio reference deviation, the first transmission data volume L i The expression is: Among them, L i ' represents the first transmission data volume data of the i-th preset time period during the composite stream transmission process, L i 0 represents the reference first transmission data volume data of the i-th preset time period during the composite stream transmission process, ΔL i represents the first transmission data volume reference deviation, the first transmission time T i The expression is: Among them, T i ' represents the first transmission time data of the i-th preset time period during the composite stream transmission process, T i 0 represents the reference first transmission time data of the i-th preset time period during the composite stream transmission process, ΔT i Indicates the first transmission time reference deviation.

[0049] It should be understood that the first channel width data of the i-th preset time period in the composite stream transmission process is obtained by measurement, the reference first channel width data is represented by the result of calculating the average of the first channel width data of the i-th preset time period in the composite stream transmission process, the first channel width reference deviation is obtained by calculating the first channel width data and the reference first channel width data through a deviation formula, the first signal-to-noise ratio data of the i-th preset time period in the composite stream transmission process is obtained by measurement, the reference first signal-to-noise ratio data is represented by the result of calculating the average of the first signal-to-noise ratio of the i-th preset time period in the composite stream transmission process, the first signal-to-noise ratio reference deviation is obtained by calculating the first signal-to-noise ratio data and the reference first signal-to-noise ratio data through a deviation formula, and the first transmission data volume data of the i-th preset time period in the composite stream transmission process is obtained by measurement. The method obtains the first transmission data volume data by calculating the mean value of the first transmission data volume in the i-th preset time period during the composite stream transmission process, obtains the first transmission data volume reference deviation by calculating the first transmission data volume data and the reference first transmission data volume data through a deviation formula, obtains the first transmission time data in the i-th preset time period during the composite stream transmission process by measurement, obtains the reference first transmission time data by calculating the mean value of the first transmission time in the i-th preset time period during the composite stream transmission process, obtains the first transmission time reference deviation by calculating the first transmission time data and the reference first transmission time data through a deviation formula, and the deviation formula is used to measure the difference between the reference value and the actual measurement value, and is expressed by the difference between the reference value and the actual measurement value; and improves the transmission quality during video data transmission.

[0050] Furthermore, the specific process of obtaining the transmission efficiency index is as follows: measuring second transmission data through a second transmission device in a preset time period during the composite stream transmission process, the second transmission device includes a network tester and a timer, the second transmission data includes a first segment length, a first round-trip time and a first packet loss rate, the first segment length represents the maximum segment length of the second video signal in the preset time period during the composite stream transmission process, the first round-trip time represents the round-trip time required for the transmission of the second video signal in the preset time period during the composite stream transmission process, and the first packet loss rate represents the probability of the second video signal being lost in the preset time period during the composite stream transmission process; obtaining a preset segment length threshold, a preset round-trip time threshold and a preset packet loss rate threshold from a database, and obtaining a preset throughput threshold based on the obtained data, the preset throughput threshold represents a preset throughput of the second video signal in the preset time period during the composite stream transmission process; obtaining a first throughput measurement value based on the measured second transmission data, and obtaining the transmission efficiency index in combination with the preset throughput threshold.

[0051] In this embodiment, the preset segment length threshold is expressed by calculating the average value of the segment length data in the database, the preset round-trip time threshold is expressed by calculating the average value of the round-trip time data in the database, and the preset packet loss rate threshold is expressed by calculating the average value of the packet loss rate data in the database. 0 represents the preset throughput threshold of the i-th preset time period during the composite stream transmission process, specifically through Get, M 0 Indicates the preset segment length threshold, t 0 represents the preset round trip time threshold, p 0 Indicates the preset packet loss rate threshold; it improves the transmission quality during video data transmission.

[0052] Furthermore, the transmission efficiency index is calculated using the following formula:

[0053]

[0054] In the formula, represents the transmission efficiency index of the i-th preset time period during the composite flow transmission process, i=1,2,...,f, i represents the number of the preset time period, f represents the total number of preset time periods, T i represents the first throughput measurement value of the i-th preset time period during the composite stream transmission process, T 0 represents a preset throughput threshold value in the i-th preset time period during the composite flow transmission process, and e represents a natural constant.

[0055] In this embodiment, as the first throughput measurement value T i The increase in T means that more data can be carried in the same transmission cycle, which relatively reduces the risk of packet loss caused by network congestion, signal interference and other factors. 0 Enough hours, The overall value increases gradually, and the transmission efficiency index increases gradually. At this time, the first throughput measurement value T i It is positively correlated with the transmission efficiency index, but when T 0 When it is big enough, The overall value decreases gradually, and the transmission efficiency index decreases gradually. At this time, the first throughput measurement value T i It is negatively correlated with the transmission efficiency index, so it can be accurately analyzed by establishing a mathematical form.

[0056] Specifically, Among them, M i represents the length of the first segment in the i-th preset time period during the composite stream transmission process, t i represents the first round trip time of the i-th preset time period during the composite stream transmission process, p irepresents the first packet loss rate of the i-th preset time period during the composite stream transmission process, M 0 Indicates the preset segment length threshold, t 0 represents the preset round trip time threshold, p 0 Indicates the preset packet loss rate threshold.

[0057] Specifically, the length of the first message segment is M i The range is 1000-5000 (bytes), the first round trip time t i The range is 10-100 (ms), the first packet loss rate p i The range is 0-1, and the preset segment length threshold M 0 The preset round trip time threshold t is 4000. 0 is 100 (ms), and the preset packet loss rate threshold p 0 is 1, as shown in Table 1, which is a statistical table of changes in the transmission efficiency index provided in the embodiment of the present application:

[0058] Table 1 Statistics of changes in transmission efficiency index

[0059]

[0060] As can be seen from the table, as the length of the first message segment M i The first round trip time t i and the first packet loss rate p i The transmission efficiency index Gradually increases, at this time the length of the first message segment is M i It is positively correlated with the transmission efficiency index. The first round trip time t i and the first packet loss rate p i It is negatively correlated with the transmission efficiency index, which means that the transmission efficiency during composite stream transmission is gradually improved; the transmission quality during video data transmission is improved.

[0061] Furthermore, a specific process of obtaining the transmission accuracy index is as follows: measuring third transmission data through a third transmission device in a preset time period during the composite stream transmission process, the third transmission device including a bit error tester and a high-speed digital oscilloscope, the third transmission data including an error symbol number, a first total symbol number, an error bit number and a first total bit number, the error symbol number indicates the number of symbols of the second video signal that have transmission errors in the preset time period during the composite stream transmission process, the first total symbol number indicates the number of symbols of the second video signal that are transmitted in total in the preset time period during the composite stream transmission process, the error bit number indicates the number of bits of the second video signal that have transmission errors in the preset time period during the composite stream transmission process, and the first total bit number indicates the number of bits of the second video signal that are transmitted in total in the preset time period during the composite stream transmission process; according to the error A first bit error rate measurement value is obtained based on the number of bit errors and the first total number of bits, and a first bit error rate measurement value is obtained based on the number of error bits and the first total number of bits, the first bit error rate measurement value represents the measurement value of the bit error rate of the second video signal in a preset time period during the composite stream transmission, and the first bit error rate measurement value represents the measurement value of the bit error rate of the second video signal in a preset time period during the composite stream transmission; a preset first bit error rate threshold, a preset second bit error rate threshold, a preset first bit error weight and a preset second bit error weight are obtained from a database, and a transmission accuracy index is obtained in combination with the first bit error rate measurement value and the first bit error rate measurement value, the preset first bit error weight is used to evaluate the influence of the first bit error rate measurement value on the transmission accuracy index, and the preset second bit error weight is used to evaluate the influence of the first bit error rate measurement value on the transmission accuracy index.

[0062] In this embodiment, the preset first bit error rate is represented by calculating the mean value of the first bit error rate data in the database, the preset second bit error rate is represented by calculating the mean value of the second bit error rate data in the database, and the preset second bit error rate is represented by calculating the mean value of the second bit error rate data in the database. The bit error tester is a special instrument used to measure the bit error rate and bit error data in digital signal transmission. The bit error tester determines the bit error rate by injecting a specific error code into the digital signal and then detecting whether the receiving end correctly receives the error code. The high-speed digital oscilloscope is an electronic measuring instrument used in the field of electronics and communication technology, mainly used to display and analyze the waveform and characteristics of electronic signals, with an extremely high sampling rate, capable of capturing and displaying the waveform details of high-speed signals; it realizes the improvement of transmission quality during video data transmission.

[0063] Specifically, the preset first bit error weight is obtained from a database; in a specific embodiment, a fitting curve is obtained by fitting the relationship between the first bit error rate measurement value and the corresponding transmission accuracy index within a historical period, and the first bit error rate measurement value is input according to the fitting curve to obtain the preset first bit error weight corresponding to the first bit error rate measurement value.

[0064] Specifically, the preset second bit error weight is obtained from a database; in a specific embodiment, a fitting curve is obtained by fitting the relationship between the first bit error rate measurement value and the corresponding transmission accuracy index in a historical period, and the first bit error rate measurement value is input according to the fitting curve to obtain the preset second bit error weight corresponding to the first bit error rate measurement value.

[0065] Furthermore, the transmission accuracy index is calculated using the following formula:

[0066]

[0067] In the formula, represents the transmission accuracy index of the i-th preset time period during the composite stream transmission process, i=1,2,...,f, i represents the number of the preset time period, f represents the total number of preset times, M i1 represents the first bit error rate measurement value of the i-th preset time period during the composite stream transmission process, M i2 represents the first bit error rate measurement value of the i-th preset time period during the composite stream transmission process, M 1 Indicates the preset first bit error rate threshold, M 2 Indicates the preset second bit error rate threshold, δ 1 represents the preset first error weight, δ 2 represents a preset second bit error weight, and e represents a natural constant.

[0068] In this embodiment, as the first bit error rate measurement value M i1 and the first bit error rate measurement value M i2 When M 1 and M 2 Enough hours, Overall and The overall value increases gradually, and the transmission accuracy index decreases gradually. At this time, the first bit error rate measurement value M i1 and the first bit error rate measurement value M i2 It is negatively correlated with the transmission accuracy index, but when M 1 and M 2 When it is big enough, Overall and The overall value gradually decreases, and the transmission accuracy index gradually increases. At this time, the first bit error rate measurement value M i1 and the first bit error rate measurement value M i2 It is positively correlated with the transmission accuracy index, so it can be accurately analyzed by establishing a mathematical form.

[0069] Specifically, Among them, W irepresents the number of error symbols in the i-th preset time period during the composite stream transmission process, W Zi represents the first total number of symbols in the i-th preset time period during the composite stream transmission process, B i Indicates the number of error bits in the i-th preset time period during the composite stream transmission process, B Zi Indicates the first total number of bits in the i-th preset time period during the composite stream transmission process.

[0070] Assumption: δ 1 =0.5,δ 2 =0.5, the first bit error rate measurement value M i1 The range is 0-0.1, the first bit error rate measurement value M i2 The range is 0-0.01, and the first bit error rate threshold M is preset 1 is 0.5, and the second bit error rate threshold M is preset 2 is 0.05, such as Figure 2 As shown in the figure, it is a statistical diagram of the transmission accuracy index provided in the embodiment of the present application. As can be seen from the figure, as the first bit error rate measurement value M i1 and the first bit error rate measurement value M i2 The transmission accuracy index Gradually increases, at this time the first bit error rate measurement value M i1 and the first bit error rate measurement value M i2 Transmission Accuracy Index The positive correlation means that the transmission accuracy during the composite stream transmission is gradually improved, and the transmission quality during the video data transmission is improved.

[0071] Furthermore, the specific acquisition process of the first composite stream is as follows: a preset first quality weight, a preset second quality weight and a preset third quality weight are obtained from a database, and a transmission quality index is obtained in combination with a transmission-related index, wherein the preset first quality weight is used to evaluate the influence of a transmission rate index on a transmission quality index, the preset second quality weight is used to evaluate the influence of a transmission efficiency index on a transmission quality index, and the preset third quality weight is used to evaluate the influence of a transmission accuracy index on a transmission quality index; the transmission quality index is compared with a preset transmission range to determine whether the transmission quality index is within the preset transmission range, and if so, the first composite stream within the preset transmission range is obtained, otherwise the first video signal is re-multiplexed until the transmission quality index is within the preset transmission range.

[0072] In this embodiment, the transmission rate index is used to evaluate the change in transmission rate during the composite stream transmission process. It reflects the speed and stability of data transmission. Ideally, the higher the transmission rate index, the larger the amount of data transmitted per unit time, and the transmission efficiency index may also increase accordingly. An increase in the transmission efficiency index usually means that more valid data is successfully transmitted, which helps to reduce the additional overhead caused by retransmitting erroneous data, thereby improving the transmission accuracy index. Therefore, it is necessary to consider the impact of the three for a comprehensive evaluation; thereby achieving improved transmission quality during video data transmission.

[0073] Specifically, the transmission quality index is obtained in the following manner:

[0074]

[0075] Where D i represents the transmission quality index of the i-th preset time period during the composite stream transmission process, i = 1, 2, ..., f, i represents the number of the preset time period, f represents the total number of preset times, β 1 is the preset first quality weight, β 2 is the preset second quality weight, β 3 To preset the third quality weight, represents the transmission rate index of the i-th preset time period during the composite stream transmission process, represents the transmission efficiency index of the i-th preset time period during the composite flow transmission process, It represents the transmission accuracy index of the i-th preset time period during the composite stream transmission process.

[0076] Specifically, the preset first quality weight is obtained from a database; in a specific embodiment, a fitting curve is obtained by fitting the relationship between the transmission rate index and the corresponding transmission quality index in a historical period, and the transmission rate index is input according to the fitting curve to obtain the preset first quality weight corresponding to the transmission rate index.

[0077] Specifically, the preset second quality weight is obtained from a database; in a specific embodiment, a fitting curve is obtained by fitting the relationship between the transmission efficiency index and the corresponding transmission quality index in a historical period, and the transmission efficiency index is input according to the fitting curve to obtain the preset second quality weight corresponding to the transmission efficiency index.

[0078] Specifically, the preset third quality weight is obtained from a database; in a specific embodiment, a fitting curve is obtained by fitting the relationship between the transmission accuracy index and the corresponding transmission quality index in a historical period, and the transmission accuracy index is input according to the fitting curve to obtain the preset third quality weight corresponding to the transmission accuracy index.

[0079] Furthermore, the specific process of decoding and integrating the first composite stream is as follows: performing separation processing on the first composite stream to obtain a separated sub-stream, the separation processing is used to separate the sub-streams in the composite stream, and the separated sub-stream represents the first composite stream that has been separated; performing secondary decoding processing on the separated sub-stream to obtain a decoded sub-stream, the secondary decoding means decoding the separated sub-stream by a decoder, and the decoded sub-stream represents the separated sub-stream that has been subjected to secondary decoding processing; recombining the decoded sub-stream to obtain a combined sub-stream, the recombining means combining the decoded sub-stream by a preset encapsulation format, and the combined sub-stream represents the recombined decoded sub-stream; performing high-definition processing on the combined sub-stream, and the high-definition processing includes up-conversion, color correction, denoising and sharpening.

[0080] In this embodiment, a specific separation tool (such as a demultiplexer) is used to separate each substream according to the identifier in the composite stream, and the separated substream is decoded using a corresponding decoder (such as a video decoder, an audio decoder). The decoding process is to convert the compressed data stream back to the original data, such as uncompressed video frames and audio samples, and reassemble the decoded video frames, audio samples, etc. into one or more combined substreams according to a preset packaging format, such as MP4 (MPEG-4 Part 14) multimedia computer file format, MKV (Matroska Video File) multimedia packaging format, Up-conversion: Increase the video resolution to a higher level to support high-definition or ultra-high-definition display, improve the details and clarity of the image by increasing the number of pixels, Color correction: Adjust the color balance, contrast and saturation of the video to obtain a more natural or more attractive visual effect, Denoising: Reduce noise and interference in the video, improve the picture quality and clarity, Sharpening: Enhance the edge details of the video image to make the picture clearer and sharper; Improve the transmission quality during the video data transmission process.

[0081] In summary, the embodiment of the present application obtains a first video signal by performing signal processing on the obtained initial video signal, then multiplexing the first video signal to obtain a second video signal, and performing composite stream transmission on the second video signal to obtain a transmission related index, and then performing a comprehensive evaluation based on the transmission related index to obtain a transmission quality index, and obtaining a first composite stream based on the transmission quality index, and finally decoding and integrating the first composite stream, thereby achieving multi-angle evaluation of data transmission quality, and further achieving improved transmission quality during video data transmission, effectively solving the problem of low transmission quality during video data transmission in the prior art.

[0082] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0083] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0084] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0085] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0086] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0087] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for ultra-high definition video transmission based on multiplexed communication, characterized in that: The following steps are involved: S1, performing signal processing on the acquired initial video signal to acquire a first video signal, wherein the signal processing includes decoding, caching and segmentation; S2, multiplexing the first video signal to obtain a second video signal, and performing composite stream transmission on the second video signal to obtain transmission related indexes, wherein the transmission related indexes include a transmission rate index, a transmission efficiency index, and a transmission accuracy index, wherein the transmission rate index is used to evaluate the transmission rate change during composite stream transmission, the transmission efficiency index is used to evaluate the transmission efficiency during composite stream transmission, and the transmission accuracy index is used to measure the accuracy during composite stream transmission, wherein the multiplexing process is used to merge the first video signal into a composite stream, wherein the second video signal is the first video signal after multiplexing process, and wherein the composite stream transmission is used to reduce the delay during the transmission of the second video signal; S3, performing a comprehensive evaluation according to the transmission-related index to obtain a transmission quality index, and obtaining a first composite stream according to the transmission quality index, wherein the transmission quality index is used to evaluate the quality of composite stream transmission; S4, performing decoding and integration processing on the first composite stream, wherein the decoding and integration processing is used to decode and split the first composite stream into sub-streams and then reassemble them into a high-definition video stream; The specific process of obtaining the transmission rate index is as follows: measuring first transmission data by a first transmission device during a preset time period of the composite stream transmission process, the first transmission device comprising a spectrum analyzer, a signal-to-noise ratio tester, a network tester and a timer, the first transmission data comprising a first channel width, a first signal-to-noise ratio, a first transmission data volume and a first transmission time; Acquire a first rate measurement value according to a first channel width and a first signal-to-noise ratio, and acquire a first effective rate measurement value according to a first transmission data volume and a first transmission time; Obtaining a preset first rate threshold, a preset first effective rate threshold, a preset first rate weight, and a preset second rate weight from a database, and obtaining a transmission rate index in combination with the first rate measurement value and the first effective rate measurement value; The transmission rate index is calculated using the following formula: In the formula, represents the transmission rate index of the i-th preset time period during the composite stream transmission process, i=1,2,...,f, i represents the number of the preset time period, f represents the total number of preset time periods, R i1 represents the first rate measurement value of the i-th preset time period during the composite flow transmission process, R i2 represents a first effective rate measurement value of the i-th preset time period during the composite flow transmission process, R1 represents a preset first rate threshold, R2 represents a preset first effective rate threshold, μ1 represents a preset first rate weight, μ2 represents a preset second rate weight, and e represents a natural constant; The specific acquisition process of the first composite flow is as follows: Obtaining a preset first quality weight, a preset second quality weight, and a preset third quality weight from a database, and obtaining a transmission quality index in combination with the transmission-related index; The transmission quality index is compared with the preset transmission range to determine whether the transmission quality index is within the preset transmission range. If it is within the preset transmission range, the first composite stream within the corresponding preset transmission range is obtained; otherwise, the first video signal is re-multiplexed until the transmission quality index is within the preset transmission range.

2. A method for transmitting ultra-high definition video based on multiplexed communication as claimed in claim 1, characterized in that ,The specific acquisition process of the first video signal is as follows: Acquiring an initial video signal through a collection device during a preset data collection period, wherein the collection device is used to ensure that the collected video signal meets an ultra-high definition standard; Decoding the acquired initial video signal to acquire a decoded signal, wherein the decoding is used to convert the initial video signal; The buffered decoded signal is segmented to obtain a first video signal, wherein the segmentation is used to improve the efficiency of multiplexing processing.

3. The method for transmitting ultra-high definition video based on multiplexed communication as claimed in claim 1, characterized in that: The specific process of obtaining the transmission efficiency index is as follows: measuring second transmission data by a second transmission device during a preset time period of the composite stream transmission process, the second transmission device comprising a network tester and a timer, the second transmission data comprising a first segment length, a first round trip time and a first packet loss rate; Obtaining a preset segment length threshold, a preset round trip time threshold, and a preset packet loss rate threshold from a database, and obtaining a preset throughput threshold based on the acquired data; A first throughput measurement value is obtained according to the measured second transmission data, and a transmission efficiency index is obtained in combination with a preset throughput threshold.

4. The method for transmitting ultra-high definition video based on multiplexed communication as claimed in claim 3, characterized in that: The transmission efficiency index is calculated using the following formula: In the formula, represents the transmission efficiency index of the i-th preset time period during the composite flow transmission process, i=1,2,...,f, i represents the number of the preset time period, f represents the total number of preset time periods, T i represents a first throughput measurement value of the i-th preset time period during the composite stream transmission process, T0 represents a preset throughput threshold of the i-th preset time period during the composite stream transmission process, and e represents a natural constant.

5. The method for transmitting ultra-high definition video based on multiplexed communication as claimed in claim 1, characterized in that: The specific process of obtaining the transmission accuracy index is as follows: measuring third transmission data by a third transmission device during a preset time period of the composite stream transmission process, the third transmission device comprising a bit error tester and a high-speed digital oscilloscope, the third transmission data comprising the number of error symbols, the first total number of symbols, the number of error bits and the first total number of bits; Obtain a first bit error rate measurement value according to the number of error symbols and the first total number of symbols, and obtain a first bit error rate measurement value according to the number of error bits and the first total number of bits; A preset first bit error rate threshold, a preset second bit error rate threshold, a preset first bit error weight and a preset second bit error weight are obtained from a database, and a transmission accuracy index is obtained in combination with the first bit error rate measurement value and the first bit error rate measurement value.

6. The method for transmitting ultra-high definition video based on multiplexed communication as claimed in claim 5, characterized in that: The transmission accuracy index is calculated using the following formula: In the formula, represents the transmission accuracy index of the i-th preset time period during the composite stream transmission process, i=1,2,...,f, i represents the number of the preset time period, f represents the total number of preset times, M i1 represents the first bit error rate measurement value of the i-th preset time period during the composite stream transmission process, M i2 represents the first bit error rate measurement value of the i-th preset time period during the composite stream transmission process, M1 represents the preset first bit error rate threshold, M2 represents the preset second bit error rate threshold, δ1 represents the preset first bit error weight, δ2 represents the preset second bit error weight, and e represents a natural constant.

7. The method for transmitting ultra-high definition video based on multiplexed communication as claimed in claim 1, characterized in that: The specific process of decoding and integrating the first composite stream is as follows: performing separation processing on the first composite flow to obtain separated sub-flows, wherein the separation processing is used to separate the sub-flows in the composite flow; Performing secondary decoding processing on the separated substream to obtain a decoded substream, wherein the secondary decoding means decoding the separated substream by a decoder; Recombining the decoded substreams to obtain a combined substream, wherein the recombining means combining the decoded substreams by using a preset encapsulation format; Perform high definition processing on the combined sub-stream.

Images