A 5G-based ultra-high-definition video signal transmission system and method

Abstract

The present invention discloses a 5G-based ultra-high-definition video signal transmission system and method, and relates to the technical field of video signal transmission. The method is that the first terminal device first converts the 8K ultra-high-definition video screen to be transmitted into four independent 4K ultra-high-definition video signals in pairs, and then through encoding, multiplexing, modulation, 5G signal transceiving, demodulation, core network forwarding, re-modulation, 5G signal re-transmission, re-demodulation, demultiplexing and decoding processing, the four 4K ultra-high-definition video signals can be obtained at the second terminal device, and finally according to the four 4K ultra-high-definition video signals and the distribution mapping relationship between the pixel points and each 4K ultra-high-definition video signal, the 8K ultra-high-definition video screen is obtained by splicing and restoring, so that the high-speed transmission requirements when used for ultra-high-definition video signal transmission can be met, and the high accuracy requirements for signal processing when used for ultra-high-definition video signal transmission can be reduced, and the viewing experience of the receiving end user can be guaranteed.

Description

Technical Field

[0001] The present invention belongs to the technical field of video signal transmission, and specifically relates to a 5G-based ultra-high-definition video signal transmission system and method. Background Art

[0002] According to ITU-R BT.2020 "Parameter Values ​​for Program Production and International Exchange of Ultra-High Definition Television Systems" and GY / T307-2017 "Parameter Values ​​for Program Production and Exchange of Ultra-High Definition Television Systems", the resolution of ultra-high definition images is 3840×2160 and 7680×4320, which are commonly known as 4K and 8K. From the perspective of TV terminals, TV sets that can receive, process and display ultra-high definition programs are called ultra-high definition TVs. The resolution of a 4K ultra-high definition TV screen is 3840×2160 pixels, and the clarity can reach 2160 TV lines. The resolution of an 8K ultra-high definition TV screen is 7680×4320 pixels, and the clarity can reach 4320 TV lines. For the transmission of ultra-high definition video, according to the H.265 standard (350-1000 compression ratio), the transmission rate of 4K video transmission is at least 12-40Mbps, and the transmission rate of 8K video transmission is at least 48-160Mbps.

[0003] Since the data volume of 8K ultra-high-definition video is very large, the wireless transmission of 8K ultra-high-definition video signals is technically very difficult. In other words, the existing end-to-end video signal wireless transmission solutions have the following problems: (1) Since the required transmission rate is at least 48-160Mbps, and the wireless network speed of the fourth generation mobile communication technology 4G (The 4th Generation Mobile Communication Technology) is only 10-100Mbps, the existing end-to-end video signal wireless transmission solutions based on 4G are difficult to meet this high-speed transmission requirement; (2) Since the accuracy requirements for encoding, modulation, demodulation and decoding during the transmission process are higher, and the existing end-to-end video signal wireless transmission solutions are limited by terminal hardware conditions and the existence of inevitable air interface interference and other factors, it is also difficult to meet this high accuracy requirement. Once the transmission frame loss problem occurs, the video image will be lost, resulting in a black screen display phenomenon, which reduces the viewing experience of the receiving end user. Summary of the invention

[0004] The purpose of the present invention is to provide a 5G-based ultra-high-definition video signal transmission system and method to solve the problem that the existing end-to-end video signal wireless transmission solution is difficult to meet the high-speed transmission requirements and high accuracy requirements when used for ultra-high-definition video signal transmission.

[0005] In order to achieve the above object, the present invention adopts the following technical solutions:

[0006] In a first aspect, a 5G-based ultra-high-definition video signal transmission system is provided, comprising a first terminal device, a first base station, a core network, a second base station, and a second terminal device, wherein the first terminal device is connected to the first base station based on the fifth generation mobile communication technology 5G wireless communication, the first base station is connected to the core network by wired communication, the core network is connected to the second base station by wired communication, and the second base station is connected to the second terminal device based on the fifth generation mobile communication technology 5G wireless communication;

[0007] The first terminal device is used to first convert the 8K ultra-high-definition video picture to be transmitted into four independent 4K ultra-high-definition video signals in pairs: assign all pixel points with odd horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture to the first 4K ultra-high-definition video signal, assign all pixel points with even horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture to the second 4K ultra-high-definition video signal, assign all pixel points with odd horizontal coordinates and even vertical coordinates in the 8K ultra-high-definition video picture to the third 4K ultra-high-definition video signal, and convert the 8K ultra-high-definition video picture into four independent 4K ultra-high-definition video signals. All pixel points whose horizontal coordinates are even and whose vertical coordinates are even are assigned to a fourth 4K ultra-high-definition video signal, and then the four 4K ultra-high-definition video signals are respectively encoded into four 4K ultra-high-definition video transmission stream signals corresponding to the four 4K ultra-high-definition video signals one by one, and then the four 4K ultra-high-definition video transmission stream signals are multiplexed into one transmission stream to generate one 8K ultra-high-definition video transmission stream signal, and then the one 8K ultra-high-definition video transmission stream signal is modulated to the working frequency band of 5G to obtain a first modulation signal, and finally the first modulation signal after power amplification is transmitted to the first base station;

[0008] The first base station is configured to, after receiving the first modulated signal, demodulate the first modulated signal after signal amplification to obtain the one-way 8K ultra-high-definition video transmission stream signal, and transmit the one-way 8K ultra-high-definition video transmission stream signal to the core network;

[0009] The core network is used to transmit the 8K ultra-high-definition video transmission stream signal to the second base station;

[0010] The second base station is used to modulate the 8K ultra-high-definition video transmission stream signal to the working frequency band of 5G to obtain a second modulated signal, and transmit the second modulated signal after power amplification to the second terminal device;

[0011] The second terminal device is used to demodulate the second modulated signal after receiving the second modulated signal to obtain the 8K ultra-high-definition video transmission stream signal, and then demultiplex the 8K ultra-high-definition video transmission stream signal to obtain the four 4K ultra-high-definition video transmission stream signals, and then respectively decode the four 4K ultra-high-definition video transmission stream signals to obtain the four 4K ultra-high-definition video signals, and finally splice and restore the 8K ultra-high-definition video screen according to the four 4K ultra-high-definition video signals and the allocation mapping relationship between the pixel points and each 4K ultra-high-definition video signal.

[0012] Based on the above invention, an end-to-end ultra-high-definition video signal wireless transmission solution based on the fifth generation mobile communication technology 5G is provided, that is, the first terminal device first converts the 8K ultra-high-definition video screen to be transmitted into four independent 4K ultra-high-definition video signals in pairs, and then through encoding, multiplexing, modulation, 5G signal transceiving, demodulation, core network forwarding, re-modulation, 5G signal re-transmission, re-demodulation, demultiplexing and decoding processing, the four-channel 4K ultra-high-definition video signals can be obtained at the second terminal device, and finally, according to the four-channel 4K ultra-high-definition video signals and the pixel points and each channel of 4K ultra-high-definition video The distribution mapping relationship of the frequency signals is restored through splicing to obtain the 8K ultra-high-definition video image. In this way, the high-speed transmission characteristics of 5G can be used to meet the high-speed transmission requirements for ultra-high-definition video signal transmission. In addition, since four-channel 4K ultra-high-definition video signals are actually processed, the high accuracy requirements for signal processing when used for ultra-high-definition video signal transmission are reduced. Even if a certain 4K ultra-high-definition video signal loses frame during transmission, it will only cause the brightness of the restored 8K image to be reduced, and will not cause a black screen due to the loss of the entire 8K image, thereby ensuring the viewing experience of users at the receiving end.

[0013] In a possible design, an 8K ultra-high-definition camera and an 8K ultra-high-definition display device are also included, wherein the 8K ultra-high-definition camera is connected to the first terminal device via a fiber optic cable or a 48G digital component serial interface cable for wired communication, and the 8K ultra-high-definition display device is connected to the second terminal device via another fiber optic cable or a 48G digital component serial interface cable for wired communication;

[0014] The 8K ultra-high-definition camera is used to capture and obtain 8K ultra-high-definition video images to be transmitted, and transmit the captured images to the first terminal device via wire;

[0015] The 8K ultra high-definition display device is used to load and display the 8K ultra high-definition video images from the second terminal device.

[0016] In a second aspect, a 5G-based ultra-high-definition video signal transmission method is provided, including:

[0017] The first terminal device converts the 8K ultra-high-definition video picture to be transmitted into four independent 4K ultra-high-definition video signals in pairs: all pixels with odd horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture are allocated to the first 4K ultra-high-definition video signal, all pixels with even horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture are allocated to the second 4K ultra-high-definition video signal, all pixels with odd horizontal coordinates and even vertical coordinates in the 8K ultra-high-definition video picture are allocated to the third 4K ultra-high-definition video signal, and all pixels with even horizontal coordinates and even vertical coordinates in the 8K ultra-high-definition video picture are allocated to the fourth 4K ultra-high-definition video signal;

[0018] The first terminal device encodes the four channels of 4K ultra-high-definition video signals into four channels of 4K ultra-high-definition video transmission stream signals corresponding to the four channels of 4K ultra-high-definition video signals one by one;

[0019] The first terminal device multiplexes the four 4K ultra-high-definition video transmission stream signals into one transmission stream to generate one 8K ultra-high-definition video transmission stream signal;

[0020] The first terminal device modulates the 8K ultra-high-definition video transmission stream signal to the working frequency band of the fifth-generation mobile communication technology 5G to obtain a first modulated signal;

[0021] The first terminal device transmits the first modulated signal after power amplification to a first base station connected to the first terminal device based on the fifth generation mobile communication technology 5G wireless communication;

[0022] After receiving the first modulated signal, the first base station demodulates the first modulated signal after signal amplification to obtain the one-way 8K ultra-high-definition video transmission stream signal, and transmits the one-way 8K ultra-high-definition video transmission stream signal to the core network;

[0023] The core network transmits the 8K ultra-high-definition video transmission stream signal to a second base station connected to a second terminal device based on the fifth-generation mobile communication technology 5G wireless communication;

[0024] The second base station modulates the 8K ultra-high-definition video transmission stream signal to the working frequency band of 5G to obtain a second modulated signal, and transmits the second modulated signal after power amplification to the second terminal device;

[0025] After receiving the second modulated signal, the second terminal device demodulates the second modulated signal after signal amplification to obtain the one-way 8K ultra-high-definition video transmission stream signal;

[0026] The second terminal device demultiplexes the one-channel 8K ultra-high-definition video transmission stream signal to obtain the four-channel 4K ultra-high-definition video transmission stream signals;

[0027] The second terminal device decodes the four channels of 4K ultra-high-definition video transmission stream signals respectively to obtain the four channels of 4K ultra-high-definition video signals;

[0028] The second terminal device splices and restores the 8K ultra-high-definition video image based on the four 4K ultra-high-definition video signals and the allocation mapping relationship between the pixel points and each 4K ultra-high-definition video signal.

[0029] In a possible design, according to the four channels of 4K ultra-high-definition video signals and the distribution mapping relationship between the pixel points and the 4K ultra-high-definition video signals, the 8K ultra-high-definition video picture is obtained by splicing and restoring, including:

[0030] If it is found that one of the four 4K ultra-high-definition video signals has frame loss, then according to the other three 4K ultra-high-definition video signals among the four 4K ultra-high-definition video signals and the allocation mapping relationship between the pixel points and each 4K ultra-high-definition video signal, a video picture including all the pixel points having an allocation mapping relationship with the other three 4K ultra-high-definition video signals is spliced;

[0031] According to the video picture, a new 8K ultra-high-definition video picture for restoring to the 8K ultra-high-definition video picture is obtained in the following manner: for each pixel point in the video picture and having an allocation mapping relationship with the certain 4K ultra-high-definition video signal, the pixel value average result of the corresponding adjacent pixel points in eight directions is taken as the corresponding pixel value, wherein the eight directions include left, upper left, upper middle, upper right, right, lower right, lower middle and lower left directions.

[0032] In a possible design, according to the four channels of 4K ultra-high-definition video signals and the distribution mapping relationship between the pixel points and the 4K ultra-high-definition video signals, the 8K ultra-high-definition video picture is obtained by splicing and restoring, including:

[0033] If it is found that X channels of 4K ultra-high-definition video signals among the four channels of 4K ultra-high-definition video signals have frame loss, then according to the other Y channels of 4K ultra-high-definition video signals among the four channels of 4K ultra-high-definition video signals and the allocation mapping relationship between the pixels and the 4K ultra-high-definition video signals of each channel, a video picture including all the pixels having an allocation mapping relationship with the other Y channels of 4K ultra-high-definition video signals is spliced, wherein X and Y are natural numbers taking values ​​in the interval [1, 3] respectively, and the sum of X and Y is equal to 4;

[0034] According to the video picture and the previous frame of 8K ultra-high-definition video picture that has been restored locally and is adjacent to the video picture, a new 8K ultra-high-definition video picture used to restore the 8K ultra-high-definition video picture is obtained in the following manner:

[0035] For each pixel point in the video image that has an allocation mapping relationship with the X-channel 4K ultra-high-definition video signal, the following formula is used to express the corresponding unknown case:

[0036] C uk，i =(S i，0 , S i，1 , S i，2 …, S i，n …, S i，N , r i，t )

[0037] In the formula, i represents a non-zero natural number, C uk，i represents the i-th unknown case corresponding to the i-th pixel point in the video picture and having an allocation mapping relationship with the X-channel 4K ultra-high-definition video signal, S i，0 represents the known pixel value of the i-th pixel in the previous frame of 8K ultra-high-definition video, N represents the total number of pixel neighbors of a single pixel, n represents a natural number not greater than N, S i，n represents the known pixel value of the nth pixel neighbor of the i-th pixel in the previous frame of 8K ultra-high-definition video, r i，t represents the pixel value to be solved of the i-th pixel point in the video picture;

[0038] For each pixel point in the video screen that is used as a pixel point neighbor of the i-th pixel point and has an allocation mapping relationship with the other Y-channel 4K ultra-high-definition video signal, the following formula is used to express the corresponding known case:

[0039] C kn，ij =(S ij，0 , S ij， 1, S ij，2 …, S ij，n …, S ij，N , r ij，t )

[0040] In the formula, j represents a non-zero natural number, C kn，ij represents the jth known case that corresponds one-to-one with the jth pixel point that is a neighbor of the i-th pixel point in the video image and has an allocation mapping relationship with the other Y-channel 4K ultra-high-definition video signal, S ij，0 represents the known pixel value of the j-th pixel in the previous frame of 8K ultra-high-definition video, S ij，nrepresents the known pixel value of the nth pixel neighbor of the jth pixel in the previous frame of 8K ultra-high-definition video, r ij，t represents the known pixel value of the j-th pixel in the video picture;

[0041] The case similarity C between the i-th unknown case and the j-th known case is calculated according to the following formula: ij :

[0042]

[0043] In the formula, k represents a natural number;

[0044] The pixel value r to be solved for the i-th pixel point in the video image is calculated according to the following formula: i，t :

[0045]

[0046] Where M i It represents the total number of pixels in the video picture that are used as pixel neighbors of the i-th pixel and have an allocation mapping relationship with the other Y-channel 4K ultra-high-definition video signals.

[0047] In a possible design, when X is equal to 1, the pixel neighbors of a single pixel point refer to a first circle of pixel points surrounding the single pixel point, wherein the first circle of pixel points includes eight pixel points that are adjacent in sequence in a clockwise direction.

[0048] In one possible design, when X is equal to two, the pixel neighbors of a single pixel point refer to a first circle of pixel points used to surround the single pixel point and a second circle of pixel points used to surround the single pixel point and the first circle of pixel points, wherein the first circle of pixel points includes eight pixel points that are adjacent in sequence in a clockwise direction, and the second circle of pixel points includes sixteen pixel points that are adjacent in sequence in a clockwise direction.

[0049] In one possible design, when X is equal to three, the pixel neighbors of a single pixel point refer to a first circle of pixel points surrounding the single pixel point, a second circle of pixel points surrounding the single pixel point and the first circle of pixel points, and a third circle of pixel points surrounding the single pixel point, the first circle of pixel points, and the second circle of pixel points, wherein the first circle of pixel points includes eight pixel points that are adjacent in sequence in a clockwise direction, the second circle of pixel points includes sixteen pixel points that are adjacent in sequence in a clockwise direction, and the third circle of pixel points includes twenty-four pixel points that are adjacent in sequence in a clockwise direction.

[0050] In one possible design, the first base station transmits the 8K ultra-high-definition video transmission stream signal to the core network, including:

[0051] The first base station transmits the 8K ultra-high-definition video transmission stream signal to the edge cloud server;

[0052] The edge cloud server demultiplexes the one-channel 8K ultra-high-definition video transmission stream signal to obtain the four-channel 4K ultra-high-definition video transmission stream signals;

[0053] The edge cloud server decodes the four channels of 4K ultra-high-definition video transmission stream signals respectively to obtain the four channels of 4K ultra-high-definition video signals;

[0054] The edge cloud server determines whether any one of the four 4K ultra-high-definition video signals has frame loss or whether X 4K ultra-high-definition video signals have frame loss. If so, splicing and restoring are performed to obtain a new 8K ultra-high-definition video picture used as the 8K ultra-high-definition video picture according to the four 4K ultra-high-definition video signals and the allocation mapping relationship between the pixel points and each 4K ultra-high-definition video signal. Then, the new 8K ultra-high-definition video picture is converted into a new 8K ultra-high-definition video transmission stream signal used as the one 8K ultra-high-definition video transmission stream signal. Finally, the new 8K ultra-high-definition video transmission stream signal is transmitted to the core network. Otherwise, the one 8K ultra-high-definition video transmission stream signal is directly transmitted to the core network, where X is a natural number taking a value in the interval [1, 3].

[0055] In one possible design, the first base station transmits the 8K ultra-high-definition video transmission stream signal to the core network, including:

[0056] The first base station transmits the 8K ultra-high-definition video transmission stream signal to the edge cloud server;

[0057] The edge cloud server demultiplexes the one-channel 8K ultra-high-definition video transmission stream signal to obtain the four-channel 4K ultra-high-definition video transmission stream signals;

[0058] The edge cloud server decodes any one of the four 4K ultra-high-definition video transmission stream signals to obtain a 4K ultra-high-definition video signal;

[0059] The edge cloud server splices the 4K ultra-high-definition video signal to obtain a 4K ultra-high-definition video image;

[0060] The edge cloud server inputs the 4K ultra-high-definition video image into a pre-trained sensitive image recognition model based on a target detection algorithm to obtain a sensitive image recognition result;

[0061] The edge cloud server determines whether there are sensitive images exceeding a preset number threshold in the 4K ultra-high-definition video screen based on the sensitive image recognition result. If so, it terminates the transmission of the 8K ultra-high-definition video transmission stream signal to the core network and instructs the first base station to feedback a transmission failure message to the first terminal device. Otherwise, it continues to transmit the 8K ultra-high-definition video transmission stream signal to the core network.

[0062] Beneficial effects of the above scheme:

[0063] (1) The present invention creatively provides an end-to-end ultra-high-definition video signal wireless transmission solution based on the fifth generation mobile communication technology 5G, that is, the first terminal device first converts the 8K ultra-high-definition video screen to be transmitted into four independent 4K ultra-high-definition video signals, and then undergoes encoding, multiplexing, modulation, 5G signal transmission and reception, demodulation, core network forwarding, re-modulation, 5G signal re-transmission and reception, re-demodulation, demultiplexing and decoding processing, so that the four 4K ultra-high-definition video signals can be obtained at the second terminal device. Finally, according to the four 4K ultra-high-definition video signals and the pixel points and the 4K ultra-high-definition video signals of each channel, the four 4K ultra-high-definition video signals are transmitted and received by the second terminal device. The distribution mapping relationship of the frequency signals is restored by splicing to obtain the 8K ultra-high-definition video picture. In this way, the high-speed transmission characteristics of 5G can be used to meet the high-speed transmission requirements for ultra-high-definition video signal transmission. In addition, since four-channel 4K ultra-high-definition video signals are actually processed, the high accuracy requirements for signal processing when used for ultra-high-definition video signal transmission are reduced. Even if a certain channel of 4K ultra-high-definition video signal loses frame during transmission, it will only cause the brightness of the restored 8K picture to be reduced, and will not cause a black screen due to the loss of the entire 8K picture, which can ensure the viewing experience of the receiving end users.

[0064] (2) When it is found that one of the four 4K ultra-high-definition video signals has frame loss, the brightness of the corresponding pixel point can be increased by taking the average pixel value of all adjacent pixel points in eight directions corresponding to each pixel point in the video screen and having an allocation mapping relationship with the one 4K ultra-high-definition video signal as the corresponding pixel value, thereby achieving the purpose of restoring the brightness of the 8K screen, and further ensuring the viewing experience of the receiving end user;

[0065] (3) When it is found that one, two or three of the four 4K ultra-high-definition video signals have frame loss, a corresponding and approximate real pixel value solution result can be obtained by combining the similarity of the corresponding unknown case with the known cases of the surrounding pixel neighbors for each pixel point in the video screen that has an allocation mapping relationship with the one, two or three 4K ultra-high-definition video signals, so that the brightness of the corresponding pixel point can be accurately improved, and the purpose of accurately restoring the brightness of the 8K picture can be achieved, which can further ensure the viewing experience of the receiving end user;

[0066] (4) After the 8K UHD video transmission stream signal is transmitted uplink, it can detect whether some 4K UHD video signals have frame loss. If so, timely image repair can be performed to avoid the situation where all 4K UHD video signals have frame loss due to the superposition of frame loss after the subsequent 8K UHD video transmission stream signal is transmitted downlink, thereby further ensuring the viewing experience of users at the receiving end;

[0067] (5) After the 8K ultra-high-definition video transmission stream signal is transmitted uplink, it can detect whether there are sensitive images being transmitted in a manner that requires low computing resources. If sensitive images exceeding the preset number threshold are found, the legality of the transmission is denied, and the transmission of illegal videos is terminated in a timely manner to ensure the legality and compliance of network informatization. BRIEF DESCRIPTION OF THE DRAWINGS

[0068] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0069] Figure 1 A schematic diagram of the structure of a 5G-based ultra-high-definition video signal transmission system provided in an embodiment of the present application.

[0070] Figure 2 A flowchart of a 5G-based ultra-high-definition video signal transmission method provided in an embodiment of the present application.

[0071] Figure 3 An example diagram of the allocation and mapping relationship between each pixel point in an 8K ultra-high-definition video screen and each 4K ultra-high-definition video signal provided in an embodiment of the present application.

[0072] Figure 4 An example diagram of the positional relationship between a single pixel point and all adjacent pixel points in eight directions provided in an embodiment of the present application.

[0073] Figure 5An example diagram of the positional relationship between a single pixel and its neighbors provided in an embodiment of the present application, wherein: Figure 5 (a) shows the positional relationship between a single pixel and its neighbors when X is equal to 1. Figure 5 (b) shows the first positional relationship between a single pixel and its neighbors when X is equal to 2. Figure 5 (c) shows the second positional relationship between a single pixel and its neighbors when X is equal to 2. Figure 5 (d) shows the positional relationship between a single pixel and its neighbors when X is equal to three. DETAILED DESCRIPTION

[0074] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the present invention will be briefly introduced below in combination with the drawings and the description of the embodiments or the prior art. Obviously, the following description of the structure of the drawings is only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. It should be noted that the description of these embodiments is used to help understand the present invention, but does not constitute a limitation of the present invention.

[0075] It should be understood that although the terms first and second, etc. may be used herein to describe various objects, these objects should not be limited by these terms. These terms are only used to distinguish one object from another object. For example, a first object can be referred to as a second object, and similarly, a second object can be referred to as a first object without departing from the scope of the exemplary embodiments of the present invention.

[0076] It should be understood that the term "and / or" that may appear in this document is merely a description of the association relationship between associated objects, indicating that there may be three relationships. For example, A and / or B can indicate three situations: A exists alone, B exists alone, or A and B exist at the same time. For another example, A, B and / or C can indicate the existence of any one of A, B and C or any combination of them. The term " / and" that may appear in this document describes another type of association object relationship, indicating that there may be two relationships. For example, A / and B can indicate two situations: A exists alone or A and B exist at the same time. In addition, the character " / " that may appear in this document generally indicates that the previous and next associated objects are in an "or" relationship.

[0077] Example:

[0078] like Figures 1-2As shown, the ultra-high-definition video signal transmission method based on 5G provided in the first aspect of this embodiment is executed in sequence by various hardware modules in the ultra-high-definition video signal transmission system, wherein the ultra-high-definition video signal transmission system includes but is not limited to a first terminal device, a first base station, a core network, a second base station, and a second terminal device, etc. The first terminal device is connected to the first base station based on the fifth generation mobile communication technology 5G (The 5th Generation Mobile Communication Technology) wireless communication, the first base station is connected to the core network by wired communication, the core network is connected to the second base station by wired communication, the second base station is connected to the second terminal device based on the fifth generation mobile communication technology 5G wireless communication, and the first terminal device, the first base station, the core network, the second base station and the second terminal device can all be implemented using existing hardware modules.

[0079] like Figure 2 As shown, the ultra-high-definition video signal transmission method includes but is not limited to the following steps S1 to S12.

[0080] S1. The first terminal device converts the 8K ultra-high-definition video picture to be transmitted into four independent 4K ultra-high-definition video signals in pairs: all pixel points with odd horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture are allocated to the first 4K ultra-high-definition video signal, all pixel points with even horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture are allocated to the second 4K ultra-high-definition video signal, all pixel points with odd horizontal coordinates and even vertical coordinates in the 8K ultra-high-definition video picture are allocated to the third 4K ultra-high-definition video signal, and all pixel points with even horizontal coordinates and even vertical coordinates in the 8K ultra-high-definition video picture are allocated to the fourth 4K ultra-high-definition video signal.

[0081] In step S1, the first terminal device is used as the starting node for transmitting the ultra-high-definition video signal, which can be, but is not limited to, a 5G smartphone; the 8K ultra-high-definition video image to be transmitted can be a real-time video image or a historical video image. The mapping relationship between each pixel point in the 8K ultra-high-definition video image and each 4K ultra-high-definition video signal is as follows: Figure 3 As shown, pixel point P 1，1 , P 1，3 and P 4319，7679 etc. are allocated to the first 4K ultra-high-definition video signal, pixel point P 1，2 , P 1，4 and P 4319，7680 etc. are allocated to the second 4K ultra-high-definition video signal, pixel point P 2，1 , P 2，3and P 4320，7679 etc. are allocated to the third 4K ultra-high-definition video signal, pixel point P 2，2 , P 2，4 and P 4320，7680 etc. are allocated to the fourth channel 4K ultra high-definition video signal.

[0082] S2. The first terminal device encodes the four 4K ultra-high-definition video signals into four 4K ultra-high-definition video transmission stream signals corresponding to the four 4K ultra-high-definition video signals.

[0083] In the step S2, the specific encoding method is the existing technology, for example, encoding to obtain a 4K ultra-high-definition video TS (Transport Stream) stream signal with a fixed packet length of 188B, so as to use the fixed packet length to find the starting position of the frame, so that the picture frame can be easily recovered from data packet loss, which is suitable for an environment with bit errors.

[0084] S3. The first terminal device multiplexes the four 4K ultra-high-definition video transmission stream signals into one transmission stream to generate an 8K ultra-high-definition video transmission stream signal.

[0085] In step S3, the specific multiplexing method is the existing technology.

[0086] S4. The first terminal device modulates the 8K ultra-high-definition video transmission stream signal to the working frequency band of the fifth-generation mobile communication technology 5G to obtain a first modulated signal.

[0087] In step S4, the operating frequency bands of the fifth generation mobile communication technology 5G mainly include 3300-3600MHz and 4800-5000MHz frequency bands; in addition, the specific modulation method is the existing technology.

[0088] S5. The first terminal device transmits the first modulated signal that has been power amplified to a first base station connected to the first terminal device based on the fifth generation mobile communication technology 5G wireless communication.

[0089] In step S5, the first base station is used as a starting node for transmitting ultra-high-definition video signals, and a power amplifier can be used to amplify the power of the first modulated signal. Since the wireless network speed of the fifth generation mobile communication technology 5G is more than 10 times that of 4G, it can meet the high-speed transmission requirements when used for ultra-high-definition video signal transmission.

[0090] S6. After receiving the first modulated signal, the first base station demodulates the first modulated signal after signal amplification to obtain the 8K ultra-high-definition video transmission stream signal, and transmits the 8K ultra-high-definition video transmission stream signal to the core network.

[0091] In the step S6, a low noise signal amplifier may be used to amplify the first modulated signal.

[0092] S7. The core network transmits the 8K ultra-high-definition video transmission stream signal to a second base station connected to a second terminal device based on the fifth-generation mobile communication technology 5G wireless communication.

[0093] In step S7, the core network is used as an intermediate node for transmitting ultra-high-definition video signals, and can forward transmission stream signals between the first base station and the second base station in a conventional manner; it preferably adopts a 5G core network so as to use 5G network slicing technology to ensure communication reliability and low latency. In addition, the second base station is also used as an intermediate node for transmitting ultra-high-definition video signals.

[0094] S8. The second base station modulates the 8K ultra-high-definition video transmission stream signal to the 5G working frequency band to obtain a second modulated signal, and transmits the second modulated signal after power amplification to the second terminal device.

[0095] S9. After receiving the second modulated signal, the second terminal device demodulates the second modulated signal after signal amplification to obtain the 8K ultra-high-definition video transmission stream signal.

[0096] In step S9, the second terminal device is used as a target node for transmitting the ultra-high-definition video signal, and may be, but is not limited to, another 5G smartphone. Similarly, a low-noise signal amplifier may be used to amplify the second modulated signal.

[0097] S10. The second terminal device demultiplexes the one-channel 8K ultra-high-definition video transmission stream signal to obtain the four-channel 4K ultra-high-definition video transmission stream signals.

[0098] In the step S10, the specific demultiplexing method is the existing technology.

[0099] S11. The second terminal device decodes the four channels of 4K ultra-high-definition video transmission stream signals respectively to obtain the four channels of 4K ultra-high-definition video signals.

[0100] In the step S11, the specific decoding method is the existing technology.

[0101] S12. The second terminal device stitches and restores the 8K ultra-high-definition video image based on the four 4K ultra-high-definition video signals and the allocation mapping relationship between the pixel points and each 4K ultra-high-definition video signal.

[0102] Therefore, based on the ultra-high-definition video signal transmission method described in the aforementioned steps S1 to S12 and based on 5G, an end-to-end ultra-high-definition video signal wireless transmission solution based on the fifth generation mobile communication technology 5G is provided, that is, the first terminal device first converts the 8K ultra-high-definition video screen to be transmitted into four independent 4K ultra-high-definition video signals in pairs, and then through encoding, multiplexing, modulation, 5G signal transceiving, demodulation, core network forwarding, re-modulation, 5G signal re-transmission, re-demodulation, demultiplexing and decoding processing, the four-channel 4K ultra-high-definition video signals can be obtained at the second terminal device, and finally the four-channel 4K ultra-high-definition video signals are transmitted in the form of a 4K ultra-high-definition video signal. The 8K ultra-high-definition video image is restored by splicing and recovering the pixel points and the distribution mapping relationship between each channel of 4K ultra-high-definition video signal. In this way, the high-speed transmission characteristics of 5G can be used to meet the high-speed transmission requirements for ultra-high-definition video signal transmission. In addition, since four channels of 4K ultra-high-definition video signals are actually processed, the high accuracy requirements for signal processing when used for ultra-high-definition video signal transmission are reduced. Even if a certain channel of 4K ultra-high-definition video signal loses frame transmission, it will only cause the brightness of the restored 8K image to be reduced, and will not cause a black screen due to the loss of the entire 8K image, thereby ensuring the viewing experience of users on the receiving end.

[0103] Based on the technical solution of the first aspect mentioned above, this embodiment also provides a possible design for restoring the brightness of the 8K picture when a certain 4K ultra-high-definition video signal has transmission frame loss, that is, according to the four channels of 4K ultra-high-definition video signals and the allocation mapping relationship between the pixel points and each channel of 4K ultra-high-definition video signals, the 8K ultra-high-definition video picture is obtained by splicing and restoring, including but not limited to the following steps S211~S212.

[0104] S211. If it is found that one of the four 4K ultra-high-definition video signals has frame loss, then according to the other three 4K ultra-high-definition video signals in the four 4K ultra-high-definition video signals and the allocation mapping relationship between the pixels and each 4K ultra-high-definition video signal, a video picture containing all the pixels that have an allocation mapping relationship with the other three 4K ultra-high-definition video signals is obtained by splicing.

[0105] In the step S211, the specific method of determining whether frame loss occurs in each of the four 4K ultra-high-definition video signals is the prior art.

[0106] S212. Based on the video picture, a new 8K ultra-high-definition video picture for restoring to the 8K ultra-high-definition video picture is obtained in the following manner: for each pixel point in the video picture and having an allocation mapping relationship with the certain 4K ultra-high-definition video signal, the pixel value average result of all corresponding adjacent pixel points in eight directions is taken as the corresponding pixel value, wherein the eight directions include left, upper left, upper middle, upper right, right, lower right, lower middle and lower left directions.

[0107] In step S212, Figure 4 As shown, the squares marked with "x" are the pixels in the video picture and have an allocation mapping relationship with the one 4K ultra-high-definition video signal, and the 8 adjacent pixels surrounding the "x" pixel are all adjacent pixels in the eight directions. Since they have an allocation mapping relationship with the other three 4K ultra-high-definition video signals, their pixel values ​​in the 8K picture can be determined in advance, and their average pixel value result can be used as the pixel value of the surrounded "x" pixel point, thereby improving the brightness of the "x" pixel point and achieving the purpose of restoring the brightness of the 8K picture.

[0108] Therefore, based on the aforementioned possible design one, when it is found that frame loss occurs in one of the four 4K ultra-high-definition video signals, the brightness of the corresponding pixel point can be improved by taking the average result of the pixel values ​​of all adjacent pixel points in eight directions that have an allocation mapping relationship with the one 4K ultra-high-definition video signal in the video picture as the corresponding pixel value, thereby achieving the purpose of restoring the brightness of the 8K picture, and further ensuring the viewing experience of the receiving user.

[0109] Based on the technical solution of the first aspect mentioned above, this embodiment further provides a possible design 2 for restoring the brightness of the 8K picture when one, two or three 4K ultra-high-definition video signals have transmission frame loss, that is, according to the four 4K ultra-high-definition video signals and the allocation mapping relationship between the pixel points and each 4K ultra-high-definition video signal, the 8K ultra-high-definition video picture is obtained by splicing and restoring, including but not limited to the following steps S221 to S222.

[0110] S221. If it is found that frame loss occurs in X-channel 4K ultra-high-definition video signals among the four-channel 4K ultra-high-definition video signals, a video picture including all pixel points having an allocation mapping relationship with the other Y-channel 4K ultra-high-definition video signals is obtained according to the other Y-channel 4K ultra-high-definition video signals among the four-channel 4K ultra-high-definition video signals and the allocation mapping relationship between pixel points and each channel of 4K ultra-high-definition video signals, wherein X and Y are natural numbers taking values ​​in the interval [1, 3] respectively, and the sum of X and Y is equal to 4.

[0111] In the step S221, the specific method of determining whether frame loss occurs in each of the four 4K ultra-high-definition video signals is the prior art.

[0112] S222. Based on the video picture and the previous frame of 8K ultra-high-definition video picture that has been restored locally and is adjacent to the video picture, a new 8K ultra-high-definition video picture used to restore the 8K ultra-high-definition video picture is obtained in the following manner S2221 to S2225.

[0113] S2221. For each pixel point in the video image that has an allocation mapping relationship with the X-channel 4K ultra-high-definition video signal, the following formula is used to express the corresponding unknown case:

[0114] C uk，i =(S i，0 , S i，1 , S i，2 …, S i，n …, S i，N , r i，t )

[0115] In the formula, i represents a non-zero natural number, C uk，i represents the i-th unknown case corresponding to the i-th pixel point in the video picture and having an allocation mapping relationship with the X-channel 4K ultra-high-definition video signal, S i，0 represents the known pixel value of the i-th pixel in the previous frame of 8K ultra-high-definition video, N represents the total number of pixel neighbors of a single pixel, n represents a natural number not greater than N, S i，n represents the known pixel value of the nth pixel neighbor of the i-th pixel in the previous frame of 8K ultra-high-definition video, r i，t Represents the pixel value to be solved for the i-th pixel point in the video picture.

[0116] In step S2221, if Figure 5 As shown, the squares marked with "x" are the pixels in the video image that have an allocation mapping relationship with the X-channel 4K ultra-high-definition video signals. Figure 5 (a) to (d) also show that when X takes different values, the pixels around the pixel “x” and used for the subsequent solution of r i，t The number of pixel neighbors corresponding to the known cases is different. In order to ensure that there are enough known cases for solving the calculation in the future, preferably, when X is equal to 1, the pixel neighbors of a single pixel point refer to the first circle of pixels surrounding the single pixel point, wherein the first circle of pixels includes eight pixels that are adjacent in sequence in the clockwise direction, that is, Figure 5(a) The blank square marked in gray is used to solve r in the following i，t There are 8 pixel neighbors corresponding to the known case; when X is equal to 2, the pixel neighbors of a single pixel point refer to the first circle of pixels surrounding the single pixel point and the second circle of pixels surrounding the single pixel point and the first circle of pixels, wherein the first circle of pixels includes eight pixels adjacent in a clockwise direction, and the second circle of pixels includes sixteen pixels adjacent in a clockwise direction, that is, Figure 5 (b) is shown, and this is used for the subsequent solution of r i，t There are 10 pixel neighbors corresponding to the known case, and Figure 5 (c) is shown, and this is used to solve r i，t There are 12 pixel neighbors corresponding to the known case; when X is equal to three, the pixel neighbors of a single pixel point refer to the first circle of pixels surrounding the single pixel point, the second circle of pixels surrounding the single pixel point and the first circle of pixels, and the third circle of pixels surrounding the single pixel point, the first circle of pixels and the second circle of pixels, wherein the first circle of pixels includes eight pixels adjacent in a clockwise direction, the second circle of pixels includes sixteen pixels adjacent in a clockwise direction, and the third circle of pixels includes twenty-four pixels adjacent in a clockwise direction, such as Figure 5 (d) is shown, and is used for the subsequent solution of r i，t There are also 12 pixel neighbors corresponding to the known cases.

[0117] S2223. For each pixel point in the video image that is used as a pixel point neighbor of the i-th pixel point and has an allocation mapping relationship with the other Y-channel 4K ultra-high-definition video signal, the following formula is used to express the corresponding known case:

[0118] C kn，ij =(S ij，0 , S ij，1 , S ij，2 …, S ij，n …, S ij，N , r ij，t )

[0119] In the formula, j represents a non-zero natural number, C kn，ij represents the jth known case that corresponds one-to-one with the jth pixel point that is a neighbor of the i-th pixel point in the video image and has an allocation mapping relationship with the other Y-channel 4K ultra-high-definition video signal, S ij，0 represents the known pixel value of the j-th pixel in the previous frame of 8K ultra-high-definition video, S ij，nrepresents the known pixel value of the nth pixel neighbor of the jth pixel in the previous frame of 8K ultra-high-definition video, r ij，t Represents the known pixel value of the j-th pixel in the video picture.

[0120] In step S2223, since the j-th pixel point has an allocation mapping relationship with the other Y-channel 4K ultra-high-definition video signals, their pixel values ​​in the 8K picture can be determined in advance to obtain corresponding known cases.

[0121] S2224. Calculate the case similarity C between the i-th unknown case and the j-th known case according to the following formula: ij :

[0122]

[0123] In the formula, k represents a natural number.

[0124] S2225. Calculate the pixel value r of the i-th pixel in the video image according to the following formula: i，t :

[0125]

[0126] Where M i It represents the total number of pixels in the video picture that are used as pixel neighbors of the i-th pixel and have an allocation mapping relationship with the other Y-channel 4K ultra-high-definition video signals.

[0127] Therefore, based on the aforementioned possible design two, when it is found that one, two or three of the four 4K ultra-high-definition video signals have frame loss, by targeting each pixel point in the video screen that has an allocation mapping relationship with the one, two or three 4K ultra-high-definition video signals, and comprehensively analyzing the similarity between the corresponding unknown cases and the known cases of the surrounding pixel point neighbors, a corresponding and approximate real pixel value solution result can be obtained, thereby accurately improving the brightness of the corresponding pixel point, achieving the purpose of accurately restoring the brightness of the 8K picture, and further ensuring the viewing experience of the receiving user.

[0128] Based on the technical solutions of the aforementioned possible design one or possible design two, this embodiment also provides a possible design three for performing image repair when the network side determines that some 4K ultra-high-definition video signals have frame loss, that is, the first base station transmits the 8K ultra-high-definition video transmission stream signal to the core network, including but not limited to the following steps S611 to S614.

[0129] S611. The first base station transmits the 8K ultra-high-definition video transmission stream signal to the edge cloud server.

[0130] In step S611, the edge cloud server is used as an intermediate detection node for transmitting ultra-high-definition video signals, and can be implemented using an existing cloud server.

[0131] S612. The edge cloud server demultiplexes the one-channel 8K ultra-high-definition video transmission stream signal to obtain the four-channel 4K ultra-high-definition video transmission stream signal.

[0132] S613. The edge cloud server decodes the four channels of 4K ultra-high-definition video transmission stream signals respectively to obtain the four channels of 4K ultra-high-definition video signals.

[0133] S614. The edge cloud server determines whether any one of the four 4K ultra-high-definition video signals has frame loss or whether any X 4K ultra-high-definition video signals have frame loss. If so, splicing and restoring are performed to obtain a new 8K ultra-high-definition video picture used as the 8K ultra-high-definition video picture according to the four 4K ultra-high-definition video signals and the allocation mapping relationship between pixel points and each 4K ultra-high-definition video signal. Then, the new 8K ultra-high-definition video picture is converted into a new 8K ultra-high-definition video transmission stream signal used as the one 8K ultra-high-definition video transmission stream signal. Finally, the new 8K ultra-high-definition video transmission stream signal is transmitted to the core network. Otherwise, the one 8K ultra-high-definition video transmission stream signal is directly transmitted to the core network, wherein X is a natural number taking a value in the interval [1, 3].

[0134] In step S614, the specific stitching recovery details can be referred to the aforementioned possible design 1 or possible design 2, which will not be described in detail here. In addition, the specific process of converting the new 8K ultra-high-definition video picture into a new 8K ultra-high-definition video transmission stream signal used as the one-way 8K ultra-high-definition video transmission stream signal can be referred to the aforementioned steps S1 to S3, which will not be described in detail here.

[0135] Therefore, based on the aforementioned possible design three, after the 8K ultra-high-definition video transmission stream signal is transmitted uplink, it can be detected whether some 4K ultra-high-definition video signals have frame loss. If so, timely picture repair can be performed to avoid the situation where all 4K ultra-high-definition video signals suffer from frame loss due to the superposition of frame loss after the subsequent 8K ultra-high-definition video transmission stream signal is transmitted downlink, which can further ensure the viewing experience of users at the receiving end.

[0136] Based on the technical solutions of the aforementioned first aspect, possible design one, possible design two or possible design three, this embodiment also provides a possible design four for determining on the network side whether sensitive images are transmitted, that is, the first base station transmits the 8K ultra-high-definition video transmission stream signal to the core network, including but not limited to the following steps S621 to S626.

[0137] S621. The first base station transmits the 8K ultra-high-definition video transmission stream signal to the edge cloud server.

[0138] In step S621, the edge cloud server is used as an intermediate detection node for transmitting ultra-high-definition video signals, and can be implemented using an existing cloud server.

[0139] S622. The edge cloud server demultiplexes the one-channel 8K ultra-high-definition video transmission stream signal to obtain the four-channel 4K ultra-high-definition video transmission stream signal.

[0140] S623. The edge cloud server decodes any one of the four 4K ultra-high-definition video transmission stream signals to obtain a 4K ultra-high-definition video signal.

[0141] S624. The edge cloud server splices the 4K ultra-high-definition video signal to obtain a 4K ultra-high-definition video image.

[0142] In the step S624, since all the pixel points with odd horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture are allocated to the first 4K ultra-high-definition video signal, all the pixel points with even horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture are allocated to the second 4K ultra-high-definition video signal, all the pixel points with odd horizontal coordinates and even vertical coordinates in the 8K ultra-high-definition video picture are allocated to the third 4K ultra-high-definition video signal, and all the pixel points with even horizontal coordinates and even vertical coordinates in the 8K ultra-high-definition video picture are allocated to the fourth 4K ultra-high-definition video signal, the spliced ​​4K ultra-high-definition video picture can be equivalent to the compressed image of the 8K ultra-high-definition video image, so that it can be used for subsequent sensitive image recognition without full splicing and restoration, which is beneficial to reducing computing resource requirements.

[0143] S625. The edge cloud server inputs the 4K ultra-high-definition video image into a sensitive image recognition model that is based on a target detection algorithm and has been pre-trained to obtain a sensitive image recognition result.

[0144] In step S625, the sensitive images may include but are not limited to pornographic images or violent and terrorist images, and the target detection algorithm may include but is not limited to the YoLo target detection algorithm.

[0145] S626. The edge cloud server determines whether there are sensitive images exceeding a preset number threshold in the 4K ultra-high-definition video screen based on the sensitive image recognition result. If so, the edge cloud server terminates the transmission of the 8K ultra-high-definition video transmission stream signal to the core network, and instructs the first base station to feedback a transmission failure message to the first terminal device. Otherwise, the edge cloud server continues to transmit the 8K ultra-high-definition video transmission stream signal to the core network.

[0146] In the step S626, the preset number threshold may be 1, or a value greater than 1, to avoid misjudgment.

[0147] Therefore, based on the aforementioned possible design four, after the 8K ultra-high-definition video transmission stream signal is transmitted uplink, it is possible to detect whether there are sensitive images being transmitted in a manner with low computing resource requirements. If sensitive images exceeding the preset number threshold are found, the legality of the transmission is denied, and the transmission of illegal videos is terminated in a timely manner to ensure the legality and compliance of network informatization.

[0148] like Figure 1 As shown, the second aspect of this embodiment provides a physical system for implementing the ultra-high-definition video signal transmission method described in the first aspect and any one of possible designs one to four, including a first terminal device, a first base station, a core network, a second base station, and a second terminal device, wherein the first terminal device is connected to the first base station based on the fifth-generation mobile communication technology 5G wireless communication, the first base station is connected to the core network by wired communication, the core network is connected to the second base station by wired communication, and the second base station is connected to the second terminal device based on the fifth-generation mobile communication technology 5G wireless communication;

[0149] The first terminal device is used to first convert the 8K ultra-high-definition video picture to be transmitted into four independent 4K ultra-high-definition video signals in pairs: assign all pixel points with odd horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture to the first 4K ultra-high-definition video signal, assign all pixel points with even horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture to the second 4K ultra-high-definition video signal, assign all pixel points with odd horizontal coordinates and even vertical coordinates in the 8K ultra-high-definition video picture to the third 4K ultra-high-definition video signal, and convert the 8K ultra-high-definition video picture into four independent 4K ultra-high-definition video signals. All pixel points whose horizontal coordinates are even and whose vertical coordinates are even are assigned to a fourth 4K ultra-high-definition video signal, and then the four 4K ultra-high-definition video signals are respectively encoded into four 4K ultra-high-definition video transmission stream signals corresponding to the four 4K ultra-high-definition video signals one by one, and then the four 4K ultra-high-definition video transmission stream signals are multiplexed into one transmission stream to generate one 8K ultra-high-definition video transmission stream signal, and then the one 8K ultra-high-definition video transmission stream signal is modulated to the working frequency band of 5G to obtain a first modulation signal, and finally the first modulation signal after power amplification is transmitted to the first base station;

[0150] The first base station is configured to, after receiving the first modulated signal, demodulate the first modulated signal after signal amplification to obtain the one-way 8K ultra-high-definition video transmission stream signal, and transmit the one-way 8K ultra-high-definition video transmission stream signal to the core network;

[0151] The core network is used to transmit the 8K ultra-high-definition video transmission stream signal to the second base station;

[0152] The second base station is used to modulate the 8K ultra-high-definition video transmission stream signal to the working frequency band of 5G to obtain a second modulated signal, and transmit the second modulated signal after power amplification to the second terminal device;

[0153] The second terminal device is used to demodulate the second modulated signal after receiving the second modulated signal to obtain the 8K ultra-high-definition video transmission stream signal, and then demultiplex the 8K ultra-high-definition video transmission stream signal to obtain the four 4K ultra-high-definition video transmission stream signals, and then respectively decode the four 4K ultra-high-definition video transmission stream signals to obtain the four 4K ultra-high-definition video signals, and finally splice and restore the 8K ultra-high-definition video screen according to the four 4K ultra-high-definition video signals and the allocation mapping relationship between the pixel points and each 4K ultra-high-definition video signal.

[0154] In a possible design, an 8K ultra-high-definition camera and an 8K ultra-high-definition display device are also included, wherein the 8K ultra-high-definition camera is connected to the first terminal device via a fiber optic cable or a 48G digital component serial interface cable for wired communication, and the 8K ultra-high-definition display device is connected to the second terminal device via another fiber optic cable or a 48G digital component serial interface cable for wired communication;

[0155] The 8K ultra-high-definition camera is used to capture and obtain 8K ultra-high-definition video images to be transmitted, and transmit the captured images to the first terminal device via wire;

[0156] The 8K ultra high-definition display device is used to load and display the 8K ultra high-definition video images from the second terminal device.

[0157] The working process, working details and technical effects of the aforementioned system provided in the second aspect of this embodiment can be referred to the ultra-high-definition video signal transmission method described in the first aspect or possible design one, and will not be repeated here.

[0158] Finally, it should be noted that the above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A 5G-based ultra-high-definition video signal transmission method, characterized in that: include: The first terminal device converts the 8K ultra-high-definition video picture to be transmitted into four independent 4K ultra-high-definition video signals in pairs: all pixels with odd horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture are allocated to the first 4K ultra-high-definition video signal, all pixels with even horizontal coordinates and odd vertical coordinates in the 8K ultra-high-definition video picture are allocated to the second 4K ultra-high-definition video signal, all pixels with odd horizontal coordinates and even vertical coordinates in the 8K ultra-high-definition video picture are allocated to the third 4K ultra-high-definition video signal, and all pixels with even horizontal coordinates and even vertical coordinates in the 8K ultra-high-definition video picture are allocated to the fourth 4K ultra-high-definition video signal; The first terminal device encodes the four channels of 4K ultra-high-definition video signals into four channels of 4K ultra-high-definition video transmission stream signals corresponding to the four channels of 4K ultra-high-definition video signals one by one; The first terminal device multiplexes the four 4K ultra-high-definition video transmission stream signals into one transmission stream to generate one 8K ultra-high-definition video transmission stream signal; The first terminal device modulates the 8K ultra-high-definition video transmission stream signal to the working frequency band of the fifth-generation mobile communication technology 5G to obtain a first modulated signal; The first terminal device transmits the first modulated signal after power amplification to a first base station connected to the first terminal device based on the fifth generation mobile communication technology 5G wireless communication; After receiving the first modulated signal, the first base station demodulates the first modulated signal after signal amplification to obtain the one-way 8K ultra-high-definition video transmission stream signal, and transmits the one-way 8K ultra-high-definition video transmission stream signal to the core network; The core network transmits the 8K ultra-high-definition video transmission stream signal to a second base station connected to a second terminal device based on the fifth-generation mobile communication technology 5G wireless communication; The second base station modulates the 8K ultra-high-definition video transmission stream signal to the working frequency band of 5G to obtain a second modulated signal, and transmits the second modulated signal after power amplification to the second terminal device; After receiving the second modulated signal, the second terminal device demodulates the second modulated signal after signal amplification to obtain the one-way 8K ultra-high-definition video transmission stream signal; The second terminal device demultiplexes the one-channel 8K ultra-high-definition video transmission stream signal to obtain the four-channel 4K ultra-high-definition video transmission stream signals; The second terminal device decodes the four channels of 4K ultra-high-definition video transmission stream signals respectively to obtain the four channels of 4K ultra-high-definition video signals; The second terminal device splices and restores the 8K ultra-high-definition video image according to the four-channel 4K ultra-high-definition video signals and the distribution mapping relationship between the pixel points and each channel of the 4K ultra-high-definition video signals, specifically including: if it is found that there is frame loss in the X-channel 4K ultra-high-definition video signal among the four-channel 4K ultra-high-definition video signals, then splices and restores the 8K ultra-high-definition video image according to the other Y-channel 4K ultra-high-definition video signals and the distribution mapping relationship between the pixel points and each channel of the 4K ultra-high-definition video signals among the four-channel 4K ultra-high-definition video signals, including the Y-channel 4K ultra-high-definition video signals having distribution mapping relationship with each channel of the 4K ultra-high-definition video signals. A video picture of all pixels having a mapping relationship, wherein X and Y are natural numbers taking values ​​in the interval [1, 3], and the sum of X and Y is equal to 4; according to the video picture and a previous frame of 8K ultra-high-definition video picture that has been restored locally and is adjacent to the video picture, a new 8K ultra-high-definition video picture used to restore the 8K ultra-high-definition video picture is obtained in the following manner: for each pixel in the video picture that has an allocation mapping relationship with the X-channel 4K ultra-high-definition video signal, the corresponding unknown case is expressed by the following formula: C uk，i =(S i，0 ,S i，1 ,S i，2 …,S i，n …,S i，N ,r i，t ) In the formula, i represents a non-zero natural number, C uk，i represents the i-th unknown case corresponding to the i-th pixel point in the video picture and having an allocation mapping relationship with the X-channel 4K ultra-high-definition video signal, S i，0 represents the known pixel value of the i-th pixel in the previous frame of 8K ultra-high-definition video, N represents the total number of pixel neighbors of a single pixel, n represents a natural number not greater than N, S i，n represents the known pixel value of the nth pixel neighbor of the i-th pixel in the previous frame of 8K ultra-high-definition video, r i，t represents the pixel value to be solved of the i-th pixel in the video picture; for each pixel in the video picture that is used as a pixel neighbor of the i-th pixel and has an allocation mapping relationship with the other Y-channel 4K ultra-high-definition video signal, the corresponding known case is expressed by the following formula: C kn，ij =(S ij，0 ,S ij，1 ,S ij，2 …,S ij,n …,S ij，N ,r ij，t ) In the formula, j represents a non-zero natural number, C kn，ij represents the jth known case that corresponds one-to-one with the jth pixel point that is a neighbor of the i-th pixel point in the video image and has an allocation mapping relationship with the other Y-channel 4K ultra-high-definition video signal, S ij，0 represents the known pixel value of the j-th pixel in the previous frame of 8K ultra-high-definition video, S ij，n represents the known pixel value of the nth pixel neighbor of the jth pixel in the previous frame of 8K ultra-high-definition video, r ij，t represents the known pixel value of the j-th pixel point in the video image; the case similarity C between the i-th unknown case and the j-th known case is calculated according to the following formula: ij : Wherein, k represents a natural number; the pixel value r to be solved of the i-th pixel point in the video image is calculated according to the following formula: i，t : Where M i It represents the total number of pixels in the video picture that are used as pixel neighbors of the i-th pixel and have an allocation mapping relationship with the other Y-channel 4K ultra-high-definition video signals.

2. The method for transmitting ultra-high definition video signals according to claim 1, characterized in that: When X is equal to 1, the pixel point neighbors of a single pixel point refer to a first circle of pixel points surrounding the single pixel point, wherein the first circle of pixel points includes eight pixel points that are adjacent in sequence in a clockwise direction.

3. The method for transmitting ultra-high definition video signals according to claim 1, wherein: When X is equal to 2, the pixel neighbors of a single pixel point refer to a first circle of pixel points used to surround the single pixel point and a second circle of pixel points used to surround the single pixel point and the first circle of pixel points, wherein the first circle of pixel points includes eight pixel points that are adjacent in sequence in a clockwise direction, and the second circle of pixel points includes sixteen pixel points that are adjacent in sequence in a clockwise direction.

4. The method for transmitting ultra-high definition video signals according to claim 1, characterized in that: When X is equal to three, the pixel neighbors of a single pixel point refer to a first circle of pixel points surrounding the single pixel point, a second circle of pixel points surrounding the single pixel point and the first circle of pixel points, and a third circle of pixel points surrounding the single pixel point, the first circle of pixel points, and the second circle of pixel points, wherein the first circle of pixel points includes eight pixel points adjacent in sequence in a clockwise direction, the second circle of pixel points includes sixteen pixel points adjacent in sequence in a clockwise direction, and the third circle of pixel points includes twenty-four pixel points adjacent in sequence in a clockwise direction.

5. The method for transmitting ultra-high definition video signals according to claim 1, wherein: The first base station transmits the 8K ultra-high-definition video transmission stream signal to the core network, including: The first base station transmits the 8K ultra-high-definition video transmission stream signal to the edge cloud server; The edge cloud server demultiplexes the one-channel 8K ultra-high-definition video transmission stream signal to obtain the four-channel 4K ultra-high-definition video transmission stream signals; The edge cloud server decodes the four channels of 4K ultra-high-definition video transmission stream signals respectively to obtain the four channels of 4K ultra-high-definition video signals; The edge cloud server determines whether any one of the four 4K ultra-high-definition video signals has frame loss or whether X 4K ultra-high-definition video signals have frame loss. If so, splicing and restoring are performed to obtain a new 8K ultra-high-definition video picture used as the 8K ultra-high-definition video picture according to the four 4K ultra-high-definition video signals and the allocation mapping relationship between the pixel points and each 4K ultra-high-definition video signal. Then, the new 8K ultra-high-definition video picture is converted into a new 8K ultra-high-definition video transmission stream signal used as the one 8K ultra-high-definition video transmission stream signal. Finally, the new 8K ultra-high-definition video transmission stream signal is transmitted to the core network. Otherwise, the one 8K ultra-high-definition video transmission stream signal is directly transmitted to the core network, where X is a natural number taking a value in the interval [1, 3].

6. The method for transmitting ultra-high definition video signals according to claim 1, characterized in that: The first base station transmits the 8K ultra-high-definition video transmission stream signal to the core network, including: The first base station transmits the 8K ultra-high-definition video transmission stream signal to the edge cloud server; The edge cloud server demultiplexes the one-channel 8K ultra-high-definition video transmission stream signal to obtain the four-channel 4K ultra-high-definition video transmission stream signals; The edge cloud server decodes any one of the four 4K ultra-high-definition video transmission stream signals to obtain a 4K ultra-high-definition video signal; The edge cloud server splices the 4K ultra-high-definition video signal to obtain a 4K ultra-high-definition video image; The edge cloud server inputs the 4K ultra-high-definition video image into a sensitive image recognition model that has been pre-trained and based on a target detection algorithm to obtain a sensitive image recognition result; The edge cloud server determines whether there are sensitive images exceeding a preset number threshold in the 4K ultra-high-definition video screen based on the sensitive image recognition result. If so, it terminates the transmission of the 8K ultra-high-definition video transmission stream signal to the core network and instructs the first base station to feedback a transmission failure message to the first terminal device. Otherwise, it continues to transmit the 8K ultra-high-definition video transmission stream signal to the core network.

Images