Image transmission system and method

Abstract

The invention discloses an image transmission system and method, the system comprises a coding unit and a decoding display unit, the coding unit comprises a dynamic control module, the dynamic control module is used for generating coding parameters according to an input target rate and image information, and the decoding display unit is used for displaying the coding parameters. Processing an image to be transmitted according to the coding parameter to generate image coding information; the decoding display unit comprises a decoding module and an adjustment display module, and the decoding module is used for performing key frame detection processing on the image coding information to obtain processed image coding information and decoding the processed image coding information to obtain image decoding information; and the adjustment display module is used for displaying the to-be-transmitted image corresponding to the image decoding information. According to the invention, the adjustment capability of the image transmission rate is improved, and the probability of blank screen and lagging in the image transmission process is reduced.

Description

Technical Field

[0001] The present invention relates to the technical field of image transmission, and more particularly to an image transmission system and method. Background Art

[0002] Currently in the field of wireless broadband, the adaptability of image transmission methods is poor, and problems such as black screens, lags, and large delays often occur when the wireless network environment fluctuates. The main reasons are as follows: (1) Considering factors such as transmission distance and power consumption, the designed broadband of wireless broadband is limited, the functions of the image transmission protocol are relatively complex, and part of the bandwidth is wasted; (2) The wireless broadband network is vulnerable to environmental interference, with large network fluctuations. When in use, the actual bandwidth fluctuates greatly, and the ability to adjust the image transmission rate is limited; (3) There is no focus on image transmission, and the loss of key data easily leads to black screens; (4) Image transmission requires accurate data arrival. When errors occur, multiple retransmissions lead to problems such as frame lags and large delays.

[0003] The related art discloses a method, device, and electronic device for dynamically adjusting surveillance videos. This technical solution is only suitable for providing users with a choice of image quality and smoothness when the network bandwidth fluctuates little, and cannot cope with the situation of large bandwidth fluctuations in a severely fluctuating wireless environment.

[0004] The related art discloses a method, device, equipment, and storage medium for video image processing. This technical solution marks important data by levels, but the content is different. It specifically protects frame images, but does not protect and recover the key information for decoding, and cannot reduce the probability of black screens.

[0005] The related art discloses a method and system for automatically adjusting the video frame rate based on adaptive modulation and coding. This technical solution only adjusts the frame rate and bit rate, with fewer adjustment dimensions and limited adjustment ability. Summary of the Invention

[0006] The object of the present invention is to provide an image transmission system and method to solve the problems of limited ability to adjust the image transmission rate and relatively high probabilities of black screens and lags existing in the existing image transmission methods.

[0007] To achieve the above object, in a first aspect, the present invention provides an image transmission system, which includes an encoding unit and a decoding and display unit. Among them, the encoding unit includes a dynamic control module, and the dynamic control module is used to generate encoding parameters according to the input target rate and image information, and process the image to be transmitted according to the encoding parameters to generate image encoding information; the decoding and display unit includes a decoding module and an adjustment and display module. The decoding module is used to perform key frame detection processing on the image encoding information to obtain processed image encoding information, and decode the processed image encoding information to obtain image decoding information. The adjustment and display module is used to display the image to be transmitted corresponding to the image decoding information.

[0008] A further technical solution thereof is: the image information includes the current resolution and the current frame rate, the encoding parameters include the target frame rate, the target resolution, the color mode, and the encoding method. The dynamic control module includes: a frame rate control sub-module, which is used to perform frame extraction processing on the image to be transmitted according to the current frame rate and the target frame rate to determine whether the current frame data is used to obtain a frame extraction result; a resolution adjustment sub-module, which is used to adjust the resolution of the current frame data with the frame extraction result of being used according to the target resolution to obtain resolution-adjusted frame data; an image color adjustment sub-module, which is used to perform color adjustment on the resolution-adjusted frame data according to the color mode to obtain color-adjusted frame data; an encoding sub-module, which is used to encode the color-adjusted frame data according to the encoding method to obtain the image encoding information.

[0009] A further technical solution thereof is: the image encoding information includes video encoding data and picture encoding data. The encoding sub-module includes: a video encoding sub-module, which is used to encode the color-adjusted frame data according to the current resolution to obtain a video encoding data packet, and perform protocol parsing on the video encoding data packet to determine the frame type, and define the frame data of the video encoding data packet according to the frame type to obtain the video encoding data. Among them, the video encoding data includes key video encoding data, important video encoding data, and general video encoding data, and the target resolution is added to the head of the key video encoding data; a picture encoding sub-module, which is used to adjust the number of picture segments according to the current resolution, encode the color-adjusted frame data based on the number of picture segments to obtain an initial picture encoding data packet, add header information to the picture encoding data to obtain a final picture encoding data packet, and parse the final picture encoding data packet to define the frame data in the final picture encoding data packet to obtain the picture encoding data. Among them, the picture encoding data includes key picture encoding data and important picture encoding data.

[0010] Its further technical solution is as follows: The encoding unit further includes: a data input module, which includes an image information configuration sub-module and a data input sub-module. The image information configuration sub-module is configured with an image information configuration interface, and the image information configuration interface is used to input the image information. The data input sub-module is configured with a data input interface, and the data input interface is used to input the original image data.

[0011] Its further technical solution is as follows: The processed image encoding information includes video encoding information and picture encoding information. The image decoding information includes video decoding information and picture decoding information. The decoding module includes: a video decoding sub-module, which is used to parse the video encoding data to perform key frame detection processing on the key video encoding data and the important video encoding data according to the backup key frame data to obtain the video encoding information, and decode the video encoding information to obtain the video decoding information; a picture decoding sub-module, which is used to parse the picture encoding data to perform key frame detection processing on the key picture encoding data and the important picture encoding data to obtain the picture encoding information, decode the picture encoding information to obtain the initial picture decoding information, and perform data recombination on the initial picture decoding information to obtain the picture decoding information.

[0012] Its further technical solution is as follows: The video decoding sub-module includes: a key frame detection and processing sub-module, which is used to determine whether the key video coding data is the same as the backup key frame data when the video coding data is the key video coding data; if the key video coding data is the same as the backup key frame data, then use the key video coding data as the video coding information; if the key video coding data is different from the backup key frame data, then determine whether the resolution of the key video coding data is the same as the resolution of the backup key frame data; if the resolution of the key video coding data is the same as the resolution of the backup key frame data, then use the backup key frame data to replace the key video coding data, and use the replaced key video coding data as the video coding information; if the resolution of the key video coding data is different from the resolution of the backup key frame data, then determine whether the resolution of the key video coding data is supported; if not, then execute the step of using the backup key frame data to replace the key video coding data and using the replaced key video coding data as the video coding information; if supported, then update the backup key frame data to the key video coding data, and use the key video coding data as the video coding information; an important frame detection and processing sub-module, which is used to determine whether the previous frame of video data of the important video coding data is the key video coding data when the video coding data is the important video coding data; if so, then use the important video coding data as the video coding information; if not, then use the important video coding data and the key video coding data as the video coding information.

[0013] Its further technical solution is as follows: The picture decoding sub-module includes: a data recombination sub-module, which is used to detect whether there is missing image data in the initial picture decoding information, and if so, fill the missing image data with a preset filling value to obtain the picture decoding information.

[0014] Its further technical solution is as follows: The decoding and display unit further includes a data protocol parsing module, and the data protocol parsing module parses the message type to send the video coding data to the video decoding queue and send the picture coding data to the picture decoding queue, so that the video decoding sub-module reads the video coding data from the video decoding queue and the picture decoding sub-module reads the picture coding data from the picture decoding queue.

[0015] Its further technical solution is as follows: The adjustment display module includes an adjustment sub-module and a display sub-module. Among them, the adjustment sub-module is used to check the resolution in the current image decoding information. If the resolution in the current image decoding information is different from the resolution in the previous frame of image decoding information, the resolution of the display sub-module is adjusted; the display sub-module is used to display the to-be-transmitted image corresponding to the image decoding information.

[0016] To achieve the above object, in a second aspect, the present invention also provides an image transmission method, which is applied to the image transmission system described in the first aspect above. The method includes: generating encoding parameters according to the input target rate and image information through a dynamic control module, and processing the to-be-transmitted image according to the encoding parameters to generate image encoding information; performing key frame detection processing on the image encoding information through a decoding module to obtain processed image encoding information, and decoding the processed image encoding information to obtain image decoding information; displaying the to-be-transmitted image corresponding to the image decoding information through an adjustment display module.

[0017] The embodiment of the present invention provides an image transmission system and method. First, the encoding unit processes the to-be-transmitted image according to the encoding parameters generated according to the input image information and the input target rate to generate image encoding information; then, the decoding and display unit performs key frame detection processing on the image encoding information to obtain processed image encoding information, decodes the processed image encoding information to obtain image decoding information, and displays the to-be-transmitted image corresponding to the image decoding information. During the entire image transmission process, since the encoding parameters are generated according to the input target rate and image information during the encoding process to process the to-be-transmitted image to generate image encoding information, multi-dimensional adjustment can be realized, the adjustment ability of the image transmission rate is improved, and it can adapt to the bandwidth fluctuation of the wireless broadband network; since the key frames in the image encoding information are detected and processed during the decoding process, the probability of black screen and freezing during the image transmission process can be reduced.

[0018] Through the following description and in combination with the accompanying drawings, the present invention will become clearer. These drawings are used to explain the embodiments of the present invention. Description of the Drawings

[0019] Figure 1 It is a block diagram of an image transmission system of the present invention;

[0020] Figure 2 It is a block diagram of an encoding unit in an image transmission system of the present invention;

[0021] Figure 3 It is a block diagram of a decoding unit in an image transmission system of the present invention;

[0022] Figure 4 It is a block diagram of a data input module in an image transmission system of the present invention;

[0023] Figure 5 It is a block diagram of a dynamic control module in an image transmission system of the present invention;

[0024] Figure 6 It is a block diagram of an encoding sub-module in an image transmission system of the present invention;

[0025] Figure 7 It is a block diagram of a decoding module in an image transmission system of the present invention;

[0026] Figure 8 It is a block diagram of a video decoding sub-module in an image transmission system of the present invention;

[0027] Figure 9 It is a schematic flowchart of key frame detection and processing in an embodiment of the present invention;

[0028] Figure 10 It is a block diagram of a picture decoding sub-module in an image transmission system of the present invention;

[0029] Figure 11 It is a block diagram of an adjustment and display module in an image transmission system of the present invention;

[0030] Figure 12 It is a schematic flowchart of an image transmission method in an embodiment of the present invention.

[0031] Reference numerals:

[0032] 10. Image transmission system; 11. Encoding unit; 111. Dynamic control module; 1111. Frame rate control sub-module; 1112. Resolution adjustment sub-module; 1113. Image color adjustment sub-module; 1114. Encoding sub-module; 1115. Video encoding sub-module; 1116. Picture encoding sub-module; 112. Data input module; 1121. Image information configuration sub-module; 1122. Data input sub-module; 113. Data output module; 12. Decoding and display unit; 121. Decoding module; 1211. Video decoding sub-module; 1212. Picture decoding sub-module; 1213. Key frame detection and processing sub-module; 1214. Important frame detection and processing sub-module; 1215. Data recombination sub-module; 122. Adjustment and display module; 1221. Adjustment sub-module; 1222. Display sub-module; 123. Data protocol analysis module. Detailed implementation manners

[0033] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Similar component numbers in the drawings represent similar components. Obviously, the embodiments described below are only a part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0034] Referring to Figures 1 to 8 and Figures 10 to 11 , the image transmission system 10 provided by the embodiments of the present invention includes an encoding unit 11 and a decoding and display unit 12. Among them, the encoding unit 11 includes a dynamic control module 111. The dynamic control module 111 is configured to generate encoding parameters according to the input target rate and image information, and process the image to be transmitted according to the encoding parameters to generate image encoding information. The decoding and display unit 12 includes a decoding module 121 and an adjustment and display module 122. The decoding module 121 is configured to perform key frame detection processing on the image encoding information to obtain processed image encoding information, and decode the processed image encoding information to obtain image decoding information. The adjustment and display module 122 is configured to display the image to be transmitted corresponding to the image decoding information. It should be noted that in the embodiments of the present invention, encoding parameters are generated by querying a preset encoding parameter table through the input target rate. Understandably, the preset encoding parameter table is configured with frame rates, resolutions, color modes, and encoding methods corresponding to different target rates. The target rate is input through the interface provided by the dynamic control module 111. It should also be noted that in the embodiments of the present invention, first, the encoding unit 11 processes the image to be transmitted according to the encoding parameters generated according to the input image information and the input target rate to generate image encoding information. Then, the decoding and display unit 12 performs key frame detection processing on the image encoding information to obtain processed image encoding information, decodes the processed image encoding information to obtain image decoding information, and displays the image to be transmitted corresponding to the image decoding information. During the entire image transmission process, because encoding parameters are generated according to the input target rate and image information during the encoding process to process the image to be transmitted to generate image encoding information, multi-dimensional adjustment can be achieved, improving the adjustment ability of the image transmission rate and adapting to the bandwidth fluctuation of the wireless broadband network. Because key frames in the image encoding information are detected and processed during the decoding process, the probability of black screen and freezing during the image transmission process can be reduced.

[0035] In some embodiments, such as in this embodiment, as Figure 2 and Figure 4As shown, the encoding unit 11 further includes: a data input module 112, which includes an image information configuration sub-module 1121 and a data input sub-module 1122. The image information configuration sub-module 1121 is configured with an image information configuration interface for inputting the image information, and the data input sub-module 1122 is configured with a data input interface for inputting the original image data. It should be noted that in the embodiments of the present invention, the image information includes the current resolution and the current frame rate. It should also be noted that in the embodiments of the present invention, the encoding unit 11 further includes a data output module 113, which is used to output the image encoding information to the decoding and display unit 12.

[0036] In some embodiments, such as this embodiment, as Figure 5 As shown, the encoding parameters include the target frame rate, the target resolution, the color mode, and the encoding method. The dynamic control module 111 includes: a frame rate control sub-module 1111, which is used to perform frame extraction processing on the image to be transmitted according to the current frame rate and the target frame rate to determine whether the current frame data is used to obtain the frame extraction result; a resolution adjustment sub-module 1112, which is used to perform resolution adjustment on the current frame data with the frame extraction result of being used according to the target resolution to obtain the resolution-adjusted frame data; an image color adjustment sub-module 1113, which is used to perform color adjustment on the resolution-adjusted frame data according to the color mode to obtain the color-adjusted frame data; an encoding sub-module 1114, which is used to encode the color-adjusted frame data according to the encoding method to obtain the image encoding information. It should be noted that in the embodiments of the present invention, in the frame rate control sub-module 1111, first calculate the ratio of the current frame rate to the target frame rate to obtain the frame rate ratio, and query the pre-set frame rate ratio table according to the frame rate ratio to obtain how many frames are used and how many frames are discarded in each round when transmitting the image to be transmitted, that is, perform frame extraction processing to determine whether the current frame data is used to obtain the frame extraction result; understandably, if the frame extraction result is used, then use this frame; the resolution adjustment sub-module 1112 is implemented through the Swscale module in FFMPEG. FFMPEG is an open-source cross-platform multimedia processing framework that provides core functions such as audio and video encoding and decoding, encapsulation / de-encapsulation, filter processing, and streaming media transmission, and the Swscale module is a module dedicated to image scaling and pixel format conversion. It should also be noted that in the embodiments of the present invention, the color-adjusted frame data is to maintain the original color or black and white; the encoding methods include two methods: video encoding and picture encoding.

[0037] In some embodiments, such as this embodiment, as Figure 6As shown, the image coding information includes video coding data and picture coding data. The coding sub-module 1114 includes: a video coding sub-module 1115, which is used to encode the color-adjusted frame data according to the current resolution to obtain a video coding data packet, perform protocol parsing on the video coding data packet to determine the frame type, and define the frame data of the video coding data packet according to the frame type to obtain the video coding data. Among them, the video coding data includes key video coding data, important video coding data, and general video coding data. The target resolution is added to the header of the key video coding data; a picture coding sub-module 1116, which is used to adjust the number of picture segments according to the current resolution, encode the color-adjusted frame data based on the number of picture segments to obtain an initial picture coding data packet, add header information to the picture coding data to obtain a final picture coding data packet, and parse the final picture coding data packet to define the frame data in the final picture coding data packet to obtain the picture coding data. Among them, the picture coding data includes key picture coding data and important picture coding data. It should be noted that in the embodiment of the present invention, the coding function in the video coding sub-module 1115 is implemented by X264 of FFMPEG. X264 is a widely used open-source H.264 / AVC video coding library; before the video coding sub-module 1115 performs coding, the number of coding slices will be set according to the current resolution. Based on the set number of coding slices, the video coding sub-module 1115 encodes the color-adjusted frame data to obtain a video coding data packet, and the video coding data packet is a data packet in NAL format. NAL is an encapsulation format for encoded video transmission; in the video coding sub-module 1115, the frame data of PPS (Picture Parameter Set) and SPS (Sequence Parameter Set) types in the video coding data packet are defined as key video coding data, the frame data of IDR (Instantaneous Decoding Refresh) type is defined as important video coding data, and the frame data of B / P type is defined as general video coding data. The PPS type frame, SPS type frame, and IDR type frame are all a type of frame in H.264, and H.264 is advanced video coding. It should also be noted that in the embodiment of the present invention, the picture coding sub-module 1116 is implemented by picture segmentation and Libjpeg-turbo coding technology; the header information includes information such as the target resolution, file size, and number (sequentially numbered for the same frame of the picture); the key picture coding data contains picture decoding data; the important picture coding data is the data in the picture coding data except the key picture coding data.

[0038] In some embodiments, such as this embodiment, as Figure 7 and Figure 8As shown, the processed image coding information includes video coding information and picture coding information, and the image decoding information includes video decoding information and picture decoding information. The decoding module 121 includes: a video decoding sub-module 1211, configured to parse the video coding data, perform key frame detection processing on the key video coding data and the important video coding data according to the backup key frame data to obtain the video coding information, and decode the video coding information to obtain the video decoding information; a picture decoding sub-module 1212, configured to parse the picture coding data, perform key frame detection processing on the key picture coding data and the important picture coding data to obtain the picture coding information, decode the picture coding information to obtain the initial picture decoding information, and perform data recombination on the initial picture decoding information to obtain the picture decoding information. It should be noted that, in the embodiment of the present invention, the video decoding sub-module 1211 includes: a key frame detection processing sub-module 1213, configured to determine whether the key video coding data is the same as the backup key frame data when the video coding data is the key video coding data; if the key video coding data is the same as the backup key frame data, then use the key video coding data as the video coding information; if the key video coding data is different from the backup key frame data, then determine whether the resolution of the key video coding data is the same as the resolution of the backup key frame data; if the resolution of the key video coding data is the same as the resolution of the backup key frame data, then use the backup key frame data to replace the key video coding data, and use the replaced key video coding data as the video coding information; if the resolution of the key video coding data is different from the resolution of the backup key frame data, then determine whether the resolution of the key video coding data is supported; if not, then perform the step of using the backup key frame data to replace the key video coding data, and use the replaced key video coding data as the video coding information; if supported, then update the backup key frame data to the key video coding data, and use the key video coding data as the video coding information; an important frame detection processing sub-module 1214, configured to determine whether the previous frame video data of the important video coding data is the key video coding data when the video coding data is the important video coding data; if so, then use the important video coding data as the video coding information; if not, then use the important video coding data and the key video coding data as the video coding information. Understandably, when the video coding data is neither the important video coding data nor the key video coding data, at this time, the video coding data is general video coding data, and no key frame detection processing is required.It should also be noted that in this embodiment, the process of performing key frame detection processing on the key picture coding data and the important picture coding data in the picture decoding sub-module 1212 is the same as the process of performing key frame detection processing on the key video coding data and the important video coding data in the video decoding sub-module 1211. For the sake of simplicity of description, it will not be elaborated here. The specific process of performing key frame detection processing on the key picture coding data and the important picture coding data in the picture decoding sub-module 1212. Further, for ease of understanding, the video coding data is used as the input frame, the key video coding data is used as the key frame, the important video coding data is used as the important frame, the backup key frame data is used as the backup frame, and the video coding information is used as the output frame. In. Figure 9 In the flowchart shown, the process of key frame detection processing is described. It can be understood that Figure 9 The key frame detection processing process is applicable to the video decoding sub-module 1211 and the picture decoding sub-module 1212. Further, the video decoding sub-module 1211 is implemented by X264 of FFMPEG.

[0039] In some embodiments, such as this embodiment, as Figure 10 shown, the picture decoding sub-module 1212 includes: a data recombination sub-module 1215, configured to detect whether there is missing image data in the initial picture decoding information. If so, fill the missing image data with a preset filling value to obtain the picture decoding information, where the preset filling value is 0.

[0040] In some embodiments, such as this embodiment, as Figure 3 shown, the decoding and display unit 12 further includes a data protocol parsing module 123. The data protocol parsing module 123 parses the message type to send the video coding data to the video decoding queue and send the picture coding data to the picture decoding queue, so that the video decoding sub-module 1211 reads the video coding data from the video decoding queue and the picture decoding sub-module 1212 reads the picture coding data from the picture decoding queue. It can be understood that the video decoding sub-module 1211 and the picture decoding sub-module 1212 run on different threads respectively.

[0041] In some embodiments, such as this embodiment, as Figure 11As shown, the adjustment display module 122 includes an adjustment sub-module 1221 and a display sub-module 1222. Among them, the adjustment sub-module 1221 is used to check the resolution in the current image decoding information. If the resolution in the current image decoding information is different from the resolution in the previous frame of image decoding information, the resolution of the display sub-module is adjusted; the display sub-module 1222 is used to display the to-be-transmitted image corresponding to the image decoding information. It can be understood that if it is video decoding information, the adjustment sub-module 1221 checks the resolution in the video decoding information; if it is picture decoding information, the adjustment sub-module 1221 checks the resolution in the picture decoding information. It should be noted that in the embodiment of the present invention, after receiving the image decoding information, the adjustment display module 122 will also receive a refresh request sent by the decoding module 121 to display the image decoding information.

[0042] For the convenience of understanding, in the embodiment of the present invention, the image transmission system 10 is verified, and the verification steps are as follows: 1. The data input of the encoding unit 11 is simulated by the decoded recorded video data, and a frame of data is read from the file regularly and sent to the encoding unit 11; 2. The communication channel between the encoding unit 11 and the decoding display unit 12 is implemented by the UDP network; 3. The channel bandwidth fluctuation is implemented by a timer, the target rate is adjusted regularly, and the decoding display unit 12 calculates and displays the image transmission speed on the screen; 4. The channel error code is implemented by designing a wireless channel simulation module. The user sets the error code probability and the amount of error code data, judges whether the current packet is in error through a random algorithm, and then sets the error location through a random algorithm, and zeros the simulated error data location; 5. The key frame loss simulation is achieved by not sending data. The rate adjustment range in this embodiment is: 2500 kbps to 50 kbps. The screen effects under different packet loss conditions are shown in the following table. As can be seen from Table 1, by detecting and processing the key frames in the image encoding information, the decoding key data can be protected, and the probability of black screen and freezing can be reduced. Moreover, this embodiment also has the ability to adjust the image transmission rate in a large range: it supports the adjustment of four dimensions, namely resolution (1080P -> 480P), frame rate (60 frames -> 2 frames), image content (color -> black and white), encoding quality, and encoding method (video -> image).

[0043] Table 1

[0044]

[0045]

[0046] Refer to Figure 12 , Figure 12The figure shows a schematic flowchart of an embodiment of an image transmission method according to the present invention. This image transmission method is applied to the above-mentioned image transmission system. Hereinafter, the specific implementation steps of the image transmission system according to the present invention will be further elaborated in detail with this method. As Figure 12 shown, the method includes steps S110 - S130:

[0047] S110. Generate encoding parameters according to the input target rate and image information through a dynamic control module, and process the image to be transmitted according to the encoding parameters to generate image encoding information;

[0048] S120. Perform key frame detection processing on the image encoding information through a decoding module to obtain processed image encoding information, and decode the processed image encoding information to obtain image decoding information;

[0049] S130. Display the image to be transmitted corresponding to the image decoding information by adjusting a display module.

[0050] In the embodiment of the present invention, the image to be transmitted is processed to generate image encoding information according to the input target rate and image information through a dynamic control module; the image encoding information is subjected to key frame detection processing through a decoding module to obtain processed image encoding information for restoring and protecting decoded key data, and the processed image encoding information is decoded to obtain image decoding information, which can reduce the probability of black screen and freezing; the image to be transmitted corresponding to the image decoding information is displayed by adjusting a display module. It can be understood that the specific implementation steps of the dynamic control module, frame rate control sub-module, resolution adjustment sub-module, image color adjustment sub-module, encoding sub-module, video encoding sub-module, picture encoding sub-module, data input module, image information configuration sub-module, data input sub-module, decoding display unit, decoding module, video decoding sub-module, picture decoding sub-module, key frame detection processing sub-module, important frame detection processing sub-module, data recombination sub-module, adjustment display module, adjustment sub-module, display sub-module, and data protocol parsing module are as described above. For the sake of simplicity of description, they will not be elaborated here.

[0051] The present invention has been described above in combination with the best embodiments, but the present invention is not limited to the disclosed embodiments above, and should cover various modifications and equivalent combinations according to the essence of the present invention.

Claims

1. An image transmission system, characterized in that: The image transmission system includes an encoding unit and a decoding and display unit, wherein: The encoding unit includes a dynamic control module, the dynamic control module is used to generate encoding parameters according to the input target rate and image information, and process the image to be transmitted according to the encoding parameters to generate image encoding information; The decoding and display unit includes a decoding module and an adjustment and display module. The decoding module is used to perform key frame detection processing on the image coding information to obtain processed image coding information, and decode the processed image coding information to obtain image decoding information. The adjustment and display module is used to display the image to be transmitted corresponding to the image decoding information.

2. The image transmission system according to claim 1, characterized in that: The image information includes the current resolution and the current frame rate, the encoding parameters include the target frame rate, the target resolution, the color mode and the encoding method, and the dynamic control module includes: A frame rate control submodule, used for performing frame extraction processing on the image to be transmitted according to the current frame rate and the target frame rate, so as to determine whether the current frame data is used to obtain the frame extraction result; A resolution adjustment submodule, used for adjusting the resolution of the current frame data used as the frame extraction result according to the target resolution to obtain resolution-adjusted frame data; An image color adjustment submodule, configured to perform color adjustment on the resolution adjustment frame data according to the color mode to obtain color adjustment frame data; The encoding submodule is used to encode the color adjustment frame data according to the encoding method to obtain the image encoding information.

3. The image transmission system according to claim 2, characterized in that: The image coding information includes video coding data and picture coding data, and the coding submodule includes: a video encoding submodule, configured to encode the color adjustment frame data according to the current resolution to obtain a video encoding data packet, perform protocol parsing on the video encoding data packet to determine a frame type, and define frame data of the video encoding data packet according to the frame type to obtain the video encoding data, wherein the video encoding data includes key video encoding data, important video encoding data and general video encoding data, and the target resolution is added to the header of the key video encoding data; The picture encoding submodule is used to adjust the number of screen divisions according to the current resolution, encode the color adjustment frame data based on the number of screen divisions to obtain an initial picture encoding data packet, add header information to the picture encoding data to obtain a final picture encoding data packet, parse the final picture encoding data packet to define the frame data in the final picture encoding data packet to obtain the picture encoding data, wherein the picture encoding data includes key picture encoding data and important picture encoding data.

4. The image transmission system according to any one of claims 1 to 3, characterized in that: The encoding unit also includes: The data input module includes an image information configuration submodule and a data input submodule. The image information configuration submodule is configured with an image information configuration interface, and the image information configuration interface is used to input the image information. The data input submodule is configured with a data input interface, and the data input interface is used to input original image data.

5. The image transmission system according to claim 3, characterized in that: The processed image encoding information includes video encoding information and picture encoding information, the image decoding information includes video decoding information and picture decoding information, and the decoding module includes: A video decoding submodule, configured to parse the video encoding data, perform key frame detection processing on the key video encoding data and the important video encoding data according to the backup key frame data to obtain the video encoding information, and decode the video encoding information to obtain the video decoding information; The picture decoding submodule is used to parse the picture coding data, perform key frame detection processing on the key picture coding data and the important picture coding data to obtain the picture coding information, decode the picture coding information to obtain initial picture decoding information, and reorganize the initial picture decoding information to obtain the picture decoding information.

6. The image transmission system according to claim 5, characterized in that: The video decoding submodule includes: A key frame detection processing submodule, used for, when the video coding data is the key video coding data, determining whether the key video coding data is the same as the backup key frame data; if the key video coding data is the same as the backup key frame data, using the key video coding data as the video coding information; if the key video coding data is different from the backup key frame data, determining whether the resolution of the key video coding data is the same as the resolution of the backup key frame data; if the resolution of the key video coding data is the same as the resolution of the backup key frame data, using the backup key frame data to replace the key video coding data, and using the replaced key video coding data as the video coding information; if the resolution of the key video coding data is different from the resolution of the backup key frame data, determining whether the resolution of the key video coding data is supported; if not supported, executing the step of replacing the key video coding data with the backup key frame data, and using the replaced key video coding data as the video coding information; if supported, updating the backup key frame data to the key video coding data, and using the key video coding data as the video coding information; The important frame detection processing submodule is used to determine whether the previous frame of video data of the important video coding data is the key video coding data when the video coding data is the important video coding data; if so, use the important video coding data as the video coding information; if not, use the important video coding data and the key video coding data as the video coding information.

7. The image transmission system according to claim 5, characterized in that: The picture decoding submodule includes: The data reassembly submodule is used to detect whether there is missing image data in the initial picture decoding information, and if so, fill the missing image data with a preset filling value to obtain the picture decoding information.

8. The image transmission system according to claim 5, characterized in that: The decoding and display unit also includes a data protocol parsing module, which parses the message type to send the video encoding data to the video decoding queue and the picture encoding data to the picture decoding queue, so that the video decoding submodule reads the video encoding data from the video decoding queue and the picture decoding submodule reads the picture encoding data from the picture decoding queue.

9. The image transmission system according to claim 1, characterized in that: The adjustment display module includes an adjustment submodule and a display submodule, wherein: The adjustment submodule is used to check the resolution in the current image decoding information, and if the resolution in the current image decoding information is different from the resolution in the previous frame of image decoding information, the resolution of the display submodule is adjusted; The display submodule is used to display the image to be transmitted corresponding to the image decoding information.

10. An image transmission method, applied to the image transmission system according to any one of claims 1 to 9, characterized in that: The method comprises: Generate encoding parameters according to the input target rate and image information through a dynamic control module, and process the image to be transmitted according to the encoding parameters to generate image encoding information; Performing key frame detection processing on the image coding information through a decoding module to obtain processed image coding information, and decoding the processed image coding information to obtain image decoding information; The image to be transmitted corresponding to the image decoding information is displayed by adjusting a display module.

Images