Video processing method, video sending device, video receiving device and video processing system

By sampling and verification code replacement of video images, error code detection and optimization during video transmission is realized, the problem of redundant information bandwidth consumption in the prior art is solved, and the stability and quality of video transmission is improved.

CN118900344APending Publication Date: 2024-11-05QINGDAO NOVELBEAM TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411128226.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-16
Publication Date
2024-11-05

AI Technical Summary

Technical Problem

The prior art is difficult to ensure video frame rate and image quality in situations where image quality requirements are high. It is mainly because forward error correction (FEC) technology adds redundant information during the encoding process and controls it through protocols, resulting in excessive bandwidth resource consumption.

Method used

By sampling the video images to be processed, a verification code is generated and the image control pixels are replaced, error detection and optimization during video transmission is realized, and additional bandwidth consumption is avoided.

Benefits of technology

This method does not require bandwidth resources to consume, reduces the bit error rate, improves the stability and quality of video transmission, and solves the problem of redundant information bandwidth consumption in the prior art.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118900344A_ABST
    Figure CN118900344A_ABST
Patent Text Reader

Abstract

The invention provides a video processing method, a video sending device, a video receiving device and a video processing system. The video processing method comprises the following steps: sampling image display pixels of a to-be-processed first video to obtain first sampling pixels; generating a first check code according to the content of the first sampling pixel; replacing the content of the first control pixel with the first check code to obtain a second video; sending the second video; wherein the first control pixels are pixels in the image control pixels of the first video.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of image processing, and in particular to a video processing method, a video sending device, a video receiving device, and a video processing system. Background Art

[0002] Video transmission plays a vital role in modern communications and is widely used in video conferencing, online education, telemedicine, and streaming services. Video transmission is mostly done in two ways: wireless and wired. Wireless transmission may be affected by network noise, packet loss, and latency, resulting in reduced resolution and image frame loss. The wired method can ensure both high pixels and high frame rates, but has high requirements for physical connection cables. Due to differences in materials, wired transmission is more prone to bit errors than wireless transmission, resulting in white lines, screen distortion, or partial image abnormalities when displaying videos.

[0003] In order to ensure video quality, the existing technology generally uses forward error correction (FEC) technology to add redundant information in the encoding process at the sending end, and defines how to integrate the redundant information into the data transmission process through the network protocol, so that the receiving end can detect and correct errors based on the redundant information.

[0004] However, since FEC technology needs to add redundant information during the encoding process and control it through a protocol, and encoding and protocols consume bandwidth resources, it is difficult to ensure video frame rate and image quality in situations where high image quality requirements are required. Summary of the invention

[0005] In order to solve one of the above technical problems, the present disclosure provides a video processing method, a video sending device, a video receiving device and a video processing system.

[0006] According to one aspect of the present disclosure, there is provided a video processing method, comprising:

[0007] Sampling the image display pixels of the first video to be processed to obtain first sampled pixels;

[0008] generating a first check code according to the content of the first sampling pixel;

[0009] Replacing the content of the first control pixel with the first check code to obtain a second video;

[0010] sending the second video;

[0011] The first control pixel is a pixel in the image control pixel of the first video.

[0012] According to the video processing method of at least one embodiment of the present disclosure, the step of generating a first check code according to the content of the first sampling pixel includes:

[0013] Acquire grouped sampling pixels from the first sampling pixels;

[0014] generating group check codes according to the grouped sampling pixels respectively; and

[0015] A first check code is obtained according to the group check code.

[0016] According to one aspect of the present disclosure, there is provided a video processing method, comprising:

[0017] receiving a third video;

[0018] Acquire a second check code from a first control pixel position in the third video: sample the image display pixels of the third video to obtain second sampled pixels, and then generate a third check code according to the content of the second sampled pixels;

[0019] Compare the second check code with the third check code to obtain an error detection result;

[0020] Among them, the third video is the video of the second video after communication transmission; the second video is obtained by sampling the image display pixels of the first video to be processed to generate a first verification code, and replacing the content of the first control pixel with the first verification code; the first control pixel is a pixel in the image control pixel of the first video; the first control pixel position is the position of the first control pixel; the image display pixels of the first video and the image display pixels of the third video are sampled in the same way; the third verification code and the first verification code are generated in the same way.

[0021] According to at least one embodiment of the video processing method of the present disclosure, after obtaining the error detection result, the method further includes:

[0022] The third video is optimized according to the error detection result to obtain a fourth video.

[0023] According to the video processing method of at least one embodiment of the present disclosure, when the error detection result includes multiple group detection results, optimizing the third video according to the error detection result to obtain a fourth video includes:

[0024] When the group detection result shows that there is a bit error, an adjacent detection result is obtained, and the third video is optimized according to the distance between the adjacent detection result and the group detection result to obtain a fourth video;

[0025] When the group detection result shows that there is no bit error, an adjacent detection result is obtained, prediction is performed based on the adjacent pixel content, predicted pixel content corresponding to the group detection result is obtained, and the third video is optimized based on the predicted pixel content and the group pixel content of the group detection result to obtain a fourth video;

[0026] The adjacent detection result is a detection result without bit errors that is adjacent to the group detection result among the multiple group detection results.

[0027] According to the video processing method of at least one embodiment of the present disclosure, the optimizing the third video according to the distance between the adjacent detection result and the group detection result to obtain the fourth video includes:

[0028] Obtaining the distance between the adjacent detection result and the group detection result;

[0029] Determining whether the distance is greater than a preset first threshold;

[0030] If it is greater than, make a prediction based on the adjacent pixel contents to obtain the predicted pixel content corresponding to the group detection result;

[0031] Otherwise, taking the adjacent pixel content as the predicted pixel content corresponding to the group detection result;

[0032] Optimizing the third video according to the predicted pixel content to obtain a fourth video;

[0033] The adjacent pixel content is the content of the pixel corresponding to the adjacent detection result.

[0034] According to the video processing method of at least one embodiment of the present disclosure, the optimizing the third video according to the predicted pixel content and the grouped pixel content of the grouped detection result to obtain the fourth video includes:

[0035] Obtaining a difference value between the predicted pixel content and the grouped pixel content;

[0036] Determine whether the difference value is greater than a preset second threshold;

[0037] If it is greater than, optimizing the third video according to the predicted pixel content to obtain a fourth video;

[0038] Otherwise, the current third video is used as the fourth video.

[0039] According to another aspect of the present disclosure, there is provided a video sending device, comprising:

[0040] a memory storing execution instructions; and

[0041] A processor executes the execution instruction stored in the memory, so that the processor executes the video processing method of any embodiment of the present disclosure.

[0042] According to another aspect of the present disclosure, a video processing system is provided, comprising: a video sending device and a video receiving device; the video sending device communicates with the video receiving device; the video sending device and the video receiving device are used to implement the video processing method of any embodiment of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The accompanying drawings illustrate exemplary embodiments of the present disclosure and together with the description serve to explain the principles of the present disclosure. These drawings are included to provide a further understanding of the present disclosure and are incorporated in and constitute a part of this specification.

[0044] Figure 1 Schematic diagram of an application scenario of the video processing method according to an embodiment of the present disclosure.

[0045] Figure 2 The interactive schematic flow chart of the video processing method according to the embodiment of the present disclosure.

[0046] Figure 3 This is a flowchart of the video processing method provided in Embodiment 1 of the present disclosure.

[0047] Figure 4 for Figure 3 A flowchart of a method for obtaining a verification code in a video processing method is shown.

[0048] Figure 5 The process of the video processing method provided in Embodiment 2 of the present disclosure Figure 1 .

[0049] Figure 6 The process of the video processing method provided in Embodiment 2 of the present disclosure Figure 2 .

[0050] Figure 7 for Figure 6 The process of obtaining the second video method in the video processing method shown Figure 1 .

[0051] Figure 8 for Figure 6 The process of obtaining the second video method in the video processing method shown Figure 2 .

[0052] Fig. 9 for Figure 7 A flowchart of a distance acquisition method in a method for acquiring a second video is shown.

[0053] Fig.10for Figure 8 The flowchart of the method for obtaining predicted pixels in the method for obtaining the second video is shown.

[0054] Fig.11 for Figure 8 The flowchart of the pixel acquisition method in the method for acquiring the second video is shown.

[0055] Fig.12 This is a schematic diagram of the structure of the video sending device provided in Example 3 of the present disclosure.

[0056] Fig.13 A schematic diagram of the structure of the video receiving device provided in Embodiment 4 of the present disclosure Figure 1 .

[0057] Fig.14 A schematic diagram of the structure of the video receiving device provided in Embodiment 4 of the present disclosure Figure 2 . DETAILED DESCRIPTION

[0058] The present disclosure is further described in detail below in conjunction with the accompanying drawings and examples. It is understood that the specific examples described herein are only used to explain the relevant content, rather than to limit the present disclosure. It should also be noted that, for ease of description, only the parts related to the present disclosure are shown in the accompanying drawings.

[0059] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in the present disclosure can be combined with each other. The technical solution of the present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0060] With the rapid development of Internet technology, video has become an indispensable part of daily life. Whether it is entertainment, education, business or social interaction, the consumption and sharing of video content have reached an unprecedented level. As the foundation supporting all of this, video transmission technology faces many challenges, especially the balance between bit error rate and high bandwidth requirements. Bit error rate refers to the probability of data errors occurring during transmission, while bandwidth refers to the maximum rate of communication transmission data. In order to combat data loss and errors in communication transmission, video transmission usually adopts error correction mechanisms such as forward error correction (FEC) and automatic retransmission request (ARQ). FEC adds redundant information to the encoding process at the sender, and defines how to integrate redundant information into the data transmission process through network protocols, so that the receiver can restore the original data even if some data packets are lost. ARQ requires the sender to resend the lost part after detecting data packet loss. Although these mechanisms improve the reliability of transmission, they also require redundant information to be added during the encoding process and controlled by protocols. Coding and protocols consume bandwidth resources, and it is difficult to guarantee video frame rate and image quality in situations where high image quality requirements are required.

[0061] Figure 1 The application scenario of the video processing method of the embodiment of the present disclosure is shown. In this application scenario, a transmitter 10 and a receiver 20 may be included, and the transmitter 10 communicates with the receiver 20 via a network. The transmitter 10 is an entity responsible for capturing, processing and transmitting video data, such as a professional camera, a smart phone, a tablet computer, a webcam, a drone, etc.; the receiver 20 is an entity that receives and processes the video from the transmitter 10, such as a personal computer, a smart phone, a smart TV, a tablet computer, etc. The transmitter 10 can also communicate with the receiver 20 via HDMI, USB, Bluetooth, etc., in the same manner as Figure 1 Similar to that shown.

[0062] Figure 2 A schematic flow chart of a video processing method according to an embodiment of the present disclosure is shown. Figure 2 The detailed description is for a clearer understanding of the technical solution of the present disclosure and should not be considered as a limitation of the protection scope of the present disclosure. In the process of implementing the technical idea of ​​the present disclosure, one or some steps may be omitted, or other alternatives may be adopted.

[0063] Step S210: The sending end samples the image display pixels of the first video to be processed to obtain first sampled pixels.

[0064] In some embodiments of the present disclosure, the transmitting end in step S210 may be a terminal such as a smart phone; the first video to be processed may be a video captured by a smart phone or a video stored in a smart phone. The image display pixels are the pixels of the image actually displayed in the first video, and the sampling method may be set arbitrarily. In order to ensure that pixels from different images of the video are included in the final first sampled pixels, step S210 may first group the first video and then sample the grouped video.

[0065] Step S211: The transmitting end obtains grouped sampling pixels from the first sampling pixels.

[0066] Step S212: The transmitting end generates a group check code according to the group sampling pixels respectively.

[0067] In some implementations of the present disclosure, the group check code in step S212 may be the sum or product of the pixels in the grouped sampling pixels.

[0068] Step S213: The sending end obtains a first check code according to the group check code.

[0069] In some implementations of the present disclosure, the first check code in step S213 is composed of all group check codes.

[0070] In step S214, the transmitting end replaces the content of the first control pixel with the first verification code to obtain the second video.

[0071] In some embodiments of the present disclosure, the first control pixel in step S214 is a pixel in the image control pixels of the first video, and can be any pixel in the image control pixels, or can be an unimportant pixel in the image control pixels.

[0072] Step S215: the sending end sends the second video.

[0073] Step S216: the receiving end receives the third video.

[0074] In some embodiments of the present disclosure, since the second video may introduce noise or interference during the communication transmission process, causing the second video to change, the third video in step S216 is the video after the second video is transmitted through communication. The communication transmission can be wired communication such as USB, HDMI, wired network, etc., or wireless communication such as WIFI, Bluetooth, etc.

[0075] Step S217: The receiving end obtains a second verification code from the first control pixel position in the third video.

[0076] In some embodiments of the present disclosure, the first control pixel position in step S217 is the position of the first control pixel.

[0077] Step S218: the receiving end samples the image display pixels of the third video, obtains the second sampled pixels, and then generates a third check code according to the content of the second sampled pixels.

[0078] In some embodiments of the present disclosure, the image display pixels of the first video and the image display pixels of the third video are sampled in the same manner; and the third check code and the first check code are generated in the same manner.

[0079] Step S219: The receiving end compares the second check code with the third check code to obtain an error detection result.

[0080] In some embodiments of the present disclosure, when it is determined through step S219 that the second check code and the third check code are the same, the error detection result is that there is no error; when it is determined through step S219 that the second check code and the third check code are different, the error detection result is that there is an error.

[0081] Step S220: The receiving end optimizes the third video according to the error detection result to obtain a fourth video.

[0082] In some implementations of the present disclosure, through step S220, the content of the third video and the like can be optimized according to the error detection result, thereby improving the video quality.

[0083] Combined with the following Figure 3 to Figure 4 The video processing method disclosed in the present invention is described in detail.

[0084] Embodiment 1:

[0085] Figure 3 The present invention is a flowchart of a video processing method according to an embodiment of the present invention.

[0086] refer to Figure 3 The video processing method M300 of this embodiment includes:

[0087] Step S310 , sampling the image display pixels of the first video to be processed to obtain first sampled pixels.

[0088] Step S320: Generate a first verification code according to the content of the first sampling pixel.

[0089] Step S330: Replace the content of the first control pixel with the first verification code to obtain a second video.

[0090] Step S340, sending the second video.

[0091] In some embodiments of the present disclosure, the first control pixel in step S330 is a pixel in the image control pixel of the first video.

[0092] The video processing method provided by the present disclosure samples the image display pixels of the first video to be processed, generates a first check code after obtaining the first sampled pixels, replaces the first control pixel in the image control pixel of the first video with the first check code to obtain the second video and then sends it to realize the video processing process. The method is realized by replacing the first control pixel of the first video with the first check code, does not need to consume bandwidth resources, ensures the stability of video transmission, and reduces the bit error rate, and solves the problem in the prior art that the FEC technology needs to add redundant information in the encoding process and control through the protocol, and the encoding and protocol will consume bandwidth resources, and it is difficult to ensure the video frame rate and image quality in occasions with high image quality requirements.

[0093] In some embodiments of the present disclosure, the first video to be processed in step S310 may be directly captured by a local camera, may be pre-stored locally, or may be received from other terminals.

[0094] In some embodiments of the present disclosure, the image display pixels in step S310 are pixels actually used to construct the video screen, that is, pixels that actually display the image in the video screen; the image display pixels are responsible for presenting the video content and are the main part of the image that the audience sees on the screen. Step S310 can perform overall sampling of all image display pixels of the first video according to a preset sampling rule. In order to prevent the overall sampling calculation amount from being too large, or the sampling of a part of the image display pixels resulting in a low error detection accuracy, the sampling process in step S310 can first group the first video, and then sample the grouped videos separately to obtain the first sampled pixels. At this time, the grouping method can be set according to actual needs, such as taking a frame of the first video as a group, taking one or several rows of pixels of a frame of the image as a group, etc.

[0095] In some embodiments of the present disclosure, the sampling method in step S310 can be down sampling (sampling some pixels from each row of image display pixels) or skip sampling (sampling some rows of image display pixels from each frame of image), etc. In order to accurately detect whether there are errors in the transmitted video, the sampling method can also be comprehensive sampling in dimensions such as row-by-row sampling or column-by-column sampling. In particular, in order to improve the efficiency of video processing, the sampling method can also correspond to the sending method of sending the second video; taking the pixel data of the second video sent row by row as an example, the sending end obtains the grouping check code row by row according to the preset sampling rules, replaces the check code and sends it, and the sending end does not need to cache the data; after receiving the pixel data row by row, the receiving end can directly perform error detection without caching, which can reduce data redundancy and reduce the complexity of management and maintenance.

[0096] In some embodiments of the present disclosure, image control pixels refer to pixels in the video that are not directly involved in constructing the video screen, that is, image control pixels are pixels that exist in the video signal but are not used to display the image content; image control pixels may be used for various purposes, such as synchronization signals, control signals or other raw data, and image control pixels will not be displayed on the screen during normal viewing; image control pixels may include: edge pixels (referring to pixels located at the edge of the image sensor, which may be excluded or specially processed in image processing to ensure the overall quality of the image), dark current pixels (used to measure and correct dark current noise), test pixels (used to calibrate and detect the performance of the image sensor to help ensure the accuracy and quality of the actual imaging pixels), overscan pixels (used to correct readout noise and other non-ideal factors), interpolation pixels (used to improve the resolution of the image or fill in missing parts), etc.

[0097] like Figure 4As shown, step S320 may include: step S321, obtaining grouped sampling pixels from the first sampling pixels; step S322, generating grouped verification codes according to the grouped sampling pixels respectively; step S323, obtaining a first verification code according to the grouped verification code. Wherein, step S322 may generate the grouped verification code according to the grouped sampling pixels by mathematical operation, and the mathematical operation may be a summation operation, a hash operation, a statistical operation (such as an average, a median, a mode, a standard deviation operation), etc.

[0098] In step S330, the first control pixel may be any pixel in the image control pixel, or may be a pixel in the image control pixel without a specific function or a pixel in the image control pixel with an unimportant function, etc. Taking a 1080p video as an example, the image display pixel is 1920*1080, and the image control pixel is not visible on the display device, and is used to help the display device to correctly synchronize and process the image display pixel.

[0099] The video processing method provided by the present disclosure takes line-by-line transmission as an example. When the data to be transmitted is the Xth line of data, the data processed by steps S320 to S340 are all the Xth line of data; at this time, the first video in step S310 can be the Xth line of video or the complete video; when the first video in step S310 is the complete video, step S310 can first obtain the Xth line of data from the first video and then perform sampling. The process of error detection at the receiving end is similar to that provided in Example 2.

[0100] Combined with the following Figures 5 to 11 The video processing method disclosed in the present invention is described in detail.

[0101] Embodiment 2:

[0102] Figure 5 The present invention is a flowchart of a video processing method according to an embodiment of the present invention.

[0103] refer to Figure 5 The video processing method M500 of this embodiment includes:

[0104] Step S510, receiving a third video.

[0105] Step S520: Obtain a second verification code from the first control pixel position in the third video.

[0106] Step S530: sampling the image display pixels of the third video to obtain second sampled pixels, and then generating a third check code according to the content of the second sampled pixels.

[0107] Step S540: compare the second check code with the third check code to obtain an error detection result.

[0108] Among them, the third video is the video after the second video is transmitted through communication; the second video is obtained by sampling the image display pixels of the first video to be processed to generate the first verification code, and then replacing the content of the first control pixel with the first verification code; the first control pixel is the pixel in the image control pixel of the first video; the first control pixel position is the position of the first control pixel; the sampling method of the image display pixels of the first video and the image display pixels of the third video are the same; the generation method of the third verification code is the same as the first verification code.

[0109] The video processing method provided by the present disclosure performs error detection on the second check code and the third check code in the received third video to obtain the error detection result. In the method, the third video is the video after the second video is transmitted through communication, and the second video is obtained by sampling the image display pixel of the first video to be processed to generate the first check code, and then replacing the content of the first control pixel in the image control pixel of the first video with the first check code, that is, the method realizes error detection after replacing the first control pixel of the first video with the first check code, without consuming additional bandwidth, and solves the problem in the prior art that the FEC technology needs to add redundant information in the encoding process and control through the protocol, and the encoding and protocol will consume bandwidth resources, and it is difficult to ensure the video frame rate and image quality in occasions with high image quality requirements. In addition, the method realizes detection by obtaining the check code through video sampling, and can also improve the detection speed, solving the problem of slow error detection speed for each pixel one by one in the prior art.

[0110] In some embodiments of the present disclosure, the third video in step S510 is ideally the same as the second video; however, since errors may occur during video transmission due to channel noise, hardware failure, interference or other problems, the third video may also be different from the second video, that is, the third video is the video after the second video is affected by video transmission errors.

[0111] In some embodiments of the present disclosure, the specific process of obtaining the error detection result in step S540 may be: determining whether the second check code is the same as the third check code; if they are the same, the detection result is that there is no error; otherwise, the detection result is that there is an error. When the second check code includes multiple identifiers, the third check code also includes multiple identifiers. In this case, step S540 is to determine whether a certain identifier in the second check code is the same as the corresponding identifier in the third check code.

[0112] In some embodiments of the present disclosure, the second check code obtained in step S520 may be the same as or different from the first check code, that is, the second check code is an identification of the first check code after being affected by the video transmission error. Therefore, when the error detection result obtained in step S540 is that there is an error, it is possible that the check code is not affected, but the content of the corresponding image display pixel is affected; it is also possible that the check code is affected, but the content of the corresponding image display pixel is not affected, etc.

[0113] Furthermore, if Figure 6 As shown, the video processing method provided by the present disclosure may also include:

[0114] Step S550, optimizing the third video according to the error detection result to obtain a fourth video.

[0115] In some embodiments of the present disclosure, the specific method of obtaining the fourth video according to the error detection result in step S550 can be that when the error detection result is that there is an error, the third video is repaired to obtain the fourth video; when the error detection result is that there is no error, the third video is directly used as the fourth video, or the third video is enhanced to obtain the fourth video. After the fourth video is obtained through step S550, the fourth video can be decoded, deblocked and denoised, scaled and cropped, synchronized, displayed, etc. for viewing by the audience.

[0116] Specifically, when the error detection result includes multiple group detection results, for any group detection result, when the group detection result is that there is an error, in order to improve the video quality, such as Figure 7 As shown, step S550 may include: step S551, obtaining an adjacent detection result; step S552, optimizing the third video according to the distance between the adjacent detection result and the group detection result to obtain a fourth video. When the group detection result is that there is no bit error, such as Figure 8 As shown, step S550 may include: step S553, obtaining adjacent detection results; step S554, predicting according to adjacent pixel contents, obtaining predicted pixel contents corresponding to the grouped detection results; step S555, optimizing the third video according to the predicted pixel contents and the grouped pixel contents of the grouped detection results, to obtain the fourth video. Among them, the adjacent detection results are the detection results without bit errors adjacent to the grouped detection results among the multiple grouped detection results. The adjacent detection results can be either the detection results before the grouped detection results or the detection results after the grouped detection results. The distance is the relative position between the detection results. Assuming 1-10 detection results, among which 5 and 6, 8 and 9 have bit errors, the adjacent detection results of 5 and 6 are 4 and / or 7, and the adjacent detection results of 8 and 9 are 7 and / or 10; the distance between 5 and 7 is 7-5=2, and the distance between 5 and 4 is 5-4=1.

[0117] like Fig. 9 As shown, step S552 may include: step S5521, obtaining the distance between the adjacent detection result and the group detection result; step S5522, determining whether the distance is greater than a preset first threshold; if greater, executing step S5523; otherwise, executing step S5524; step S5523, predicting according to the adjacent pixel content, obtaining the predicted pixel content corresponding to the group detection result; step S5524, using the adjacent pixel content as the predicted pixel content corresponding to the group detection result; step S5525, optimizing the third video according to the predicted pixel content (i.e., using the predicted pixel content to replace the pixel content corresponding to the group detection result), to obtain a fourth video; wherein the adjacent pixel content is the content of the pixel corresponding to the adjacent detection result. Step S5525 may be replacing the original pixel of the group detection result in the first video with the predicted pixel.

[0118] like Fig.10 As shown, step S554 or step S5523 may include: step S5541, obtaining the predicted state and prediction matrix of the adjacent pixel content; step S5542, obtaining the predicted pixel content according to the predicted state and the prediction matrix; wherein the adjacent pixel content is the content of the pixel corresponding to the adjacent detection result. Step S5541 can obtain the predicted state according to the adjacent pixel content and the preset dynamic model, and obtain the prediction matrix according to the preset dynamic model and the state covariance matrix of the adjacent pixels; step S5542 can determine the residual and gain according to the predicted state and the prediction matrix, and then determine the predicted pixel content according to the residual and the gain.

[0119] To improve video quality, such as Fig.11 As shown, step S555 may include: step S5551, obtaining the difference value between the predicted pixel content and the grouped pixel content; step S5552, determining whether the difference value is greater than a preset second threshold; if greater, executing step S5553; otherwise, executing step S5554; step S5553, optimizing the third video according to the predicted pixel content (i.e., replacing the grouped pixel content with the predicted pixel content) to obtain a fourth video; step S5554, using the current third video as the fourth video.

[0120] In one embodiment, the difference value between the predicted pixel content and the grouped pixel content can be obtained by the following steps: comparing the difference value between the predicted pixel content and the grouped pixel content (current row data) in units of pixels, and accumulating the difference value to obtain the difference value. The preset second threshold value can be 200.

[0121] The video processing method provided in the present disclosure and the method for generating the second video are similar to those provided in Example 1.

[0122] Fig.12 The video sending device of the present invention can be implemented based on a hardware implementation method using a processor.

[0123] Embodiment 3:

[0124] An embodiment of the present disclosure provides a video sending device.

[0125] The device may include a corresponding module for performing each or several steps in the above flowchart. Therefore, each step or several steps in the above flowchart may be performed by a corresponding module, and the device may include one or more modules in these modules. The module may be one or more hardware modules specially configured to perform the corresponding steps, or implemented by a processor configured to perform the corresponding steps, or stored in a computer-readable medium for implementation by a processor, or implemented by some combination.

[0126] Fig.12 1 is a video transmission device 1000 that shows a hardware implementation of a processing system. The hardware can be implemented using a bus architecture. The bus architecture can include any number of interconnected buses and bridges, depending on the specific application and overall design constraints of the hardware. The bus 1100 connects various circuits including one or more processors 1200, memory 1300 and / or hardware modules together. The bus 1100 can also connect various other circuits 1400 such as peripherals, voltage regulators, power management circuits, external antennas, etc., which are conventional techniques in the art and will not be described again.

[0127] like Fig.12 As shown, the video sending device according to the present disclosure may include:

[0128] The video sampling module 1010 is used to sample the image display pixels of the first video to be processed to obtain first sampled pixels.

[0129] The identification acquisition module 1020 is used to generate a first verification code according to the content of the first sampling pixel.

[0130] The identification replacement module 1030 is used to replace the content of the first control pixel with the first verification code to obtain the second video.

[0131] The video sending module 1040 is used to send the second video.

[0132] The first control pixel is a pixel in the image control pixel of the first video.

[0133] The video sending device provided in the embodiment of the present disclosure implements the process of video sending through the above modules, and the process of each of the above modules implementing its function, which is similar to that provided in embodiment 1 of the present disclosure.

[0134] Fig.13 The video receiving device of the present invention can be implemented based on a hardware implementation method using a processor.

[0135] Embodiment 4:

[0136] An embodiment of the present disclosure provides a video receiving device.

[0137] The device may include a corresponding module for performing each or several steps in the above flowchart. Therefore, each step or several steps in the above flowchart may be performed by a corresponding module, and the device may include one or more modules in these modules. The module may be one or more hardware modules specially configured to perform the corresponding steps, or implemented by a processor configured to perform the corresponding steps, or stored in a computer-readable medium for implementation by a processor, or implemented by some combination.

[0138] Fig.13 21 is a video receiving device 2000 that shows a hardware implementation of a processing system. The hardware can be implemented using a bus architecture. The bus architecture can include any number of interconnected buses and bridges, depending on the specific application and overall design constraints of the hardware. The bus 2100 connects various circuits including one or more processors 2200, memory 2300 and / or hardware modules together. The bus 2100 can also connect various other circuits 2400 such as peripherals, voltage regulators, power management circuits, external antennas, etc., which are conventional techniques in the art and will not be described again.

[0139] like Fig.13 As shown, the video receiving device according to the present disclosure may include:

[0140] The video receiving module 2010 is used to receive a third video.

[0141] The identification acquisition module 220 is used to obtain the second verification code from the first control pixel position in the third video: after sampling the image display pixels of the third video and obtaining the second sampled pixels, the third verification code is generated according to the content of the second sampled pixels.

[0142] The error code detection module 2030 is used to compare the second check code with the third check code to obtain an error code detection result.

[0143] Among them, the third video is the video after the second video is transmitted through communication; the second video is obtained by sampling the image display pixels of the first video to be processed to generate the first verification code, and then replacing the content of the first control pixel with the first verification code; the first control pixel is the pixel in the image control pixel of the first video; the first control pixel position is the position of the first control pixel; the sampling method of the image display pixels of the first video and the image display pixels of the third video are the same; the generation method of the third verification code is the same as the first verification code.

[0144] Furthermore, if Fig.14 As shown, the video receiving device provided by the present disclosure may also include:

[0145] The video optimization module 2040 is used to optimize the third video according to the error detection result to obtain a fourth video.

[0146] The video receiving device provided in the embodiment of the present disclosure implements the process of video receiving through the above modules, and the process of each of the above modules implementing its function, which is similar to that provided in Embodiment 2 of the present disclosure.

[0147] The present disclosure also provides a video processing system, including a video sending device and a video receiving device, wherein the video sending device communicates with the video receiving device. Fig.12 As shown, the structure of the video receiving device is as follows Fig.13 As shown in / 14, the video processing system implements a video processing process similar to that provided in Examples 3 and 4.

[0148] The present disclosure also provides a readable storage medium, in which a computer program is stored, and the computer program is used to implement the above method when executed by a processor. "Readable storage medium" can be any device that can contain, store, communicate, propagate or transmit a program for use in an instruction execution system, device or equipment or in combination with these instruction execution systems, devices or equipment. More specific examples of readable storage media include the following: an electrical connection portion (electronic device) with one or more wirings, a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and editable read-only memory (EPROM or flash memory), an optical fiber device, and a portable read-only memory (CDROM), etc.

[0149] The present disclosure also provides a computer program product. The method of the present disclosure can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instruction is loaded and executed, the process or function of the present disclosure is executed in whole or in part.

[0150] The computer program or instructions may be stored in a readable storage medium or transmitted from one readable storage medium to another readable storage medium, for example, the computer program or instructions may be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means. The readable storage medium may be any available medium that can be accessed or a data storage device such as a server, data center, etc. that integrates one or more available media. The available medium may be a magnetic medium, such as a floppy disk, a hard disk, or a magnetic tape; it may also be an optical medium, such as a digital video disk; it may also be a semiconductor medium, such as a solid state drive. The computer readable storage medium may be a volatile or non-volatile storage medium, or may include both volatile and non-volatile types of storage media.

[0151] Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, systems, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0152] The present disclosure is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to the present disclosure. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0153] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0154] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0155] In the description of this specification, the description with reference to the terms "one embodiment / method", "some embodiments / methods", "example", "specific example", or "some examples" etc. means that the specific features, structures, or characteristics described in conjunction with the embodiment / method or example are included in at least one embodiment / method or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment / method or example. Moreover, the specific features, structures, or characteristics described may be combined in any one or more embodiments / methods or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments / methods or examples described in this specification and features of different embodiments / methods or examples, unless they are contradictory.

[0156] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0157] Those skilled in the art should understand that the above embodiments are only for the purpose of clearly illustrating the present disclosure, and are not intended to limit the scope of the present disclosure. For those skilled in the art, other changes or modifications may be made based on the above disclosure, and these changes or modifications are still within the scope of the present disclosure.

Claims

1. A video processing method, characterized in that: include: Sampling the image display pixels of the first video to be processed to obtain first sampled pixels; generating a first check code according to the content of the first sampling pixel; Replacing the content of the first control pixel with the first check code to obtain a second video; as well as sending the second video; The first control pixel is a pixel in the image control pixel of the first video.

2. The video processing method according to claim 1, characterized in that: The generating a first check code according to the content of the first sampling pixel comprises: Acquire grouped sampling pixels from the first sampling pixels; generating group check codes according to the grouped sampling pixels respectively; and A first check code is obtained according to the group check code.

3. A video processing method, characterized in that: include: receiving a third video; Acquire a second check code from a first control pixel position in the third video: sample the image display pixels of the third video to obtain second sampled pixels, and then generate a third check code according to the content of the second sampled pixels; as well as Compare the second check code with the third check code to obtain an error detection result; Among them, the third video is the video of the second video after communication transmission; the second video is obtained by sampling the image display pixels of the first video to be processed to generate a first verification code, and replacing the content of the first control pixel with the first verification code; the first control pixel is a pixel in the image control pixel of the first video; the first control pixel position is the position of the first control pixel; the image display pixels of the first video and the image display pixels of the third video are sampled in the same way; the third verification code and the first verification code are generated in the same way.

4. The video processing method according to claim 3, characterized in that: After obtaining the error detection result, the method further includes: The third video is optimized according to the error detection result to obtain a fourth video.

5. The video processing method according to claim 4, characterized in that: When the error detection result includes a plurality of group detection results, optimizing the third video according to the error detection result to obtain a fourth video includes: When the group detection result shows that there is a bit error, an adjacent detection result is obtained, and the third video is optimized according to the distance between the adjacent detection result and the group detection result to obtain a fourth video; and When the group detection result shows that there is no bit error, an adjacent detection result is obtained, prediction is performed according to the adjacent pixel content, and predicted pixel content corresponding to the group detection result is obtained, and the third video is optimized according to the predicted pixel content and the group pixel content of the group detection result to obtain a fourth video; The adjacent detection result is a detection result without bit errors that is adjacent to the group detection result among the multiple group detection results.

6. The video processing method according to claim 5, characterized in that: The step of optimizing the third video according to the distance between the adjacent detection result and the group detection result to obtain the fourth video includes: Obtaining the distance between the adjacent detection result and the group detection result; Determining whether the distance is greater than a preset first threshold; If it is greater than, make a prediction based on the adjacent pixel contents to obtain the predicted pixel content corresponding to the group detection result; Otherwise, taking the adjacent pixel content as the predicted pixel content corresponding to the group detection result; and Optimizing the third video according to the predicted pixel content to obtain a fourth video; The adjacent pixel content is the content of the pixel corresponding to the adjacent detection result.

7. The video processing method according to claim 5, characterized in that: The step of optimizing the third video according to the predicted pixel content and the grouped pixel content of the grouped detection result to obtain a fourth video comprises: Obtaining a difference value between the predicted pixel content and the grouped pixel content; Determine whether the difference value is greater than a preset second threshold; If it is greater than, optimizing the third video according to the predicted pixel content to obtain a fourth video; and Otherwise, the current third video is used as the fourth video.

8. A video sending device, characterized in that: include: A memory storing execution instructions; as well as A processor, wherein the processor executes the execution instruction stored in the memory, so that the processor executes the video processing method according to any one of claims 1 to 2.

9. A video receiving device, characterized in that: include: A memory storing execution instructions; as well as A processor, wherein the processor executes the execution instruction stored in the memory, so that the processor executes the video processing method according to any one of claims 3 to 8.

10. A video processing system, characterized in that: include: A video sending device and a video receiving device; the video sending device communicates with the video receiving device; the video sending device is used to implement the video processing method described in any one of claims 1 to 2; the video receiving device is used to implement the video processing method described in any one of claims 3 to 8.