Video processing method, system, equipment and medium

Abstract

The invention relates to a video processing method, system and device and a medium. The method comprises the steps of obtaining a pulse video frame sequence; wherein each pulse video frame comprises a plurality of pixels, and each pixel has a pulse value; for each pulse video frame in the pulse video frame sequence, analyzing the pulse video frame pixel by pixel, and determining the brightness of the pixel according to the pulse of the pixel in the pulse video frame; and synthesizing the brightness of each pixel in each pulse video frame, and determining the brightness of the pulse video frame sequence. According to the invention, the brightness of each pixel in the corresponding video frame can be more reasonably and accurately restored.

Description

Technical Field

[0001] The present invention relates to the field of video processing technology, and in particular to a video processing method, system, device and medium. Background Art

[0002] With the continuous development of video technology, people's demand for shooting high-speed moving objects has become more and more urgent. However, although traditional high-speed photography can reach thousands or even tens of thousands of frames per second, the cost is too high and it can only be used in special fields such as scientific research, and has not been widely used.

[0003] In order to solve these problems, pulse video technology has been studied and applied as a new imaging method in recent years. Pulse video adopts an innovative imaging principle, which is different from the traditional image capture method. This method uses a pulse signal to replace the traditional continuous frame acquisition, and captures the image information of high-speed moving objects through an "integral comparison mechanism". However, in the subsequent image processing and brightness restoration, each pixel value output by the pulse video is a binary signal (0 or 1), and further image processing algorithms are required to restore the true brightness of each pixel. How to reasonably extract useful brightness information from pulse video has become a major challenge. Therefore, it is necessary to provide a video processing method, system, device and medium. Summary of the invention

[0004] In view of the above-mentioned shortcomings of the prior art, an object of the present invention is to provide a method, system, device and medium for product interface conversion, which improves the problem of low brightness restoration accuracy of pulse video frames in the prior art.

[0005] To achieve the above-mentioned purpose and other related purposes, the present invention provides a video processing method, comprising: obtaining a pulse video frame sequence; wherein each pulse video frame includes multiple pixels, and each pixel has a pulse value; for each pulse video frame in the pulse video frame sequence: analyzing the pulse video frame pixel by pixel, and determining the brightness of the pixel based on the pulse of the pixel in the pulse video frame; and determining the brightness of the pulse video frame sequence by comprehensively analyzing the brightness of each pixel in each pulse video frame.

[0006] In one embodiment of the present invention, for each pulse video frame in a pulse video frame sequence: analyzing the pulse video frame pixel by pixel, and determining the brightness of the pixel based on the pulse of the pixel in the pulse video frame, includes: sequentially analyzing each pulse video frame in the pulse video frame sequence; for each pulse video frame: analyzing the pulse video frame pixel by pixel, reading the pulse of each pixel in the pulse video frame, and arranging all pulses of the same pixel in sequence to form a pulse sequence; wherein the pulse includes a first value and a second value that are different; for the pulse sequence of the same pixel: dividing the pulse sequence into at least one pulse subsequence according to the first value; and calculating the brightness of each pulse subsequence in the corresponding pulse video frame.

[0007] In one embodiment of the present invention, the calculation of the brightness of each pulse subsequence in the corresponding pulse video frame includes: if the first pulse of the pulse subsequence is the first value, then the brightness of the pixel in the pulse video frame corresponding to the pulse subsequence is the first value; if the first pulse of the pulse subsequence is the second value, then based on the preset accumulated charge amount and the total amount of all pulses in the pulse subsequence, the brightness of the pixel in the pulse video frame corresponding to the pulse subsequence is determined.

[0008] In one embodiment of the present invention, the brightness of the pixel in the pulse video frame corresponding to the pulse subsequence is Wherein, L is the brightness of the pixel in the corresponding video frame, G is the preset cumulative charge threshold, and j is the number of pulses having the second value in the pulse subsequence.

[0009] In one embodiment of the present invention, the brightness of each pixel in each pulse video frame is integrated to determine the brightness of the pulse video frame sequence, including: for each pixel: performing gamma correction on the brightness of the pixel in each pulse video frame to obtain the final brightness of the pixel in each pulse video frame; arranging the gamma-corrected pulse video frames in sequence to obtain the brightness of the corrected pulse video frame sequence.

[0010] In an embodiment of the present invention, after the brightness of each pixel in each pulse video frame is integrated to determine the brightness of the pulse video frame sequence, the method further includes: performing image denoising on each pulse video frame with determined brightness.

[0011] In one embodiment of the present invention, the image denoising of each pulse video frame of determined brightness includes: performing image smoothing processing on each pulse video frame based on a bilateral filtering method to obtain a smoothed pulse video frame.

[0012] In one embodiment of the present invention, a video processing system is also provided, the system comprising: a pulse video acquisition module, used to acquire a pulse video frame sequence; wherein each pulse video frame comprises a plurality of pixels, and each pixel has a pulse value; a brightness determination module, used to analyze the pulse video frame pixel by pixel for each pulse video frame in the pulse video frame sequence, and determine the brightness of the pixel according to the pulse of the pixel in the pulse video frame; and a brightness adjustment module, used to comprehensively determine the brightness of each pixel in each pulse video frame to determine the brightness of the pulse video frame sequence.

[0013] In one embodiment of the present invention, an electronic device is also provided, including: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the electronic device implements any of the above-mentioned video processing methods.

[0014] In one embodiment of the present invention, a computer-readable storage medium is further provided, on which a computer program is stored. When the computer program is executed by a processor of a computer, the computer executes any of the above-mentioned video processing methods.

[0015] As described above, a video processing method, system, device and medium of the present invention have the following beneficial effects: making full use of the local information of the pulse value, by analyzing the brightness of each pixel, the accuracy of the final brightness calculation is ensured, and by analyzing the pulse video frame by frame, the change of the brightness between frames can be captured more accurately, so that the final calculated brightness value is more accurate. By integrating the brightness distribution of each pulse video frame, the restoration of the brightness value of the entire sequence is achieved. According to the acquisition principle of pulse video data, the present invention can restore the brightness of each pixel in the corresponding video frame more reasonably and accurately. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A schematic flow chart of a video processing method provided by an embodiment of the present invention;

[0017] Figure 2 A schematic diagram showing brightness estimation of pulse data at each moment provided by an embodiment of the present invention;

[0018] Figure 3 Shown is a structural block diagram of a video processing system provided by an embodiment of the present invention;

[0019] Figure 4 Shown is a structural schematic diagram of an electronic device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0020] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0021] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0022] In the following description, numerous details are discussed to provide a more thorough explanation of the embodiments of the present invention. However, it is obvious to those skilled in the art that the embodiments of the present invention can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present invention difficult to understand.

[0023] Pulse video uses an integral comparison mechanism. The integrator can accumulate the charge output by the photoelectric converter. The comparator compares the charge on the integrator with the preset threshold at a fixed time interval. If the accumulated charge on the integrator reaches the preset threshold, it outputs 1 and clears the charge on the integrator. If the charge on the integrator does not reach the preset threshold, it outputs 0 and maintains the charge on the integrator. It can be seen that this method is very different from the traditional shooting method. The traditional shooting method extracts the charge on the integrator at a fixed time interval, and the charge on the integrator will be cleared regardless of the charge.

[0024] Traditional shooting methods use the number of charges extracted as the brightness of the pixel corresponding to the integrator. In the era of digital photography, the brightness will be quantized into an integer, represented by 8 bits or more. This brings two problems: first, the processor needs to have a very high sensitivity. Because in high-speed photography, the signal will be distributed over all time intervals, and the signal collected at each time interval will become very weak; second, the processor needs to have a very high data processing speed. Because in high-speed photography, the amount of data is proportional to the frame rate. Pulse video better overcomes the two problems of traditional high-speed photography. First, pulse video does not need to extract the specific intensity of the signal at each time interval, but only needs to compare the signal intensity (number of charges) with the size of the preset threshold. Second, each pixel only generates 1 bit of data at each time interval, reducing the amount of data.

[0025] However, the inventors found that the pulse video records the brightness of each pixel through the output of 0 and 1, and it needs to be processed later to obtain the brightness of each pixel in the usual sense at each moment. An existing post-processing method is to intercept the pulse data of several consecutive moments, add the pulse data of the same pixel, and use the sum of the pulse data as the brightness of the pixel. After gamma correction, the brightness that conforms to the visual characteristics of the human eye is obtained. However, this method does not fully conform to the principle of pulse video data acquisition. Because the 0 and 1 in the pulse data do not represent the brightness at the corresponding moment, but indicate whether it has accumulated to the preset threshold. Therefore, this method cannot accurately characterize the brightness value of the pixel.

[0026] The present invention provides a video processing method, which accurately restores the overall brightness characteristics of the pulse video frame sequence by analyzing the pulse video frame frame by frame and pixel by pixel, combining the pulse value to determine the pixel brightness, and comprehensively analyzing the brightness distribution of each pulse video frame. By effectively extracting the brightness information at the pixel level and retaining the temporal dynamic characteristics of the pulse video frame, the accuracy of the brightness calculation is improved, and the integrity of the sequence restoration is ensured, providing a high-quality brightness data foundation for subsequent image reconstruction.

[0027] See also Figure 1 , the video processing method includes the following steps:

[0028] S1. Obtain a pulse video frame sequence; wherein each pulse video frame includes a plurality of pixels, and each pixel has a pulse value.

[0029] A pulse video frame sequence is a set of frames arranged in chronological order, each frame is composed of multiple pixels, and each pixel has a pulse value at the current frame moment. Assuming that each frame is composed of N pixels, pulse data of N pixels is output at each moment (i.e., the corresponding video frame), 1 bit for each pixel, and a total of N bits for the frame. Among them, the pulse value is binary. When the value is 1, it indicates that the brightness of the corresponding pixel exceeds the preset cumulative charge threshold; when the value is 0, it indicates that the brightness of the corresponding pixel does not exceed the preset cumulative charge threshold. It is understood that the pulse video frame sequence described in the present invention can be a complete pulse sequence captured by the camera, which covers the entire shooting process to reflect the brightness changes of pixels at continuous moments, and can also be part of the complete shooting process to record the pulse information within a specific time range.

[0030] S2. For each pulse video frame in the pulse video frame sequence: analyze the pulse video frame pixel by pixel, and determine the brightness of the pixel according to the pulse of the pixel in the pulse video frame.

[0031] In each pulse video frame, the pulse values ​​of all pixels are extracted in sequence, and the pulse value of each pixel in a single frame is analyzed: if the pulse value of the pixel is 1, it means that the brightness of the pixel in the current frame has reached or exceeded the preset cumulative charge threshold, and its brightness can be directly assigned to a fixed value. Conversely, if the pulse value of the pixel is 0, it means that the brightness of the pixel in the current frame has not reached the threshold. At this time, the brightness value of the pixel in the current frame needs to be determined based on the cumulative pulse situation of subsequent frames or the previous and next pulse states and other information.

[0032] Specifically, in one embodiment of the present invention, for each pulse video frame in the pulse video frame sequence: analyzing the pulse video frame pixel by pixel, and determining the brightness of the pixel according to the pulse of the pixel in the pulse video frame, includes:

[0033] sequentially analyzing each pulse video frame in the pulse video frame sequence;

[0034] For each pulse video frame: analyzing the pulse video frame pixel by pixel, reading the pulse of each pixel in the pulse video frame, and arranging all pulses of the same pixel in sequence to form a pulse sequence; wherein the pulse includes a first value and a second value that are different;

[0035] Pulse sequence for the same pixel:

[0036] dividing the pulse sequence into at least one pulse subsequence according to the first value;

[0037] Calculate the brightness of each pulse subsequence in the corresponding pulse video frame.

[0038] Process each frame in the pulse video frame sequence in sequence, and for each pulse video frame, extract the pulse values ​​of all pixels in the frame, and the pulse value includes two different values, wherein the first value is 1 and the second value is 0. For the current video frame, read its pulse value pixel by pixel. For the same pixel, the pulse value of the pixel in the current frame is sequentially combined with the pulse value in the previous frame, and arranged in chronological order to form a complete pulse sequence for the pixel. After all pixels are processed in the above manner, for each pixel: divide the pulse sequence into at least one pulse subsequence according to the first value, and calculate the brightness of each pulse subsequence in the corresponding pulse video frame. It can be understood that there are many ways to divide pulse subsequences, and the present invention only exemplifies two of them below. Although other division methods are not specified, those skilled in the art can adaptively select based on actual needs.

[0039] Specifically, in one embodiment of the present invention, dividing the pulse sequence into at least one pulse subsequence according to the first value includes: judging whether the first value exists in the pulse sequence; if it exists, judging the number of the first values; if the first value is one, determining the pulse subsequence according to the position of the first value: if the first value is at the first position of the pulse sequence, the first value is regarded as a pulse subsequence, and the remaining second values ​​are regarded as a pulse subsequence; if the first value is at the last position of the pulse sequence, the entire pulse sequence is regarded as a pulse subsequence; if the first value is in the middle of the pulse sequence, the first value and the second values ​​before it are regarded as a pulse subsequence, Treat the remaining second values ​​as another pulse subsequence; if there are at least two first values, then for each first value: determine whether there is at least one continuous second value in front of it, if so, the first value and the at least one continuous second value in front of it form a pulse subsequence; if not, determine whether there is at least one continuous first value after the first value, if so, divide the first value and the at least one continuous first value behind it into a pulse subsequence, if not, the first value alone forms a pulse subsequence; after all first values ​​are divided, the remaining second values ​​form a pulse subsequence. By this division method, the entire pulse sequence can be divided into at least one pulse subsequence. Exemplarily, the pulse sequence is 1100, and there are two first values. For the first first value: there is no second value in front of it, and there is a continuous first value behind it, then the two first values ​​are divided into a pulse subsequence, that is, 11, and the remaining 00 forms a pulse subsequence.

[0040] In another embodiment of the present invention, a pulse sequence is divided into at least one pulse subsequence according to a first value, including: taking the first pulse of the pulse sequence as the starting pulse; starting from the starting pulse, sequentially reading the subsequent pulses, and judging whether a pulse different from the starting pulse is read: if not read, then determining the brightness of the pixel in the pulse video frame corresponding to the starting pulse and the remaining pulses based on the starting pulse; if read, then determining the pulse subsequence based on the starting pulse, and determining the brightness of the pixel in the corresponding pulse video frame according to the pulse subsequence; and judging whether the pulse sequence is read out, and if not read out, again taking the first pulse after the pulse subsequence as the starting pulse, and re-judging whether there is a pulse different from it. Specifically, the first pulse value of the pulse sequence is regarded as the starting pulse, starting from the starting pulse, sequentially reading the subsequent pulse values, and judging whether the current pulse value is different from the starting pulse value: if all the subsequent pulse values ​​are the same as the starting pulse value, it means that the brightness state of the current pixel is consistent in the entire sequence or the remaining sequence (such as always bright or always dark), and at this time, the brightness value of the pixel in the current and subsequent pulse video frames can be directly determined according to the starting pulse value. On the contrary, during the reading process, if a pulse value different from the starting pulse value is read, it means that the brightness state of the current pixel has changed. At this time, it is necessary to determine the pulse subsequence according to the value of the starting pulse, and determine the brightness value of the pixel in the corresponding video frame based on the pulse subsequence. Among them, the pulse subsequence represents a set of pulse values ​​within a continuous period of time extracted from the pulse video frame sequence. After dividing the pulse subsequence, it is necessary to determine whether the current pulse sequence has been completely read: if it has been read, it means that the pulse value sequence of the current pixel has been processed. On the contrary, if it has not been read, the first pulse value after the current pulse subsequence is used as the new starting pulse, and the above process is repeated until the entire pulse sequence is read.

[0041] In one embodiment of the present invention, the step of calculating the brightness of each pulse subsequence in the corresponding pulse video frame includes:

[0042] If the first pulse of the pulse subsequence is the first value, the brightness of the pixel in the pulse video frame corresponding to the pulse subsequence is the first value;

[0043] If the first pulse of the pulse subsequence is the second value, the brightness of the pixel in the pulse video frame corresponding to the pulse subsequence is determined based on the preset accumulated charge amount and the total amount of all pulses in the pulse subsequence.

[0044] For each pulse subsequence, if the first pulse of the pulse subsequence is the first value, it means that the remaining pulses in the subsequence are also the first value, indicating that the brightness of the pixel has reached a fixed brightness value and no further calculation is required. At this time, the brightness of the pulse video frame corresponding to the first pulse in the pulse subsequence to the video frame corresponding to the last pulse value in the sequence is directly assigned to the first value. For example, if the pulse subsequence of a pixel is 111, then since the starting pulse is the first value, the brightness of the pixel from the first frame to the third frame is 1.

[0045] In another case, if the first pulse of the pulse subsequence is the second value (i.e., 0), it means that the brightness of the pixel does not reach the threshold. At this time, the brightness of the pixel in the video frame corresponding to the first pulse to the video frame corresponding to the last pulse in the pulse subsequence is calculated according to formula (1):

[0046]

[0047] Wherein, L is the brightness value of the pixel in the corresponding video frame, G is the preset cumulative charge threshold, and j is the number of pulses with the second value in the pulse subsequence. For example, if the pulse sequence of a pixel is 000, then since the starting pulse is the second value, the brightness of the pixel from the first frame to the third frame is It can be understood that if the first pulse of the pulse subsequence is the second value, the pulse values ​​of the entire pulse subsequence can be the second value, or the last pulse value of the pulse subsequence can be the first value and the remaining pulse values ​​can be the second value. In either case, the brightness can be restored according to the above formula (1).

[0048] S3. Integrate the brightness of each pixel in each pulse video frame to determine the brightness of the pulse video frame sequence.

[0049] For each pixel, the corresponding brightness is recorded at the relevant position of the corresponding video frame according to the position of the pixel in the pulse video frame. After all the pulse video frames are processed, the brightness distribution of the pulse video frame sequence can be obtained.

[0050] Specifically, in one embodiment of the present invention, the step of integrating the brightness of each pixel in each pulse video frame to determine the brightness of the pulse video frame sequence includes:

[0051] For each pixel: performing gamma correction on the brightness of the pixel in each pulse video frame to obtain the final brightness of the pixel in each pulse video frame;

[0052] The gamma-corrected pulse video frames are arranged in sequence to obtain the brightness of the corrected pulse video frame sequence.

[0053] In the pulse video frame sequence, the position of a specific pixel is extracted frame by frame, and after determining the brightness of the pixel in the current video frame, the brightness of the pixel is gamma corrected, as shown in formula (2):

[0054] L end =L γ (2)

[0055] Where γ is the preset gamma correction parameter (0<γ<1), L end is the brightness of the pixel in the current frame after gamma correction. Through gamma correction, linear brightness is converted to nonlinear brightness to optimize the match with the visual characteristics of the human eye. For all pixels in each frame, the above process is repeated, and gamma correction is performed one by one to obtain the pixel brightness distribution of each pulse video frame. All gamma-corrected pulse video frames are arranged in chronological order to form a complete brightness distribution of the corrected pulse video frame sequence. Since the brightness distribution of each video frame is gamma-corrected, the overall brightness sequence is more in line with the visual perception effect of the human eye.

[0056] The basic idea of ​​the present invention comes from the principle of collecting pulse video data. After setting the threshold, assuming that the collection device of a certain pixel outputs 1 after continuously outputting i 0s, it means that after i+1 moments, the number of charges accumulated on the integrator reaches or exceeds the preset threshold. Therefore, the brightness of the pixel at the i+1 moment can be estimated by one i+1 of the preset threshold. After gamma correction, it is the brightness that conforms to the visual characteristics of the human eye. As an example of the present invention, if the pulse sequence of a certain pixel is 10010100, which corresponds to 8 video frames from 1 to 8, the brightness of the pixel in the first video frame is 1, and the brightness in the 2nd to 4th video frames is 1. The brightness of the 5th and 6th video frames is The brightness of the 7th-8th video frames is

[0057] In an embodiment of the present invention, after the brightness of each pixel in each pulse video frame is integrated to determine the brightness of the pulse video frame sequence, the method further includes: performing image denoising on each pulse video frame with determined brightness.

[0058] In order to ensure that the pulse video frame sequence has higher visual quality and accuracy, after integrating the brightness of each pixel in each pulse video frame to determine the overall brightness of the pulse video frame sequence, it is also necessary to perform image denoising on each pulse video frame with determined brightness to reduce noise interference caused by signal acquisition or environmental factors, thereby improving the clarity and brightness consistency of the frame image.

[0059] In one embodiment of the present invention, the image denoising of each pulse video frame of determined brightness includes: performing image smoothing processing on each pulse video frame based on bilateral filtering to obtain smoothed pulse video frames. Bilateral filtering combines information in the spatial domain and the pixel intensity domain, effectively removes noise while retaining edge details, thereby obtaining smoothed pulse video frames, providing higher quality frame data for subsequent image reconstruction and analysis.

[0060] See also Figure 2 As another example, for a certain pixel, the pulse sequence is 0010010001001011, and its first pulse subsequence is 001, that is, the brightness of the pixel in the 1st to 3rd video frames (i.e., time 0-2) is 1 / 3 when no gamma correction is performed. Taking the first pulse value (i.e., 0) after the subsequence as the starting pulse, searching backward until the first different pulse is encountered, the second pulse subsequence is 001, indicating that the accumulated charge at these three moments (i.e., the area between the curve and the horizontal axis) reaches the charge threshold G, that is, the brightness of the pixel in the 4th to 6th video frames (i.e., time 3-5) is 1 / 3 when no gamma correction is performed. The third pulse subsequence is 0001, that is, the brightness of the pixel in the 7th to 10th video frames (i.e., time 6-9) is 1 / 4 when no gamma correction is performed. The fourth pulse subsequence is 001, that is, the brightness of the pixel in the 11th to 13th video frames (i.e., time 10-12) is 1 / 3 when no gamma correction is performed. The fifth pulse subsequence is 01, that is, the brightness of the pixel in the 14th to 15th video frames (i.e., time 13-14) is 1 / 2 when no gamma correction is performed. The brightness of the last pulse 1 is 1.

[0061] See also Figure 3 The video processing system 100 includes: a pulse video acquisition module 110, a brightness determination module 120 and a brightness adjustment module 130. The pulse video acquisition module 110 is used to acquire a pulse video frame sequence; wherein each pulse video frame includes a plurality of pixels, and each pixel has a pulse value. The brightness determination module 120 is used to analyze the pulse video frame pixel by pixel for each pulse video frame in the pulse video frame sequence, and determine the brightness of the pixel according to the pulse of the pixel in the pulse video frame. The brightness adjustment module 130 is used to determine the brightness of the pulse video frame sequence by comprehensively analyzing the brightness of each pixel in each pulse video frame.

[0062] For the specific definition of the video processing system, please refer to the definition of the video processing method in the above text, which will not be repeated here. Each module in the above video processing system can be implemented in whole or in part by software, hardware and a combination thereof. The above modules can be embedded in or independent of the processor in the computer device in hardware format, or can be stored in the memory in the computer device in software format, so that the processor can call the operations corresponding to the above modules.

[0063] It should be noted that, in order to highlight the innovative part of the present invention, the present embodiment does not introduce modules that are not closely related to solving the technical problem proposed by the present invention, but this does not mean that there are no other modules in the present embodiment.

[0064] See also Figure 4 The electronic device 1 may include a memory 12, a processor 13 and a bus, and may also include a computer program stored in the memory 12 and executable on the processor 13, such as a video processing program.

[0065] Among them, the memory 12 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, mobile hard disk, multimedia card, card-type memory (for example: SD or DX memory, etc.), magnetic memory, disk, optical disk, etc. In some embodiments, the memory 12 can be an internal storage unit of the electronic device 1, such as a mobile hard disk of the electronic device 1. In other embodiments, the memory 12 can also be an external storage device of the electronic device 1, such as a plug-in mobile hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the electronic device 1. Further, the memory 12 can also include both an internal storage unit of the electronic device 1 and an external storage device. The memory 12 can not only be used to store application software and various types of data installed in the electronic device 1, such as video processing code, etc., but also can be used to temporarily store data that has been output or is to be output.

[0066] In some embodiments, the processor 13 may be composed of an integrated circuit, for example, a single packaged integrated circuit, or a plurality of packaged integrated circuits with the same or different functions, including one or more central processing units (CPUs), microprocessors, digital processing chips, graphics processors, and combinations of various control chips. The processor 13 is the control core (Control Unit) of the electronic device 1, and uses various interfaces and lines to connect various components of the entire electronic device 1, and executes or executes programs or modules (such as video processing programs, etc.) stored in the memory 12, and calls data stored in the memory 12 to execute various functions of the electronic device 1 and process data.

[0067] The processor 13 executes the operating system and various installed applications of the electronic device 1. The processor 13 executes the applications to implement the steps in the above-mentioned video processing method.

[0068] Exemplarily, the computer program may be divided into one or more modules, which are stored in the memory 12 and executed by the processor 13 to complete the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program in the electronic device 1. For example, the computer program may be divided into a pulse video acquisition module 110, a brightness determination module 120, and a brightness adjustment module 130.

[0069] The above-mentioned integrated unit implemented in the form of a software function module can be stored in a computer-readable storage medium, and the computer-readable storage medium can be non-volatile or volatile. The above-mentioned software function module is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a computer device, or a network device, etc.) or a processor to perform part of the functions of the video processing method described in each embodiment of the present application.

[0070] In summary, the present invention discloses a video processing method, system, device and medium, which accurately restores the overall brightness characteristics of the pulse video frame sequence by analyzing the pulse video frame frame by frame and pixel by pixel, determining the pixel brightness in combination with the pulse value, and comprehensively analyzing the brightness distribution of each pulse video frame. By effectively extracting the brightness information at the pixel level and retaining the temporal dynamic characteristics of the pulse video frame, the accuracy of the brightness calculation is improved, and the integrity of the sequence restoration is ensured, providing a high-quality brightness data foundation for subsequent image reconstruction. Therefore, the present invention effectively overcomes the various shortcomings in the prior art and has a high industrial utilization value.

[0071] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the art may modify or alter the above embodiments without departing from the spirit and scope of the present invention. Therefore, all equivalent modifications or alterations made by a person of ordinary skill in the art without departing from the spirit and technical concept disclosed by the present invention shall still be covered by the claims of the present invention.

Claims

1. A video processing method, characterized in that: Applied to pulse video, the method comprises: Acquire a sequence of pulse video frames; wherein each pulse video frame includes a plurality of pixels, and each pixel has a pulse value; For each pulse video frame in the pulse video frame sequence: analyzing the pulse video frame pixel by pixel, and determining the brightness of the pixel according to the pulse of the pixel in the pulse video frame; The brightness of each pixel in each pulse video frame is integrated to determine the brightness of the pulse video frame sequence.

2. The video processing method according to claim 1, characterized in that: The step of analyzing the pulse video frame pixel by pixel for each pulse video frame in the pulse video frame sequence, and determining the brightness of the pixel according to the pulse of the pixel in the pulse video frame, comprises: sequentially analyzing each pulse video frame in the pulse video frame sequence; For each pulse video frame: analyzing the pulse video frame pixel by pixel, reading the pulse of each pixel in the pulse video frame, and arranging all pulses of the same pixel in sequence to form a pulse sequence; wherein the pulse includes a first value and a second value that are different; Pulse sequence for the same pixel: dividing the pulse sequence into at least one pulse subsequence according to the first value; Calculate the brightness of each pulse subsequence in the corresponding pulse video frame.

3. The video processing method according to claim 2, characterized in that: The step of calculating the brightness of each pulse subsequence in the corresponding pulse video frame includes: If the first pulse of the pulse subsequence is the first value, the brightness of the pixel in the pulse video frame corresponding to the pulse subsequence is the first value; If the first pulse of the pulse subsequence is the second value, the brightness of the pixel in the pulse video frame corresponding to the pulse subsequence is determined based on the preset accumulated charge amount and the total amount of all pulses in the pulse subsequence.

4. The video processing method according to claim 3, characterized in that: The brightness of the pixel in the pulse video frame corresponding to this pulse subsequence is Wherein, L is the brightness of the pixel in the corresponding video frame, G is the preset cumulative charge threshold, and j is the number of pulses having the second value in the pulse subsequence.

5. The video processing method according to claim 1, characterized in that: The step of synthesizing the brightness of each pixel in each pulse video frame to determine the brightness of the pulse video frame sequence comprises: For each pixel: performing gamma correction on the brightness of the pixel in each pulse video frame to obtain the final brightness of the pixel in each pulse video frame; The gamma-corrected pulse video frames are arranged in sequence to obtain the brightness of the corrected pulse video frame sequence.

6. The video processing method according to claim 1, characterized in that: After the brightness of each pixel in each pulse video frame is integrated to determine the brightness of the pulse video frame sequence, the method further includes: performing image denoising on each pulse video frame with determined brightness.

7. The video processing method according to claim 6, characterized in that: The image denoising is performed on each pulse video frame of determined brightness, comprising: performing image smoothing processing on each pulse video frame based on a bilateral filtering method to obtain a smoothed pulse video frame.

8. A video processing system, characterized in that: The system comprises: A pulse video acquisition module, used for acquiring a pulse video frame sequence; wherein each pulse video frame includes a plurality of pixels, and each pixel has a pulse value; A brightness determination module is used for: for each pulse video frame in the pulse video frame sequence: analyzing the pulse video frame pixel by pixel, and determining the brightness of the pixel according to the pulse of the pixel in the pulse video frame; The brightness adjustment module is used to determine the brightness of the pulse video frame sequence by integrating the brightness of each pixel in each pulse video frame.

9. An electronic device, characterized in that: The electronic device comprises: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the electronic device to implement the video processing method as described in any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the video processing method according to any one of claims 1 to 7.

Images