Video processing method and device, equipment, storage medium and computer program product

By using video processing methods in the monitoring device, and generating and using target video frames to fill the frames of the original video frame, the problem of video frame rate drop in dark light environments is solved, and the frame rate and fluency of the video picture are improved.

CN119854436AActive Publication Date: 2025-04-18SHENZHEN LUMIUNITED TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411893207.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-20
Publication Date
2025-04-18
Estimated Expiration
2044-12-20

AI Technical Summary

Technical Problem

In darker light environments, existing monitoring equipment realizes the output of color monitoring screens by reducing the acquisition of video frames and increasing exposure time, but the frame rate is significantly reduced, resulting in poor picture flow and unable to access platforms that require video frame rate.

Method used

A video processing method is provided, by obtaining video frames in the down-frame shooting mode, generating target video frames to be supplemented, and performing frame-complementing the original video frame based on the target video frame, thereby improving the frame rate of the video picture.

Benefits of technology

The frame rate of the video screen is quickly and effectively improved, solving the problem of video frame rate drop caused by ambient illumination, and ensuring the video screen effect while improving the smoothness of the video.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119854436A_ABST
    Figure CN119854436A_ABST
Patent Text Reader

Abstract

The invention relates to a video processing method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: acquiring a first video frame collected in a first shooting mode; the first shooting mode is used for indicating to shoot by adopting the target frame rate after frame reduction; the target frame rate is determined based on environment information of the target scene; generating a to-be-supplemented target video frame according to the first video frame and the target frame rate; and on the basis of the target video frame, performing frame compensation processing on the first video frame to obtain a video frame after frame compensation. By adopting the method, the problem that the video frame rate is reduced due to the environment of the target scene can be solved, and the video frame rate is improved while the video picture effect is ensured.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a video processing method, apparatus, computer equipment, storage medium and computer program product. Background Art

[0002] With the continuous development of image technology and monitoring equipment, today's monitoring equipment can generate clear color images even when used in dimly lit environments, such as at night or in dark environments, effectively improving the recognition effect of monitoring targets in the monitoring screen.

[0003] Current surveillance equipment usually outputs color and high-brightness surveillance images in low-light environments by reducing the acquisition of video frames and increasing the exposure time of single video frames. Although this method can output color surveillance images in low-light environments, the frame rate of the color surveillance images is also significantly reduced, resulting in an unsmooth color surveillance image, and even the inability to connect the color surveillance image to platforms or clients that have video frame rate requirements. Summary of the invention

[0004] Based on this, it is necessary to provide a video processing method, device, computer equipment, computer-readable storage medium and computer program product that can improve the video picture effect in a dark environment in order to solve the above technical problems.

[0005] In a first aspect, the present application provides a video processing method. The method comprises:

[0006] Acquire a first video frame captured in a first shooting mode; the first shooting mode is used to indicate shooting with a target frame rate after frame reduction; the target frame rate is determined based on environmental information of a target scene;

[0007] generating a target video frame to be supplemented according to the first video frame and the target frame rate;

[0008] Based on the target video frame, the first video frame is subjected to frame interpolation processing to obtain a frame-interpolated video frame.

[0009] In one of the embodiments, generating a target video frame to be supplemented according to the first video frame and the target frame rate includes:

[0010] Determining a target frame supplement position according to the position of the first video frame and the target frame rate;

[0011] Based on the first video frame, the target video frame to be supplemented at the target frame supplement position is determined.

[0012] In one of the embodiments, determining the target video frame to be supplemented at the target supplement frame position based on the first video frame includes:

[0013] Copying a previous video frame corresponding to the target frame-interpolation position to obtain a copied previous video frame; the previous video frame represents a first video frame located before the target frame-interpolation position;

[0014] The copied previous video frame is set as the target video frame to be supplemented at the target supplement frame position.

[0015] In one embodiment, determining a target frame supplement position according to the position of the first video frame and the target frame rate includes:

[0016] Performing an average process on the time periods corresponding to the plurality of first video frames to obtain a plurality of supplementary frame positions;

[0017] If each of the first video frames falls into the multiple interpolation frame positions, the remaining interpolation frame positions among the multiple interpolation frame positions except the interpolation frame positions corresponding to each of the first video frames are determined as target interpolation frame positions;

[0018] If the position of the first video frame is between two adjacent interpolation frame positions, and the distance between the position of the first video frame and the interpolation frame position that is closer is less than a distance threshold, the interpolation frame position that is closer is deleted, and the target interpolation frame position is obtained based on the remaining interpolation frame position after deletion.

[0019] In one of the embodiments, before acquiring the first video captured in the first shooting mode, the method further includes:

[0020] If it is detected that the ambient illumination information of the target scene meets the first ambient condition, the currently executed shooting mode is switched to the first shooting mode.

[0021] In one embodiment, obtaining a first video frame captured in a first shooting mode includes:

[0022] Acquire a first image parameter corresponding to the first shooting mode; the first image parameter represents an image adjustment parameter used to generate a color image when the ambient illumination information meets the first environmental condition;

[0023] Acquire the first video frame shot according to the first image parameters.

[0024] In one embodiment, after obtaining the frame-interpolated video, the method further includes:

[0025] If it is detected that the environmental illumination information satisfies the second environmental condition, the first shooting mode being executed is switched to the second shooting mode; the second shooting mode is used to indicate that a preset frame rate is used for shooting processing; the second image parameter corresponding to the second shooting mode represents an image adjustment parameter for daytime imaging;

[0026] A second video frame captured in the second shooting mode is obtained.

[0027] In a second aspect, the present application further provides a video processing device. The device comprises:

[0028] A frame reduction shooting module, used for acquiring a first video frame captured in a first shooting mode; the first shooting mode is used for indicating shooting with a target frame rate after frame reduction; the target frame rate is determined based on environmental information of a target scene;

[0029] A supplementary frame generation module, used to generate a target video frame to be supplemented according to the first video frame and the target frame rate;

[0030] The video frame interpolation module is used to perform frame interpolation processing on the first video frame based on the target video frame to obtain a frame-interpolated video frame.

[0031] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0032] Acquire a first video frame captured in a first shooting mode; the first shooting mode is used to indicate shooting with a target frame rate after frame reduction; the target frame rate is determined based on environmental information of a target scene;

[0033] generating a target video frame to be supplemented according to the first video frame and the target frame rate;

[0034] Based on the target video frame, the first video frame is subjected to frame interpolation processing to obtain a frame-interpolated video frame.

[0035] In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0036] Acquire a first video frame captured in a first shooting mode; the first shooting mode is used to indicate shooting with a target frame rate after frame reduction; the target frame rate is determined based on environmental information of a target scene;

[0037] generating a target video frame to be supplemented according to the first video frame and the target frame rate;

[0038] Based on the target video frame, the first video frame is subjected to frame interpolation processing to obtain a frame-interpolated video frame.

[0039] In a fifth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0040] Acquire a first video frame captured in a first shooting mode; the first shooting mode is used to indicate shooting with a target frame rate after frame reduction; the target frame rate is determined based on environmental information of a target scene;

[0041] generating a target video frame to be supplemented according to the first video frame and the target frame rate;

[0042] Based on the target video frame, the first video frame is subjected to frame interpolation processing to obtain a frame-interpolated video frame.

[0043] The video processing method, device, computer equipment, storage medium and computer program product described above obtain a first video frame captured in a first shooting mode; the first shooting mode is used to indicate shooting with a target frame rate after frame reduction; the target frame rate is determined based on the environmental information of the target scene; a target video frame to be supplemented is generated based on the first video frame and the target frame rate; based on the target video frame, the first video frame is supplemented to obtain a supplemented video frame. By adopting this method, the target video frame is obtained using the target frame rate, and then the first video frame is supplemented using the target video frame, which quickly and effectively improves the frame rate of the video picture, solves the problem of video frame rate reduction caused by the environment of the target scene, and improves the frame rate of the video while ensuring the video picture effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 A diagram showing an application environment of a video processing method in an embodiment;

[0045] Figure 2 is a schematic flow chart of a video processing method in one embodiment;

[0046] Figure 3 A schematic diagram of determining a target video frame to be supplemented at a target supplement frame position in an embodiment;

[0047] Figure 4 is a flow chart of a step of determining a target frame supplement position according to a position of a first video frame and a target frame rate in an embodiment;

[0048] Figure 5 It is a schematic diagram of performing averaging processing on time periods corresponding to a plurality of first video frames in one embodiment;

[0049] Figure 6 is a schematic diagram of the intervals between a plurality of first video frames actually collected in one embodiment;

[0050] Figure 7 is a schematic diagram of the position of the supplementary frame to be deleted in one embodiment;

[0051] Figure 8 is a flow chart of a video processing method in another embodiment;

[0052] Fig. 9 is a flowchart of a video processing method in yet another embodiment;

[0053] Fig.10 is a structural block diagram of a video processing device in one embodiment;

[0054] Fig.11 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0055] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0056] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0057] The video processing method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Among them, the application environment can be a smart home system, which can include: a router, a gateway, a terminal 101 (such as a mobile phone, a tablet computer, a laptop), a server 102, a shooting device 103 (such as a camera, a black light full-color camera), etc. In the smart home system, the shooting device 103 can be connected to the gateway via ZIGBEE / Bluetooth / WiFi, and the gateway and the terminal can be connected to the router via WiFi respectively. In addition, the terminal can also establish a network connection with the server through 2G / 3G / 4G / 5G, WiFi, etc., so as to obtain the data sent by the server.

[0058] Among them, the terminal 101 is used to provide local services for users. The server 102 can be implemented by an independent server or a server cluster composed of multiple servers, or can be implemented by a cloud server. In actual applications, after obtaining the video frame after frame filling, the shooting device 103 can also send the video frame after frame filling to the terminal 101 and / or the server 102, so that the terminal 101 and / or the server 102 can display and process the video frame after frame filling.

[0059] In one embodiment, a first video frame captured in a first shooting mode is acquired by the shooting device 103; the first shooting mode is used to indicate that shooting is performed at a target frame rate after frame reduction; the target frame rate is determined based on environmental information of the target scene; the shooting device 103 generates a target video frame to be supplemented based on the first video frame and the target frame rate; the shooting device 103 performs frame supplementation processing on the first video frame based on the target video frame to obtain a supplemented video frame.

[0060] In another embodiment, the shooting device 103 sends the first video frame captured in the first shooting mode to the terminal 101 and / or the server 102; then the terminal 101 and / or the server 102 obtains the first video frame captured in the first shooting mode; the first shooting mode is used to indicate that shooting is performed at a target frame rate after frame reduction; the target frame rate is determined based on environmental information of the target scene; the terminal 101 and / or the server 102 generates a target video frame to be supplemented based on the first video frame and the target frame rate; the terminal 101 and / or the server 102 performs frame supplementation processing on the first video frame based on the target video frame to obtain a supplemented video frame.

[0061] In one embodiment, Figure 2 As shown, a video processing method is provided, and the method is described by taking the application of the method to an electronic device as an example. The electronic device may be Figure 1 The shooting device 103 in the embodiment may also be the server 102 or the terminal 101, or may be implemented by the shooting device 103 interacting with at least one of the server 102 and the terminal 101. The method includes the following steps:

[0062] Step S201, obtaining a first video frame captured in a first shooting mode; the first shooting mode is used to indicate shooting with a target frame rate after frame reduction; the target frame rate is determined based on environmental information of a target scene.

[0063] Among them, shooting mode refers to the different settings and functions used by shooting devices (such as cameras, webcams, and mobile phones) when shooting to adapt to different shooting needs and environments. In shooting mode, the shooting device will automatically set the corresponding shooting parameters, such as shutter speed (S), sensitivity (ISO), exposure compensation (EV), focus mode (AF), white balance (WB) and other shooting parameters. The shooting mode can be factory-provided by the shooting device, and some shooting devices also support users to customize personalized shooting modes. Different shooting modes are suitable for different scenes and provide different shooting effects. Common shooting modes include normal mode, portrait mode, creative auto mode, HDR (High Dynamic Range) mode, and professional mode.

[0064] The first shooting mode in this embodiment may be a shooting mode adapted to a target scene with dark light. The first shooting mode may include an imaging frame rate requirement (such as a target frame rate) for the shooting device.

[0065] Among them, video frame, also called frame, is the smallest unit of single image in image animation, which is equivalent to each frame of film. One frame is a still image. Displaying frames quickly and continuously creates the illusion of movement. Therefore, a high frame rate can obtain smoother and more realistic video content.

[0066] Video is composed of a series of continuous video frames played at a certain speed. Each static image in the video is called a video frame. In application scenarios such as smart home and smart transportation, each video frame in the monitoring video contains information such as the position, size, color, etc. of all elements in the picture. Users can understand the application scenario by observing the video frames of the monitoring video.

[0067] The first video frame in this embodiment refers to a video frame captured by a capturing device according to image parameters indicated by a first capturing mode.

[0068] The frame rate is a unit of measurement for the number of video frames displayed per unit time, that is, the number of frames that refresh the picture per second. A higher frame rate (such as 60FPS) can provide a smoother video playback effect, while a lower frame rate (such as 30FPS) may cause the video to appear less smooth.

[0069] The target frame rate after frame reduction in this embodiment refers to the frame rate after frame reduction that is set due to the influence of the environmental information of the target scene. The target frame rate in the first shooting mode is lower than the frame rate in the conventional shooting mode, or lower than the standard frame rate specified by the platform (such as the smart home platform) that is connected to the shooting device. For example, when the target scene is dim, if the shooting device does not have fill light hardware configuration such as infrared lights, the shooting device cannot obtain a color high-brightness image using the frame rate of the conventional shooting mode. At this time, the shooting device can continue to capture video at a reduced target frame rate for scenes with dim light, so as to obtain the cumulative effect of picture brightness by increasing the exposure time of a single video frame, so that the shooting device can output a bright image even in an extremely dark environment. The target frame rate after frame reduction can be pre-set.

[0070] The target scene refers to the spatial scene captured by the camera. The environmental information refers to the parameters describing the environmental conditions of the target scene; for example, the environmental information may be the current ambient illumination of the target scene (unit: lux).

[0071] Specifically, the correlation between the environmental information of the target scene and the target frame rate can be preset. When the shooting device executes the first shooting mode, the current environmental information of the target scene can be first collected by the sensor equipped with the shooting device, and then the target scene is shot according to the target frame rate corresponding to the current environmental information, so that the shooting device obtains the first video frame of the target frame rate.

[0072] Taking the environmental information as the environmental illumination as an example, the correlation relationship between the current environmental illumination of the target scene and the target frame rate of the shooting device is shown in Table 1.

[0073] Table 1

[0074]

[0075] Step S202: Generate a target video frame to be supplemented according to the first video frame and the target frame rate.

[0076] Among them, the target video frame to be supplemented refers to the video frame that needs to be supplemented between the first video frames. The shooting device acquires the first video frame according to the target frame rate after frame reduction, resulting in a lower frame rate of the video corresponding to the first video frame. In the video processing process, by inserting the target video frame between the first video frames, the frame rate of the video acquired by the shooting device in the first shooting mode can be improved. The target video frame is a video frame obtained based on the first video frame. In practical applications, the target video frame can be obtained by copying the first video frame, that is, the target video frame can be the same as the first video frame.

[0077] It should be noted that in order to meet the shooting effects of the shooting equipment in a specific environment (such as a night environment), the acquisition of video frames per unit time is usually reduced, and the exposure time of a single video frame is increased to improve the picture effect of a single video frame (such as improving the picture brightness of a single video frame). Therefore, the target frame rate is lower than the standard frame rate specified by the platform connected to the shooting equipment (such as a smart home platform).

[0078] Specifically, in order to meet the standard frame rate requirements of the platform connected to the shooting device, the shooting device needs to determine the number of frames to be supplemented based on the target frame rate and the standard frame rate; and then generate the target number of frames to be supplemented based on the first video frame.

[0079] Step S203: Based on the target video frame, the first video frame is subjected to frame interpolation processing to obtain a frame-interpolated video frame.

[0080] Among them, interpolation processing can refer to interpolation of video frames to increase the number of video frames, improve the frame rate, or improve the smoothness of video playback. When processing video frames, interpolation processing can help solve problems such as insufficient frame rate, video playback screen freezes, and failure to meet the frame rate requirements of the docking platform.

[0081] Among them, the video frame after frame interpolation refers to the video frame obtained after the frame interpolation process. When performing video processing, the electronic device can insert one or more video frames into the original video frame to obtain a video frame with more frames. Compared with the first video frame, the video frame after frame interpolation has an increase in the number of frames, which can make the video playback smoother and meet the frame rate requirements of the docking platform. The video frame after frame interpolation may include the first video frame and the target video frame.

[0082] Specifically, the shooting device adds the generated target video frame between multiple first video frames to form a post-frame-added video frame; the post-frame-added video frame can also be saved and sent to the target platform for playback.

[0083] In the above video processing method, a first video frame captured in a first shooting mode is obtained; the first shooting mode is used to indicate that the target frame rate after frame reduction is used for shooting; the target frame rate is determined based on the environmental information of the target scene; the target video frame to be supplemented is generated according to the first video frame and the target frame rate; based on the target video frame, the first video frame is subjected to frame supplementation processing to obtain a video frame after frame supplementation. By adopting this method, the target video frame is obtained using the target frame rate, and then the first video frame is subjected to frame supplementation processing using the target video frame, which quickly and effectively realizes the improvement of the frame rate of the video picture, solves the problem of video frame rate reduction caused by the environment of the target scene, and improves the frame rate of the video while ensuring the video picture effect.

[0084] In one embodiment, the above step S202 generates a target video frame to be supplemented according to the first video frame and the target frame rate, and specifically includes the following contents: determining a target frame supplement position according to the position of the first video frame and the target frame rate; and determining a target video frame to be supplemented at the target frame supplement position based on the first video frame.

[0085] The target frame supplement position is used to represent the position where the video frame needs to be supplemented in the video captured by the shooting device in the first shooting mode.

[0086] Specifically, the shooting device calculates the position of the video frame that needs to be supplemented according to the position of the first video frame and the number of supplemented frames that need to be supplemented, that is, determines the target supplemented frame position. For example, assuming that the shooting device currently captures 5 first video frames, and the platform to which the shooting device is connected requires a frame rate of 20 frames, then 15 target video frames need to be inserted between the originally captured 5 first video frames, that is, 15 target supplemented frame positions are determined between these 5 first video frames, and the target supplemented frame positions can be evenly distributed or calculated according to an algorithm.

[0087] Then, the shooting device generates a target video frame to be added to the target frame-adding position based on the first video frame near the target frame-adding position. For example, a new video frame may be synthesized for the target frame-adding position based on the first video frame near the target frame-adding position as the target video frame to be added; for another example, a video frame that is exactly the same as the first video frame may be copied as the target video frame at the target frame-adding position.

[0088] In this embodiment, a target frame-interpolation position in a first video frame captured in a first shooting mode is first determined, and then a target video frame corresponding to each target frame-interpolation position is generated based on a first video frame adjacent to the target frame-interpolation position, so that a subsequent step can use the target video frame to perform frame-interpolation processing on the first video frame, thereby improving the frame rate of the video captured in the first shooting mode. Moreover, by generating the target video frame based on the first video frame adjacent to the target frame-interpolation position, the influence of the interpolated video frame on the overall smoothness of the video picture during picture playback can be reduced, thereby improving the playback effect of the interpolated video frame.

[0089] In one embodiment, the above steps determine the target video frame to be supplemented at the target frame supplement position based on the first video frame, and specifically include the following contents: copying the previous video frame corresponding to the target frame supplement position to obtain the copied previous video frame; the previous video frame represents the first video frame located at the previous frame of the target frame supplement position; and setting the copied previous video frame as the target video frame to be supplemented at the target frame supplement position.

[0090] The previous video frame refers to the first video frame located before the target interpolation frame position. It should be noted that the previous video frame must be the first video frame captured by the shooting device in the first shooting mode, and will not be a video frame filled by interpolation processing.

[0091] The copied previous video frame refers to a video frame obtained by copying the previous video frame. Since the copied previous video frame is obtained by copying the previous video frame, the copied previous video frame has the same picture content as its corresponding previous video frame.

[0092] Specifically, the shooting device determines the first video frame that is located in the previous frame of the target frame complement position according to the positions of each first video frame, and sets it as the previous video frame corresponding to the target frame complement position. The previous video frame is copied to obtain the copied previous video frame, and the copied previous video frame is set as the target video frame to be supplemented at the target frame complement position. For example, assuming that there are originally 5 first video frames, namely first video frame No. 1, first video frame No. 2, first video frame No. 3, first video frame No. 4 and first video frame No. 5. Assuming that the target frame complement position is between first video frame No. 3 and first video frame No. 4, then the previous video frame corresponding to the target frame complement position is first video frame No. 3. Then, you can automatically copy the first video frame No. 3, or you can copy the first video frame No. 3 through the copy command or manual shortcut keys (such as Ctrl+C). The copied first video frame No. 3 is the previous video frame after copying, and then you can use the paste command or manual shortcut keys (such as Ctrl+V) to fill the copied first video frame No. 3 into the target frame filling position.

[0093] It should be noted that, if the previous video frames corresponding to multiple target frame-complementing positions are all the same first video frame, then the target video frames to be supplemented at the multiple target correction positions may be the same copied previous video frame. Figure 3 A schematic diagram of a target video frame to be supplemented in order to determine the target supplement frame position, such as Figure 3 As shown, the target video frames corresponding to the five target frame complement positions between first video frame No. 1 and first video frame No. 2 are all first video frame No. 1, the target video frames corresponding to the five target frame complement positions between first video frame No. 2 and first video frame No. 3 are all first video frame No. 2, the target video frame corresponding to one target frame complement position between first video frame No. 3 and first video frame No. 4 is first video frame No. 3, and the target video frame corresponding to the four target frame complement positions between first video frame No. 4 and first video frame No. 5 is first video frame No. 4.

[0094] In this embodiment, the previous video frame corresponding to the target frame supplement position is copied as the target video frame to be supplemented at the target frame supplement position, so that the target video frame to be supplemented can keep the picture still during playback, and the playback effect is the same as the first video frame before the frame supplement, thereby without changing the overall smoothness of the picture during playback, and effectively ensuring the playback effect of the video frame after the frame supplement.

[0095] In one embodiment, Figure 4 As shown, the above steps determine the target frame supplement position according to the position of the first video frame and the target frame rate, and specifically include the following contents:

[0096] Step S401, performing average processing on time periods corresponding to a plurality of first video frames to obtain a plurality of supplementary frame positions.

[0097] The time period is used to describe the continuous time interval from one time point to another time point. The time period in this embodiment refers to the start and end time of multiple first video frames. For example, the total start and end time of multiple first video frames is from 16:00:00 to 16:00:01, then this start and end time is the time period corresponding to these first video frames. The time period is also used to indicate that multiple first video frames are collected successively during this period.

[0098] The averaging process refers to dividing the time period into a certain number (such as the number of frames of the docking platform). For example, the time period corresponding to the first video frames is 1 second in total, and the number of frames required by the docking platform is 20. Then, the averaging process can be used to divide the 1 second into 20 sub-time periods.

[0099] The supplementary frame position indicates the initially planned position where the video frame needs to be supplemented.

[0100] Specifically, the shooting device calculates the sum of the time periods corresponding to the multiple first video frames. For example, the sum of the time periods corresponding to the multiple first video frames may be calculated by multiplying the time of each first video frame by the number of first video frames. The sum of the time periods is then averaged. For example, the sum of the time periods may be evenly divided into a corresponding number of frames according to the frame rate requirement of the docked platform, and a plurality of sub-time periods with uniform time intervals are calculated. The frame supplement position is then obtained based on the time information corresponding to each sub-time period.

[0101] Figure 5This is a schematic diagram of averaging the time periods corresponding to multiple first video frames. Taking the standard frame rate of the target platform as 20 frames as an example, it is assumed that the time period corresponding to the multiple first video frames is 1 second, and the shooting device divides 1 second into 20 equal parts. Then the time interval between two adjacent supplementary frame positions is 1 / 20 second, that is, the supplementary frame position can be 0.05 seconds, 0.1 seconds, 0.15 seconds, ..., 0.95 seconds.

[0102] Step S402: If each first video frame falls into a plurality of interpolation frame positions, the remaining interpolation frame positions among the plurality of interpolation frame positions except the interpolation frame positions corresponding to each first video frame are determined as target interpolation frame positions.

[0103] Among them, the first video frame falls into multiple interpolation frame positions, which means that the position of the first video frame is the same as the interpolation frame position, or the distance between the position of the first video frame and the interpolation frame position is within a preset range (that is, the position of the first video frame is "close" to the interpolation frame position). For example, assuming that the position of a first video frame is 0.05 seconds, which is exactly the same as a interpolation frame position (0.05 seconds), it can be considered that the first video frame falls into this interpolation frame position. For another example, assuming that the position of a first video frame is 0.05 seconds, and the distance between it and a interpolation frame position (0.049 seconds) is within a preset range (within 0.001 seconds), it means that the position of the first video frame is very close to this interpolation frame position, and it can also be considered that the first video frame falls into this interpolation frame position.

[0104] Specifically, if the position of each first video frame is the same as the interpolation frame position, it means that a first video frame already exists at the interpolation frame position and no interpolation frame processing is required; if the distance between the position of each first video frame and the interpolation frame position is close, for example, the distance between the position of the first video frame and the interpolation frame position is within a preset distance range, it means that no interpolation frame processing is required at the interpolation frame position; and then the shooting device can set the remaining interpolation frame positions among the multiple interpolation frame positions obtained in the above step S301, except for the interpolation frame positions that are the same as or close to the first video frames, as the target interpolation frame positions.

[0105] Step S403, if the position of the first video frame is between two adjacent interpolation frame positions, and the distance between the position of the first video frame and the interpolation frame position that is closer is less than the distance threshold, the interpolation frame position that is closer is deleted, and the target interpolation frame position is obtained according to the remaining interpolation frame positions after deletion.

[0106] From the perspective of the video timeline, the position of the first video frame and the interpolation frame position may refer to their positions on the timeline. The position of the first video frame is located between two adjacent interpolation frame positions, indicating that the time point corresponding to the position of the first video frame is between the time points corresponding to the two adjacent interpolation frame positions, for example, the time point corresponding to the position of the first video frame may be between 0.05 seconds and 0.1 seconds.

[0107] Specifically, if there is (one or more) first video frame positions located between two adjacent interpolation frame positions, it is further determined whether the distance between the first video frame and the interpolation frame position that is closer to it is less than a preset distance threshold, and if so, the interpolation frame position that is closer to it is deleted, otherwise, the interpolation frame position that is closer to it is not deleted. After deleting the interpolation frame positions where each first video frame falls, and deleting the interpolation frame position that is closer to the first video frame when the first video frame is located between two adjacent interpolation frame positions, the shooting device uses the remaining interpolation frame positions as target interpolation frame positions.

[0108] In actual applications, due to fluctuations in ambient illumination, the intervals between frames in the multiple first video frames collected by the camera according to the target frame rate after frame reduction are not uniform. For example, the current ambient illumination of the target scene is 0.11 lux. The intervals between the multiple first video frames actually collected by the camera are as follows: Figure 6 The actual position of the first video frame may also happen to fall on Figure 5 The evenly distributed interpolation frame positions shown may also fall between the evenly distributed interpolation frame positions. The interpolation frame positions that are the same as the position of the first video frame and the interpolation frame positions whose distance from the position of the first video frame is within a preset distance range are deleted; for those that fall between the evenly distributed interpolation frame positions, the interpolation frame positions that are closer to the position of the first video frame are deleted. Figure 7 Schematic diagram of the position of the interpolated frame to be deleted.

[0109] In this embodiment, multiple interpolation positions that need to be interpolated are preliminarily formulated by averaging the time periods corresponding to multiple first video frames; then, based on the distance between the position of the first video frame and the multiple interpolation positions, the interpolation positions that are the same as or close to the positions of the first video frame are deleted, and finally the remaining interpolation positions after deletion are set as the target interpolation positions, thereby achieving reasonable determination of the target interpolation positions to be interpolated, while meeting the standard frame rate requirements of the target platform and not affecting the overall smoothness of the video picture after interpolation.

[0110] In one embodiment, before the above step S201, obtaining the first video frame captured in the first shooting mode, it also includes: if it is detected that the ambient illumination information of the target scene meets the first environmental condition, switching the currently executed shooting mode to the first shooting mode.

[0111] The target scene refers to a specific area or scene captured by a camera. For example, the target scene can be an indoor living room, bedroom, balcony, etc., or an outdoor garden, sports field, sidewalk, etc. The target scene can be selected according to the needs of the actual application field. For example, application fields such as security monitoring, smart life, traffic monitoring, and motion analysis all have their own focused scenes and monitoring objects.

[0112] Among them, the ambient illumination information is used to characterize the physical quantity that reflects the light intensity of the target scene. The ambient illumination information can also measure the luminous flux received by the target scene per unit area. The ambient illumination information is usually measured in lux. The ambient illumination information can be obtained through sensors, cameras or other measuring devices. For example, the light sensor can detect the ambient light in real time. The intensity of light in the target scene can affect the imaging viewing angle effect of the shooting device. In low-light environments, it may be necessary to enable the night vision function, fill light function, or adjust the settings of the shooting device. In practical applications, ambient illumination is affected by many factors, including natural light (such as sunlight, skylight), artificial light sources (such as lamps), time (such as day and night changes) and climate (such as rainy weather).

[0113] Among them, environmental conditions refer to judgment conditions set for environmental information of the target scene. Environmental conditions can include condition information set for environmental illumination information, environmental illumination range, light source type and other aspects of environmental information. The first environmental condition in this embodiment is used to analyze and judge whether the target scene is in an environment with low illumination (such as a night environment or a dark environment); for example, the first environmental condition can be set to environmental illumination information less than 2lux. If the current environmental illumination information is detected to be 0.11lux, it can be considered that the first environmental condition is met.

[0114] Specifically, the shooting device can detect the ambient illumination information of the target scene through its built-in light sensor. When it is detected that the current ambient illumination information of the target environment meets the first environmental condition, for example, when it is detected that the current ambient illumination information of the target environment is lower than the preset illumination threshold, the shooting device needs to switch the currently executed shooting mode (such as the second shooting mode) to the first shooting mode to reduce the frame rate to achieve brightness compensation of the video screen. It should be noted that if the currently executed shooting mode is the first shooting mode, there is no need to switch the shooting mode.

[0115] In this embodiment, if the built-in light sensor of the shooting device detects that the ambient illumination information of the target scene meets the first environmental condition, the shooting device starts the first shooting mode to compensate for the brightness of the video picture, and restores the true color of the target scene in the first video frame by reducing the frame rate of the acquired first video frame. There is no need to deploy additional fill light equipment for the shooting device, and the shooting effect of the shooting device under the first environmental condition (such as at night or in a dark environment) is also improved.

[0116] In one embodiment, the above step S201, obtaining a first video frame captured in a first shooting mode, specifically includes the following contents: obtaining a first image parameter corresponding to the first shooting mode; the first image parameter represents an image adjustment parameter used to generate a color image when the ambient illumination information meets the first ambient condition; obtaining a first video frame shot according to the first image parameter.

[0117] Among them, image parameters refer to indicators and parameters related to image quality. Image parameters are used to describe multiple aspects of the image, such as clarity, details, and color accuracy. The first image parameter in this embodiment may be an image adjustment parameter (IQ) adapted for black light full-color imaging. For example, the first image parameter may include requirements for multiple parameters such as frame rate, contrast, color saturation, noise, sharpness, and format of the video frames captured in the first shooting mode. In practical applications, the first image parameter may be set based on experience or by specific algorithms or platform requirements to optimize the quality and display effect of the video frames captured in the first shooting mode.

[0118] The image adjustment parameters include noise, clarity, color restoration, etc. of the video frame. The first shooting mode is used to represent a mode for restoring the color of an object in a dark environment by reducing the frame rate.

[0119] Specifically, when the ambient illumination of the target scene is reduced to the point where it is necessary to enter the first shooting mode, the shooting device will load the first image parameters corresponding to the first shooting mode, such as loading an image adjustment parameter file for black light full-color imaging. The image adjustment parameter file can determine the target frame rate after frame reduction based on the ambient illumination information and restore the true colors of objects in the target scene in the imaging, thereby capturing the first video frame of color imaging at the target frame rate.

[0120] In this embodiment, the first video frame is captured by utilizing the first image parameter corresponding to the first shooting mode, thereby achieving color restoration of the video picture in a darker lighting environment. There is no need to deploy additional fill light equipment for the shooting device, which saves equipment costs and improves the shooting effect of the shooting device in a darker lighting environment.

[0121] In one embodiment, after obtaining the supplemented video frame in the above step S203, it also includes: if it is detected that the ambient illumination information satisfies the second ambient condition, the first shooting mode to be executed is switched to the second shooting mode; the second shooting mode is used to indicate that a preset frame rate is used for shooting processing; the second image parameters corresponding to the second shooting mode represent the image adjustment parameters for daytime imaging; and the second video frame captured in the second shooting mode is obtained.

[0122] The second environmental condition is used to analyze and determine whether the target scene is in an environment with brighter illumination (such as a daytime environment). The second environmental condition can be set according to the environmental illumination information or environmental illumination range of the target scene. For example, the second environmental condition can be set to an environmental illumination range of [2lux, 5lux). If the current environmental illumination information is detected to be 2.5lux, it can be considered that the second environmental condition is met.

[0123] The second shooting mode may be a shooting mode adapted for bright light conditions in the target scene. The second shooting mode may also include imaging frame rate requirements for the shooting device (such as target frame rate). Different from the first shooting mode, the second shooting mode is mainly for bright light conditions, while the first shooting mode is mainly for dark light conditions, so the frame rate requirement of the second shooting mode is higher than the frame rate requirement of the first shooting mode.

[0124] Among them, the second image parameters may be image adjustment parameters adapted for daytime imaging. For example, the second image parameters may include requirements for multiple parameters such as frame rate, contrast, color saturation, noise, sharpness, format, etc. of the video frames collected in the second shooting mode. In practical applications, the second image parameters can also be set based on experience, or can be set by specific algorithms or platform requirements to optimize the quality and display effect of the video frames collected in the second shooting mode. It can be understood that because the second shooting mode is a shooting mode for a brighter light environment and the first shooting mode is a shooting mode for a darker light environment, the second image parameters are usually different from the first image parameters. For example, the frame number requirement of the second image parameter is usually higher than the frame number requirement of the first image parameter.

[0125] Specifically, the shooting device can detect the ambient illumination information of the target scene through its built-in light sensor. When it is detected that the current ambient illumination information of the target environment meets the second environmental condition, for example, when it is detected that the current ambient illumination information of the target environment is higher than a preset illumination threshold, the shooting device needs to switch the currently executed shooting mode (such as the first shooting mode) to the second shooting mode to increase the frame rate and enter a normal shooting state.

[0126] At this time, the shooting device will load the second image parameters corresponding to the second shooting mode, for example, load the image adjustment parameter file for daytime imaging, which can perform video acquisition according to the standard frame rate of the target platform docked with the shooting device, and then the shooting device shoots a second video frame with a standard frame rate. Among them, the second video frame refers to a video frame shot according to the image parameters indicated by the second shooting mode. The second image parameters of the second shooting mode meet the standard frame rate specified by the platform docked with the shooting device, so the frame rate of the second video frame shot by the second shooting mode meets the standard frame rate specified by the platform docked with the shooting device. The target frame rate in the first shooting mode is lower than the standard frame rate specified by the platform docked with the shooting device, so the frame rate of the first video frame shot by the first shooting mode is lower than the standard frame rate specified by the platform docked with the shooting device, that is, the frame rate of the second video frame is higher than the frame rate of the first video frame. In addition, since the ambient illumination during the day is better than the ambient illumination at night, the picture brightness and color of the second video frame are usually better than the picture brightness and color of the first video frame.

[0127] In this embodiment, by detecting whether the ambient illumination information meets the second environmental condition, flexible switching between the first shooting mode and the second shooting mode is achieved, and then the second video frame can be captured according to the second image parameters corresponding to the second shooting mode, thereby realizing video frame acquisition in a daytime environment with good lighting, and improving the flexibility of the shooting device in video processing.

[0128] In one embodiment, Figure 8 As shown, another video processing method is provided, which is applied to Figure 1 The following steps are taken as an example:

[0129] Step S801: If it is detected that the ambient illumination information of the target scene meets the first ambient condition, the currently executed shooting mode is switched to the first shooting mode.

[0130] Step S802, obtaining a first image parameter corresponding to the first shooting mode; the first image parameter represents an image adjustment parameter used to generate a color image when the ambient illumination information satisfies a first ambient condition.

[0131] Step S803: Acquire a first video frame captured according to the first image parameters.

[0132] Step S804: determining a target frame supplement position according to the position of the first video frame and the target frame rate.

[0133] Step S805 , based on the first video frame, determining a target video frame to be supplemented at a target supplement frame position.

[0134] Step S806: Based on the target video frame, the first video frame is subjected to frame interpolation processing to obtain a frame-interpolated video frame.

[0135] Step S807, if it is detected that the ambient illumination information meets the second ambient condition, the first shooting mode is switched to the second shooting mode; the second shooting mode is used to indicate that a preset frame rate is used for shooting processing; the second image parameters corresponding to the second shooting mode represent image adjustment parameters for daytime imaging.

[0136] Step S808: Acquire a second video frame captured in a second shooting mode.

[0137] The above-mentioned video processing method can achieve the following beneficial effects: using the target frame rate to obtain the target video frame, and then using the target video frame to perform frame complement processing on the first video frame, quickly and effectively realizing the frame rate improvement of the video picture, solving the problem of video frame rate reduction caused by the environment of the target scene, while ensuring the video picture effect, it also improves the frame rate of the video.

[0138] In order to more clearly illustrate the video processing method provided by the embodiment of the present disclosure, the above-mentioned video processing method is specifically described below with a specific embodiment. Fig. 9 As shown, another video processing method is provided, which can be applied to Figure 1 The shooting equipment in the system includes the following:

[0139] (1) Start a shooting device (such as a camera). The shooting device is a camera with black light full-color imaging capability, and its normal frame rate in daytime working mode is 20 frames.

[0140] (2) After starting the shooting device, the built-in light sensor in the shooting device is used to detect whether the current ambient illumination meets the conditions for starting the black light full-color mode.

[0141] (3) If not, the camera loads the daytime image adjustment parameters and shoots at the standard frame rate required by the target platform connected to the camera.

[0142] (4) If the conditions are met, the camera loads the blacklight full-color image adjustment parameters and shoots at the target frame rate of frame reduction to achieve brightness compensation of the captured image by frame reduction. The blacklight full-color image adjustment parameters include parameters such as image noise, clarity, and color reproduction.

[0143] (5) The shooting device can also determine specific imaging parameters (such as the frame rate after frame reduction, the number of frames to be supplemented, color restoration, etc.) according to the current illumination value of the shooting environment, so as to automatically make up the difference between the target frame rate and the standard frame rate.

[0144] For example, when the illumination value is 0.1lux, the imaging frame rate of the shooting device will drop to 12 frames, and 8 frames need to be added compared to the standard 20 frames for daytime imaging. During the frame addition process, the unit time of the video can be evenly divided into 20 equal parts, and then the position of the 8 frames to be added is determined based on the position of the existing 12 frames; at each frame addition position, the copied previous frame is inserted to finally obtain the video after frame addition.

[0145] (6) The light sensor will continuously detect whether the current ambient illumination meets the conditions for turning off the black light full color mode. For example, when the current illumination value of the shooting environment rises to a point where it is no longer necessary to reduce the frame rate to compensate for the brightness of the image, the camera will end the frame reduction and frame supplementation working state and enter the daytime working mode; at this time, the camera automatically loads the image adjustment parameters for daytime imaging, and the frame rate of the camera returns to the normal 20 frames.

[0146] (7) Eventually, the camera will stop being used, completing a work cycle.

[0147] In this embodiment, the problem of a decrease in the frame rate of the captured video frames due to the acquisition of color imaging video frames when the ambient illumination decreases is solved, and there is no need to deploy additional fill light equipment for the shooting equipment. While saving equipment costs, the frame rate of the video frames captured by the shooting equipment under low ambient illumination is improved, thereby improving the picture smoothness and imaging effect of the shooting equipment under low ambient illumination.

[0148] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0149] Based on the same inventive concept, the embodiment of the present application also provides a video processing device for implementing the above-mentioned video processing method. The implementation solution provided by the device to solve the problem is similar to the implementation solution recorded in the above-mentioned method, so the specific limitations in one or more video processing device embodiments provided below can refer to the limitations on the video processing method above, and will not be repeated here.

[0150] In one embodiment, Fig.10 As shown, a video processing device 1000 is provided, comprising: a frame reduction shooting module 1001, a frame interpolation generation module 1002 and a video frame interpolation module 1003, wherein:

[0151] The frame reduction shooting module 1001 is used to obtain the first video frame captured in the first shooting mode; the first shooting mode is used to indicate shooting with a target frame rate after frame reduction; the target frame rate is determined based on the environmental information of the target scene.

[0152] The supplementary frame generation module 1002 is used to generate a target video frame to be supplemented according to the first video frame and the target frame rate.

[0153] The video frame interpolation module 1003 is used to perform frame interpolation processing on the first video frame based on the target video frame to obtain a frame-interpolated video frame.

[0154] In one embodiment, the interpolation frame generation module 1002 is further configured to determine a target interpolation frame position according to the position of the first video frame and a target frame rate; and determine a target video frame to be interpolated at the target interpolation frame position based on the first video frame.

[0155] In one embodiment, the video processing device 1000 also includes a frame supplement determination module, which is used to copy the previous video frame corresponding to the target frame supplement position to obtain the copied previous video frame; the previous video frame represents the first video frame located before the target frame supplement position; and the copied previous video frame is set as the target video frame to be supplemented at the target frame supplement position.

[0156] In one embodiment, the video processing device 1000 also includes a position determination module, which is used to average the time periods corresponding to the multiple first video frames to obtain multiple interpolation frame positions; if each first video frame falls into the multiple interpolation frame positions, the remaining interpolation frame positions in the multiple interpolation frame positions except the interpolation frame positions corresponding to each first video frame are determined as target interpolation frame positions; if the position of the first video frame is between two adjacent interpolation frame positions, and the distance between the position of the first video frame and the interpolation frame position that is closer is less than a distance threshold, the interpolation frame position that is closer is deleted, and the target interpolation frame position is obtained according to the remaining interpolation frame positions after deletion.

[0157] In one embodiment, the video processing device 1000 further includes a first switching module, which is used to switch the currently executed shooting mode to the first shooting mode if it is detected that the ambient illumination information of the target scene meets the first environmental condition.

[0158] In one embodiment, the frame reduction shooting module 1001 is also used to obtain a first image parameter corresponding to a first shooting mode; the first image parameter represents an image adjustment parameter used to generate a color image when the ambient illumination information meets the first ambient condition; and obtain a first video frame shot according to the first image parameter.

[0159] In one embodiment, the video processing device 1000 also includes a second switching module, which is used to switch the executed first shooting mode to a second shooting mode if it is detected that the ambient illumination information meets the second environmental condition; the second shooting mode is used to indicate that a preset frame rate is used for shooting processing; the second image parameters corresponding to the second shooting mode represent the image adjustment parameters of daytime imaging; and the second video frame captured in the second shooting mode is obtained.

[0160] Each module in the above video processing device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0161] In one embodiment, a computer device is provided. The computer device may be a photographing device, and its internal structure diagram may be as follows: Fig.11 As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. Among them, the processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data such as the first video frame and the video frame after the frame is supplemented. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a video processing method is implemented.

[0162] Those skilled in the art will understand that Fig.11 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0163] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.

[0164] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0165] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0166] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0167] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0168] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A video processing method, characterized in that: The method comprises: Acquire a first video frame captured in a first shooting mode; the first shooting mode is used to indicate shooting with a target frame rate after frame reduction; the target frame rate is determined based on environmental information of a target scene; generating a target video frame to be supplemented according to the first video frame and the target frame rate; Based on the target video frame, the first video frame is subjected to frame interpolation processing to obtain a frame-interpolated video frame.

2. The method according to claim 1, characterized in that The step of generating a target video frame to be supplemented according to the first video frame and the target frame rate includes: Determining a target frame supplement position according to the position of the first video frame and the target frame rate; Based on the first video frame, the target video frame to be supplemented at the target frame supplement position is determined.

3. The method according to claim 2, characterized in that The step of determining the target video frame to be supplemented at the target supplement frame position based on the first video frame includes: Copying a previous video frame corresponding to the target frame-interpolation position to obtain a copied previous video frame; the previous video frame represents a first video frame located before the target frame-interpolation position; The copied previous video frame is set as the target video frame to be supplemented at the target supplement frame position.

4. The method according to claim 2, characterized in that: The step of determining a target frame supplement position according to the position of the first video frame and the target frame rate includes: Performing an average process on the time periods corresponding to the plurality of first video frames to obtain a plurality of supplementary frame positions; If each of the first video frames falls into the multiple interpolation frame positions, the remaining interpolation frame positions among the multiple interpolation frame positions except the interpolation frame positions corresponding to each of the first video frames are determined as target interpolation frame positions; If the position of the first video frame is between two adjacent interpolation frame positions, and the distance between the position of the first video frame and the interpolation frame position that is closer is less than a distance threshold, the interpolation frame position that is closer is deleted, and the target interpolation frame position is obtained based on the remaining interpolation frame position after deletion.

5. The method according to claim 1, characterized in that Before acquiring the first video captured in the first shooting mode, the method further includes: If it is detected that the ambient illumination information of the target scene meets the first ambient condition, the currently executed shooting mode is switched to the first shooting mode.

6. The method according to claim 5, characterized in that The obtaining of a first video frame captured in a first shooting mode includes: Acquire a first image parameter corresponding to the first shooting mode; the first image parameter represents an image adjustment parameter used to generate a color image when the ambient illumination information meets the first environmental condition; Acquire the first video frame shot according to the first image parameters.

7. The method according to claim 5, characterized in that After obtaining the frame-interpolated video, the method further includes: If it is detected that the environmental illumination information satisfies the second environmental condition, the first shooting mode being executed is switched to the second shooting mode; the second shooting mode is used to indicate that a preset frame rate is used for shooting processing; the second image parameter corresponding to the second shooting mode represents an image adjustment parameter for daytime imaging; A second video frame captured in the second shooting mode is obtained.

8. A video processing device, characterized in that: The device comprises: A frame reduction shooting module, used for acquiring a first video frame captured in a first shooting mode; the first shooting mode is used for indicating shooting with a target frame rate after frame reduction; the target frame rate is determined based on environmental information of a target scene; A supplementary frame generation module, used to generate a target video frame to be supplemented according to the first video frame and the target frame rate; The video frame interpolation module is used to perform frame interpolation processing on the first video frame based on the target video frame to obtain a frame-interpolated video frame.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

11. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Video generation method and device, equipment and medium

    CN114245035A

  • Dynamic frame rate compensation method, image processing circuit and electronic equipment

    CN115514860A

  • Image processing method and device, electronic equipment and computer readable storage medium

    CN116886984A

  • Method and device for adjusting shooting frame rate of vehicle-mounted camera and vehicle

    CN118018857A

  • Video processing method and related device

    WO2021175055A1