Image processing method and device, equipment and medium

Abstract

The invention provides an image processing method and device, equipment and a medium. The method comprises the following steps: acquiring a first reference frame image and a first action parameter of the first reference frame image; acquiring a first frame image set of the candidate video stream, and acquiring a second reference frame image of each first frame image in the first frame image set; obtaining a second action parameter of each second reference frame image based on the first action parameter; obtaining an image effect adjustment parameter of each first frame image based on the third action parameter of each first frame image and the second action parameter of each second reference frame image; and performing image effect adjustment on each first frame image based on the image effect adjustment parameter to obtain each second frame image so as to obtain a target video stream corresponding to the candidate video stream. Smooth transition from the reference video stream to which the first reference frame image belongs to the image effect of the target video stream is realized, and the difference degree between the image effects of the target video stream and the reference video stream is reduced.

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to an image processing method, device, equipment and medium. Background Art

[0002] With the development of technology, multi-camera devices occupy an increasingly important position in people's daily work and life. In the process of image acquisition through multi-camera devices, due to the possible differences in the imaging quality of multiple cameras, there are differences in the presentation effects of the images captured by the multiple cameras.

[0003] In this scenario, when it is necessary to switch and view images captured by multiple cameras, the differentiated image effects will have a certain degree of impact on the user's viewing experience. Summary of the invention

[0004] The present disclosure aims to solve one of the technical problems in the related art at least to some extent.

[0005] To this end, the first aspect of the present disclosure proposes an image processing method.

[0006] A second aspect of the present disclosure provides an image processing device.

[0007] A third aspect of the present disclosure provides an electronic device.

[0008] A fourth aspect of the present disclosure provides a computer-readable storage medium.

[0009] A fifth aspect of the present disclosure provides a chip.

[0010] The first aspect of the present disclosure provides an image processing method, which includes: obtaining a first reference frame image and a first action parameter of the first reference frame image, wherein the first action parameter is used to characterize the image effect of the reference frame image; obtaining a first frame image set of a candidate video stream, and obtaining a second reference frame image of each first frame image in the first frame image set, wherein each first frame image in the first frame image set is an image to be displayed; based on the first action parameter, obtaining a second action parameter of each second reference frame image, wherein the second action parameters of each second reference frame image are different; based on a third action parameter of each first frame image and a second action parameter of each second reference frame image, obtaining an image effect adjustment parameter of each first frame image, wherein the image effect adjustment parameter of each first frame image is different; adjusting the image effect of each first frame image based on the image effect adjustment parameter to obtain each second frame image, so as to obtain a target video stream corresponding to the candidate video stream. .

[0011] In a second aspect of the present disclosure, an image processing device is proposed, which includes: a first acquisition module, used to acquire a first reference frame image and a first action parameter of the first reference frame image, wherein the first action parameter is used to characterize the image effect of the reference frame image; a second acquisition module, used to acquire a first frame image set of a candidate video stream, and acquire a second reference frame image of each first frame image in the first frame image set, wherein each first frame image in the first frame image set is an image to be displayed; a third acquisition module, used to obtain a second action parameter of each second reference frame image based on the first action parameter, wherein the second action parameter of each second reference frame image is different; a fourth acquisition module, used to obtain an image effect adjustment parameter of each first frame image based on the third action parameter of each first frame image and the second action parameter of each second reference frame image, wherein the image effect adjustment parameter of each first frame image is different; an adjustment module, used to adjust the image effect of each first frame image based on the image effect adjustment parameter to obtain each second frame image, so as to obtain a target video stream corresponding to the candidate video stream.

[0012] A third aspect of the present disclosure proposes an electronic device, comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the instructions to implement the image processing method proposed in the first aspect above.

[0013] A fourth aspect of the present disclosure proposes a computer-readable storage medium. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the image processing method proposed in the first aspect.

[0014] The fifth aspect of the present disclosure proposes a chip, comprising one or more interface circuits and one or more processors; the interface circuit is used to receive a signal and send the signal to the processor, the signal includes a computer instruction stored in a memory, and when the processor executes the computer instruction, the chip executes the steps of the image processing method proposed in the first aspect of the embodiment of the present disclosure.

[0015] The image processing method and device proposed in the present disclosure extract the first action parameter of the first reference frame image, obtain the first frame image set of the candidate video stream and the second reference frame image of each first frame image, and obtain the second action parameter of each second reference frame image based on the first action parameter. Obtain the third action parameter of each first frame image, and obtain the image effect adjustment parameter used when adjusting the image effect of each first frame image based on the second action parameter and the third action parameter, and then adjust the image effect of each first frame image according to the image effect adjustment parameter to obtain each second frame image, thereby realizing the image effect adjustment of the candidate video stream and obtaining the adjusted target video stream. In the present disclosure, the second action parameter of each second reference frame image is obtained based on the first action parameter of the first reference frame image, so that the image effect adjustment parameter obtained based on the second action parameter and the third action parameter realizes the fusion of the image effect action parameter of the reference video stream to which the first reference frame image belongs and the image effect action parameter of the candidate video stream, and then the second frame images obtained based on the image effect adjustment parameter can realize the fusion of the image effect of the reference video stream to which the first reference frame image belongs and the image effect of the candidate video stream itself. The image effect adjustment parameters of each first frame image are different, so that there is a difference in the degree of fusion of the image effect of each adjusted second frame image with the reference video stream to which the first reference frame image belongs, and a smooth transition of the image effect of the reference video stream to which the first reference frame image belongs to the image effect of the target video stream is realized, and the difference between the image effects of the target video stream and the reference video stream to which the first reference frame image belongs is reduced. In the scenario where the reference video stream to which the first reference frame image belongs is switched to the target video stream, the influence of the image effect difference on the user viewing experience is reduced, the image effect adjustment method and adjustment effect between video streams are optimized, and the user experience is optimized.

[0016] It should be understood that the contents described in the present disclosure are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above and / or additional aspects and advantages of the present disclosure will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0018] Figure 1 A flowchart of an image processing method according to an embodiment of the present disclosure;

[0019] Figure 2 is a flowchart of an image processing method according to another embodiment of the present disclosure;

[0020] Figure 3 is a flowchart of an image processing method according to another embodiment of the present disclosure;

[0021] Figure 4 is a flowchart of an image processing method according to another embodiment of the present disclosure;

[0022] Figure 5 is a structural schematic diagram of an image processing device according to an embodiment of the present disclosure;

[0023] Figure 6 A block diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0024] Embodiments of the present disclosure are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.

[0025] An image processing method, apparatus, device and medium proposed in an embodiment of the present disclosure will be described below with reference to the accompanying drawings.

[0026] Figure 1 FIG. 1 is a flow chart of an image processing method according to an embodiment of the present disclosure. Figure 1 As shown, the method includes:

[0027] S101, obtaining a first reference frame image and a first action parameter of the first reference frame image, wherein the first action parameter is used to characterize an image effect of the reference frame image.

[0028] The image processing method provided in the embodiment of the present disclosure may be executed by a terminal, such as a mobile phone, a computer, and a server, etc. Further, the image processing method provided in the embodiment of the present disclosure may be executed by a processing chip, and illustratively, the chip may include an image processing chip ISP.

[0029] In the related art, for a terminal configured with multiple image acquisition devices, a user may switch between multiple image acquisition devices when using the terminal to record a video. When there are differences in the image display effects of the videos captured by the multiple image acquisition devices, it may affect the user's video viewing experience.

[0030] The disclosed embodiment can adjust the image effects of the video streams captured by multiple image capture devices respectively, thereby reducing the degree of difference between the video streams.

[0031] Optionally, a video stream that needs to be adjusted for image effects may be determined as a candidate video stream, and a frame image used as a reference when adjusting the image effects of the candidate video stream may be determined as a first reference frame image.

[0032] As an example, set the first camera to capture video stream and then switch to the second camera to capture video stream, wherein the video stream captured by the first camera is determined as video stream 1, and the video stream captured by the second camera is determined as video stream 2. In this example, the image effect of the last frame image of video stream 1 can be used as a reference to adjust the image effect of video stream 2, so that a smooth image effect transition can be achieved between video stream 1 and video stream 2.

[0033] In this example, video stream 2 is the candidate video stream, and the last frame image of video stream 1 is the first reference frame image of video stream 2.

[0034] Optionally, based on a preset method for acquiring image effect action parameters, image effect action parameters may be extracted from the first reference frame image, and the extracted parameters may be determined as first action parameters of the first reference frame image.

[0035] Exemplarily, the first action parameter may be a three-dimensional lookup table (3D lut) action parameter, or may be other action parameters that can achieve image display effect adjustment, which is not specifically limited here.

[0036] It should be noted that the first action parameter can be understood as the corresponding parameter used to characterize the image effect of the first reference frame image. It can be understood that based on the first action parameter, relevant information about the image effect presented when the first reference frame image is displayed can be obtained, wherein the first action parameter may include color effect information, light and dark contrast effect information, brightness effect information and clarity effect information of the first reference frame image, etc., which are not specifically limited here.

[0037] S102, obtaining a first frame image set of a candidate video stream, and obtaining a second reference frame image of each first frame image in the first frame image set, wherein each first frame image in the first frame image set is an image to be displayed.

[0038] In the embodiment of the present disclosure, when adjusting the image effect of the candidate video stream, it is necessary to adjust each frame image included in the candidate video stream separately. In this scenario, each frame image included in the candidate video stream can be determined as a first frame image respectively, and the image set composed of the first frame images can be determined as the first frame image set in the candidate video stream.

[0039] Among them, each first frame image in the first frame image set can be understood as an image to be displayed that needs to be displayed in the display area of ​​the user terminal.

[0040] Optionally, when adjusting the image effect of each first frame image, there is a reference image on which the image effect adjustment depends, and the frame image used as a reference when adjusting the image effect of each first frame image can be determined as the second reference frame image of each first frame image.

[0041] The second reference frame image may be a preset frame image, or may be obtained based on the first reference frame image, or may be obtained based on the first frame image set of the candidate video stream, which is not specifically limited here.

[0042] S103, obtaining a second action parameter of each second reference frame image based on the first action parameter, wherein the second action parameter of each second reference frame image is different.

[0043] In the disclosed embodiment, the image effect adjustment of the candidate video stream can be achieved by adjusting the image effect of each first frame image, wherein, for any first frame image, the image action parameters of the second reference frame image corresponding to the first frame image can be extracted and determined as the second action parameters of the second reference frame image.

[0044] Optionally, a first action parameter corresponding to the first reference frame image can be obtained, and a second action parameter of the second reference frame image of each first frame image can be obtained based on the first action parameter, so as to achieve a smooth transition from the image effect of the reference video stream to which the first reference frame image belongs to the image effect of the candidate video stream.

[0045] Among them, the first action parameter can be processed based on a preset algorithm, and then the second action parameter of the second reference frame image can be obtained according to the result of the algorithm processing, or the first action parameter can be directly used as the second action parameter of the second reference frame image, which is not specifically limited here.

[0046] It should be noted that, for any first frame image, based on the second action parameter of the second reference frame image of the first frame image, the first frame image can achieve a fusion of the image effect of the first reference frame image and the image effect of the first frame image itself after the image effect is performed.

[0047] From this, it can be seen that in order to achieve a smooth transition of the image effect from the reference video stream to which the first reference frame image belongs to the candidate video stream, the second reference frame images in the first frame image set are different. Furthermore, it can be seen that there are differences between the second action parameters of each second reference frame image.

[0048] It should be noted that the image effect action parameters proposed in the embodiments of the present disclosure can be understood as relevant parameters that do not change the image content after being applied and only act on the effects presented by the image, among which the image effect action parameters can be three-dimensional lookup table (3D LUT) action parameters.

[0049] As an example, the 3D LUT effect parameters are normalized to between 0 and 1, and the presentation in a table of size 17×17×17×3 can be as follows:

[0050] [0,0,0,0.0625,0,0,0.125,0,0,...,1,0,0,0,0.0625,0,0.0625,0.0625,0,...,1,1,0,0,0,0.0625,...1,1,1]

[0051] S104, obtaining image effect adjustment parameters of each first frame image based on the third action parameter of each first frame image and the second action parameter of each second reference frame image, wherein the image effect adjustment parameters of each first frame image are different.

[0052] In the disclosed embodiment, each first frame image in the candidate video stream has an action parameter corresponding to its preset initial image effect. For each first frame image in the first frame image set, the action parameter corresponding to the initial image effect of each first frame image itself can be determined as the third action parameter of each first frame image.

[0053] Among them, the third action parameter of each first frame image can be determined based on the device parameters of the image acquisition device of the candidate video stream, or based on the expected image display effect of each first frame image, and no specific limitation is made here.

[0054] In this scenario, for any first frame image, the image effect of the first frame image can be adjusted according to the third action parameter of the first frame image itself and the second action parameter of the second reference frame image corresponding to the first frame image.

[0055] Among them, the second action parameter corresponding to the first frame image and the third action parameter corresponding to the first frame image can be algorithmically processed based on a preset integration algorithm, and the adjustment parameter used when adjusting the image effect of the first frame image is obtained according to the result of the algorithm processing, and the adjustment parameter is determined as the image effect adjustment parameter corresponding to the first frame image.

[0056] It should be noted that, in the embodiment of the present disclosure, there are differences between the second action parameters of each first reference frame image. Therefore, it can be seen that there are differences between the image effect adjustment parameters of each first frame image obtained based on the second action parameters and the third action parameters.

[0057] S105, adjusting the image effect of each first frame image based on the image effect adjustment parameter to obtain each second frame image, so as to obtain a target video stream corresponding to the candidate video stream.

[0058] In the disclosed embodiment, for any first frame image, the image effect of the first frame image can be adjusted according to the image effect adjustment parameters corresponding to the first frame image, and the frame image obtained after the image effect adjustment is determined as the second frame image corresponding to the first frame image, thereby obtaining each second frame image obtained after the image effect adjustment is performed on each first frame image.

[0059] Optionally, according to the image effect adjustment method in the relevant technology, the third action parameter of the first frame image itself can be adjusted based on the image effect adjustment parameter corresponding to any first frame image, so that the first frame image can present the corresponding image effect based on the adjusted action parameter, thereby realizing the image effect adjustment of the first frame image and obtaining the corresponding second frame image.

[0060] It should be noted that, in the embodiment of the present disclosure, the image effect adjustment parameters of each first frame image are different. Then, the image effects of each second frame image obtained by adjusting the image effects based on different image effect adjustment parameters are different, thereby reducing the degree of fusion of the image effects of each first frame image with the reference video stream, thereby achieving a smooth transition of the image effects from the reference video stream to which the first reference frame image belongs to the candidate video stream.

[0061] In the disclosed embodiment, the second frame image is a frame image obtained after adjusting the image effect of the first frame image. In this scenario, for any first frame image, the image effect displayed by the first frame image in the candidate video stream can be adjusted based on the corresponding second frame image, thereby realizing the image effect adjustment processing of each first frame image in the candidate video stream.

[0062] Furthermore, a video stream after image effect adjustment processing is obtained, and is determined as a target video stream after image effect adjustment of the candidate video stream.

[0063] The image processing method proposed in the present disclosure extracts the first action parameter of the first reference frame image, obtains the first frame image set of the candidate video stream and the second reference frame image of each first frame image, and obtains the second action parameter of each second reference frame image based on the first action parameter. The third action parameter of each first frame image is obtained, and based on the second action parameter and the third action parameter, the image effect adjustment parameter used when adjusting the image effect of each first frame image is obtained, and then the image effect adjustment of each first frame image is performed according to the image effect adjustment parameter to obtain each second frame image, thereby realizing the image effect adjustment of the candidate video stream and obtaining the adjusted target video stream. In the present disclosure, the second action parameter of each second reference frame image is obtained based on the first action parameter of the first reference frame image, so that the image effect adjustment parameter obtained based on the second action parameter and the third action parameter realizes the fusion of the image effect action parameter of the reference video stream to which the first reference frame image belongs and the image effect action parameter of the candidate video stream, and then the second frame images obtained based on the image effect adjustment parameter can realize the fusion of the image effect of the reference video stream to which the first reference frame image belongs and the image effect of the candidate video stream itself. The image effect adjustment parameters of each first frame image are different, so that there is a difference in the degree of fusion of the image effect of each adjusted second frame image with the reference video stream to which the first reference frame image belongs, and a smooth transition of the image effect of the reference video stream to which the first reference frame image belongs to the image effect of the target video stream is realized, and the difference between the image effects of the target video stream and the reference video stream to which the first reference frame image belongs is reduced. In the scenario where the reference video stream to which the first reference frame image belongs is switched to the target video stream, the influence of the image effect difference on the user viewing experience is reduced, the image effect adjustment method and adjustment effect between video streams are optimized, and the user experience is optimized.

[0064] In the above embodiment, the acquisition of the target video stream can be combined with Figure 2 understand, Figure 2 FIG. 1 is a flow chart of an image processing method according to another embodiment of the present disclosure. Figure 2 As shown, the method includes:

[0065] S201, obtaining a first camera and a second camera configured on a multi-camera terminal.

[0066] In the embodiments of the present disclosure, a terminal configured with multiple cameras for daily use may be determined as a multi-camera terminal, wherein the multi-camera terminal may include a mobile phone, an XR device, and a vehicle-mounted camera terminal, etc., which is not specifically limited here.

[0067] In a scenario where two cameras are configured on a multi-camera terminal, the two cameras may be respectively determined as a first camera and a second camera.

[0068] S202: Start the first camera to obtain a reference video stream through the first camera to obtain a first reference frame image in the reference video stream.

[0069] In the disclosed embodiment, the first camera can be set as the camera that first performs image acquisition on the multi-camera terminal. In this scenario, when the multi-camera terminal needs to perform image acquisition, the first camera can be started based on the preset startup method of the first camera.

[0070] Furthermore, image acquisition is performed based on an image acquisition function configured by the first camera, and a video stream consisting of the acquired multiple frames of images is determined as a reference video stream acquired by the first camera.

[0071] In this scenario, the first reference frame image required for adjusting the image effect of the candidate video stream can be obtained from the reference video stream, wherein the last frame image in the reference video stream can be determined as the first reference frame image, or any frame image in the reference video stream that meets the preset reference frame image screening conditions can be determined as the first reference frame image, and no specific limitation is made here.

[0072] S203, in response to identifying that the start condition of the second camera is triggered, start the second camera, and switch from the first camera to the second camera to obtain a candidate video stream.

[0073] In the embodiment of the present disclosure, the first camera and the second camera may have different camera parameters. In this scenario, there may be differences in the image effects of the video streams captured by the first camera and the second camera.

[0074] Optionally, when the first camera is capturing images, the second camera may be started by triggering a preset start condition, so as to achieve the purpose of switching from the first camera to the second camera.

[0075] Among them, a first acquisition magnification of the first camera and a second acquisition magnification of the second camera can be obtained.

[0076] In the embodiment of the present disclosure, the first camera and the second camera each have an initially set shooting magnification, which can be respectively determined as a first acquisition magnification of the first camera and a second acquisition magnification of the second camera.

[0077] Optionally, in response to the first acquisition magnification of the first camera being adjusted to the second acquisition magnification, it is determined that the start condition of the second camera is triggered.

[0078] In the disclosed embodiment, during image acquisition by the first camera, the user can adjust the image acquisition magnification of the first camera. For example, in a scenario where the first acquisition magnification is 1.0, the user can adjust the magnification from 1.0 to 0.5 according to his / her shooting needs.

[0079] In this scenario, the first acquisition ratio and the second acquisition ratio can be compared, and then it can be identified whether the multi-camera terminal currently triggers the start condition of the second camera based on the comparison result.

[0080] As an example, the first acquisition magnification is set to 1.0 and the second acquisition magnification is set to 0.5. When the first acquisition magnification of the first camera is adjusted from 1.0 to 0.5 by the user, it can be determined that the start condition of the second camera of the multi-camera terminal is triggered.

[0081] Furthermore, when it is recognized that the start-up condition of the second camera is triggered, the second camera can be started based on a preset start-up method, and the image acquisition is switched to the second camera, thereby obtaining a video stream composed of multiple frames of images captured by the second camera as a candidate video stream.

[0082] S204, obtaining a first reference frame image and a first action parameter of the first reference frame image, wherein the first action parameter is used to characterize an image effect of the reference frame image.

[0083] For detailed information about step S204, please refer to the relevant content in the above embodiment, which will not be repeated here.

[0084] S205 , obtaining a first frame image set of the candidate video stream, and obtaining a second reference frame image of each first frame image in the first frame image set, wherein each first frame image in the first frame image set is an image to be displayed.

[0085] As a possible implementation method, for the i-th first frame image to be displayed, in response to i being greater than 1, the i-1-th first frame image in the candidate video stream is obtained, and based on the i-1-th first frame image, a second reference frame image of the i-th first frame image is obtained.

[0086] In the disclosed embodiment, the first frame image set of the candidate video stream includes multiple first frame images, wherein there is a difference in the determination method of the second reference frame images of the first frame image located at the first position and the second reference frame images of the first frame images located at the non-first position.

[0087] Optionally, for the i-th first frame image, when i is greater than 1, it can be determined that the position of the first frame image in the first frame image set is not the first one. In this scenario, in order to achieve a smooth transition between the image effects of the i-1th first frame image and the i-th first frame image, the second reference frame image of the i-th first frame image can be obtained based on the i-1th first frame image.

[0088] In which, in response to i being greater than 1, the i-1th second frame image obtained after adjusting the image effect of the i-1th first frame image is obtained, and the i-1th second frame image is determined as the second reference image of the i-th first frame image.

[0089] Optionally, the image effect adjustment parameters of the i-1th first frame image can be obtained, and the image effect adjustment of the i-1th first frame image can be performed according to the image effect adjustment parameters to obtain the adjusted i-1th second frame image. In this scenario, the i-1th second frame image can be determined as the second reference frame image of the i-1th first frame image.

[0090] Optionally, the i-th first frame image in the first frame image set may be the first frame image located first among all the first frame images, wherein, for the i-th first frame image to be displayed, in response to i being equal to 1, the first reference frame image is obtained and determined as the second reference frame image of the i-th first frame image.

[0091] In the embodiment of the present disclosure, in the scenario where the reference video stream switches to the candidate video stream, the first frame image in the first frame image set of the candidate video stream, its preceding adjacent frame image is the last frame image of the reference video stream. In this scenario, for the i-th first frame image where i is 1, in order to achieve a smooth transition of the image effect from the reference video stream to the candidate video stream, the last frame image of the reference video stream can be determined as the second reference frame image of the i-th first frame image.

[0092] That is to say, in a scenario where the last frame image of the reference video stream is determined as the first reference frame image, the first reference frame image is the second reference frame image of the i-th first frame image.

[0093] S206: Obtain a second action parameter of each second reference frame image based on the first action parameter, wherein the second action parameter of each second reference frame image is different.

[0094] Optionally, for the i-th first frame image, in response to i being equal to 1, the first action parameter of the first reference frame image is determined as the second action parameter of the second reference frame image corresponding to the i-th first frame image.

[0095] In the scenario where i is 1, the i-th first frame image is the first frame image that is ranked first in the first frame image set of the candidate video stream. In order to achieve a smooth transition of the image effect from the reference video stream to the target video stream, the image effect of the i-th first frame image that is ranked first can be adjusted based on the image effect of the reference video stream.

[0096] Among them, the image effect of the i-th first frame image can be directly adjusted to the image effect of the last frame image of the reference video stream. In this scenario, the first action parameter of the first reference frame image can be determined as the image effect action parameter of the i-th first frame image located in the first position, and determined as the second action parameter of the second reference frame image corresponding to the i-th first frame image.

[0097] Optionally, in response to i being greater than 1, the fourth action parameter of the (i-1)th second frame image is obtained as the second action parameter of the second reference frame image corresponding to the i-th first frame image.

[0098] In the scenario where i is greater than 1, the i-th first frame image is the first frame image that is not the first in the first frame image set of the candidate video stream. In this scenario, the first reference frame image of the i-th first frame image is the i-1th second frame image obtained by adjusting the image effect of the i-1th first frame image.

[0099] In this scenario, the image effect parameters of the i-1th second frame image can be extracted, and the extracted image effect parameters can be determined as the fourth effect parameters of the i-1th second frame image. Furthermore, the fourth effect parameter can be determined as the parameter used when adjusting the image effect of the i-th first frame image. In the scenario where the i-1th second frame image is the second reference frame image of the current i-th first frame image, the fourth effect parameter can be determined as the second effect parameter of the second reference frame image corresponding to the i-th first frame image.

[0100] S207, obtaining image effect adjustment parameters of each first frame image based on the third action parameter of each first frame image and the second action parameter of each second reference frame image, wherein the image effect adjustment parameters of each first frame image are different.

[0101] Optionally, for the i-th first frame image, in response to i being greater than 1, a first weighting coefficient of the second action parameter and a second weighting coefficient of the third action parameter are obtained, and the second action parameter and the third action parameter are weighted according to the first weighting coefficient and the second weighting coefficient to obtain the image effect adjustment parameter of the i-th first frame image.

[0102] In the embodiment of the present disclosure, in a scenario where i is greater than 1, when adjusting the image effect of the i-th first frame image, it is necessary to achieve a fusion between the image effect of the corresponding first reference frame image and its own initial image effect. In this scenario, the second action parameter of the first reference frame image and the third action parameter corresponding to the initial image effect of the i-th first frame image itself can be used, and the two can be weighted.

[0103] Optionally, the weighting coefficient of the second action parameter can be obtained and determined as the first weighting coefficient, and the weighting coefficient of the third action parameter can be obtained and determined as the second weighting coefficient, and the second action parameter and the third action parameter can be weighted according to the first weighting coefficient and the second weighting coefficient, and then the weighted result can be determined as the image effect adjustment parameter used when adjusting the image effect of the i-th first frame image in the scene.

[0104] It should be noted that the second action parameter and the third action parameter can be weighted integrated based on the linear attenuation weighting strategy in the relevant technology, or can be weighted integrated based on the exponential attenuation weighting strategy in the relevant technology, or can be weighted integrated based on other weighting strategies that can achieve weighted integration of the second action parameter and the third action parameter, and no specific limitation is made here.

[0105] As a possible implementation, the second action parameter and the third action parameter may be weighted according to a preset weighting formula, which may be as follows:

[0106] lut′ n =(1-w n )×lut n +w n ×lut identity

[0107] In the above formula, lut′ n Indicates image effect adjustment parameters, lut n Indicates the second action parameter, lut identity Indicates the third action parameter.

[0108] In the embodiment of the present disclosure, for obtaining the second action parameter of the first reference frame image of the i-th first frame image where i is greater than 1, the image effect action parameter of the i-1th second frame image can be extracted after image effect adjustment is performed on the i-1th first frame image, or it can be obtained based on the image effect adjustment parameter corresponding to the i-1th first frame image before image effect adjustment is performed on the i-1th first frame image, and no specific limitation is made here.

[0109] Optionally, for the ith first frame image, in response to i being equal to 1, the second action parameter of the second reference frame image corresponding to the ith first frame image is determined as the image effect adjustment parameter of the ith first frame image.

[0110] In the embodiment of the present disclosure, for the i-th first frame image where i is equal to 1, in order to adjust its image effect to the image effect corresponding to the reference video stream, the second action parameter of the second reference frame image corresponding to the i-th first frame image can be directly determined as the image effect adjustment parameter of the first frame image.

[0111] S208 , for any first frame image, updating the third action parameter of the first frame image according to the image effect adjustment parameter to obtain an updated fifth action parameter.

[0112] As a possible implementation method, for any first frame image, the image effect adjustment parameters corresponding to the first frame image can be added and integrated with its own third action parameters to achieve the update of the third action parameters by the image effect adjustment parameters, and then the parameters obtained after the addition and integration can be determined as the fifth action parameters of the first frame image.

[0113] As another possible implementation method, for any first frame image, its third action parameter can be replaced and updated based on the image effect adjustment parameter corresponding to the first frame image, and the parameter obtained after addition and integration can be determined as the fifth action parameter of the first frame image.

[0114] S209, adjusting the image effect of the first frame image based on the fifth action parameter to obtain a second frame image after the adjustment of the first frame image.

[0115] Optionally, a method for adjusting image effects using image effect action parameters in related technologies can be obtained, and the image effect of the first frame image to be adjusted can be adjusted based on the fifth action parameter through this method, thereby obtaining a second frame image after the image effect of the first frame image is adjusted.

[0116] Optionally, the third action parameter of the first frame image to be adjusted can be replaced by the fifth action parameter, and the image effect presented by the first frame image can be adjusted based on the fifth action parameter, wherein the relevant parameters of the image effect such as image magnification and color of the first frame image can be changed according to the fifth action parameter, thereby achieving the purpose of adjusting the image effect of the first frame image, and then obtaining the adjusted second frame image.

[0117] S210, performing replacement processing on each first frame image in the candidate video stream based on the second frame image of each first frame image, to obtain a target video stream corresponding to the candidate video stream.

[0118] Optionally, for any first frame image, the position of the first frame image in the first frame image set of the candidate video stream can be obtained, and the first frame image at that position can be replaced with a second frame image obtained by adjusting the effect of the first frame image.

[0119] Furthermore, each first frame image in the candidate video stream is replaced based on each second frame image, thereby adjusting the image effect of the candidate video stream to obtain an adjusted target video stream.

[0120] The image processing method proposed in the present disclosure obtains the second action parameter of each second reference frame image based on the first action parameter of the first reference frame image, so that the image effect adjustment parameter obtained based on the second action parameter and the third action parameter realizes the fusion of the image effect action parameter of the reference video stream to which the first reference frame image belongs and the image effect action parameter of the candidate video stream, and then the second frame images obtained based on the image effect adjustment parameter can realize the fusion of the image effect of the reference video stream to which the first reference frame image belongs and the image effect of the candidate video stream itself. The image effect adjustment parameters of each first frame image are different, so that the degree of fusion of the image effect of each adjusted second frame image with the reference video stream to which the first reference frame image belongs is different, and a smooth transition of the image effect of the reference video stream to which the first reference frame image belongs to the image effect of the target video stream is realized, and the degree of difference between the image effects of the target video stream and the reference video stream to which the first reference frame image belongs is reduced. In the scenario where the reference video stream to which the first reference frame image belongs is switched to the target video stream, the degree of influence of the image effect difference on the user viewing experience is reduced, the image effect adjustment method and adjustment effect between video streams are optimized, and the user experience is optimized.

[0121] In the above embodiment, the acquisition of the image effect parameters can be combined with Figure 3 understand, Figure 3 FIG. 1 is a flow chart of an image processing method according to another embodiment of the present disclosure. Figure 3 As shown, the method includes:

[0122] S301, obtaining a third frame image to be extracted, wherein the third frame image is obtained by downsampling any frame image to be extracted.

[0123] In the disclosed embodiment, the trained model can be used to perform parameter extraction on any frame image that requires image effect parameter extraction, wherein the input frame image from which the input model corresponding to the frame image is subjected to parameter extraction can be determined as the third frame image to be extracted.

[0124] As an example, any frame image to be extracted can be downsampled, and the downsampled frame image can be determined as the third frame image, wherein the image size of the downsampled third frame image can be 256×256 or other preset image sizes, which are not specifically limited here.

[0125] S302, obtaining a trained image effect parameter extraction model.

[0126] Optionally, the image effect parameter extraction model to be trained proposed in the embodiments of the present disclosure may be constructed based on a model in the related art that can realize image effect parameter extraction.

[0127] Furthermore, the image effect parameter extraction model to be trained is trained according to the model training method in the related art until the training is completed, thereby obtaining a trained image effect parameter extraction model.

[0128] S303: extract image effect parameters of the third frame image based on the image effect parameter extraction model to obtain sixth effect parameters of the third frame image.

[0129] Optionally, the acquired third frame image can be input into a trained image effect parameter extraction model, and the image effect parameter extraction model is used to perform feature extraction and analysis on the third frame image, thereby extracting image effect parameters corresponding to the third frame image.

[0130] Among them, this parameter can be determined as the sixth action parameter of the third frame image.

[0131] Optionally, in a scenario where the third frame image is obtained by downsampling the first reference frame image, the sixth action parameter is the first action parameter of the first reference frame image.

[0132] Optionally, in a scenario where the third frame image is obtained by downsampling a second reference frame image corresponding to any first frame image, the sixth action parameter is the second action parameter of the second reference frame image.

[0133] Optionally, in a scenario where the third frame image is obtained by downsampling the first frame image, the sixth action parameter is the third action parameter of the first frame image.

[0134] Optionally, in a scenario where the third frame image is obtained by downsampling the second frame image, the sixth action parameter is the fourth action parameter of the second frame image.

[0135] The image processing method proposed in the present invention downsamples the frame image to be extracted to obtain the corresponding third frame image, and extracts parameters of the third frame image through a trained image effect parameter extraction model to obtain the sixth effect parameter of the third frame image, thereby improving the extraction efficiency and accuracy of the image effect parameters of the frame image, and providing accurate data support for the downstream task of adjusting the image effects of each first frame image in the candidate video stream, thereby improving the adjustment efficiency and adjustment accuracy of the image effects of each first frame image.

[0136] To better understand the above embodiments, Figure 4 , Figure 4 FIG. 1 is a flow chart of an image processing method according to another embodiment of the present disclosure. Figure 4 shown.

[0137] exist Figure 4 The multi-camera terminal shown in the figure has a collection end configured with Figure 4 The first camera, the second camera, ..., the Nth camera shown can be Figure 4 The multi-camera terminal shown performs image acquisition to obtain video streams acquired by each camera.

[0138] Optionally, the video streams collected by the first camera, the second camera, ..., the Nth camera can be transmitted to Figure 4 The image processing unit shown in the figure transmits the video streams collected by the first camera, the second camera, ..., the Nth camera to the image processing unit through the data transmission interface 1 connected to the image processing unit. Figure 4 The storage unit is shown.

[0139] Further, the storage unit transmits the video streams collected by the first camera, the second camera, ..., the Nth camera to Figure 4 The independent computing unit shown in the figure determines the reference video stream and the candidate video stream in the video streams respectively collected by the first camera, the second camera, ..., the Nth camera through the independent computing unit, and obtains the image effect adjustment parameters of each frame image in each video stream through the image effect adjustment parameter acquisition method proposed in the above embodiment, and transmits the obtained image effect adjustment parameters back to Figure 4 The storage unit is shown.

[0140] It should be noted that Figure 4 The independent computing unit shown is configured with a trained image effect parameter extraction model, through which the image effect parameters can be accurately extracted.

[0141] like Figure 4 As shown, the display end of the multi-camera terminal can be connected to the storage unit through the data transmission interface 2. Figure 4In the scenario shown, the storage unit can transmit the acquired image effect adjustment parameters of each frame image to the display end through the data transmission interface 2, and the data transmission interface 2 transmits each frame image and the image effect adjustment parameters of each frame image to the display end. Figure 4 An image effect adjustment unit is shown.

[0142] Further, through Figure 4 The image effect adjustment unit shown in the figure adjusts the image effect of each frame image that needs to be adjusted to achieve the image effect adjustment of each candidate video stream, and transmits the adjusted target video stream and the reference video stream that does not need to be adjusted to Figure 4 The display device shown is used to display to the user various video streams that can achieve smooth transition of image effects.

[0143] It should be noted that Figure 4 The image effect adjustment unit of the display end shown is configured with a 3D lut module. Based on the configuration of the module, the image effect adjustment unit can implement image effect adjustment of the candidate video stream based on the received image effect adjustment parameters, thereby obtaining the adjusted target video stream.

[0144] The image processing method proposed in the present disclosure obtains the second action parameter of each second reference frame image based on the first action parameter of the first reference frame image, so that the image effect adjustment parameter obtained based on the second action parameter and the third action parameter realizes the fusion of the image effect action parameter of the reference video stream to which the first reference frame image belongs and the image effect action parameter of the candidate video stream, and then the second frame images obtained based on the image effect adjustment parameter can realize the fusion of the image effect of the reference video stream to which the first reference frame image belongs and the image effect of the candidate video stream itself. The image effect adjustment parameters of each first frame image are different, so that the degree of fusion of the image effect of each adjusted second frame image with the reference video stream to which the first reference frame image belongs is different, and a smooth transition of the image effect of the reference video stream to which the first reference frame image belongs to the image effect of the target video stream is realized, and the degree of difference between the image effects of the target video stream and the reference video stream to which the first reference frame image belongs is reduced. In the scenario where the reference video stream to which the first reference frame image belongs is switched to the target video stream, the degree of influence of the image effect difference on the user viewing experience is reduced, the image effect adjustment method and adjustment effect between video streams are optimized, and the user experience is optimized.

[0145] Corresponding to the image processing methods proposed in the above-mentioned embodiments, an embodiment of the present disclosure further proposes an image processing device. Since the image processing device proposed in the embodiment of the present disclosure corresponds to the image processing methods proposed in the above-mentioned embodiments, the implementation method of the above-mentioned image processing method is also applicable to the image processing device proposed in the embodiment of the present disclosure, and will not be described in detail in the following embodiments.

[0146] Figure 5 FIG. 1 is a schematic diagram of the structure of an image processing device according to an embodiment of the present disclosure. Figure 5 As shown, the image processing device 500 includes a first acquisition module 51, a second acquisition module 52, a third acquisition module 53, a fourth acquisition module 54 and an adjustment module 55, wherein:

[0147] A first acquisition module 51 is used to acquire a first reference frame image and a first action parameter of the first reference frame image, wherein the first action parameter is used to characterize an image effect of the reference frame image;

[0148] A second acquisition module 52 is used to acquire a first frame image set of the candidate video stream, and acquire a second reference frame image of each first frame image in the first frame image set, wherein each first frame image in the first frame image set is an image to be displayed;

[0149] A third acquisition module 53 is used to obtain a second action parameter of each second reference frame image based on the first action parameter, wherein the second action parameter of each second reference frame image is different;

[0150] A fourth acquisition module 54 is used to obtain an image effect adjustment parameter of each first frame image based on the third action parameter of each first frame image and the second action parameter of each second reference frame image, wherein the image effect adjustment parameter of each first frame image is different;

[0151] The adjustment module 55 is used to adjust the image effect of each first frame image based on the image effect adjustment parameter to obtain each second frame image, so as to obtain the target video stream corresponding to the candidate video stream.

[0152] In the disclosed embodiment, the second acquisition module 52 is also used to: for the i-th first frame image to be displayed, in response to i being equal to 1, acquire the first reference frame image and determine it as the second reference frame image of the i-th first frame image; in response to i being greater than 1, acquire the i-1-th first frame image in the candidate video stream, and obtain the second reference frame image of the i-th first frame image based on the i-1-th first frame image.

[0153] In the disclosed embodiment, the second acquisition module 52 is also used to: in response to i being greater than 1, acquire the i-1th second frame image obtained after adjusting the image effect of the i-1th first frame image; determine the i-1th second frame image as the second reference image of the i-th first frame image.

[0154] In the disclosed embodiment, the third acquisition module 53 is also used to: for the i-th first frame image, in response to i being equal to 1, determine the first action parameter of the first reference frame image as the second action parameter of the second reference frame image corresponding to the i-th first frame image; in response to i being greater than 1, obtain the fourth action parameter of the i-1-th second frame image as the second action parameter of the second reference frame image corresponding to the i-th first frame image.

[0155] In the embodiment of the present disclosure, the fourth acquisition module 54 is also used to: for the i-th first frame image, in response to i being greater than 1, obtain the first weighting coefficient of the second action parameter and the second weighting coefficient of the third action parameter, and weight the second action parameter and the third action parameter according to the first weighting coefficient and the second weighting coefficient to obtain the image effect adjustment parameter of the i-th first frame image.

[0156] In the disclosed embodiment, the fourth acquisition module 54 is also used to: for the i-th first frame image, in response to i being equal to 1, determine the second action parameter of the second reference frame image corresponding to the i-th first frame image as the image effect adjustment parameter of the i-th first frame image.

[0157] In the disclosed embodiment, the adjustment module 55 is also used for: for any first frame image, updating the third action parameter of the first frame image according to the image effect adjustment parameter to obtain the updated fifth action parameter; adjusting the image effect of the first frame image based on the fifth action parameter to obtain the adjusted second frame image of the first frame image; replacing each first frame image in the candidate video stream based on the second frame image of each first frame image to obtain the target video stream corresponding to the candidate video stream.

[0158] In the disclosed embodiment, the device also includes an extraction module, which is used to: obtain a third frame image to be extracted, wherein the third frame image is obtained based on downsampling any frame image to be extracted; obtain a trained image effect parameter extraction model; extract image effect parameters from the third frame image based on the image effect parameter extraction model to obtain a sixth effect parameter of the third frame image.

[0159] In the disclosed embodiment, the first acquisition module 51 is also used to: acquire the first camera and the second camera configured on the multi-camera terminal; start the first camera to obtain a reference video stream through the first camera to obtain a first reference frame image in the reference video stream; in response to identifying that the start condition of the second camera is triggered, start the second camera, and switch from the first camera to the second camera to obtain a candidate video stream.

[0160] In the disclosed embodiment, the first acquisition module 51 is further used to: acquire a first acquisition magnification of the first camera and a second acquisition magnification of the second camera; in response to the first acquisition magnification of the first camera being adjusted to the second acquisition magnification, determine that the start condition of the second camera is triggered.

[0161] The image processing device proposed in the present disclosure extracts the first action parameter of the first reference frame image, obtains the first frame image set of the candidate video stream and the second reference frame image of each first frame image, and obtains the second action parameter of each second reference frame image based on the first action parameter. The third action parameter of each first frame image is obtained, and based on the second action parameter and the third action parameter, the image effect adjustment parameter used when adjusting the image effect of each first frame image is obtained, and then the image effect adjustment of each first frame image is performed according to the image effect adjustment parameter to obtain each second frame image, thereby realizing the image effect adjustment of the candidate video stream and obtaining the adjusted target video stream. In the present disclosure, the second action parameter of each second reference frame image is obtained based on the first action parameter of the first reference frame image, so that the image effect adjustment parameter obtained based on the second action parameter and the third action parameter realizes the fusion of the image effect action parameter of the reference video stream to which the first reference frame image belongs and the image effect action parameter of the candidate video stream, and then the second frame images obtained based on the image effect adjustment parameter can realize the fusion of the image effect of the reference video stream to which the first reference frame image belongs and the image effect of the candidate video stream itself. The image effect adjustment parameters of each first frame image are different, so that there is a difference in the degree of fusion of the image effect of each adjusted second frame image with the reference video stream to which the first reference frame image belongs, and a smooth transition of the image effect of the reference video stream to which the first reference frame image belongs to the image effect of the target video stream is realized, and the difference between the image effects of the target video stream and the reference video stream to which the first reference frame image belongs is reduced. In the scenario where the reference video stream to which the first reference frame image belongs is switched to the target video stream, the influence of the image effect difference on the user viewing experience is reduced, the image effect adjustment method and adjustment effect between video streams are optimized, and the user experience is optimized.

[0162] To achieve the above embodiments, the present disclosure also provides an electronic device, a computer-readable storage medium, and a computer program product.

[0163] Figure 6 is a block diagram of an electronic device 600 according to an embodiment of the present disclosure, as shown in Figure 6 As shown, the electronic device 600 includes a memory 601, a processor 602, and a computer program stored in the memory 601 and executable on the processor 602. When the processor 602 executes the program instructions, the image processing method provided in the above embodiment is implemented.

[0164] The image processing method proposed in the present disclosure extracts the first action parameter of the first reference frame image, obtains the first frame image set of the candidate video stream and the second reference frame image of each first frame image, and obtains the second action parameter of each second reference frame image based on the first action parameter. The third action parameter of each first frame image is obtained, and based on the second action parameter and the third action parameter, the image effect adjustment parameter used when adjusting the image effect of each first frame image is obtained, and then the image effect adjustment of each first frame image is performed according to the image effect adjustment parameter to obtain each second frame image, thereby realizing the image effect adjustment of the candidate video stream and obtaining the adjusted target video stream. In the present disclosure, the second action parameter of each second reference frame image is obtained based on the first action parameter of the first reference frame image, so that the image effect adjustment parameter obtained based on the second action parameter and the third action parameter realizes the fusion of the image effect action parameter of the reference video stream to which the first reference frame image belongs and the image effect action parameter of the candidate video stream, and then the second frame images obtained based on the image effect adjustment parameter can realize the fusion of the image effect of the reference video stream to which the first reference frame image belongs and the image effect of the candidate video stream itself. The image effect adjustment parameters of each first frame image are different, so that there is a difference in the degree of fusion of the image effect of each adjusted second frame image with the reference video stream to which the first reference frame image belongs, and a smooth transition of the image effect of the reference video stream to which the first reference frame image belongs to the image effect of the target video stream is realized, and the difference between the image effects of the target video stream and the reference video stream to which the first reference frame image belongs is reduced. In the scenario where the reference video stream to which the first reference frame image belongs is switched to the target video stream, the influence of the image effect difference on the user viewing experience is reduced, the image effect adjustment method and adjustment effect between video streams are optimized, and the user experience is optimized.

[0165] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0166] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0167] The program code for implementing the method itself can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code can be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0168] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0169] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0170] The systems and techniques described herein can be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a grid browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication grid). Examples of communication grids include: a local area network (LAN), a wide area network (WAN), the Internet, and a blockchain grid.

[0171] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication grid. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or "VPS" for short). The server may also be a server for a distributed system, or a server combined with a blockchain.

[0172] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0173] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0174] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present disclosure includes additional implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present disclosure belong.

[0175] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or otherwise processing in a suitable manner if necessary, and then stored in a computer memory.

[0176] It should be understood that the various parts of the present disclosure can be implemented in hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0177] A person skilled in the art may understand that all or part of the steps in the above-mentioned embodiment method may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0178] In addition, each functional unit in each embodiment of the present disclosure may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0179] The storage medium mentioned above may be a read-only memory, a disk or an optical disk, etc. Although the embodiments of the present disclosure have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations of the present disclosure. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present disclosure.

[0180] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0181] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. An image processing method, characterized in that: The method comprises: Acquire a first reference frame image and a first action parameter of the first reference frame image, wherein the first action parameter is used to characterize an image effect of the reference frame image; Acquire a first frame image set of a candidate video stream, and acquire a second reference frame image of each first frame image in the first frame image set, wherein each first frame image in the first frame image set is an image to be displayed; Based on the first action parameter, obtaining a second action parameter of each second reference frame image, wherein the second action parameter of each second reference frame image is different; Based on the third action parameter of each first frame image and the second action parameter of each second reference frame image, an image effect adjustment parameter of each first frame image is obtained, wherein the image effect adjustment parameter of each first frame image is different; The image effect of each first frame image is adjusted based on the image effect adjustment parameter to obtain each second frame image, so as to obtain the target video stream corresponding to the candidate video stream.

2. The method according to claim 1, characterized in that The step of obtaining a first frame image set of a candidate video stream and obtaining a second reference frame image of each first frame image in the first frame image set, wherein each first frame image in the first frame image set is an image to be displayed, comprises: For the i-th first frame image to be displayed, in response to i being equal to 1, acquiring the first reference frame image, and determining the second reference frame image as the i-th first frame image; In response to i being greater than 1, the i-1th first frame image in the candidate video stream is acquired, and the second reference frame image of the i-1th first frame image is obtained based on the i-1th first frame image.

3. The method according to claim 1, characterized in that In response to i being greater than 1, acquiring the i-1th first frame image in the candidate video stream, and obtaining the second reference frame image of the i-th first frame image according to the i-1th first frame image, comprising: In response to i being greater than 1, obtaining the i-1th second frame image obtained after adjusting the image effect of the i-1th first frame image; The (i-1)th second frame image is determined as the second reference image of the (i)th first frame image.

4. The method according to claim 1, characterized in that: The step of obtaining the second action parameters of each second reference frame image based on the first action parameters, wherein the second action parameters of each second reference frame image are different, comprises: For the i-th first frame image, in response to i being equal to 1, determining the first action parameter of the first reference frame image as the second action parameter of the second reference frame image corresponding to the i-th first frame image; In response to i being greater than 1, the fourth action parameter of the (i-1)th second frame image is obtained as the second action parameter of the second reference frame image corresponding to the i-th first frame image.

5. The method according to claim 4, characterized in that The image effect adjustment parameters of each first frame image are obtained based on the third action parameter of each first frame image and the second action parameter of each second reference frame image, wherein the image effect adjustment parameters of each first frame image are different, including: For the i-th first frame image, in response to i being greater than 1, obtain the first weighting coefficient of the second action parameter and the second weighting coefficient of the third action parameter, and weight the second action parameter and the third action parameter according to the first weighting coefficient and the second weighting coefficient to obtain the image effect adjustment parameter of the i-th first frame image.

6. The method according to claim 5, characterized in that The method further comprises: For the i-th first frame image, in response to i being equal to 1, the second action parameter of the second reference frame image corresponding to the i-th first frame image is determined as the image effect adjustment parameter of the i-th first frame image.

7. The method according to claim 1, characterized in that The step of adjusting the image effect of each first frame image based on the image effect adjustment parameter to obtain each second frame image, so as to obtain a target video stream corresponding to the candidate video stream, includes: For any first frame image, updating the third action parameter of the first frame image according to the image effect adjustment parameter to obtain an updated fifth action parameter; Adjusting the image effect of the first frame image based on the fifth action parameter to obtain the second frame image after the adjustment of the first frame image; Based on the second frame image of each first frame image, each first frame image in the candidate video stream is replaced to obtain the target video stream corresponding to the candidate video stream.

8. The method according to any one of claims 1 to 7, characterized in that The method further comprises: Acquire a third frame image to be extracted, wherein the third frame image is obtained based on downsampling any frame image to be extracted; Obtain the trained image effect parameter extraction model; Image effect action parameters of the third frame image are extracted based on the image effect action parameter extraction model to obtain a sixth action parameter of the third frame image.

9. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: Get the first camera and the second camera configured on the multi-camera terminal; Starting the first camera to obtain a reference video stream through the first camera to obtain the first reference frame image in the reference video stream; In response to identifying that a start condition of the second camera is triggered, the second camera is started, and the first camera is switched to the second camera to obtain the candidate video stream.

10. The method according to claim 9, characterized in that The method further comprises: Obtain a first acquisition magnification of the first camera and a second acquisition magnification of the second camera; In response to the first acquisition magnification of the first camera being adjusted to the second acquisition magnification, it is determined that a start condition of the second camera is triggered.

11. An image processing device, characterized in that: The device comprises: A first acquisition module, used for acquiring a first reference frame image and a first action parameter of the first reference frame image, wherein the first action parameter is used for characterizing an image effect of the reference frame image; A second acquisition module is used to acquire a first frame image set of a candidate video stream, and acquire a second reference frame image of each first frame image in the first frame image set, wherein each first frame image in the first frame image set is an image to be displayed; A third acquisition module, configured to obtain a second action parameter of each second reference frame image based on the first action parameter, wherein the second action parameter of each second reference frame image is different; a fourth acquisition module, configured to obtain an image effect adjustment parameter of each first frame image based on the third action parameter of each first frame image and the second action parameter of each second reference frame image, wherein the image effect adjustment parameter of each first frame image is different; The adjustment module is used to adjust the image effect of each first frame image based on the image effect adjustment parameter to obtain each second frame image, so as to obtain the target video stream corresponding to the candidate video stream.

12. An electronic device, characterized in that: include: processor; a memory for storing executable instructions for the processor; The processor is configured to execute instructions to implement the method as claimed in any one of claims 1 to 10.

13. A computer-readable storage medium, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 10.

14. A chip, characterized in that: It includes one or more interface circuits and one or more processors; the interface circuit is used to receive a signal and send the signal to the processor, the signal includes a computer instruction stored in a memory, and when the processor executes the computer instruction, the chip executes the steps of the method described in any one of claims 1 to 10.

Images