Multimedia data processing method and apparatus, and electronic device and storage medium

Abstract

Provided in the embodiments of the present disclosure are a multimedia data processing method and apparatus, and an electronic device and a storage medium. The method comprises: acquiring original multimedia data; acquiring a reference image; and adjusting an image frame in the original multimedia data on the basis of a display attribute of the reference image, so as to obtain target multimedia data, and displaying the target multimedia data, wherein the target multimedia data comprises an image frame sequence, which is adjusted on the basis of the display attribute of the reference image, in the original multimedia data. According to the embodiments of the present disclosure, the display style of original multimedia data is adjusted on the basis of the color style of a reference image, such that the target multimedia data presents a display effect similar to the reference image. Therefore, the step of manually adjusting the display attribute is omitted, thereby improving the color adjustment efficiency. Since the reference image can visually present a color adjustment result that a user desires, adjusting the original multimedia data on the basis of the display attribute of the reference image can improve the adjustment accuracy, thereby avoiding repeated modifications of parameters.

Description

Multimedia data processing method, device, electronic device and storage medium

[0001] This application claims priority to the Chinese invention patent application entitled “A method, device, electronic device and storage medium for processing multimedia data” and application number 202311415449X, filed on October 27, 2023. The entire contents of that application are incorporated by reference into this application. Technical Field

[0002] The present disclosure relates to image technology, and more particularly to a method, device, electronic device, and storage medium for processing multimedia data. Background Art

[0003] With the popularization of mobile terminals and the Internet, more and more users can capture multimedia data and share the multimedia data through the Internet.

[0004] Before sharing, users may need to adjust the color style of multimedia data to obtain a color adjustment result that meets their requirements. Current color adjustment methods mainly rely on manual parameter setting, which makes it difficult to quickly and accurately obtain a color adjustment result that meets color adjustment requirements.

[0005] Summary of the Invention

[0006] In a first aspect, embodiments of the present disclosure provide a method for processing multimedia data, comprising: obtaining original multimedia data; obtaining a reference image; adjusting image frames in the original multimedia data based on display attributes of the reference image to obtain target multimedia data; and displaying the target multimedia data. The target multimedia data includes a sequence of image frames in the original multimedia data that have been adjusted based on the display attributes of the reference image.

[0007] In a second aspect, embodiments of the present disclosure further provide a multimedia data processing device, comprising: a data acquisition module for acquiring original multimedia data; an image acquisition module for acquiring a reference image; and an image adjustment module for adjusting image frames in the original multimedia data based on display properties of the reference image to obtain target multimedia data, and displaying the target multimedia data. The target multimedia data includes a sequence of image frames in the original multimedia data that have been adjusted based on the display properties of the reference image.

[0008] In a third aspect, an embodiment of the present disclosure further provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement a method for processing multimedia data as described in any embodiment of the present disclosure.

[0009] In a fourth aspect, an embodiment of the present disclosure further provides a storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to execute the multimedia data processing method as described in any embodiment of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

[0011] FIG1 is a schematic flow chart of a method for processing multimedia data provided by an embodiment of the present disclosure;

[0012] FIG2 is a flow chart of another method for processing multimedia data provided by an embodiment of the present disclosure;

[0013] FIG3 is a schematic diagram of displaying a reference image superimposed on an image frame of original multimedia data provided by an embodiment of the present disclosure;

[0014] FIG4 is a schematic diagram of a reference image superimposed with line material according to an embodiment of the present disclosure;

[0015] FIG5 is a schematic diagram of a color block special effect provided by an embodiment of the present disclosure;

[0016] FIG6 is a schematic diagram of a color block shift provided by an embodiment of the present disclosure;

[0017] FIG7 is a schematic structural diagram of a multimedia data processing device provided by an embodiment of the present disclosure;

[0018] FIG8 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0019] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0020] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0021] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.

[0022] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0023] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0024] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0025] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) must comply with the requirements of relevant laws, regulations and relevant provisions.

[0026] The embodiments of the present disclosure provide a method, device, electronic device, and storage medium for processing multimedia data, which can improve color adjustment efficiency and accuracy.

[0027] The disclosed embodiments provide a method, apparatus, electronic device, and storage medium for processing multimedia data. These methods adjust image frames in original multimedia data based on the display properties of a reference image to obtain target multimedia data and display the target multimedia data. This method adjusts the display style of the original multimedia data based on the color style of the reference image, resulting in a display effect similar to that of the reference image. This eliminates the need for manual adjustment of display properties and improves color adjustment efficiency. Because the reference image can intuitively present the desired color adjustment result, adjusting the original multimedia data based on the display properties of the reference image can improve adjustment accuracy and avoid repeated parameter modifications.

[0028] Figure 1 is a flow chart of a method for processing multimedia data provided by an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to the case of video color grading. The method can be executed by a multimedia data processing device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, which can be a mobile terminal, a PC or a server, etc.

[0029] As shown in FIG1 , the method includes:

[0030] S110. Obtain original multimedia data. The original multimedia data may be a video or image selected by the user for color grading. In some embodiments, historical videos stored in the client may be designated as the original multimedia data. Alternatively, multimedia data captured by the user in real time may be obtained as the original multimedia data. Alternatively, multimedia data selected by the user from a local photo album may be obtained as the original multimedia data. Exemplarily, the original multimedia data is obtained and played. Display properties of the original multimedia data are adjusted without interrupting playback.

[0031] S120. Obtain a reference image. The reference image represents a reference image for adjusting the display properties of the image frame of the original multimedia data. In the embodiment of the present disclosure, the reference image can be an image uploaded by the user that meets the color adjustment requirements. The reference image can be an image taken by the user or an image downloaded from the Internet. The embodiment of the present disclosure does not limit the source of the reference image. Exemplarily, after detecting that the color adjustment function is turned on and obtaining the original multimedia data to be color adjusted selected by the user, the reference image uploaded by the user is obtained. Since the display style of the reference image meets the color adjustment requirements of the user, the step of repeatedly modifying parameters in order to obtain a color adjustment result that meets the color adjustment requirements during the manual color adjustment process can be avoided, thereby improving the color adjustment efficiency.

[0032] S130. Adjust the image frames in the original multimedia data according to the display attributes of the reference image to obtain target multimedia data, and display the target multimedia data. The display attributes represent the display effect of the reference image in terms of color and brightness. For example, the display attributes may include brightness attributes and color attributes. The target multimedia data may represent the color adjustment result of the original multimedia data. The target multimedia data includes a sequence of image frames in the original multimedia data that are adjusted based on the display attributes of the reference image, and the target multimedia data presents a display effect similar to the reference image. Exemplarily, for the image frames in the reference image and the original multimedia data, the target pixel interval corresponding to the image is determined according to the display attributes.

[0033] For each target pixel interval, attribute matching is performed on the image frame in the original multimedia data based on the display attributes of the pixels of the reference image. The attribute matching results corresponding to each target pixel interval are fused to obtain the multimedia data processing results corresponding to the image frame. Attribute matching may include matching attributes such as color and brightness. The attribute matching result represents the processing result of migrating the attribute features of the reference image to the image frame of the original multimedia data. By migrating the attribute features of the reference image to the image frame of the original multimedia data, the image frame of the original multimedia data presents display attributes similar to the reference image. For each pixel in the skin color area of ​​the image frame of the original multimedia data, the display attributes of the pixel are adjusted according to the display attributes of the reference image to obtain the skin color adjustment result corresponding to the image frame. For the image frame in the original multimedia data, the skin color adjustment result and the multimedia data processing result are fused according to the skin color weight to obtain the target multimedia data. The skin color weight represents the probability that each pixel in the image frame of the original multimedia data belongs to the skin color area.

[0034] In an embodiment of the present disclosure, color space conversion is performed on the reference image and the image frame of the original multimedia data, respectively. Based on the color space conversion results, the brightness channel data of the reference image and the image frame of the original multimedia data are obtained respectively. According to the brightness channel data, the histograms corresponding to the reference image and the image frame of the original multimedia data are determined respectively. According to the number of pixels corresponding to each brightness value in the histogram of the reference image, the brightness segmentation point corresponding to the reference image is determined. Then, according to the brightness segmentation point corresponding to the reference image, the reference image is segmented into a plurality of target pixel intervals. According to the number of pixels corresponding to each brightness value in the histogram of the image frame of the original multimedia data, the brightness segmentation point corresponding to the image frame in the original multimedia data is determined. Then, according to the brightness segmentation point corresponding to the image frame, the image frame is segmented into a plurality of target pixel intervals. For example, the target pixel intervals include shadow intervals, midtone intervals, and highlight intervals.

[0035] In some embodiments, pixels of the reference image are statistically analyzed based on their brightness attributes, and brightness segmentation points are determined based on the pixel statistics. The reference image is then segmented into a plurality of target pixel intervals based on the brightness segmentation points. The number of target pixel intervals is determined based on the number of brightness segmentation points, and adjacent target pixel intervals have overlapping areas.

[0036] In some embodiments, a reference image is converted to a YUV color space. Y channel data is determined to be a luminance attribute, and a histogram of the Y channel of the reference image is generated using the Y channel data. Shadow, midtone, and highlight pixels are determined based on each luminance value in the Y channel histogram. Alternative segmentation points are determined so that the number of pixels corresponding to shadows, midtones, and highlights is the same. Alternatively, alternative segmentation points are determined so that the areas of shadow intervals, midtone intervals, and highlight intervals are all the same.

[0037] To avoid color jumps at the pixels corresponding to the backup segmentation points, adjacent intervals can be staggered by a certain range, creating an overlapping area. The area of ​​the overlapping area can be set based on the actual application scenario. For example, the overlapping area can be set to n times the area of ​​the color area corresponding to the reference image, with 0 < n < 1.

[0038] The brightness segmentation points are determined based on the brightness values ​​corresponding to the starting and ending points of each overlapping region. For example, if the target pixel range includes a shadow range, a midtone range, and a highlight range, there are two overlapping regions within the target pixel range: the overlap between the shadow and midtone ranges, and the overlap between the midtone and highlight ranges. There are four brightness segmentation points within the target pixel range: S1, S2, S3, and S4, where S1 < S2 < S3 < S4. The shadow range is [0, S2], the midtone range is [S1, S4], and the highlight range is [S3, 255].

[0039] The brightness segmentation points and the range of the target pixel interval of the image frame in the original multimedia data are determined in a manner similar to the above manner, which will not be described in detail here.

[0040] For each pixel of an image frame in the original multimedia data, if the pixel belongs to an overlapping area of ​​a target pixel interval, a first weight corresponding to the pixel and each target pixel interval is determined based on the brightness attribute of the pixel and the brightness segmentation point corresponding to the overlapping area. Alternatively, if the pixel belongs to a non-overlapping area of ​​the target pixel interval, a first weight corresponding to the pixel and each target pixel interval is determined based on the target pixel interval to which the pixel belongs.

[0041] After determining the brightness segmentation point, for each pixel of the image frame in the original multimedia data, a number of first weights can be determined according to its brightness. The number of first weights is consistent with the number of target pixel intervals. For example, if the image frame in the original multimedia data is divided into a shadow interval, a midtone interval, and a highlight interval, three first weights can be calculated for each pixel in the image frame in the original multimedia data. That is, the shadow weight W of the pixel corresponding to the shadow interval is W, and the midtone interval is W. shadow , the midtone weight W of the pixel corresponding to the midtone interval mid, and the highlight weight W of the pixel corresponding to the highlight interval highlight , and the sum of the three weights is 1.

[0042] For each pixel of the image frame in the original multimedia data, if the brightness of the pixel is completely in the shadow range, the first weight of the pixel corresponding to the shadow range is W shadow =1, the first weight of the pixel corresponding to the mid-tone interval is W mid =0, the first weight of the pixel corresponding to the highlight interval is W highlight = 0. The first weights of pixels completely located in the mid-tone range and the highlight range can be determined in the same manner, which will not be described in detail here.

[0043] If the brightness of the pixel belongs to the overlapping area of ​​the shadow range and the mid-tone range, the pixel has both shadow weight and mid-tone weight. According to the brightness of the pixel and the brightness of the brightness division points (S1 and S2) of the overlapping area, the first weight W of the pixel corresponding to the shadow range is determined. shadow , determine the first weight W of the pixel corresponding to the midtone interval mid , determine the first weight of the pixel corresponding to the highlight interval as W highlight =0.

[0044] The first weight corresponding to the reference image can be determined by using a method similar to the above, which will not be described in detail here.

[0045] In some embodiments, for each of the target pixel intervals, attribute matching is performed on the image frames in the original multimedia data based on the display attributes of the pixels of the reference image. The attribute matching results corresponding to each of the target pixel intervals are fused to obtain the multimedia data processing results corresponding to the image frames, including: performing brightness matching on the image frames in the original multimedia data based on the brightness attributes of the reference image to obtain brightness matching results of the image frames in the original multimedia data. In order to match the image brightness and color separately, the image frames in the original multimedia data are converted into the YUV color space. Color matching is performed on the UV channel, and brightness matching is performed on the Y channel. For example, a histogram matching algorithm is used to perform histogram matching on the Y channel of the image frame in the original multimedia data and the Y channel of the reference image to obtain a brightness matching result.

[0046] Determining a color feature and a transformation matrix corresponding to each target pixel interval based on the color attributes of each target pixel interval. The color feature characterizes the color distribution of pixels in the target pixel interval corresponding to the image frame and the reference image in the original multimedia data. In the disclosed embodiment, the color feature may include, for example, a UV channel mean and a covariance matrix.

[0047] For the image frame and reference image in the original multimedia data, UV channel data for pixels in the shadow, midtone, and highlight regions are obtained. The UV mean and covariance matrix are calculated based on the UV channel data. The transformation matrix M is then determined based on the UV mean and covariance matrices.

[0048] In some embodiments, determining the color features and transformation matrix corresponding to the target pixel interval based on the color attributes of each target pixel interval includes: determining a first color mean and a first covariance matrix corresponding to the target pixel interval based on the color attributes of the pixels in each target pixel interval of the image frame in the original multimedia data; determining a second color mean and a second covariance matrix corresponding to the target pixel interval based on the color attributes of the pixels in each target pixel interval of the reference image; and determining the transformation matrix corresponding to the target pixel interval based on the first color mean, the second color mean, the first covariance matrix, and the second covariance matrix, wherein the color features include the first color mean and the second color mean.

[0049] Taking the shadow interval as an example, for all pixels whose brightness is in the shadow interval, calculate the UV channel mean of all shadow pixels in the image frame in the original multimedia data Covariance matrix Σ src The first color mean can be expressed as and The first covariance matrix can be expressed as Σ src . Calculate the UV channel mean of all shadow pixels in the reference image Covariance matrix Σ ref The second color mean can be expressed as and The second covariance matrix can be expressed as Σ ref The MKL algorithm is used to determine the transformation matrix M based on the above mean and covariance matrix.

[0050] In some embodiments, after determining the first color mean and the first covariance matrix corresponding to the target pixel interval, the method further includes determining an eigenvalue of the first covariance matrix. The eigenvalue represents the shape of an ellipse presented by the pixels of the image frame in the original multimedia data according to a Gaussian distribution. If the eigenvalue satisfies a set condition, the identity matrix is ​​used as the transformation matrix.

[0051] The preset condition represents the shape threshold of an ellipse that the pixels of the image frame in the original multimedia data present according to a Gaussian distribution. If the color transformation exceeds the Gaussian distribution shape threshold, color outliers may be generated. In this case, the transformation matrix M is set to the identity matrix instead of calculating the transformation matrix based on the covariance matrix.

[0052] For example, according to the covariance matrix Σ of the image frame in the original multimedia data src Determine the eigenvalues ​​e1 and e2 of the covariance matrix, where e1 > e2. The eigenvalues ​​of the covariance matrix represent the major axis e1 and minor axis e2 of the ellipse presented by the pixels of the image frame in the original multimedia data according to the Gaussian distribution. If e1 / e2 > the set shape threshold, it indicates that the ellipse presented by the Gaussian distribution is very flat. In this case, performing a color transformation on this Gaussian distribution is likely to produce color outliers. Therefore, the transformation matrix M is set to the identity matrix.

[0053] By adopting the above method, the first color mean values ​​of the image frame in the shadow interval, mid-tone interval and highlight interval in the original multimedia data can be calculated respectively, which is and and and The covariance matrix of the image frame in the shadow interval, mid-tone interval and highlight interval in the original multimedia data is calculated respectively, which is Σ src0 ,Σ src1 ,Σ src2 The transformation matrices M0, M1, and M2 of the image frame in the original multimedia data in the shadow range, mid-tone range, and highlight range are calculated respectively.

[0054] Color matching is performed on each target pixel interval corresponding to the image frame in the original multimedia data according to the color feature and the transformation matrix.

[0055] Exemplarily, for each target pixel interval of the image frame in the original multimedia data, the second weight corresponding to the pixel is determined according to color information of the pixel in the target pixel interval and the first color mean.

[0056] The second weight represents the degree of deviation of the pixel's color from the mean of the Gaussian distribution. A smaller second weight indicates that the pixel's color value deviates from the mean of the Gaussian distribution. A larger second weight indicates that the pixel's color value is closer to the mean of the Gaussian distribution.

[0057] Take the shadow interval as an example. The color information uv of the pixels in the shadow interval of the image frame in the original multimedia data in the UV channel can be expressed as a two-dimensional vector. The first color mean value of the shadow interval of the image frame in the original multimedia data It can be expressed as According to the pixel color information uv, the first color mean and the first covariance matrix Σ src0 Calculate the second weight. A similar method is used to calculate the second weights corresponding to the pixels in the midtone range and the highlight range, which will not be repeated here.

[0058] Color matching is performed on the target pixel interval according to the color features and the transformation matrix, respectively, to obtain a first color matching result and a second color matching result corresponding to the target pixel interval. For example, color matching can be performed on the target pixel interval of the image frame in the original multimedia data based on the transformation matrix to obtain a first color matching result. The first color matching result can be new color information obtained after color transformation is performed on the target pixel interval of the image frame in the original multimedia data based on the transformation matrix. The second color matching result is determined based on the color of the pixel in the image frame in the original multimedia data, the first color mean corresponding to the target pixel interval to which the pixel belongs, and the second color mean corresponding to the target pixel interval in the reference image. The second color matching result can be new color information obtained by adjusting the color information of the target pixel interval based on the color mean of the image frame in the original multimedia data and the reference image in the target pixel interval.

[0059] Take the shadow interval as an example. Perform color transformation on each pixel in the shadow interval of the image frame in the original multimedia data based on the transformation matrix to obtain new color information as the first color matching result. Adjust the color information of each pixel in the shadow interval of the image frame in the original multimedia data based on the color mean of the image frame in the original multimedia data and the reference image in the shadow interval to obtain new color information as the second color matching result. For example, the color information uv of the pixel of the image frame in the original multimedia data is combined with the transformation matrix M0 corresponding to the shadow interval to obtain the first color matching result corresponding to the shadow interval, thereby realizing the color style transfer of the reference image to the image frame in the original multimedia data. The color information uv of the pixel of the image frame in the original multimedia data minus the color information uv of the pixel of the image frame in the original multimedia data Then superimpose the reference image A second color matching result corresponding to the shadow interval is obtained. The second color mean of the shadow interval of the reference image can be expressed as

[0060] The first color matching result and the second color matching result are fused according to the second weight to obtain a color matching result of the target pixel interval.

[0061] Taking the shadow range as an example, a fusion coefficient is determined based on the second weight. The first and second color matching results corresponding to the shadow range are fused based on the fusion coefficient to obtain a color matching result for the shadow range. The fusion coefficient includes the second weight, and the sum of the fusion coefficients is 1. The color matching results for the midtone range and the highlight range are calculated using a similar method and will not be further described here.

[0062] It should be noted that for pixels in the image frame of the original multimedia data whose brightness falls completely within the shadow range, midtone range, or highlight range, only the color matching result for the shadow range exists. For pixels in the image frame of the original multimedia data whose brightness falls within the overlapping area of ​​the shadow range and the midtone range, there are color matching results for the shadow range and color matching results for the midtone range. For pixels in the image frame of the original multimedia data whose brightness falls within the overlapping area of ​​the midtone range and the highlight range, there are color matching results for the midtone range and color matching results for the highlight range.

[0063] For each pixel of the image frame in the original multimedia data, the color matching results of the target pixel interval are fused according to the first weight corresponding to the pixel and each target pixel interval to obtain the color matching result of the image frame in the original multimedia data; and based on the color matching results and brightness matching results of the image frame in the original multimedia data, a processing result image of the image frame in the original multimedia data is determined as the multimedia data processing result corresponding to the image frame.

[0064] In some embodiments, for each pixel of an image frame in the original multimedia data, first weights (i.e., shadow weight, midtone weight, and highlight weight) corresponding to each target pixel interval (i.e., shadow interval, midtone interval, and highlight interval) are first determined. Based on the first weights, the color matching results of the pixel in the corresponding target pixel interval (i.e., shadow weight, midtone weight, and highlight weight) are fused to obtain a color matching result for the image frame in the original multimedia data.

[0065] For example, for each pixel in an image frame in the original multimedia data, the color matching result of the pixel in the shadow range, the color matching result of the pixel in the midtone range, and the color matching result of the pixel in the highlight range are fused based on the shadow weight, midtone weight, and highlight weight of the pixel. In this way, the color matching result of the image frame in the original multimedia data is obtained.

[0066] In some embodiments, for pixels in a skin color area in an image frame of the original multimedia data, the display attributes of the pixels are adjusted according to the display attributes of the skin color area of ​​the reference image, to obtain a skin color adjustment result corresponding to the image frame. This includes: determining the probability that each pixel in the image frame of the original multimedia data belongs to a skin color area as a skin color weight, and determining the pixels included in the skin color area in the image frame of the original multimedia data according to the skin color weight. Determining the mean value of the display attributes of the skin color area in the image frame of the original multimedia data according to the display attributes of the pixels included in the skin color area in the image frame of the original multimedia data. For pixels in the skin color area in the image frame of the original multimedia data, adjusting the display attributes of the pixels according to the mean value of the display attributes of the image frame and the reference image in the skin color area, to obtain a skin color adjustment result corresponding to the image frame.

[0067] The skin color adjustment result represents the processing result of migrating the color and brightness characteristics of the reference image to the skin color area in the image frame of the original multimedia data.

[0068] Exemplarily, raw multimedia data is input into a skin color segmentation model. The skin color segmentation model is used to perform skin color segmentation on each image frame in the raw multimedia data, obtaining a probability that each pixel in the image frame belongs to a skin color region. Based on the probability, the pixels included in the skin color region of the image frame in the raw multimedia data are determined. Similarly, a reference image is input into the skin color segmentation model. The skin color segmentation model is used to perform skin color segmentation on the reference image, obtaining a probability that each pixel in the reference image belongs to a skin color region. Based on the probability, the pixels included in the skin color region of the reference image are determined.

[0069] Determine, based on the brightness of each pixel in the skin color region of the image frame in the original multimedia data, a mean brightness value of the skin color region of the image frame in the original multimedia data. Determine, based on the brightness of each pixel in the skin color region of the reference image, a mean brightness value of the skin color region of the reference image. Determine, based on the chromaticity of each pixel in the skin color region of the image frame in the original multimedia data, a mean chromaticity value of the skin color region of the image frame in the original multimedia data. Determine, based on the chromaticity of each pixel in the skin color region of the reference image, a mean chromaticity value of the skin color region of the reference image.

[0070] For each pixel in the skin color area of ​​the image frame of the original multimedia data, a difference between the brightness of the pixel and an average brightness of the skin color area is calculated, and the difference is superimposed with the average brightness of the skin color area of ​​the reference image to obtain a brightness adjustment result for the pixel.

[0071] For each pixel in the skin color area of ​​the image frame of the original multimedia data, a difference between the chromaticity of the pixel and a chromaticity mean value of the skin color area is calculated, and the difference is superimposed with the chromaticity mean value of the skin color area of ​​the reference image to obtain a chromaticity adjustment result for the pixel.

[0072] A skin color adjustment result corresponding to the image frame is obtained according to a brightness adjustment result and a chromaticity adjustment result of each pixel in the skin color area of ​​the image frame of the original multimedia data.

[0073] The target multimedia data is obtained by fusing the multimedia data processing results and the skin color adjustment results of the image frames using a linear fusion method based on the skin color weight. For example, the target multimedia data is determined based on a fusion result of the multimedia data processing results and the skin color adjustment results corresponding to the image frame sequence included in the target multimedia data.

[0074] The technical solution of the disclosed embodiments adjusts image frames in the original multimedia data based on the display properties of a reference image to obtain and display the target multimedia data. This allows the display style of the original multimedia data to be adjusted based on the color style of the reference image, resulting in a display effect similar to that of the reference image. This eliminates the need for manual adjustment of display properties and improves color adjustment efficiency. Because the reference image can intuitively present the desired color adjustment result, adjusting the original multimedia data based on the display properties of the reference image can improve adjustment accuracy and avoid repeated parameter modifications.

[0075] Figure 2 is a flow chart illustrating another multimedia data processing method provided by an embodiment of the present disclosure. This embodiment, based on the above embodiment, adds steps for displaying reference images and special effect elements. As shown in Figure 2 , the method includes: S210, obtaining original multimedia data. S220, obtaining a reference image. S230, generating a special effect element based on the reference image, and displaying the reference image and special effect element superimposed on the original multimedia data.

[0076] If only the original multimedia data is displayed while adjusting the display properties of image frames in the original multimedia data based on a reference image, the display effect is relatively simple, resulting in a poor user experience. This can even cause users to mistakenly believe that the reference image upload failed and repeat the operation, leading to erroneous processing. By superimposing the reference image and special effects elements on the original multimedia data, this simple display effect and the erroneous repeated upload of the reference image can be avoided.

[0077] The special effect element is superimposed on the reference image at a set position and moves in a set direction. For example, special effect elements include color block effects. Color block effects can include blocks of different colors. The color of the color block represents the color category obtained by clustering the colors of the pixels in the reference image. Alternatively, the color of the color block can be a fixed color. The embodiment of the present disclosure does not specifically limit the shape and color of the color block.

[0078] Exemplarily, the color category included in the reference image is determined based on the color attributes of pixels in the reference image, and a special effect element corresponding to the color represented by the color category is generated.

[0079] In some embodiments, multiple cluster centers are pre-set, and pixels in the reference image are clustered based on the colors of the pixels and the colors of the pixels corresponding to the cluster centers to obtain multiple pixel groups. The colors corresponding to the cluster centers of all groups of pixels can be used as the color categories included in the reference image.

[0080] Exemplarily, the reference image is displayed superimposed on the image frame of the original multimedia data, creating an effect of sliding into the display screen of the original multimedia data along a set direction. Figure 3 is a schematic diagram of displaying a reference image superimposed on an image frame of original multimedia data, provided by an embodiment of the present disclosure. As shown in Figure 3, during playback of the original multimedia data, the reference image is displayed superimposed on the original multimedia data at a first position 310 at time t1 and slides to a second position 320 at time t2.

[0081] A line material is superimposed and displayed in the reference image, and the line material moves along a first direction in the reference image. The movement of the line material along the first direction in the reference image can present an effect of light scanning the reference image. By superimposing a dynamic image of the line material moving along the first direction onto the reference image displayed in the original multimedia data, an effect of light scanning the reference image is presented. Figure 4 is a schematic diagram of a reference image superimposed with line material provided by an embodiment of the present disclosure. As shown in Figure 4, a mask image 410 with set transparency is generated according to the width and height of the reference image, and there are bright areas 411 and dark areas 412 in the mask image 410. A dynamic image is synthesized based on multiple mask images 410 with different positions of the bright areas 411. The dynamic image is superimposed on the reference image to obtain the effect of light scanning the reference image.

[0082] The special effect element is superimposed on the first area of ​​the reference image according to the set superposition form. The set superposition form represents the form of superimposing the color block special effect on the reference image. For example, the set superposition form can be to display the color blocks in different positions of the reference image in sequence according to the color of the color blocks. The first area can be a preset area within the range of the reference image. Figure 5 is a schematic diagram of a color block special effect provided by an embodiment of the present disclosure. As shown in Figure 5, each color block 520 is displayed one by one in the reference image 510 until all color blocks 520 are displayed in the first area of ​​the reference image 510. During the display process of each color block 520, the width and height of the color block are transformed from the first state to the second state.

[0083] Exemplarily, the display positions and brightness order corresponding to the special effect elements are determined based on the set overlay format. The display order of the special effect elements is determined based on the brightness order. The special effect elements are displayed in a superimposed manner in the first region of the reference image in the image frame of the original multimedia data, according to the display positions and display order. The display position represents the position of the special effect element in the reference image. For example, the display position may include color blocks arranged horizontally (or vertically or diagonally) within the reference image, with the spacing between adjacent color blocks being the same (or gradually increasing or decreasing). The brightness order may include arranging colors or brightness from dark to light, or from light to dark, etc. Because each color block represents a color appearing in the reference image, and the color blocks have different shades and brightnesses, the display order of the color blocks in the reference image can be determined based on the brightness order specified in the set overlay format. Then, the color blocks are displayed one by one at their corresponding display positions according to the display order. When each color block is displayed, the first state of the color block is first displayed in the reference image, and the process of the color block transitioning from the first state to the second state is presented. For example, a small color block is first displayed in a reference image, and then the small color block is enlarged to obtain a color block with a set width and height.

[0084] Move the special effect element from the first area of ​​the reference image along the second direction to the second area corresponding to the reference image, and adjust the display status of the special effect element in the second area. The second area represents the area range outside the reference image. Figure 6 is a schematic diagram of a color block shift provided by an embodiment of the present disclosure. As shown in Figure 6, after all color blocks are displayed in the first area of ​​the reference image, all color blocks 610 are rotated from a horizontal arrangement to a vertical arrangement, and moved to the second area 620 corresponding to the reference image. After all color blocks 610 reach the second area 620, the spacing between adjacent color blocks is increased. S240. Adjust the image frame in the original multimedia data according to the display properties of the reference image to obtain target multimedia data. S250. When the display status of the special effect element in the original multimedia data meets the set conditions, display the target multimedia data.

[0085] The set condition may represent a condition under which the special effect element disappears from the original multimedia data. When the special effect element disappears from the original multimedia data, the target multimedia data is displayed. For example, when the spacing between adjacent color blocks is increased to a set value, the special effect color is determined to meet the set condition. Alternatively, when the spacing between adjacent color blocks is increased and the display time of the color blocks reaches a set time, the special effect color is determined to meet the set condition.

[0086] The technical solution of the disclosed embodiment can intuitively display the color style of the reference image selected by the user by generating special effect elements corresponding to the reference image and superimposing the reference image and special effect elements on the original multimedia data. It can also avoid the erroneous operation of a single display effect or repeated uploading of reference images in the process of adjusting the display properties of the original multimedia data based on the reference image by vividly displaying the special effect elements, thereby increasing interactivity and fun and improving user experience.

[0087] Figure 7 is a schematic diagram of the structure of a multimedia data processing device provided by an embodiment of the present disclosure. The device can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, which can be a mobile terminal, PC or server, etc.

[0088] As shown in Figure 7, the apparatus includes an image acquisition module 710 and an image adjustment module 720. The data acquisition module 710 is configured to acquire original multimedia data; the image acquisition module 720 is configured to acquire a reference image; and the image adjustment module 730 is configured to adjust image frames in the original multimedia data based on the display properties of the reference image to obtain target multimedia data and display the target multimedia data. The target multimedia data includes a sequence of image frames in the original multimedia data that have been adjusted based on the display properties of the reference image.

[0089] Optionally, the system further includes a special effect element generation module configured to, after acquiring a reference image, generate a special effect element based on the reference image, and superimpose the reference image and the special effect element on the original multimedia data. The special effect element is displayed superimposed on the reference image at a set position and moves in a set direction; and when the display state of the special effect element in the original multimedia data satisfies a set condition, the target multimedia data is displayed.

[0090] Furthermore, generating a special effect element based on the reference image includes: determining a color category included in the reference image based on color attributes of pixels in the reference image; and generating a special effect element corresponding to a color represented by the color category.

[0091] Furthermore, the superimposing display of the reference image and special effect element in the original multimedia data includes: superimposing and displaying the reference image in the image frame of the original multimedia data; superimposing and displaying line material in the reference image, and the line material moving along a first direction in the reference image; superimposing the special effect element to a first area in the reference image according to a set superimposition form; moving the special effect element from the first area of ​​the reference image along a second direction to a second area corresponding to the reference image, and adjusting the display status of the special effect element in the second area.

[0092] Furthermore, superimposing the special effects element to the first area in the reference image according to the set superimposition form includes: determining the display position and brightness arrangement order corresponding to the special effects element according to the set superimposition form; determining the display order of the special effects elements according to the brightness arrangement order; and superimposing and displaying the special effects element in the first area of ​​the reference image in the image frame of the original multimedia data according to the display position and display order.

[0093] Optionally, the image adjustment module 720 is specifically configured to: determine, for the reference image and the image frames in the original multimedia data, target pixel intervals corresponding to the images based on the display attributes; for each target pixel interval, perform attribute matching on the image frames in the original multimedia data based on the display attributes of the pixels in the reference image, fuse the attribute matching results corresponding to each target pixel interval, and obtain a multimedia data processing result corresponding to the image frame; for pixels in a skin color area in the image frames of the original multimedia data, adjust the display attributes of the pixels based on the display attributes of the skin color area in the reference image, and obtain a skin color adjustment result corresponding to the image frame; for the image frames in the original multimedia data, fuse the skin color adjustment result and the multimedia data processing result based on a skin color weight to obtain the target multimedia data. The skin color weight represents the probability that each pixel in the image frames of the original multimedia data belongs to the skin color area.

[0094] Furthermore, for pixels in the skin color area in the image frame of the original multimedia data, the display attributes of the pixels are adjusted according to the display attributes of the skin color area of ​​the reference image to obtain a skin color adjustment result corresponding to the image frame, including: determining the probability that each pixel in the image frame of the original multimedia data belongs to the skin color area as a skin color weight, and determining the pixels included in the skin color area in the image frame of the original multimedia data according to the skin color weight; determining the mean value of the display attributes of the skin color area in the image frame of the original multimedia data according to the display attributes of the pixels included in the skin color area in the image frame of the original multimedia data; for pixels in the skin color area in the image frame of the original multimedia data, adjusting the display attributes of the pixels according to the mean values ​​of the display attributes of the image frame and the reference image in the skin color area respectively to obtain a skin color adjustment result corresponding to the image frame.

[0095] The multimedia data processing device provided in the embodiments of the present disclosure can execute the multimedia data processing method provided in any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution method.

[0096] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

[0097] FIG8 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Referring to FIG8 , a schematic diagram of the structure of an electronic device (such as a terminal device or server in FIG8 ) 800 suitable for implementing an embodiment of the present disclosure is shown below. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG8 is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

[0098] As shown in FIG8 , the electronic device 800 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 801, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803. Various programs and data required for the operation of the electronic device 800 are also stored in the RAM 803. The processing device 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An edit / output (I / O) interface 805 is also connected to the bus 804.

[0099] Typically, the following devices may be connected to the I / O interface 805: an input device 806 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 807 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 808 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 809. The communication device 809 may allow the electronic device 800 to communicate with other devices wirelessly or by wire to exchange data. Although FIG8 shows the electronic device 800 with various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0100] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 809, or installed from the storage device 808, or installed from the ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0101] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0102] The electronic device provided by the embodiment of the present disclosure and the method for processing multimedia data provided by the above embodiment belong to the same inventive concept. For technical details not fully described in this embodiment, please refer to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0103] An embodiment of the present disclosure provides a computer storage medium having a computer program stored thereon. When the program is executed by a processor, the method for processing multimedia data provided in the above embodiment is implemented.

[0104] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0105] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0106] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0107] The computer-readable medium carries one or more programs. When executed by the electronic device, the one or more programs cause the electronic device to: obtain original multimedia data; obtain a reference image; adjust image frames in the original multimedia data based on display properties of the reference image to obtain target multimedia data; and display the target multimedia data. The target multimedia data includes a sequence of image frames in the original multimedia data that have been adjusted based on the display properties of the reference image.

[0108] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0109] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0110] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. The name of a unit does not necessarily limit the unit itself.

[0111] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0112] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0113] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0114] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0115] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A method for processing multimedia data, comprising: Obtaining raw multimedia data; Get a reference image; The image frames in the original multimedia data are adjusted according to the display properties of the reference image to obtain target multimedia data, and the target multimedia data is displayed, wherein the target multimedia data includes a sequence of image frames in the original multimedia data adjusted based on the display properties of the reference image.

2. The method according to claim 1, wherein after acquiring the reference image, it further comprises: Generating a special effect element according to the reference image, and superimposing and displaying the reference image and the special effect element in the original multimedia data, wherein the special effect element is superimposed and displayed at a set position of the reference image and moves in a set direction; When the display state of the special effect element in the original multimedia data meets the set condition, the step of displaying the target multimedia data is executed.

3. The method according to claim 2, wherein generating a special effect element according to the reference image comprises: Determining the color category included in the reference image according to the color attributes of the pixels in the reference image; A special effect element corresponding to the color represented by the color category is generated.

4. The method according to claim 2, wherein the step of superimposing and displaying the reference image and the special effect element in the original multimedia data comprises: Overlaying and displaying the reference image in an image frame of the original multimedia data; Overlaying and displaying line material in the reference image, wherein the line material moves along a first direction in the reference image; superimposing the special effect element onto the first area in the reference image according to a set superimposition form; The special effect element is moved from the first area of ​​the reference image to the second area corresponding to the reference image along the second direction, and the display state of the special effect element in the second area is adjusted.

5. The method according to claim 4, wherein superimposing the special effect element onto the first area in the reference image according to a set superimposition form comprises: Determine the display position and brightness arrangement order corresponding to the special effect element according to the set superposition form; Determining a display order of the special effect elements according to the brightness arrangement order; The special effect element is displayed in a superimposed manner in a first area of ​​a reference image in an image frame of the original multimedia data according to the display position and display order.

6. The method according to claim 1, wherein adjusting the image frame in the original multimedia data according to the display attribute of the reference image to obtain the target multimedia data comprises: For the reference image and the image frame in the original multimedia data, respectively determine the image pair according to the display attribute The corresponding target pixel interval; For each of the target pixel intervals, attribute matching is performed on the image frame in the original multimedia data based on the display attributes of the pixels of the reference image, and the attribute matching results corresponding to each of the target pixel intervals are merged to obtain the multimedia data processing result corresponding to the image frame; For pixels in a skin color area in an image frame of the original multimedia data, adjusting display properties of the pixels according to display properties of the skin color area of ​​the reference image to obtain a skin color adjustment result corresponding to the image frame; For the image frame in the original multimedia data, the skin color adjustment result and the multimedia data processing result are fused according to the skin color weight to obtain the target multimedia data, wherein the skin color weight represents the probability that each pixel in the image frame of the original multimedia data belongs to the skin color area.

7. The method according to claim 6, wherein the step of adjusting the display attributes of the pixels in the skin color area of ​​the image frame of the original multimedia data according to the display attributes of the skin color area of ​​the reference image to obtain the skin color adjustment result corresponding to the image frame comprises: Determine the probability that each pixel in the image frame of the original multimedia data belongs to the skin color area as the skin color weight, and determine the pixels included in the skin color area in the image frame of the original multimedia data according to the skin color weight; Determining a mean value of the display attributes of the skin color area in the image frame of the original multimedia data according to the display attributes of the pixels included in the skin color area in the image frame of the original multimedia data; For pixels in a skin color area in an image frame of the original multimedia data, display properties of the pixels are adjusted according to mean values ​​of display properties of the image frame and a reference image in the skin color area, to obtain a skin color adjustment result corresponding to the image frame.

8. A multimedia data processing device, comprising: A data acquisition module, used for acquiring original multimedia data; An image acquisition module, used for acquiring a reference image; An image adjustment module is used to adjust the image frames in the original multimedia data according to the display properties of the reference image, obtain target multimedia data, and display the target multimedia data, wherein the target multimedia data includes a sequence of image frames in the original multimedia data that are adjusted based on the display properties of the reference image.

9. An electronic device, comprising: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the multimedia data processing method as described in any one of claims 1 to 7.

10. A storage medium comprising computer executable instructions, wherein the computer executable instructions are used to execute the method for processing multimedia data according to any one of claims 1 to 7 when executed by a computer processor.

11. A computer program product tangibly stored in a computer storage medium and comprising computer executable instructions which, when executed by a device, cause the device to perform the method according to any one of claims 1 to 7.

Images