Multimedia content processing method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a multimedia content processing method and device, electronic equipment and a storage medium. The method comprises the steps that original multimedia content and target parameters are obtained, the target parameters comprise content adjustment parameters and a superposition mode, and the content adjustment parameters are used for triggering distortion operation, zooming operation and attribute adjustment operation; performing distortion operation on the original multimedia content to obtain distortion content, performing zooming operation on the distortion content to obtain special effect content, and performing attribute adjustment operation on the special effect content to obtain attribute adjustment content, the special effect content including a target special effect material; and superposing the attribute adjustment content to the original multimedia content according to the superposition mode to obtain the target multimedia content. According to the embodiment of the invention, the target special effect material is generated based on the original multimedia content, and the target special effect material is superposed to the original multimedia content to obtain the target multimedia content added with the target special effect, so that the content display effect is enriched, and the processing accuracy and the processing efficiency are improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to image processing technologies, and in particular, to a method, apparatus, electronic device, and storage medium for processing multimedia content. Background Art

[0002] In video editing or image processing scenarios, it is usually necessary to add some special effects to video frames or images to enrich the display effects of videos or images. For example, adding light point special effects to a video or an image to render a certain special atmosphere.

[0003] Currently, some pixel points in the original image are manually adjusted in brightness through image editing software to present light point special effects in the original image. For example, adjusting the brightness value of the pixel points that need to emit light in the original image to present the effect of light rays in the original image. However, this method requires the user to have professional image processing skills and requires repeated brightness adjustment to obtain the light point special effects that meet the expectations, resulting in problems of low accuracy and low processing efficiency in image processing. Summary of the Invention

[0004] The present disclosure provides a method, apparatus, electronic device, and storage medium for processing multimedia content, which can improve the accuracy and processing efficiency of multimedia content processing.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for processing multimedia content, including:

[0006] Obtaining original multimedia content and target parameters, where the target parameters include content adjustment parameters and an overlay mode, and the content adjustment parameters are used to trigger distortion operations, scaling operations, and attribute adjustment operations;

[0007] Performing a distortion operation on the original multimedia content to obtain distorted content, performing a scaling operation on the distorted content to obtain special effect content, and performing an attribute adjustment operation on the special effect content to obtain attribute-adjusted content, where the special effect content includes target special effect materials;

[0008] Overlaying the attribute-adjusted content on the original multimedia content according to the overlay mode to obtain target multimedia content.

[0009] In a second aspect, an embodiment of the present disclosure further provides a device for processing multimedia content, where the device includes:

[0010] A content acquisition module, configured to obtain original multimedia content and target parameters, where the target parameters include content adjustment parameters and an overlay mode, and the content adjustment parameters are used to trigger distortion operations, scaling operations, and attribute adjustment operations;

[0011] A content adjustment module, configured to perform a distortion operation on the original multimedia content to obtain distorted content, perform a scaling operation on the distorted content to obtain special effect content, and perform an attribute adjustment operation on the special effect content to obtain attribute-adjusted content, where the special effect content includes target special effect materials;

[0012] A content overlay module, configured to overlay the attribute-adjusted content on the original multimedia content according to the overlay mode to obtain target multimedia content.

[0013] In a third aspect, an embodiment of the present disclosure further provides an electronic device, where the electronic device includes:

[0014] One or more processors;

[0015] A storage device, configured to store one or more programs,

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the method for processing multimedia content according to any embodiment of the present disclosure.

[0017] In a fourth aspect, an embodiment of the present disclosure further provides a storage medium containing computer-executable instructions, where the computer-executable instructions are used to execute the method for processing multimedia content according to any embodiment of the present disclosure when executed by a computer processor.

[0018] An embodiment of the present disclosure provides a method, apparatus, electronic device, and storage medium for processing multimedia content. By obtaining the original multimedia content and target parameters, performing a distortion operation on the original multimedia content based on the target parameters to obtain distorted content, then performing a scaling operation on the distorted content to obtain special effect content, performing an attribute adjustment operation on the special effect content to obtain attribute-adjusted content, and overlaying the attribute-adjusted content on the original multimedia content to obtain target multimedia content, it is possible to generate target special effect materials based on the original multimedia content, overlay the target special effect materials on the original multimedia content, and obtain target multimedia content with the target special effect added, enriching the content display effect and improving the accuracy and processing efficiency of multimedia content processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In combination with the accompanying drawings and with reference to the following specific embodiments, the above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic and the original and elements are not necessarily drawn to scale.

[0020] Figure 1 It is a flowchart of a method for processing multimedia content provided by an embodiment of the present disclosure;

[0021] Figure 2Schematic diagram of the positional relationship between a reference line and a dividing line provided by an embodiment of the present disclosure;

[0022] Figure 3 Flow schematic diagram of another method for processing multimedia content provided by an embodiment of the present disclosure;

[0023] Figure 4 Schematic diagram of the structure of a multimedia content processing device provided by an embodiment of the present disclosure;

[0024] Figure 5 Schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Detailed implementation manners

[0025] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although some embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. On the contrary, these embodiments are provided to more thoroughly and completely understand the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not used to limit the protection scope of the present disclosure.

[0026] It should be understood that the various steps recorded in the method embodiments of the present disclosure can be executed in different orders and / or executed in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this regard.

[0027] As used herein, the term "including" and its variants are open-ended, that is, "including but not limited to". The term "based on" is "at least partially based on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0028] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions executed by these devices, modules or units or their interdependent relationships.

[0029] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive. Those skilled in the art should understand that unless otherwise clearly specified in the context, it should be understood as "one or more".

[0030] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0031] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of data) should comply with the requirements of the corresponding laws, regulations and related provisions.

[0032] Figure 1 The figure is a schematic flowchart of a method for processing multimedia content provided by an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to the situation of making light point special effects. This method can be executed by a multimedia content processing device, and the device can be implemented in the form of software and / or hardware. Optionally, it is implemented by an electronic device, and the electronic device can be a mobile terminal, a PC or a server, etc.

[0033] As Figure 1 shown, the method includes:

[0034] S110. Obtain the original multimedia content and target parameters.

[0035] Among them, the target parameters include content adjustment parameters and overlay modes. The content adjustment parameters are used to trigger distortion operations, scaling operations, and attribute adjustment operations. The original multimedia content represents the multimedia content to which the target special effect material is to be added. For example, the original multimedia content can include videos or images, etc. The target special effect material can be used to represent the special effect material presenting light points or light rays.

[0036] The overlay mode is used to represent the way of overlaying the target special effect material after attribute adjustment on the original multimedia content. For example, the overlay mode can include adding the brightness values of the corresponding pixel points of the original multimedia content and the attribute adjustment content to obtain the brightness value of the pixel point. Or, taking the larger one of the brightness values of the corresponding pixel points of the original multimedia content and the attribute adjustment content as the brightness value of the pixel point. Or, determining the first difference between the brightness value of the pixel point in the original multimedia content and 1, and determining the second difference between the brightness value of the same pixel point in the attribute adjustment content and 1, and determining the brightness value of the pixel point according to the first difference and the second difference.

[0037] The distortion operation is used to perform distortion processing on the original multimedia content to obtain distorted content. Among them, the distortion processing can be realized by adjusting the coordinates of the pixel points of the original multimedia content. Specifically, fisheye lens distortion or square distortion can be performed on the original multimedia content.

[0038] The scaling operation is used to perform scaling processing on the distorted content to obtain special effect content. Among them, the scaling processing can be realized by adjusting the coordinates of the pixel points of the distorted content. The scaling ratio corresponding to the scaling operation can be determined by adjusting the visible range.

[0039] The attribute adjustment operation is used to adjust the attributes of the special effect content to obtain the attribute-adjusted content. Among them, the attribute adjustment can be achieved by adjusting the brightness values of the pixel points of the special effect content. For example, the brightness coefficient of each pixel point can be calculated based on the pixel point coordinates, the distortion center coordinates, the visible range, and the brightness parameter, and the brightness value of the corresponding pixel point is multiplied by the brightness system to achieve the adjustment of the brightness value of the pixel point.

[0040] Exemplarily, the original multimedia content and the target parameters input in the interaction interface are obtained, where the target parameters include at least one of the distortion center coordinates, the visible range, the distortion center attribute, the brightness parameter, and the overlay mode.

[0041] The distortion center coordinates represent the position of the light source center. The visible range is used to control the length and expansion degree of the light rays emitted by the light source. Among them, the light rays represent the light ray effects that are emitted from the light source and can pass through the original multimedia content. A smaller visible range will produce more concentrated and obvious light rays, while a larger visible range will cause the light rays to spread and expand, visually presenting the effect of stretching or distorting the original multimedia content. The distortion center attribute represents the attribute information of the light source center. For example, the distortion center attribute includes shape parameters and angle parameters, etc. Among them, the shape parameter can represent the shape of the light source center. The angle parameter can represent the rotation angle of the light source center. For example, if the shape of the light source center is circular, then the original multimedia content is subjected to fisheye lens distortion processing. If the shape of the light source center is square, then the original multimedia content is subjected to square distortion processing.

[0042] The brightness parameter is used to characterize the global brightness. The global brightness is related to the visible range. As the visible range decreases, the overall brightness of the image decreases, and vice versa, the overall brightness of the image increases.

[0043] It should be noted that if the original multimedia content is a video, the distortion operation, the scaling operation, and the attribute adjustment operation provided by the embodiments of the present disclosure are respectively performed on each video frame in the video.

[0044] S120. Perform a distortion operation on the original multimedia content to obtain distorted content, perform a scaling operation on the distorted content to obtain special effect content, and perform an attribute adjustment operation on the special effect content to obtain attribute-adjusted content.

[0045] Among them, the special effect content includes target special effect materials. For example, the target feature materials can include light point special effects or light beam special effects, etc. The length of the light rays emitted from the light source center can be controlled by adjusting the visible range to achieve the switching between the light point special effect and the light beam special effect. In addition, the light point can be made to move along the boundary of the target object by adjusting the position of the light source center to achieve the light point stroking special effect.

[0046] The distorted content can represent the multimedia content after performing distortion processing on the original multimedia content. For example, if the original multimedia content is an image, the distorted content can represent the distorted image. If the original multimedia content is a video, the distorted content can represent the distorted video frames after performing distortion processing on each video frame in the video. The distortion processing method can include fisheye lens distortion or square distortion, etc.

[0047] The special effect content can represent the multimedia content after performing stretching and scaling processing on the distorted content. The stretching and scaling of the distorted content can be achieved by adjusting the visible range.

[0048] The attribute adjustment content can represent the multimedia content after performing global brightness limitation processing on the special effect content. Since the visible range can control the extent of the light emitted by the light source, a smaller visible range corresponds to a lower global brightness. Therefore, it is necessary to calculate the brightness coefficient based on the visible range, pixel coordinates, distortion center coordinates, and brightness parameters to adjust the brightness value of the pixel with the brightness coefficient to obtain the attribute adjustment content, and the attribute adjustment content has a brightness effect corresponding to the visible range.

[0049] In some embodiments, performing a distortion operation on the original multimedia content to obtain distorted content includes:

[0050] Determining the distortion type according to the shape parameter in the distortion center attribute, where the distortion type includes a first distortion type and a second distortion type. For the first distortion type, performing a distortion operation on the original multimedia content according to the distortion center coordinates to obtain distorted content. Or, for the second distortion type, performing a distortion operation on the original multimedia content according to the angle parameter in the distortion center attribute to obtain distorted content.

[0051] If the shape parameter is circular, the distortion type is the first distortion type, and the first distortion type represents performing fisheye lens distortion processing on the original multimedia content. If the shape parameter is square, the distortion type is the second distortion type, and the second distortion type represents performing square distortion processing on the original multimedia content.

[0052] In the embodiments of the present disclosure, for the first distortion type, performing a distortion operation on the original multimedia content according to the distortion center coordinates to obtain distorted content includes:

[0053] For the first distortion type, according to the coordinates of the first pixel point of the original multimedia content and the distortion center coordinates, determine the first distortion coefficient corresponding to the first pixel point; adjust the coordinates of the first pixel point according to the distortion center coordinates and the first distortion coefficient to obtain the distorted content. Among them, the first pixel point can be a pixel point in the original multimedia content. The first distortion coefficient can represent the distortion coefficient used for distorting the original multimedia content. Adjust the coordinates of the first pixel point using the distortion coefficient corresponding to the first pixel point.

[0054] Taking the multimedia content as an image as an example, the fisheye lens distortion processing of the original image includes: assuming that the coordinates of the pixel point in the original image are (x o , y o ), the coordinates of the distortion center (focus) of the lens are (C x , C y ), the focal length is f x , f y , then determine the distance between the pixel point in the original image and the distortion center coordinates, and perform normalization processing on this distance according to the focal length to obtain (X n , Y n ), where X n , Y n are the coordinates with the optical center as the principal point. Then, determine the target distance R n between (X n , Y n ) and the principal point. Determine the distortion coefficient k n according to the target distance R ratio , and the target polynomial containing R n can be used to calculate k ratio . According to the normalized coordinates (X n , Y n ), the distortion coefficient k ratio , the focal length f x , f y , and the distortion center coordinates (C x , C y ), calculate the image coordinates (X u , Y u ) after undistortion. For example, the value obtained by dividing X n by k ratio can be multiplied by f x to obtain the first product, and the first product can be added to C x to obtain X u . The value obtained by dividing Y n by k ratio can be multiplied by f y to obtain the second product, and the second product can be added to C y to obtain Y u .

[0055] In the embodiments of the present disclosure, for the second type of distortion, performing a distortion operation on the original multimedia content according to the angle parameter in the distortion center attribute includes:

[0056] For the second type of distortion, determine a reference line and a dividing line according to the angle parameter in the distortion center attribute. Divide the original multimedia content into content blocks according to the dividing line, and determine the first distance between the coordinate of the second pixel point of the content block and the reference line. Determine the second distortion coefficient corresponding to the second pixel point according to the first distance. Adjust the coordinate of the second pixel point according to the second distortion coefficient to obtain the distorted content.

[0057] Among them, the reference line is used to calculate the distortion coefficient corresponding to the pixel point in the original multimedia content. For example, the distortion coefficient can be determined according to the distance between the pixel point and the reference line. The dividing line is used to divide the original multimedia content into content blocks. The reference line can be determined according to the angle parameter in the distortion center attribute, and then, according to the preset angle relationship between the reference line and the dividing line, the dividing line is determined based on the position of the reference line.

[0058] Taking the multimedia content as an image as an example, performing square distortion processing on the original image includes: obtaining an angle parameter, and the value range of the angle parameter can be any angle from 0 degrees to 360 degrees, which is used to represent the tilt of the light source center. Since the tilt effect cycles with a period of 90 degrees, the angle parameter D can be converted into an angle value Dˊ within the range of 0-90 degrees. For example, if the angle parameter is 135 degrees, the converted angle value within the range of 0-90 degrees is 45 degrees. The reference line is two mutually perpendicular line segments. For example, the reference line includes a first reference line and a second reference line, and the included angle between the first reference line and the horizontal line is Dˊ. The dividing line is two mutually perpendicular line segments. For example, the dividing line includes a first dividing line and a second dividing line, and the included angle between the first dividing line and the first reference line satisfies a preset angle relationship.

[0059] Figure 2 It is a schematic diagram of the positional relationship between a reference line and a dividing line provided by the embodiments of the present disclosure. As Figure 2 shown, the included angle between the first reference line 210 and the horizontal line is Dˊ, and the second reference line 220 is perpendicular to the first reference line 210. The included angle between the first dividing line 230 and the first reference line 210 is 45 degrees, and the second dividing line 240 is perpendicular to the first dividing line 230. The first reference line 210, the second reference line 220, the first dividing line 230 and the second dividing line 240 intersect at the distortion center.

[0060] Since the first dividing line 230 and the second dividing line 240 divide the original image into four quadrants, each quadrant represents an image block, namely the first image block 250 corresponding to the first quadrant, the second image block 260 corresponding to the second quadrant, the third image block 270 corresponding to the third quadrant, and the fourth image block 280 corresponding to the fourth quadrant.

[0061] For the pixel points located in the first quadrant and the third quadrant, the distortion coefficient can be determined according to the distance between the pixel point and the first reference line 210. For the pixel points located in the second quadrant and the fourth quadrant, the distortion coefficient can be determined according to the distance between the pixel point and the second reference line 220. For example, for the second pixel point in the first image block 250, determine the first distance between the coordinates of the second pixel point and the first reference line 210, and use the first distance as the second distortion coefficient corresponding to the second pixel point. Or, for the second pixel point in the second image block 260, determine the first distance between the coordinates of the second pixel point and the second reference line 220, and use the first distance as the second distortion coefficient corresponding to the second pixel point. Or, for the second pixel point in the third image block 270, determine the first distance between the coordinates of the second pixel point and the first reference line 210, and use the first distance as the second distortion coefficient corresponding to the second pixel point. Or, for the second pixel point in the fourth image block 280, determine the first distance between the coordinates of the second pixel point and the second reference line 220, and use the first distance as the second distortion coefficient corresponding to the second pixel point. Adjust the coordinates of the second pixel point according to the second distortion coefficient to obtain the distorted content.

[0062] It should be noted that if the multimedia content is a video, the above distortion processing is performed on each video frame in the video.

[0063] In some embodiments, performing a scaling operation on the distorted content to obtain special effect content includes: for the third pixel point in the distorted content, determining the second distance between the coordinates of the third pixel point and the distortion center coordinates. Adjust the coordinates of the third pixel point according to the second distance and the visible range to obtain the special effect content.

[0064] For example, calculate the second distance between each third pixel point in the distorted content and the distortion center coordinates, determine the base a according to the second distance, determine the exponent n according to the visible range, and obtain the power operation result a n , multiply the power operation result by the coordinate value of the third pixel point to obtain the new coordinate value of the third pixel point. Optionally, iteratively perform the above coordinate adjustment process for the third pixel point to obtain the special effect content.

[0065] In some embodiments, performing an attribute adjustment operation on the special effect content to obtain attribute-adjusted content includes: for a fourth pixel point in the special effect content, determining a distance parameter based on a third distance between the coordinates of the fourth pixel point and the coordinates of the distortion center and the visible range. Determining a brightness coefficient corresponding to the fourth pixel point according to the distance parameter, the visible range, and a brightness parameter, and adjusting the brightness of the fourth pixel point according to the brightness coefficient to obtain the attribute-adjusted content.

[0066] For example, for a fourth pixel point in the special effect content, determining a third distance between the coordinates of the fourth pixel point and the coordinates of the distortion center, determining a difference between the third distance and the visible range, and obtaining a first preset value, where the first preset value is a preset value. Comparing the difference with the first preset value, and taking the larger one of the two values as the distance parameter, where the difference represents the result of the subtraction operation between the third distance and the visible range.

[0067] Obtaining a second preset value, where the second preset value is a preset value. Determining a value to be compared according to the larger one of the visible range and the second preset value and the distance parameter, taking the larger one of the value to be compared and the second preset value as the denominator, and taking the brightness parameter as the numerator, calculating the brightness coefficient corresponding to the fourth pixel point, and multiplying the brightness coefficient by the brightness value of the fourth pixel point to obtain the attribute-adjusted content.

[0068] S130. Superimposing the attribute-adjusted content on the original multimedia content according to the superimposing mode to obtain a target multimedia content.

[0069] Wherein, the target multimedia content is a multimedia content with a target special effect material added and the pixel brightness corresponding to the visible range.

[0070] Exemplarily, for a pixel point in the original multimedia content, respectively obtaining the brightness values of the pixel point in the original multimedia content and the attribute-adjusted content. Adding the brightness values of the same pixel point in the original multimedia content and the attribute-adjusted content to obtain the target multimedia content.

[0071] Optionally, for a pixel point in the original multimedia content, respectively obtaining the brightness values of the pixel point in the original multimedia content and the attribute-adjusted content. Comparing the brightness values of the same pixel point in the original multimedia content and the attribute-adjusted content, and taking the larger brightness value as the brightness value of the pixel point to obtain the target multimedia content.

[0072] Optionally, for the pixel points in the original multimedia content, obtain the brightness values of the pixel points in the original multimedia content and the attribute adjustment content respectively. Determine the first difference between the brightness value of the pixel point in the original multimedia content and 1, and determine the second difference between the brightness value of the same pixel point in the attribute adjustment content and 1. Determine the brightness value of the pixel point according to the first difference and the second difference to obtain the target multimedia content.

[0073] Optionally, after determining the target multimedia content, display the target multimedia content through an interaction interface. If a adjustment operation for the target parameter is detected, obtain the adjusted target parameter, and parse the content adjustment parameter and / or the overlay mode that has changed in the new target parameter. If the content adjustment parameter changes, then determine the parameter that has changed among the distortion center coordinates, the visible range, the distortion center attribute, or the brightness parameter. If the distortion center coordinates change, trigger the distortion operation, the scaling operation, and the attribute adjustment operation to be executed again. If the visible range changes, trigger the scaling operation and the attribute adjustment operation to be executed again. If the distortion center attribute changes, trigger the distortion operation to be executed again. If the brightness parameter changes, trigger the attribute adjustment operation to be executed again. If the overlay mode changes, overlay the attribute adjustment content on the original multimedia content according to the adjusted overlay mode to obtain the target multimedia content.

[0074] The technical solution of the embodiments of the present disclosure obtains the original multimedia content and the target parameter, performs a distortion operation on the original multimedia content based on the target parameter to obtain a distorted content, then performs a scaling operation on the distorted content to obtain a special effect content, performs an attribute adjustment operation on the special effect content to obtain an attribute adjustment content, and overlays the attribute adjustment content on the original multimedia content to obtain the target multimedia content, realizing the generation of the target special effect material based on the original multimedia content, overlaying the target special effect material on the original multimedia content to obtain the target multimedia content with the target special effect added, enriching the content display effect, and improving the accuracy and processing efficiency of multimedia content processing.

[0075] Figure 3 FIG. is a schematic flowchart of another method for processing multimedia content provided by the embodiments of the present disclosure. On the basis of the above embodiments, the embodiments of the present disclosure additionally limit the step of moving the target special effect material. As Figure 3 shown, the method includes:

[0076] S310. Obtain the original multimedia content and the target parameter, where the target parameter includes a content adjustment parameter and an overlay mode, and the content adjustment parameter is used to trigger a distortion operation, a scaling operation, and an attribute adjustment operation.

[0077] Exemplarily, obtain the original multimedia content and target parameters input in the interaction interface, where the target parameters include at least one of the distortion center coordinates, visible range, distortion center attributes, brightness parameters, and overlay mode.

[0078] S320. Perform a distortion operation on the original multimedia content to obtain distorted content, perform a scaling operation on the distorted content to obtain special effect content, and perform an attribute adjustment operation on the special effect content to obtain attribute-adjusted content, where the special effect content includes target special effect materials.

[0079] S330. Overlay the attribute-adjusted content on the original multimedia content according to the overlay mode to obtain target multimedia content.

[0080] S340. In response to a movement operation on the target special effect material in the target multimedia content, determine a movement trajectory according to the distortion center coordinates corresponding to the target special effect material.

[0081] Among them, the movement operation can represent an interaction operation on the target object in the target multimedia content. For example, the movement operation can represent dragging the target special effect material along the boundary of the target object in the target multimedia content. Or, the movement operation can represent moving the target special effect material in the target multimedia content in a set direction. Optionally, the movement operation of the target special effect material can be achieved by adjusting the distortion center coordinates. The movement trajectory can be determined according to the distortion center coordinates during the movement of the target special effect material. If the movement operation is to drag the target special effect material along the boundary of the target object in the target multimedia content, the movement trajectory represents the boundary of the target object.

[0082] Exemplarily, in response to a movement operation on the target special effect material in the target multimedia content, obtain the distorted center coordinates after movement, and determine the movement trajectory according to the distorted center coordinates.

[0083] S350. Control the movement of the target special effect material in the target multimedia content according to the movement trajectory.

[0084] Exemplarily, for the case of performing distortion processing on the original multimedia content using the first distortion type, trigger the execution of the distortion operation, scaling operation, and attribute adjustment operation according to the distortion center coordinates on the movement trajectory. For the case of performing distortion processing on the original multimedia content using the second distortion type, trigger the execution of the scaling operation and attribute adjustment operation according to the distortion center coordinates on the movement trajectory.

[0085] Then, according to the overlay mode, the attribute adjustment content corresponding to the distortion center coordinates is overlaid on the original multimedia content to obtain the target multimedia content corresponding to the distortion center coordinates on the movement trajectory, and the target multimedia content is displayed in the interaction interface to present the effect of the target special effect material moving along the movement trajectory in the target multimedia content. For example, if the movement trajectory is the boundary of the target object, the target multimedia content presents the effect of light point tracing.

[0086] The technical solution of the embodiment of the present disclosure can enrich the display effect of the original multimedia content and improve the user interaction experience by adding a target special effect material to the original multimedia content, determining the movement trajectory according to the movement operation on the target special effect material, and controlling the movement of the target special effect material in the target multimedia content according to the movement trajectory.

[0087] Figure 4 FIG. is a schematic structural diagram of a processing device for multimedia content provided by an embodiment of the present disclosure. The device can be implemented in the form of software and / or hardware. Optionally, it is implemented by an electronic device, and the electronic device can be a mobile terminal, a PC or a server, etc.

[0088] As Figure 4 shown, the device includes: a content acquisition module 410, a content adjustment module 420, and a content overlay module 430.

[0089] The content acquisition module 410 is configured to acquire the original multimedia content and target parameters, where the target parameters include content adjustment parameters and an overlay mode, and the content adjustment parameters are used to trigger distortion operations, scaling operations, and attribute adjustment operations;

[0090] The content adjustment module 420 is configured to perform a distortion operation on the original multimedia content to obtain a distorted content, perform a scaling operation on the distorted content to obtain a special effect content, and perform an attribute adjustment operation on the special effect content to obtain an attribute adjustment content, where the special effect content includes a target special effect material;

[0091] The content overlay module 430 is configured to overlay the attribute adjustment content on the original multimedia content according to the overlay mode to obtain the target multimedia content.

[0092] Optionally, the content acquisition module 410 is specifically configured to:

[0093] Acquire the original multimedia content and target parameters input in the interaction interface, where the target parameters include at least one of distortion center coordinates, visible range, distortion center attributes, brightness parameters, and overlay mode.

[0094] Optionally, the device further includes:

[0095] A movement module, configured to, in response to a movement operation on a target special effect material in the target multimedia content, determine a movement trajectory according to the distortion center coordinates corresponding to the target special effect material; and control the movement of the target special effect material in the target multimedia content according to the movement trajectory.

[0096] Optionally, the content adjustment module 420 includes:

[0097] A type determination unit, configured to determine a distortion type according to the shape parameter in the distortion center attribute, where the distortion type includes a first distortion type and a second distortion type;

[0098] A first distortion unit, configured to, for the first distortion type, perform a distortion operation on the original multimedia content according to the distortion center coordinates to obtain a distorted content;

[0099] A second distortion unit, configured to, for the second distortion type, perform a distortion operation on the original multimedia content according to the angle parameter in the distortion center attribute to obtain a distorted content.

[0100] Further, the first distortion unit is specifically configured to:

[0101] For the first distortion type, determine a first distortion coefficient corresponding to the first pixel point according to the coordinates of the first pixel point of the original multimedia content and the distortion center coordinates;

[0102] Adjust the coordinates of the first pixel point according to the distortion center coordinates and the first distortion coefficient to obtain a distorted content.

[0103] Further, the second distortion unit is specifically configured to:

[0104] For the second distortion type, determine a reference line and a dividing line according to the angle parameter in the distortion center attribute;

[0105] Divide the original multimedia content into content blocks according to the dividing line, and determine a first distance between the coordinates of the second pixel point of the content block and the reference line;

[0106] Determine a second distortion coefficient corresponding to the second pixel point according to the first distance;

[0107] Adjust the coordinates of the second pixel point according to the second distortion coefficient to obtain a distorted content.

[0108] Optionally, the content adjustment module 420 further includes:

[0109] The special effect content generation unit is configured to determine, for a third pixel point in the distorted content, a second distance between the coordinates of the third pixel point and the coordinates of the distortion center; and adjust the coordinates of the third pixel point according to the second distance and the visible range to obtain the special effect content.

[0110] Optionally, the content adjustment module 420 further includes:

[0111] The brightness adjustment unit is configured to determine, for a fourth pixel point in the special effect content, a distance parameter according to a third distance between the coordinates of the fourth pixel point and the coordinates of the distortion center and the visible range; determine a brightness coefficient corresponding to the fourth pixel point according to the distance parameter, the visible range, and a brightness parameter, and adjust the brightness of the fourth pixel point according to the brightness coefficient to obtain the attribute adjustment content.

[0112] The multimedia content processing device provided by the embodiments of the present disclosure can execute the multimedia content processing method provided by any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution of the method.

[0113] It should be noted that the various units and modules included in the above device are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of the functional units are only for the convenience of mutual distinction and do not limit the protection scope of the embodiments of the present disclosure.

[0114] Figure 5 FIG. is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. Referring below to Figure 5 , which shows a schematic structural diagram of an electronic device 500 suitable for implementing the embodiments of the present disclosure (such as Figure 5 the terminal device or server in). The terminal device in the embodiments of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablet Computers), PMPs (Portable Multimedia Players), in-vehicle terminals (such as in-vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 5 The electronic device shown is only an example and should not impose any limitation on the functions and usage scope of the embodiments of the present disclosure.

[0115] As Figure 5As shown, the electronic device 500 may include a processing device (such as a central processing unit, a graphics processing unit, etc.) 501, which may perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the electronic device 500 are also stored. The processing device 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. An editing / output (I / O) interface 505 is also connected to the bus 504.

[0116] Generally, the following devices may be connected to the I / O interface 505: an input device 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 508 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 509. The communication device 509 may allow the electronic device 500 to communicate with other devices wirelessly or wiredly to exchange data. Although Figure 5 an electronic device 500 with various devices is shown, it should be understood that it is not required to implement or have all the shown devices. More or fewer devices may be implemented or had alternatively.

[0117] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program codes for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication device 509, or installed from the storage device 508, or installed from the ROM 502. When the computer program is executed by the processing device 501, the above functions defined in the method of the embodiment of the present disclosure are executed.

[0118] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only for illustrative purposes and are not used to limit the scope of these messages or information.

[0119] The electronic device provided by the embodiment of the present disclosure and the method for processing multimedia content provided by the above embodiment belong to the same inventive concept. The technical details not described in detail in this embodiment may be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0120] The embodiment of the present disclosure provides a computer storage medium, on which a computer program is stored, and when the program is executed by a processor, the method for processing multimedia content provided by the above embodiment is implemented.

[0121] It should be noted that the above-mentioned computer-readable medium in the present disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program can be used by or in conjunction with an instruction execution system, apparatus, or device. In the present disclosure, the computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium, and the computer-readable signal medium can send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted by any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0122] In some embodiments, the client and the server can communicate using any currently known or future-developed network protocol such as HTTP (HyperText Transfer Protocol), and can be interconnected with digital data communication in any form or medium (e.g., a communication network). Examples of the communication network include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future-developed network.

[0123] The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist separately without being assembled into the electronic device.

[0124] The above-mentioned computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device is caused to:

[0125] Obtain the original multimedia content and target parameters, where the target parameters include content adjustment parameters and overlay modes, and the content adjustment parameters are used to trigger distortion operations, scaling operations, and attribute adjustment operations;

[0126] Perform a distortion operation on the original multimedia content to obtain distorted content, perform a scaling operation on the distorted content to obtain special effect content, and perform an attribute adjustment operation on the special effect content to obtain attribute-adjusted content, where the special effect content includes target special effect materials;

[0127] Overlay the attribute-adjusted content on the original multimedia content according to the overlay mode to obtain the target multimedia content.

[0128] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof. The above programming languages include, but are not limited to, object-oriented programming languages - such as Java, Smalltalk, C++, and also include conventional procedural programming languages - such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partially on the user's computer, execute as a stand-alone software package, execute partially on the user's computer and partially on a remote computer, or execute entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network - including a local area network (LAN) or a wide area network (WAN) - or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0129] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code that contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and / or flowchart, and the combinations of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or operations, or may be implemented by a combination of dedicated hardware and computer instructions.

[0130] The units involved in the embodiments of the present disclosure can be implemented in software or in hardware. In some cases, the names of the units do not constitute a limitation on the units themselves.

[0131] The functions described above herein can be performed, at least in part, by one or more hardware logic components. By way of example, and without limitation, the types of hardware logic components that can be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on a chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0132] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0133] The above description is only a preferred embodiment of the present disclosure and an illustration of the technical principles applied. Those skilled in the art should understand that the scope of the disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above technical features, and should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosure concept. For example, the technical solutions formed by mutually replacing the above features with the technical features (but not limited to) having similar functions disclosed in the present disclosure.

[0134] In addition, although the operations are depicted in a particular order, this should not be construed as requiring that the operations be performed in the particular order shown or in sequential order. In certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features described in the context of separate embodiments can also be implemented combinatorially in a single embodiment. Conversely, the various features described in the context of a single embodiment can also be implemented separately or in any suitable sub-combination in multiple embodiments.

[0135] Although the subject matter has been described in language specific to structural features and / or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. On the contrary, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A method for processing multimedia content, characterized in that, including: obtaining original multimedia content and target parameters, where the target parameters include content adjustment parameters and an overlay mode, and the content adjustment parameters are used to trigger distortion operations, scaling operations, and attribute adjustment operations; performing a distortion operation on the original multimedia content to obtain distorted content, performing a scaling operation on the distorted content to obtain special effect content, and performing an attribute adjustment operation on the special effect content to obtain attribute-adjusted content, where the special effect content includes target special effect materials; overlaying the attribute-adjusted content on the original multimedia content according to the overlay mode to obtain target multimedia content.

2. The method according to claim 1, characterized in that, The obtaining of the original multimedia content and target parameters includes: obtaining the original multimedia content and target parameters input in an interactive interface, where the target parameters include at least one of distortion center coordinates, a visible range, distortion center attributes, brightness parameters, and an overlay mode.

3. The method according to claim 2, wherein It further includes: responding to a movement operation on a target special effect material in the target multimedia content, and determining a movement trajectory according to the distortion center coordinates corresponding to the target special effect material; controlling the movement of the target special effect material in the target multimedia content according to the movement trajectory.

4. The method according to claim 2, wherein The performing of the distortion operation on the original multimedia content to obtain distorted content includes: determining a distortion type according to the shape parameter in the distortion center attributes, where the distortion type includes a first distortion type and a second distortion type; for the first distortion type, performing a distortion operation on the original multimedia content according to the distortion center coordinates to obtain distorted content; for the second distortion type, performing a distortion operation on the original multimedia content according to the angle parameter in the distortion center attributes to obtain distorted content.

5. The method according to claim 4, characterized in that, The for the first distortion type, performing a distortion operation on the original multimedia content according to the distortion center coordinates to obtain distorted content includes: for the first distortion type, determining a first distortion coefficient corresponding to a first pixel point according to the coordinates of the first pixel point of the original multimedia content and the distortion center coordinates; adjusting the coordinates of the first pixel point according to the distortion center coordinates and the first distortion coefficient to obtain distorted content.

6. The method according to claim 4, wherein The for the second distortion type, performing a distortion operation on the original multimedia content according to the angle parameter in the distortion center attributes to obtain distorted content includes: for the second distortion type, determining a reference line and a dividing line according to the angle parameter in the distortion center attributes; dividing the original multimedia content into content blocks according to the dividing line, and determining a first distance between the coordinates of a second pixel point of the content block and the reference line; determining a second distortion coefficient corresponding to the second pixel point according to the first distance; adjusting the coordinates of the second pixel point according to the second distortion coefficient to obtain distorted content.

7. The method according to claim 2, characterized in that The performing of the scaling operation on the distorted content to obtain special effect content includes: for a third pixel point in the distorted content, determining a second distance between the coordinates of the third pixel point and the distortion center coordinates; adjusting the coordinates of the third pixel point according to the second distance and the visible range to obtain special effect content.

8. The method according to claim 2, wherein Performing an attribute adjustment operation on the special effect content to obtain attribute adjustment content includes: For the fourth pixel point in the special effect content, determining a distance parameter according to the third distance between the coordinates of the fourth pixel point and the distortion center coordinates and the visual range; Determining a brightness coefficient corresponding to the fourth pixel point according to the distance parameter, the visual range, and the brightness parameter, and adjusting the brightness of the fourth pixel point according to the brightness coefficient to obtain the attribute adjustment content.

9. A processing device for multimedia content, characterized in that, Including: A content acquisition module, configured to acquire the original multimedia content and target parameters, where the target parameters include content adjustment parameters and an overlay mode, and the content adjustment parameters are used to trigger a distortion operation, a scaling operation, and an attribute adjustment operation; A content adjustment module, configured to perform a distortion operation on the original multimedia content to obtain distorted content, perform a scaling operation on the distorted content to obtain special effect content, and perform an attribute adjustment operation on the special effect content to obtain attribute adjustment content, where the special effect content includes target special effect materials; A content overlay module, configured to overlay the attribute adjustment content on the original multimedia content according to the overlay mode to obtain target multimedia content.

10. An electronic device, characterized in that, The electronic device includes: One or more processors; A storage device, configured to store one or more programs, When the one or more programs are executed by the one or more processors, enabling the one or more processors to implement the multimedia content processing method according to any one of claims 1-8.

11. A storage medium containing computer-executable instructions, characterized in that, The computer-executable instructions, when executed by a computer processor, are used to execute the multimedia content processing method according to any one of claims 1-8.

Images