Media processing method and device, equipment and medium

Abstract

The invention provides a media processing method and device, equipment and a medium. A specific embodiment of the method comprises the following steps: acquiring an original media; determining dissipation motion information of pixel points in the original media; generating a plurality of frames of target images based on the dissipation motion information and the original media; and based on the multiple frames of target images, generating a target dynamic medium, and enabling pixel points in the target dynamic medium to perform motion dissipation according to the dissipation motion information. According to the embodiment, the aim of adding the motion dissipation effect to the existing media is fulfilled, so that the target media can transmit more dynamic information, the vividness of media pictures is enhanced, the effect of media special effects is improved, the special effects of the media are richer, and the user experience is improved.

Description

TECHNICAL FIELD

[0001] Embodiments of the present disclosure relate to the technical field of media processing, and in particular, to a media processing method, apparatus, device and medium. BACKGROUND

[0002] With the continuous development and improvement of digital media technologies such as video, image and animation, the application of digital media has become more and more extensive. For example, digital media is widely used in advertising, film, art and new media fields. Media not only brings a lot of convenience to people, but also adds more interest to people's life. In order to make the media more vivid, people usually process the existing media through technical means to obtain more vivid and expressive media. At present, there is a need for a scheme for adding special effects to existing media. SUMMARY

[0003] Embodiments of the present disclosure describe a media processing method, apparatus, device and medium.

[0004] According to a first aspect, a media processing method is provided, the method comprising: obtaining an original media; determining dissipation motion information of a pixel point in the original media; generating a plurality of target images based on the dissipation motion information and the original media; and generating a target dynamic media based on the plurality of target images, so that the pixel points in the target dynamic media move and dissipate according to the dissipation motion information.

[0005] According to a second aspect, a media processing apparatus is provided, the apparatus comprising: an obtaining unit configured to obtain an original media; a determining unit configured to determine dissipation motion information of a pixel point in the original media; a first generating unit configured to generate a plurality of target images based on the dissipation motion information and the original media; and a second generating unit configured to generate a target dynamic media based on the plurality of target images, so that the pixel points in the target dynamic media move and dissipate according to the dissipation motion information.

[0006] According to a third aspect, a computer-readable storage medium is provided, which stores a computer program. When the computer program is executed in a computer, the computer executes the method of any one of the first aspect.

[0007] According to a fourth aspect, an electronic device is provided, comprising a memory and a processor, wherein the memory stores executable code, and the processor executes the executable code to implement the method of any one of the first aspect.

[0008] According to the media processing scheme provided by the embodiment of the present disclosure, the original media is obtained, the dissipation motion information of the pixel points in the original media is determined, the multi-frame target image is generated based on the dissipation motion information and the original media, and the target dynamic media is generated based on the multi-frame target image, so that the pixel points in the target dynamic media move and dissipate according to the dissipation motion information. Thus, the purpose of adding the motion dissipation effect to the existing media is achieved, the target media can convey more dynamic information, the liveliness of the media picture is enhanced, the effect of the media special effect is improved, the media special effect is more abundant, and the user experience is improved.

[0009] According to the embodiment, the offset direction information of the corresponding pixel points in the original media on the media plane is determined according to the direction indication image, so that the dissipation motion of the pixel points in the original media is more random, and the randomness effect of the dissipation motion of the pixel points is improved.

[0010] According to the embodiment, the direction indication image is divided into the horizontal offset direction indication image and the vertical offset direction indication image, and the offset direction information of the corresponding pixel points in the original media on the media plane is determined through the horizontal offset direction indication image and the vertical offset direction indication image, so that the randomness effect of the dissipation motion of the pixel points is further improved.

[0011] According to the embodiment, the pixel points in the original media move with the media plane in the space, so that the target dynamic media obtained after processing has more space motion effect, and the space effect of the dissipation motion of the pixel points is improved. BRIEF DESCRIPTION OF DRAWINGS

[0012] Figure 1 is a scene schematic diagram of media processing according to an example embodiment of the present disclosure;

[0013] Figure 2 is an example system architecture schematic diagram to which the embodiment of the present disclosure is applied;

[0014] Figure 3 is a flowchart of a media processing method according to an example embodiment of the present disclosure;

[0015] Figure 4 is another scene schematic diagram of media processing according to an example embodiment of the present disclosure;

[0016] Figure 5 is a block diagram of a media processing device according to an example embodiment of the present disclosure;

[0017] Figure 6 is a schematic block diagram of an electronic device provided by some embodiments of the present disclosure. DETAILED DESCRIPTION

[0018] It can be understood that, before using the technical solutions disclosed in the embodiments of the present disclosure, the type of personal information involved in the present disclosure, the use range, the use scenario, etc. should be informed to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations.

[0019] For example, in response to receiving an active request of a user, a prompt information is sent to the user to explicitly prompt the user that the operation requested to be performed will require obtaining and using personal information of the user. Thus, the user can voluntarily choose whether to provide personal information to the software or hardware such as an electronic device, an application program, a server or a storage medium, etc. performing the technical solutions of the present disclosure according to the prompt information.

[0020] As an optional but non-limiting implementation manner, in response to receiving an active request of a user, the manner of sending a prompt information to the user may, for example, be a pop-up window manner, in which the prompt information can be presented in a text manner. In addition, the pop-up window can also carry a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0021] It can be understood that the above notification and obtaining of user authorization process is only illustrative and does not limit the implementation manner of the present disclosure. Other manners meeting relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0022] The technical solutions provided by the present disclosure will be described in further detail below in combination with the drawings and embodiments. It can be understood that the specific embodiments described herein are only used to explain the related invention, but not to limit the invention. In addition, it should be noted that, for the convenience of description, only the parts related to the invention are shown in the drawings. It should be noted that, in the case of no conflict, the embodiments of the present disclosure and the features in the embodiments can be combined with each other.

[0023] With the continuous development and improvement of digital media technologies such as video, image, animation, etc., the application of digital media has become more and more extensive. For example, digital media is widely used in advertising, film, art and new media fields, etc. Media not only brings many conveniences to people, but also adds more interest to people's life. In order to make the media more vivid, people usually perform special effect processing on the existing media through technical means, so as to obtain more vivid and expressive media. For example, dynamic special effects can be added to the existing media.

[0024] At present, dynamic blur, trailing or gradient transition can be simulated to make the media elements have "motion" or "flow", so as to add dynamic gradient effect to the existing image or video to obtain dynamic gradient special effect media. However, people also hope to obtain more and richer dynamic special effects.

[0025] The media processing scheme provided by the present disclosure includes: obtaining an original media, determining dissipation motion information of a pixel point in the original media, generating a plurality of target images based on the dissipation motion information and the original media, and generating a target dynamic media based on the plurality of target images, so that the pixel points in the target dynamic media move according to the dissipation motion information. Thus, the purpose of adding motion dissipation effect to the existing media is achieved, the target media can convey more dynamic information, the liveliness of the media picture is enhanced, the effect of the media special effect is improved, the media special effect is more abundant, and the user experience is improved.

[0026] Referring to Figure 1 , a scene diagram of media processing according to an exemplary embodiment is shown.

[0027] As Figure 1 shown, the specific application scenario of the present embodiment can be that a terminal device held by a user is installed with a media processing client. First, the user can input an image 104 as an original media to the media processing client through the terminal device. In addition, the user can also select a noise image 101, a noise image 102 and a noise image 103 through the media processing client. The media processing client can first determine the horizontal motion direction information of the pixel points in the original media on the media plane based on the noise image 101. Based on the noise image 102, the vertical motion direction information of the pixel points in the original media on the media plane is determined. Based on the noise image 103, the motion starting time of the pixel points in the original media on the media plane is determined.

[0028] Then, the disappearance time of the pixel points in the original media on the media plane can be determined according to the motion starting time of the pixel points in the original media on the media plane and the fixed motion time. According to the preset motion speed parameter, the motion trajectory of the pixel points in the original media on the media plane is calculated. According to the motion trajectory of the pixel points in the original media on the media plane, the dissipation motion information of the pixel points in the original media on the media plane is obtained.

[0029] Finally, the pixel values of the pixel points in the original media can be sampled according to the dissipation motion information of the pixel points in the original media on the media plane to generate an image sequence including a plurality of target images 105. Based on the image sequence, a target dynamic media can be generated, and the pixel points in the target dynamic media move according to the dissipation motion information.

[0030] It should be noted that, in Figure 1In the embodiments, the media processing client directly performs the media processing is taken as an example for description, in other embodiments, the media processing client can also transmit the noise image 101, the noise image 102, the noise image 103 and the image 104 to the media processing server deployed in the service platform through the network, the media processing server generates the multiple frames of target images based on the noise image 101, the noise image 102, the noise image 103 and the image 104, generates the target dynamic media based on the multiple frames of target images, and transmits the target dynamic media to the media processing client through the network, so as to provide the target dynamic media to the user, for details, refer to Figure 2 Embodiments.

[0031] Figure 2 An exemplary system architecture diagram for applying the embodiments of the present disclosure is shown.

[0032] As shown in Figure 2 , the system architecture 200 can include a terminal device 202, a network 203 and a server 204. It should be understood that Figure 2 the number or type of terminal devices, networks and servers in the above is only exemplary. According to actual needs, there can be any number or type of terminal devices, networks and servers.

[0033] The network 203 is used to provide a communication link medium between the terminal device, the server. The network 203 can include various connection types, such as wired, wireless communication link or optical fiber cable, etc.

[0034] The media processing client is installed in the terminal device 202, and the terminal device 202 can interact with the server through the network 203 to receive or send requests or information, etc. The terminal device 202 can be various electronic devices, including but not limited to smart phones, tablet computers, laptop computers, desktop computers and smart wearable devices, etc.

[0035] The media processing server is deployed in the server 204, and the server 204 can store, analyze and process the received data, and can also send control commands or requests to the terminal device or other servers. The server can provide media processing services in response to the service request of the user. It can be understood that one server can provide one or more services, and the same service can also be provided by multiple servers.

[0036] Based on Figure 2In the system architecture shown, in the embodiments of the present disclosure, a user 201 can input instruction information for media processing through a terminal device 202. The instruction information can include, but is not limited to, multiple frames of noise images and original media images, etc. The terminal device 202 can transmit the instruction information to a server 204 through a network 203. After receiving the instruction information, the server 204 can generate a target dynamic media with pixel points having a dissipating motion effect based on the instruction information. Finally, the server 204 can return the target dynamic media to the terminal device 202 through the network 203, so that the user 201 can view and save the target dynamic media through the terminal device 202.

[0037] The present disclosure will be described in detail below with reference to specific embodiments.

[0038] Figure 3 A flowchart of a media processing method according to an exemplary embodiment is shown. The method can be applied in a media processing client or a media processing server. In the embodiment, the media processing client is installed in a terminal device, which can include, but is not limited to, a mobile terminal device such as a smart phone, a smart wearable device, a tablet computer, a notebook computer, a desktop computer, etc. The media processing server is deployed in a service platform, which can be implemented as any device, server or device cluster with computing and processing capabilities. The method can include the following steps:

[0039] As shown in Figure 3 In step 301, an original media is obtained.

[0040] In the embodiment, the original media is a media to be processed. The original media can be a static media (for example, an image, etc.) or a dynamic media (for example, a short video, an animated image, etc.). The original media can be a media selected by a user from a local album, a media selected by a user from a cloud album, or a media instantly taken by a user through a shooting device of a terminal device. It can be understood that the embodiment is not limited to the specific type and specific acquisition method of the original media.

[0041] In step 302, dissipating motion information of a pixel point in the original media is determined.

[0042] In the embodiment, the dissipating motion information of each pixel point in the original media can be determined in units of pixel points in the original media. The dissipating motion of a pixel point can include at least random dissipating motion. The dissipating motion information of a pixel point can include a starting motion time, a disappearing time of the pixel point, and a motion trajectory of the pixel point on a media plane.

[0043] Specifically, the media processing client can first determine the offset direction information of the pixel points in the original media on the media plane, and determine the start time of the motion of the pixel points in the original media on the media plane. Then, based on the start time of the motion, the disappearance time of the motion of the pixel points in the original media on the media plane is determined, and based on the offset direction information, the start time and the disappearance time, the dissipation motion information of the pixel points in the original media is determined.

[0044] In an implementation manner, a plurality of pixel point dissipation motion information can be pre-set by a developer, and a plurality of candidate reference templates corresponding to the plurality of pixel point dissipation motion information can be generated according to the pre-set plurality of pixel point dissipation motion information. A user can select a target reference template from the candidate reference templates through an interface provided by the media processing client. Then, the dissipation motion information of the pixel points in the original media is determined according to the target reference template.

[0045] In another implementation manner, a plurality of different indication images can also be selected or input by the user, and the offset direction information of the pixel points in the original media on the media plane, the start time of the motion, the disappearance time of the motion, and the dissipation motion information of the pixel points in the original media can be determined based on the different indication images.

[0046] Specifically, first, the offset direction information of the pixel points in the original media on the media plane can be determined. For example, a direction indication image can be obtained, and the pixel values of the pixel points in the direction indication image can be obtained. Then, a pre-set first correspondence rule including the correspondence between the pixel values and the offset directions is obtained. According to the first correspondence rule, the offset direction information of the corresponding pixel points in the original media on the media plane is determined by using the pixel values of the pixel points in the direction indication image. The direction indication image and the original media have the same resolution, and can be a noise image or a designated image with simple picture content. It can be understood that the specific content of the direction indication image is not limited in this embodiment.

[0047] In some embodiments, the offset direction of the pixel points on the media plane can be pre-divided into n directions, so that each offset direction corresponds to a range of pixel values. The correspondence between the offset direction and the pixel value is recorded in the first correspondence rule. When determining the offset direction information of the pixel points in the original media on the media plane, a direction indication image can be obtained, which can include one frame of image. The offset direction information of the corresponding pixel points in the original media on the media plane can be determined according to the pixel values of the pixel points in the one frame of direction indication image and the first correspondence rule.

[0048] For example, the offset direction of a pixel on the media plane can be divided into direction 1, direction 2, …, and direction n, where direction 1 corresponds to a pixel value less than a1, direction 2 corresponds to a pixel value greater than or equal to a1 and less than a2, and direction n corresponds to a pixel value greater than or equal to an. The correspondence between the pixel value and the offset direction is recorded in a preset correspondence rule. When determining the offset direction information of a pixel in the original media on the media plane, a frame of direction indication image can be obtained, and the pixel value of each pixel in the direction indication image can be obtained. Then, according to the pixel value of each pixel in the direction indication image and the preset correspondence rule, the offset direction information of the corresponding pixel in the original media on the media plane is determined. For example, the pixel value of the pixel with the position coordinate (x1, y1) in the direction indication image is less than a1, and based on the preset correspondence rule, it is known that the pixel value less than a1 corresponds to direction 1. Therefore, the offset direction of the pixel with the position coordinate (x1, y1) in the original media on the media plane is direction 1. The pixel value of the pixel with the position coordinate (x2, y2) in the direction indication image is greater than or equal to an, and based on the preset correspondence rule, it is known that the pixel value greater than or equal to an corresponds to direction n. Therefore, the offset direction of the pixel with the position coordinate (x2, y2) in the original media on the media plane is direction n.

[0049] According to the embodiment, the offset direction information of the corresponding pixel in the original media on the media plane is determined according to the direction indication image, so that the dispersion movement of the pixel in the original media is more random, and the randomness effect of the dispersion movement of the pixel is improved.

[0050] In some other embodiments, the direction indication image can also be divided into a horizontal offset direction indication image and a vertical offset direction indication image. The horizontal offset direction indication image is used to indicate the horizontal offset movement direction information of the pixel in the original media on the media plane, and the vertical offset direction indication image is used to indicate the vertical offset movement direction information of the pixel in the original media on the media plane. The horizontal offset direction can be divided into left, stationary, and right, so that each horizontal offset direction corresponds to a range of pixel values. The vertical offset direction can also be divided into up, stationary, and down, so that each vertical offset direction also corresponds to a range of pixel values. The correspondence between the horizontal offset direction and the pixel value, and the correspondence between the vertical offset direction and the pixel value, are recorded in a first correspondence rule. When determining the offset direction information of a pixel in the original media on the media plane, the horizontal offset direction indication image and the vertical offset direction indication image can be obtained respectively, and the horizontal offset direction information of the corresponding pixel in the original media on the media plane can be determined according to the pixel value of the pixel in the horizontal offset direction indication image. The vertical offset direction information of the corresponding pixel in the original media on the media plane can be determined according to the pixel value of the pixel in the vertical offset direction indication image.

[0051] For example, the lateral offset direction of the pixel point on the media plane includes left, no movement, right, which can make the direction "left" correspond to the pixel value less than or equal to a, the direction "right" correspond to the pixel value greater than or equal to b, and the direction "no movement" correspond to the pixel value greater than a and less than b. The vertical offset direction of the pixel point on the media plane includes up, no movement, down, which can make the direction "up" correspond to the pixel value less than or equal to a, the direction "down" correspond to the pixel value greater than or equal to b, and the direction "no movement" correspond to the pixel value greater than a and less than b. The correspondence between the pixel value and the lateral offset direction and the vertical offset direction is recorded in the preset correspondence rule.

[0052] In the determination of the offset direction information of the pixel point in the original media on the media plane, the lateral offset direction indication image and the vertical offset direction indication image can be obtained respectively, and the pixel value of each pixel point in the lateral offset direction indication image and the vertical offset direction indication image can be obtained respectively. Then, according to the pixel value and the preset correspondence rule, the offset direction information of the corresponding pixel point in the original media on the media plane is determined. For example, the pixel value of the pixel point with the position coordinates (x1, y1) in the lateral direction indication image is less than or equal to a, and based on the preset correspondence rule, the pixel value less than or equal to a corresponds to left. Therefore, the lateral offset direction of the pixel point with the position coordinates (x1, y1) in the original media on the media plane is left. The pixel value of the pixel point with the position coordinates (x2, y2) in the vertical direction indication image is greater than or equal to b, and based on the preset correspondence rule, the pixel value greater than or equal to b corresponds to down. Therefore, the vertical offset direction of the pixel point with the position coordinates (x2, y2) in the original media on the media plane is down.

[0053] Since the direction indication image is divided into the lateral offset direction indication image and the vertical offset direction indication image in the embodiment, the offset direction information of the corresponding pixel point in the original media on the media plane is determined through the lateral offset direction indication image and the vertical offset direction indication image, which further improves the randomness effect of the dissipation movement of the pixel point.

[0054] Then, while determining the direction information of the pixel point in the original media offset on the media plane, the starting time of the pixel point in the original media moving on the media plane can also be determined. Specifically, a time indication image can be acquired, and the pixel value of the pixel point in the time indication image can be acquired. The time indication image has the same resolution as the original media, and can be a noise image or a designated image with simple picture content. It can be understood that the embodiment does not limit the specific content of the time indication image. The correspondence between the pixel value and the starting time can be pre-set, so that the pixel value is positively correlated with the starting time (i.e., the larger the pixel value, the later the starting time of the movement), or negatively correlated (i.e., the larger the pixel value, the earlier the starting time of the movement), and the correspondence between the pixel value and the starting time is recorded in the second correspondence rule. When determining the starting time of the pixel point in the original media moving on the media plane, the pre-set second correspondence rule can be acquired, and the starting time of the pixel point in the original media moving on the media plane can be determined according to the second correspondence rule and the pixel value of the pixel point in the time indication image.

[0055] For example, it can be pre-set that the starting time of the pixel point moving on the media plane and the pixel value of the pixel point in the time indication image satisfy a designated function relationship, and the designated function relationship between the pixel value and the starting time of the movement is recorded in the pre-set correspondence rule. When determining the starting time of the pixel point in the original media moving on the media plane, the time indication image can be acquired, and the pixel value of each pixel point in the time indication image can be acquired. Then, according to the pixel value of each pixel point in the time indication image and the pre-set correspondence rule, the starting time of the corresponding pixel point in the original media moving on the media plane can be calculated.

[0056] For example, the pixel value of the pixel point with position coordinates (x1, y1) in the time indication image is c, and according to the pre-set correspondence rule, it can be known that the pixel value c corresponds to the starting time t1. Therefore, the starting time of the pixel point with position coordinates (x1, y1) in the original media moving on the media plane is t1. The pixel value of the pixel point with position coordinates (x2, y2) in the direction indication image is d, and according to the pre-set correspondence rule, it can be known that the pixel value d corresponds to the starting time t2 of the movement. Therefore, the starting time of the pixel point with position coordinates (x2, y2) in the original media moving on the media plane is t2.

[0057] Then, after determining the starting time of the pixel point in the original media moving on the media plane, the disappearance time of the pixel point in the original media moving on the media plane can be further determined based on the starting time of the movement. For example, a fixed movement time length L can be pre-set, and for any pixel point, the disappearance time of the pixel point moving on the media plane can be obtained by adding the fixed movement time length L to the starting time of the movement of the pixel point.

[0058] Finally, the dissipation motion information of the pixel points in the original media can be determined based on the information of the offset direction, the starting time and the disappearing time. In one implementation, the pixel points in the original media can be made to perform the dissipation motion on the media plane, a preset motion speed parameter can be acquired, and the motion trajectory of the pixel points in the original media on the media plane can be directly determined as the dissipation motion information of the pixel points in the original media according to the information of the offset direction of the pixel points in the original media on the media plane, the preset motion speed parameter and the starting time and the disappearing time.

[0059] In another implementation, the pixel points in the original media can also be made to perform the dissipation motion with the media plane in the space. Specifically, the motion trajectory of the pixel points in the original media on the media plane can be determined based on the information of the offset direction, the starting time and the disappearing time. The motion trajectory of the media plane in the space can be acquired, for example, as shown in FIG. 4B, the image 401 is the original image, and the plane of the image 401 is made to move in the space to obtain the image 402. The motion trajectory of the pixel points in the original media on the media plane can be mapped to the space based on the motion trajectory of the media plane in the space to obtain the dissipation motion information. Since the pixel points in the original media move with the media plane in the space in the embodiment, the target dynamic media obtained after processing has a more spatial motion effect, and the spatial effect of the dissipation motion of the pixel points is improved. Figure 4

[0060] Further, the dissipation motion of the pixel points in the original media can further include a non-random designated motion in addition to the random dissipation motion. The designated motion can include but is not limited to the overall motion of the pixel points in the original media (for example, the overall motion of the pixel points in the original media according to a designated trajectory) and / or the deformation motion of the pixel points in the original media (for example, the overall deformation motion of the pixel points in the original media according to a designated manner) and the like. Specifically, designated motion information for the pixel points in the original media can be acquired, the designated motion information being used to indicate the designated motion manner of the pixel points in the original media, and the dissipation motion information of the pixel points in the original media is adjusted according to the designated motion information. Since the pixel points are also added with the non-random designated motion in the embodiment, the overall motion effect of the pixel points is increased.

[0061] In step 303, a plurality of target images are generated based on the dissipation motion information and the original media, and in step 304, a target dynamic media is generated based on the plurality of target images, so that the pixel points in the target dynamic media move and dissipate according to the dissipation motion information.

[0062] ​In the embodiment, the multiple target images can be generated based on the dissipation motion information and the original media. Specifically, first, a sampling image can be obtained based on the original media. In one implementation, the original media can be an image, and the image can be taken as the sampling image. In another implementation, the original media can be a video or an animation, and multiple images included in the video or the animation can be taken as the sampling image.

[0063] Then, the pixel values of the pixels in the sampling image are sampled based on the dissipation motion information of the pixels in the original media, and the multiple target images are generated based on the sampled pixel values. For example, the dissipation motion information of a pixel P1 located at (x3, y3) in the original media indicates that the pixel P1 currently moves to (x4, y4). The pixel value of the pixel located at (x3, y3) in the sampling image can be obtained and mapped to the pixel located at (x4, y4) in the new image. For another example, the dissipation motion information of a pixel P2 located at (x5, y5) in the original media indicates that the pixel P2 currently moves to (x6, y6). The pixel value of the pixel located at (x5, y5) in the sampling image can be obtained and mapped to the pixel located at (x6, y6) in the new image, so as to obtain a target image.

[0064] The media processing method provided by the present disclosure includes the following steps: obtaining an original media, determining dissipation motion information of pixels in the original media, generating multiple target images based on the dissipation motion information and the original media, and generating a target dynamic media based on the multiple target images, so that the pixels in the target dynamic media move according to the dissipation motion information. Thus, the purpose of adding the motion dissipation effect to the existing media is achieved, the target media can convey more dynamic information, the liveliness of the media picture is enhanced, the effect of the media special effect is improved, the media special effect is more abundant, and the user experience is improved.

[0065] It should be noted that although the operations of the method of the embodiments of the present disclosure are described in a specific order in the above embodiments, this does not require or imply that the operations must be performed in this specific order, or that all of the shown operations must be performed to achieve the desired result. On the contrary, the steps depicted in the flowcharts can change the order of execution. Additionally or alternatively, some steps can be omitted, multiple steps can be combined into one step, and / or one step can be divided into multiple steps.

[0066] Corresponding to the foregoing media processing method embodiments, the present disclosure also provides embodiments of media processing devices.

[0067] As Figure 5 shown, Figure 5is a block diagram of a media processing apparatus according to an exemplary embodiment of the present disclosure, which can include an acquisition unit 501, a determination unit 502, a first generation unit 503 and a second generation unit 504.

[0068] The acquisition unit 501 is configured to acquire an original media.

[0069] The determination unit 502 is configured to determine dissipation motion information of a pixel point in the original media.

[0070] The first generation unit 503 is configured to generate a plurality of target images based on the dissipation motion information and the original media.

[0071] The second generation unit 504 is configured to generate a target dynamic media based on the plurality of target images, so that the pixel points in the target dynamic media move according to the dissipation motion information.

[0072] In some embodiments, the determination unit 502 is configured to determine information of a shift direction of the pixel point in the original media on a media plane, determine a motion start time of the pixel point in the original media on the media plane, determine a disappearance time of the pixel point in the original media on the media plane based on the motion start time, and determine the dissipation motion information of the pixel point in the original media based on the information of the shift direction, the motion start time and the disappearance time.

[0073] In some other embodiments, the determination unit 502 can determine the information of the shift direction of the pixel point in the original media on the media plane by the following manner: acquiring a direction indicating image, acquiring a pixel value of a pixel point in the direction indicating image, acquiring a preset first corresponding rule, and the first corresponding rule includes a corresponding relationship between the pixel value and the shift direction. According to the first corresponding rule, the pixel value of the pixel point in the direction indicating image is used to determine the information of the shift direction of the corresponding pixel point in the original media on the media plane.

[0074] In some other embodiments, the direction indicating image includes a horizontal shift direction indicating image and a vertical shift direction indicating image, the horizontal shift direction indicating image is used to indicate horizontal motion direction information of the pixel point on the media plane, and the vertical shift direction indicating image is used to indicate vertical motion direction information of the pixel point on the media plane.

[0075] In some embodiments, the determining unit 502 can determine the motion start time of the pixel point in the original media on the media plane by: obtaining a time indication image, obtaining a pixel value of the pixel point in the time indication image, obtaining a preset second correspondence rule, the second correspondence rule comprising a correspondence between the pixel value and the motion start time, and determining the motion start time of the pixel point in the original media on the media plane according to the second correspondence rule and the pixel value of the pixel point in the time indication image.

[0076] In some embodiments, the determining unit 502 can determine the dissipation motion information of the pixel point in the original media based on the information of the offset direction, the motion start time and the disappearance time by: determining the motion trajectory of the pixel point in the original media on the media plane based on the information of the offset direction, the motion start time and the disappearance time, obtaining a spatial motion trajectory of the media plane in space, and mapping the motion trajectory of the pixel point in the original media on the media plane to space based on the spatial motion trajectory of the media plane in space to obtain the dissipation motion information.

[0077] In some embodiments, the first generating unit 503 is configured to: obtain a sampling image for sampling based on the original media, sample the pixel value of the pixel point from the sampling image based on the dissipation motion information, and generate the plurality of target images based on the sampled pixel value.

[0078] For the apparatus embodiment, since it basically corresponds to the method embodiment, the relevant part is described in the part of the method embodiment. The apparatus embodiment described above is only illustrative, wherein the units described as separate components can or can not be physically separated, and the components displayed as units can or can not be physical units, i.e., they can be located in one place or distributed on multiple network units. According to actual needs, some or all of the modules can be selected to achieve the purpose of the embodiment of the present disclosure. Those skilled in the art can understand and implement it without creative labor.

[0079] The following refers to Figure 6 , Figure 6A schematic block diagram of an electronic device is provided for some embodiments of the present disclosure. The electronic device 920 is suitable for implementing the media processing method provided by the embodiments of the present disclosure, for example. The electronic device 920 can be a terminal device or the like, and can be used to implement a client or a server. The electronic device 920 can include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet Personal Computer), a PMP (Portable Multimedia Player), a vehicle terminal (e.g., a car navigation terminal), a wearable electronic device, and the like, as well as a stationary terminal such as a digital TV, a desktop computer, a smart home device, and the like. It should be noted that, Figure 6 The electronic device 920 shown is merely an example, which does not impose any limitation on the functions and use range of the embodiments of the present disclosure.

[0080] As shown in FIG. 9, Figure 6 The electronic device 920 can include a processing device (e.g., a central processing unit, a graphics processing unit, or the like) 921, which can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 922 or loaded from a storage device 928 into a random access memory (RAM) 923. Various programs and data required for the operation of the electronic device 920 are also stored in the RAM 923. The processing device 921, the ROM 922, and the RAM 923 are connected to each other through a bus 924. An input / output (I / O) interface 925 is also connected to the bus 924.

[0081] Generally, the following devices can be connected to the I / O interface 925: an input device 926 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, and the like; an output device 927 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, and the like; a storage device 928 including, for example, a magnetic tape, a hard disk, and the like; and a communication device 929. The communication device 929 can allow the electronic device 920 to communicate with other electronic devices wirelessly or by wire to exchange data. Although Figure 6 The electronic device 920 is shown with various devices, but it should be understood that it is not required to implement or have all of the devices shown, and the electronic device 920 can instead implement or have more or less devices. Figure 6 Each block shown in FIG. 9 can represent a device or multiple devices as needed.

[0082] According to an embodiment of the present disclosure, the media processing method described above can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product comprising a computer program carried on a non-transitory computer-readable medium, the computer program comprising program code for executing the media processing method described above. In such an embodiment, the computer program can be downloaded and installed from the network through the communication apparatus 929, or installed from the storage apparatus 928, or installed from the ROM 922. When the computer program is executed by the processing apparatus 921, the functions defined in the media processing method provided by an embodiment of the present disclosure can be implemented.

[0083] An embodiment of the present disclosure further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed in a computer, the computer program causes the computer to perform the method provided by the present disclosure.

[0084] It should be noted that the computer-readable medium in the embodiments of the present disclosure can be a computer-readable signal medium or a computer-readable storage medium or any combination of the two. The computer-readable storage medium may, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or apparatus, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In an embodiment of the present disclosure, the computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device or apparatus. In an embodiment of the present disclosure, the computer-readable signal medium can include a data signal carried in a baseband or as a part of a carrier wave, which carries computer-readable program code. Such a propagated data signal can take on many forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer-readable signal medium can also be any computer-readable medium that is not a storage medium and that can communicate, propagate or transport program for use by or in connection with an instruction execution system, device or apparatus. The program code contained in the computer-readable medium can be transmitted by any suitable medium, including but not limited to a wire, an optical fiber, an RF (Radio Frequency) or the like, or any suitable combination of the above.

[0085] Computer program code for carrying out operations of embodiments of the present disclosure can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0086] The various embodiments in the present disclosure are described in progressive manner, and the same or similar parts among the various embodiments can be referred to each other. Each embodiment focuses on the difference from other embodiments. In particular, the storage medium and computing device embodiments are described simply because they are substantially similar to the method embodiments, and the relevant parts can be referred to the description of the method embodiments.

[0087] Those skilled in the art will appreciate that the functions described in the above one or more examples can be implemented in hardware, software, firmware, or any combination thereof. When implemented in software, the functions can be stored on or transmitted over as one or more instructions or code on a computer-readable medium.

[0088] The above detailed description has disclosed the purpose, technical solutions and advantages of the embodiments of the present disclosure. It should be understood that the above description is only a specific implementation of the embodiments of the present disclosure, and is not intended to limit the protection scope of the present disclosure. Any modification, equivalent replacement, improvement, etc. made on the basis of the technical solutions of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. A media processing method, the method comprising: Obtain the original media; Determine the dissipation motion information of pixels in the original media; Based on the dissipated motion information and the original media, multiple frames of target images are generated; Based on the multi-frame target images, a target dynamic media is generated, and the pixels in the target dynamic media are motion-dissipated according to the dissipation motion information.

2. The method according to claim 1, wherein, Determining the dissipation motion information of pixels in the original media includes: Determine the information regarding the offset direction of pixels in the original media on the media plane; Determine the start time of the motion of pixels in the original media on the media plane; Based on the motion start time, determine the disappearance time of the pixels in the original media on the media plane; Based on the information of the offset direction, the motion start time, and the disappearance time, the dissipation motion information of the pixels in the original media is determined.

3. The method according to claim 2, wherein, The information used to determine the offset direction of pixels in the original media on the media plane includes: Acquire a direction indicator image, and acquire the pixel values ​​of the pixels in the direction indicator image; Obtain a preset first correspondence rule, which includes the correspondence between pixel values ​​and offset directions; Based on the first correspondence rule, the information of the offset direction of the corresponding pixel in the original media on the media plane is determined by using the pixel value of the pixel in the direction indicator image.

4. The method according to claim 3, wherein, The direction indication image includes a horizontal offset direction indication image and a vertical offset direction indication image; the horizontal offset direction indication image is used to indicate the horizontal movement direction information of the pixel on the media plane; the vertical offset direction indication image is used to indicate the vertical movement direction information of the pixel on the media plane.

5. The method according to claim 2, wherein, Determining the starting time of the motion of pixels in the original media on the media plane includes: Acquire a time indicator image, and acquire the pixel values ​​of the pixels in the time indicator image; Obtain a preset second correspondence rule, which includes the correspondence between pixel values ​​and the start time of motion; According to the second correspondence rule, the starting time of the motion of the pixels in the original media on the media plane is determined by using the pixel value of the pixel in the time indicator image.

6. The method according to claim 2, wherein, The determination of the dissipation motion information of pixels in the original media based on the information of the offset direction, the motion start time, and the disappearance time includes: Based on the information of the offset direction, the start time of the motion and the disappearance time, the motion trajectory of the pixel in the original media on the media plane is determined; Obtain the spatial motion trajectory of the media plane in space; Based on the spatial motion trajectory of the media plane in space, the motion trajectory of the pixels in the original media on the media plane is mapped into space to obtain the dissipated motion information.

7. The method according to claim 1, wherein, The step of generating multiple target images based on the dissipated motion information and the original media includes: Based on the original media, a sampled image for sampling is obtained; Based on the dissipated motion information, the pixel values ​​of the pixels are sampled from the sampled image; The multi-frame target image is generated based on the pixel values ​​obtained from the sampling.

8. A media processing apparatus, the apparatus comprising: The acquisition unit is configured to acquire the raw media. The determining unit is configured to determine the dissipation motion information of pixels in the original media; The first generation unit is configured to generate multiple frames of target images based on the dissipated motion information and the original media; The second generation unit is configured to generate target dynamic media based on the multi-frame target images, so that the pixels in the target dynamic media undergo motion dissipation according to the dissipation motion information.

9. A computer-readable storage medium having a computer program stored thereon, which, when executed in a computer, causes the computer to perform the method of any one of claims 1-7.

10. An electronic device comprising a memory and a processor, wherein the memory stores executable code, and the processor, when executing the executable code, implements the method of any one of claims 1-7.

Images