Video playback methods, devices, electronic devices and storage media

Abstract

This disclosure relates to a video playback method, apparatus, electronic device, and storage medium, including: acquiring a target video; dividing each video frame into multiple image blocks; for each particle element, acquiring description information corresponding to a preset image block containing each particle element; determining the associated content of the preset image block based on the first frame image information corresponding to the preset image block and the description information of the preset image block in its respective video frame set, wherein the first frame image information is the image content in the first video frame corresponding to the preset image block; and sending the associated content of the preset image block containing each particle element to a terminal, so that the terminal plays the target video based on the associated content of the preset image block containing each particle element. Thus, since the data volume of the associated content of the image block containing each particle element is relatively small, the size of the transmitted file can be significantly reduced, and the network bandwidth consumption can be significantly reduced when transmitting particle effect videos.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of computer, and more particularly, to a video playing method and device, an electronic device and a storage medium. BACKGROUND

[0002] Augmented Reality (AR) technology is a technology of skillfully fusing virtual information with the real world. In AR special effects, there are usually some particle special effects. A particle system is a technology for simulating certain fuzzy phenomena in three-dimensional computer graphics. The phenomena that can be simulated by the particle system include fire, smoke, snowflakes, meteor trails, and the like. In actual use, a particle dynamic effect can be superimposed on a video picture to achieve an abstract visual effect of simulating fuzzy phenomena in the real world.

[0003] In the related art, in order to reduce the volume of a particle dynamic effect video, a video compression technology is usually used to compress the particle dynamic effect video. However, the compression degree of the video compression technology is limited. The volume of the compressed particle dynamic effect video is still relatively large, which leads to a large amount of network bandwidth consumed when transmitting the particle dynamic effect video. SUMMARY

[0004] The present disclosure provides a video playing method and device, an electronic device and a storage medium to at least solve the problem of consuming a large amount of network bandwidth when transmitting a particle dynamic effect video in the related art.

[0005] According to a first aspect of an embodiment of the present disclosure, a video playing method is provided, including: obtaining a target video, wherein the target video contains a plurality of video frames arranged in sequence; dividing each video frame in the plurality of video frames into a plurality of image blocks, wherein each image block contains a particle element; for each particle element, obtaining description information corresponding to a preset image block containing the particle element, wherein the description information corresponding to each particle element is description information of the preset image block in a video frame set to which the preset image block belongs; determining associated content of the preset image block according to first frame image information corresponding to the preset image block and the description information of the preset image block in the video frame set to which the preset image block belongs, wherein the first frame image information is image content in a first video frame corresponding to the preset image block; and sending the associated content of the preset image block containing each particle element to a terminal, so that the terminal plays the target video based on the associated content of the preset image block containing each particle element.

[0006] Optionally, the acquiring, for each particle element, the description information corresponding to the preset image block containing the particle element comprises: sequentially taking each video frame as a target video frame in order from the last video frame to the first video frame in the plurality of video frames; for each target image block in the target video frame, screening a preset image block containing a particle element in the each target image block from a video frame before the target video frame; and acquiring the description information of the preset image block in the video frame set to which the preset image block belongs.

[0007] Optionally, the screening, for each target image block in the target video frame, a preset image block containing a particle element in the each target image block from a video frame before the target video frame comprises: determining a plurality of adjacent video frame groups contained in the plurality of video frames, wherein each adjacent video frame group contains a first video frame in order and a second video frame in order; and for each adjacent video frame group in the plurality of adjacent video frame groups, screening the preset image block from a plurality of image blocks contained in the first video frame based on an image block containing a particle element in the each target image block in the second video frame.

[0008] Optionally, the screening, for each adjacent video frame group in the plurality of adjacent video frame groups, the preset image block from the plurality of image blocks contained in the first video frame based on the image block containing the particle element in the each target image block in the second video frame comprises: for each adjacent video frame group in the plurality of adjacent video frame groups, calculating a feature similarity between a first image block and a second image block, wherein the first image block is a plurality of image blocks contained in the first video frame, and the second image block is the image block containing the particle element in the each target image block in the second video frame; and determining, as the preset image block, an image block in the first video frame having a feature similarity greater than or equal to a preset threshold.

[0009] Optionally, the method further comprises: removing a background image contained in each image block in a plurality of image blocks contained in each video frame in the plurality of video frames, wherein the background image contained in each image block is an image in the each image block other than the particle element; and the acquiring, for each particle element, the description information corresponding to the preset image block containing the particle element comprises: acquiring, for each particle element, the description information corresponding to the preset image block containing the particle element and from which the background image is removed.

[0010] Optionally, the description information comprises at least one of the following: a position, a size, a spatial pose, a transparency, a hue, and a saturation of the image block in the corresponding video frame.

[0011] Optionally, the spatial pose of the image block on a first video frame in the video frame set to which the image block belongs is a reference spatial pose, and the spatial pose of the image block on other video frames in the video frame set to which the image block belongs, other than the first video frame, is a rotated pose relative to the reference spatial pose.

[0012] Optionally, the feature similarity is a corner feature similarity or an RGB distribution feature similarity of pixels.

[0013] According to a second aspect of the embodiments of the present disclosure, a video playing method is provided, including: receiving associated content of a preset image block containing each particle element sent by a server, wherein the preset image block is an image block in a plurality of image blocks obtained by the server by dividing each video frame in a plurality of video frames sequentially arranged in a target video, and each image block contains one particle element; the associated content of the preset image block containing each particle element includes: image content of the preset image block containing each particle element in a first video frame in a video frame set to which the preset image block belongs, and description information of the preset image block containing each particle element in the video frame set to which the preset image block belongs; and playing the target video based on the associated content of the preset image block containing each particle element.

[0014] Optionally, the playing of the target video based on the associated content of the preset image block containing each particle element includes: creating a blank picture for each video frame in the plurality of video frames; for each image block of the each video frame, copying image content of an image block containing a particle element in the each image block in a first video frame in a video frame set to which the image block belongs into the blank picture according to description information of the each image block in the each video frame, to obtain a particle picture corresponding to the each video frame; and playing a plurality of particle pictures corresponding to the plurality of video frames.

[0015] According to a third aspect of the embodiments of the present disclosure, a video playing device is provided, comprising: a video obtaining module configured to obtain a target video, wherein the target video comprises a plurality of video frames arranged in sequence; a dividing module configured to divide each video frame in the plurality of video frames into a plurality of image blocks, wherein each image block comprises a particle element; a description information obtaining module configured to, for each particle element, obtain description information corresponding to a preset image block comprising the particle element, wherein the description information corresponding to each particle element is description information of the preset image block in a video frame set to which the preset image block belongs; a related content determining module configured to determine a related content of the preset image block according to first frame image information corresponding to the preset image block and the description information of the preset image block in the video frame set to which the preset image block belongs, wherein the first frame image information is image content in a first video frame corresponding to the preset image block; and a sending module configured to send the related content of the preset image block comprising each particle element to a terminal, so that the terminal plays the target video based on the related content of the preset image block comprising each particle element.

[0016] Optionally, the description information obtaining module is configured to: sequentially take each video frame as a target video frame in an order from a last video frame to a first video frame in the plurality of video frames; for each target image block in the target video frame, screen a preset image block comprising a particle element in the each target image block from a video frame located before the target video frame; and obtain description information of the preset image block in a video frame set to which the preset image block belongs.

[0017] Optionally, the description information obtaining module is configured to: determine a plurality of adjacent video frame groups comprised by the plurality of video frames, wherein each adjacent video frame group comprises a first video frame arranged in an earlier order and a second video frame arranged in a later order; and for each adjacent video frame group in the plurality of adjacent video frame groups, screen the preset image block from a plurality of image blocks comprised by the first video frame based on an image block comprising a particle element in the each target image block in the second video frame.

[0018] Optionally, the description information obtaining module is configured to: for each adjacent video frame group in the plurality of adjacent video frame groups, calculate a feature similarity between a first image block and a second image block, wherein the first image block is a plurality of image blocks comprised by the first video frame, and the second image block is an image block comprising a particle element in the each target image block in the second video frame; and determine, as the preset image block, an image block in the first video frame having a feature similarity greater than or equal to a preset threshold.

[0019] Optionally, the video playing apparatus further comprises a removing module configured to remove background images contained in each image block from the plurality of image blocks contained in each video frame from the plurality of video frames, wherein the background images contained in each image block are images other than the particle elements in the each image block; and the description information obtaining module is configured to obtain, for each particle element, description information corresponding to a preset image block containing the each particle element and from which the background images are removed.

[0020] Optionally, the description information comprises at least one of the following: transparency, hue, and saturation of the image block in the corresponding video frame.

[0021] Optionally, the spatial pose of the image block on a first video frame from the video frame set to which the image block belongs is a reference spatial pose, and the spatial pose of the image block on a video frame other than the first video frame from the video frame set to which the image block belongs is a rotation pose relative to the reference spatial pose.

[0022] Optionally, the feature similarity is a corner feature similarity or a pixel RGB distribution feature similarity.

[0023] According to a fourth aspect of the embodiments of the present disclosure, a video playing apparatus is provided, comprising: a receiving module configured to receive, from a server, associated content of a preset image block containing each particle element, wherein the preset image block is an image block from a plurality of image blocks obtained by the server from division of each video frame from a plurality of video frames arranged in sequence and contained in a target video, and each image block contains one particle element; the associated content of the preset image block containing each particle element comprises: image content of the preset image block containing the each particle element in a first video frame from a video frame set to which the preset image block belongs, and description information of the preset image block containing the each particle element in the video frame set to which the preset image block belongs; and a playing module configured to play the target video based on the associated content of the preset image block containing each particle element.

[0024] Optionally, the playing module is configured to: create a blank picture for each video frame from the plurality of video frames; and for each image block of the each video frame, copy, into the blank picture, image content of the image block containing the particle element in the each image block in a first video frame from a video frame set to which the image block belongs, according to description information of the each image block in the each video frame, to obtain a particle picture corresponding to the each video frame; and play a plurality of particle pictures corresponding to the plurality of video frames.

[0025] According to a fifth aspect of the embodiments of the present disclosure, an electronic device is provided, comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to implement the video playing method according to the present disclosure.

[0026] According to a sixth aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, when instructions in the computer readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the video playing method according to the present disclosure.

[0027] According to a seventh aspect of the embodiments of the present disclosure, a computer program product is provided, comprising a computer program, when the computer program is executed by a processor, the video playing method according to the present disclosure is implemented.

[0028] The technical solutions provided by the embodiments of the present disclosure at least bring the following beneficial effects:

[0029] The video playing method, device, electronic device and storage medium provided by the present disclosure can dynamically track the particle elements in the particle special effect video, and when the particle special effect video is delivered to the terminal, only the associated content of the image block containing each particle element can be delivered. Since the data amount of the associated content of the image block containing each particle element is small, the size of the transmission file can be significantly reduced. Compared with the way of sending the complete particle special effect video to the terminal, the present disclosure can significantly reduce the occupation of network bandwidth when transmitting the particle special effect video, and can greatly save the network bandwidth cost.

[0030] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0031] The accompanying drawings incorporated in the specification and forming a part of it, illustrate embodiments consistent with the present disclosure, and together with the description, serve to explain the principles of the present disclosure, and do not limit the present disclosure.

[0032] Figure 1 is a flow chart showing a video playing method according to an exemplary embodiment of the present disclosure;

[0033] Figure 2 is a schematic diagram showing that a particle special effect video contains multiple particle special effects according to an exemplary embodiment of the present disclosure;

[0034] Figure 3 is a flow chart showing another video playing method according to an exemplary embodiment of the present disclosure;

[0035] Figure 4is a block diagram illustrating a video playing apparatus according to an exemplary embodiment of the present disclosure;

[0036] Figure 5 is a block diagram illustrating another video playing apparatus according to an exemplary embodiment of the present disclosure;

[0037] Figure 6 is a block diagram illustrating an electronic device according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0038] In order to make the ordinary person skilled in the art better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be described clearly and completely below with reference to the drawings.

[0039] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present disclosure described herein can be implemented in an order other than that illustrated or described herein. The embodiments described in the following embodiments do not represent all embodiments consistent with the present disclosure. Rather, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0040] It should be noted that "at least one of a plurality of items" appearing in the present disclosure means that three types of alternatives are included, i.e. "any one of the plurality of items", "a combination of any two or more of the plurality of items", and "all of the plurality of items". For example, "including at least one of A and B" includes the following three alternatives: (1) including A; (2) including B; and (3) including A and B. For another example, "performing at least one of step one and step two" means the following three alternatives: (1) performing step one; (2) performing step two; and (3) performing step one and step two.

[0041] Figure 1 is a flowchart illustrating a video playing method according to an exemplary embodiment of the present disclosure, applied to a server.

[0042] Referring to Figure 1In step 101, a target video can be acquired, wherein the target video can include a plurality of video frames arranged in sequence. That is, a particle effect video can be acquired. The particle effect video can include N video frames arranged in sequence in time order, for example, the particle effect video can include N video frames arranged in sequence in time order: 1st frame, 2nd frame, …, N-1th frame and Nth frame, N is an integer greater than 1. The particle effect can include but is not limited to the following: flame, smoke, snowflake, explosion, water flow, spark, falling leaves, cloud, fog, dust, meteor trail, luminous trajectory.

[0043] In step 102, each video frame in the plurality of video frames can be divided into a plurality of image blocks, wherein each image block can include one particle element. That is, each of the N video frames can be divided into a plurality of image blocks. For example, image segmentation technology can be used to segment each of the N video frames into a plurality of image blocks: I1, I2, …, IN. M-1 M Each image block can include a complete particle element.

[0044] In step 103, for each particle element, the description information corresponding to the preset image block containing each particle element can be acquired. The description information corresponding to each particle element can be the description information of the preset image block in the video frame set to which it belongs.

[0045] That is, for each particle element, the description information of the image block containing the particle element in each video frame in the at least one video frame to which it belongs can be acquired, and the at least one video frame is at least one of the N video frames. That is, for each particle element, the particle element in the particle effect video can be dynamically tracked to obtain the motion trajectory of the particle element in at least one of the N video frames.

[0046] According to an example embodiment of the present disclosure, each video frame can be sequentially taken as a target video frame in the order from the last video frame to the first video frame in the plurality of video frames. Then, for each target image block in the target video frame, the preset image block containing the particle element in each target image block can be filtered out from the video frames before the target video frame. Next, the description information of the preset image block in the video frame set to which it belongs can be acquired. The above-mentioned target image block is an image block that has not been filtered out.

[0047] Referring to Figure 2 , Figure 2 is a schematic diagram showing that a particle effect video according to an example embodiment of the present disclosure includes a plurality of particle effects. Figure 2 ​The 10 video frames are arranged in time sequence from left to right as: the 1st frame, the 2nd frame, the 3rd frame, the 4th frame, the 5th frame, the 6th frame, the 7th frame, the 8th frame, the 9th frame, and the 10th frame. Each of the 10 frames can have a snowflake particle element. The 2nd frame can have a cloud particle element in addition to the snowflake particle element. The 4th frame, the 5th frame, and the 6th frame can have a fire particle element in addition to the snowflake particle element. The 8th frame can have a meteor particle element in addition to the snowflake particle element. The 10th frame can have a falling leaf particle element in addition to the snowflake particle element.

[0048] In order, each video frame can be taken as a target video frame from the 10th video frame to the 1st video frame. For example, the 10th video frame can be taken as a target video frame first. The 10th video frame contains two particle elements, namely the snowflake particle element and the falling leaf particle element. For the target image block containing the snowflake particle element in the 10th video frame, an image block containing the snowflake particle element in the target image block can be screened from the image blocks of the video frames before the 10th video frame. For the target image block containing the falling leaf particle element in the 10th video frame, an image block containing the falling leaf particle element in the target image block can be screened from the image blocks of the video frames before the 10th video frame.

[0049] Since Figure 2 each of the 10 frames in the 10th video frame contains a snowflake particle element, the snowflake particle element can be tracked in each of the 10 frames in the 1st frame to the 9th frame. At this time, the description information of the image block containing the snowflake particle element in the target image block in the 10th video frame in each of the 10 frames can be obtained. Since Figure 2 only the 10th frame of the 10 frames in the 10th video frame contains a falling leaf particle element, the falling leaf particle element cannot be tracked in each of the 1st frame to the 9th frame. Therefore, the description information of the image block containing the falling leaf particle element in the target image block in the 10th video frame in the 10th frame can be obtained.

[0050] Next, the 9th frame can be taken as a target video frame. The 9th frame contains only one snowflake particle element, and the snowflake particle element belongs to the particle element tracked by the snowflake particle element in the 10th frame, that is, the snowflake particle element in the 9th frame belongs to the screened particle element. Therefore, at this time, the screened snowflake particle element in the 9th frame will not be tracked to the video frames before it.

[0051] Then, the 8th frame can be taken as the target video frame, and the 8th frame contains a snowflake particle element and a meteor particle element. Among them, the snowflake particle element in the 8th frame belongs to the particle element that has been screened out before. Therefore, at this time, the snowflake particle element screened out in the 8th frame will not be tracked to the previous video frame any more; the meteor particle element in the 8th frame belongs to the particle element that has not been screened out before. Therefore, the meteor particle element in the 8th frame that has not been screened out can be tracked to the previous video frame. Figure 2 Among the 10 frames in the 1st frame to the 7th frame, only the 8th frame contains the meteor particle element. Therefore, the description information of the image block containing the meteor particle element in the target image block in the 8th frame can be obtained in the 8th frame.

[0052] Next, the 7th frame can be taken as the target video frame, and the 7th frame contains only a snowflake particle element. Moreover, the snowflake particle element in the 7th frame belongs to the particle element that has been screened out before. Therefore, at this time, the snowflake particle element screened out in the 7th frame will not be tracked to the previous video frame any more.

[0053] Then, the 6th frame can be taken as the target video frame, and the 6th frame contains a snowflake particle element and a fire particle element. Among them, the snowflake particle element in the 6th frame belongs to the particle element that has been screened out before. Therefore, at this time, the snowflake particle element screened out in the 6th frame will not be tracked to the previous video frame any more; the fire particle element in the 6th frame belongs to the particle element that has not been screened out before. Therefore, the fire particle element in the 6th frame that has not been screened out can be tracked to the previous video frame. Figure 2 Among the 10 frames in the 1st frame to the 7th frame, the 4th frame, the 5th frame and the 6th frame contain the fire particle element. Therefore, the description information of the image block containing the fire particle element in the target image block in the 6th frame can be obtained in the 4th frame, the 5th frame and the 6th frame.

[0054] Next, the 5th frame can be taken as the target video frame, and the 5th frame contains a snowflake particle element and a fire particle element. Among them, the snowflake particle element and the fire particle element in the 5th frame belong to the particle element that has been screened out before. Therefore, at this time, the snowflake particle element and the fire particle element screened out in the 5th frame will not be tracked to the previous video frame any more.

[0055] Then, the fourth frame can be taken as a target video frame, and the fourth frame contains a snowflake particle element and a flame particle element. The snowflake particle element and the flame particle element in the fourth frame belong to the particle elements screened out before. Therefore, the snowflake particle element and the flame particle element screened out in the fourth frame will not be tracked to the previous video frames any more.

[0056] Next, the third frame can be taken as a target video frame, and the third frame contains only a snowflake particle element. Since the snowflake particle element in the third frame belongs to the particle elements screened out before. Therefore, the snowflake particle element screened out in the third frame will not be tracked to the previous video frames any more.

[0057] Then, the second frame can be taken as a target video frame, and the second frame contains a snowflake particle element and a cloud particle element. The snowflake particle element in the second frame belongs to the particle elements screened out before. Therefore, the snowflake particle element screened out in the second frame will not be tracked to the previous video frames any more; the cloud particle element in the second frame belongs to the particle elements not screened out before. Therefore, the cloud particle element not screened out in the second frame can be tracked to the previous video frames. Since Figure 2 The cloud particle element exists only in the second frame among the ten frames, and therefore, the description information of the image block containing the cloud particle element in the target image block in the second frame can be obtained in the second frame to which the image block belongs.

[0058] Next, the first frame can be taken as a target video frame, and the first frame contains only a snowflake particle element. Since the snowflake particle element in the first frame belongs to the particle elements screened out before. Therefore, the snowflake particle element screened out in the first frame will not be tracked to the previous video frames any more. In this way, for each particle element, the particle element can be tracked in the order from the last video frame to the first video frame, and all the particle elements in all the video frames can be tracked to avoid the situation that a particle element in a video frame is missed.

[0059] According to the example embodiments of the present disclosure, a plurality of adjacent video frame groups contained in a plurality of video frames can be determined. Each adjacent video frame group can contain a first video frame ranked first and a second video frame ranked last. Then, for each adjacent video frame group in the plurality of adjacent video frame groups, a preset image block can be screened out from a plurality of image blocks contained in the first video frame based on an image block containing a particle element in each target image block in the second video frame.

[0060] That is, for each pair of two adjacent video frames starting from the target video frame, the image block containing the particle element in the target image block is filtered from the plurality of image blocks contained in the video frame that is earlier in the sequence, with reference to the image block containing the particle element in the target image block in the video frame that is later in the sequence.

[0061] For example, for the snowflake particle element in the 10th video frame, there are 9 pairs of two adjacent video frames starting from the target video frame, namely: (9th, 10th), (8th, 9th), (7th, 8th), (6th, 7th), (5th, 6th), (4th, 5th), (3rd, 4th), (2nd, 3rd), and (1st, 2nd). For the pair of (9th, 10th), the image block containing the snowflake particle element in the target image block is filtered from the plurality of image blocks contained in the 9th video frame that is earlier in the sequence, with reference to the image block containing the snowflake particle element in the target image block in the 10th video frame that is later in the sequence. Next, for the pair of (8th, 9th), the image block containing the snowflake particle element in the target image block is filtered from the plurality of image blocks contained in the 8th video frame that is earlier in the sequence, with reference to the image block containing the snowflake particle element in the target image block in the 9th video frame that is later in the sequence. In this way, the 1st video frame in the 10 video frames can be tracked in sequence.

[0062] For the falling leaf particle element in the 10th video frame, there are also 9 pairs of two adjacent video frames starting from the target video frame. For the pair of (9th, 10th), the image block containing the falling leaf particle element in the target image block is filtered from the plurality of image blocks contained in the 9th video frame that is earlier in the sequence, with reference to the image block containing the falling leaf particle element in the target image block in the 10th video frame that is later in the sequence. Since the falling leaf particle element only exists in the 10th video frame in the 10 video frames, the falling leaf particle element cannot be tracked in the 9th video frame.

[0063] Similarly, for the fire particle element in the target video frame of the 6th video frame, there are 5 pairs of every two adjacent video frames starting from the target video frame, which are (5th frame, 6th frame), (4th frame, 5th frame), (3rd frame, 4th frame), (2nd frame, 3rd frame), and (1st frame, 2nd frame). For the (5th frame, 6th frame) in the 5 pairs of adjacent video frames, the image block containing the fire particle element in the target image block in the image block in the later-ordered 6th frame can be taken as a reference to filter the image block containing the fire particle element in the target image block from the multiple image blocks contained in the earlier-ordered 5th frame. Next, for the (4th frame, 5th frame) in the 5 pairs of adjacent video frames, the image block containing the fire particle element in the target image block in the image block in the later-ordered 5th frame can be taken as a reference to filter the image block containing the fire particle element in the target image block from the multiple image blocks contained in the earlier-ordered 4th frame. Then, for the (3rd frame, 4th frame) in the 5 pairs of adjacent video frames, the image block containing the fire particle element in the target image block in the image block in the later-ordered 4th frame can be taken as a reference to filter the image block containing the fire particle element in the target image block from the multiple image blocks contained in the earlier-ordered 3rd frame. Since the fire particle element exists only in the 4th frame, the 5th frame, and the 6th frame in the 10 frames, the fire particle element cannot be tracked in the 3rd frame.

[0064] Thus, since the physical time interval of two adjacent video frames is relatively close, the motion properties of the particle elements contained in the two adjacent video frames have strong reference significance to each other. Therefore, the tracking of the particle elements can be sequentially performed for each adjacent video frame group in the multiple adjacent video frame groups, so as to ensure that the motion trajectory of each particle element is accurately tracked.

[0065] For other video frames in the 10 frames, the process of tracking the particle elements is similar to the foregoing process, which is not listed one by one here.

[0066] According to the example embodiments of the present disclosure, for each adjacent video frame group in the multiple adjacent video frame groups, the feature similarity between the first image block and the second image block can be calculated. The first image block can be the multiple image blocks contained in the first video frame, and the second image block can be the image block containing the particle element in each target image block in the second video frame. Next, the image block in the first video frame with the feature similarity greater than or equal to a preset threshold value can be determined as a preset image block.

[0067] The feature similarity between each image block containing the particle element in the target image block in the video frame at the rear of the order and each image block contained in the video frame at the front of the order can be calculated. Then, the image block with a feature similarity greater than or equal to a preset threshold value can be selected from the image blocks contained in the video frame at the front of the order as the image block containing the particle element in the target image block.

[0068] For example, for the snowflake particle element in the target video frame of the 10th video frame, there are 9 pairs of every two adjacent video frames starting from the target video frame. For the 9th frame and the 10th frame in the 9 pairs of adjacent video frames, the feature similarity between the image block containing the snowflake particle element in the target image block in the video frame at the rear of the order and each image block contained in the video frame at the front of the order can be calculated. Then, the image block with a feature similarity greater than or equal to a preset threshold value can be selected from the image blocks contained in the video frame at the front of the order as the image block containing the snowflake particle element in the target image block. Next, for the 8th frame and the 9th frame in the 9 pairs of adjacent video frames, the feature similarity between the image block containing the snowflake particle element in the target image block in the video frame at the rear of the order and each image block contained in the video frame at the front of the order can be calculated. Then, the image block with a feature similarity greater than or equal to a preset threshold value can be selected from the image blocks contained in the video frame at the front of the order as the image block containing the snowflake particle element in the target image block. In this way, the snowflake particle element can be tracked sequentially to the 1st frame in the 10 video frames.

[0069] For the falling leaf particle element in the target video frame of the 10th video frame, there are 9 pairs of every two adjacent video frames starting from the target video frame. For the 9th frame and the 10th frame in the 9 pairs of adjacent video frames, the feature similarity between the image block containing the falling leaf particle element in the target image block in the video frame at the rear of the order and each image block contained in the video frame at the front of the order can be calculated. Since the video frame at the front of the order does not contain the falling leaf particle element, the image blocks selected from the image blocks contained in the video frame at the front of the order all have a feature similarity less than the preset threshold value. At this time, based on the result that the image blocks selected from the image blocks contained in the video frame at the front of the order all have a feature similarity less than the preset threshold value, it can be determined that the falling leaf particle element is not tracked on the 9th frame.

[0070] Similarly, for the fire particle element in the target video frame of the 6th video frame, there are 5 pairs of every two adjacent video frames starting from the target video frame, for the (5th frame, 6th frame) in the 5 pairs of adjacent video frames, the feature similarity between the image block containing the fire particle element in the 6th frame which is later in the order and each image block contained in the 5th frame which is earlier in the order can be calculated. Then, the image block corresponding to the feature similarity greater than or equal to the preset threshold value can be filtered out from the image blocks contained in the 5th frame which is earlier in the order as the image block containing the fire particle element in the target image block. Next, for the (4th frame, 5th frame) in the 5 pairs of adjacent video frames, the feature similarity between the image block containing the fire particle element in the 5th frame which is later in the order and each image block contained in the 4th frame which is earlier in the order can be calculated. Then, the image block corresponding to the feature similarity greater than or equal to the preset threshold value can be filtered out from the image blocks contained in the 4th frame which is earlier in the order as the image block containing the fire particle element in the target image block. Then, for the (3rd frame, 4th frame) in the 5 pairs of adjacent video frames, the feature similarity between the image block containing the fire particle element in the 4th frame which is later in the order and each image block contained in the 3rd frame which is earlier in the order can be calculated. Since the 3rd frame which is earlier in the order does not contain the fire particle element, the image blocks filtered out from the image blocks contained in the 3rd frame which is earlier in the order are all image blocks corresponding to the feature similarity less than the preset threshold value. At this time, based on the result that the image blocks filtered out from the image blocks contained in the 3rd frame which is earlier in the order are all image blocks corresponding to the feature similarity less than the preset threshold value, it can be determined that the fire particle element is not tracked on the 3rd frame.

[0071] In this way, since the physical time interval of two adjacent video frames is relatively close, the motion properties of the particle elements contained in the two adjacent video frames have strong reference significance to each other, that is, if the two adjacent video frames contain the same particle element, the feature similarity of the two image blocks containing the same particle element will also be relatively high. Therefore, whether the particle element is tracked in the image block can be determined based on the size of the feature similarity of the image block, which can ensure the accuracy and effectiveness of the particle element tracking.

[0072] For other video frames in the 10 frames, the process of tracking the particle element by the feature similarity is similar to the foregoing process, which will not be enumerated one by one.

[0073] According to the example embodiments of the present disclosure, the foregoing feature similarity can be an angular point feature similarity or an RGB distribution feature similarity of pixels.

[0074] According to the example embodiments of the present disclosure, the background image contained in each of the image blocks contained in each of the plurality of video frames can also be removed. The background image contained in each of the image blocks can be the image in each of the image blocks except the particle element. Then, for each particle element, the description information corresponding to the preset image block containing the particle element and removed of the background image can be obtained.

[0075] That is, the background image contained in each of the image blocks contained in each of the N video frames can also be removed. The background image contained in each of the image blocks is the image in the image block except the complete particle element. Next, for each particle element, the description information of the image block containing the particle element and removed of the background image in each of the at least one video frame to which the image block belongs can be obtained. Since the background image does not contain any information, the background image contained in each of the image blocks can be removed, which not only avoids the interference of the background image on the subsequent particle element tracking process, but also saves the computing resources since the background image will not participate in the subsequent data processing process. Moreover, the size of the final particle special effect video file can be reduced, and the network bandwidth overhead can be further saved.

[0076] In step 104, the associated content of the preset image block can be determined according to the first frame image information corresponding to the preset image block and the description information of the preset image block in the video frame set to which the preset image block belongs. The first frame image information can be the image content in the first video frame corresponding to the preset image block.

[0077] That is, the image content of the image block containing the particle element on the first video frame in the at least one video frame can be associated with the description information of the image block containing the particle element in each of the video frames to obtain the associated content of the image block containing the particle element.

[0078] For example, for the snowflake particle element on the 10 video frames in Figure 2 , the image content of the image block containing the snowflake particle element on the 1st frame of the 10 video frames can be associated with the description information of the image block containing the snowflake particle element in each of the 10 video frames to obtain the associated content of the image block containing the snowflake particle element. Alternatively, for the fire particle element in the particle special effect video in Figure 2 , the image content of the image block containing the fire particle element on the 4th frame can be associated with the description information of the image block containing the fire particle element in each of the 4th, 5th and 6th frames to obtain the associated content of the image block containing the fire particle element.

[0079] According to the example embodiments of the present disclosure, the description information can include: a position, a size, a spatial pose of the image block in the corresponding video frame, and at least one of: a transparency, a hue, a saturation of the image block in the corresponding video frame. In this way, the description information corresponding to the image block containing each particle element contains rich content, which can accurately describe the state of the image block containing the particle element in the corresponding video frame, i.e., the playback effect of the restored particle special effect video can reach the playback effect of the original particle special effect video.

[0080] According to the example embodiments of the present disclosure, the spatial pose of the image block on the first video frame in the video frame set to which the image block belongs can be a reference spatial pose, and the spatial pose of the image block on the video frame other than the first video frame in the video frame set to which the image block belongs can be a rotation pose relative to the reference spatial pose.

[0081] For example, the reference spatial pose of the image block on the first video frame in the at least one video frame to which the image block belongs can be a horizontal-vertical pose, and the spatial pose of the image block on the video frame other than the first video frame in the at least one video frame to which the image block belongs can be a rotation pose rotated by a certain angle relative to the horizontal-vertical pose.

[0082] In step 105, the terminal can be sent the associated content of the preset image block containing each particle element, so that the terminal plays the target video based on the associated content of the preset image block containing each particle element.

[0083] Figure 3 is a flowchart illustrating another video playback method according to the example embodiments of the present disclosure, applied to a terminal.

[0084] Referring to Figure 3 In step 301, the associated content of the preset image block containing each particle element sent by the server can be received. The preset image block can be an image block in a plurality of image blocks obtained by the server dividing each video frame in a plurality of video frames sequentially arranged in a target video, and each image block can contain one particle element. The associated content of the preset image block containing each particle element can include: image content of the preset image block containing each particle element in the first video frame in the video frame set to which the image block belongs, and description information of the preset image block containing each particle element in the video frame set to which the image block belongs.

[0085] The associated content of the image block containing each particle element can be received. The image block containing each particle element can be obtained by dividing each video frame of the particle special effect video containing sequentially arranged N video frames by the server, and each image block can contain a complete particle element. The associated content of the image block containing each particle element can include: image content of the image block containing the particle element on the first video frame of at least one video frame to which the image block belongs, and description information of the image block containing the particle element in each video frame of the at least one video frame. The at least one video frame can be at least one of the N video frames, and N can be an integer greater than 1.

[0086] For example, the particle special effect video can contain N video frames arranged in time sequence: frame 1, frame 2, …, frame N-1, and frame N. The particle special effect can include but is not limited to the following: flame, smoke, snowflake, explosion, water flow, spark, falling leaves, cloud, fog, dust, meteor trail, and light track.

[0087] The division of each video frame to obtain the image block, and the process of obtaining the image content of the image block containing each particle element on the first video frame of at least one video frame to which the image block belongs, and the description information of the image block in each video frame of the at least one video frame have been described in detail in the previous embodiment, and will not be repeated here.

[0088] In step 302, the target video can be played based on the associated content of the preset image block containing each particle element, that is, the particle special effect video can be played based on the associated content of the image block containing each particle element. In this way, since the data amount of the associated content of the image block containing each particle element is small, the size of the transmission file can be significantly reduced. Compared with the method of sending the complete particle special effect video to the terminal, the disclosure can significantly reduce the occupation of network bandwidth when transmitting the particle special effect video, and can greatly save the network bandwidth cost.

[0089] According to an exemplary embodiment of the disclosure, for each video frame of the plurality of video frames, a blank picture can be created. Then, for each image block of each video frame, the image content of the image block containing the particle element in the first video frame of the video frame set to which the image block belongs can be copied into the blank picture according to the description information of each image block in each video frame, to obtain a particle picture corresponding to each video frame. Next, the plurality of particle pictures corresponding to the plurality of video frames can be played.

[0090] That is, for each of the N video frames, a blank picture can be created. Next, for each image block of the video frame, the image content of the image block containing the particle element in the at least one video frame to which the image block belongs, on the first video frame, can be copied into the blank picture according to the description information of the image block in the video frame, to obtain a particle special effect picture corresponding to the video frame.

[0091] In this way, since the description information corresponding to the image block containing each particle element can accurately describe the state of the image block in the corresponding video frame, the blank picture can be restored based on the description information of the image block in the video frame, and the playing effect of the restored multiple particle pictures can reach the playing effect of the original particle special effect video.

[0092] For example, referring back to Figure 2 , for the second frame of the 10 frames in Figure 2 , which contains two particle elements, snowflake particle elements and cloud particle elements. The image content of the image block containing the snowflake particle element on the first frame of the 10 frames to which the image block belongs can be copied into the blank picture according to the position, size, spatial pose, transparency, hue, saturation, etc. of the image block in the second frame; and the image content of the image block containing the cloud particle element on the second frame to which the image block belongs can be copied into the blank picture according to the position, size, spatial pose, transparency, hue, saturation, etc. of the image block in the second frame. In this way, a particle special effect picture corresponding to the second frame can be obtained.

[0093] Then, the N particle special effect pictures corresponding to the N video frames can be played to realize the playing of the particle special effect video. In this way, the server can dynamically track the particle elements in the particle special effect video, and when delivering the particle special effect video to the terminal, only the associated content of the image block containing each particle element can be delivered. Then, the terminal can restore the original particle special effect video to a series of particle special effect pictures for playing based on the associated content of the image block containing each particle element.

[0094] Figure 4 is a block diagram of a video playing device according to an example embodiment of the present disclosure, applied to a server.

[0095] Referring to Figure 4 , the video playing device 400 can include a video acquisition module 401, a division module 402, a description information acquisition module 403, an associated content determination module 404, and a sending module 405.

[0096] The video acquisition module 401 can acquire a target video, wherein the target video can include a plurality of video frames arranged in sequence. That is, a particle special effect video can be acquired. The particle special effect video can include N video frames arranged in sequence in time order, for example, the particle special effect video can include N video frames arranged in sequence in time order: 1st frame, 2nd frame, …, N-1th frame and Nth frame, N is an integer greater than 1. The particle special effect can include but is not limited to the following: flame, smoke, snowflake, explosion, water flow, spark, falling leaves, cloud, fog, dust, meteor trail, luminous track.

[0097] The division module 402 can divide each video frame in the plurality of video frames into a plurality of image blocks, wherein each image block can include a particle element. That is, each video frame in the N video frames can be divided into a plurality of image blocks. For example, the image segmentation technology can be used to segment each video frame in the N video frames into a plurality of image blocks: I1, I2, …, IN. M-1 M Each image block can include a complete particle element.

[0098] For each particle element, the description information acquisition module 403 can acquire the description information corresponding to the preset image block including each particle element. The description information corresponding to each particle element can be the description information of the preset image block in the video frame set to which it belongs. That is, for each particle element, the particle element in the particle special effect video can be dynamically tracked to obtain the motion track of the particle element in at least one video frame in the N video frames.

[0099] According to an example embodiment of the present disclosure, the description information acquisition module 403 can sequentially take each video frame as a target video frame in the order from the last video frame to the first video frame in the plurality of video frames. Then, for each target image block in the target video frame, the description information acquisition module 403 can filter out the preset image block including the particle element in each target image block from the video frame before the target video frame. Next, the description information acquisition module 403 can acquire the description information of the preset image block in the video frame set to which it belongs. The above-mentioned target image block is an image block that has not been filtered out.

[0100] According to an example embodiment of the present disclosure, the description information acquisition module 403 can determine a plurality of adjacent video frame groups included in the plurality of video frames. Each adjacent video frame group can include a first video frame ranked first and a second video frame ranked last. Then, for each adjacent video frame group in the plurality of adjacent video frame groups, the description information acquisition module 403 can filter out the preset image block from the plurality of image blocks included in the first video frame based on the image block including the particle element in each target image block in the second video frame. ​

[0101] According to an example embodiment of the present disclosure, for each of the plurality of groups of adjacent video frames, the description information obtaining module 403 can calculate a feature similarity between a first image block and a second image block. The first image block can be a plurality of image blocks contained in the first video frame, and the second image block can be an image block containing a particle element in each target image block in the second video frame. Next, the description information obtaining module 403 can determine an image block in the first video frame as a preset image block if the feature similarity of the image block is greater than or equal to a preset threshold.

[0102] According to an example embodiment of the present disclosure, the aforementioned feature similarity can be a corner point feature similarity or a pixel RGB distribution feature similarity.

[0103] According to an example embodiment of the present disclosure, the video playing device 400 can further include a removing module. The removing module can remove a background image contained in each image block from a plurality of image blocks contained in each video frame in the plurality of video frames. The background image contained in each image block can be an image in each image block other than the particle element. Then, for each particle element, the description information obtaining module 403 can obtain description information corresponding to a preset image block containing each particle element and from which the background image is removed.

[0104] Since the background image does not contain any information, the background image contained in each image block can be removed, which not only avoids the interference of the background image on the subsequent particle element tracking process, but also saves computing resources since the background image does not participate in the subsequent data processing process. In addition, the size of the final particle special effect video file can be reduced, and the network bandwidth overhead can be further saved.

[0105] The associated content determining module 404 can determine the associated content of the preset image block according to the first frame image information corresponding to the preset image block and the description information of the preset image block in the video frame set to which the preset image block belongs. The first frame image information can be the image content in the first video frame corresponding to the preset image block.

[0106] According to an example embodiment of the present disclosure, the aforementioned description information can include the position, size, spatial pose of the image block in the corresponding video frame, and at least one of the following: the transparency, hue, and saturation of the image block in the corresponding video frame.

[0107] According to an example embodiment of the present disclosure, the spatial pose of the image block on the first video frame in the video frame set to which the image block belongs can be a reference spatial pose, and the spatial pose of the image block on the other video frames in the video frame set to which the image block belongs other than the first video frame can be a rotation pose relative to the reference spatial pose.

[0108] For example, if the reference spatial pose of the image block on the first video frame in the at least one video frame to which the image block belongs is a landscape portrait pose, the spatial pose of the image block on the other video frames in the at least one video frame to which the image block belongs except the first video frame can be a rotated pose rotated by a certain angle relative to the landscape portrait pose.

[0109] The sending module 405 can send the terminal the associated content of the preset image block containing each particle element, so that the terminal plays the target video based on the associated content of the preset image block containing each particle element.

[0110] Figure 5 is a block diagram illustrating another video playing device according to an example embodiment of the present disclosure, applied to a terminal.

[0111] With reference to Figure 5 The video playing device 500 can include a receiving module 501 and a playing module 502.

[0112] The receiving module 501 can receive the associated content of the preset image block containing each particle element sent by the server. The preset image block can be an image block in a plurality of image blocks obtained by the server dividing each video frame in a plurality of video frames sequentially arranged in a target video, and each image block can contain one particle element. The associated content of the preset image block containing each particle element can include: image content of the preset image block containing each particle element in the first video frame in a video frame set to which the image block belongs, and description information of the preset image block containing each particle element in the video frame set.

[0113] For example, the particle special effect video can contain N video frames sequentially arranged in time sequence: 1st frame, 2nd frame, …, N-1th frame and Nth frame. The particle special effect can include but is not limited to the following: flame, smoke, snowflake, explosion, water flow, spark, falling leaves, cloud, fog, dust, meteor trail, luminous track.

[0114] The process of dividing each video frame to obtain an image block, and obtaining image content of the image block containing each particle element on the first video frame in the at least one video frame to which the image block belongs, and description information of the image block in each video frame in the at least one video frame has been described in detail in the previous embodiment, and will not be repeated here.

[0115] The playing module 502 can play the target video based on the associated content of the preset image block containing each particle element, that is, the playing module 502 can play the particle special effect video based on the associated content of the image block containing each particle element.

[0116] According to an exemplary embodiment of this disclosure, for each video frame in a plurality of video frames, the playback module 502 can create a blank image. Then, for each image block in each video frame, the playback module 502 can copy the image content of the image block containing the particle elements in each image block in the first video frame of the video frame set to which it belongs, according to the description information of each image block in each video frame, into the blank image to obtain the particle image corresponding to each video frame.

[0117] For example, return to reference Figure 2 ,against Figure 2 The second frame out of the ten frames contains two particle elements: a snowflake particle element and a cloud particle element. The image content of the image block containing the snowflake particle element in the first frame of the ten frames can be copied into a blank image according to its position, size, spatial orientation, transparency, hue, and saturation within the second frame. Similarly, the image content of the image block containing the cloud particle element in the second frame can be copied into a blank image according to its position, size, spatial orientation, transparency, hue, and saturation within the second frame. This way, the particle effect image corresponding to the second frame can be obtained.

[0118] Then, the playback module 502 can play multiple particle images corresponding to multiple video frames. In this way, the server can dynamically track particle elements in the particle effect video, and when sending the particle effect video to the terminal, it can only send the associated content of the image block containing each particle element. Then, the terminal can restore the original particle effect video into a series of particle effect images for playback based on the associated content of the image block containing each particle element. Since the data volume of the associated content of the image block containing each particle element is small, the size of the transmitted file can be significantly reduced. Compared to sending the complete particle effect video to the terminal, this disclosure can significantly reduce the network bandwidth usage when transmitting particle effect videos, thus saving a large amount of network bandwidth costs.

[0119] Figure 6 This is a block diagram illustrating an electronic device 600 according to an exemplary embodiment of the present disclosure.

[0120] Reference Figure 6 The electronic device 600 includes at least one memory 601 and at least one processor 602. The at least one memory 601 stores instructions that, when executed by the at least one processor 602, perform a video playback method according to an exemplary embodiment of the present disclosure.

[0121] As an example, the electronic device 600 can be a PC computer, a tablet device, a personal digital assistant, a smart phone, or other device capable of executing the above instructions. Here, the electronic device 600 need not be a single electronic device, but can be a collection of any devices or circuits capable of executing the above instructions (or instruction sets) individually or jointly. The electronic device 600 can also be part of an integrated control system or system manager, or can be configured as a portable electronic device that interfaces with local or remote (e.g., via wireless transmission) devices.

[0122] In the electronic device 600, the processor 602 can include a central processor (CPU), a graphics processor (GPU), a programmable logic device, a dedicated processor system, a microcontroller, or a microprocessor. As an example and not a limitation, the processor can also include an analog processor, a digital processor, a microprocessor, a multi-core processor, a processor array, a network processor, etc.

[0123] The processor 602 can execute instructions or code stored in the memory 601, where the memory 601 can also store data. The instructions and data can also be sent and received over a network via a network interface device, which can employ any known transmission protocol.

[0124] The memory 601 can be integrated with the processor 602, such as being disposed within an integrated circuit microprocessor, etc. Further, the memory 601 can include a separate device, such as an external disk drive, a storage array, or other storage device usable by any database system. The memory 601 and the processor 602 can be operatively coupled, or can communicate with each other, such as through I / O ports, network connections, etc., so that the processor 602 can read files stored in the memory.

[0125] Further, the electronic device 600 can also include a video display (such as a liquid crystal display) and a user interaction interface (such as a keyboard, a mouse, a touch input device, etc.). All components of the electronic device 600 can be connected to each other via a bus and / or a network.

[0126] According to an example embodiment of the disclosure, a computer-readable storage medium can also be provided, which, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the above-described video playback method. Examples of the computer-readable storage medium here include read-only memory (ROM), random access programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), flash memory, non-volatile memory, CD-ROM, CD-R, CD+R, CD-RW, CD+RW, DVD-ROM, DVD-R, DVD+R, DVD-RW, DVD+RW, DVD-RAM, BD-ROM, BD-R, BD-R LTH, BD-RE, Blu-ray or optical disc memory, a hard disk drive (HDD), a solid state drive (SSD), a card-type memory such as a multimedia card, a secure digital (SD) card, or an extreme digital (XD) card, a magnetic tape, a floppy disk, a magneto-optical data storage device, an optical data storage device, a hard disk, a solid state disk, and any other device configured to store a computer program and any associated data, data files, and data structures in a non-transitory manner and provide the computer program and any associated data, data files, and data structures to a processor or computer so that the processor or computer can execute the computer program. The computer program in the above-described computer-readable storage medium can be executed in an environment deployed in a computer device such as a client, a host, a proxy device, a server, etc., and in addition, in one example, the computer program and any associated data, data files, and data structures are distributed over a networked computer system so that the computer program and any associated data, data files, and data structures are stored, accessed, and executed by one or more processors or computers in a distributed manner.

[0127] According to an example embodiment of the disclosure, a computer program product can also be provided, which includes a computer program that, when executed by a processor, implements the video playback method according to the disclosure.

[0128] According to the video playback method, apparatus, electronic device, and storage medium of the disclosure, the particle elements in the particle special effect video can be dynamically tracked, and when the particle special effect video is delivered to a terminal, only the associated content of the image block containing each particle element can be delivered. Since the data amount of the associated content of the image block containing each particle element is small, the size of the transmission file can be significantly reduced. Compared with the way of sending the complete particle special effect video to the terminal, the disclosure can significantly reduce the occupation of network bandwidth when transmitting the particle special effect video, and can greatly save the network bandwidth overhead.

[0129] Further, since the background image does not contain any information, the background image contained in each image block can be removed, which not only avoids the interference of the background image to the subsequent particle element tracking process, but also saves the computing resources since the background image will not participate in the subsequent data processing process. Moreover, the volume of the final particle special effect video file can be reduced, and the network bandwidth overhead can be further saved.

[0130] Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. It is intended that the disclosure be construed as including any variations, uses or adaptive changes of the specific embodiments described herein consistent with this disclosure and the general principles of the disclosure. The specification and examples are exemplary only and not intended to be limiting in scope or spirit of the disclosure as defined by the claims.

[0131] It should be understood that the present disclosure is not limited to the precise structures herein described and illustrated in the drawings, and that various modifications and changes can be made without departing from its scope. The scope of the present disclosure is limited only by the claims that follow.

Claims

1. A video playing method, characterized in that, The method comprises: acquiring a target video, wherein the target video comprises a plurality of video frames arranged in sequence; dividing each video frame in the plurality of video frames into a plurality of image blocks, wherein each image block comprises a particle element; acquiring description information of each particle element, the description information comprising description information of each particle element appearing in each video frame corresponding to the particle element; associating image content of the image block corresponding to each particle element appearing in the first video frame with the description information of the corresponding particle element to obtain association content; sending the association content to a terminal to enable the terminal to play the target video based on the association content; wherein the description information comprises a spatial pose of the image block in which each particle element is located in the corresponding video frame, and for each particle element, the spatial pose of the image block in which the particle element is located in the first video frame to which the image block belongs is a reference spatial pose, and the spatial pose of the image block in which the particle element is located in other video frames except the first video frame is a rotation pose relative to the reference spatial pose.

2. The video playback method of claim 1, wherein, The acquiring of the description information of each particle element comprises: sequentially taking each video frame as a target video frame in the order from the last video frame to the first video frame in the plurality of video frames; screening the image block containing each particle element from the video frames before the target video frame; acquiring description information of the image block containing each particle element in the video frame to which the image block belongs.

3. The video playback method of claim 2, wherein, The screening of the image block containing each particle element from the video frames before the target video frame comprises: determining a plurality of adjacent video frame groups contained in the plurality of video frames, wherein each adjacent video frame group comprises a first video frame arranged in the front and a second video frame arranged in the back; for each adjacent video frame group in the plurality of adjacent video frame groups, screening the image block containing each particle element from a plurality of image blocks contained in the first video frame based on each particle element in the second video frame.

4. The video playback method of claim 3, wherein, The screening of the image block containing each particle element from a plurality of image blocks contained in the first video frame based on each particle element in the second video frame for each adjacent video frame group in the plurality of adjacent video frame groups comprises: for each adjacent video frame group in the plurality of adjacent video frame groups, calculating a feature similarity between a first image block and a second image block, wherein the first image block is a plurality of image blocks contained in the first video frame, and the second image block is an image block containing each particle element in the second video frame; determining the image block in the first video frame with a feature similarity greater than or equal to a preset threshold as the image block containing each particle element.

5. The video playback method of claim 1, wherein, The method further comprises: eliminating background images contained in each image block in a plurality of image blocks contained in each video frame in the plurality of video frames, wherein the background image contained in each image block is an image in the image block except the particle element; the acquiring of the description information of each particle element comprises: obtain description information corresponding to the image block of each particle element and the background image removed.

6. The video playback method according to any one of claims 1 to 5, wherein, The description information further comprises a position and a size of the image block in the corresponding video frame, and at least one of the following: a transparency, a hue, and a saturation of the image block in the corresponding video frame.

7. The video playback method of claim 4, wherein, The feature similarity is a corner feature similarity or a pixel RGB distribution feature similarity.

8. A video playing method, characterized in that, The method comprises: receiving the associated content of each particle element sent by the server, wherein the associated content of each particle element comprises image content of the corresponding image block in the first video frame in which the particle element appears and description information of the corresponding particle element, wherein the description information comprises description information of the particle element corresponding to each video frame in which the particle element appears, and the image block is obtained by dividing each video frame in the target video sent by the server. playing the target video based on the associated content of each particle element; The description information comprises a spatial pose of the image block in which each particle element is located in the corresponding video frame, and for each particle element, the spatial pose of the image block in which the particle element is located in the first video frame to which the image block belongs is a reference spatial pose, and the spatial pose of the image block in which the particle element is located in other video frames except the first video frame is a rotation pose relative to the reference spatial pose.

9. The video playback method of claim 8, wherein, The playing of the target video based on the associated content of each particle element comprises: creating a blank picture for each video frame in the plurality of video frames; copying, for each particle element, the image content of the corresponding image block in the first video frame in which the particle element appears into the blank picture according to the description information of the particle element, to obtain a particle picture corresponding to the video frame; playing the plurality of particle pictures corresponding to the plurality of video frames.

10. A video playback device, comprising: The method comprises: a video acquisition module configured to acquire a target video, wherein the target video comprises a plurality of video frames arranged in sequence; a division module configured to divide each video frame in the plurality of video frames into a plurality of image blocks, wherein each image block comprises a particle element; a description information acquisition module configured to acquire description information of each particle element, wherein the description information comprises description information of the particle element corresponding to each video frame in which the particle element appears; an associated content determination module configured to associate image content of the corresponding image block in the first video frame in which each particle element appears with description information of the corresponding particle element to obtain associated content; a sending module configured to send the associated content to a terminal to enable the terminal to play the target video based on the associated content; and a video acquisition module configured to acquire a target video, wherein the target video comprises a plurality of video frames arranged in sequence; a division module configured to divide each video frame in the plurality of video frames into a plurality of image blocks, wherein each image block comprises a particle element; a description information acquisition module configured to acquire description information of each particle element, wherein the description information comprises description information of the particle element corresponding to each video frame in which the particle element appears; an associated content determination module configured to associate image content of the corresponding image block in the first video frame in which each particle element appears with description information of the corresponding particle element to obtain associated content; a sending module configured to send the associated content to a terminal to enable the terminal to play the target video based on the associated content; and The description information includes a spatial pose of the image block in which each particle element is located in a corresponding video frame, and for each particle element, a spatial pose of the image block in which the particle element is located on a first video frame to which the image block belongs is a reference spatial pose, and a spatial pose of the image block in which the particle element is located on a video frame other than the first video frame is a rotation pose relative to the reference spatial pose.

11. A video playback device, comprising: The method comprises: receiving, by a receiving module, associated content of each particle element sent by a server, wherein the associated content of each particle element includes image content of a corresponding image block in a first video frame in which the particle element appears and description information of the corresponding particle element, wherein the description information includes description information of the particle element corresponding to each video frame in which the particle element appears, and the image block is an image block obtained by dividing each video frame in a plurality of sequentially arranged video frames included in a target video by the server; playing the target video based on the associated content of each particle element; The description information includes a spatial pose of the image block in which each particle element is located in a corresponding video frame, and for each particle element, a spatial pose of the image block in which the particle element is located on a first video frame to which the image block belongs is a reference spatial pose, and a spatial pose of the image block in which the particle element is located on a video frame other than the first video frame is a rotation pose relative to the reference spatial pose.

12. An electronic device, comprising: The method comprises: a processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the video playing method according to any one of claims 1 to 7 or the video playing method according to any one of claims 8 to 9.

13. A computer-readable storage medium, characterized in that, When the instructions in the computer readable storage medium are executed by the processor of the electronic device, the electronic device can execute the video playing method according to any one of claims 1 to 7 or the video playing method according to any one of claims 8 to 9.

14. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the video playing method according to any one of claims 1 to 7 or the video playing method according to any one of claims 8 to 9.

Images