Image dynamic display method and system

By constructing a partition tree to process single-frame images in parallel, and using optical flow algorithms and interpolation methods to generate intermediate frame images, the blurring and tearing problems in dynamic image display are solved, achieving higher smoothness and detail display effects.

CN118984360AActive Publication Date: 2024-11-19HUAIHUA UNIV
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202411108356.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-13
Publication Date
2024-11-19
Estimated Expiration
2044-08-13

AI Technical Summary

Technical Problem

Existing technologies suffer from image blurring, tearing, or ghosting in dynamic image display, and low refresh rates and low resolutions affect the smoothness and detail of the image.

Method used

By constructing a partition tree, the image is divided into single-frame images, and initial nodes are embedded in the partition tree. Data stacks and triggers are used for buffering and frame interpolation. Intermediate frame images are generated by combining optical flow algorithms and interpolation methods to achieve parallel processing.

Benefits of technology

It improves the smoothness and detail of dynamic image display, reduces stuttering and pauses, and enhances processing efficiency and user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118984360A_ABST
    Figure CN118984360A_ABST
Patent Text Reader

Abstract

The invention provides an image dynamic display method and system, and relates to the technical field of image display, and the method comprises the steps: S100: constructing a partition tree, embedding an initial node, transmitting a received image to the initial node, and segmenting the image into a plurality of single-frame images; and S200, decomposing the partition tree into a left sub-tree, a middle trunk and a right sub-tree, creating a data stack in the middle trunk, and hanging four groups of blocks in the data stack. According to the method, the left sub-tree and the plurality of blocks are constructed, so that the image is buffered, jamming and pause in the dynamic display process of the image are reduced, the user experience is greatly improved, the left sub-tree and the right sub-tree are integrated, and the partition tree is constructed, so that parallel processing of frame insertion and buffering is realized, the image processing efficiency is greatly improved, and the user experience is improved. And meanwhile, the dynamic display effect of the image is better, and the fluency is higher.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of image display technology, and in particular to a method and system for dynamic image display. Background Art

[0002] Image dynamic display refers to the technology of achieving animation effects or real-time display by constantly updating and changing image content in computer graphics and multimedia applications. It is widely used in games, video playback, data visualization, virtual reality and augmented reality. In order to obtain high-quality and stable dynamic images, the data source needs to be analyzed and processed; for example, low refresh rate and high response time may cause blur, tearing or smearing of images when moving quickly; low resolution will affect the clarity and detail presentation of the image, and will also reduce the smoothness of the dynamic image. The above problems can be well solved by interpolating and buffering the data source.

[0003] Therefore, “how to improve the smoothness of dynamic image display through interpolation and buffering” is the technical problem that the present invention needs to solve. Summary of the invention

[0004] The object of the present invention is to provide a method and system for dynamic image display, so as to solve the problem of "how to improve the smoothness of dynamic image display through interpolation and buffering" raised in the above background technology.

[0005] To achieve the above object, the present invention provides the following technical solutions:

[0006] A method for dynamic image display, the method comprising:

[0007] S100: construct a partition tree and embed it into an initial node, transfer the received image to the initial node, and divide it into several single-frame images;

[0008] S200: decomposing the partition tree into a left subtree, a middle trunk and a right subtree, creating a data stack in the middle trunk, and hanging four groups of blocks in the data stack, wherein the four groups of blocks are respectively two groups of buffer blocks arranged on the upper side of the data stack and two groups of processing blocks arranged on the lower side of the data stack, and configuring the transmission order of the single frame image in the blocks;

[0009] S300: Integrate a trigger at the top of the data stack, activate the trigger, pop the buffer block into the left subtree, and pop the processing block into the right subtree;

[0010] S400: importing the two single-frame images before and after into two groups of processing blocks in the right subtree respectively, and comparing the difference between the two single-frame images, determining the active part, calculating the pixel motion of the two single-frame images based on a preset optical flow algorithm, drawing a motion vector map of the pixels, and performing motion compensation, generating an intermediate frame image by using a preset interpolation method, and inserting the intermediate frame image between the two groups of processing blocks, and transferring the single-frame images and the intermediate frame images in the two groups of processing blocks to the buffer block according to the transmission order;

[0011] S500: Building a data transmission link between the left subtree and a preset terminal, processing the buffer block popped into the left subtree, wherein the processing includes: decoding, resizing, color conversion and rendering, and after processing, transferring to the data transmission link.

[0012] Furthermore, the S100 includes:

[0013] Locate the entrance of the partition tree, embed an initial node into the entrance, use the initial node as a receiving end, build an image receiving channel, and after verification, open the channel to a preset terminal;

[0014] After the channel transmits the image to the initial node, the image is split in the initial node, and each frame is exported as a single picture to obtain a single frame image;

[0015] Collect the properties of a single frame and number them.

[0016] Further, the S200 includes:

[0017] Collecting display requirements of the image, setting a plurality of data stacks at the middle trunk, wherein each of the data stacks is mounted with four groups of blocks, and marking the arrangement order of the blocks;

[0018] Constructing a play queue in the left subtree, and putting all buffer blocks into the play queue, wherein the buffer blocks are arranged in the play queue according to the numbers;

[0019] The buffer blocks in the play queue are processed in parallel.

[0020] Further, the S300 includes:

[0021] Based on the trigger, assigning different trigger strategies to the buffer block and the processing block;

[0022] The triggering strategy is:

[0023] When the buffer block crosses the trigger and enters the left subtree, the play queue is opened and the buffer block is added;

[0024] When the processing block crosses the trigger and enters the right subtree, the processing block is initialized, and two single-frame images with adjacent numbers are imported into the processing block using the initial node;

[0025] After the playback and importing are completed, the buffer blocks and processing blocks are pushed back into the data stack according to the arrangement order.

[0026] Furthermore, the S400 includes:

[0027] Constructing a computing platform for intermediate frames, integrating the optical flow algorithm and interpolation method into the computing platform, and generating intermediate frame images;

[0028] The number of the intermediate frame images is determined, two groups of processing blocks and intermediate frame images are linked using a serial data bus, and the number is updated.

[0029] Further, the S500 includes:

[0030] Inserting a side chain into the play queue and using the side chain as an entry to the play queue;

[0031] Building an image processing pipeline in the side chain;

[0032] Across the data transmission link and the play queue, a single frame image is dynamically displayed using a pre-built frame rate control strategy.

[0033] Furthermore, the method further comprises:

[0034] In the right subtree, a hierarchical recognition model is constructed, and the single frame image is input into the trained hierarchical recognition model;

[0035] Outputting at least three display levels, wherein the display levels include: foreground, middle ground and background;

[0036] Compare the changed display levels in the two single-frame images and define them as the difference.

[0037] Furthermore, the method further comprises:

[0038] Marking the initialized blocks in the partition tree as empty blocks, and constructing a recycling strategy for the empty blocks;

[0039] After all the blocks are put into the data stack, the single frame image is transferred according to the transmission order.

[0040] Furthermore, the system comprises:

[0041] The segmentation module is used to construct a partition tree and embed it into the initial node, transfer the received image to the initial node, and segment it into several single-frame images;

[0042] A configuration module is used to decompose the partition tree into a left subtree, a middle trunk and a right subtree, create a data stack in the middle trunk, and hang four groups of blocks in the data stack, wherein the four groups of blocks are two groups of buffer blocks arranged on the upper side of the data stack and two groups of processing blocks arranged on the lower side of the data stack, and configure the transmission order of the single frame image in the blocks;

[0043] A pop-up module, used for integrating a trigger at the top of the data stack, activating the trigger, popping the buffer block into the left subtree, and popping the processing block into the right subtree;

[0044] A transfer module, used to import the two single-frame images before and after into the two groups of processing blocks in the right subtree respectively, and compare the difference between the two single-frame images, determine the active part, calculate the pixel motion of the two single-frame images based on the preset optical flow algorithm, draw the motion vector map of the pixels, and perform motion compensation, generate an intermediate frame image using a preset interpolation method, and insert the intermediate frame image between the two groups of processing blocks, and transfer the single-frame images and the intermediate frame images in the two groups of processing blocks to the buffer block according to the transmission order;

[0045] The transfer module is used to build a data transmission link between the left subtree and the preset terminal, and process the buffer block popped into the left subtree, wherein the processing includes: decoding, resizing, color conversion and rendering, and after processing, it is transferred to the data transmission link.

[0046] Furthermore, the segmentation module includes:

[0047] An opening unit is used to locate the entrance of the partition tree, embed an initial node into the entrance, build an image receiving channel with the initial node as the receiving end, and open the channel to a preset terminal after verification;

[0048] An export unit, configured to split the image in the initial node after the channel transmits the image to the initial node, and export each frame as a single picture to obtain a single frame image;

[0049] The numbering unit is used to collect the attributes of a single frame image and number them.

[0050] Compared with the prior art, the present invention has the following beneficial effects:

[0051] 1. By dividing the image into single frames, the image can be analyzed more accurately, thereby realizing image preprocessing and caching, reducing the amount of calculation during dynamic display of the image. By constructing the right subtree, the interpolation of the single frame is realized, which greatly improves the detail display effect of the dynamic image and further improves the smoothness of the dynamic display of the image. By constructing the left subtree and several blocks, the image is buffered, reducing the freeze and pause during the dynamic display of the image, greatly improving the user experience. By integrating the left subtree and the right subtree and constructing the partition tree, parallel processing of interpolation and buffering is realized, which greatly improves the image processing efficiency, and also makes the dynamic display of the image better and smoother.

[0052] 2. By identifying the display level and initializing the empty block, the data processing amount of the partition tree is reduced, thereby making the processing efficiency of the partition tree higher and the effect of dynamic image display better. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention.

[0054] Figure 1 A flowchart of a method for dynamic image display provided by an embodiment of the present invention;

[0055] Figure 2 A first sub-flow chart of the method for dynamic image display provided by an embodiment of the present invention;

[0056] Figure 3 A second sub-flow chart of the method for dynamic image display provided by an embodiment of the present invention;

[0057] Figure 4 A third sub-flow chart of the image dynamic display method provided by an embodiment of the present invention;

[0058] Figure 5 A fourth sub-flow chart of the image dynamic display method provided by an embodiment of the present invention;

[0059] Figure 6 A fifth sub-flow chart of the image dynamic display method provided by an embodiment of the present invention;

[0060] Figure 7 A block diagram of a dynamic image display system according to an embodiment of the present invention;

[0061] Figure 8 A block diagram of the composition of a segmentation module in an image dynamic display system provided by an embodiment of the present invention;

[0062] Fig. 9A block diagram of the configuration module in the image dynamic display system provided by an embodiment of the present invention;

[0063] Fig.10 A block diagram of the composition of a pop-up module in an image dynamic display system provided by an embodiment of the present invention;

[0064] Fig.11 A block diagram of the composition of a transfer module in an image dynamic display system provided by an embodiment of the present invention;

[0065] Fig.12 A block diagram of the composition of the transfer module in the image dynamic display system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0066] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0067] In Example 1, Figure 1 The implementation process of the image dynamic display method provided by the embodiment of the present invention is shown and described in detail below:

[0068] S100: construct a partition tree and embed it into an initial node, transfer the received image to the initial node, and divide it into several single-frame images.

[0069] Construct a partition tree and embed an initial node into the partition tree, wherein the partition tree is a tree data structure, similar to a tree in nature, and is divided into three parts: left, middle and right, which correspond to the left subtree, middle trunk and right subtree in the present application, respectively. These three parts are independent of each other and interconnected; embed an initial node at a position similar to the root of the tree, wherein the initial node is used to receive and pre-process the image entering the partition tree, and the initial node can also coordinate the management of the left subtree, right subtree and several blocks; use the initial node to divide the image into several single-frame images, wherein the specific number should be determined according to the dynamic display requirements of the image.

[0070] S200: Decompose the partition tree into a left subtree, a middle trunk and a right subtree, create a data stack in the middle trunk, and hang four groups of blocks in the data stack, wherein the four groups of blocks are two groups of buffer blocks arranged on the upper side of the data stack and two groups of processing blocks arranged on the lower side of the data stack, and configure the transmission order of the single frame image in the blocks.

[0071] A data stack is created in the middle trunk, where the data stack is a data structure used to store and manage data. The data stack in this embodiment is mainly used to arrange and manage blocks. The blocks follow the principle of top-out and bottom-in in the data stack, and the blocks are arranged in the data stack in a specific order. The specific order is that in the data stack, two groups of buffer blocks and two groups of processing blocks are arranged from top to bottom, where the blocks are used to analyze and process single-frame images, and the two groups of processing blocks respectively store two adjacent single-frame images.

[0072] For example, the data stack is arranged from top to bottom with buffer block one, buffer block two, processing block one and processing block two. The single frame image in processing block one will enter buffer block one through buffer block two in the transmission order, and the several blocks in buffer block two will enter buffer block two through processing block one.

[0073] S300: Integrate a trigger at the top of the data stack, activate the trigger, pop the buffer block into the left subtree, and pop the processing block into the right subtree.

[0074] A trigger is integrated at the top of the data stack. When two groups of buffer blocks store single-frame images at the same time, the trigger is activated to pop the two groups of buffer blocks from the data stack into the left subtree and pop the two groups of processing blocks from the data stack into the right subtree.

[0075] It should be noted that, continuing with the above example, when the single-frame images in the processing blocks 1 and 2 enter the buffer blocks 1 and 2, there are no single-frame images in the processing blocks 1 and 2.

[0076] S400: Import the two single-frame images in front and behind into the two groups of processing blocks in the right subtree respectively, and compare the difference between the two single-frame images to determine the active part, calculate the pixel motion of the two single-frame images based on the preset optical flow algorithm, draw the motion vector map of the pixels, and perform motion compensation, generate an intermediate frame image using a preset interpolation method, and insert the intermediate frame image between the two groups of processing blocks, and transfer the single-frame images and the intermediate frame images in the two groups of processing blocks to the buffer block according to the transmission order.

[0077] Since there are no single-frame images in the two groups of processing blocks, the two adjacent single-frame images can be imported into the two groups of processing blocks in the right subtree, and the difference between the two single-frame images can be compared to determine the active part. The optical flow algorithm in the prior art is used to determine the pixels corresponding to the difference, and the pixel movement in the two single-frame images is calculated. The motion vector map of the pixels is drawn, and motion compensation is performed. The interpolation method in the prior art is then used to generate an intermediate frame image, and the intermediate frame image is inserted between the two groups of processing blocks. After completing the above operations, after the two groups of buffer blocks enter the data stack, the two groups of processing blocks containing the intermediate frame images are pushed into the data stack.

[0078] S500: Building a data transmission link between the left subtree and a preset terminal, processing the buffer block popped into the left subtree, wherein the processing includes: decoding, resizing, color conversion and rendering, and after processing, transferring to the data transmission link.

[0079] Build a data transmission link between the left subtree and the preset terminal, where the preset terminal can be a display terminal or other data processing terminal. Process the two groups of buffer blocks in parallel, and transfer the processed single-frame images in the two groups of buffer blocks to the data transmission link. Play them in the preset terminals in turn via the data transmission link.

[0080] In Example 2, Figure 2 The implementation process of the image dynamic display method provided by the embodiment of the present invention is shown, and S100 is described in detail below, as follows:

[0081] S101: Locate the entrance of the partition tree, embed an initial node into the entrance, build an image receiving channel with the initial node as the receiving end, and open the channel to a preset terminal after verification.

[0082] Locate the import of the partition tree and embed the import into the initial node, that is, use the initial node to receive the image, and use the initial node as the receiving end to build an image receiving channel; only after the verification is completed will the channel be opened, in which the preset terminal is the source of the image.

[0083] S102: After the channel transmits the image to the initial node, the image is split in the initial node, and each frame is exported as a single picture to obtain a single frame image.

[0084] When the image is transmitted to the initial node through the channel, the initial node is used to preprocess the image, wherein the preprocessing is to split the image into several single-frame images.

[0085] S103: Collect the attributes of the single frame image and number them.

[0086] The properties of the single-frame image are determined, wherein the properties include: pixel size, format, and generation time of the single-frame image, etc., and the single-frame image is numbered according to the position of the single-frame image in the image.

[0087] In Example 3, Figure 3 The implementation process of the image dynamic display method provided by the embodiment of the present invention is shown, and S200 is described in detail below, as follows:

[0088] S201: collecting display requirements of the image, setting a plurality of data stacks at the middle trunk, wherein each of the data stacks is mounted with four groups of blocks, and marking the arrangement order of the blocks.

[0089] In order to improve the smoothness of dynamic image display, multiple buffer blocks and corresponding data stacks are created; several data stacks are set in the middle trunk, each data stack has the same data structure, and four groups of blocks are mounted therein, and the arrangement order of the blocks is also the same; however, it should be noted that the arrangement order here is the specific order in Example 1.

[0090] S202: constructing a play queue in the left subtree, and putting all buffer blocks into the play queue, wherein the buffer blocks are arranged in the play queue according to numbers.

[0091] After creating multiple groups of buffer blocks, a corresponding play queue for arranging all buffer blocks should be constructed; using the play queue and data transmission link, single-frame images in the buffer blocks are played in sequence, thereby realizing dynamic display of images.

[0092] In the playback queue, the single-frame images in the buffer block are arranged in the order of their numbers. This has the advantage of avoiding frame skipping.

[0093] S203: Processing the buffer blocks in the play queue in parallel.

[0094] The buffer blocks in the play queue are processed in parallel. The specific processing steps may be to merge the single-frame images in adjacent buffer blocks, or other processing methods may be used.

[0095] In Example 4, Figure 4 The implementation process of the image dynamic display method provided by the embodiment of the present invention is shown, and S300 is described in detail as follows:

[0096] S301: assigning different trigger strategies to the buffer block and the processing block based on the trigger;

[0097] The triggering strategy is:

[0098] When the buffer block crosses the trigger and enters the left subtree, the play queue is opened and the buffer block is added;

[0099] When the processing block crosses the trigger and enters the right subtree, the processing block is initialized, and the two single-frame images with adjacent numbers are imported into the processing block using the initial node. Here, crossing means passing through.

[0100] Using triggers, the buffer block and the processing block are processed differently. When the buffer block passes the trigger and enters the left subtree, the playback queue is opened and the buffer block containing the single-frame image is added to the playback queue; when the processing block passes the trigger and enters the right subtree, there is no single-frame image in the two groups of processing blocks; the processing block is initialized, and after the initialization is completed, the two single-frame images with adjacent numbers are imported into the processing block, and the comparison and interpolation are continued.

[0101] S302: After the playback and importing are completed, the buffer block and the processing block are pushed back into the data stack according to the arrangement order.

[0102] After the playback is completed, the two groups of buffer blocks are pushed into the data stack. After the two groups of processing blocks have completed frame insertion, they are also pushed into the data stack and arranged below the two groups of buffer blocks in the specific order in Example 1.

[0103] In Example 5, Figure 5 The implementation process of the image dynamic display method provided by the embodiment of the present invention is shown, and S400 is described in detail below, as follows:

[0104] S401: constructing a computing platform for intermediate frames, integrating the optical flow algorithm and interpolation method into the computing platform, and generating intermediate frame images.

[0105] Build a computing platform for the intermediate frame, integrate the optical flow algorithm and interpolation method into the computing platform, input two adjacent single-frame images into the computing platform, and output the intermediate frame image.

[0106] S402: Determine the number of the intermediate frame images, link the two groups of processing blocks and the intermediate frame images using a serial data bus, and update the numbering.

[0107] Determine the number of intermediate frames. For two single-frame images with smaller differences and smaller pixel motions, a smaller number of intermediate frames can be determined. For two single-frame images with larger differences and larger pixel motions, a larger number of intermediate frames can be determined. Determining different numbers of intermediate frames can improve the detail display effect of dynamic images and ensure smooth transition of intermediate frames.

[0108] The processing block storing two adjacent single-frame images and the corresponding intermediate frame images are linked by using a serial data bus, and the intermediate frame images are assigned corresponding numbers. The advantage of this is that it can further ensure the smooth transition between the single-frame images and the intermediate frame images, while avoiding frame jumps.

[0109] In Example 6, Figure 6 The implementation process of the image dynamic display method provided by the embodiment of the present invention is shown, and S500 is described in detail as follows:

[0110] S501: inserting a side chain into the play queue, and using the side chain as an entry of the play queue.

[0111] Insert a side chain into the play queue and use the side chain as the entry of the play queue. That is to say, a single frame image needs to be processed by the side chain before entering the play queue.

[0112] S502: Construct an image processing pipeline in the side chain.

[0113] The image processing pipeline does not have any special practical significance. It is just a general term for processing steps such as decoding, resizing, color conversion and rendering. The image processing pipeline is used to process the single frame image in the side chain, and after the processing is completed, the single frame image is transferred to the playback queue.

[0114] S503: Across the data transmission link and the play queue, a single frame image is dynamically displayed using a pre-built frame rate control strategy.

[0115] After the processed single-frame image is transferred to the playback queue, the frame rate control strategy is used to cross the data transmission link and the playback queue to dynamically display the single-frame image; crossing here means passing through (the same as Example 4), and the frame rate control strategy is determined by the staff based on the actual image dynamic display requirements.

[0116] In Example 7, different from Example 1, in this embodiment of the present invention, the method further includes:

[0117] In the right subtree, a hierarchical recognition model is constructed, and the single frame image is input into the trained hierarchical recognition model;

[0118] Outputting at least three display levels, wherein the display levels include: foreground, middle ground and background;

[0119] Compare the changed display levels in the two single-frame images and define them as the difference.

[0120] A hierarchical recognition model is constructed in the right subtree, and is trained using an existing data set to improve the accuracy of the hierarchical recognition model; a single frame image is input into the hierarchical recognition model, and a display hierarchy including foreground, midground and background is output.

[0121] Compare the display levels of the two single-frame images before and after, find out the changed display level, and define it as the difference.

[0122] In Example 8, different from Example 1, in this embodiment of the present invention, the method further includes:

[0123] Marking the initialized blocks in the partition tree as empty blocks, and constructing a recycling strategy for the empty blocks;

[0124] After all the blocks are put into the data stack, the single frame image is transferred according to the transmission order.

[0125] The initialized blocks in the partition tree are marked as empty blocks, and a recycling strategy for the empty blocks is constructed. The recycling strategy means that after the blocks are initialized, they can continue to be used as empty blocks, and two adjacent single-frame images are filled into the empty blocks to obtain processing blocks; after the blocks are placed in the data stack, the single-frame images are transferred according to the transmission order.

[0126] Figure 7 The structure block diagram of the image dynamic display system provided by the embodiment of the present invention is shown, and the image dynamic display system 1 comprises:

[0127] A segmentation module 11 is used to construct a partition tree and embed the initial node, transfer the received image to the initial node, and segment it into a number of single-frame images;

[0128] Configuration module 12, used for decomposing the partition tree into a left subtree, a middle trunk and a right subtree, creating a data stack in the middle trunk, and hanging four groups of blocks in the data stack, wherein the four groups of blocks are respectively two groups of buffer blocks arranged on the upper side of the data stack and two groups of processing blocks arranged on the lower side of the data stack, and configuring the transmission order of the single frame image in the blocks;

[0129] A pop-up module 13, used for integrating a trigger at the top of the data stack, activating the trigger, popping the buffer block into the left subtree, and popping the processing block into the right subtree;

[0130] The transfer module 14 is used to import the two single-frame images in front and behind into the two groups of processing blocks in the right subtree respectively, and compare the difference between the two single-frame images, determine the active part, calculate the pixel motion of the two single-frame images based on the preset optical flow algorithm, draw the motion vector map of the pixels, and perform motion compensation, generate an intermediate frame image by using a preset interpolation method, and insert the intermediate frame image between the two groups of processing blocks, and transfer the single-frame images and the intermediate frame images in the two groups of processing blocks to the buffer block according to the transmission order;

[0131] The transfer module 15 is used to build a data transmission link between the left subtree and the preset terminal, and process the buffer block popped into the left subtree, wherein the processing includes: decoding, resizing, color conversion and rendering, and after processing, it is transferred to the data transmission link.

[0132] Figure 8 The structure block diagram of the image dynamic display system provided by the embodiment of the present invention is shown, and the segmentation module 11 includes:

[0133] The opening unit 111 is used to locate the entrance of the partition tree, embed the initial node into the entrance, build an image receiving channel with the initial node as the receiving end, and open the channel to the preset terminal after verification;

[0134] An export unit 112 is used for, after the channel transmits the image to the initial node, splitting the image in the initial node and exporting each frame as a single picture to obtain a single frame image;

[0135] The numbering unit 113 is used to collect the attributes of a single frame image and number them.

[0136] Fig. 9 The structure block diagram of the image dynamic display system provided by the embodiment of the present invention is shown, and the configuration module 12 includes:

[0137] The marking unit 121 is used to collect the display requirements of the image, set a plurality of data stacks at the middle trunk, wherein each of the data stacks is mounted with four groups of blocks, and mark the arrangement order of the blocks;

[0138] An arranging unit 122, configured to construct a play queue in the left subtree, and put all buffer blocks into the play queue, wherein the buffer blocks are arranged in the play queue according to their numbers;

[0139] The parallel processing unit 123 is used to process the buffer blocks in the play queue in parallel.

[0140] Fig.10 The structure diagram of the image dynamic display system provided by the embodiment of the present invention is shown, and the pop-up module 13 includes:

[0141] An assigning unit 131, configured to assign different triggering strategies to the buffer block and the processing block according to the trigger;

[0142] The triggering strategy is:

[0143] When the buffer block crosses the trigger and enters the left subtree, the play queue is opened and the buffer block is added;

[0144] When the processing block crosses the trigger and enters the right subtree, the processing block is initialized, and two single-frame images with adjacent numbers are imported into the processing block using the initial node;

[0145] The pushing unit 132 is used to push the buffer block and the processing block back into the data stack according to the arrangement order after the playback and import are completed.

[0146] Fig.11 The structure block diagram of the image dynamic display system provided by the embodiment of the present invention is shown, and the transfer module 14 includes:

[0147] A generating unit 141 is used to construct a computing platform for an intermediate frame, integrate the optical flow algorithm and the interpolation method into the computing platform, and generate an intermediate frame image;

[0148] The updating unit 142 is used to determine the number of the intermediate frame images, link the two groups of processing blocks and the intermediate frame images using a serial data bus, and update the number.

[0149] Fig.12 The structure block diagram of the image dynamic display system provided by the embodiment of the present invention is shown, and the transfer module 15 includes:

[0150] An inserting unit 151, used for inserting a side chain into the play queue and using the side chain as an entry of the play queue;

[0151] A construction unit 152, configured to construct an image processing pipeline in the side chain;

[0152] The spanning unit 153 is used to span the data transmission link and the play queue, and dynamically display the single frame image using a pre-built frame rate control strategy.

[0153] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0154] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

[0155] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for dynamic image display, characterized in that: The method comprises: S100: construct a partition tree and embed it into an initial node, transfer the received image to the initial node, and divide it into several single-frame images; S200: decomposing the partition tree into a left subtree, a middle trunk and a right subtree, creating a data stack in the middle trunk, and hanging four groups of blocks in the data stack, wherein the four groups of blocks are respectively two groups of buffer blocks arranged on the upper side of the data stack and two groups of processing blocks arranged on the lower side of the data stack, and configuring the transmission order of the single frame image in the blocks; S300: Integrate a trigger at the top of the data stack, activate the trigger, pop the buffer block into the left subtree, and pop the processing block into the right subtree; S400: importing the two single-frame images before and after into two groups of processing blocks in the right subtree respectively, and comparing the difference between the two single-frame images, determining the active part, calculating the pixel motion of the two single-frame images based on a preset optical flow algorithm, drawing a motion vector map of the pixels, and performing motion compensation, generating an intermediate frame image by using a preset interpolation method, and inserting the intermediate frame image between the two groups of processing blocks, and transferring the single-frame images and the intermediate frame images in the two groups of processing blocks to the buffer block according to the transmission order; S500: Building a data transmission link between the left subtree and a preset terminal, processing the buffer block popped into the left subtree, wherein the processing includes: decoding, resizing, color conversion and rendering, and after processing, transferring to the data transmission link.

2. The method for dynamic image display according to claim 1, characterized in that: The S100 includes: Locate the entrance of the partition tree, embed an initial node into the entrance, use the initial node as a receiving end, build an image receiving channel, and after verification, open the channel to a preset terminal; After the channel transmits the image to the initial node, the image is split in the initial node, and each frame is exported as a single picture to obtain a single frame image; Collect the properties of a single frame and number them.

3. The image dynamic display method according to claim 2, characterized in that: The S200 includes: Collect the display requirements of the image, set up a number of data stacks at the middle trunk, wherein each of the data stacks is mounted with four groups of blocks, and the arrangement order of the blocks is marked; Constructing a play queue in the left subtree, and putting all buffer blocks into the play queue, wherein the buffer blocks are arranged in the play queue according to the numbers; The buffer blocks in the play queue are processed in parallel.

4. The method for dynamic image display according to claim 3, characterized in that: The S300 includes: Based on the trigger, assigning different trigger strategies to the buffer block and the processing block; The triggering strategy is: When the buffer block crosses the trigger and enters the left subtree, the play queue is opened and the buffer block is added; When the processing block crosses the trigger and enters the right subtree, the processing block is initialized, and two single-frame images with adjacent numbers are imported into the processing block using the initial node; After the playback and importing are completed, the buffer blocks and processing blocks are pushed back into the data stack according to the arrangement order.

5. The method for dynamic image display according to claim 4, characterized in that: The S400 includes: Constructing a computing platform for intermediate frames, integrating the optical flow algorithm and interpolation method into the computing platform, and generating intermediate frame images; The number of the intermediate frame images is determined, two groups of processing blocks and intermediate frame images are linked using a serial data bus, and the number is updated.

6. The method for dynamic image display according to claim 3, characterized in that: The S500 includes: Inserting a side chain into the play queue and using the side chain as an entry to the play queue; Building an image processing pipeline in the side chain; Across the data transmission link and the play queue, a single frame image is dynamically displayed using a pre-built frame rate control strategy.

7. The method for dynamic image display according to claim 4, characterized in that: The method further comprises: In the right subtree, a hierarchical recognition model is constructed, and the single frame image is input into the trained hierarchical recognition model; Outputting at least three display levels, wherein the display levels include: foreground, middle ground and background; Compare the changed display levels in the two single-frame images and define them as the difference.

8. The method for dynamic image display according to claim 2, characterized in that: The method further comprises: Marking the initialized blocks in the partition tree as empty blocks, and constructing a recycling strategy for the empty blocks; After all the blocks are put into the data stack, the single frame image is transferred according to the transmission order.

9. An image dynamic display system, characterized in that: The system comprises: The segmentation module is used to construct a partition tree and embed it into the initial node, transfer the received image to the initial node, and segment it into several single-frame images; A configuration module is used to decompose the partition tree into a left subtree, a middle trunk and a right subtree, create a data stack in the middle trunk, and hang four groups of blocks in the data stack, wherein the four groups of blocks are two groups of buffer blocks arranged on the upper side of the data stack and two groups of processing blocks arranged on the lower side of the data stack, and configure the transmission order of the single frame image in the blocks; A pop-up module, used for integrating a trigger at the top of the data stack, activating the trigger, popping the buffer block into the left subtree, and popping the processing block into the right subtree; A transfer module, used to import the two single-frame images before and after into the two groups of processing blocks in the right subtree respectively, and compare the difference between the two single-frame images, determine the active part, calculate the pixel motion of the two single-frame images based on the preset optical flow algorithm, draw the motion vector map of the pixels, and perform motion compensation, generate an intermediate frame image using a preset interpolation method, and insert the intermediate frame image between the two groups of processing blocks, and transfer the single-frame images and the intermediate frame images in the two groups of processing blocks to the buffer block according to the transmission order; The transfer module is used to build a data transmission link between the left subtree and the preset terminal, and process the buffer block popped into the left subtree, wherein the processing includes: decoding, resizing, color conversion and rendering, and after processing, it is transferred to the data transmission link.

10. The image dynamic display system according to claim 9, wherein the segmentation module comprises: An opening unit is used to locate the entrance of the partition tree, embed an initial node into the entrance, build an image receiving channel with the initial node as the receiving end, and open the channel to a preset terminal after verification; An export unit, configured to split the image in the initial node after the channel transmits the image to the initial node, and export each frame as a single picture to obtain a single frame image; The numbering unit is used to collect the attributes of a single frame image and number them.

Citation Information

Patent Citations

  • Three-dimensional visualization simulation method directed at boundary element analysis

    CN102902848A

  • Image processing method and device, electronic equipment and computer readable storage medium

    CN112596843A

  • High-efficiency real-time optical flow method deep learning video frame insertion method

    CN116886959A

  • Frame interpolation method and device based on real-time rendering

    CN117218275A

  • Information processing method and device, electronic equipment and readable storage medium

    CN118334190A