Image display method and system

Abstract

The invention is suitable for the technical field of image display, and particularly relates to an image display method and system, and the method comprises the steps: S100: constructing a partition tree, embedding an initial node, transmitting a received image to the initial node, and segmenting the image into a plurality of single-frame images; and S200, decomposing the partition tree into a left sub-tree, a middle trunk and a right sub-tree, creating a data stack in the middle trunk, and hanging four groups of blocks in the data stack. According to the method, the left sub-tree and the plurality of blocks are constructed, so that the image is buffered, jamming and pause in the dynamic display process of the image are reduced, the user experience is greatly improved, the left sub-tree and the right sub-tree are integrated, and the partition tree is constructed, so that parallel processing of frame insertion and buffering is realized, the image processing efficiency is greatly improved, and the user experience is improved. And meanwhile, the dynamic display effect of the image is better, and the fluency is higher.

Description

[0001] This application is a divisional application of an invention application with an application date of August 13, 2024, a Chinese application number of 202411108356.7, and an invention title of "An Image Dynamic Display Method and System". Technical Field

[0002] The present invention relates to the technical field of image display, and particularly to an image display method and system. Background Art

[0003] Image dynamic display refers to a technology in computer graphics and multimedia applications that realizes animation effects or real-time display by continuously updating and changing image content. It is widely used in fields such as games, video playback, data visualization, virtual reality, and augmented reality. To obtain high-quality and stable dynamic images, it is necessary to analyze and process the data source; for example, low refresh rates and high response times may cause blurring, tearing, or ghosting phenomena when the image moves quickly; low resolution will affect the clarity and detail presentation of the image and also reduce the smoothness of the dynamic image. By performing frame interpolation and buffering on the data source, the above problems can be well solved.

[0004] Therefore, "how to improve the smoothness of image dynamic display through frame interpolation and buffering" is the technical problem to be solved by the present invention. Summary of the Invention

[0005] The purpose of the present invention is to provide an image display method and system to solve the problem of "how to improve the smoothness of image dynamic display through frame interpolation and buffering" proposed in the above background art.

[0006] To achieve the above purpose, the present invention provides the following technical solutions:

[0007] An image display method, the method comprising:

[0008] S100: Construct a partition tree, embed an initial node, transfer the received image to the initial node, and slice it into several single-frame images;

[0009] S200: Decompose the partition tree into a left subtree, a middle main trunk, and a right subtree, create a data stack within the middle main trunk, and hang four groups of data blocks under the data stack, where the four groups of data blocks are two buffer blocks arranged on the upper side of the data stack and two processing blocks arranged on the lower side of the data stack, and configure the transfer order of the single-frame images in the data blocks;

[0010] S300: Integrate a trigger at the top of the data stack, activate the trigger, pop the buffer blocks into the left subtree, and pop the processing blocks into the right subtree;

[0011] S400: Import the two consecutive single-frame images into two sets of processing blocks in the right subtree respectively, compare the differences between the two single-frame images to determine the active part, calculate the pixel motion of the two single-frame images based on a preset optical flow algorithm, draw the motion vector diagram of the pixels, perform motion compensation, generate an intermediate frame image using a preset interpolation method, insert the intermediate frame image between the two sets of processing blocks, and transfer the single-frame images and the intermediate frame image in the two sets of processing blocks to the buffer block according to the transmission order;

[0012] S500: Establish a data transmission link between the left subtree and a preset terminal, and process the buffer block popped into the left subtree, where the processing includes: decoding, resizing, color conversion, and rendering, and after processing, transfer it into the data transmission link.

[0013] Further, the S100 includes:

[0014] Locate the entrance of the partition tree, embed an initial node into the entrance, use the initial node as the receiving end to establish an image receiving channel, and after verification, open the channel to a preset terminal;

[0015] When the channel transmits the image to the initial node, in the initial node, split the image and export each frame as a single picture to obtain a single-frame image;

[0016] Collect the attributes of the single-frame image and number them.

[0017] Further, the S200 includes:

[0018] Collect the display requirements of the image, set several data stacks at the middle main trunk, where each data stack is mounted with four groups of data blocks, and mark the arrangement order of the data blocks;

[0019] Build a playback queue in the left subtree and include all buffer blocks in the playback queue, where the buffer blocks are arranged in the playback queue according to the numbers;

[0020] Process the buffer blocks in the playback queue in parallel.

[0021] Further, the S300 includes:

[0022] Based on the trigger, assign different trigger strategies to the buffer block and the processing block;

[0023] Among them, the trigger strategy is:

[0024] When the buffer block crosses the trigger and enters the left subtree, start the playback queue and add the buffer block;

[0025] After the processing block crosses the trigger and enters the right subtree, initialize the processing block, and use the initial node to import two adjacent single-frame images with consecutive numbers into the processing block;

[0026] After the playback and import are completed, push the buffer block and the processing block back into the data stack in the stated arrangement order.

[0027] Furthermore, the S400 includes:

[0028] Construct a computing platform for intermediate frames, integrate the optical flow algorithm and the interpolation method into the computing platform to generate intermediate frame images;

[0029] Determine the number of the intermediate frame images, link two groups of processing blocks and intermediate frame images using a serial data bus, and update the numbering.

[0030] Furthermore, the S500 includes:

[0031] Insert a side chain into the playback queue and use the side chain as the entry of the playback queue;

[0032] Construct an image processing pipeline in the side chain;

[0033] Cross the data transmission link and the playback queue, and use a pre-constructed frame rate control strategy to dynamically display single-frame images.

[0034] Furthermore, the method further includes:

[0035] In the right subtree, construct a hierarchical recognition model and input single-frame images into the trained hierarchical recognition model;

[0036] Output at least three display levels, where the display levels include: foreground, middle ground, and background;

[0037] Compare the display levels that change between two consecutive single-frame images and define them as differences.

[0038] Furthermore, the method further includes:

[0039] Mark the initialized data blocks in the partition tree as empty blocks and construct a recycling strategy for the empty blocks;

[0040] When all data blocks are incorporated into the data stack, transfer single-frame images following the transfer order.

[0041] Furthermore, the system includes:

[0042] A splitting module, configured to construct a partition tree, embed an initial node, transmit the received image to the initial node, and split it into several single-frame images;

[0043] Configuration module, used to decompose the partition tree into a left subtree, a middle main trunk, and a right subtree, create a data stack within the middle main trunk, and append four groups of data blocks to the data stack, where the four groups of data blocks are two buffer blocks arranged on the upper side of the data stack and two processing blocks arranged on the lower side of the data stack, and configure the transmission order of the single-frame images in the data blocks;

[0044] Pop-up module, used to integrate a trigger at the top of the data stack, activate the trigger, pop the buffer blocks into the left subtree, and pop the processing blocks into the right subtree;

[0045] Transfer module, used to import two consecutive single-frame images into two processing blocks in the right subtree respectively, compare the differences between the two single-frame images to determine the active part, calculate the pixel motion of the two single-frame images based on a preset optical flow algorithm, draw a motion vector map of the pixels, perform motion compensation, generate an intermediate frame image using a preset interpolation method, insert the intermediate frame image between the two processing blocks, and transfer the single-frame images and the intermediate frame image in the two processing blocks to the buffer blocks according to the transmission order;

[0046] Transfer-in module, used to establish a data transmission link between the left subtree and a preset terminal, and process the buffer blocks popped into the left subtree, where the processing includes: decoding, resizing, color conversion, and rendering, and after processing, transfer into the data transmission link.

[0047] Further, the splitting module includes:

[0048] Open unit, used to locate the inlet of the partition tree, embed an initial node into the inlet, use the initial node as the receiving end to establish an image receiving channel, and after verification, open the channel to a preset terminal;

[0049] Export unit, used to split the image within the initial node after the image is transmitted to the initial node through the channel, and export each frame as a single picture to obtain single-frame images;

[0050] Numbering unit, used to collect the attributes of the single-frame images and number them.

[0051] Compared with the prior art, the beneficial effects of the present invention are:

[0052] 1. By splitting an image into single-frame images, the image can be analyzed more precisely, thereby realizing preprocessing and caching of the image, reducing the computational load during dynamic image display. By constructing a right subtree, frame interpolation of the single-frame images is achieved, greatly improving the detail display effect of the dynamic image and further enhancing the smoothness of dynamic image display. By constructing a left subtree and data blocks, buffering of the image is realized, reducing lags and pauses during dynamic image display and greatly improving the user experience. By integrating the left subtree and the right subtree and constructing a partition tree, parallel processing of frame interpolation and buffering is achieved, greatly improving the image processing efficiency and also making the dynamic image display have a better effect and higher smoothness.

[0053] 2. By identifying the display hierarchy and initializing empty blocks, the data processing volume of the partition tree is reduced, thereby making the processing efficiency of the partition tree higher and the dynamic image display have a better effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] To more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention.

[0055] Figure 1 It is a flowchart of the image display method provided by the embodiment of the present invention;

[0056] Figure 2 It is the first sub-flowchart of the image display method provided by the embodiment of the present invention;

[0057] Figure 3 It is the second sub-flowchart of the image display method provided by the embodiment of the present invention;

[0058] Figure 4 It is the third sub-flowchart of the image display method provided by the embodiment of the present invention;

[0059] Figure 5 It is the fourth sub-flowchart of the image display method provided by the embodiment of the present invention;

[0060] Figure 6 It is the fifth sub-flowchart of the image display method provided by the embodiment of the present invention;

[0061] Figure 7 It is the block diagram of the composition of the image dynamic display system provided by the embodiment of the present invention;

[0062] Figure 8 It is the block diagram of the composition of the splitting module in the image dynamic display system provided by the embodiment of the present invention;

[0063] Figure 9Block diagram of the configuration module in the image dynamic display system provided by the embodiments of the present invention;

[0064] Figure 10 Block diagram of the pop-up module in the image dynamic display system provided by the embodiments of the present invention;

[0065] Figure 11 Block diagram of the transfer module in the image dynamic display system provided by the embodiments of the present invention;

[0066] Figure 12 Block diagram of the transfer-in module in the image dynamic display system provided by the embodiments of the present invention. Detailed implementation manners

[0067] In order to make the objectives, technical solutions and advantages of the present invention clearer and more understandable, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0068] In Embodiment 1, Figure 1 The implementation process of the image display method provided by the embodiments of the present invention is shown, and details are as follows:

[0069] S100: Construct a partition tree, embed an initial node, transmit the received image to the initial node, and divide it into several single-frame images.

[0070] Construct a partition tree and embed an initial node into the partition tree. The partition tree is a tree-like data structure, similar to a tree in nature, which is divided into three parts: left, middle, and right, corresponding to the left subtree, middle trunk, and right subtree in the present application respectively. These three parts are independent of each other and yet interconnected; embed the initial node at a position similar to the root of the tree. The initial node is used to receive and preprocess the image entering the partition tree, and the initial node can also overall manage the left subtree, right subtree, and data blocks, etc.; use the initial node to divide the image into several single-frame images, and the specific quantity should be determined according to the dynamic display requirements of the image.

[0071] S200: Decompose the partition tree into a left subtree, a middle trunk, and a right subtree, create a data stack in the middle trunk, and hang four groups of data blocks under the data stack. The four groups of data blocks are two buffer blocks arranged on the upper side of the data stack and two processing blocks arranged on the lower side of the data stack, and configure the transmission order of the single-frame images in the data blocks.

[0072] Create a data stack within the intermediate backbone, where the data stack is a data structure for storing and managing data; the data stack in this embodiment is mainly used to arrange and manage data blocks. The data blocks follow the principle of "last in, first out" within the data stack, and the data blocks are arranged in a specific order in the data stack. The specific order is that within the data stack, there are two sets of buffer blocks and two sets of processing blocks arranged in sequence from top to bottom. The data blocks are used to analyze and process single-frame images, and two adjacent single-frame images are stored in the two sets of processing blocks respectively.

[0073] For example, in the data stack, there are buffer block one, buffer block two, processing block one, and processing block two arranged in sequence from top to bottom. The single-frame image in processing block one will enter buffer block one via buffer block two in the transmission order, and the data block in buffer block two will enter buffer block two via processing block one.

[0074] S300: Integrate a trigger at the top of the data stack, activate the trigger, pop the buffer blocks into the left subtree, and pop the processing blocks into the right subtree.

[0075] Integrate a trigger at the top of the data stack. When single-frame images are stored in both sets of buffer blocks simultaneously, activate the trigger, pop the two sets of buffer blocks from the data stack into the left subtree, and pop the two sets of processing blocks from the data stack into the right subtree.

[0076] It should be noted that continuing with the above example, when the single-frame images in processing block one and two enter buffer block one and two, there are no single-frame images in processing block one and two at this time.

[0077] S400: Import the two adjacent single-frame images into the two sets of processing blocks in the right subtree respectively, compare the differences between the two single-frame images, determine the active part, based on a preset optical flow algorithm, calculate the pixel motion of the two single-frame images, draw the motion vector diagram of the pixels, and perform motion compensation. Use a preset interpolation method to generate an intermediate frame image, and insert the intermediate frame image between the two sets of processing blocks. According to the transmission order, transfer the single-frame images and the intermediate frame image in the two sets of processing blocks to the buffer blocks.

[0078] Since there are no single-frame images in the two sets of processing blocks, at this time, the two adjacent single-frame images before and after can be imported into the two sets of processing blocks in the right subtree, compare the differences between the two single-frame images, determine the active part, use the optical flow algorithm in the prior art to determine the pixels corresponding to the differences, calculate the pixel motion in the two single-frame images, draw the motion vector diagram of the pixels, and perform motion compensation. Then use the interpolation method in the prior art to generate an intermediate frame image, and insert the intermediate frame image between the two sets of processing blocks. After completing the above operations, after the two sets of buffer blocks enter the data stack, push the two sets of processing blocks containing the intermediate frame image into the data stack.

[0079] S500: Establish a data transmission link between the left subtree and a preset terminal, and process the buffer blocks popped into the left subtree, where the processing includes: decoding, resizing, color conversion, and rendering. After the processing, transfer them into the data transmission link.

[0080] Establish a data transmission link between the left subtree and a preset terminal, where the preset terminal can be a display terminal or other data processing terminals. Process two groups of buffer blocks in parallel, and transfer the single-frame images in the two processed groups of buffer blocks to the data transmission link. Through the data transmission link, play them sequentially in the preset terminal.

[0081] In Embodiment 2, Figure 2 The implementation process of the image display method provided by the embodiment of the present invention is shown. The following details S100 as follows:

[0082] S101: Locate the inlet of the partition tree, embed an initial node into the inlet, use the initial node as the receiving end to establish an image receiving channel, and after verification, open the channel to the preset terminal.

[0083] Locate the inlet of the partition tree and embed the inlet into the initial node. That is, use the initial node to receive the image and use the initial node as the receiving end to establish an image receiving channel. The channel will only be opened after verification, where the preset terminal is the source of the image.

[0084] S102: When the channel transmits the image to the initial node, split the image within the initial node, export each frame as a single picture to obtain a single-frame image.

[0085] When the image is transmitted through the channel into the initial node, use the initial node to preprocess the image, where the preprocessing is to split the image into several single-frame images.

[0086] S103: Collect the attributes of the single-frame image and number them.

[0087] Determine the attributes of the single-frame image, where the attributes include: the pixel size, format, generation time, etc. of the single-frame image, and number the single-frame image according to its position in the image.

[0088] In Embodiment 3, Figure 3 The implementation process of the image display method provided by the embodiment of the present invention is shown. The following details S200 as follows:

[0089] S201: Collect the display requirements of the image, set several data stacks at the middle backbone, where each data stack is mounted with four groups of data blocks, and mark the arrangement order of the data blocks.

[0090] To improve the smoothness of dynamic image display, multiple buffer blocks and corresponding data stacks are created; several data stacks are set in the middle main trunk. Each data stack has the same data structure, and four groups of blocks are mounted in it, and the arrangement order of the blocks is also the same; however, it should be noted that the arrangement order here is the specific order in Embodiment 1.

[0091] S202: Build a playback queue in the left subtree and classify all buffer blocks into the playback queue, where the buffer blocks are arranged in the playback queue according to their numbers.

[0092] After creating multiple groups of buffer blocks, a playback queue for arranging all buffer blocks should be continuously built; using the playback queue and the data transmission link, single-frame images in the buffer blocks are played in sequence, thereby realizing the dynamic display of images.

[0093] In the playback queue, they are arranged in the order of the numbers of single-frame images in the buffer blocks. The advantage of doing this is to avoid frame skipping.

[0094] S203: Process the buffer blocks in the playback queue in parallel.

[0095] Processing the buffer blocks in the playback queue in parallel, the specific processing steps can be to fuse single-frame images in adjacent buffer blocks, or other processing methods.

[0096] In Embodiment 4, Figure 4 The implementation process of the image display method provided by the embodiment of the present invention is shown. The following details S300 as follows:

[0097] S301: Based on the trigger, different trigger strategies are assigned to the buffer block and the processing block;

[0098] Among them, the trigger strategy is:

[0099] When the buffer block crosses the trigger and enters the left subtree, the playback queue is opened and the buffer block is added;

[0100] When the processing block crosses the trigger and enters the right subtree, the processing block is initialized, and two adjacent-numbered single-frame images are imported into the processing block using the initial node. Here, "crossing" means passing through.

[0101] Using the trigger, different processing is performed on the buffer block and the processing block. When the buffer block passes through the trigger and enters the left subtree, the playback queue is opened, and the buffer block containing the single-frame image is added to the playback queue; when the processing block passes through the trigger and enters the right subtree, there are no single-frame images in both groups of processing blocks at this time; the processing block is initialized, and after the initialization is completed, two adjacent-numbered single-frame images are imported into the processing block, and comparison and frame interpolation are continued.

[0102] S302: After the playback and import are completed, push the buffer blocks and processing blocks back into the data stack in the stated arrangement order.

[0103] After the playback is completed, push two sets of buffer blocks into the data stack. After the frame interpolation of two sets of processing blocks is completed, also push them into the data stack, and arrange them below the two sets of buffer blocks in the specific order in Embodiment 1.

[0104] In Embodiment 5, Figure 5 The implementation process of the image display method provided by the embodiment of the present invention is shown. The following details S400 as follows:

[0105] S401: Construct a calculation platform for the intermediate frame, integrate the optical flow algorithm and the interpolation method into the calculation platform, and generate an intermediate frame graph.

[0106] Construct a calculation platform for the intermediate frame, integrate the optical flow algorithm and the interpolation method into the calculation platform, input two adjacent single-frame graphs into the calculation platform, and output to obtain an intermediate frame graph.

[0107] S402: Determine the number of the intermediate frame graphs, link two sets of processing blocks and the intermediate frame graphs by using a serial data bus, and update the number.

[0108] Determine the number of the intermediate frame graphs. For two single-frame graphs with small differences and small pixel movement, a smaller number of intermediate frame graphs can be determined. For two single-frame graphs with large differences and large pixel movement, a larger number of intermediate frame graphs can be determined. Determining different numbers of intermediate frame graphs can improve the detail display effect of the dynamic image and ensure the smooth transition of the intermediate frame graphs.

[0109] Link the processing blocks storing two adjacent single-frame graphs and the corresponding intermediate frame graphs by using a serial data bus, and assign corresponding numbers to the intermediate frame graphs. The advantage of doing this is that it can further ensure the smooth transition between the single-frame graphs and the intermediate frame graphs, and at the same time avoid frame skipping.

[0110] In Embodiment 6, Figure 6 The implementation process of the image display method provided by the embodiment of the present invention is shown. The following details S500 as follows:

[0111] S501: Insert a side chain into the playback queue, and use the side chain as the entry of the playback queue.

[0112] Insert a side chain into the playback queue, and use the side chain as the entry of the playback queue. That is to say, before the single-frame graph enters the playback queue, it needs to be processed by the side chain first.

[0113] S502: Construct an image processing pipeline in the side chain.

[0114] The image processing pipeline does not have special practical significance. It is only a general term for processing steps such as decoding, resizing, color conversion, and rendering. The single-frame image in the side chain is processed using the image processing pipeline, and after the processing is completed, the single-frame image is transferred to the playback queue.

[0115] S503: Across the data transmission link and the playback queue, use the pre-constructed frame rate control strategy to dynamically display the single-frame image.

[0116] After the processed single-frame image is transferred to the playback queue, use the frame rate control strategy to dynamically display the single-frame image across the data transmission link and the playback queue; the meaning of "across" here is to pass through (the same as in Embodiment 4), where the frame rate control strategy is determined by the staff according to the actual dynamic display requirements of the image.

[0117] In Embodiment 7, different from Embodiment 1, in the embodiment of the present invention, the method further includes:

[0118] In the right subtree, construct a hierarchical recognition model and input the single-frame image into the trained hierarchical recognition model.

[0119] Output at least three display levels, where the display levels include: foreground, middle ground, and background.

[0120] Compare the display levels that change in the two consecutive single-frame images before and after, and define them as differences.

[0121] Construct a hierarchical recognition model in the right subtree and train it using the existing data set to improve the accuracy of the hierarchical recognition model; input the single-frame image into the hierarchical recognition model, and the output display levels include: foreground, middle ground, and background.

[0122] Compare the display levels of the two consecutive single-frame images before and after, find the display levels that change among them, and define them as differences.

[0123] In Embodiment 8, different from Embodiment 1, in the embodiment of the present invention, the method further includes:

[0124] Mark the initialized data blocks in the partition tree as empty blocks, and construct a recycling strategy for the empty blocks.

[0125] When all the data blocks are incorporated into the data stack, transfer the single-frame image following the transfer order.

[0126] Initialize the number of blocks in the partition tree as empty blocks, construct a recycling strategy for the empty blocks. The recycling strategy means that after the number of blocks is initialized, it can be used as an empty block again. Fill the adjacent two single-frame images into the empty block to obtain a processing block. After the number of blocks is incorporated into the data stack, transfer the single-frame images according to the transmission order.

[0127] Figure 7 The block diagram of the composition structure of the image dynamic display system provided by the embodiment of the present invention is shown. The image dynamic display system 1 includes:

[0128] A splitting module 11, configured to construct a partition tree, embed an initial node, transmit the received image to the initial node, and split it into several single-frame images;

[0129] A configuration module 12, configured to decompose the partition tree into a left subtree, a middle main trunk, and a right subtree, create a data stack in the middle main trunk, and hang four groups of number blocks under the data stack. Among them, the four groups of number blocks are two groups of buffer blocks arranged on the upper side of the data stack and two groups of processing blocks arranged on the lower side of the data stack, and configure the transmission order of the single-frame images in the number blocks;

[0130] A pop-up module 13, configured to integrate a trigger at the top of the data stack, activate the trigger, pop the buffer block into the left subtree, and pop the processing block into the right subtree;

[0131] A transfer module 14, configured to import the front and back two single-frame images into two groups of processing blocks in the right subtree respectively, compare the differences between the two single-frame images to determine the active part, calculate the pixel movement of the two single-frame images based on a preset optical flow algorithm, draw the movement vector diagram of the pixels, perform motion compensation, generate an intermediate frame image by using a preset interpolation method, and insert the intermediate frame image between the two groups of processing blocks, and transfer the single-frame images and the intermediate frame images in the two groups of processing blocks to the buffer blocks according to the transmission order;

[0132] A transfer-in module 15, configured to build a data transmission link between the left subtree and a preset terminal, and process the buffer blocks popped into the left subtree. The processing includes: decoding, resizing, color conversion, and rendering, and after processing, transfer into the data transmission link.

[0133] Figure 8 The block diagram of the composition structure of the image dynamic display system provided by the embodiment of the present invention is shown. The splitting module 11 includes:

[0134] An open unit 111, configured to locate the inlet of the partition tree, embed an initial node at the inlet, use the initial node as the receiving end to build an image receiving channel, and after verification, open the channel to a preset terminal;

[0135] An export unit 112, configured to split the image within the initial node after transmitting the image to the initial node through the channel, and export each frame as a single picture to obtain a single-frame image;

[0136] A numbering unit 113, configured to collect the attributes of the single-frame image and number them.

[0137] Figure 9 The composition structure block diagram of the image dynamic display system provided by an embodiment of the present invention is shown. The configuration module 12 includes:

[0138] A marking unit 121, configured to collect the display requirements of the image, set a plurality of data stacks at the intermediate backbone, where each data stack is mounted with four groups of data blocks, and mark the arrangement order of the data blocks;

[0139] An arrangement unit 122, configured to build a playback queue in the left subtree and classify all buffer blocks into the playback queue, where the buffer blocks are arranged in the playback queue according to the numbers.

[0140] A parallel processing unit 123, configured to process the buffer blocks in the playback queue in parallel.

[0141] Figure 10 The composition structure block diagram of the image dynamic display system provided by an embodiment of the present invention is shown. The pop-up module 13 includes:

[0142] An endowing unit 131, configured to endow different trigger strategies to the buffer blocks and processing blocks according to the trigger;

[0143] Where the trigger strategy is:

[0144] When the buffer block crosses the trigger and enters the left subtree, the playback queue is opened and the buffer block is added;

[0145] When the processing block crosses the trigger and enters the right subtree, the processing block is initialized, and two adjacent numbered single-frame images are imported into the processing block by using the initial node;

[0146] A pushing unit 132, configured to push the buffer blocks and processing blocks back into the data stack according to the arrangement order after playback and import are completed.

[0147] Figure 11 The composition structure block diagram of the image dynamic display system provided by an embodiment of the present invention is shown. The transfer module 14 includes:

[0148] A generating unit 141, configured to build a calculation platform for intermediate frames, integrate the optical flow algorithm and the interpolation method into the calculation platform, and generate intermediate-frame images;

[0149] An update unit 142 is configured to determine the number of the intermediate frame images, link two groups of processing blocks and the intermediate frame images by using a serial data bus, and update the numbering.

[0150] Figure 12 The block diagram showing the composition structure of the image dynamic display system provided by the embodiment of the present invention, the transfer module 15 includes:

[0151] An insertion unit 151 is configured to insert a side chain into the playback queue and use the side chain as an entry of the playback queue;

[0152] A construction unit 152 is configured to construct an image processing pipeline in the side chain;

[0153] A spanning unit 153 is configured to span the data transmission link and the playback queue, and perform dynamic display on a single frame image by using a pre-constructed frame rate control strategy.

[0154] The technical features of the above embodiments can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0155] The above embodiments only represent several implementation manners of the present invention. The description thereof is relatively specific and detailed, but it should not be construed as a limitation on the scope of the patent of the present invention. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present invention, several modifications and improvements can be made, and these all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the appended claims.

[0156] The above is only the preferred embodiment of the present invention, and it is not intended to limit the present invention. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An image display method, characterized in that, The method includes: Construct a partition tree, embed an initial node, transfer the received image to the initial node, and split it into several single-frame images; Decompose the partition tree into a left subtree, a middle main trunk, and a right subtree. Set several data stacks at the middle main trunk. Each data stack is mounted with four groups of blocks arranged in sequence. The four groups of blocks are two buffer blocks arranged on the upper side of the data stack and two processing blocks arranged on the lower side of the data stack; Construct a play queue in the left subtree, and classify all buffer blocks into the play queue and arrange them according to the numbers; Integrate a trigger at the top of the data stack. Based on the trigger, assign different trigger strategies to the buffer blocks and the processing blocks. The trigger strategy is as follows: when a buffer block crosses the trigger and enters the left subtree, start the play queue and add the buffer block; when a processing block crosses the trigger and enters the right subtree, initialize the processing block, and use the initial node to import two adjacent single-frame images into the processing block; after the play and import are completed, push the buffer blocks and the processing blocks back into the data stack in the arranged sequence; Import the front and back single-frame images into two groups of processing blocks in the right subtree respectively, compare the differences between the two single-frame images to determine the active part, calculate the pixel motion of the two single-frame images based on a preset optical flow algorithm, draw the motion vector diagram of the pixels, perform motion compensation, generate an intermediate frame image using a preset interpolation method, and insert the intermediate frame image between the two groups of processing blocks. Transfer the single-frame images and the intermediate frame image in the two groups of processing blocks to the buffer blocks in the transmission order; Build a data transmission link between the left subtree and a preset terminal, insert a side chain into the play queue, and use the side chain as the entry of the play queue. Build an image processing pipeline in the side chain, process the single-frame images in the side chain using the image processing pipeline, and then transfer the single-frame images into the play queue; cross the data transmission link and the play queue, and perform dynamic display on the single-frame images using a pre-constructed frame rate control strategy.

2. The image display method according to claim 1, wherein The constructing a partition tree, embedding an initial node, transferring the received image to the initial node, and splitting it into several single-frame images includes: Locate the inlet of the partition tree, embed the initial node into the inlet, use the initial node as the receiving end to build an image receiving channel, and after verification, open the channel to the preset terminal; When the channel transfers the image to the initial node, split the image in the initial node, and export each frame as a single picture to obtain single-frame images; Collect the attributes of the single-frame images and number them.

3. The image display method according to claim 1, wherein After constructing a play queue in the left subtree, classifying all buffer blocks into the play queue and arranging them according to the numbers, it further includes processing the buffer blocks in the play queue in parallel.

4. The image display method according to claim 1, wherein The generating an intermediate frame image includes: Construct a computing platform for the intermediate frame, integrate the optical flow algorithm and the interpolation method into the computing platform, and generate an intermediate frame image; Determine the number of the intermediate frame images, use a serial data bus to link the two groups of processing blocks and the intermediate frame images, and update the numbers.

5. The image display method according to claim 1, wherein The method further includes: In the right subtree, construct a hierarchical recognition model and input a single-frame image into the trained hierarchical recognition model; Output at least three display levels, where the display levels include: foreground, middle ground, and background; Compare the display levels that have changed in two consecutive single-frame images and define them as differences.

6. The image display method according to claim 1, characterized in that, The method further includes: Mark the initialized data blocks in the partition tree as empty blocks and construct a recycling strategy for the empty blocks; After all data blocks are incorporated into the data stack, transfer the single-frame images according to the transfer order.

7. An image display system, characterized in that, The system includes: A splitting module, configured to construct a partition tree, embed an initial node, transfer the received image to the initial node, and split it into several single-frame images; A configuration module, configured to decompose the partition tree into a left subtree, a middle main trunk, and a right subtree, set several data stacks at the middle main trunk, and each data stack is mounted with four groups of data blocks arranged in order. The four groups of data blocks are two groups of buffer blocks arranged on the upper side of the data stack and two groups of processing blocks arranged on the lower side of the data stack; construct a playback queue in the left subtree, incorporate all buffer blocks into the playback queue and arrange them according to the numbers; A popping module, configured to integrate a trigger at the top of the data stack, and based on the trigger, endow different trigger strategies to the buffer blocks and the processing blocks; where the trigger strategy is: when a buffer block crosses the trigger and enters the left subtree, start the playback queue and add the buffer block; when a processing block crosses the trigger and enters the right subtree, initialize the processing block, and use the initial node to import two adjacent single-frame images into the processing block; after playback and import are completed, push the buffer blocks and the processing blocks back into the data stack in order; A transfer module, configured to import two consecutive single-frame images into two groups of processing blocks in the right subtree respectively, compare the differences between the two single-frame images, determine the active part, calculate the pixel motion of the two single-frame images based on a preset optical flow algorithm, draw the motion vector diagram of the pixels, perform motion compensation, generate an intermediate frame image using a preset interpolation method, insert the intermediate frame image between the two groups of processing blocks, and transfer the single-frame images and the intermediate frame images in the two groups of processing blocks to the buffer blocks according to the transfer order; A transfer-in module, configured to establish a data transfer link between the left subtree and a preset terminal, insert a side chain into the playback queue, and use the side chain as the entry of the playback queue. Construct an image processing pipeline in the side chain, process the single-frame images in the side chain using the image processing pipeline, and then transfer the single-frame images into the playback queue; cross the data transfer link and the playback queue, and perform dynamic display on the single-frame images using a pre-constructed frame rate control strategy.

Images