A method, device, storage medium, and display device for optimizing dynamic display effects

Abstract

The present invention is applicable to the field of display technologies, and provides a method, an apparatus, a storage medium, and a display device for optimizing dynamic display effects. The method includes: obtaining a video to be displayed; obtaining a dynamic image subject in the frame of the picture, extracting the coordinates of all joint points of the dynamic image subject to obtain a branch position function of the dynamic image subject, and constructing a dot matrix grid graph; superimposing the branch position function and the dot matrix grid graph, and marking the sub-grids covered by the branch position function as bright spot grids; obtaining the grid coordinates of all the bright spot grids to obtain a bright spot set; generating a frame to be played, and outputting the frame to be played to an LED dot matrix display panel for playing. The advantage of this application is that it can automatically transform and adapt the human image, etc. in the video to be played, and significantly improve the display effect when such display devices perform dynamic display.

Description

Technical Field

[0001] The present invention belongs to the technical field of display image processing, and particularly relates to a method, device, storage medium and display device for optimizing dynamic display effects. Background Art

[0002] An LED dot matrix display is a display device composed of multiple light-emitting diodes (i.e., LEDs) arranged in a matrix form. By controlling the on / off states of each LED, it presents characters, numbers, graphics, and dynamic images. The LED dot matrix display is arranged in a row-column cross form to form a rectangular dot matrix. Each row and column has a large number of LED light-emitting units. The LED at each intersection represents a pixel, and dynamic display of characters, images, or animation effects is achieved through row-column scanning drive.

[0003] Taking a common monochromatic LED dot matrix display as an example, during use, a user can upload image, text, video content, etc. to the processing software. The software processes this content into two-dimensional 0-1 information (generally, 1 represents that the LED at the corresponding pixel position is lit), and then transmits this information to the LED display panel for dynamic or static display.

[0004] However, existing image processing methods are difficult to automatically process and display content such as human images with relatively complex dynamic effects. Their display content is often relatively messy, with a large number of discontinuous break points between lines, resulting in poor display effects of the display, especially for LED array displays with a small number of row-column arrays and a low pixel density, where their dynamic display effects are very poor. Summary of the Invention

[0005] The purpose of the embodiments of the present application is to provide a method for optimizing dynamic display effects, aiming to solve the problem that existing image processing methods are difficult to automatically process and display content such as human images with relatively complex dynamic effects, their display content is often relatively messy, with a large number of discontinuous break points between lines, and the display effects of the display are poor.

[0006] The embodiments of the present application are implemented as follows. A method for optimizing dynamic display effects is provided, and the method includes:

[0007] Obtain a video to be displayed, and extract the frame of the picture and the timing information of the frame of the picture from the video to be displayed;

[0008] Obtain the dynamic image subject in the frame of the picture, and extract the coordinates of all joint points of the dynamic image subject; based on the joint point coordinates, obtain the branch position function of the dynamic image subject, and the branch position function is the coordinate function of the line segment formed by connecting two joint points with a connection relationship;

[0009] Obtain the number of horizontal dots of the LED dot matrix display panel and the number of vertical dots , construct a dot matrix grid diagram, and the dot matrix grid diagram contains sub-grids;

[0010] Overlay the branch position function with the dot matrix grid diagram, and mark the sub-grids covered by the branch position function as highlighted grids; obtain the grid coordinates of all the highlighted grids to obtain a highlighted set;

[0011] Overlay the highlighted set with the timing information of the corresponding video frame to generate a frame to be played, and output the frame to be played to the LED dot matrix display panel for playback.

[0012] Another object of the embodiments of the present application is to provide a dynamic display effect optimization device, and the device includes:

[0013] A video to be displayed processing module, configured to obtain a video to be displayed, and extract a video frame and the timing information of the video frame from the video to be displayed;

[0014] A branch position function acquisition module, configured to obtain the dynamic image main body in the video frame, and extract the coordinates of all the joint points of the dynamic image main body; based on the joint point coordinates, obtain the branch position function of the dynamic image main body, and the branch position function is the coordinate function of the line segment formed by connecting two joint points with a connection relationship;

[0015] A dot matrix grid diagram module, configured to obtain the number of horizontal dots of the LED dot matrix display panel and the number of vertical dots , construct a dot matrix grid diagram, and the dot matrix grid diagram contains sub-grids;

[0016] A highlighted set acquisition module, configured to overlay the branch position function with the dot matrix grid diagram, and mark the sub-grids covered by the branch position function as highlighted grids; obtain the grid coordinates of all the highlighted grids to obtain a highlighted set;

[0017] A frame to be played generation module, configured to overlay the highlighted set with the timing information of the corresponding video frame to generate a frame to be played, and output the frame to be played to the LED dot matrix display panel for playback.

[0018] Another object of the embodiments of the present application is to provide a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the processor is caused to execute the steps of the above-mentioned dynamic display effect optimization method.

[0019] Another object of the embodiments of the present application is to provide a display device, including an LED dot matrix display panel, a memory, and a processor. A computer program is stored in the memory. When the computer program is executed by the processor, the processor executes the steps of the dynamic display effect optimization method as described above, and displays the frame to be played on the LED dot matrix display panel.

[0020] An advantage of the dynamic display effect optimization method provided by the embodiments of the present application is that it can automatically transform and adapt the human figures in the video to be played for LED array displays with different pixel densities, avoiding problems such as line breaks, blurred images, and unclear boundaries in the display images obtained by traditional transformation algorithms, and significantly improving the display effect during dynamic display of such display devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is an application environment diagram of a dynamic display effect optimization method provided by the embodiments of the present application;

[0022] Figure 2 It is a flowchart of a dynamic display effect optimization method provided by the embodiments of the present application;

[0023] Figure 3 It is a display effect diagram of a dot matrix display for a certain text provided by the embodiments of the present application;

[0024] Figure 4 It is a frame image in a video to be displayed provided by the embodiments of the present application;

[0025] Figure 5 It is an image processed by a traditional image processing algorithm provided by the embodiments of the present application;

[0026] Figure 6 It is a display effect diagram of an LED dot matrix display provided by the embodiments of the present application;

[0027] Figure 7 It is another display effect diagram of an LED dot matrix display provided by the embodiments of the present application;

[0028] Figure 8 It is an array matrix array diagram provided by the embodiments of the present application;

[0029] Figure 9 It is a schematic diagram of processing the arc-shaped contour boundary provided by the embodiments of the present application;

[0030] Figure 10 It is a schematic diagram of a method for processing a frame of an image provided by the embodiments of the present application;

[0031] Figure 11 Another display effect diagram of the LED dot matrix display provided by the embodiment of the present application;

[0032] Figure 12 A structural block diagram of a dynamic display effect optimization device provided by the embodiment of the present application;

[0033] Figure 13 The internal structural block diagram of a computer device in one embodiment. Detailed implementation manners

[0034] In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0035] It can be understood that the terms "first", "second", etc. used in the present application may be used herein to describe various elements, but unless otherwise specified, these elements are not limited by these terms. These terms are only used to distinguish the first unit or module from another unit or module. For example, without departing from the scope of the present application, the first script may be referred to as the second script, and similarly, the second script may be referred to as the first script.

[0036] Figure 1 An application environment diagram of the dynamic display effect optimization method provided by the embodiment of the present application, as Figure 1 shown, in this application environment, it includes a display device 110 and a computer device 120.

[0037] The computer device 120 may be an independent physical server or terminal, or a server cluster composed of multiple physical servers. It may be a cloud server providing basic cloud computing services such as cloud servers, cloud databases, cloud storage, and CDN, or a tablet computer, a laptop computer, a desktop computer, etc.

[0038] The display device 110 may be a monochromatic LED display, an LED display array, etc., but is not limited thereto. The display device 110 and the computer device 120 may be connected by a wired or wireless network, and the present application does not make any restrictions here.

[0039] In the embodiment of the present application, as Figure 3As shown, it is an effect diagram of a dot matrix display showing a certain text. It can be understood that due to factors such as many oblique lines, large inclination angles, and fewer pixel numbers in the LED display array in the content to be displayed, traditional image processing methods may cause discontinuity points in the low-density LED display array, making it difficult to clearly display image or text information. Although manual adjustment can improve the static graphic display effect of the display, when the display shows dynamic information, the above problems are more serious. There are too many frames in the picture, the difficulty of manual error correction is large, the animation effect is blurred, and the user cannot clearly know the content displayed in the display.

[0040] In one embodiment, as Figure 4 shown, it is a frame image in a video to be displayed. For the human eye, based on experience, it can clearly know that the target object to be displayed is a moving portrait. However, for a computer, there is no "subjective experience" and it can only process this two-dimensional image through algorithms. However, there is no effective solution in existing image processing algorithms to optimize the display effect of LED displays, especially array displays such as low-density LED displays and monochrome LED displays. Since the image often contains interference factors such as background colors, scene elements irrelevant to the dynamic effect of the main body, and shadow backgrounds of the scene, the image processed based on traditional mainstream algorithms is as Figure 5 shown. After inputting this image into the LED dot matrix display, the displayed effect is as Figure 6 shown. The display cannot clearly display the required video information, and this problem is more prominent in small-size array displays such as Figure 7 shown.

[0041] Therefore, as Figure 2 shown, this application proposes a method for optimizing dynamic display effects. In this embodiment, this method is mainly exemplified by being applied to the computer device 120 in the above Figure 1 . The data processed by the computer device 120 can be output to a cache or read-only memory for storage, or directly output to the LED panel for direct playback. A method for optimizing dynamic display effects may specifically include the following steps:

[0042] Step S10, obtain the video to be displayed, and extract the frame of the picture and the timing information of the frame of the picture from the video to be displayed.

[0043] In this embodiment, the timing information may refer to time information or sequence information, etc., and is used to record the playing time or sequence corresponding to the picture in the video. The OpenCV video processing library can be used to read the video frame by frame and record the frame index or timestamp for subsequent synchronization with the playback of the LED dot matrix.

[0044] Step S20: Obtain the dynamic image subject in the frame, and extract the coordinates of all the joint points of the dynamic image subject; based on the joint point coordinates, obtain the limb position function of the dynamic image subject, where the limb position function is the coordinate function of the line segment formed by connecting two joint points with a connection relationship.

[0045] In this embodiment, the joint points of dynamic subjects such as humans, animals, cartoon characters, and fancy characters can be detected through the pose estimation algorithm of a preset model, and limb line segments can be constructed based on adjacent joint points. For example, the coordinates of the shoulder joint and the elbow joint define the limb of the human arm. The joint points and their topological connection relationships are detected to generate the limb function. For example, if the two endpoints of the nth limb are joint point A and joint point B, then the limb position function is the coordinate function of the line segment formed by connecting joint point A to joint point B in the frame coordinate system.

[0046] Step S30: Obtain the number of horizontal dots of the LED dot matrix display panel and the number of vertical dots , and construct a dot matrix grid map, where the dot matrix grid map contains sub-grid cells.

[0047] In this embodiment, a grid coordinate matrix is generated and mapped to the actual LED physical positions. According to the number of lamp beads in the horizontal and vertical directions of the LED panel, a coordinate system composed of p×q grid cells is generated, and each grid corresponds to an LED lamp.

[0048] Step S40: Overlay the limb position function with the dot matrix grid map, and mark the sub-grid cells covered by the limb position function as highlighted grid cells; obtain the grid coordinates of all the highlighted grid cells to obtain a highlighted set.

[0049] In this embodiment, it is determined which grid cells each limb line segment passes through, and these cells will be marked as "highlighted". This step is used to generate the pixel / grid coordinates covered by the line segment.

[0050] Step S50: Overlay the highlighted set with the timing information of the frame corresponding to this set to generate a frame to be played, and output the frame to be played to the LED dot matrix display panel for playback.

[0051] In this embodiment, the highlighted grid coordinates corresponding to each frame are bound to their timing information, and the data is encapsulated into a time series and sent to the LED dot matrix in sequence through a communication protocol. Traditional data transmission methods for dot matrix displays such as Figure 8As shown, generally, a hexadecimal array matrix array is transmitted. In this transmission mode, the numerical information representing the unlit LED is generally recorded as 0. However, when the number of LEDs in the LED array is large, the transmission of data "0" also occupies bandwidth, and the amount of data transmitted is large, which may affect the refresh rate of the display. It can be understood that this application can also use this method for data transmission. Preferably, in order to compress the amount of data, only the grid coordinates of the bright spot grid are transmitted.

[0052] The method provided in the embodiment of the present application can automatically process the video to be displayed into a content format suitable for display on an LED array display. By obtaining joint points and branch functions, the method can accurately describe the motion trajectory of a dynamic subject. It is particularly suitable for small-sized array LED displays and can clearly display the target subject with a high contrast between the dark background and the bright subject. The displayed content retains the main lines and has strong continuity. When, for example, a human body is shown running, the bright spot grid changes corresponding to the swinging of the limbs are smoother and more natural.

[0053] As a preferred embodiment of the present application, the branch position function may also have a certain width, that is, each section of the branch position function is "widened" by several rows of display arrays in the same direction on both sides thereof, so as to improve the display effect and make each branch display clearer. The implementation method is to first obtain the direction vector of the line segment AB, obtain the unit normal vector perpendicular to the direction vector, and translate the endpoints on the line segment AB by a unit distance ω on both sides of the normal direction. The widened branch area is the rectangular area surrounded by the four translated endpoints. The widened bright spot grid can be obtained by superimposing the area with the dot grid diagram. The value of ω can be changed according to the actual situation. At the same time, width filling can smooth the edges of the line segments and reduce jaggedness.

[0054] In a preferred embodiment, the method for obtaining the bright spot set further includes:

[0055] Acquire the dynamic image subject in the picture frame, and extract the contour boundary of the dynamic image subject;

[0056] Segmenting the contour boundary into a plurality of continuous line segments, and obtaining boundary coordinates of two end points of each of the continuous line segments;

[0057] Based on the scaling factor, scaling the distance from the boundary coordinate to the nearest branch position function to obtain a scaled coordinate;

[0058] Based on the scaled coordinates, obtaining a scaled boundary;

[0059] The scaling boundary is superimposed on the dot grid image, and the sub-grid covered by the area enclosed by the scaling boundary is recorded as a bright spot grid.

[0060] In the embodiments of the present application, considering that a larger array display can show richer information, the graphics shown are further optimized. Since the display density of the LED dot matrix display panel itself is relatively low, the contour boundary of the arc-shaped dynamic image main body can be directly converted into a representation composed of several consecutive straight line segments connected end to end, and this will not significantly affect or reduce the display effect of the original image on the LED dot matrix display panel. As Figure 9 shown, the arc-shaped contour boundary can be outlined by several boundary coordinate points. Based on the coordinate points, a large number of continuous line segments can be obtained, and the scaling distance value is as shown in Figure 9 the annotation, which is used to change the "fatness" information of the graphic proportionally.

[0061] In the embodiments of the present application, through the image segmentation edge detection method, the outer contour of the dynamic main body is recognized. Then, the polygon approximation method can be used to approximate the continuous curve contour as a broken line segment, reducing the computational complexity while retaining the main shape features. Each contour boundary point is scaled along the normal direction from it to the nearest branch. The scaling distance is controlled by the coefficient η. The scaled boundary points are connected in sequence to form a closed polygon, which is used as the new dynamic main body display area. Finally, it can be judged whether the center of each grid unit is located within the scaled boundary. If it is inside, it is marked as a bright grid. This method flexibly controls the size of the display area through the scaling coefficient η. Since only the end points of the contour line segments and the branch position function need to be processed, avoiding pixel-by-pixel calculation, the required computational amount is significantly reduced, improving the processing speed of the system for videos and images. By precisely controlling the display range of the dynamic image, it adapts to LED panels with different resolutions.

[0062] In a preferred embodiment, during the process of scaling the distance from the boundary coordinate to the nearest branch position function, the scaling direction of the boundary coordinate is: the connection direction from the boundary coordinate to the nearest point on the nearest branch position function from this boundary coordinate.

[0063] In the embodiments of the present application, the scaling direction is along the connection direction from the boundary point to the nearest branch point. Each boundary point will be scaled along this direction. When the scaling coefficient is less than 1, the overall contour will shrink towards the branch, making the displayed main body more compact.

[0064] In a preferred embodiment, based on the scaling coefficient, the method for scaling the distance from the boundary coordinate to the nearest branch position function to obtain the scaled coordinate is:

[0065] Let the boundary coordinate be , the scaling coefficient be η, and the coordinate of the nearest point from the branch position function to the boundary coordinate be ;

[0066] Then the scaled coordinate satisfies:

[0067] ,

[0068] ,

[0069] .

[0070] In the embodiment of the present application, a method for calculating scaled coordinates is given. In this embodiment, the value of the scaling coefficient η can be adjusted according to actual requirements and situations to obtain a better display effect. For example, assuming that the branch point C(2, 3), the boundary point S(5, 7), and the scaling coefficient η = 0.5, then:

[0071] .

[0072] Based on this method, it is possible to achieve scaling in a specific ratio in the direction of the branch point. Through scaling, the "fatness" of the dynamic content displayed on the display can be changed, improving the restoration effect of the original dynamic pattern, and enabling the system to adapt to a larger area of the LED array display panel.

[0073] In a preferred embodiment, the method for obtaining the dynamic image subject in the picture frame and extracting all the joint point coordinates of the dynamic image subject is as follows:

[0074] Obtain the picture frame, crop and / or fill and / or scale the picture frame based on a preset size to obtain an adjusted picture, and construct a picture size coordinate system based on the adjusted picture;

[0075] Process the adjusted picture based on the background subtraction algorithm to locate the dynamic target area and segment the foreground dynamic target;

[0076] Process the foreground dynamic target based on the pose detection model to obtain the pose nodes of the foreground dynamic target and obtain the connection relationship between the pose nodes;

[0077] Obtain the coordinates of all the pose nodes in the picture size coordinate system to obtain all the joint point coordinates.

[0078] In the embodiment of the present application, background subtraction combined with morphological processing is used to remove noise and avoid false detection. Through the above method, the dynamic image joints are extracted in real time and accurately from the complex video stream, laying a foundation for the efficient display of the subsequent LED dot matrix.

[0079] In an embodiment, based on the method provided by the embodiment of the present application, the picture frame is processed, and the processing method is as Figure 10 shown: Obtain each pose node and the connection relationship to obtain all the joint point coordinates, and then obtain the branch position ( Figure 10(the light-colored line segments in it), the final processed display effect diagram is as Figure 11 shown.

[0080] In a preferred embodiment, the method for obtaining the preset size is as follows:

[0081] Obtain the horizontal dot matrix quantity of the LED dot matrix display panel and the vertical dot matrix quantity of the aspect ratio;

[0082] The ratio of the numerical values of the horizontal pixel quantity to the vertical pixel quantity of the preset size is an integer multiple of the aspect ratio.

[0083] In the embodiment of the present application, by cutting / filling / scaling, the ratio of the numerical values of the horizontal pixel quantity to the vertical pixel quantity of the preset size is an integer multiple of the aspect ratio, so as to make the input content resolution correspond to the resolution of the display, and reduce the possibility of edge blurring.

[0084] As Figure 12 shown, in one embodiment, a dynamic display effect optimization device is provided. The dynamic display effect optimization device can be integrated into the above computer device 120, and specifically may include:

[0085] A video to be displayed processing module 510, configured to obtain a video to be displayed, and extract a picture frame and the timing information of the picture frame from the video to be displayed;

[0086] A limb position function obtaining module 520, configured to obtain a dynamic image main body in the picture frame, and extract the coordinate of all joint points of the dynamic image main body; based on the joint point coordinates, obtain a limb position function of the dynamic image main body, and the limb position function is a coordinate function of a line segment formed by connecting two joint points with a connection relationship;

[0087] A dot matrix grid diagram module 530, configured to obtain the horizontal dot matrix quantity of the LED dot matrix display panel and the vertical dot matrix quantity , and construct a dot matrix grid diagram, where the dot matrix grid diagram contains sub-grid;

[0088] A highlight set obtaining module 540, configured to superimpose the limb position function and the dot matrix grid diagram, and record the sub-grid covered by the limb position function as a highlight grid; obtain the grid coordinates of all the highlight grids to obtain a highlight set;

[0089] A frame to be played generating module 550, configured to superimpose the highlight set and the timing information of the picture frame corresponding to the set, generate a frame to be played, and output the frame to be played to the LED dot matrix display panel for playing.

[0090] In the embodiments of the present application, for the explanation and description of the above dynamic display effect optimization device, reference can be made to the explanation and description of the corresponding method above. For the description of the dynamic display effect optimization method, please refer to the above text, and details will not be repeated here.

[0091] In the embodiments of the present application, the advantage of the device is that it can automatically transform and adapt the human figures in the video to be played for LED array displays with different pixel densities, avoiding problems such as line breaks, blurred images, and unclear boundaries in the display images obtained by traditional transformation algorithms, and significantly improving the display effect of such display devices during dynamic display.

[0092] In one embodiment, the device further includes:

[0093] A contour boundary acquisition module, configured to acquire the dynamic image main body in the picture frame and extract the contour boundary of the dynamic image main body;

[0094] A boundary coordinate acquisition module, configured to segmentize the contour boundary into a plurality of continuous line segments and acquire the boundary coordinates of the two end points of each continuous line segment;

[0095] A scaled coordinate acquisition module, configured to scale the distance from the boundary coordinates to the position function of the nearest branch based on a scaling factor to obtain scaled coordinates;

[0096] A scaled boundary acquisition module, configured to obtain a scaled boundary based on the scaled coordinates;

[0097] A highlight grid acquisition module, configured to superimpose the scaled boundary on the dot matrix grid map and mark the sub-grid covered by the area enclosed by the scaled boundary as a highlight grid.

[0098] In the embodiments of the present application, for the explanation of the above modules, reference can be made to the explanation and description of the corresponding method above, and details will not be repeated here.

[0099] Figure 13 Shows the internal structure diagram of a computer device in one embodiment. The computer device may specifically be Figure 1 the computer device 120 in. As Figure 12As shown in the figure, the computer device includes a processor, a memory, a network interface, an input device, and a display screen connected via a system bus. Among them, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and can also store a computer program. When the computer program is executed by the processor, the processor can implement the dynamic display effect optimization method. The internal memory can also store a computer program. When the computer program is executed by the processor, the processor can execute the dynamic display effect optimization method. The display screen of the computer device can be a liquid crystal display screen, etc. The input device of the computer device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the housing of the computer device, or an external keyboard, touchpad, or mouse, etc.

[0100] Those skilled in the art can understand that Figure 13 the structure shown in the figure is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0101] In one embodiment, the dynamic display effect optimization device provided by the present application can be implemented in the form of a computer program, and the computer program can run on a device as shown in Figure 13 the figure. Each program module constituting the dynamic display effect optimization device can be stored in the memory of the device. For example, Figure 12 the to-be-displayed video processing module 510, the branch position function acquisition module 520, etc. shown in the figure. The computer program composed of each program module enables the processor to execute the steps in the dynamic display effect optimization method of each embodiment of the present application described in this specification.

[0102] For example, Figure 13 the computer device shown in the figure can execute step S10 through the to-be-displayed video processing module 510 in the dynamic display effect optimization device as shown in Figure 12 the figure. The computer device can execute step S20 through the branch position function acquisition module 520. And so on.

[0103] In one embodiment, a computer-readable storage medium is provided. A computer program is stored on the computer-readable storage medium. When the computer program is executed by the processor, the processor is enabled to execute the steps of the dynamic display effect optimization method as described above.

[0104] In the embodiments of the present application, for the description of the above dynamic display effect optimization method, please refer to the above text, and details are not described herein again.

[0105] In the embodiments of the present application, the program running based on the method stored in the storage medium of the embodiments of the present application has the advantage that it can automatically transform and adapt the human figures and the like in the video to be played for LED array displays with different pixel densities. The whole process does not require manual error correction, avoiding problems such as line breaks, blurred images, and unclear boundaries in the display images obtained by traditional transformation algorithms, and significantly improving the display effect during dynamic display of such display devices.

[0106] In one embodiment, a display device is provided, including an LED dot matrix display panel, a memory, and a processor. A computer program is stored in the memory. When the computer program is executed by the processor, the processor is caused to execute the steps of the dynamic display effect optimization method as described above, and display the frame to be played on the LED dot matrix display panel.

[0107] In the embodiments of the present application, the system is a computer hardware system. For the description of the above dynamic display effect optimization method, please refer to the above, and details are not described herein again.

[0108] In the embodiments of the present application, the advantage of the present system is that it can automatically transform and adapt the human figures and the like in the video to be played for LED array displays with different pixel densities. The whole process does not require manual error correction, avoiding problems such as line breaks, blurred images, and unclear boundaries in the display images obtained by traditional transformation algorithms, and significantly improving the display effect during dynamic display of such display devices.

[0109] It should be understood that although the steps in the flowcharts of the embodiments of the present application are shown in sequence according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise clearly stated in this application, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, at least some of the steps in each embodiment may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential either, but can be executed alternately or in turn with at least a part of other steps or sub-steps or stages of other steps.

[0110] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, storage, database, or other medium used in the various embodiments provided in the present application can include non-volatile and / or volatile memories. Non-volatile memories can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memories can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), Rambus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and Rambus dynamic RAM (RDRAM), etc.

[0111] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0112] The above-described embodiments only represent several implementation manners of the present application. The description is relatively specific and detailed, but it should not be construed as a limitation on the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application should be subject to the appended claims.

Claims

1. A method for optimizing dynamic display effects, characterized in that: The method comprises: Acquire a video to be displayed, and extract picture frames and timing information of the picture frames from the video to be displayed; Acquire the dynamic image main body in the picture frame, extract all the joint point coordinates of the dynamic image main body; obtain the branch position function of the dynamic image main body based on the joint point coordinates, the branch position function is the coordinate function of the line segment formed by connecting two joint points having a connection relationship; Get the number of horizontal dots on the LED dot matrix display panel And the number of vertical dots , construct a dot grid map, the dot grid map contains subgrids; The branch position function is superimposed on the dot grid diagram, and the sub-grids covered by the branch position function are recorded as bright spot grids; the grid coordinates of all the bright spot grids are obtained to obtain a bright spot set; Superimposing the bright spot set with the timing information of the picture frame corresponding to the set to generate a frame to be played, and outputting the frame to be played to the LED dot matrix display panel for playing; The method for obtaining the highlight set also includes: Acquire the dynamic image subject in the picture frame, and extract the contour boundary of the dynamic image subject; Segmenting the contour boundary into a plurality of continuous line segments, and obtaining boundary coordinates of two end points of each of the continuous line segments; Based on the scaling factor, scaling the distance from the boundary coordinate to the nearest branch position function to obtain a scaled coordinate; Based on the scaled coordinates, obtaining a scaled boundary; The scaling boundary is superimposed on the dot grid image, and the sub-grid covered by the area enclosed by the scaling boundary is recorded as a bright spot grid.

2. A method for optimizing dynamic display effects according to claim 1, characterized in that: In the process of scaling the distance from the boundary coordinate to the branch position function closest to it, the scaling direction of the boundary coordinate is: the direction of the line from the boundary coordinate to the nearest point on the branch position function closest to the boundary coordinate.

3. A method for optimizing dynamic display effects according to claim 1, characterized in that: Based on the scaling factor, the distance from the boundary coordinate to the nearest branch position function is scaled to obtain the scaled coordinate: Let the boundary coordinates be , the scaling factor is η, and the coordinates of the branch position function to the nearest point of the boundary coordinates are ; Then scale the coordinates satisfy: ， ， 。 4. A method for optimizing dynamic display effects according to claim 1, characterized in that: The method of obtaining the dynamic image subject in the picture frame and extracting the coordinates of all joint points of the dynamic image subject is as follows: Acquire the picture frame, crop and / or fill and / or scale the picture frame based on a preset size to obtain an adjusted picture, and construct a picture size coordinate system based on the adjusted picture; Processing the adjusted picture based on a background subtraction algorithm, locating the dynamic target area, and segmenting the foreground dynamic target; Processing the foreground dynamic target based on the posture detection model to obtain posture nodes of the foreground dynamic target and obtain connection relationships between the posture nodes; Obtain the coordinates of all posture nodes in the coordinate system of the screen size to obtain the coordinates of all joint points.

5. A method for optimizing dynamic display effects according to claim 4, characterized in that: The method for obtaining the preset size is: Get the number of horizontal dots on the LED dot matrix display panel The number of vertical dots aspect ratio; The ratio of the number of horizontal pixels to the number of vertical pixels of the preset size is an integer multiple of the aspect ratio.

6. A dynamic display effect optimization device, characterized in that: The device comprises: A video processing module to be displayed, used for acquiring the video to be displayed, and extracting picture frames and timing information of the picture frames from the video to be displayed; A branch position function acquisition module is used to acquire the dynamic image main body in the picture frame and extract the coordinates of all joint points of the dynamic image main body; based on the coordinates of the joint points, a branch position function of the dynamic image main body is obtained, wherein the branch position function is a coordinate function of a line segment formed by connecting two joint points having a connection relationship; The dot matrix grid map module is used to obtain the horizontal dot matrix number of the LED dot matrix display panel And the number of vertical dots , construct a dot grid map, the dot grid map contains subgrids; A bright spot set acquisition module is used to superimpose the branch position function with the dot grid map, record the sub-grids covered by the branch position function as bright spot grids; obtain the grid coordinates of all the bright spot grids to obtain a bright spot set; A frame generation module to be played, used for superimposing the bright spot set with the timing information of the picture frame corresponding to the set to generate a frame to be played, and outputting the frame to be played to the LED dot matrix display panel for playing; The device also includes: A contour boundary acquisition module, used to acquire the dynamic image subject in the picture frame and extract the contour boundary of the dynamic image subject; A boundary coordinate acquisition module, used to segment the contour boundary into a plurality of continuous line segments, and acquire boundary coordinates of two end points of each continuous line segment; A scaling coordinate acquisition module, used for scaling the distance from the boundary coordinate to the nearest branch position function based on the scaling coefficient to obtain the scaling coordinate; A scaling boundary acquisition module, used to obtain a scaling boundary based on the scaling coordinates; The bright spot grid acquisition module is used to superimpose the zoom boundary with the dot grid image, and record the sub-grid covered by the area surrounded by the zoom boundary as a bright spot grid.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the steps of the dynamic display effect optimization method according to any one of claims 1 to 5.

8. A display device, characterized in that: It comprises an LED dot matrix display panel, a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the dynamic display effect optimization method as described in any one of claims 1 to 5, and displays the frame to be played on the LED dot matrix display panel.

Images