Dynamic display effect optimization method and device, storage medium and display equipment

Abstract

The invention is suitable for the technical field of displays, and provides a dynamic display effect optimization method and device, a storage medium and display equipment, and the method comprises the steps: obtaining a to-be-displayed video; obtaining a dynamic image main body in the picture frame, extracting all joint point coordinates of the dynamic image main body, obtaining a branch position function of the dynamic image main body, and constructing a lattice grid chart; superposing the branch position function and the lattice grid chart, and recording the sub-grids covered by the branch position function as bright spot grids; acquiring grid coordinates of all the bright spot grids to obtain a bright spot set; and generating a to-be-played frame, and outputting the to-be-played frame to the LED dot matrix display panel for playing. The method has the advantages that the character image and the like in the video to be played can be automatically converted and adapted, and the display effect of the display device during dynamic display is remarkably improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of display image processing, and in particular relates to a method, device, storage medium and display device for optimizing dynamic display effects. Background Art

[0002] LED dot matrix display is a display device composed of multiple light-emitting diodes (LEDs) arranged in a matrix form. It presents text, numbers, graphics and dynamic images by controlling the on and off state of each LED. LED matrix display is arranged in a rectangular dot matrix in the form of rows and columns. Each row and column has a large number of LED light-emitting units. The LED at each intersection represents a pixel. The dynamic display of text, images or animation effects is achieved through row and column scanning drive.

[0003] Taking the common monochrome LED dot matrix display as an example, when using it, the user can upload images, text or video content to the processing software, and the software will process these contents into two-dimensional 0-1 information (generally 1 represents the LED at the corresponding pixel position is lit), and then transmit this information to the LED display panel for dynamic or static display.

[0004] However, existing image processing methods make it difficult to automatically process and display content such as human images with complex dynamic effects. The displayed content is often messy, with a large number of discontinuous points between lines, which leads to poor display effects. Especially for LED array displays with a small number of row and column arrays and a low pixel density, the dynamic display effect is very poor. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a method for optimizing dynamic display effects, aiming to solve the problem that existing image processing methods are difficult to automatically process and display content such as character images with more complex dynamic effects, and the displayed content is often relatively messy, with a large number of discontinuous points between lines, and the display effect of the display is poor.

[0006] The embodiment of the present application is implemented by providing a method for optimizing dynamic display effects, the method comprising: Acquire a video to be displayed, and extract picture frames and timing information of the picture frames from the video to be displayed; Acquire the dynamic image main body in the picture frame, extract all the joint point coordinates of the dynamic image main body; obtain the branch position function of the dynamic image main body based on the joint point coordinates, the branch position function is the coordinate function of the line segment formed by connecting two joint points having a connection relationship; Get the number of horizontal dots on the LED dot matrix display panel And the number of vertical dots , construct a dot grid map, the dot grid map contains subgrids; The branch position function is superimposed on the dot grid diagram, and the sub-grids covered by the branch position function are recorded as bright spot grids; the grid coordinates of all the bright spot grids are obtained to obtain a bright spot set; The bright spot set is superimposed with the timing information of the picture frame corresponding to the set to generate a frame to be played, and the frame to be played is output to the LED dot matrix display panel for playing.

[0007] Another object of the embodiment of the present application is to provide a dynamic display effect optimization device, the device comprising: A video processing module to be displayed, used for acquiring the video to be displayed, and extracting picture frames and timing information of the picture frames from the video to be displayed; A branch position function acquisition module is used to acquire the dynamic image main body in the picture frame and extract the coordinates of all joint points of the dynamic image main body; based on the coordinates of the joint points, a branch position function of the dynamic image main body is obtained, wherein the branch position function is a coordinate function of a line segment formed by connecting two joint points having a connection relationship; The dot matrix grid map module is used to obtain the horizontal dot matrix number of the LED dot matrix display panel And the number of vertical dots , construct a dot grid map, the dot grid map contains subgrids; A bright spot set acquisition module is used to superimpose the branch position function with the dot grid map, record the sub-grids covered by the branch position function as bright spot grids; obtain the grid coordinates of all the bright spot grids to obtain a bright spot set; The module for generating frames to be played is used to superimpose the bright spot set with the timing information of the picture frame corresponding to the set to generate frames to be played, and output the frames to be played to the LED dot matrix display panel for playing.

[0008] Another object of an embodiment of the present application is to provide a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the processor executes the steps of the dynamic display effect optimization method as described above.

[0009] Another object of an embodiment of the present application is to provide a display device, including an LED dot matrix display panel, a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the dynamic display effect optimization method as described above, and displays the frame to be played on the LED dot matrix display panel.

[0010] A dynamic display effect optimization method provided in an embodiment of the present application has the outstanding advantage that it can automatically convert and adapt the character images in the video to be played for LED array displays with different pixel densities, thereby avoiding problems such as line breakpoints, blurred images, unclear boundaries, etc. that appear in the display screen obtained by traditional conversion algorithms, and significantly improves the display effect of such display devices during dynamic display. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1 An application environment diagram of a dynamic display effect optimization method provided in an embodiment of the present application; Figure 2 A flowchart of a method for optimizing dynamic display effects provided in an embodiment of the present application; Figure 3 A diagram showing the display effect of a certain text on a dot matrix display provided in an embodiment of the present application; Figure 4 A frame of image in a video to be displayed provided in an embodiment of the present application; Figure 5 An image processed based on a traditional image processing algorithm provided in an embodiment of the present application; Figure 6 A display effect diagram of an LED dot matrix display provided in an embodiment of the present application; Figure 7 Another display effect diagram of an LED dot matrix display provided in an embodiment of the present application; Figure 8 An array matrix array diagram provided in an embodiment of the present application; Fig. 9 A schematic diagram of processing an arc-shaped contour boundary provided in an embodiment of the present application; Fig.10 A schematic diagram of a method for processing a picture frame provided in an embodiment of the present application; Fig.11 A display effect diagram of another LED dot matrix display provided in an embodiment of the present application; Fig.12 A structural block diagram of a dynamic display effect optimization device provided in an embodiment of the present application; Fig.13 FIG. 4 is a block diagram of the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0012] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0013] It is understood that the terms "first", "second", etc. used in this application may be used herein to describe various elements, but unless otherwise specified, these elements are not limited by these terms. These terms are only used to distinguish a first unit or module from another unit or module. For example, a first script may be referred to as a second script, and similarly, a second script may be referred to as a first script without departing from the scope of this application.

[0014] Figure 1 The application environment diagram of the dynamic display effect optimization method provided in the embodiment of the present application is as follows: Figure 1 As shown, in this application environment, a display device 110 and a computer device 120 are included.

[0015] The computer device 120 can be an independent physical server or terminal, or a server cluster composed of multiple physical servers. It can be a cloud server or tablet computer, laptop computer, desktop computer, etc. that provides basic cloud computing services such as cloud server, cloud database, cloud storage and CDN.

[0016] The display device 110 may be a monochrome LED display, an LED display array, etc., but is not limited thereto. The display device 110 and the computer device 120 may be connected via a wired or wireless network, which is not limited in this application.

[0017] In the embodiments of the present application, Figure 3 The figure shows a dot matrix display for a text display effect. Understandably, due to factors such as the large number of oblique lines in the graphics to be displayed, the large inclination angle, and the small number of pixels in the LED display array, the traditional image processing method may cause discontinuities in the low-density LED display array, making it difficult to clearly display images or text information. Although manual adjustment can improve the static image and text display effect of the display, when the display displays dynamic information, the above problems are more serious. There are too many frames, manual error correction is difficult, the animation effect is fuzzy, and the user cannot clearly know the content displayed on the display.

[0018] In one embodiment, Figure 4As shown in the figure, it is a frame of image in a video to be displayed. For the human eye, it can be clearly known based on experience that the target subject to be displayed is a moving portrait, but for the computer, there is no "subjective experience" and the two-dimensional image can only be processed by algorithms. However, the existing image processing algorithms do not have an effective solution that can optimize the display effect of LED displays, especially array displays such as low-density LED displays and monochrome LED displays. Because the image often contains interference factors such as background color, scene elements unrelated to the dynamic effect of the subject, and the shadow background of the scene, the image processed based on the traditional mainstream algorithm is Figure 5 As shown, after the image is input into the LED dot matrix display, the display effect is as follows Figure 6 As shown in the figure, the display cannot clearly display the required video information. Figure 7 The small size of the array shown is more prominent on the display.

[0019] Therefore, if Figure 2 As shown, the present application proposes a method for optimizing dynamic display effects. This embodiment mainly applies this method to the above Figure 1 Taking the computer device 120 in the example, the data processed by the computer device 120 can be output to a cache, a read-only memory for storage, or directly output to an LED panel for direct playback. A method for optimizing dynamic display effects may specifically include the following steps: Step S10, obtaining a video to be displayed, and extracting picture frames and timing information of the picture frames from the video to be displayed.

[0020] In this embodiment, the timing information may refer to time information or sequence information, etc., which is used to record the time or sequence of the corresponding playback of the picture in the video. The OpenCV video processing library can be used to read the video frame by frame, and record the frame index or timestamp for subsequent synchronization with the playback of the LED dot matrix.

[0021] Step S20, obtain the dynamic image body in the picture frame, and extract all the joint point coordinates of the dynamic image body; based on the joint point coordinates, obtain the branch position function of the dynamic image body, and the branch position function is the coordinate function of the line segment formed by two joint points with a connection relationship.

[0022] In this embodiment, the joints of dynamic subjects such as human bodies, animals, cartoon characters, and cursive characters can be detected by using a posture estimation algorithm of a preset model, and branch line segments can be constructed based on adjacent joints. For example, the coordinates of the shoulder joint and the elbow joint define the branches of a human arm. The joints and their topological connection relationships are detected, and a branch function is generated. For example, if the two endpoints of the nth branch are joint points A and B, then the branch position function It is the coordinate function of the line segment formed by the connection from joint point A to joint point B in the screen coordinate system.

[0023] Step S30, obtaining the number of horizontal dots of the LED dot matrix display panel And the number of vertical dots , construct a dot grid map, the dot grid map contains sub-grids.

[0024] In this embodiment, a grid coordinate matrix is ​​generated and mapped to the actual physical position of the LED. According to the number of lamp beads in the horizontal and vertical directions of the LED panel, a coordinate system consisting of p×q grid units is generated, and each grid corresponds to an LED lamp.

[0025] Step S40, superimposing the branch position function with the dot grid diagram, recording the sub-grids covered by the branch position function as bright spot grids; obtaining the grid coordinates of all the bright spot grids to obtain a bright spot set.

[0026] In this embodiment, it is determined which grid cells each branch line segment passes through, and these cells will be marked as “bright spots.” This step is used to generate pixel / grid coordinates covered by the line segment.

[0027] Step S50, superimposing the bright spot set with the timing information of the picture frame corresponding to the set to generate a frame to be played, and outputting the frame to be played to the LED dot matrix display panel for playing.

[0028] In this embodiment, the bright spot grid coordinates corresponding to each frame are bound to its timing information, and the data is packaged into a time series, which is sent to the LED dot matrix display in sequence through the communication protocol. Figure 8 As shown, generally, a hexadecimal array matrix array is transmitted. In this transmission mode, the numerical information representing the unlit LED is generally recorded as 0. However, when the number of LEDs in the LED array is large, the transmission of data "0" also occupies bandwidth, and the amount of data transmitted is large, which may affect the refresh rate of the display. It can be understood that this application can also use this method for data transmission. Preferably, in order to compress the amount of data, only the grid coordinates of the bright spot grid are transmitted.

[0029] The method provided in the embodiment of the present application can automatically process the video to be displayed into a content format suitable for display on an LED array display. By obtaining joint points and branch functions, the method can accurately describe the motion trajectory of a dynamic subject. It is particularly suitable for small-sized array LED displays and can clearly display the target subject with a high contrast between the dark background and the bright subject. The displayed content retains the main lines and has strong continuity. When, for example, a human body is shown running, the bright spot grid changes corresponding to the swinging of the limbs are smoother and more natural.

[0030] As a preferred embodiment of the present application, the branch position function may also have a certain width, that is, each section of the branch position function is "widened" by several rows of display arrays in the same direction on both sides thereof, so as to improve the display effect and make each branch display clearer. The implementation method is to first obtain the direction vector of the line segment AB, obtain the unit normal vector perpendicular to the direction vector, and translate the endpoints on the line segment AB by a unit distance ω on both sides of the normal direction. The widened branch area is the rectangular area surrounded by the four translated endpoints. The widened bright spot grid can be obtained by superimposing the area with the dot grid diagram. The value of ω can be changed according to the actual situation. At the same time, width filling can smooth the edges of the line segments and reduce jaggedness.

[0031] In a preferred embodiment, the method for obtaining the bright spot set further includes: Acquire the dynamic image subject in the picture frame, and extract the contour boundary of the dynamic image subject; Segmenting the contour boundary into a plurality of continuous line segments, and obtaining boundary coordinates of two end points of each of the continuous line segments; Based on the scaling factor, scaling the distance from the boundary coordinate to the nearest branch position function to obtain a scaled coordinate; Based on the scaled coordinates, obtaining a scaled boundary; The scaling boundary is superimposed on the dot grid image, and the sub-grid covered by the area enclosed by the scaling boundary is recorded as a bright spot grid.

[0032] In the embodiment of the present application, considering that a larger array display can display more abundant information, the displayed graphics are further optimized. Since the display density of the LED dot matrix display panel itself is low, the contour boundary of the arc-shaped dynamic image body can be directly converted into a representation of a number of continuous straight line segments connected end to end, which will not significantly affect or reduce the display effect of the original image on the LED dot matrix display panel. Fig. 9 As shown, the arc-shaped contour boundary can be outlined by a number of boundary coordinate points. Based on the coordinate points, a large number of continuous line segments can be obtained. The scaled distance value is as follows Fig. 9 As shown in the annotation, it is used to proportionally change the "fat or thin" information of the graphic.

[0033] In an embodiment of the present application, the outer contour of the dynamic subject is identified by an image segmentation edge detection method. Then, the polygonal approximation method can be used to approximate the continuous curve contour to a broken line segment, reducing the computational complexity while retaining the main shape features. Each contour boundary point is scaled along the normal direction to the nearest branch, and the scaling distance is controlled by the coefficient η. The scaled boundary points are connected in sequence to form a closed polygon as a new dynamic subject display area. Finally, it can be determined whether the center of each grid unit is within the scaling boundary. If it is inside, it is marked as a bright spot grid. This method flexibly controls the size of the display area through the scaling coefficient η. Since only the contour segment endpoints and branch position functions need to be processed to avoid pixel-by-pixel calculations, the required amount of calculations is significantly reduced, and the system's processing speed for videos and images is improved. By accurately controlling the display range of dynamic images, LED panels with different resolutions can be adapted.

[0034] In a preferred embodiment, in the process of scaling the distance from the boundary coordinate to the branch position function closest to it, the scaling direction of the boundary coordinate is: the direction of the line from the boundary coordinate to the nearest point on the branch position function closest to the boundary coordinate.

[0035] In the embodiment of the present application, the scaling direction is along the line connecting the boundary point to the nearest branch point. Each boundary point will be scaled along this direction. When the scaling factor is less than 1, the overall outline will shrink toward the branches, making the displayed subject more compact.

[0036] In a preferred embodiment, based on the scaling factor, the distance from the boundary coordinate to the nearest branch position function is scaled, and the method for obtaining the scaled coordinate is: Let the boundary coordinates be , the scaling factor is η, and the coordinates of the branch position function to the nearest point of the boundary coordinates are ; Then scale the coordinates satisfy: , , .

[0037] In the embodiment of the present application, a method for calculating the scaling coordinates is provided. In this embodiment, the value of the scaling factor η can be adjusted according to actual needs and circumstances to obtain a better display effect. For example, assuming the branch point C(2,3), the boundary point S(5,7), and the scaling factor η=0.5, then: .

[0038] Based on this method, it is possible to achieve scaling in a specific ratio in the direction of the branch points. By scaling, the "fatness" of the dynamic content displayed on the display can be changed, the restoration effect of the original dynamic pattern can be improved, and the system can be adapted to a larger area of ​​LED array display panel.

[0039] In a preferred embodiment, the method of obtaining the dynamic image subject in the picture frame and extracting the coordinates of all joint points of the dynamic image subject is: Acquire the picture frame, crop and / or fill and / or scale the picture frame based on a preset size to obtain an adjusted picture, and construct a picture size coordinate system based on the adjusted picture; Processing the adjusted picture based on a background subtraction algorithm, locating the dynamic target area, and segmenting the foreground dynamic target; Processing the foreground dynamic target based on the posture detection model to obtain posture nodes of the foreground dynamic target and obtain connection relationships between the posture nodes; Obtain the coordinates of all posture nodes in the coordinate system of the screen size to obtain the coordinates of all joint points.

[0040] In the embodiment of the present application, background subtraction is combined with morphological processing to remove noise and avoid false detection. Through the above method, the dynamic image joint points are extracted from the complex video stream in real time and accurately, laying the foundation for the efficient display of the subsequent LED dot matrix.

[0041] In one embodiment, the picture frame is processed based on the method provided in the embodiment of the present application, and the processing method is as follows: Fig.10 As shown: Get each posture node and connection relationship, get the coordinates of all joint points, and then get the branch position ( Fig.10 The final processed display effect is shown in the figure below Fig.11 shown.

[0042] In a preferred embodiment, the method for obtaining the preset size is: Get the number of horizontal dots on the LED dot matrix display panel The number of vertical dots aspect ratio; The ratio of the number of horizontal pixels to the number of vertical pixels of the preset size is an integer multiple of the aspect ratio.

[0043] In an embodiment of the present application, by cropping / filling / scaling, the ratio of the number of horizontal pixels to the number of vertical pixels of a preset size is made an integer multiple of the aspect ratio, so that the resolution of the input content corresponds to the resolution of the display, reducing the possibility of edge blur.

[0044] like Fig.12As shown, in one embodiment, a dynamic display effect optimization device is provided, which can be integrated into the above-mentioned computer device 120, and specifically may include: The video processing module 510 to be displayed is used to obtain the video to be displayed, and extract the picture frames and the timing information of the picture frames from the video to be displayed; The branch position function acquisition module 520 is used to acquire the dynamic image main body in the picture frame, extract all the joint point coordinates of the dynamic image main body; based on the joint point coordinates, obtain the branch position function of the dynamic image main body, the branch position function is the coordinate function of the line segment formed by connecting two joint points having a connection relationship; The dot matrix grid diagram module 530 is used to obtain the number of horizontal dot matrix of the LED dot matrix display panel. And the number of vertical dots , construct a dot grid map, the dot grid map contains subgrids; The bright spot set acquisition module 540 is used to superimpose the branch position function with the dot grid map, record the sub-grids covered by the branch position function as bright spot grids; obtain the grid coordinates of all the bright spot grids to obtain a bright spot set; The frame generation module 550 is used to superimpose the bright spot set with the timing information of the picture frame corresponding to the set to generate a frame to be played, and output the frame to be played to the LED dot matrix display panel for playback.

[0045] In the embodiments of the present application, the explanation and description of the above-mentioned dynamic display effect optimization device can refer to the explanation and description of the above-mentioned corresponding method. For the description of the dynamic display effect optimization method, please refer to the above, which will not be repeated here.

[0046] In the embodiment of the present application, the advantage of the device is that it can automatically convert and adapt the character images in the video to be played for LED array displays with different pixel densities, avoiding problems such as line breakpoints, blurred images, unclear boundaries, etc. that appear in the display screen obtained by traditional conversion algorithms, and significantly improves the display effect of such display devices when performing dynamic displays.

[0047] In one embodiment, the apparatus further comprises: A contour boundary acquisition module, used to acquire the dynamic image subject in the picture frame and extract the contour boundary of the dynamic image subject; A boundary coordinate acquisition module, used to segment the contour boundary into a plurality of continuous line segments, and acquire boundary coordinates of two end points of each continuous line segment; A scaling coordinate acquisition module, used for scaling the distance from the boundary coordinate to the nearest branch position function based on the scaling coefficient to obtain the scaling coordinate; A scaling boundary acquisition module, used to obtain a scaling boundary based on the scaling coordinates; The bright spot grid acquisition module is used to superimpose the zoom boundary with the dot grid image, and record the sub-grid covered by the area surrounded by the zoom boundary as a bright spot grid.

[0048] In the embodiments of the present application, the explanation of the above modules can refer to the above explanation and description of the corresponding methods, which will not be repeated here.

[0049] Fig.13 The internal structure diagram of a computer device in one embodiment is shown. The computer device may specifically be Figure 1 The computer device 120 in FIG. Fig.12 As shown, the computer device includes a processor, a memory, a network interface, an input device and a display screen connected through a system bus. Among them, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program. When the computer program is executed by the processor, the processor can implement a dynamic display effect optimization method. The internal memory may also store a computer program. When the computer program is executed by the processor, the processor can execute a dynamic display effect optimization method. The display screen of the computer device may be a liquid crystal display screen, etc., and the input device of the computer device may be a touch layer covered on the display screen, or a button, trackball or touchpad set on the computer device housing, or an external keyboard, touchpad or mouse, etc.

[0050] Those skilled in the art will understand that Fig.13 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0051] In one embodiment, the dynamic display effect optimization device provided by the present application can be implemented in the form of a computer program. Fig.13 The memory of the device can store various program modules constituting the dynamic display effect optimization device, for example, Fig.12 The video processing module 510 to be displayed, the branch position function acquisition module 520, etc. are shown. The computer program composed of various program modules enables the processor to execute the steps of the dynamic display effect optimization method of each embodiment of the present application described in this specification.

[0052] For example, Fig.13 The computer device shown can be Fig.12 The to-be-displayed video processing module 510 in the dynamic display effect optimization device shown executes step S10. The computer device can execute step S20 through the branch position function acquisition module 520. And so on.

[0053] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the processor executes the steps of the dynamic display effect optimization method as described above.

[0054] In the embodiment of the present application, please refer to the above for the description of the above-mentioned dynamic display effect optimization method, which will not be repeated here.

[0055] In the embodiment of the present application, the program run based on the method stored in the storage medium of the embodiment of the present application has the advantage of being able to automatically convert and adapt the character images in the video to be played for LED array displays of different pixel densities, without the need for manual error correction throughout the entire process, thereby avoiding problems such as line breakpoints, blurred images, unclear boundaries, etc. that appear in the display screen obtained by traditional conversion algorithms, and significantly improving the display effect of such display devices during dynamic display.

[0056] In one embodiment, a display device is provided, including an LED dot matrix display panel, a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the dynamic display effect optimization method as described above, and displays the frame to be played on the LED dot matrix display panel.

[0057] In the embodiment of the present application, the system is a computer hardware system. For the description of the above-mentioned dynamic display effect optimization method, please refer to the above text and will not be repeated here.

[0058] In the embodiment of the present application, the advantage of the system is that it can automatically convert and adapt the characters in the video to be played for LED array displays with different pixel densities, without the need for manual error correction throughout the entire process, thus avoiding problems such as line breakpoints, blurred images, unclear boundaries, etc. that appear in the display screen obtained by traditional conversion algorithms, and significantly improving the display effect of such display devices during dynamic display.

[0059] It should be understood that, although each step in the flow chart of each embodiment of the present application is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is clear explanation in this article, the execution of these steps does not have strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0060] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0061] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0062] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for optimizing dynamic display effects, characterized in that: The method comprises: Acquire a video to be displayed, and extract picture frames and timing information of the picture frames from the video to be displayed; Acquire the dynamic image main body in the picture frame, extract all the joint point coordinates of the dynamic image main body; obtain the branch position function of the dynamic image main body based on the joint point coordinates, the branch position function is the coordinate function of the line segment formed by connecting two joint points having a connection relationship; Get the number of horizontal dots on the LED dot matrix display panel And the number of vertical dots , construct a dot grid map, the dot grid map contains subgrids; The branch position function is superimposed on the dot grid diagram, and the sub-grids covered by the branch position function are recorded as bright spot grids; the grid coordinates of all the bright spot grids are obtained to obtain a bright spot set; The bright spot set is superimposed with the timing information of the picture frame corresponding to the set to generate a frame to be played, and the frame to be played is output to the LED dot matrix display panel for playing.

2. A method for optimizing dynamic display effects according to claim 1, characterized in that: The method for obtaining the highlight set also includes: Acquire the dynamic image subject in the picture frame, and extract the contour boundary of the dynamic image subject; Segmenting the contour boundary into a plurality of continuous line segments, and obtaining boundary coordinates of two end points of each of the continuous line segments; Based on the scaling factor, scaling the distance from the boundary coordinate to the nearest branch position function to obtain a scaled coordinate; Based on the scaled coordinates, obtaining a scaled boundary; The scaling boundary is superimposed on the dot grid image, and the sub-grid covered by the area enclosed by the scaling boundary is recorded as a bright spot grid.

3. A method for optimizing dynamic display effects according to claim 2, characterized in that: In the process of scaling the distance from the boundary coordinate to the branch position function closest to it, the scaling direction of the boundary coordinate is: the direction of the line from the boundary coordinate to the nearest point on the branch position function closest to the boundary coordinate.

4. A method for optimizing dynamic display effects according to claim 2, characterized in that: Based on the scaling factor, the distance from the boundary coordinate to the nearest branch position function is scaled to obtain the scaled coordinate: Let the boundary coordinates be , the scaling factor is η, and the coordinates of the branch position function to the nearest point of the boundary coordinates are ; Then scale the coordinates satisfy: ， ， 。 5. The method for optimizing dynamic display effects according to claim 1, characterized in that: The method of obtaining the dynamic image subject in the picture frame and extracting the coordinates of all joint points of the dynamic image subject is as follows: Acquire the picture frame, crop and / or fill and / or scale the picture frame based on a preset size to obtain an adjusted picture, and construct a picture size coordinate system based on the adjusted picture; Processing the adjusted picture based on a background subtraction algorithm, locating the dynamic target area, and segmenting the foreground dynamic target; Processing the foreground dynamic target based on the posture detection model to obtain posture nodes of the foreground dynamic target and obtain connection relationships between the posture nodes; Obtain the coordinates of all posture nodes in the coordinate system of the screen size to obtain the coordinates of all joint points.

6. A method for optimizing dynamic display effects according to claim 5, characterized in that: The method for obtaining the preset size is: Get the number of horizontal dots on the LED dot matrix display panel The number of vertical dots aspect ratio; The ratio of the number of horizontal pixels to the number of vertical pixels of the preset size is an integer multiple of the aspect ratio.

7. A dynamic display effect optimization device, characterized in that: The device comprises: A video processing module to be displayed, used for acquiring the video to be displayed, and extracting picture frames and timing information of the picture frames from the video to be displayed; A branch position function acquisition module is used to acquire the dynamic image main body in the picture frame and extract the coordinates of all joint points of the dynamic image main body; based on the coordinates of the joint points, a branch position function of the dynamic image main body is obtained, wherein the branch position function is a coordinate function of a line segment formed by connecting two joint points having a connection relationship; The dot matrix grid map module is used to obtain the horizontal dot matrix number of the LED dot matrix display panel And the number of vertical dots , construct a dot grid map, the dot grid map contains subgrids; A bright spot set acquisition module is used to superimpose the branch position function with the dot grid map, record the sub-grids covered by the branch position function as bright spot grids; obtain the grid coordinates of all the bright spot grids to obtain a bright spot set; The module for generating frames to be played is used to superimpose the bright spot set with the timing information of the picture frame corresponding to the set to generate frames to be played, and output the frames to be played to the LED dot matrix display panel for playing.

8. The dynamic display effect optimization device according to claim 7, characterized in that: The device also includes: A contour boundary acquisition module, used to acquire the dynamic image subject in the picture frame and extract the contour boundary of the dynamic image subject; A boundary coordinate acquisition module, used for segmenting the contour boundary into a plurality of continuous line segments, and acquiring boundary coordinates of two end points of each of the continuous line segments; A scaling coordinate acquisition module, used for scaling the distance from the boundary coordinate to the nearest branch position function based on the scaling coefficient to obtain the scaling coordinate; A scaling boundary acquisition module, used to obtain a scaling boundary based on the scaling coordinates; The bright spot grid acquisition module is used to superimpose the zoom boundary with the dot grid image, and record the sub-grid covered by the area surrounded by the zoom boundary as a bright spot grid.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the steps of the dynamic display effect optimization method according to any one of claims 1 to 6.

10. A display device, characterized in that: It comprises an LED dot matrix display panel, a memory and a processor, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the processor executes the steps of the dynamic display effect optimization method as described in any one of claims 1 to 6, and displays the frame to be played on the LED dot matrix display panel.

Images