LED display screen control method and device and storage medium

Abstract

The invention relates to the technical field of LED display screen control, in particular to an LED display screen control method and device and a storage medium. Aiming at the problem that the resolution of the to-be-played video is not matched with the LED display screen, whether the adjustment matching degree is qualified or not is judged by adjusting the resolution of the to-be-played video and obtaining the picture white space rate of the to-be-played video; if the matching degree is adjusted to be qualified, taking the window of the current LED display screen of the video to be played as a final video picture window, otherwise, constructing a candidate window set based on the aspect ratio of the LED display screen; screening representative candidate windows based on the main body out-of-bound ratio of each picture frame of each candidate window by identifying a main body object bounding box in each picture frame; if the candidate window needs to be adjusted, obtaining a final video picture window and a display area of the LED display screen according to a main body out-of-bound ratio; the picture adaptation degree and the picture attenuation degree are considered, and the content integrity is considered while the adjustment adaptation degree is improved, so that the overall visual effect of video playing is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of LED display screen control, and relates to an LED display screen control method, device and storage medium. BACKGROUND

[0002] In the use of the LED display screen, the resolution and the aspect ratio of the to-be-played video often do not match the resolution and the aspect ratio of the LED display screen. If the video is simply scaled or stretched, the picture may be distorted, the main object may be missing, and there may be too much white space, which affects the display effect. Meanwhile, in the long-term use of the LED display screen, the screen pixels may be attenuated to different degrees due to aging and other factors, and if the video playing pixel area overlaps the screen pixels, the picture display quality may be further reduced, resulting in poor visual experience.

[0003] However, the prior art has the following problems: 1. The prior art simply scales, splices or manually adjusts the aspect ratio of the video to adapt to the LED display screen, often without considering the influence of the distribution of screen pixel attenuation on the picture, resulting in a part of the adjusted video affecting the visual effect and failing to meet the user's demand for high-quality display effect.

[0004] 2. In the case where the resolution of the to-be-played video does not match the resolution of the LED display screen, the prior art adapts the LED display screen by roughly cropping, without considering the integrity of the video content main body in each frame of picture, which may result in the main body being out of the frame or the loss of key information, or a large amount of white space is used to meet the integrity of the video, resulting in the inadaptation of the playing video picture to the display screen and poor visual effect after adjustment. SUMMARY

[0005] The present application aims to overcome the defects of the prior art and provide an LED display screen control method, device and storage medium.

[0006] To solve the technical problems, the present application provides an LED display screen control method, which comprises the following steps: obtaining the resolution of a to-be-played video and the resolution of an LED display screen, adjusting the resolution of the to-be-played video if the resolutions are different, and obtaining the picture white space rate to determine whether the adjustment is qualified.

[0007] If the adjustment is qualified, the current LED display screen window of the to-be-played video is taken as the final video picture window, otherwise, a candidate window set is constructed by selecting candidate windows on the to-be-played video based on the aspect ratio of the LED display screen.

[0008] The video to be played is frame processed, a subject object bounding box in each picture frame is recognized, a subject out-of-frame ratio of each picture frame of each candidate window in the candidate window set is calculated, a representative candidate window is selected from the candidate window set in combination with a picture fading degree of each candidate window, and whether the representative candidate window needs to be adjusted is determined.

[0009] If the representative candidate window needs to be adjusted, a final video picture window after adjustment is obtained according to the subject out-of-frame ratio of the representative candidate window, the content of the final video picture window is enlarged into the LED display screen in a proportional manner, and a display area of the LED display screen is obtained.

[0010] In a second aspect, the present application provides a device comprising a memory for storing a computer program and a processor for executing the computer program to realize the steps of the control method for the LED display screen.

[0011] In a third aspect, the present application provides a storage medium comprising an LED display screen control program stored on the storage medium, and the LED display screen control program is executed by a processor to realize the steps of the control method for the LED display screen.

[0012] Compared with the prior art, the present application has the following beneficial effects: (1) The present application adjusts the video to be played with a resolution different from that of the LED display screen, judges whether the adjustment matching degree is qualified according to the picture blanking rate, avoids content distortion caused by random video scaling, and ensures the display effect of the video.

[0013] (2) The present application takes the window of the current LED display screen of the video to be played with the qualified adjustment matching degree as the final video picture window, otherwise, candidate windows are selected on the video to be played based on the aspect ratio of the LED display screen, a candidate window set is constructed, and a selection space is provided for subsequent selection of the optimal solution, and the rationality of picture display is ensured by controlling the window size.

[0014] (3) The present application identifies the subject object bounding box in each picture frame, calculates the subject out-of-frame ratio of each picture frame of each candidate window, selects the representative candidate window from the candidate window set through the multi-picture blanking rate and picture fading degree constraint conditions, and determines whether the representative candidate window needs to be adjusted, so as to ensure that the video subject object is not misclipped, quantify the out-of-frame degree of the subject object, and improve the completeness of the adjusted video display.

[0015] (4) The present application obtains the final video picture window after adjustment according to the subject out-of-frame ratio of the representative candidate window, enlarges the content of the final video picture window into the LED display screen in a proportional manner, ensures the integrity of the final playing picture, and improves the adjustment adaptation degree while considering the content integrity, so as to improve the overall visual experience of video playing. BRIEF DESCRIPTION OF DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings needed to be used in the following embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without any creative effort on the basis of these drawings.

[0017] Figure 1 The flow chart of the method steps of the present application.

[0018] Figure 2 The flow chart of the method steps of the present application.

[0019] Figure 3 The flow chart of the method steps of the present application.

[0020] Figure 4 The schematic diagram of the composition of the device of the present application. DETAILED DESCRIPTION

[0021] Various exemplary embodiments of the present application will now be described in detail below with reference to the accompanying drawings. Note that the relative arrangement, numerical expressions, and numerical values of the components and steps set forth in these embodiments are not intended to limit the scope of the present application unless otherwise specifically stated. It should also be understood that the sizes of the various parts shown in the drawings are not drawn to scale for the sake of convenience in description.

[0022] The following description of at least one example embodiment is merely illustrative in nature and is in no way intended to limit the scope of the application or its application or uses. Techniques, methods, and devices known to those of ordinary skill in the relevant art can not be discussed in detail, but should be considered part of the specification when appropriate.

[0023] In all examples shown and discussed herein, any specific values should be interpreted as merely illustrative, and not as limiting. Thus, other examples of the example embodiments can have different values.

[0024] Reference will now be made to Figure 1 As shown, the present application provides a control method of an LED display screen, comprising: S1, obtaining an adjusted picture blank rate based on the resolution of a video to be played and the resolution of the LED display screen, and judging whether the adjustment matching degree is qualified.

[0025] In specific embodiments of the present application, the specific implementation steps of S1 are as follows: S11, obtaining the resolution of the video to be played and the resolution of the LED display screen.

[0026] In the specific embodiments of the present application, the resolution of the video to be played is obtained in the following way: the communication interface 504 of the device 500, after receiving the video file to be played, parses the packaging format of the video file, reads the resolution written during encoding, which is in pixels, for example, 1920x1080.

[0027] The resolution of the LED display screen can be directly obtained from the background database of the LED display screen.

[0028] S12, if the resolution of the video to be played is the same as the resolution of the LED display screen, the video to be played is put into the LED display screen for playing according to the current resolution.

[0029] S13, if the resolutions are different, the resolution of the video to be played is adjusted, and the picture blank rate is obtained to determine whether the matching degree is qualified.

[0030] Considering that when the resolution of the video to be played and the resolution of the LED display screen are different, if the aspect ratio is different, in the scaling process to ensure that the video is not deformed, the video width or height will first reach the corresponding pixel value of the LED display screen, and considering that if the video is to be completely displayed within the LED display screen, the video needs to be scaled to a direction to reach the pixel value of the LED display screen, and the other direction is less than the corresponding pixel value of the LED display screen.

[0031] In addition, when the aspect ratio of the video to be played is greater than or equal to the aspect ratio of the LED display screen, the width of the video to be played should be the same as the width of the LED display screen, and the height should be less than the height of the LED display screen to adapt the video to the LED display screen. Similarly, when the aspect ratio of the video to be played is less than or equal to the aspect ratio of the LED display screen, the height of the video to be played should be the same as the height of the LED display screen.

[0032] Based on this, in the specific embodiments of the present application, the method for determining the matching degree comprises: S131, obtaining the corresponding aspect ratio based on the resolution of the video to be played and the resolution of the LED display screen. The aspect ratio is the ratio of the width pixel value to the height pixel value of the resolution.

[0033] S132, if the aspect ratio of the video to be played is greater than or equal to the aspect ratio of the LED display screen, the scaling ratio is determined based on the width pixel value of the LED display screen and the width pixel value of the video to be played, and the pre-playing resolution of the video to be played is obtained based on the scaling ratio.

[0034] Specifically, the calculation method of the pre-playing resolution of the video to be played is: taking the ratio of the width pixel value of the LED display screen to the width pixel value of the video to be played as the scaling ratio, and taking the product of the scaling ratio and the resolution of the video to be played as the pre-playing resolution of the video to be played.

[0035] S133. Conversely, the scaling ratio is determined based on the height pixel value of the LED display screen and the height pixel value of the video to be played, thus obtaining the pre-playback resolution of the video to be played.

[0036] S134. Based on the pre-playback resolution of the video to be played and the resolution of the LED display screen, calculate the difference in the total number of pixels between the two, and use the ratio of this difference to the number of pixels on the LED display screen as the white space ratio of the screen.

[0037] S135. If the white space ratio of the screen is higher than the set white space ratio threshold, the adjustment matching degree is deemed unqualified; otherwise, the adjustment matching degree is considered qualified.

[0038] In a specific embodiment of the present invention, the white space ratio threshold is set to 20% by default. When the aspect ratio of the LED display screen is equal to 1, the white space ratio threshold can be appropriately reduced. When the aspect ratio of the LED display screen is less than 0.5 or greater than 2, the white space ratio threshold can be appropriately increased. The implementer can set the specific value himself.

[0039] This invention adjusts the video to be played with a resolution different from that of the LED display screen, and obtains the white space ratio of the screen to determine whether the adjustment matching degree is qualified. This avoids arbitrary scaling of the video, which would cause content distortion and ensure the display effect of the video.

[0040] S2. If the matching degree is satisfactory, the final video window is determined; otherwise, a candidate window set is constructed.

[0041] The specific implementation is as follows: S21, if the matching degree is qualified, the current window of the LED display screen of the video to be played is used as the final video screen window. The video to be played is played on the LED display screen according to the pre-playback resolution.

[0042] S22. Conversely, candidate windows are selected on the video to be played based on the aspect ratio of the LED display screen, and a candidate window set is constructed.

[0043] Considering that the mismatch indicates that the blank area on the screen is too large, a candidate window set can be constructed by selecting candidate windows on the video to be played, and the mismatch can be partially cropped to adjust the matching degree.

[0044] Furthermore, considering that the position of the main subject varies during the cropping process, constructing a candidate window set facilitates obtaining all candidate windows that cover the entire video frame to be played.

[0045] Based on this, such as Figure 2 As shown, the method for obtaining the candidate window set includes: S221, when the aspect ratio of the video to be played is greater than the aspect ratio of the LED display screen, obtaining the height pixel value of the video after scaling based on the pre-playback resolution of the video to be played.

[0046] S222. The ratio of the height pixel value of the video to be played after scaling to the set white space threshold is taken as the maximum value of the height pixel value of the candidate window, and the ratio of the height pixel value of the video to be played after scaling is used to form the height pixel range of the candidate window.

[0047] S223. The product of each height pixel value within the height pixel value range of the candidate window and the aspect ratio of the LED display screen is used as the corresponding width pixel value of the candidate window. Based on each height pixel value and the corresponding width pixel value, various basic windows are obtained.

[0048] In this embodiment, the candidate window type corresponding to the maximum value of the height pixel value is a candidate window that just meets the white space rate threshold, and the candidate window type corresponding to the height pixel value of the video to be played after scaling is a candidate window that meets the white space rate of zero.

[0049] S224. Center all types of basic windows in the video frame to be played, and translate them sequentially in the width direction by unit pixel value to obtain each candidate window, forming a candidate window set.

[0050] S225. Similarly, obtain the window candidate set when the aspect ratio of the video to be played is less than the aspect ratio of the LED display screen. The specific acquisition process is as follows: W1. Obtain the width pixel value of the video to be played after scaling based on the pre-playing resolution of the video to be played.

[0051] W2. The ratio of the scaled width pixel value of the video to be played to the set whitespace threshold is taken as the maximum value of the width pixel value of the candidate window, and this value is combined with the scaled width pixel value of the video to be played to form the width pixel range of the candidate window.

[0052] W3. The ratio of the width pixel value within the width pixel value range of the candidate window to the aspect ratio of the LED display screen is used as the corresponding height pixel value of the candidate window to obtain the pixel area of ​​each candidate window, thus obtaining various basic windows.

[0053] W4. Center all types of basic windows in the video frame to be played, and then translate them sequentially in the width direction by unit pixel value to obtain each candidate window, forming a candidate window set.

[0054] This invention uses the window of the LED display screen of the video to be played that meets the matching degree as the final video screen window. Otherwise, it selects candidate windows on the video to be played based on the aspect ratio of the LED display screen to construct a candidate window set, rather than a single fixed window. This provides selection space for subsequent screening of the optimal solution and ensures the rationality of the image display by controlling the window size.

[0055] S3, calculate the subject out-of-frame ratio of each picture frame of each candidate window, screen the representative candidate window, and determine whether the representative candidate window needs to be adjusted.

[0056] Considering that part of the subject content of the video picture may be cropped in each candidate window, directly playing will affect the integrity of the video, therefore, the position of the video subject needs to be analyzed and whether it is cropped needs to be determined to determine the representative candidate window.

[0057] In addition, it is considered that there may be no window in the candidate window that satisfies that the subject of the picture is not out-of-frame, therefore, a representative candidate window with the lowest out-of-frame ratio is selected from each candidate window to facilitate subsequent adjustment based on the window.

[0058] Therefore, the specific implementation of S3 is as follows: S31, frame processing is performed on the video to be played, the subject object bounding box in each picture frame is recognized, and the subject out-of-frame ratio of each picture frame of each candidate window in the candidate window set is calculated.

[0059] In the embodiment, the frame length is set to 20 ms during frame processing, and the specific frame processing means is a prior art, which will not be described in detail.

[0060] It should be noted that the calculation method of the subject out-of-frame ratio of each picture frame of each candidate window includes: S311, the subject object bounding box is obtained by performing semantic segmentation on each picture frame through image semantic segmentation technology, and the pixel points of the bounding box outside the candidate window in each picture frame in the candidate window set are obtained, wherein the semantic segmentation technology is a prior art in the field of image processing, for example, a video semantic segmentation model based on deep learning is used to perform instance segmentation on the framed picture, the largest area or highest confidence foreground object in the model output is recognized as the subject object of the current frame, and the pixel-level mask or the bounding box of the circumscribed rectangle is obtained, and the specific process can be realized in the field, and the present application will not be described in detail.

[0061] S312, the out-of-frame edge of the corresponding candidate window is determined based on the position of the pixel points of the bounding box outside the candidate window, the out-of-frame length of each pixel point from the candidate window is calculated, and the longest out-of-frame length of each out-of-frame edge is screened.

[0062] The Euclidean distance of each pixel point to each point on the candidate window is calculated by the Euclidean distance calculation formula, and the minimum value is taken as the out-of-frame length.

[0063] S313, the sum of the longest out-of-frame length of each out-of-frame edge of each candidate window in each picture frame is obtained, and the ratio of the sum to the length of the non-out-of-frame edge of the candidate window is taken as the subject out-of-frame ratio of each picture frame of each candidate window.

[0064] When the width-to-height ratio of the video to be played is greater than the width-to-height ratio of the LED display screen, the non-out-of-bound edge refers to the upper and lower edges of the video, that is, the width pixel value of the candidate window.

[0065] S32, filtering a representative candidate window from the candidate window set based on the subject out-of-bound ratios of each picture frame of the candidate window set, and determining whether the representative candidate window needs to be adjusted.

[0066] It is considered that the number of windows with the subject out-of-bound ratio of each picture frame being zero may not be unique, at this time, a best candidate window is selected by comprehensively considering the blanking rate and the picture decay degree, and the picture decay degree has a greater influence on the overall picture than the influence of the blanking rate around the video, so the picture decay degree is taken as the first consideration object.

[0067] It is also considered that the picture decay degrees of multiple types of candidate windows may be minimum values at the same time, at this time, a candidate window type corresponding to the minimum area is selected by comparing the pixel areas of the candidate windows, so as to obtain a candidate window with a relatively small blanking rate, and when the selected candidate window type exists in multiple windows with different translation positions, a window closest to the geometric center of the video to be played is selected.

[0068] Based on this, in the specific embodiments of the present application, the step of determining whether the representative candidate window needs to be adjusted comprises: S321, when there is a candidate window with the subject out-of-bound ratio of each picture frame being zero, it is determined that the candidate window does not need to be adjusted, and the number of candidate windows that do not need to be adjusted is counted.

[0069] S322, if the number is unique, the candidate window that does not need to be adjusted is taken as the representative candidate window, otherwise, the picture decay degrees in each candidate window that does not need to be adjusted are calculated, each type of basic window corresponding to the minimum value of the picture decay degree is obtained, a basic window with the minimum pixel area is selected from the basic windows, and is recorded as a candidate type, and the number of candidate windows of the candidate type is counted.

[0070] In addition, it is also necessary to supplement that the calculation method of the picture decay degree in the candidate window that does not need to be adjusted comprises: step one, the decay rates of each pixel point of the LED display screen are retrieved from the background database of the LED display screen.

[0071] The measurement method of the decay rate of each pixel point comprises: first, the LED display screen is tested periodically with different pure color pictures, the color images of the LED display screen of each pure color picture are subjected to gray scale processing, and the actual gray scale values of each pixel point of the LED display screen are obtained.

[0072] Secondly, the standard gray value corresponding to different pure colors is called from the background database of the LED display screen.

[0073] Then, the difference between the actual gray value of each pixel point of the LED display screen under each pure color picture and the corresponding standard gray value is obtained, and the ratio of the difference to the corresponding standard gray value is taken as the attenuation rate of each pixel point.

[0074] Finally, the attenuation rates of each pixel point under different pure colors are counted, the maximum value among them is taken as the attenuation rate of the pixel point, and is updated to the background database of the LED display screen.

[0075] Step two, based on the attenuation rate of each pixel point, the attenuation influencing point of the LED display screen is determined, based on the height pixel value and the corresponding width pixel value of each candidate window without adjustment, combined with the pre-play resolution of the to-be-played video, the play pixel area of the to-be-played video on the LED display screen of each candidate window without adjustment is obtained.

[0076] Among them, the attenuation influencing point refers to all points with a non-zero attenuation rate, or a measurement deviation of 1% can be set, and when the attenuation rate is greater than 1%, it is determined as an attenuation influencing point.

[0077] Specifically, the method for obtaining the play pixel area is: obtaining the magnification according to the ratio of the width pixel value of the LED display screen to the width pixel value of each candidate window without adjustment, obtaining the final video play resolution under each candidate window without adjustment according to the product of the magnification and the pre-play resolution of the to-be-played video, and placing it in the center of the LED display screen area based on the final video play resolution, to obtain the play pixel area on the LED display screen.

[0078] Step three, the attenuation influencing points in the play pixel area of each candidate window without adjustment are obtained, which are recorded as picture attenuation influencing points, the number of attenuation influencing points in the play pixel area is counted, the Euclidean distance between each picture attenuation influencing point and the center pixel point of the LED display screen is obtained, and the weight of each attenuation influencing point is obtained after normalization processing.

[0079] Considering that the closer to the center of the picture, the greater the influence of the attenuation, based on this, the weight acquisition method of each attenuation influencing point is: obtaining the Euclidean distance between each picture attenuation influencing point and the center pixel point of the LED display screen, taking the ratio of the Euclidean distance to the maximum value as the influence distance of each picture attenuation influencing point, and then taking the ratio of the reciprocal of the influence distance of each picture attenuation influencing point to the sum of the reciprocals of all attenuation influencing point influence distances as the weight of the corresponding picture attenuation influencing point.

[0080] Step four, the attenuation rates of each attenuation influencing point in the play pixel area of each candidate window without adjustment are weighted and summed according to the corresponding weights to obtain the attenuation degree.

[0081] S323, when the number of candidate windows of the candidate type is unique, the candidate window of the candidate type is taken as the representative candidate window, when the number of candidate windows of the candidate type is not unique, the Euclidean distance between the geometric center of each candidate window of the candidate type and the video geometric center is calculated, and the candidate window with the shortest distance is selected as the representative candidate window.

[0082] S324, when the body out-of-frame ratio of any candidate window in a certain picture frame is not zero, it is determined that the candidate window needs to be adjusted, the maximum value of the body out-of-frame ratio of each candidate window in each picture frame is obtained, and is recorded as the representative out-of-frame ratio.

[0083] S325, the candidate window with the smallest representative out-of-frame ratio is selected from each candidate window as the representative candidate window.

[0084] The application calculates the body out-of-frame ratio of each candidate window in each picture frame by identifying the body object bounding box in each picture frame, selects the representative candidate window from the candidate window set through the multi-picture margin rate and picture attenuation degree constraint condition, and determines whether the representative candidate window needs to be adjusted, so as to ensure that the video body object is not misclipped, quantify the out-of-frame degree of the body object, and improve the integrity of the display of the adjusted video.

[0085] S4, determine the final video picture window based on the body out-of-frame ratio of the representative candidate window, and play it into the LED display screen.

[0086] The specific implementation of S4 is as follows: S41, if it is determined that the representative candidate window does not need to be adjusted, the representative candidate window is taken as the final video picture window.

[0087] S42, if the representative candidate window needs to be adjusted, the adjusted final video picture window is obtained according to the body out-of-frame ratio of the representative candidate window, and the specific implementation steps are as shown in Figure 3 S421, when the out-of-frame edge is located at the left and right boundaries of the representative candidate window, the maximum value of the out-of-frame length corresponding to the left out-of-frame edge and the maximum value of the out-of-frame length corresponding to the right out-of-frame edge are selected from each picture frame; the sum of the two is calculated and the ratio of the sum to the width pixel value of the representative candidate window is taken as the equal ratio magnification.

[0088] S422, taking the geometric center of the representative candidate window as the center, the width pixel value and the height pixel value are enlarged according to the equal ratio magnification to obtain the height pixel value and the width pixel value of the adjusted representative candidate window.

[0089] S423, the position and out-of-frame length of the out-of-frame edge of the representative candidate window are obtained, the deviation pixel value is calculated, and the translation direction and translation distance are determined based on the position of the out-of-frame edge and the deviation pixel value.

[0090] The specific steps of obtaining the translation direction and the translation distance are as follows: taking the difference between the out-of-bound lengths of the two out-of-bound edges as a deviation pixel value, taking the side with the larger out-of-bound length as the translation direction, and taking half of the deviation pixel value as the translation distance.

[0091] S424, similarly, when the out-of-bound edges are located at the upper and lower boundaries of the representative candidate window, the final video picture window when the out-of-bound edges are located at the upper and lower boundaries is obtained according to the adjustment method when the out-of-bound edges are located at the left and right boundaries of the representative candidate window, and the specific obtaining process is as follows: S4241, selecting the maximum value in the out-of-bound length corresponding to the upper out-of-bound edge and the maximum value in the out-of-bound length corresponding to the lower out-of-bound edge from each picture frame; calculating the sum of the two and the sum of the height pixel values of the representative candidate window, and taking the ratio of the sum of the height pixel values of the representative candidate window as the equal ratio magnification multiple.

[0092] S4242, taking the geometric center of the representative candidate window as the center, the width pixel value and the height pixel value are enlarged according to the equal ratio magnification multiple to obtain the adjusted height pixel value and width pixel value of the representative candidate window.

[0093] S4243, obtaining the position and out-of-bound length of the out-of-bound edge of the representative candidate window, calculating the deviation pixel value, and determining the translation direction and the translation distance based on the position of the out-of-bound edge and the deviation pixel value.

[0094] S43, the content of the final video picture window is enlarged to the LED display screen in an equal ratio, and the specific obtaining process is as follows: based on the resolution of the LED display screen, the width pixel value and the height pixel value of the display screen are obtained, the ratio of the width pixel value or the height pixel value to the pixel value of the corresponding edge of the final video picture window is taken as the magnification ratio, and the magnification value is enlarged to the LED display screen according to the magnification ratio.

[0095] According to the main out-of-bound ratio of the representative candidate window, the adjusted final video picture window is obtained, the content of the final video picture window is enlarged to the LED display screen in an equal ratio, the integrity of the final playing picture is ensured, the adjustment and adaptation degree is improved, and the content integrity is considered at the same time, so that the overall visual experience of video playing is improved.

[0096] Corresponding to the method embodiment above, the device 500 and the control method of the LED display screen in the present application can be mutually corresponding and can be referred to.

[0097] As shown in Figure 4 The device 500 can include a processor 501, a memory 502, a display output interface 503.

[0098] The processor 501 is configured to control the overall operation of the device 500 to complete all or part of the steps of the above-mentioned control method for the LED display screen. The memory 502 is configured to store various types of data to support the operation of the device 500, which may, for example, include instructions for any application or method operating on the device 500, and application-related data, such as pictures, audio, video, and the like.

[0099] The memory 502 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as read-only memory, random access memory, solid state disk, U disk, optical disk, cloud storage space.

[0100] The display output interface 503 is connected to the processor 501 and is configured to output the final display signal processed to the LED display screen.

[0101] The communication component 504 is configured to perform wired or wireless communication between the device 500 and other devices for receiving a video to be played. Wireless communication, such as Wi-Fi, Bluetooth, near field communication (NFC), 2G, 3G or 4G, or a combination of one or more of them, so the corresponding communication component 504 can include a Wi-Fi module, a Bluetooth module, and an NFC module.

[0102] In a preferred embodiment of the present application, a device 500 can be implemented by one or more application-specific integrated circuits, digital signal processors, digital signal processing devices, programmable logic devices, field programmable gate arrays, controllers, microcontrollers, microprocessors or other electronic elements for executing the above-mentioned control method for the LED display screen.

[0103] In another preferred embodiment, a storage medium storing an LED display screen control program is also provided, which implements the steps of the above-mentioned LED display screen control method when executed by a processor. For example, the storage medium can be the above-mentioned memory 502 including program instructions, and the above-mentioned program instructions can be executed by the processor 501 of the device 500 to complete the above-mentioned control method for the LED display screen.

[0104] The above-mentioned embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented by software, the above-mentioned embodiments can be implemented in whole or in part in the form of a computer program product.

[0105] Those skilled in the art can understand that the modules and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0106] In addition, each functional module in each embodiment of the present application can be integrated into one processing module, or each module can exist physically alone, or two or more modules can be integrated into one module.

[0107] The above is merely specific embodiments of the present application, but the protection scope of the present application is not limited thereto, and any modification or replacement within the technical scope disclosed by the present application can be easily thought of by those skilled in the art, and should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0108] Finally, the above is only the preferred embodiment of the present application, and is not intended to limit the present application, and any modification, equivalent replacement, improvement, etc. within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims

1. A method for controlling an LED display screen, characterized in that, The method comprises the following steps: acquiring the resolution of a video to be played and the resolution of an LED display screen, adjusting the resolution of the video to be played if the resolutions are different, and acquiring the picture blank rate to determine whether the adjustment matching degree is qualified; if the adjustment matching degree is qualified, taking the current window of the LED display screen of the video to be played as the final video picture window, otherwise, selecting candidate windows on the video to be played based on the aspect ratio of the LED display screen, and constructing a candidate window set; performing frame processing on the video to be played, identifying the main object bounding box in each picture frame, calculating the main object out-of-frame ratio of each picture frame of each candidate window in the candidate window set, selecting a representative candidate window from the candidate window set in combination with the picture attenuation degree of each candidate window, and determining whether the representative candidate window needs to be adjusted; if the representative candidate window needs to be adjusted, obtaining an adjusted final video picture window according to the main object out-of-frame ratio of the representative candidate window, and enlarging the content of the final video picture window to the LED display screen in equal proportion to obtain the display area of the LED display screen. 2.The method of claim 1, wherein, The method for determining the adjustment matching degree comprises the following steps: acquiring the corresponding aspect ratio based on the resolution of the video to be played and the resolution of the LED display screen; if the aspect ratio of the video to be played is greater than or equal to the aspect ratio of the LED display screen, determining a scaling ratio based on the width pixel value of the LED display screen and the width pixel value of the video to be played, and obtaining a pre-playing resolution of the video to be played based on the scaling ratio; otherwise, determining a scaling ratio based on the height pixel value of the LED display screen and the height pixel value of the video to be played, and obtaining the pre-playing resolution of the video to be played; calculating the difference between the total number of pixel points of the pre-playing resolution of the video to be played and the resolution of the LED display screen, and taking the ratio of the difference to the number of pixel points of the LED display screen as the picture blank rate; if the picture blank rate is higher than a set blank rate threshold, it is determined that the adjustment matching degree is unqualified, otherwise it is considered that the adjustment matching degree is qualified. 3.The method of claim 2, wherein, The method for obtaining the candidate window set comprises the following steps: when the aspect ratio of the video to be played is greater than the aspect ratio of the LED display screen, obtaining the scaled height pixel value of the video to be played based on the pre-playing resolution of the video to be played; taking the ratio of the set blank rate threshold to the scaled height pixel value of the video to be played as the maximum value of the height pixel value of the candidate window, and taking the scaled height pixel value of the video to be played and the maximum value as the height pixel range of the candidate window; taking the product of each height pixel value in the height pixel value range of the candidate window and the aspect ratio of the LED display screen as the corresponding width pixel value of the candidate window, and obtaining each type of basic window according to each height pixel value and the corresponding width pixel value; placing each type of basic window in the center of the picture of the video to be played, and sequentially translating each type of basic window in the width direction by a unit pixel value to obtain each candidate window, and composing the candidate window set; Similarly, the window candidate set when the aspect ratio of the video to be played is less than the aspect ratio of the LED display screen is obtained. 4.The method of claim 3, wherein, The method for calculating the main object out-of-frame ratio of each picture frame of each candidate window comprises the following steps: for each picture frame, obtaining the main object bounding box through semantic segmentation, and obtaining the bounding box pixel points of each candidate window in each picture frame outside the candidate window in the candidate window set; Determine the out-of-window edge of each candidate window based on the position of the pixel points outside the bounding box of the candidate window, calculate the out-of-window length of each pixel point from the candidate window, and screen the longest out-of-window length of each out-of-window edge; Obtain the sum of the longest out-of-window lengths of each out-of-window edge of each candidate window in each frame of picture, and record the ratio of the sum to the length of the non-out-of-window edge of the candidate window as the main out-of-window ratio of each frame of picture of each candidate window.

5. The method of claim 1, wherein, The step of determining whether the candidate window needs to be adjusted comprises: When the main out-of-window ratio of each frame of picture of a certain candidate window is zero, it is determined that the candidate window does not need to be adjusted, and the number of candidate windows that do not need to be adjusted is counted; If the number is unique, the candidate window that does not need to be adjusted is taken as the representative candidate window, otherwise, the picture decay degree of each candidate window that does not need to be adjusted is calculated, the minimum value of the picture decay degree is obtained, the basic window with the smallest pixel area is selected from the basic windows corresponding to the minimum value, and the type of the basic window is recorded as a candidate type, and the number of candidate windows of the candidate type is counted; When the number of candidate windows of the candidate type is unique, the candidate window of the candidate type is taken as the representative candidate window, and when the number of candidate windows of the candidate type is not unique, the Euclidean distance between the geometric center of each candidate window of the candidate type and the geometric center of the video is calculated, and the candidate window with the shortest distance is selected as the representative candidate window; When the main out-of-window ratio of a certain frame of picture of any candidate window is not zero, it is determined that the candidate window needs to be adjusted, the maximum value of the main out-of-window ratio of each frame of picture of each candidate window is obtained, and the maximum value is recorded as a representative out-of-window ratio; The candidate window with the smallest representative out-of-window ratio is selected from each candidate window as the representative candidate window. 6.The method of claim 5, wherein, The calculation method of the picture decay degree in the candidate window that does not need to be adjusted comprises: The decay rate of each pixel point of the LED display screen is called from the background database of the LED display screen; Based on the decay rate of each pixel point, the decay influence point of the LED display screen is determined, the height pixel value and the corresponding width pixel value of each candidate window that does not need to be adjusted are obtained, and the pre-play resolution of the to-be-played video is combined to obtain the play pixel area of the to-be-played video of each candidate window that does not need to be adjusted on the LED display screen; The decay influence point in the play pixel area of each candidate window that does not need to be adjusted is obtained, and the decay influence point is recorded as a picture decay influence point. The number of decay influence points in the play pixel area is counted, the Euclidean distance between each picture decay influence point and the center pixel point of the LED display screen is obtained, and the Euclidean distance is normalized to obtain the weight of each decay influence point; The decay rates of the decay influence points in the play pixel area of each candidate window that does not need to be adjusted are weighted and summed according to the corresponding weights to obtain the decay degree. 7.The method of claim 6, wherein, The measurement method of the decay rate of each pixel point comprises: Periodically test the LED display screen with different pure color pictures, perform gray scale processing on the color images of the LED display screen with each pure color picture to obtain the actual gray scale value of each pixel point of the LED display screen, and simultaneously call the standard gray scale value corresponding to each pure color from the background database of the LED display screen; Obtain the difference between the actual gray scale value and the corresponding standard gray scale value of each pixel point of the LED display screen under each pure color picture, and take the ratio of the difference to the corresponding standard gray scale value as the decay rate of each pixel point. ​ The attenuation rates of each pixel point under different pure colors are counted, the maximum value is taken as the attenuation rate of the pixel point, and is updated to the background database of the LED display screen. 8.The method of claim 7, wherein, The method for obtaining the final video picture window comprises: When the out-of-bound edge is located at the left and right boundaries of the representative candidate window, the maximum value in the out-of-bound length corresponding to the left out-of-bound edge and the maximum value in the out-of-bound length corresponding to the right out-of-bound edge are selected from each picture frame; the sum of the two is calculated and the ratio of the sum of the width pixel values of the representative candidate window to the sum of the width pixel values of the representative candidate window is taken as the equal ratio magnification; The width pixel value and the height pixel value of the representative candidate window are magnified according to the equal ratio magnification to obtain the adjusted height pixel value and width pixel value of the representative candidate window; The position and the out-of-bound length of the out-of-bound edge of the representative candidate window are obtained, the deviation pixel value is calculated, the translation direction and the translation distance are determined based on the position of the out-of-bound edge and the deviation pixel value; Similarly, when the out-of-bound edge is located at the upper and lower boundaries of the representative candidate window, the final video picture window of the out-of-bound edge located at the upper and lower boundaries is obtained according to the adjustment method when the out-of-bound edge is located at the left and right boundaries of the representative candidate window.

9. An apparatus, comprising: It comprises: a memory for storing a computer program; a processor for implementing the steps of the control method for the LED display screen according to any one of claims 1 to 8 when the computer program is executed.

10. A storage medium, characterized by It comprises: The computer storage medium stores an LED display screen control program, and the steps of the LED display screen control method according to any one of claims 1 to 8 are implemented when the processor executes the LED display screen control program.

Images