Multi-layer mixed broadcast display control method and device as well as equipment and product

Abstract

The present application relates to a multi-layer mixed broadcast display control method and apparatus, as well as equipment and products. The method comprises: obtaining image playback data, including effect images corresponding to a plurality of layer sequences, each effect image being provided with a motion mode and a state switching time for each motion state switching process during motion; calculating the number of gradient frames required for the effect image during the motion state switching process based on the state switching time of each effect image and the frame time slot of the pixel screen; generating a plurality of gradient image frames of the effect image during the motion state switching process based on the motion mode of each effect image according to the corresponding number of gradient frames; determining the frame output timing of the pixel screen according to the frame time slot, synthesizing each effect image and the image frame corresponding to the frame output timing into a display frame in the order of layers, and outputting it to the pixel screen for display. The present application optimizes the multi-layer mixed broadcast display effect of the pixel screen by dynamically calculating the number of gradient frames and refining the gradient processing.

Description

Technical Field

[0001] The present application relates to the field of pixel screen control, and in particular to a multi-layer mixed broadcast display control method and device, as well as equipment and products. Background Art

[0002] When playing mixed images with multiple layers on a pixel screen, traditional technologies often fail to fully consider the delicate frame processing required for each layer before and after motion switching. While traditional methods can achieve basic image content display, the overall visual experience suffers from noticeable stuttering and lacks subtle gradients, resulting in a poor user experience and difficulty achieving a smooth effect.

[0003] Specifically, traditional technologies for processing multi-layered mixed images typically involve multiple layer types, such as background, foreground, and carousel layers. The motion state transition durations (reflecting motion speed) of these layers are often set by the user to vary based on design requirements. However, traditional technologies typically employ a simplified approach to processing these layers: the motion state transition durations of all layers are summed and then divided by the number of layers to obtain a unified intermediate speed value. Based on this unified speed value, the images of each layer are then gradient-processed to achieve a matching effect. While this approach simplifies the calculation process to some extent, it ignores the differences in motion state transition durations between different layers. This not only violates the user's design intent, but also affects the visual experience because the inconsistent motion state transition durations of each layer imply inconsistent transition speeds. Forcing these layers to be consistent can cause the image quality of faster transitions to appear jerky, while slower transitions can appear sluggish, making the overall effect less smooth and natural.

[0004] In addition, pixel screens differ significantly from ordinary high-resolution displays. Pixel screens are typically made up of larger-particle LEDs with larger spacing between them, allowing them to be easily discerned by the human eye. This structural feature places higher demands on the processing of frame effects when displaying images on pixel screens. If the ordinary interpolation technology used on general high-resolution displays is simply transferred to the field of pixel screen control, the control problem of displaying multi-layer mixed images on pixel screens cannot be effectively solved due to the special structure and display principle of pixel screens. Therefore, traditional technologies have obvious limitations in controlling the display of multi-layer mixed images on pixel screens, and a new technical solution is urgently needed to solve the above problems in order to achieve a smoother and more delicate display effect. Summary of the Invention

[0005] The purpose of this application is to provide a multi-layer mixed broadcast display control method and device, as well as equipment and products.

[0006] According to one aspect of the present application, a multi-layer mixed broadcast display control method is provided, comprising:

[0007] Acquire image playback data, the image playback data including a plurality of effect images corresponding to a layer sequence, each effect image being provided with a motion mode and a state switching time, the state switching time being set corresponding to each motion state switching process in a motion process defined by the motion mode;

[0008] According to the state switching time of each effect image and the frame time slot of the pixel screen, the number of gradient frames required for the effect image in the motion state switching process is calculated;

[0009] Based on the motion mode of each effect image, a plurality of gradient image frames of the effect image in the motion state switching process are generated according to the corresponding number of gradient frames, wherein the gradient image frames are used to smoothly transition between the two state image frames before and after the motion state switching;

[0010] The frame output timing of the pixel screen is determined according to the frame time slot, and each effect image and the image frame corresponding to the frame output timing are synthesized into a display frame in layer order, and output to the pixel screen for display.

[0011] According to another aspect of the present application, a multi-layer mixed broadcast display control device is provided, comprising:

[0012] a data acquisition module configured to acquire image playback data, the image playback data including a plurality of effect images corresponding to a layer sequence, each effect image being provided with a motion mode and a state switching time, the state switching time being set corresponding to each motion state switching process in a motion process defined by the motion mode;

[0013] A frame number determination module is configured to calculate the number of gradient frames required for the effect image during the motion state switching process according to the state switching time of each effect image and the frame time slot of the pixel screen;

[0014] An image generation module is configured to generate, based on the motion mode of each effect image, a plurality of gradient image frames of the effect image during the motion state switching process according to a corresponding number of gradient frames, wherein the gradient image frames are used to smoothly transition between the two state image frames before and after the motion state switching;

[0015] The synthesis output module is configured to determine the frame output timing of the pixel screen according to the frame time slot, synthesize each effect image and the image frame corresponding to the frame output timing into a display frame in layer order, and output it to the pixel screen for display.

[0016] According to another aspect of the present application, a multi-layer mixed broadcast display control device is provided, comprising a pixel screen and a controller, wherein the controller comprises a central processing unit and a memory, wherein the central processing unit is used to call and run a computer program stored in the memory to execute the steps of the multi-layer mixed broadcast display control method.

[0017] According to another aspect of the present application, a computer program product is provided, comprising a computer program or computer instructions, wherein when the computer program or computer instructions are called and executed by a central processing unit, the steps of the multi-layer mixed broadcast display control method are executed.

[0018] This application proposes a multi-layer mixing solution for the special display needs of pixel screens. By accurately calculating the state switching time of each effect image and the frame time slot of the pixel screen, the number of gradient frames is dynamically determined, thereby retaining the difference in the duration of the motion state switching of different layers, ensuring the accurate realization of the user's design intention. At the same time, based on the motion mode of each effect image, a gradient image frame is generated, which effectively solves the problem of poor display effect caused by the simple application of ordinary mixing technology in traditional technology, and significantly improves the display effect of multi-layer mixed images on the pixel screen, making the gradient display more delicate and avoiding the jamming phenomenon. In addition, this application synthesizes the image frames of each effect image into display frames in layer order through the frame output timing of the pixel screen, further optimizes the display control, ensures the accuracy and consistency of layer superposition, improves the quality of the final display effect, and provides users with a smoother and more natural visual experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 This is a schematic diagram of the electrical structure of an exemplary multi-layer mixed broadcast display control device of this application;

[0020] Figure 2 Schematic diagram of the flow of a multi-layer mixed broadcast display control method in an embodiment of the present application;

[0021] Figure 3 This is a screenshot of an exemplary graphical user interface of the present application, suitable for allowing users to set parameters such as the speed corresponding to the motion mode and state switching time of the effect image;

[0022] Figure 4 This is a schematic structural diagram of a multi-layer mixed broadcast display control device according to an embodiment of the present application;

[0023] Figure 5 Schematic diagram of the structure of the computer device in the embodiment of the present application. DETAILED DESCRIPTION

[0024] See also Figure 1As can be seen from the structural diagram of a multi-layer mixed broadcast display control device provided by an embodiment of the present application, it includes a controller 1 and a pixel screen 2. The controller 1 is mainly responsible for converting the effect images corresponding to the order of multiple layers contained in the image playback data into display frames, and outputting them to the pixel screen 2, which displays the corresponding images. Specifically, the controller 1 dynamically determines the number of gradient frames, determines the state image frame, and generates a gradient image frame by accurately calculating the state switching time of each effect image and the frame time slot of the pixel screen. The frame output timing of the pixel screen is determined according to the frame time slot, and the state image frames and / or gradient image frames of each effect image corresponding to the frame output timing are synthesized into display frames, which are output to the pixel screen for display, so as to achieve smooth transition and smooth display of multiple layers.

[0025] The controller 1 typically includes a control chip and a communication component. In some embodiments, the controller 1 can also be configured with a power adapter, a control panel, a display screen, etc. as needed. The power adapter is mainly used to convert AC power into DC power to power the entire device. The control chip can be implemented using various embedded chips, such as Bluetooth SoC (System on Chip), WiFi SoC, MCU (Micro Controller Unit), DSP (Digital Signal Processing), and other types of chips. The control chip typically includes a central processing unit and a memory, and the memory and central processing unit are used to store and execute program instructions, respectively, to achieve corresponding functions. The above various types of control chips can have their own communication components, or they can be additionally configured with communication components as needed.

[0026] The communication component can be used to communicate with external devices, such as personal computers or mobile terminals such as smartphones. Users can issue various configuration instructions through their mobile terminals, and the control chip of controller 1 receives these instructions through the communication component, completing basic configuration to control the operation of pixel screen 2. Furthermore, controller 1 can also receive image playback data from mobile terminals or servers through the communication component, controlling the pixel screen's display based on this image playback data.

[0027] The display screen can be used to display various control information so as to cooperate with the buttons in the control panel to support the implementation of human-computer interaction functions. In some embodiments, the control panel and the display screen can be integrated into the same touch screen.

[0028] The pixel screen 2 of the present application can be a curtain light 4 composed of multiple light strips 21, or it can be a product composed of one or more light boards 22. The light board itself can also be composed of multiple light strips 21 or in other ways. Their commonality is that multiple lamp beads 210 are arranged sparsely in a plane space according to a determinant rule. It is not difficult to understand that, unlike a display screen, each lamp bead 210 of the pixel screen constitutes a pixel, but the particles are relatively coarse, thereby forming a lighting product with relatively sparse pixels visually. When the controller 1 needs to control the pixel screen 2 to display an image, it will convert the corresponding effect image into a corresponding image frame, and output the image frame to the display circuit inside the pixel screen 2. The display circuit drives the various lamp beads in the pixel screen 2 to display colors according to the image frame, thereby displaying the image corresponding to the effect image.

[0029] The effect image in this application is usually a single picture file, including but not limited to JPG, PNG, TIF, BMP and other files with bitmap properties. The effect image can be generated by the user's graffiti in the interface canvas, or it can be generated with the help of image processing. When it is necessary to play a mixed broadcast effect of multiple effect images through the pixel screen 2, these effect images can be constructed into an image file package as part of the image playback data of this application. In terms of file format, the image file package can be a file collection composed of multiple image files, such as a Zip or Rar file, or it can be an animation file such as Gif, a video file such as MP4, and other file formats that encode multiple frames of images. As long as the image file package is parsed in advance, the corresponding effect images therein can be obtained to achieve image mixing.

[0030] The image playback data of the present application includes effect images corresponding to the order of multiple layers. In some embodiments, any one or more layers may also include multiple carousel effect images that are played in sequence. It is sufficient to specify the carousel order or carousel duration of each effect image of the same layer so that the controller of the present application can switch and play them in sequence. The image playback data may also include the designation of the motion mode of each layer or even each effect image and the state switching time corresponding to its motion state switching, so that the controller of the present application can call the preset business logic corresponding to the motion mode, determine the various state image frames of the entire motion process according to the state switching time, and serve as the basis for further determining the gradient image frames in the motion state switching process.

[0031] The controller 1 in the multi-layer mixed broadcast display control device of the present application can be installed with a computer program product implemented according to the multi-layer mixed broadcast display control method of the present application. By running the corresponding computer program, the mixed broadcast display control of the pixel screen 2 can be realized. By installing the computer program product of the present application into various multi-layer mixed broadcast display control devices with different performances (such as pixel screen devices, controllers of curtain light products), the upgrade of related products can be achieved. For manufacturers, they only need to upgrade the software of various sold products to be compatible with products of different performances while taking care of products with lower performances, standardize the mixed broadcast business logic, and improve the user experience of the entire product line.

[0032] See also Figure 2 In some embodiments, the multi-layer mixed broadcast display control method of the present application is applied to a multi-layer mixed broadcast display control device, i.e., a local device, and includes:

[0033] Step S5100: Acquire image playback data, the image playback data including a plurality of effect images corresponding to a layer sequence, each effect image being provided with a motion mode and a state switching time, the state switching time being set corresponding to each motion state switching process in the motion process defined by the motion mode;

[0034] Image playback data is the foundation for achieving multi-layer mixed playback. It contains multiple effect images corresponding to the order of the layers, and the layer order can be marked with priority tags. Each effect image not only contains specific image content, but also sets the associated motion mode and state switching time. The state switching time corresponds to each motion state switching process set during the motion process defined by the motion mode. This data is the key parameter for controlling the pixel screen display effect. By accurately acquiring and analyzing this data, it can provide accurate instructions and basis for subsequent display control.

[0035] The acquisition of image playback data can be achieved in a variety of ways. For example, in some embodiments, the image playback data can be stored in a local memory, and the controller obtains the required image playback data by reading a data file in the local memory. In other embodiments, the image playback data can be received from an external server or user terminal via a network interface. For example, a user can upload a file containing image playback data via a mobile terminal or personal computer, and the controller receives these files through a communication component and parses the image playback data therein. In addition, the image playback data can also be directly transmitted to the controller from other devices via wired or wireless communication.

[0036] Effect images, as the core content of image playback data, are the specific images displayed on the pixel screen. Each effect image belongs to a layer, and the same layer can have multiple effect images played sequentially. For example, in a multi-layer display scene containing a background layer, a foreground layer, and a carousel layer, the effect image of the background layer can be a flashing and moving background image, the effect image of the foreground layer can be a dynamic icon or text, and the effect image of the carousel layer can be a series of pictures played sequentially. Moreover, each effect image in the carousel layer can also be animated. The motion mode and state switching time of each effect image are key parameters for achieving dynamic display.

[0037] A motion mode defines the motion of an effect image during display, such as translation, rotation, scaling, or gradient. The motion mode determines the motion scheme corresponding to the effect image's initial and final form. This typically corresponds to pre-set business logic in the controller and is implemented as an interface for direct call execution. Therefore, the motion mode can be used to determine the corresponding state image frames for each state of the effect image during its motion. For example, a translation mode considers each pixel movement of the effect image as a state transition, thereby determining the initial state image frame at the original position before the transition and the target state image frame after the transition. A gradient motion mode, such as a flickering gradient mode, considers each gradient change in the effect image's pixel color value as a state transition, similarly determining the two state image frames before and after each state transition. The same principle applies to other motion modes. It's easy to understand that a motion mode can identify multiple transitions during the effect image's motion, thereby determining the two state image frames before and after each transition. This transition is extremely short compared to the overall motion process.

[0038] The state transition time specifies how long it takes for the effect image to switch from one motion state to another. This refers to the time it takes to complete a motion transition. For example, the time it takes for the effect image to move one pixel in the translation mode mentioned above, or the time it takes for the gradient mode to change one color gradient. A larger state transition time value indicates slower motion; a smaller state transition time value indicates faster motion.

[0039] To understand the concept of state switching time, please refer to Figure 3 , Figure 3This screenshot shows the user interface for customizing the motion mode and state transition time for an effect image in the image playback data before providing the controller with playback data. The "Action" section offers various motion modes, such as a flashing star and a directional arrow. The "Speed" section provides a slider for intuitive speed adjustment, with one side indicating slower speeds and the other indicating faster speeds. At the data level, the user's position on the slider determines a percentage, which the background process matches with a set range to determine the corresponding state transition time. For example, if the range is 40ms to 440ms and the slider is centered, the corresponding percentage is 50%. The range is calculated by subtracting the lower limit from the upper limit (440 - 40 = 400). 50% of 400 equals 200, and adding the lower limit (40) equals 240ms. This indicates a 240ms state transition time for the effect image.

[0040] Step S5200: Calculate the number of gradient frames required for the effect image during the motion state switching process according to the state switching time of each effect image and the frame time slot of the pixel screen;

[0041] Based on the state switching time of each effect image and the frame time slot of the pixel screen, the number of gradient frames required for the effect image during the motion state switching process is calculated, which can achieve a smooth display effect and ensure that the motion state switching of the effect image of each layer can be carried out at a suitable frame rate, thereby avoiding freezes or discontinuities in the display process to match the designer's original design effect for the animation special effects.

[0042] As previously mentioned, state transition time refers to the time it takes for an effect image to switch from one motion state to another. This parameter can be pre-set by the user based on design requirements or adjusted through the user interface. For example, in a translational motion mode, the state transition time can be defined as the time it takes for the effect image to move one pixel; in a gradient motion mode, the state transition time can be defined as the time it takes for the pixel color value of the effect image to change by one gradient. The length of the state transition time directly affects the speed of the motion: the longer the time, the slower the motion; the shorter the time, the faster the motion.

[0043] The frame time slot of a pixel screen is a fundamental parameter of a pixel screen display system. It represents the time interval between each frame output by the pixel screen. This time slot determines the frame output timing of each display frame. The size of the frame time slot depends on the pixel screen's hardware performance, such as the screen's refresh rate. The frame time slot is crucial for calculating the number of transition frames, as it determines how many frames can be inserted within the state switching time to achieve a smooth transition.

[0044] The process for calculating the number of transition frames is as follows: divide the state switching time of each effect image by the pixel screen's frame time slot. The difference between the result and 1 is the total number of frames required. This 1 represents the image frame after the motion state switch. This total number of frames represents the total number of image frames that the pixel screen can output during the state switching time. For example, if the state switching time of an effect image is 240 milliseconds and the pixel screen's frame time slot is 20 milliseconds, the total number of frames required is approximately 11 frames ((240ms / 20ms) - 1 = 11). This calculation ensures that the pixel screen can output a sufficient number of image frames at an appropriate frame rate throughout the state switching process to achieve a smooth motion effect.

[0045] Note that while some embodiments may adjust the total frame count based on a pre-set frame rate adjustment policy, this is not required by default. The calculated total frame count directly reflects the number of gradual transition frames derived from the state switching time and frame time slots, enabling smooth motion state switching.

[0046] Step S5300: Based on the motion mode of each effect image, generate a plurality of gradient image frames of the effect image during the motion state switching process according to the corresponding number of gradient frames, wherein the gradient image frames are used to smoothly transition between the two state image frames before and after the motion state switching;

[0047] A motion mode is the motion pattern that an effect image follows during display. It defines how the image moves from its initial state to its target state. For example, a panning mode indicates that the image moves in a specific direction on the screen; a gradient mode might involve a gradual change in the image's color. Each motion mode has its own corresponding business logic, which is pre-defined in the controller and can be directly called to generate the corresponding state image frame based on the motion mode.

[0048] Regarding motion modes, the present application provides a variety of specific embodiments. For example, in translation motion mode, the position of each pixel of the effect image will gradually change according to the motion direction and speed, generating a series of gradient image frames with different positions. In rotation motion mode, the effect image will gradually rotate around a center point, generating a series of gradient image frames with different angles. In zoom motion mode, the size of the effect image will gradually increase or decrease, generating a series of gradient image frames with different sizes. These specific embodiments demonstrate the flexibility and wide applicability of the present application, which can meet the display requirements in different scenarios.

[0049] The number of gradient frames is calculated based on the state switching time and the pixel screen's frame slot. It determines how many frames are inserted during the motion state switching process to achieve a smooth transition. For example, if the state switching time is 240 milliseconds and the frame slot is 20 milliseconds, the calculated number of gradient frames is 12-1 = 11 frames. This means that during the entire state switching process, 11 gradient image frames need to be generated to fill the transition between the initial state image frame and the target state image frame.

[0050] During the gradient image frame generation process, pixel color values ​​between the initial and target state frames need to be gradually adjusted to achieve a smooth color transition. Specifically, the number of gradient frames refers to the number of intermediate frames inserted between the initial and target state frames, excluding the target state frame itself. Therefore, the number of gradient frames is effectively the total number of frames minus 1.

[0051] Taking color gradient as an example, assuming the pixel color values ​​of the initial state image frame are RGB(255, 0, 5), the pixel color values ​​of the target state image frame are RGB(5, 0, 255), and the number of gradient image frames is 4. This means that 4 gradient image frames need to be generated between the initial state and the target state, plus the target state image frame itself, for a total of 5 transition frames.

[0052] To achieve a smooth color transition, a color difference is calculated and evenly distributed across each gradient image frame. The color difference is the difference between the initial and target color values. In this example, the color difference is RGB(-250, 0, 250). To generate gradient image frames, the color difference is evenly distributed across each gradient image frame. If the number of gradient frames is 4, the color change for each gradient image frame can be calculated by dividing the color difference by the number of gradient frames plus 1 (i.e., the total number of frames). In this example, the total number of frames is 5, so the color change for each gradient image frame is RGB(-50, 0, 50).

[0053] According to the above calculation method, the pixel color values ​​of the generated gradient image frame will be:

[0054] First gradient image frame: RGB(205, 0, 55)

[0055] Second gradient image frame: RGB(155, 0, 105)

[0056] The third gradient image frame: RGB(105, 0, 155)

[0057] Fourth gradient image frame: RGB(55, 0, 205)

[0058] Finally, the pixel color value of the target state image frame is RGB(5, 0, 255). This color transition method ensures a smooth transition from the initial state to the target state and avoids abrupt color changes.

[0059] It's important to note that when generating gradient image frames, changes in color values ​​or other parameters must be integers to ensure pixel accuracy. This means that when calculating color or position changes, appropriate mathematical methods must be used to avoid decimals. For example, rounding or truncation can be used to ensure that all calculations result in integers.

[0060] Step S5400: determine the frame output timing of the pixel screen according to the frame time slot, synthesize each effect image and the image frame corresponding to the frame output timing into a display frame in layer order, and output it to the pixel screen for display.

[0061] The pixel screen's frame output timing is determined by its frame time slot, which is the time interval between each frame output. This parameter directly affects the image frame update frequency. The frame time slot determines the number of image frames the pixel screen can output within a specific timeframe, providing a time base for layer synthesis and display. Each frame output timing is synthesized into a display frame for output.

[0062] When compositing display frames, the image frames corresponding to each effect image need to be overlaid according to the layer order. The layer order is determined by the priority defined in the image playback data, with the background layer typically at the bottom and the foreground layer at the top. For example, in a multi-layer display scene containing a background layer, a carousel layer, and a foreground layer, the effect image frames of the background layer will be composited first, followed by the image frames of the carousel layer, and finally the image frames of the foreground layer. This order ensures that the content of the foreground layer is correctly overlaid on the background layer, achieving the desired visual effect.

[0063] In some embodiments, when image frames of multiple layers are superimposed, deviations may occur due to color superposition. In order to further optimize the display effect, the synthesized image frames can also be color corrected to ensure that the final displayed image color is accurate and consistent, making the final displayed image color more natural and accurate.

[0064] After layer overlay and even color correction, the display frames are output to the pixel screen according to the screen's frame output timing. Thanks to the optimization of these steps, each display frame ensures smooth transitions and fluid display, avoiding visual stuttering or discontinuities caused by layer switching or color changes. By precisely controlling the frame output timing and layer composition order, high-quality multi-layer mixed display effects are achieved, meeting the display requirements of various application scenarios.

[0065] In addition, this application also supports a variety of specific implementations to adapt to different hardware performance and display requirements. For example, on low-performance devices, the display effect can be optimized by reducing the number of gradient frames or simplifying the layer synthesis logic; on high-performance devices, the number of gradient frames can be increased or a more complex color correction algorithm can be used to achieve a more delicate display effect. This flexibility enables this application to be widely applied to various pixel screen display devices, from simple advertising screens to complex stage background display systems, and can provide high-quality multi-layer mixed broadcast display solutions.

[0066] Through the above embodiments, the present application provides an innovative solution to the special display requirements of pixel screens, which can effectively solve the problems existing in traditional technologies and bring significant beneficial effects and technical advantages, including but not limited to:

[0067] First of all, this application obtains image playback data and accurately calculates the state switching time of each effect image and the frame time slot of the pixel screen. It can dynamically determine the number of gradient frames required for each effect image during the motion state switching process, avoiding the disadvantage of traditional technology that all layers are processed at a uniform intermediate speed, thereby retaining the differences in the motion state switching time of different layers, ensuring the accurate realization of the user's design intentions, making the motion effect of each layer more in line with its preset motion mode, and significantly improving the naturalness and smoothness of the display effect.

[0068] Secondly, this application generates gradient image frames in the motion state switching process determined by the motion mode of each effect image according to the corresponding number of gradient frames of each effect image, which is used to smoothly transition the two state image frames before and after the motion state switching. It fully considers the characteristics of the pixel screen composed of lamp beads with larger granularity. Through refined gradient processing, it effectively solves the problem of poor display effect caused by the simple application of ordinary mixing technology in traditional technology. It can significantly improve the display effect of multi-layer mixed images on the pixel screen, make the gradient display more delicate, avoid the jamming phenomenon, and provide users with a smoother and more natural visual experience.

[0069] In addition, this application further optimizes the display control of multi-layer mixed images by synthesizing the corresponding image frames including gradient image frames corresponding to each effect image into display frames in layer order according to the frame output timing of the pixel screen, and outputs them to the pixel screen for display, thereby ensuring the accuracy and consistency of layer overlay and further improving the quality of the final display effect.

[0070] Based on any embodiment of the method of the present application, the number of gradient frames required for the effect image during the motion state switching process is calculated according to the state switching time of each effect image and the frame time slot of the pixel screen, including:

[0071] Step S5210: Obtain a fixed frame output interval of the pixel screen as a frame time slot;

[0072] Once the refresh rate of a pixel screen is determined, its fixed frame output interval is also determined. This parameter can be directly used as the frame time slot. Therefore, the frame time slot refers to the time interval between each frame output by the pixel screen. It is a key parameter of the pixel screen display system, directly affecting the image frame update frequency and display smoothness. By obtaining this parameter, an accurate time reference is provided for the subsequent calculation of the number of gradient frames.

[0073] Acquiring the frame time slot can be achieved in a variety of ways. In some embodiments, the frame time slot can be directly determined by the hardware characteristics of the pixel screen, for example, based on the screen's refresh rate. The refresh rate refers to the number of times the screen can refresh per second, usually measured in Hertz (Hz). For example, a screen with a refresh rate of 60Hz has a frame time slot of 1 / 60 second, or approximately 16.67 milliseconds. In this case, the frame time slot is a fixed value, pre-set by the pixel screen's hardware specifications.

[0074] In other embodiments, the frame time slot can be adjusted through software configuration. For example, a controller can dynamically adjust the frame time slot based on different display requirements or hardware performance. This adjustment can be achieved by modifying the pixel screen driver or control parameters. For example, if higher display smoothness is required, the frame time slot can be set to a smaller value, thereby increasing the number of frames output per second; conversely, if hardware performance is limited, the frame time slot can be appropriately increased to reduce the hardware burden.

[0075] Additionally, the frame timeslot can be configured via an external device or user interface. For example, users can manually set the frame timeslot through the controller's control panel or an external device connected to the controller, such as a personal computer or mobile terminal. This provides users with greater flexibility and allows for personalized configuration based on specific application scenarios and display requirements.

[0076] Regardless of whether the frame time slot is determined by hardware features, software configuration, or user settings, its value must be accurately obtained and used in subsequent calculations. In this application, the frame time slot is an important basis for calculating the number of gradient frames, ensuring that a sufficient number of gradient image frames can be inserted within the state switching time to achieve a smooth transition.

[0077] Step S5220: Calculate the total number of frames required for each effect image during the motion state switching process based on the state switching time and the frame time slot, where the total number of frames is the difference between the state switching time and the frame time slot minus 1.

[0078] The process of calculating the total number of frames based on the state switching time and frame time slot is as follows: divide the state switching time of each effect image by the frame time slot of the pixel screen, and the difference after subtracting 1 is the total number of frames required. This 1 represents the state image frame itself after the motion state is switched, so the total number of frames is actually the total number of image frames that the pixel screen can output during the state switching time minus 1. For example, if the state switching time of an effect image is 240 milliseconds and the frame time slot of the pixel screen is 20 milliseconds, then the total number of frames required is 11 frames ((240ms / 20ms) - 1 = 11). This calculation result ensures that the pixel screen can output a sufficient number of image frames at a suitable frame rate throughout the state switching process to achieve a smooth motion effect.

[0079] It's important to note that the calculated total number of frames must be an integer, as pixel screens cannot output fractional frames. Therefore, in practice, you may need to round or truncate the result to ensure an integer total number of frames. Furthermore, the calculated total number of frames directly affects the subsequent determination of the number of transition frames, so accuracy is crucial.

[0080] Step S5230: adjusting the total number of frames as the number of gradual frames according to a preset frame rate adjustment strategy, and determining a corresponding relationship between the number of gradual frames and a frame output timing determined according to the frame time slot.

[0081] In order to achieve the best display effect, considering the hardware performance of the pixel screen, or considering the need for flexible adjustment according to the actual application scenario, the total number of frames can be adjusted as the number of gradient frames according to the preset frame rate adjustment strategy, and the correspondence between the number of gradient frames and the frame output timing can be determined. Specifically, the following embodiments can be used for implementation.

[0082] In one embodiment, a frame rate adjustment strategy based on hardware performance is provided. In actual applications, the hardware performance of a pixel display (such as processor speed, memory bandwidth, etc.) may limit its maximum supported frame rate. Therefore, the corresponding preset frame rate adjustment strategy adjusts the total number of frames based on the pixel display's maximum supported frame rate. Specifically, the controller pre-evaluates the pixel display's hardware performance and determines its maximum supported frame rate. For example, if the pixel display's maximum supported frame rate is 30Hz, meaning the ideal maximum frame time slot is no less than 33.33ms, and the total number of frames calculated based on a state switching time of 240ms and a frame time slot of 20ms is 11 frames, but this frame rate exceeds the pixel display's actual capabilities, the total number of frames needs to be adjusted to no more than 30Hz. In this case, hardware performance can be adjusted by reducing the number of transition frames or adjusting the frame time slot. For example, adjusting the frame time slot from 20ms to 33.33ms (corresponding to a 30Hz refresh rate) would adjust the total number of frames to 7 frames ((240ms / 33.33ms) - 1 ≈ 7). This adjustment ensures that the pixel screen can output image frames at a speed close to the ideal frame rate within the range allowed by the hardware performance, thereby achieving smooth motion effects.

[0083] In another embodiment, a frame rate adjustment strategy based on display effect optimization is provided to adapt to certain application scenarios. To optimize the display effect, the frame rate needs to be adjusted according to specific display requirements. For example, when displaying fast-moving images, the frame rate can be increased to reduce motion blur and improve visual clarity. Conversely, when displaying static or slowly changing images, the frame rate can be appropriately reduced to save hardware resources. Therefore, the frame rate adjustment strategy can also dynamically adjust the total number of frames based on the dynamic characteristics of the displayed content. For example, for fast-moving images, the frame interval can be set to 16.67ms (corresponding to a 60Hz refresh rate), thereby increasing the total number of frames to achieve a smoother display effect. For static images, the frame interval can be set to 33.33ms (corresponding to a 30Hz refresh rate), thereby reducing the total number of frames to reduce hardware load. This method of dynamically adjusting the frame rate based on the displayed content can flexibly adapt to different display requirements while ensuring efficient utilization of hardware resources.

[0084] After adjusting the total number of frames, it is necessary to determine the correspondence between the number of gradient frames and the frame output timing. This process ensures that each gradient frame can be output to the pixel screen at the correct time point, thereby achieving a smooth transition effect. Specifically, the frame output timing is determined by the frame time slot of the pixel screen, and the number of gradient frames is determined based on the adjusted total number of frames. For example, if the adjusted total number of frames is 7 frames, then these 7 gradient frames will be output sequentially according to the frame output timing of the pixel screen. The controller will calculate the output time point of each gradient frame based on the frame time slot and the total number of frames, and ensure that these time points are consistent with the actual output timing of the pixel screen. In this way, even with limited hardware performance or changing display requirements, high-quality multi-layer mixed broadcast display effects can be achieved.

[0085] Through the above embodiments, the present application accurately calculates the total number of frames and optimizes the total number of frames according to a preset frame rate adjustment strategy to obtain the actual number of gradient frames, which is used to generate multiple gradient image frames in the process of motion state switching. It can flexibly adapt to different hardware conditions and display requirements, ensuring that a smooth and fluent multi-layer mixed broadcast display effect can be achieved in various situations, so that it can be widely used in various pixel screen display devices and scenarios.

[0086] Based on any embodiment of the method of the present application, adjusting the total number of frames as the number of gradual transition frames according to a preset frame rate adjustment strategy includes:

[0087] Step S5231: Obtain the operating performance parameters of the device where the pixel screen is located and input them into a preset machine learning model for evaluation to obtain the maximum supported frame rate of the pixel screen;

[0088] To ensure that the number of gradient frames matches the hardware performance of the pixel screen, this embodiment uses a dynamic evaluation method based on a machine learning model to determine the maximum supported frame rate of the pixel screen. To do this, it is necessary to obtain the operating performance parameters of the device where the pixel screen is located and input these parameters into a preset machine learning model for evaluation.

[0089] Performance parameters refer to various parameters that reflect the hardware capabilities of the pixel display and its control device, including but not limited to processor utilization, memory headroom, video memory bandwidth, and screen refresh rate. These parameters affect the pixel display's computing power when displaying images, and thus the maximum frame rate it can support. For example, processor utilization determines the number of image frames that can be processed per second, while video memory bandwidth determines the speed of data transmission. The screen refresh rate directly limits the maximum number of times the pixel display can refresh per second.

[0090] During implementation, performance parameters can be obtained in a variety of ways. For example, they can be directly read using the device's hardware detection tools or obtained through system interfaces. Once these parameters are obtained, they are input into a pre-set machine learning model. This model is trained based on a large amount of data on the relationship between known performance parameters and actual supported frame rates. It can accurately estimate the maximum supported frame rate of the pixel screen based on the input performance parameters.

[0091] The method of evaluating the maximum supported frame rate using a machine learning model is highly adaptable and accurate. It not only dynamically adjusts based on the current device's performance, but also re-evaluates after device upgrades or hardware replacements, ensuring the optimal frame rate setting is always used. Furthermore, this method is adaptable to different types of pixel-based devices, allowing the model to assess the appropriate maximum supported frame rate, whether for low-performance entry-level devices or high-performance professional devices.

[0092] Step S5232: Adjust the total number of frames as the number of gradient frames based on the maximum supported frame rate, so that the number of gradient frames does not exceed the maximum supported frame rate.

[0093] When adjusting the total number of frames based on the maximum supported frame rate, ensure that the number of transition frames does not exceed the maximum supported frame rate. Specifically, if the calculated total number of frames exceeds the maximum supported frame rate, adjust the total number of frames to the maximum supported frame rate. For example, assume the maximum supported frame rate of the pixel screen is 30Hz, meaning it supports a maximum of 30 frames of image output per second. If the total number of frames calculated based on the state switching time and frame time slot is 12, and the state switching time is 240ms, then the number of frames corresponding to the maximum supported frame rate is (240ms / (1 / 30Hz)) - 1 = 7 frames. In this case, adjust the total number of frames from 12 to 7 to ensure that the number of transition frames does not exceed the maximum supported frame rate.

[0094] In addition, actual display requirements and user experience need to be considered when adjusting the total number of frames. In some cases, even if the hardware performance allows a higher frame rate, a lower frame rate may be selected for display effects or energy saving considerations. For example, if the user wants a smoother gradient effect during state switching, but the hardware performance only supports a lower frame rate, the display effect can be optimized by adjusting the number of gradient frames. In this case, the controller can adjust the number of gradient frames to a suitable value based on the balance between user needs and hardware performance, such as adjusting the total number of frames from 12 frames to 9 frames, to achieve smoother visual effects while avoiding display problems caused by insufficient hardware performance.

[0095] Through the above embodiments, the present application can dynamically evaluate the maximum supported frame rate of the pixel screen, and adjust the number of gradient frames accordingly, so as to ensure that the display effect matches the hardware performance. Specifically, the use of a machine learning model to evaluate the operating performance parameters of the pixel screen not only improves the accuracy and adaptability of the evaluation, but also dynamically adjusts the frame rate setting according to the real-time operating status of the device. It is not only suitable for pixel screen devices with different performance, but also can be re-evaluated after hardware upgrades or replacements to ensure that the optimal frame rate configuration is always used. In addition, by adjusting the number of gradient frames to adapt to the maximum supported frame rate, the present application effectively avoids the problem of display freezes or poor effects caused by insufficient hardware performance, while taking into account the smoothness and fluidity of the display effect, thereby improving the user experience. This dynamic adjustment mechanism provides higher flexibility and reliability for the multi-layer mixed broadcast display of the pixel screen, ensuring high-quality display effects under various hardware conditions.

[0096] On the basis of any embodiment of the method of the present application, based on the motion mode of each effect image, generating multiple gradient image frames of the effect image in the process of switching the motion state according to the corresponding number of gradient frames, including:

[0097] Step S5310: determining two state image frames before and after the motion state switching of each effect image according to the motion mode of the effect image, wherein the state image frames include an initial state image frame and a target state image frame;

[0098] Determining the two state image frames before and after the motion state switching of each effect image based on its motion pattern is the basis for generating the gradient image frame. It is necessary to analyze the motion pattern of each effect image to determine the state image frames corresponding to multiple key states during the motion process. These state image frames represent the various intermediate states of the effect image during the motion process and are the key reference points for generating smooth transition gradient image frames. Two adjacent state image frames represent two motion states, one before and one after. The switching process from one state image frame to the next state image frame constitutes a single motion state switching process. For a motion state switching, it refers to the motion state before and after the corresponding motion state switching process, which respectively correspond to the state image frame before the switch, i.e., the initial image frame, and the state image frame after the switch, i.e., the target state image frame.

[0099] A motion mode is the motion pattern that an effect image follows during display. It defines how the image moves from its initial state to its target state. For example, in translation mode, the effect image moves in a specific direction; in rotation mode, the effect image rotates around a central point; in scaling mode, the effect image changes size; and in gradient mode, the pixel color values ​​of the effect image change. Each motion mode has its own corresponding business logic, which is pre-set in the controller to generate the corresponding state image frame based on the motion mode.

[0100] Taking the translation motion mode as an example, assuming the effect image needs to move from the left to the right side of the screen, the motion mode breaks down the entire movement process into multiple motion states, each corresponding to a state image frame. For example, the movement process can be divided into five motion states, each corresponding to a state image frame, representing a different position of the effect image during the movement. By determining these state image frames, the changes in the effect image between each motion state can be calculated, thereby generating a series of gradually changing image frames, achieving a smooth transition from one position to the next.

[0101] In rotational motion mode, assuming the effect image needs to rotate from 0 to 90 degrees, the entire rotation process can be broken down into multiple motion states, each corresponding to a state image frame, representing the state of the effect image at different rotation angles. For example, the rotation process can be divided into four motion states, each corresponding to a state image frame, representing the state of the effect image at 0, 30, 60, and 90 degrees, respectively. By calculating the angular changes between these states, a series of gradually changing image frames can be generated, achieving a smooth rotation effect.

[0102] In zoom motion mode, assuming the effect image needs to be enlarged from its original size to twice its original size, the entire zoom process can be broken down into multiple motion states, each corresponding to a state image frame representing the state of the effect image at different zoom ratios. For example, the zoom process can be divided into four motion states, each corresponding to a state image frame representing the effect image at its original size, 1.33x the original size, 1.67x the original size, and twice its original size. By calculating the size changes between these states, a series of gradually changing image frames can be generated, achieving a smooth zoom effect.

[0103] In gradient motion mode, assuming the pixel color values ​​of the effect image need to change from RGB(255, 0, 0) to RGB(0, 0, 255), the entire color change process can be subdivided into multiple motion states, each corresponding to a state image frame, representing the state of the effect image at different color stages. For example, the color change process can be divided into five motion states, each corresponding to a state image frame, representing the state of the effect image at RGB(255, 0, 0), RGB(191,0, 64), RGB(127, 0, 128), RGB(64, 0, 191), and RGB(0, 0, 255). By calculating the color changes between these states, a series of gradient image frames can be generated, achieving a smooth color transition effect.

[0104] This process is not only applicable to the motion modes listed above, but can also be extended to other types of motion modes, such as flickering, deformation, etc. By accurately determining the two state image frames before and after the motion state switch of each effect image, this application can provide an accurate reference for generating smoothly transitioned gradient image frames, thereby achieving high-quality multi-layer mixed broadcast display effects.

[0105] As can be seen, the present application can dynamically determine multiple state image frames during the motion state switching process of each effect image based on its motion pattern. These state image frames include not only the initial state and the target state, but also the various motion states in between, thus providing an accurate reference for generating smoothly transitioned gradient image frames.

[0106] Step S5320: For each corresponding pixel in the two state image frames, calculate its color difference value, where the color difference value is the difference between the pixel color value of the initial state image frame and the pixel color value of the target state image frame;

[0107] Generating a gradual transition image frame relies on calculating the color difference between each corresponding pixel in the two state image frames. Determining this color difference requires comparing the pixel color values ​​of the initial state image frame and the target state image frame corresponding to the motion state switching process one by one to determine the amount of color change from one state to the other. The color difference refers to the difference between the pixel color values ​​of the initial state image frame and the target state image frame, and this difference serves as the basic data for generating the gradual transition image frame.

[0108] Specifically, the color value of each pixel is typically composed of three components: red (R), green (G), and blue (B), with each component ranging from 0 to 255. For each corresponding pixel in the initial state image frame and the target state image frame, the color difference between its three RGB components is calculated. For example, assuming the color value of a pixel in the initial state image frame is RGB(250,0,0), and the color value of the corresponding pixel in the target state image frame is RGB(0,0,250), then the color difference of the pixel is -250 for the R component, 0 for the G component, and +250 for the B component.

[0109] In practice, this calculation requires traversing all corresponding pixels in the two state image frames. For each pixel, the color difference between its R, G, and B components is calculated. These color differences are then used to generate the gradient image frame, achieving a smooth transition from the initial state to the target state.

[0110] Step S5330: Generate a plurality of gradient image frames between the two state image frames according to the color difference and the number of gradient frames corresponding to the effect image.

[0111] After determining the color difference of each pixel, we can generate gradient image frames corresponding to the number of gradient frames based on the color difference. Taking color gradient as an example, assume that the pixel color values ​​of the initial state image frame are RGB(250,0,0), the pixel color values ​​of the target state image frame are RGB(0,0,250), and the number of gradient frames is 4. First, calculate the color difference of each pixel: -250 for the R component, 0 for the G component, and +250 for the B component. Then, evenly distribute these color differences to each gradient image frame. If the number of gradient frames is 4, considering the number of segments, we should add 1 to the number of gradient frames, that is, 5. Dividing these components by 5, the color change of each gradient frame is -50 for the R component, 0 for the G component, and +50 for the B component.

[0112] According to the above calculation method, the pixel color values ​​of the generated gradient image frame will be:

[0113] First gradient frame: RGB(200, 0, 50)

[0114] Second gradient frame: RGB(150, 0, 100)

[0115] Third gradient frame: RGB(100, 0, 150)

[0116] Fourth gradient frame: RGB(50, 0, 200)

[0117] Finally, the pixel color value of the target state image frame is RGB(0, 0, 250). This color transition method ensures a smooth transition from the initial state to the target state and avoids abrupt color changes.

[0118] It's important to note that when generating gradient image frames, changes in color values ​​or other parameters must be integers to ensure pixel accuracy. This means that when calculating color or position changes, appropriate mathematical methods must be used to avoid decimals. For example, rounding or truncation can be used to ensure that all calculations result in integers.

[0119] Furthermore, this process is not only applicable to color gradients but can also be extended to other types of gradients, such as changes in position, size, or shape. For example, in translation mode, the position difference between the initial and target positions can be calculated and evenly distributed to each gradient image frame, thereby generating a series of gradient image frames with gradually changing positions. In scaling mode, the size difference between the initial and target sizes can be calculated and evenly distributed to each gradient image frame, thereby generating a series of gradient image frames with gradually changing sizes.

[0120] Through the above embodiments, the technical advantage achieved by the present application is that it can dynamically generate multiple gradient image frames according to the motion mode of each effect image, thereby achieving a smooth transition from one state to another. This process not only takes into account color gradients, but also extends to other types of gradients such as position, size and shape, ensuring that high-quality display effects can be achieved under various motion modes. By accurately calculating the color difference or other parameter changes of each pixel and evenly distributing them to each gradient frame, the present application can generate a series of intermediate state image frames, avoiding the abruptness of color changes or other state changes. In addition, by ensuring that all calculation results are integers, the present application ensures the accuracy of pixel values ​​and further improves the smoothness and naturalness of the display effect. This method not only improves the adaptability and flexibility of the system, but also provides users with a better visual experience. It is suitable for various pixel screen display scenarios from low-performance entry-level devices to high-performance professional devices.

[0121] On the basis of any embodiment of the method of the present application, generating a plurality of gradient image frames between the two state image frames according to the color difference and the number of gradient frames corresponding to the effect image includes:

[0122] Step S5331: Calculate the color change gradient of each gradient image frame according to the color difference and the number of gradient frames;

[0123] As previously mentioned, the color difference refers to the difference between the pixel color values ​​of the initial state image frame and the pixel color values ​​of the target state image frame. The color value of each pixel is generally composed of three components: red (R), green (G), and blue (B), and each component ranges from 0 to 255. For each corresponding pixel in the initial state image frame and the target state image frame, the color difference of its three RGB components is calculated. For example, assuming that the color value of a pixel in the initial state image frame is RGB(250, 0, 0) and the color value of the corresponding pixel in the target state image frame is RGB(0, 0, 250), then the color difference of the pixel is -250 for the R component, 0 for the G component, and +250 for the B component.

[0124] Based on these color differences, the color gradient of each gradient image frame can be calculated. The color gradient refers to the change in pixel color value in each gradient frame, which is used to smoothly transition from the initial state to the target state. The color gradient is calculated by dividing the color difference of each color component by the number of gradient frames plus 1 (i.e., the total number of frames). For example, if the number of gradient frames is 4 and the total number of frames is 5 (including the initial state and the target state), the color gradient of each color component is the color difference divided by 5. In the above example, the gradient of the R component is -250 / 5 = -50, the gradient of the G component is 0 / 5 = 0, and the gradient of the B component is +250 / 5 = +50.

[0125] Step S5332: Using the initial state image frame as a sample, create an image frame sequence including a plurality of gradient image frames corresponding to the number of gradient frames. For each gradient image frame, based on its position in the sequence, generate the pixel color value of the gradient image frame by adding the pixel color value of the initial state image frame to the corresponding color change gradient.

[0126] To generate a gradient image frame, we need to gradually transition from the initial state image frame to the target state image frame based on the color gradient of each pixel. To achieve this, we first need to create an image frame sequence containing multiple gradient image frames based on the initial state image frame. The number of these gradient image frames corresponds to the number of gradient frames calculated previously, ensuring a smooth transition from the initial state to the target state.

[0127] When creating a sequence of gradient image frames, the pixel color values ​​of each gradient image frame are obtained by adding the pixel color values ​​of the initial state image frame to the corresponding color change gradient. This process needs to take into account the position of each gradient frame in the sequence, because gradient frames at different positions correspond to different transition stages. For example, assume that the pixel color value of the initial state image frame is RGB(250, 0, 0), the pixel color value of the target state image frame is RGB(0, 0, 250), and the number of gradient frames is 4. According to the above, the calculated color change gradients are -50 for the R component, 0 for the G component, and +50 for the B component. Based on these change gradients, a sequence of gradient image frames can be generated, where the pixel color values ​​of each gradient frame are as follows:

[0128] The first gradient image frame: The pixel color value of the initial state image frame is added to the corresponding color change gradient (R component -50, G component 0, B component +50) to obtain RGB (200, 0, 50).

[0129] Second gradient image frame: Based on the first gradient frame, the corresponding color change gradient is added again to obtain RGB(150, 0, 100).

[0130] The third gradient image frame: Based on the second gradient frame, the corresponding color change gradient is added again to obtain RGB(100, 0, 150).

[0131] Fourth gradient image frame: Based on the third gradient frame, the corresponding color change gradient is added again to obtain RGB(50, 0, 200).

[0132] Ultimately, the pixel color value of the target state image frame is RGB(0, 0, 250). In this way, the pixel color value of each gradient image frame can be accurately calculated based on its position in the sequence, thus achieving a smooth transition from the initial state to the target state.

[0133] In this way, a precise color change gradient can be calculated for each gradient frame, ensuring a smooth transition between pixel color values ​​within each gradient frame. This process is not only applicable to color gradients but can also be extended to other types of gradients, such as changes in position, size, or shape. For example, in translation mode, the position difference between the initial and target positions can be calculated and evenly distributed to each gradient frame, generating a series of gradient frames with gradually changing positions. In scaling mode, the size difference between the initial and target sizes can be calculated and evenly distributed to each gradient frame, generating a series of gradient frames with gradually changing sizes.

[0134] Through the above-described embodiments, the present application can accurately generate multiple gradient image frames based on the color gradient of each pixel, thereby achieving a smooth transition from the initial state to the target state. This process not only improves the smoothness and naturalness of the display effect, but also enhances the adaptability and flexibility of the device, providing users with a better visual experience.

[0135] Based on any embodiment of the method of the present application, determining two state image frames before and after the motion state switching of each effect image according to the motion mode of the effect image includes:

[0136] Step S5311: determining a corresponding preset motion mode and motion parameters according to the motion mode of each effect image;

[0137] Step S5312: Using the effect image as an initial state image frame, applying the motion parameters, and determining a state image frame after each motion state switching of the effect image according to the motion mode.

[0138] Determining the two state image frames before and after each effect image switches motion state is the basis for generating the gradient image frames. This requires determining the corresponding preset motion mode and motion parameters based on the motion mode of each effect image. A motion mode refers to the movement pattern followed by the effect image during display, such as translation, rotation, scaling, or color gradient. Each motion mode has its own preset business logic, which is pre-set in the controller to generate the corresponding state image frames based on the motion mode.

[0139] Motion parameters are the specific numerical values ​​that implement the motion, such as movement speed, rotation angle, scaling ratio, or color step size. These parameters define the specific changes in the effect image during the motion process and are the key basis for generating state image frames. For example, in translation mode, motion parameters may include movement direction and speed; in rotation mode, motion parameters may include rotation center and angle; in scaling mode, motion parameters may include scaling ratio; and in color gradient mode, motion parameters may include color step size.

[0140] Taking the translation motion mode as an example, suppose the effect image needs to move from the left to the right side of the screen, the motion mode is horizontal rightward movement, and the motion parameters include a movement speed of 1 pixel per second. Based on this information, it can be determined that the two adjacent motion states of the effect image are exactly displaced by 1 pixel. This displacement process constitutes the motion state switching process, and the two state image frames before and after the motion state switch can be determined. The initial state image frame is the position of the effect image before a movement, and the target state image frame is the position of the effect image after a movement. By applying the motion parameters, the specific position of the effect image after each motion state switch can be calculated, thereby generating the corresponding state image frame.

[0141] In rotational motion mode, assume the effect image needs to rotate 90 degrees around its center point, and the motion parameters include a rotation speed of 30 degrees per second. The initial state image frame represents the angular state of the effect image before the rotation per second, while the target state image frame represents the angular state of the effect image after the rotation per second. By applying the motion parameters, the angular change of the effect image after each motion state switch can be determined, thereby generating the corresponding state image frame.

[0142] In zoom motion mode, assume the effect image needs to be scaled from its original size to twice its original size. The motion parameters include a magnification ratio of 0.5 per second. The initial state image frame is the size of the effect image before each second, and the target state image frame is the size of the effect image after each second. By applying the motion parameters, the size change of the effect image after each motion state switch is determined, generating the corresponding state image frame.

[0143] In color gradient mode, assume the pixel color values ​​of the effect image need to change from RGB(255, 0, 0) to RGB(0, 0, 255), and the motion parameters include a color change step size of RGB(-50, 0, 50) per second. The initial state image frame is the color state of the effect image before the color change per second, and the target state image frame is the color state of the effect image after the color change per second. By applying the motion parameters, the color change of the effect image after each motion state switch can be determined, thereby generating the corresponding state image frame.

[0144] Through the above steps, the present application can dynamically determine the two state image frames before and after the motion state switch of each effect image based on the motion mode and motion parameters. These state image frames include not only the initial state and the target state, but also the various motion states in between, thus providing an accurate reference for generating smoothly transitioned gradient image frames. This method not only improves the smoothness and naturalness of the display effect, but also enhances the adaptability and flexibility of the system, providing users with a better visual experience.

[0145] Based on any embodiment of the method of the present application, the motion mode includes any one of a directional displacement mode, a center scaling mode, a center rotation mode, and a pixel gradient mode, and the motion parameters include a step value corresponding to the motion state switching corresponding to the implementation of the motion.

[0146] Summarizing the various embodiments disclosed above, it can be seen that the motion mode and motion parameters of the effect image are key elements in achieving smooth transitions. The motion mode defines the motion patterns of the effect image during display, while the motion parameters specifically describe the details of the motion. The following is a detailed description of the various motion modes and their corresponding motion parameters (step values):

[0147] Directional motion involves moving the effect image in a specific direction. For example, in panning mode, the direction of movement is specified, so the effect image can move from the left side of the screen to the right. The motion parameters (step values) are typically expressed in terms of speed. For example, the direction of movement could be horizontal rightward, and the speed could be 10 pixels per second, meaning the effect moves 10 pixels at a time.

[0148] Centered scaling involves enlarging or reducing the effect image around its center point. For example, an effect image can be enlarged from its original size to twice its original size. When a scaling factor is specified, the motion parameter (step value) is typically expressed as the scaling speed. For example, the step value can be the change in scaling factor per time, such as 0.1 times.

[0149] Centered rotation refers to the effect image rotating around its center point. For example, the effect image can be rotated from 0 to 90 degrees. The motion parameter (step value) is usually expressed as the rotation angular velocity. For example, the rotation angular velocity can be 5 degrees per second.

[0150] Pixel gradients involve a gradual change in the pixel color values ​​of the effect image. For example, the pixel color values ​​of the effect image might change from RGB(255, 0, 0) to RGB(0, 0, 255). The motion parameter (step value) is typically expressed as the color change step size. For example, the color change step size might be RGB(-50, 0, 50) per second.

[0151] By using the aforementioned motion method and corresponding motion parameters (step values), this application can accurately generate two state image frames for each effect image, before and after the motion state switch. These state image frames include not only the initial state and the target state, but also the various intermediate motion states, providing an accurate reference for generating smoothly transitioned gradient image frames. This method not only improves the smoothness and naturalness of the display effect, but also enhances the adaptability and flexibility of the system, providing users with a higher-quality visual experience.

[0152] Based on any embodiment of the method of the present application, each effect image and the image frame corresponding to the frame output timing are synthesized into a display frame in layer order, and output to the pixel screen for display, including:

[0153] Step S5410: superimposing the image frames of each effect image corresponding to the frame output timing at the pixel level according to the layer order of each effect image;

[0154] When combining the individual effect images and the image frames corresponding to the frame output sequence into display frames according to their layer order, the image frames corresponding to each effect image can be overlaid at the pixel level based on their layer order. Layer order refers to the hierarchical relationship between multiple effect images during display. It is usually defined in the image playback data and determines the display priority of the images on the pixel screen. For example, the background layer is usually at the bottom layer, while the foreground layer is at the top layer.

[0155] During the overlay process, the image frames corresponding to each effect image are composited pixel by pixel with the image frames of other layers based on their position in the layer order. This means that the color value of each pixel is superimposed according to the layer order to generate the final display frame. For example, assuming there is a multi-layer display scene containing a background layer, a carousel layer, and a foreground layer, the effect image frames of the background layer will be composited first, followed by the image frames of the carousel layer, and finally the image frames of the foreground layer. This order ensures that the content of the foreground layer can be correctly overlaid on the background layer, thus achieving the desired visual effect.

[0156] In practice, pixel-level overlay can be achieved in a variety of ways. One common approach is to use a pixel-by-pixel blending algorithm, such as alpha blending. In this algorithm, the color value of each pixel is weighted based on the transparency (alpha value) of the layer it is in. For example, if a pixel in the foreground layer has a high degree of transparency, the color of the pixel in the background layer will have a greater impact on the final display effect; conversely, if the pixel in the foreground layer is completely opaque, the color of the pixel in the background layer will be completely covered.

[0157] The overlay process can also take other factors into account, such as the layer's blending mode. Different blending modes can achieve different visual effects. For example, the Multiply mode multiplies the foreground layer's pixel color with the background layer's pixel color, creating a darker effect; while the Screen mode adds the foreground layer's pixel color to the background layer's pixel color, creating a brighter effect.

[0158] Step S5420: performing color correction on the superimposed image frame to compensate for color deviation caused by the synthesis of different layers;

[0159] Color correction of the superimposed image frames can further ensure the accuracy and consistency of the final display effect. The purpose of color correction is to compensate for color deviations that may occur during the layer superposition process. These deviations may be caused by the layer's blending mode, transparency settings, or pixel-level superposition algorithm.

[0160] Color correction can be implemented in a variety of ways, but one common approach is using a color correction matrix. A color correction matrix is ​​a mathematical tool that adjusts the color values ​​of each pixel in an image frame to ensure the final displayed colors are as intended. For example, if, during the overlay process, certain colors of the foreground layer are found to excessively affect the colors of the background layer, the parameters in the color correction matrix can be adjusted to reduce this effect, resulting in more natural and accurate colors in the final displayed frame.

[0161] Another implementation involves using a color lookup table (CLUT). A CLUT is a predefined mapping table that maps input pixel color values ​​to corrected output color values. By using a CLUT, you can quickly perform color correction on every pixel in an image frame. For example, if the overlaid image appears dark overall, you can adjust the mapping in the CLUT to increase the image's brightness.

[0162] Color correction can also be achieved through software algorithms, such as calculating the average color value of each pixel or using more complex image processing techniques such as histogram equalization or color balance adjustment. These algorithms can dynamically adjust the color value of each pixel to achieve the best visual effect based on the overall color distribution of the image or the color requirements of specific areas.

[0163] In practice, color correction can be tightly integrated with the layer overlay process. For example, while overlaying layer image frames pixel by pixel, a color correction algorithm can be applied simultaneously to ensure that the color values ​​of each pixel remain consistent and accurate in the resulting overlayed image frame. This real-time correction method can effectively reduce color deviations in the final image frame and improve display quality.

[0164] Step S5430: output the corrected image frame as a display frame to the pixel screen for display.

[0165] Outputting the corrected image frame as a display frame to the pixel screen is the final step in achieving high-quality display effects. It ensures that the image after layer overlay and color correction is correctly displayed on the pixel screen, providing users with the ultimate visual experience.

[0166] Specifically, a display frame refers to an image frame after layer overlay and color correction. It contains all the information about the effect image and has been adjusted to a format suitable for display on a pixel screen. The output of the display frame needs to take into account the display characteristics of the pixel screen, including resolution, refresh rate, and color display capabilities. For example, if the pixel screen has a resolution of 256×512, the resolution of the display frame should also match this specification to ensure that the image can be displayed completely and clearly on the screen.

[0167] When outputting an image frame, the color value of each pixel in the frame needs to be converted into a signal format that the pixel screen can recognize. This process is usually completed by the display circuit in the controller. For example, in a pixel screen based on the RGB color model, the color value of each pixel is composed of three components: red, green, and blue. The display circuit converts these components into corresponding electrical signals, driving the LEDs or pixels in the pixel screen to emit light, thereby displaying the complete image.

[0168] In practical applications, the process of outputting image frames can be achieved in a variety of ways. One common method is to use hardware interfaces such as HDMI, VGA, or DVI to transmit the image frame data to the pixel screen. These interfaces support high-speed data transmission, ensuring that the image frames are displayed on the screen in a timely and accurate manner. For example, through the HDMI interface, the controller can transmit the image frame in the form of a digital signal to the pixel screen. After receiving the signal, the pixel screen drives the internal display elements according to the signal content to display the corresponding image.

[0169] Another implementation involves transmitting the image frame data to the pixel screen via wireless communication technologies, such as Wi-Fi or Bluetooth. This approach is suitable for portable or wirelessly connected pixel screen devices. For example, via a Wi-Fi module, the controller can send the image frame data to the pixel screen in the form of a wireless signal. The pixel screen then decodes the signal and converts it into a format suitable for display.

[0170] Through the above embodiments, the present application can achieve high-quality multi-layer mixed broadcast display effects, significantly improving the display performance and user experience of the pixel screen. First, by superimposing layers at a pixel-by-pixel level and considering factors such as transparency and blending mode, the accuracy and flexibility of layer synthesis are ensured, and complex visual effects can be achieved. Secondly, the color correction mechanism effectively compensates for the color deviation that may occur during the layer superposition process, further improving the accuracy and consistency of the display effect. Finally, by adapting to the display characteristics of the pixel screen and adopting a variety of transmission methods, it is ensured that the display frame can be efficiently and accurately output to the pixel screen to meet the needs of different devices and scenarios. These technical advantages not only improve the adaptability and flexibility of the system, but also provide users with a smoother, more natural and high-quality visual experience, and are suitable for various pixel screen display scenarios from low-performance entry-level devices to high-performance professional equipment.

[0171] See also Figure 4 Another embodiment of the present application further provides a multi-layer mixed broadcast display control device, which includes a data acquisition module 5100, a frame number determination module 5200, an image generation module 5300, and a synthesis output module 5400, wherein the data acquisition module 5100 is configured to acquire image playback data, the image playback data including multiple effect images corresponding to the order of layers, each effect image is provided with a motion mode and a state switching time, the state switching time corresponding to each motion state switching process in the motion process defined by the motion mode; the frame number determination module 5200 is configured to generate a state switching process according to the state of each effect image. The state switching time and the frame time slot of the pixel screen are used to calculate the number of gradient frames required for the effect image during the motion state switching process; the image generation module 5300 is configured to generate multiple gradient image frames of the effect image during the motion state switching process based on the motion mode of each effect image and the corresponding number of gradient frames, and the gradient image frames are used to smoothly transition between the two state image frames before and after the motion state switching; the synthesis output module 5400 is configured to determine the frame output timing of the pixel screen according to the frame time slot, synthesize each effect image and the image frame corresponding to the frame output timing into a display frame in layer order, and output it to the pixel screen for display.

[0172] Based on any embodiment of the device of the present application, the frame number determination module 5200 includes: a time slot determination module, which is configured to obtain a fixed frame output interval of the pixel screen as a frame time slot; a frame number calculation module, which is configured to calculate the total number of frames required for each effect image during the motion state switching process based on the state switching time and the frame time slot, and the total number of frames is the difference between the state switching time and the frame time slot minus 1; a strategy application module, which is configured to adjust the total number of frames as the number of gradient frames according to a preset frame rate adjustment strategy, and determine the correspondence between the number of gradient frames and the frame output timing determined according to the frame time slot.

[0173] Based on any embodiment of the device of the present application, the frame number adjustment module includes: a frame rate evaluation module, which is configured to obtain the operating performance parameters of the device where the pixel screen is located and input a preset machine learning model for evaluation to obtain the maximum supported frame rate of the pixel screen; a frame number adjustment module, which is configured to adjust the total number of frames as the number of gradient frames based on the maximum supported frame rate, so that the number of gradient frames does not exceed the maximum supported frame rate.

[0174] Based on any embodiment of the device of the present application, the image generation module 5300 includes: a before and after determination module, configured to determine the two state image frames before and after the motion state switching of each effect image according to the motion mode, and the state image frames include an initial state image frame and a target state image frame; a difference determination module, configured to calculate the color difference of each corresponding pixel in the two state image frames, and the color difference is the difference between the pixel color value of the initial state image frame and the pixel color value of the target state image frame; a gradient generation module, configured to generate multiple gradient image frames between the two state image frames according to the color difference and the number of gradient frames of the effect image.

[0175] Based on any embodiment of the device of the present application, the gradient generation module includes: a gradient calculation module, configured to calculate the color change gradient of each gradient image frame based on the color difference and the number of gradient frames; a sequence creation module, configured to use the initial state image frame as a sample to create an image frame sequence containing multiple gradient image frames corresponding to the number of gradient frames. For each gradient image frame, according to its position in the sequence, the pixel color value of the gradient image frame is generated by adding the pixel color value of the initial state image frame to the corresponding color change gradient.

[0176] Based on any embodiment of the device of the present application, the front and back determination module includes: a mode analysis module, which is configured to determine the corresponding preset motion mode and motion parameters according to the motion mode of each effect image; a state analysis module, which is configured to use the effect image as the initial state image frame, apply the motion parameters, and determine the state image frame of the effect image after each motion state switching according to the motion mode.

[0177] Based on any embodiment of the device of the present application, the movement mode includes any one of a directional displacement mode, a center scaling mode, a center rotation mode, and a pixel gradient mode, and the movement parameters include a step value corresponding to the movement state switching corresponding to the implementation of the movement.

[0178] Based on any embodiment of the device of the present application, the synthesis output module 5400 includes: an image overlay module, which is configured to overlay the image frames of each effect image corresponding to the frame output timing at the pixel level according to the layer order of each effect image; a color correction module, which is configured to perform color correction on the superimposed image frames to compensate for the color deviation caused by the synthesis of different layers; and a display output module, which is configured to output the corrected image frames as display frames to the pixel screen for display.

[0179] Based on any embodiment of this application, please refer to Figure 5Another embodiment of the present application further provides a computer device that can act as a controller in a multi-layer mixed broadcast display control device, such as Figure 5 As shown, a schematic diagram of the internal structure of a computer device. The computer device includes a processor, a computer-readable storage medium, a memory, and a network interface connected via a system bus. Among them, the computer-readable storage medium of the computer device stores an operating system, a database, and a computer program that encapsulates computer-readable instructions. The database may store a control information sequence. When the computer-readable instructions are executed by the processor, the processor may implement a multi-layer mixed broadcast display control method. The processor of the computer device is used to provide computing and control capabilities to support the operation of the entire computer device. The memory of the computer device may store computer-readable instructions. When the computer-readable instructions are executed by the processor, the processor may execute the multi-layer mixed broadcast display control method of the present application. The network interface of the computer device is used to connect and communicate with a terminal. Those skilled in the art will understand that Figure 5 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0180] In this embodiment, the processor is used to execute Figure 4 The memory stores the program code and various data required to execute the specific functions of each module and its submodule in the multi-layer mixed broadcast display control device. The network interface is used to transmit data between user terminals or servers. The memory in this embodiment stores the program code and data required to execute all modules / submodules in the multi-layer mixed broadcast display control device of this application. The server can call the server's program code and data to execute the functions of all submodules.

[0181] The present application also provides a storage medium storing computer-readable instructions. When the computer-readable instructions are executed by one or more processors, the one or more processors execute the steps of the multi-layer mixed broadcast display control method described in any embodiment of the present application.

[0182] The present application also provides a computer program product, including a computer program / instruction, which, when executed by one or more processors, implements the steps of the multi-layer mixed broadcast display control method described in any embodiment of the present application.

[0183] Those skilled in the art will appreciate that all or part of the processes in the above-described embodiments of the present application can be implemented by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes in the above-described embodiments of the method. The aforementioned storage medium can be a computer-readable storage medium such as a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0184] The above description is only part of the implementation methods of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

[0185] In summary, the present application can show significant application advantages in practical applications. By accurately calculating the number of gradient frames of each effect image in the process of switching between motion states, and generating corresponding gradient image frames according to the motion mode of each layer, it can effectively solve the common problems of stuttering and rough gradient in pixel screen display, especially suitable for pixel screen display scenes with large granularity. By optimizing the layer overlay and display control process, it ensures that the display effect of multi-layer mixed images is both accurate and consistent, significantly improving the smoothness and naturalness of the visual experience. This innovative control method not only improves the overall performance of the pixel screen display system, but also provides users with a more flexible and high-quality display solution. It can be widely used in various scenarios such as advertising display, stage background, information display, etc., to meet the high requirements of different users for the display effects of pixel screens.

Claims

1. A multi-layer mixed broadcast display control method, characterized in that: include: Acquire image playback data, the image playback data including a plurality of effect images corresponding to a layer sequence, each effect image being provided with a motion mode and a state switching time, the state switching time being set corresponding to each motion state switching process in a motion process defined by the motion mode; According to the state switching time of each effect image and the frame time slot of the pixel screen, the number of gradient frames required for the effect image in the motion state switching process is calculated; Based on the motion mode of each effect image, a plurality of gradient image frames of the effect image in the motion state switching process are generated according to the corresponding number of gradient frames, wherein the gradient image frames are used to smoothly transition between the two state image frames before and after the motion state switching; The frame output timing of the pixel screen is determined according to the frame time slot, and each effect image and the image frame corresponding to the frame output timing are synthesized into a display frame in layer order, and output to the pixel screen for display.

2. The multi-layer mixed broadcast display control method according to claim 1, characterized in that: According to the state switching time of each effect image and the frame time slot of the pixel screen, the number of gradient frames required for the effect image in the motion state switching process is calculated, including: Obtain the fixed frame output interval of the pixel screen as the frame time slot; Calculate the total number of frames required for each effect image during the motion state switching process according to the state switching time and the frame time slot, where the total number of frames is the difference between the state switching time and the frame time slot minus 1; The total number of frames is adjusted as the number of gradual frames according to a preset frame rate adjustment strategy, and a corresponding relationship between the number of gradual frames and a frame output timing determined according to the frame time slot is determined.

3. The multi-layer mixed broadcast display control method according to claim 2, characterized in that: Adjusting the total number of frames as the number of gradual transition frames according to a preset frame rate adjustment strategy includes: Obtain the operating performance parameters of the device where the pixel screen is located and input them into the preset machine learning model for evaluation to obtain the maximum supported frame rate of the pixel screen; The total number of frames is adjusted based on the maximum supported frame rate as the number of gradient frames so that the number of gradient frames does not exceed the maximum supported frame rate.

4. The multi-layer mixed broadcast display control method according to claim 1, characterized in that: Based on the motion mode of each effect image, a plurality of gradient image frames of the effect image in the motion state switching process are generated according to the corresponding number of gradient frames, including: According to the motion mode of each effect image, two state image frames before and after the motion state switching are determined, wherein the state image frames include an initial state image frame and a target state image frame; For each corresponding pixel in the two state image frames, calculating its color difference value, wherein the color difference value is the difference between the pixel color value of the initial state image frame and the pixel color value of the target state image frame; A plurality of gradient image frames between the two state image frames are generated according to the color difference and the number of gradient frames corresponding to the effect image.

5. The multi-layer mixed broadcast display control method according to claim 4, characterized in that: Generating a plurality of gradient image frames between the two state image frames according to the color difference and the number of gradient frames corresponding to the effect image, comprising: Calculating the color change gradient of each gradient image frame according to the color difference and the number of gradient frames; Using the initial state image frame as a sample, an image frame sequence is created, which includes a number of gradient image frames corresponding to the number of gradient frames. For each gradient image frame, the pixel color value of the gradient image frame is generated by adding the pixel color value of the initial state image frame to the corresponding color change gradient according to its position in the sequence.

6. The multi-layer mixed broadcast display control method according to claim 4, characterized in that: According to the motion mode of each effect image, two state image frames before and after the motion state switching are determined, including: Determine the corresponding preset motion mode and motion parameters according to the motion mode of each effect image; The effect image is used as an initial state image frame, and the motion parameters are applied to determine a state image frame after the effect image switches its motion state each time according to the motion mode.

7. The multi-layer mixed broadcast display control method according to claim 6, characterized in that: The motion mode includes any one of a directional displacement mode, a center scaling mode, a center rotation mode, and a pixel gradient mode, and the motion parameter includes a step value corresponding to the motion state switching corresponding to the implementation of the motion.

8. The multi-layer mixed broadcast display control method according to any one of claims 1 to 7, characterized in that: Each effect image and the image frame corresponding to the frame output timing are synthesized into a display frame in layer order, and output to the pixel screen for display, including: According to the layer order of each effect image, the image frames of each effect image corresponding to the frame output timing are superimposed at the pixel level; Perform color correction on the superimposed image frames to compensate for the color deviation caused by the synthesis of different layers; The corrected image frame is output as a display frame to the pixel screen for display.

9. A multi-layer mixed broadcast display control device, characterized in that: include: a data acquisition module configured to acquire image playback data, the image playback data including a plurality of effect images corresponding to a layer sequence, each effect image being provided with a motion mode and a state switching time, the state switching time being set corresponding to each motion state switching process in a motion process defined by the motion mode; A frame number determination module is configured to calculate the number of gradient frames required for the effect image during the motion state switching process according to the state switching time of each effect image and the frame time slot of the pixel screen; An image generation module is configured to generate, based on the motion mode of each effect image, a plurality of gradient image frames of the effect image during the motion state switching process according to a corresponding number of gradient frames, wherein the gradient image frames are used to smoothly transition between the two state image frames before and after the motion state switching; The synthesis output module is configured to determine the frame output timing of the pixel screen according to the frame time slot, synthesize each effect image and the image frame corresponding to the frame output timing into a display frame in layer order, and output it to the pixel screen for display.

10. A multi-layer mixed broadcast display control device, comprising a pixel screen and a controller, wherein the controller comprises a central processing unit and a memory, characterized in that: The central processing unit is used to call and run the computer program stored in the memory to execute the steps of the method according to any one of claims 1 to 8, so as to obtain the images of each effect image file through the multi-layer mixing display controller.

11. A computer program product comprising a computer program or computer instructions, characterized in that When the computer program or computer instruction is called and executed by a central processing unit, the steps of the method according to any one of claims 1 to 8 are executed.

Images