A method, device and equipment for smoothing strip screen signal images on a digital splicing wall

By generating HTML5 pages and JSON files, separating the background and text images, and combining to generate video files, the problem of unsmooth text display when the bar screen signal is superimposed on the home screen is solved, and a smooth bar screen signal display is achieved.

CN115996302BActive Publication Date: 2025-04-04VTRON GRP CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211501367.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-28
Publication Date
2025-04-04
Estimated Expiration
2042-11-28

AI Technical Summary

Technical Problem

When the prior art superimposes the bar screen signal on the main screen, the text display in the video stream is not smooth, with a sense of lag and jump, and a good display effect cannot be achieved.

Method used

By obtaining the display parameter configuration data of the bar screen signal, an HTML5 page and a JSON file is generated, the HTML5 page is rendered with a browser and the background image is stored, the text element information is rendered using the rendering engine interface, a text image sequence is generated, and the background image and text image are combined to generate a video file. Finally, the video file is transferred and distributed to a large-screen processor.

Benefits of technology

It realizes smooth display of bar screen signals, avoids lag and jumping of text movement, and improves the display effect.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115996302B_ABST
    Figure CN115996302B_ABST
Patent Text Reader

Abstract

The present invention relates to the field of mobile communication technology, and discloses a method, device and equipment for smoothing the image of a strip screen signal on a digital splicing wall. The present invention generates an HTML5 page for recording background element information and a JSON file for recording text element information according to display parameter configuration data of the strip screen signal, uses a browser to perform background rendering based on the HTML5 page, uses a rendering engine interface to perform text rendering based on the JSON file, merges the obtained background image and text image sequence to obtain a video file, transfers and distributes the entire video file, and finally controls the corresponding screen by a large screen processor to display the corresponding strip screen signal. The present invention can realize the superposition of strip screen signals without the need for strip screen hardware, realize the smooth display of strip screen signals, and avoid the bad experience caused by the jamming and jumping of text movement in the strip screen signal.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of mobile communication technology, and in particular to a method, device and equipment for smoothing a strip-screen signal image on a digital splicing wall. Background Art

[0002] Existing digital splicing walls generally include a main screen and a strip-shaped LED sub-screen (hereinafter referred to as the strip screen) above the main screen. In daily use, the main screen is used to display various application signal images, and the strip screen is used to display text signal images, such as meeting titles, welcome messages, etc. The image source of these signals is generally an application running on a PC (personal computer). After the image is output through the PC graphics card or the network, it is connected to the large-screen processor and then displayed on the display unit of the digital splicing wall. If the content originally displayed on the strip screen (the signal content is the background and text) is superimposed on the main screen, the equipment of the strip screen can be reduced, thereby reducing the system hardware cost and improving product competitiveness.

[0003] At present, a popular solution for superimposing the above background and text as signals on the main screen is to add an HTML5 webpage to the computer program running on the PC, add background elements and text elements to the webpage, and then convert each frame of the image displayed on the webpage into a video stream in real time and send it to the main screen to display the video stream. Among them, the background elements include static or dynamic pictures, videos, etc., and the text elements include text content and setting information of effects such as the direction and speed of text movement.

[0004] The above solution is to use the browser to render HTML pages, including background and text. After each frame is rendered, the image of the corresponding frame is encoded and distributed, and the large screen processor decodes the image of the corresponding frame and sends it to the large screen for display. However, in the video stream generated by this solution, the text on the large screen does not move at a uniform speed, but there will be a sense of lag and jump, so that a good display effect cannot be achieved. Summary of the invention

[0005] The present invention provides a method, device and equipment for smoothing a strip screen signal image on a digital splicing wall, which solves the technical problem in the prior art that when a strip screen signal is superimposed on a main screen, text display in the generated video stream is not smooth.

[0006] A first aspect of the present invention provides a method for smoothing a strip screen signal image on a digital splicing wall, comprising:

[0007] Acquire display parameter configuration data of the strip screen signal, and generate an HTML5 page recording background element information and a JSON file recording text element information according to the display parameter configuration data;

[0008] Using a browser to load the HTML5 page and render it, storing each frame of the rendered image obtained as a background image of the strip screen signal, and establishing a mapping relationship between the timestamp of the rendered image obtained and the corresponding background image;

[0009] Rendering the text element information in the JSON file using a rendering engine interface to obtain a text image sequence arranged in ascending order of timestamps, and storing the text image sequence; establishing a mapping relationship between each text image in the text image sequence and the timestamp when the corresponding text image is generated;

[0010] Merging each text image in the text image sequence with a background image of a corresponding time stamp to generate a corresponding video file;

[0011] The video file is streamed and distributed to a large-screen processor so that the large-screen processor controls the corresponding screen to display a corresponding strip screen signal.

[0012] According to an achievable manner of the first aspect of the present invention, the step of loading the HTML5 page using a browser and rendering the page includes:

[0013] The HTML5 page is loaded using the CEF interface of the browser and rendered using an offline rendering method.

[0014] According to an achievable manner of the first aspect of the present invention, the text element information includes text parameters and text display area parameters; the text element information in the JSON file is rendered using a rendering engine interface to obtain a text image sequence arranged in ascending order of timestamps, including:

[0015] Creating a transparent first texture object according to the text display area parameters;

[0016] Creating a transparent second texture object according to the text parameters and rendering the text to the second texture object to obtain a rendered texture object;

[0017] Evenly divide the time period during which the rendered texture object is displayed in the first texture object into a plurality of time points, calculate the position of the rendered texture object in the first texture object at each time point, and obtain a position calculation result corresponding to each time point;

[0018] The rendered texture object is superimposed on the first texture object according to the position calculation result to obtain the text image corresponding to each time point, a mapping relationship is established between the timestamp when the text image is generated and the corresponding text image, and the text image sequence is assembled in ascending order of the timestamps.

[0019] According to an achievable manner of the first aspect of the present invention, the time period during which the rendered texture object is displayed in the first texture object is evenly divided into a plurality of time points, including:

[0020] The time interval between two adjacent time points is determined according to a frame rate of 60 fps, and each time point within the time period is determined according to the time interval.

[0021] According to an achievable manner of the first aspect of the present invention, the calculating the position of the rendered texture object in the first texture object at each time point includes:

[0022] The position of the rendered texture object in the first texture object is calculated according to the following formula:

[0023]

[0024] Wherein, Texture1_x represents the horizontal coordinate of the upper left corner of the rendered texture object relative to the first texture object at the current time point, Texture1_y represents the vertical coordinate of the upper left corner of the rendered texture object relative to the first texture object at the current time point, and w Texture0 is the pixel width of the first texture object, w Texture1 is the pixel width of the rendered texture object, t %totalTime is the time corresponding to the current time point in the time period, totalTime is the duration of the time period, Texture0_y is the ordinate of the first texture object, h Texture0 is the pixel height of the first texture object, h Texture1 The pixel height of the texture object after rendering.

[0025] According to an achievable manner of the first aspect of the present invention, superimposing the rendered texture object onto the first texture object according to the position calculation result to obtain a text image corresponding to each time point includes:

[0026] After obtaining each text image corresponding to a time point, the first texture object is processed to restore it to a transparent texture;

[0027] The rendered texture object is superimposed on the processed first texture object according to the position calculation result corresponding to the next time point to obtain a corresponding text image.

[0028] According to an achievable manner of the first aspect of the present invention, merging each text image in the text image sequence with a background image of a corresponding time stamp to generate a corresponding video file includes:

[0029] The video file is generated at a frame rate of 60 fps.

[0030] A second aspect of the present invention provides a device for smoothing a strip screen signal image on a digital splicing wall, comprising:

[0031] A configuration module, used to obtain display parameter configuration data of the strip screen signal, and generate an HTML5 page recording background element information and a JSON file recording text element information according to the display parameter configuration data;

[0032] A background rendering module is used to load the HTML5 page using a browser and render it, store each frame of the rendered image obtained as a background image of the strip screen signal, and establish a mapping relationship between the timestamp of the rendered image obtained and the corresponding background image;

[0033] A text rendering module is used to render the text element information in the JSON file using a rendering engine interface to obtain a text image sequence arranged in ascending order of timestamps, and store the text image sequence; a mapping relationship is established between each text image in the text image sequence and the timestamp when the corresponding text image is generated;

[0034] A synthesis module, used for merging each text image in the text image sequence with a background image of a corresponding time stamp to generate a corresponding video file;

[0035] The distribution module is used to convert the video file and distribute it to the large-screen processor so that the large-screen processor controls the corresponding screen to display the corresponding strip screen signal.

[0036] According to an achievable manner of the second aspect of the present invention, the background rendering module includes:

[0037] The first rendering unit is used to load the HTML5 page by using the CEF interface of the browser and render it by using an offline rendering method.

[0038] According to an achievable manner of the second aspect of the present invention, the text element information includes text parameters and text display area parameters; the text rendering module includes:

[0039] A creating unit, used for creating a transparent first texture object according to the text display area parameters;

[0040] A second rendering unit, used for creating a transparent second texture object according to the text parameters and rendering the text to the second texture object to obtain a rendered texture object;

[0041] a position calculation unit, configured to evenly divide a time period during which the rendered texture object is displayed in the first texture object into a plurality of time points, calculate a position of the rendered texture object in the first texture object at each time point, and obtain a position calculation result corresponding to each time point;

[0042] An overlay processing unit is used to overlay the rendered texture object onto the first texture object according to the position calculation result, obtain the text image corresponding to each time point, establish a mapping relationship between the timestamp when the text image is generated and the corresponding text image, and piece together the text image sequence in the order of the timestamp from small to large.

[0043] According to an achievable manner of the second aspect of the present invention, the position calculation unit includes:

[0044] The time point determination subunit is used to determine the time interval between two adjacent time points at a frame rate of 60fps, and determine each time point within the time period according to the time interval.

[0045] According to an achievable manner of the second aspect of the present invention, the position calculation unit includes:

[0046] The calculation subunit is used to calculate the position of the rendered texture object in the first texture object according to the following formula:

[0047]

[0048] Wherein, Texture1_x represents the horizontal coordinate of the upper left corner of the rendered texture object relative to the first texture object at the current time point, Texture1_y represents the vertical coordinate of the upper left corner of the rendered texture object relative to the first texture object at the current time point, and w Texture0 is the pixel width of the first texture object, w Texture1 is the pixel width of the rendered texture object, t %totalTime is the time corresponding to the current time point in the time period, totalTime is the duration of the time period, Texture0_y is the ordinate of the first texture object, h Texture0 is the pixel height of the first texture object, h Texture1 The pixel height of the texture object after rendering.

[0049] According to an achievable manner of the second aspect of the present invention, the overlay processing unit includes:

[0050] The texture processing subunit is used for processing the first texture object to restore it to a transparent texture after obtaining the text image corresponding to each time point;

[0051] The superimposition subunit is used to superimpose the rendered texture object onto the processed first texture object according to the position calculation result corresponding to the next time point to obtain a corresponding text image.

[0052] According to an achievable manner of the second aspect of the present invention, the synthesis module includes:

[0053] The video generation unit is used to generate the video file at a frame rate of 60fps.

[0054] A third aspect of the present invention provides a device for smoothing a strip screen signal image on a digital splicing wall, comprising:

[0055] A memory for storing instructions; wherein the instructions are used to implement the method for smoothing a strip-screen signal image on a digital splicing wall as described in any of the above implementation methods;

[0056] A processor is used to execute instructions in the memory.

[0057] A fourth aspect of the present invention is a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method for smoothing a strip-screen signal image on a digital splicing wall as described in any of the above achievable methods is implemented.

[0058] It can be seen from the above technical solutions that the present invention has the following advantages:

[0059] The present invention obtains display parameter configuration data of a strip screen signal, generates an HTML5 page for recording background element information and a JSON file for recording text element information according to the display parameter configuration data; uses a browser to load the HTML5 page and render it, stores each frame of rendered image obtained as the background image of the strip screen signal, and establishes a mapping relationship between the timestamp of the rendered image obtained and the corresponding background image; uses a rendering engine interface to render the text element information in the JSON file, obtains a text image sequence arranged in order of timestamps from small to large, and stores the text image sequence; and compares the timestamp between each text image in the text image sequence and the timestamp when the corresponding text image was generated. A mapping relationship is established; each text image in the text image sequence is merged with the background image of the corresponding timestamp to generate a corresponding video file; the video file is transferred and distributed to the large-screen processor, so that the large-screen processor controls the corresponding screen to display the corresponding strip screen signal; the present invention processes the background rendering and the text rendering separately, merges the obtained background image and the text image sequence to obtain the video file, transfers and distributes the entire video file, and finally the large-screen processor controls the corresponding screen to display the corresponding strip screen signal, which can realize the superposition of the strip screen signal without the need for strip screen hardware, realize the smooth display of the strip screen signal, and avoid the bad experience caused by the jamming and jumping of the text movement in the strip screen signal. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0061] Figure 1 A flowchart of a method for smoothing a strip screen signal image on a digital splicing wall provided by an optional embodiment of the present invention;

[0062] Figure 2 An optional embodiment of the present invention is based on Figure 1 Schematic diagram of the display effect of the strip screen signal after being processed by the method shown;

[0063] Figure 3 A structural connection block diagram of a device for smoothing a strip-screen signal image on a digital splicing wall provided as an optional embodiment of the present invention.

[0064] Reference numerals:

[0065] 1-Configuration module; 2-Background rendering module; 3-Text rendering module; 4-Synthesis module. DETAILED DESCRIPTION

[0066] The embodiments of the present invention provide a method, device and equipment for smoothing a strip screen signal image on a digital splicing wall, which are used to solve the technical problem that when the strip screen signal is superimposed on the main screen in the prior art, the text display in the generated video stream is not smooth.

[0067] In order to make the purpose, features and advantages of the present invention more obvious and easy to understand, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the embodiments described below are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0068] Embodiments of the present invention may be applied to computer systems / servers that may operate with numerous other general or special computing system environments or configurations. Examples of well-known computing systems, environments, and / or configurations suitable for use with computer systems / servers include, but are not limited to, personal computer systems, server computer systems, client computers, handheld or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, networked personal computers, minicomputer systems, mainframe computer systems, and distributed cloud computing technology environments including any of the above systems, and the like.

[0069] The invention provides a method for smoothing a strip screen signal image on a digital splicing wall.

[0070] See also Figure 1 , Figure 1 A flow chart of a method for smoothing a strip-screen signal image on a digital splicing wall provided by an embodiment of the present invention is shown.

[0071] An embodiment of the present invention provides a method for smoothing a strip-screen signal image on a digital splicing wall, comprising steps S1-S5.

[0072] Step S1, obtaining display parameter configuration data of the strip screen signal, and generating an HTML5 page for recording background element information and a JSON file for recording text element information according to the display parameter configuration data.

[0073] As a specific implementation, for obtaining the display parameter configuration data, a corresponding parameter configuration interface may be set, and the user may configure the parameters on the parameter configuration interface to obtain the display parameter configuration data. Alternatively, the display parameter configuration data sent by the user terminal may be obtained by sending a request to a preset user terminal. Alternatively, the user may directly upload a parameter configuration file, and the display parameter configuration data may be obtained by parsing the parameter configuration file.

[0074] Among them, the display parameter configuration data includes background element information and text element information. The background element information may include the background size and background file, and the background file is generally a picture or video. The text element information may include text parameters and text display area parameters; the text parameters may include the font, font size, color, content, font movement direction, and time of a complete movement (i.e., the time period displayed in the background); the text display area parameters may include basic information such as the position, size, and pixel unit of the text display area. In order to obtain a better display effect, the size of the text display area should be less than or equal to the background size.

[0075] HTML5 is a language description method for constructing Web content, and JSON is a lightweight data exchange format. In the embodiment of the present application, an HTML5 page and a JSON file are output to record background element information and text element information respectively, so that the background element information and the text element information can be processed separately when executing subsequent steps. Compared with the traditional method in which both the background element information and the text element information are processed by the browser, this solution can improve processing efficiency.

[0076] Step S2, using a browser to load the HTML5 page and render it, storing each frame of the obtained rendered image as the background image of the strip screen signal, and establishing a mapping relationship between the timestamp of the obtained rendered image and the corresponding background image.

[0077] In one achievable manner, the HTML5 page is loaded using a CEF interface of a browser, and rendered using an offline rendering method.

[0078] The CEF interface is a set of functional interfaces of the Chromium browser, which can support the HTML5 standard. Using offline rendering can achieve more refined picture effects. Whenever the CEF interface draws a frame of HTML5 page rendering image to the memory block, the rendering image is copied from the memory block and named as the background image, for example, named memery_bg, and the current PC system time ime_bg is obtained as the timestamp of the rendered image, and the timestamp of the rendered image is mapped to the corresponding background image to obtain <time_bg a ,memery_bg a >, where a represents the image number, which is numbered in ascending order according to the timestamp of the rendered image. After storing each frame of the rendered image as the background image of the strip screen signal, the stored data can be expressed as:

[0079] {<time_bg0,memery_bg0> ,<time_bg1,memery_bg1> ,..., <time_bg n ,memery_bg n >}

[0080] Where n represents the number of background images.

[0081] Step S3, using the rendering engine interface to render the text element information in the JSON file, to obtain a text image sequence arranged in ascending order according to the timestamp, and to store the text image sequence; a mapping relationship is established between each text image in the text image sequence and the timestamp when the corresponding text image is generated.

[0082] In an embodiment of the present application, the rendering engine interface may be OpenGL, DirectX or other rendering engine interfaces.

[0083] In one achievable manner, the rendering engine interface is used to render the text element information in the JSON file to obtain a text image sequence arranged in ascending order of timestamps, including:

[0084] Creating a transparent first texture object according to the text display area parameters;

[0085] Creating a transparent second texture object according to the text parameters and rendering the text to the second texture object to obtain a rendered texture object;

[0086] Evenly divide the time period during which the rendered texture object is displayed in the first texture object into a plurality of time points, calculate the position of the rendered texture object in the first texture object at each time point, and obtain a position calculation result corresponding to each time point;

[0087] The rendered texture object is superimposed on the first texture object according to the position calculation result to obtain the text image corresponding to each time point, a mapping relationship is established between the timestamp when the text image is generated and the corresponding text image, and the text image sequence is assembled in ascending order of the timestamps.

[0088] In the embodiment of the present application, when creating a transparent first texture object, the texture size is the display area size represented by the text display area parameter, the position is (Texture0_x, Texture0_y), the upper left corner of the background image is the origin, and the pixel width is w Texture0 , the pixel height is h Texture0 .

[0089] In the embodiment of the present application, when creating a transparent second texture object, the text is rendered in the second texture object according to the text parameters (including font, font size, color and character content) recorded in the JSON file. According to the font size, the pixel height h of the second texture object is calculated. Texture1 , calculate the pixel width w of the second texture object based on the font size and character content Texture1 The created second texture object can be converted into the rendered texture object by recording the complete character content, and then merged into the appropriate position of the first texture object. At different times, the position of the rendered texture object in the first texture object is different, which produces the effect of text movement.

[0090] In the embodiment of the present application, a mapping relationship is established between the timestamp when the text image is generated and the corresponding text image, and the corresponding storage data can be expressed as <time_te b ,memery_te b >, where b represents the image number, which is numbered in ascending order according to the timestamp when the text image is generated. The text image sequence is assembled in ascending order of the timestamp, and the corresponding storage data can be expressed as:

[0091] {<time_te0,memery_te0> ,<time_te1,memery_te1> ,..., <time_te N ,memery_te N >}

[0092] Where N represents the number of text images in the text image sequence.

[0093] In an achievable manner, the step of evenly dividing a time period during which the rendered texture object is displayed in the first texture object into a plurality of time points includes:

[0094] The time interval between two adjacent time points is determined according to a frame rate of 60 fps, and each time point within the time period is determined according to the time interval.

[0095] In the embodiment of the present application, the time period during which the rendered texture object is displayed in the first texture object is the time interval from when the text is displayed in the first texture object to when it disappears. Specifically, assuming that the text moves from right to left, with the first texture object as the display area, the time period is the time from when the text starts to move from the rightmost side of the display area to the left until the rightmost character of the text just disappears.

[0096] In an achievable manner, the calculating the position of the rendered texture object in the first texture object at each time point includes:

[0097] The position of the rendered texture object in the first texture object is calculated according to the following formula:

[0098]

[0099] Wherein, Texture1_x represents the horizontal coordinate of the upper left corner of the rendered texture object relative to the first texture object at the current time point, Texture1_y represents the vertical coordinate of the upper left corner of the rendered texture object relative to the first texture object at the current time point, and w Texture0 is the pixel width of the first texture object, w Texture1 is the pixel width of the rendered texture object, t %totalTime is the time corresponding to the current time point in the time period, totalTime is the duration of the time period, Texture0_y is the ordinate of the first texture object, h Texture0 is the pixel height of the first texture object, h Texture1 The pixel height of the texture object after rendering.

[0100] In the present embodiment, t %totalTime is the corresponding time of the current time point within the time period, that is, when calculating, the time of the current time point needs to be converted into the corresponding time within the time period. Since the text can be displayed repeatedly on the large screen, the display time of the same time point in any two time periods is different, and time conversion calculation is required. At this time, the corresponding time within the time period can be determined by taking the remainder of the time period. For example, set the time period to 5s, and start timing from the first display of the text, at which time t = 0; as long as the text display is actively stopped, t will continue to increase. At a certain moment, such as t = 32 seconds, t takes the remainder of the time period, and the corresponding time is 2 seconds. That is to say, at 32 seconds and 2 seconds, the display position of the text is the same.

[0101] In the embodiment of the present application, the calculation of the ordinate of the rendered texture object is performed with the middle alignment of the two textures as the goal. It should be noted that the calculation of the ordinate of the rendered texture object may not be performed with the middle alignment of the two textures as the goal. For example, the rendered texture object is set to be bottom aligned, top aligned, or other relative positions with the first texture object. Accordingly, the calculation formula for the pixel height of the rendered texture object can be adjusted as follows:

[0102]

[0103] Where ξ is the preset adjustment coefficient.

[0104] In an achievable manner, superimposing the rendered texture object onto the first texture object according to the position calculation result to obtain a text image corresponding to each time point includes:

[0105] After obtaining each text image corresponding to a time point, the first texture object is processed to restore it to a transparent texture;

[0106] The rendered texture object is superimposed on the processed first texture object according to the position calculation result corresponding to the next time point to obtain a corresponding text image.

[0107] In an embodiment of the present application, each time after obtaining a text image corresponding to a time point, the texture of the first texture object needs to be cleared, that is, restored to a transparent texture, and the rendered texture object does not need to be changed, because it records the text content. As long as the content does not change, the rendered texture object does not change. Each time text is rendered, only the position of the rendered texture object needs to be recalculated, and the texture resources remain unchanged. This can save video memory resources and improve rendering efficiency.

[0108] It should be noted that, since both the background image and the text image sequence need to be stored, the background image and the text image sequence can be stored in different memories, or stored in different locations in the same memory.

[0109] Step S4: merging each text image in the text image sequence with the background image of the corresponding time stamp to generate a corresponding video file.

[0110] In an embodiment of the present application, a background image and a text image sequence are merged, wherein the background image is the bottom, and the text image is superimposed on the upper layer, and the position is in the display area of ​​the set text parameters, and each superposition forms a new frame of image; after all the images are merged, a video file is generated and saved to the hard disk. Since the number of text image sequences and the number of background image sequences are different, and the time is also different, the selection method of background images and text images is involved here. Specifically, a corresponding background image is found for each text image. For an image in any text image sequence, assuming its time is time_text_x, find a background image that satisfies time_bg_y<time_text_x<(time_bg_y+1), where the background image corresponding to time_bg_y is matched with the current text image. As a feasible method, the generated image frames can be generated into a video file at a frame rate of 60fps.

[0111] Step S5, converting the video file and distributing it to the large-screen processor, so that the large-screen processor controls the corresponding screen to display the corresponding strip screen signal.

[0112] In order to achieve a smoother effect, the large-screen processor needs to display each frame at a stable frequency (for example, every 16 milliseconds), which means that when distributing signals, images need to be generated and distributed at a stable frequency. However, in actual applications, the time to generate each frame of an image and convert it into a video stream in real time is often not equal, for example, sometimes it takes 20ms and sometimes it takes 14ms. If it is sent directly each time, the time intervals for displaying the image on the large-screen processor will be different, which will produce an unsmooth adverse effect. In an embodiment of the present application, a video file is first generated for the image frame, and then the video file is distributed as a stream, rather than directly distributing each frame of the image in real time after converting it into a stream. This can avoid the phenomenon of unbalanced text movement caused by the different times for generating each frame of the image and converting it into a video stream, which causes the large-screen processor to receive the video frame at different times.

[0113] Taking the bar message "Warmly welcome xxxxx to visit us" as an example, the final display effect is as follows: Figure 2 shown.

[0114] In the above-mentioned embodiment of the present invention, background rendering and text rendering are processed separately, the obtained background image and text image sequence are merged to obtain a video file, the entire video file is streamed and distributed, and finally the large-screen processor controls the corresponding screen to display the corresponding strip screen signal. The superposition of strip screen signals can be achieved without the need for strip screen hardware, and the smooth display of strip screen signals can be achieved, thus avoiding the poor experience caused by the stuttering and jumping of text movement in the strip screen signal.

[0115] The present invention also provides a device for smoothing a strip screen signal image on a digital splicing wall, which can be used to execute the method for smoothing a strip screen signal image on a digital splicing wall described in any one of the above embodiments of the present invention.

[0116] See also Figure 3 , Figure 3 A structural connection block diagram of a device for smoothing a strip-screen signal image on a digital splicing wall provided by an embodiment of the present invention is shown.

[0117] An embodiment of the present invention provides a device for smoothing a strip-screen signal image on a digital splicing wall, comprising:

[0118] Configuration module 1, used for obtaining display parameter configuration data of the strip screen signal, and generating an HTML5 page recording background element information and a JSON file recording text element information according to the display parameter configuration data;

[0119] Background rendering module 2, used to load the HTML5 page using a browser and render it, store each frame of the rendered image obtained as the background image of the strip screen signal, and establish a mapping relationship between the timestamp of the rendered image obtained and the corresponding background image;

[0120] The text rendering module 3 is used to render the text element information in the JSON file using a rendering engine interface to obtain a text image sequence arranged in ascending order of timestamps, and store the text image sequence; a mapping relationship is established between each text image in the text image sequence and the timestamp when the corresponding text image is generated;

[0121] A synthesis module 4, used for merging each text image in the text image sequence with a background image of a corresponding time stamp to generate a corresponding video file;

[0122] The distribution module 5 is used to convert the video file and distribute it to the large-screen processor, so that the large-screen processor controls the corresponding screen to display the corresponding strip screen signal.

[0123] In one achievable manner, the background rendering module 2 includes:

[0124] The first rendering unit is used to load the HTML5 page by using the CEF interface of the browser and render it by using an offline rendering method.

[0125] In one achievable manner, the text element information includes text parameters and text display area parameters; the text rendering module 3 includes:

[0126] A creating unit, used for creating a transparent first texture object according to the text display area parameters;

[0127] A second rendering unit, used for creating a transparent second texture object according to the text parameters and rendering the text to the second texture object to obtain a rendered texture object;

[0128] a position calculation unit, configured to evenly divide a time period during which the rendered texture object is displayed in the first texture object into a plurality of time points, calculate a position of the rendered texture object in the first texture object at each time point, and obtain a position calculation result corresponding to each time point;

[0129] An overlay processing unit is used to overlay the rendered texture object onto the first texture object according to the position calculation result, obtain the text image corresponding to each time point, establish a mapping relationship between the timestamp when the text image is generated and the corresponding text image, and piece together the text image sequence in the order of the timestamp from small to large.

[0130] In one achievable manner, the position calculation unit includes:

[0131] The time point determination subunit is used to determine the time interval between two adjacent time points at a frame rate of 60fps, and determine each time point within the time period according to the time interval.

[0132] In one achievable manner, the position calculation unit includes:

[0133] The calculation subunit is used to calculate the position of the rendered texture object in the first texture object according to the following formula:

[0134]

[0135] Wherein, Texture1_x represents the horizontal coordinate of the upper left corner of the rendered texture object relative to the first texture object at the current time point, Texture1_y represents the vertical coordinate of the upper left corner of the rendered texture object relative to the first texture object at the current time point, and w Texture0 is the pixel width of the first texture object, w Texture1 is the pixel width of the rendered texture object, t %totalTime is the time corresponding to the current time point in the time period, totalTime is the duration of the time period, Texture0_y is the ordinate of the first texture object, h Texture0 is the pixel height of the first texture object, h Texture1 The pixel height of the texture object after rendering.

[0136] In one achievable manner, the overlay processing unit includes:

[0137] The texture processing subunit is used for processing the first texture object to restore it to a transparent texture after obtaining the text image corresponding to each time point;

[0138] The superimposition subunit is used to superimpose the rendered texture object onto the processed first texture object according to the position calculation result corresponding to the next time point to obtain a corresponding text image.

[0139] In one achievable manner, the synthesis module 4 includes:

[0140] The video generation unit is used to generate the video file at a frame rate of 60fps.

[0141] The present invention also provides a device for smoothing a strip screen signal image on a digital splicing wall, comprising:

[0142] A memory for storing instructions; wherein the instructions are used to implement the method for smoothing the image of a strip-screen signal on a digital splicing wall as described in any one of the above embodiments;

[0143] A processor is used to execute instructions in the memory.

[0144] The present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method for smoothing a strip-screen signal image on a digital splicing wall as described in any one of the above embodiments is implemented.

[0145] Technical personnel in the relevant field can clearly understand that, for the convenience and conciseness of description, the specific working processes of the above-described devices, equipment and modules can refer to the corresponding processes in the aforementioned method embodiments, and the specific beneficial effects of the above-described devices, equipment and modules can refer to the corresponding beneficial effects in the aforementioned method embodiments, which will not be repeated here.

[0146] In the several embodiments provided in the present application, it should be understood that the disclosed devices, equipment and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0147] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0148] In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of software functional modules.

[0149] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0150] As described above, the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features thereof may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for smoothing a strip screen signal image on a digital splicing wall, characterized in that: include: Acquire display parameter configuration data of the strip screen signal, and generate an HTML5 page recording background element information and a JSON file recording text element information according to the display parameter configuration data; Using a browser to load the HTML5 page and render it, storing each frame of the rendered image obtained as a background image of the strip screen signal, and establishing a mapping relationship between the timestamp of the rendered image obtained and the corresponding background image; Rendering the text element information in the JSON file using a rendering engine interface to obtain a text image sequence arranged in ascending order of timestamps, and storing the text image sequence; establishing a mapping relationship between each text image in the text image sequence and the timestamp when the corresponding text image is generated; Merging each text image in the text image sequence with a background image of a corresponding time stamp to generate a corresponding video file; The video file is streamed and distributed to a large-screen processor so that the large-screen processor controls the corresponding screen to display a corresponding strip screen signal.

2. The method for smoothing the image of a strip screen signal on a digital splicing wall according to claim 1, characterized in that: The step of using a browser to load the HTML5 page and render it includes: The HTML5 page is loaded using the CEF interface of the browser and rendered using an offline rendering method.

3. The method for smoothing the image of a strip screen signal on a digital splicing wall according to claim 1, characterized in that: The text element information includes text parameters and text display area parameters; the text parameters include the font, font size, color, content, font movement direction, and / or the time of a complete movement; The rendering engine interface is used to render the text element information in the JSON file to obtain a text image sequence arranged in ascending order of timestamps, including: Creating a transparent first texture object according to the text display area parameters; Creating a transparent second texture object according to the text parameters and rendering the text to the second texture object to obtain a rendered texture object; Evenly divide the time period during which the rendered texture object is displayed in the first texture object into a plurality of time points, calculate the position of the rendered texture object in the first texture object at each time point, and obtain a position calculation result corresponding to each time point; The rendered texture object is superimposed on the first texture object according to the position calculation result to obtain the text image corresponding to each time point, a mapping relationship is established between the timestamp when the text image is generated and the corresponding text image, and the text image sequence is assembled in ascending order of the timestamps.

4. The method for smoothing the image of a strip screen signal on a digital splicing wall according to claim 3, characterized in that: The step of evenly dividing the time period during which the rendered texture object is displayed in the first texture object into a plurality of time points comprises: The time interval between two adjacent time points is determined according to a frame rate of 60 fps, and each time point within the time period is determined according to the time interval.

5. The method for smoothing the image of a strip-screen signal on a digital splicing wall according to claim 3, characterized in that: The calculating the position of the rendered texture object in the first texture object at each time point includes: The position of the rendered texture object in the first texture object is calculated according to the following formula: ; In the formula, represents the horizontal coordinate of the upper left corner of the rendered texture object relative to the first texture object at the current time point, represents the ordinate of the upper left corner of the rendered texture object relative to the first texture object at the current time point, is the pixel width of the first texture object, is the pixel width of the rendered texture object, is the corresponding time of the current time point in the time period, is the duration of the time period, is the ordinate of the first texture object, is the pixel height of the first texture object, The pixel height of the texture object after rendering.

6. The method for smoothing the image of a strip screen signal on a digital splicing wall according to claim 3, characterized in that: The step of superimposing the rendered texture object onto the first texture object according to the position calculation result to obtain a text image corresponding to each time point includes: After obtaining each text image corresponding to a time point, the first texture object is processed to restore it to a transparent texture; The rendered texture object is superimposed on the processed first texture object according to the position calculation result corresponding to the next time point to obtain a corresponding text image.

7. The method for smoothing the image of a strip screen signal on a digital splicing wall according to claim 1, characterized in that: The step of merging each text image in the text image sequence with a background image of a corresponding time stamp to generate a corresponding video file includes: The video file is generated at a frame rate of 60 fps.

8. A device for smoothing a strip-screen signal image on a digital splicing wall, characterized in that: include: A configuration module, used to obtain display parameter configuration data of the strip screen signal, and generate an HTML5 page recording background element information and a JSON file recording text element information according to the display parameter configuration data; A background rendering module is used to load the HTML5 page using a browser and render it, store each frame of the rendered image obtained as a background image of the strip screen signal, and establish a mapping relationship between the timestamp of the rendered image obtained and the corresponding background image; A text rendering module is used to render the text element information in the JSON file using a rendering engine interface to obtain a text image sequence arranged in ascending order of timestamps, and store the text image sequence; a mapping relationship is established between each text image in the text image sequence and the timestamp when the corresponding text image is generated; A synthesis module, used for merging each text image in the text image sequence with a background image of a corresponding time stamp to generate a corresponding video file; The distribution module is used to convert the video file and distribute it to the large-screen processor so that the large-screen processor controls the corresponding screen to display the corresponding strip screen signal.

9. A device for smoothing the image of a strip screen signal on a digital splicing wall, characterized in that: include: A memory for storing instructions; wherein the instructions are used to implement the method for smoothing a strip-screen signal image on a digital splicing wall according to any one of claims 1 to 7; A processor is used to execute instructions in the memory.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by the processor, the method for smoothing a strip-screen signal image on a digital splicing wall according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Online video advertisement editing method and device

    CN109493120A

  • Page display method and device, electronic equipment and readable storage medium

    CN110502711A