Data processing method, apparatus and system

Abstract

The application discloses a data processing method, device and system. The method comprises the following steps: receiving and storing image data; receiving and storing a plurality of font data; receiving additional information of target font data in the plurality of font data; reading the target font data from the plurality of font data according to the additional information; superimposing the stored image data and the target font data, and sending to a display screen. The application solves the technical problem of poor display effect caused by the fact that when the OSD function needs to be enabled, the decoding node is overloaded due to the increasing processing demand of the decoding node in a distributed system.

Description

Technical Field

[0001] This invention relates to the field of display technology, and more specifically, to a data processing method, apparatus, and system. Background Technology

[0002] In existing distributed systems, multiple decoding nodes are typically used to stitch together multiple video sources into a single large screen output.

[0003] The decoding node undertakes a large amount of computation when processing data, resulting in a large computational load. This is especially true when the OSD (On-Screen Display) function is enabled, which can overload the decoding node, leading to slow response or poor display quality. Currently, no effective solution has been proposed. Summary of the Invention

[0004] This invention provides a data processing method, apparatus, and system to at least solve the technical problem that in a distributed system, as the processing demand of the decoding nodes increases, when the OSD function needs to be enabled, the decoding nodes become overloaded, resulting in poor display effects.

[0005] According to one aspect of the present invention, a data processing method is provided, comprising: receiving and storing image data; receiving and storing multiple character pattern data; receiving additional information of target character pattern data from the multiple character pattern data; reading the target character pattern data from the multiple character pattern data according to the additional information; overlaying the stored image data and the target character pattern data, and sending them to a display screen.

[0006] Optionally, the additional information includes: position information and speed information. Reading the target character data from multiple character data based on the additional information includes: calculating the storage address of the target character data from the multiple character data based on the position information and speed information; and reading the target character data based on the storage address.

[0007] Optionally, this method is applied to a distributed system, which includes multiple decoding nodes. The method is executed by any one of the multiple decoding nodes. Each of the multiple decoding nodes is equipped with a clock module, which is used to synchronize the clocks of the multiple decoding nodes. The timing of the image data corresponding to the synchronized multiple decoding nodes is the same.

[0008] Further, optionally, the method is executed by a first decoding node among multiple decoding nodes, the image data corresponding to the first decoding node is the first image data, and receiving and storing the image data includes: the first decoding node receiving the first image data and decoding it to obtain the decoded first image data; the synchronized first decoding node storing the decoded first image data.

[0009] Optionally, the method further includes: receiving additional information sent by the client according to a preset period or update instruction.

[0010] According to one aspect of the present invention, a data processing apparatus is provided, comprising: a first storage module for receiving and storing image data; a second storage module for receiving and storing a plurality of character pattern data; a receiving module for receiving additional information of target character pattern data from the plurality of character pattern data; a reading module for reading target character pattern data from the plurality of character pattern data according to the additional information; and an overlay module for overlaying the stored image data and the target character pattern data and sending them to a display screen.

[0011] Optionally, the reading module includes: a calculation unit, used to calculate the storage address of the target character data among multiple character data based on the position information and speed information when the additional information includes position information and speed information; and a reading unit, used to read the target character data according to the storage address.

[0012] Optionally, the device is applied to a distributed system, which includes multiple decoding nodes. The device is executed by any one of the multiple decoding nodes. Each of the multiple decoding nodes is equipped with a clock module, which is used to synchronize the clocks of the multiple decoding nodes. The timing of the image data corresponding to the synchronized multiple decoding nodes is the same.

[0013] Furthermore, optionally, the device also includes an update module for receiving additional information sent by the client according to a preset period or update instruction.

[0014] According to another aspect of the present invention, a cross-screen display processing system is also provided, comprising: at least two decoding nodes and a client, wherein each decoding node includes: a main controller, a memory, and a processor; each decoding node sets the main controllers to be synchronized according to a preset protocol; each decoding node receives image data and multiple character pattern data sent by the client through the main controller, and stores the image data and multiple character pattern data in the memory to obtain the storage address of the image data and multiple character pattern data in each decoding node; the client sends additional information to the corresponding decoding node according to a preset period, the additional information including: position information and speed information; each decoding node receives the additional information through the main controller, and the main controller sends the additional information to the processor; the processor calculates the storage address of the target character pattern data in the multiple character pattern data based on the position information and speed information in the received additional information, extracts the target character pattern data from the memory according to the storage address, overlays the target character pattern data with the image data, and displays it through the display screen; wherein the processor includes: an FPGA or a GPU.

[0015] In this embodiment of the invention, image data is received and stored; multiple character pattern data are received and stored; additional information of a target character pattern data from the multiple character pattern data is received; the target character pattern data is read from the multiple character pattern data according to the additional information; the stored image data and the target character pattern data are superimposed and sent to the display screen. When the OSD function is enabled, the decoding node can determine the target character pattern data from the multiple character pattern data according to the additional information, reducing the computational load of the decoding node, thereby achieving the technical effect of reducing the burden on the decoding node. This solves the technical problem that in a distributed system, as the processing demand of the decoding node increases, when the OSD function needs to be enabled, the decoding node is overloaded, resulting in poor display effect. Attached Figure Description

[0016] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0017] Figure 1 This is a schematic diagram of a cross-screen display processing system according to an embodiment of the present invention;

[0018] Figure 2 This is a schematic diagram of displaying subtitles in a cross-screen display processing system according to an embodiment of the present invention;

[0019] Figure 3 This is a flowchart illustrating the process of displaying dynamic subtitles in a cross-screen display processing system according to an embodiment of the present invention;

[0020] Figure 4 This is a flowchart illustrating a data processing method according to an embodiment of the present invention;

[0021] Figure 5 This is a schematic diagram of a data processing apparatus according to an embodiment of the present invention. Detailed Implementation

[0022] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0023] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0024] Technical terms used in this application:

[0025] OSD: Short for On-Screen Display, meaning displaying on the screen (or within a picture), usually on a specific screen. In other words, OSD can refer to text and image overlay or image overlay.

[0026] FPGA: Field Programmable Gate Array;

[0027] GPU: Graphics Processing Unit;

[0028] Vsync: Vertical Synchronization;

[0029] DDR: Memory, DDR SDRAM, Double Data Rate SDRAM.

[0030] Example 1

[0031] According to one aspect of the present invention, a cross-screen display processing system is also provided. Figure 1 This is a schematic diagram of a cross-screen display processing system according to an embodiment of the present invention, such as... Figure 1As shown, the system includes at least two decoding nodes 12 and a client 14. Each decoding node 12 includes a main controller 121, a memory 122, and a processor 123. Each decoding node 12 synchronizes the main controllers 121 according to a preset protocol. Each decoding node 12 receives image data and multiple character pattern data sent by the client 14 through the main controller 121, and stores the image data and multiple character pattern data in the memory 122 to obtain the storage address of the image data and multiple character pattern data in each decoding node 12. The client 14 sends additional information to the corresponding decoding node according to a preset period. The additional information includes position information and speed information. Each decoding node 12 receives the additional information through the main controller 121, which sends the additional information to the processor 123. The processor 123 calculates the storage address of the target character pattern data in the multiple character pattern data based on the position information and speed information in the received additional information, extracts the target character pattern data from the memory 122 according to the storage address, overlays the target character pattern data with the image data, and displays it on a display screen. The processor 123 includes an FPGA or a GPU.

[0032] Specifically, Figure 2 This is a schematic diagram of displaying subtitles in a cross-screen display processing system according to an embodiment of the present invention, such as... Figure 2 As shown, in this embodiment, the client 14 can be a device or APP adapted to relevant software. In the cross-screen display processing system provided in this embodiment, the preset protocol can be the 1588 protocol, and each decoding node 12 synchronizes via the 1588 protocol to ensure a high-precision synchronization rate. Figure 2 As shown, in the embodiments of this application, each decoding node 12 can be labeled as source 1, source 2, source 3 and source 4;

[0033] In this system, users can input strings into the client, which then converts the strings into character pattern data and sends the character pattern data to multiple decoding nodes.

[0034] The data to be displayed can be the string "Hello, World!" input by the user through the client 14 and its additional display information. The client 14 converts the string into character pattern data and sends it to the main controller 121 of each decoding node 12. That is, the client sends the converted character pattern data "Hello, World!" to decoding node 1, decoding node 2, decoding node 3 and decoding node 4 respectively. Each decoding node stores the converted character pattern data "Hello, World!". The main controller 121 writes the character pattern data into the memory 122 associated with the decoding node 12.

[0035] Client 14 periodically sends additional information to the main controller 121 of each decoding node 12 according to a preset movement speed (i.e., the preset period in this embodiment);

[0036] In this embodiment, the processor 123 is described using an FPGA as an example. Each main controller writes the coordinates to be displayed into an OSD module based on the FPGA. The OSD module calculates the storage address (e.g., DDR address) of the character data corresponding to each decoding node. Figure 2 Taking the example shown, if the complete DDR address range of the character pattern is 0x0-0x1000, and the OSD module of the node corresponding to source 1 calculates the character pattern data address segment corresponding to the first line of the character pattern string as 0x0-0x38 based on the current display coordinates, then source 1 reads the character pattern data from the address segment 0x0-0x38 and performs superposition processing. Similarly, the OSD module of the node corresponding to source 2 calculates the character pattern data address segment corresponding to the first line of the character pattern string as 0x39-0x77 based on the current display coordinates, then source 2 reads the character pattern data from the address segment 0x39-0x77 and performs superposition processing.

[0037] In addition, the display coordinates are updated according to the direction of movement, and the execution actions inside the FPGA are repeated to complete the dynamic character pattern function.

[0038] It should be noted that the embodiments in this application only use FPGA as a preferred example for illustration. The processor 123 can also be a GPU. That is, the main controller transmits the coordinates to be displayed to the GPU to calculate the DDR address of the character pattern data corresponding to each decoding node. Then the GPU reads the character pattern data from the DDR address and performs superposition processing.

[0039] Specifically, such as Figure 3 As shown, Figure 3 This is a flowchart illustrating the display of dynamic subtitles in a cross-screen display processing system according to an embodiment of the present invention, as detailed below:

[0040] Step 1: High-precision source synchronization is performed between each decoding node using the 1588 protocol;

[0041] Step 2: The user inputs subtitle information through the client;

[0042] Step 3: Convert the subtitle information from character data to font data using the client.

[0043] Step 4: The client sends character pattern data to all decoding nodes and stores it in the DDR corresponding to each decoding node;

[0044] Step 5: The client sends additional information to each decoding node (specifically, the main controller of the decoding node);

[0045] Step 6: The main controller sends the additional information to the OSD module in the FPGA of the decoding node. The OSD module calculates the corresponding DDR address based on the position and speed information in the additional information.

[0046] Step 7: The OSD module extracts the corresponding character pattern data according to the DDR address and overlays the character pattern data with the image data;

[0047] Step 8: The OSD module determines whether the processing of the last line of character pattern data has been completed. If yes, proceed to Step 9; otherwise, proceed to Step 6-7.

[0048] Step 9: The OSD module updates the additional information sent by the client based on the speed and direction of motion, and then executes Step 5 after the update.

[0049] The cross-screen display processing system provided in this application embodiment employs high-precision frequency synchronization technology, thus ensuring that the VSYNC of each decoding node remains consistent. This results in smooth and natural transitions between subtitles when displaying across screens, without any visible dividing lines. Furthermore, the cross-screen display processing system provided in this application embodiment avoids complex conversion processing by the main controller, allowing the client to handle the conversion itself, thereby reducing the burden on the main controller.

[0050] It should be noted that the examples provided in the embodiments of this application are only examples of preferred implementations, and are intended to implement the cross-screen display processing system provided in the embodiments of this application. No specific limitations are imposed.

[0051] Example 2

[0052] According to an embodiment of the present invention, a method embodiment of a data processing method is provided, which is applied to the cross-screen display processing system in Embodiment 1. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0053] Figure 4 This is a flowchart illustrating a data processing method according to an embodiment of the present invention, such as... Figure 4 As shown, the processing system for cross-screen display applied in Example 1 includes the following steps:

[0054] Step S402: Receive and store image data;

[0055] Step S404: Receive and store multiple character pattern data;

[0056] Specifically, the data processing method provided in this application embodiment can be applied to a distributed system, which includes multiple decoding nodes. Each decoding node is equipped with a clock module, which is used to synchronize the clocks of the multiple decoding nodes. The timing of the image data corresponding to the synchronized multiple decoding nodes is the same.

[0057] Further, optionally, the data processing method provided in this application embodiment is executed by a first decoding node after synchronization among multiple decoding nodes. The image data corresponding to the first decoding node is the first image data. Receiving and storing the image data includes: the first decoding node receiving the first image data and decoding it to obtain the decoded first image data; and the synchronized first decoding node storing the decoded first image data.

[0058] Furthermore, optionally, the synchronized decoded image data can be stored.

[0059] Storing multiple character pattern data can be achieved by storing multiple character pattern data in different storage locations, and these different storage locations can correspond to different storage addresses.

[0060] Specifically, multiple character pattern data can be obtained by converting the string "Hello, World!" input by the user through the client into character pattern data. The master controller of the first decoding node receives these multiple character pattern data; that is, the client sends the converted "Hello, World!" to the first decoding node, and the first decoding node writes the character pattern data into the memory through the master controller. The memory can be DDR.

[0061] Step S406: Receive additional information about the target character data from multiple character data sets;

[0062] Step S408: Read the target character data from multiple character data sets based on the additional information;

[0063] Optionally, the additional information includes: position information and speed information. Reading the target character data from multiple character data based on the additional information includes: calculating the storage address of the target character data from the multiple character data based on the position information and speed information; and reading the target character data based on the storage address.

[0064] The location information can be the coordinates of the target font data's display position on the screen.

[0065] The location information is obtained by the client based on the speed information. In the process of receiving this additional information, the client sends it according to a preset period or update command. That is, the client periodically sends additional information to the main controller.

[0066] Specifically, in this embodiment, an FPGA is used as an example. Each main controller writes position information into the OSD module with the FPGA as its core. The OSD module calculates the storage address (e.g., DDR address) of the corresponding character data based on the position information and speed information.

[0067] Step S410: Overlay the stored image data with the target character data and send it to the display screen.

[0068] Research and analysis revealed that the significant computational load when enabling OSD functionality stems from the conversion of string data to character data performed by the decoding node. Therefore, this application decentralizes this string-to-character-data conversion process to the client, thereby reducing the data processing burden on the decoding node.

[0069] Specifically, it should be noted that in this embodiment, the image data and the target character data are read simultaneously. If the complete character DDR address range is 0x0-0x1000, and the OSD module of the node corresponding to source 1 calculates the character data address segment corresponding to the first line of the character string as 0x0-0x38 based on the current display coordinates, then source 1 reads the character data from the 0x0-0x38 address segment for overlay processing. Similarly, if the OSD module of the node corresponding to source 2 calculates the character data address segment corresponding to the first line of the character string as 0x39-0x77 based on the current display coordinates, then source 2 reads the character data from the 0x39-0x77 address segment for overlay processing.

[0070] In addition, the display coordinates are updated according to the direction of movement, and the execution actions inside the FPGA are repeated to complete the dynamic character pattern function.

[0071] It should be noted that the embodiments in this application only use FPGA as a preferred example for illustration. The processor can also be a GPU. That is, the main controller transmits the coordinates to be displayed to the GPU to calculate the DDR address of the corresponding character data. Then the GPU reads the character data from the DDR address and performs superposition processing.

[0072] Optionally, the data processing method provided in this application embodiment further includes: receiving additional information sent by the client according to a preset period or update instruction. That is, in embodiment 1 Figure 3 Step 9.

[0073] In this embodiment of the invention, by receiving and storing image data; receiving and storing multiple character pattern data; receiving additional information of target character pattern data from the multiple character pattern data; reading target character pattern data from the multiple character pattern data according to the additional information; superimposing the stored image data and target character pattern data and sending it to the display screen, when the OSD function is enabled, the decoding node can determine the target character pattern data from the multiple character pattern data according to the additional information, thereby reducing the computational load of the decoding node and achieving the technical effect of reducing the burden on the decoding node. This solves the technical problem that in a distributed system, as the processing demand of the decoding node increases, when the OSD function needs to be enabled, the decoding node is overloaded, resulting in poor display effect.

[0074] Example 3

[0075] According to another aspect of the present invention, a data processing apparatus is also provided. Figure 5 This is a schematic diagram of a data processing apparatus according to an embodiment of the present invention, such as... Figure 5 As shown, it includes: a first storage module 50 for receiving and storing image data; a second storage module 52 for receiving and storing multiple character pattern data; a receiving module 54 for receiving additional information of target character pattern data from the multiple character pattern data; a reading module 56 for reading target character pattern data from the multiple character pattern data according to the additional information; and an overlay module 58 for overlaying the stored image data and target character pattern data and sending it to the display screen.

[0076] Optionally, the reading module 56 includes: a calculation unit, used to calculate the storage address of the target character data among multiple character data based on the position information and speed information when the additional information includes position information and speed information; and a reading unit, used to read the target character data according to the storage address.

[0077] Optionally, the data processing device provided in this application embodiment is applied to a distributed system. The distributed system includes multiple decoding nodes. The data processing device provided in this application embodiment is executed by any one of the multiple decoding nodes. Each of the multiple decoding nodes is equipped with a clock module, which is used to synchronize the clocks of the multiple decoding nodes. The timing of the image data corresponding to the synchronized multiple decoding nodes is the same.

[0078] Further, optionally, the data processing device provided in this application embodiment is executed by a first decoding node among multiple decoding nodes. The image data corresponding to the first decoding node is first image data. Receiving and storing image data includes: the first decoding node receiving the first image data and decoding it to obtain decoded first image data; and the synchronized first decoding node storing the decoded first image data.

[0079] Furthermore, optionally, the data processing apparatus provided in this application embodiment further includes: an update module, used to receive additional information sent by the client according to a preset period or update instruction.

[0080] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0081] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0082] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0083] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0084] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0085] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0086] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A data processing method, characterized in that, The method is applied to a distributed system comprising multiple decoding nodes. The method is executed by any one of the multiple decoding nodes, and the decoding node includes: a main controller, a memory, and a processor. The main controller is used to receive and store image data; and to receive and store multiple character pattern data. The main controller is used to receive additional information about the target character data from the plurality of character data. The processor is configured to read target character data from the plurality of character data according to the additional information; The processor is used to overlay the stored image data with the target character data and send it to the display screen; The additional information is sent by the client according to a preset period, and the additional information includes: the position information and speed information of the target character data; Each of the multiple decoding nodes is equipped with a clock module, which is used to synchronize the clocks of the multiple decoding nodes; the timing of the image data corresponding to the synchronized multiple decoding nodes is the same.

2. The method according to claim 1, characterized in that, The step of reading the target character data from the plurality of character data according to the additional information includes: Calculate the storage address of the target character data among the plurality of character data based on the location information and the speed information; Read the target character data based on the storage address.

3. The method according to claim 1, characterized in that, The method is executed by a first decoding node among the plurality of decoding nodes, and the image data corresponding to the first decoding node is the first image data. The receiving and storing of the image data includes: The first decoding node receives the first image data and decodes it to obtain the decoded first image data; The first decoding node after synchronization stores the decoded first image data.

4. The method according to claim 1, characterized in that, The method further includes: The system receives the additional information sent by the client according to a preset period or update instruction.

5. A data processing apparatus, characterized in that, The device is applied in a distributed system, the distributed system including multiple decoding nodes, the device being executed by any one of the multiple decoding nodes, the decoding node including: a main controller, a memory, and a processor, and the device including: The first storage module is used to receive and store image data through the main controller; The second storage module is used to receive and store multiple character pattern data through the main controller; The receiving module is used to receive additional information of the target character data from the plurality of character data through the main controller; A reading module is used to read target character data from the plurality of character data according to the additional information by the processor; An overlay module is used to overlay the stored image data and the target character data through the processor and send them to the display screen; The additional information is sent by the client according to a preset period, and the additional information includes: the position information and speed information of the target character data; Each of the multiple decoding nodes is equipped with a clock module, which is used to synchronize the clocks of the multiple decoding nodes; the timing of the image data corresponding to the synchronized multiple decoding nodes is the same.

6. The apparatus according to claim 5, characterized in that, The reading module includes: The calculation unit is used to calculate the storage address of the target character data among the plurality of character data based on the position information and the speed information; The reading unit is used to read the target character data according to the storage address.

7. The apparatus according to claim 5, characterized in that, The device further includes: The update module is used to receive the additional information sent by the client according to a preset period or update instruction.

8. A cross-screen display processing system, characterized in that, include: At least two decoding nodes and a client, wherein each decoding node includes: a main controller, memory, and a processor; Each decoding node is configured to synchronize with each main controller according to a preset protocol; Each decoding node receives image data and multiple character pattern data sent by the client through the main controller, and stores the image data and multiple character pattern data in the memory, thereby obtaining the storage address of the image data and multiple character pattern data in each decoding node; The client sends additional information to the corresponding decoding node according to a preset period; the additional information includes: the location information and speed information of the target character data; Each decoding node receives the additional information through the main controller, which then sends the additional information to the processor. The processor calculates the storage address of the target character data from the plurality of character data based on the position and speed information in the received additional information, retrieves the target character data from the memory according to the storage address, overlays the target character data with the image data, and displays it on the display screen. At least two decoding nodes are equipped with a clock module for clock synchronization. The synchronized image data of the at least two decoding nodes have the same timing.

Images