Light emitting diode display system and display device, electronic device and chip

Abstract

The present disclosure relates to a light emitting diode display system and display device, electronic device and chip, comprising: a media source and a plurality of receiving cards, wherein: the media source is configured to send a global virtual canvas to the plurality of receiving cards; a single receiving card comprises: a positioning register configured to record a position parameter and a pixel driving range corresponding to a region in a light emitting diode screen of the receiving card; a microprocessor configured to calculate a global scaling factor based on a resolution of the global virtual canvas and a resolution of the light emitting diode screen; and a hardware extraction engine configured to calculate a pixel region to be displayed in a received video frame corresponding to the receiving card based on the global scaling factor and the position parameter and the pixel driving range. By using the system of the present disclosure, adaptive scaling of dynamic video streams at the receiving card end can be achieved.

Description

Technical Field

[0001] This disclosure relates to the field of displays, and more particularly to a light-emitting diode display system and display device, electronic device and chip. Background Technology

[0002] Light-emitting diode (LED) display control systems typically employ a hierarchical architecture of "video source—sending card—receiving card—LED panel". Generally, the sending card receives image signals from the video source, performs scaling, splicing, and color space conversion on the images, and distributes the processed video data in slices according to the physical location of the receiving card on the LED screen. The receiving card receives pre-cropped data segments from the sending card and drives the LED pixel matrix under its jurisdiction for display. In other words, the data processed by the receiving card is still based on the specific resolution segments pre-cropped by the sending card.

[0003] In the above architecture, image scaling and slicing operations are centralized on the transmitting card side. The mapping relationship between the pixel regions driven by each receiving card and the corresponding data segments in the video source is statically specified by the transmitting card through pre-configuration. When the resolution of the input video source changes or the physical splicing layout of the screen is adjusted, the transmitting card needs to re-execute the global scaling calculation and redistribute the updated mapping configuration to each receiving card.

[0004] Currently, the existing "cardless" mode focuses on the video source device directly completing the data processing and forwarding tasks undertaken by the sending card, or the display screen directly outputting the built-in test screen when the LED display system is offline. Neither of these involves the adaptive scaling processing of the dynamic video stream at the receiving card end. Summary of the Invention

[0005] In view of this, the present disclosure provides a light-emitting diode display system, display device, electronic device and chip.

[0006] According to one aspect of this disclosure, a light-emitting diode (LED) display system is provided, comprising: a media source and a plurality of receiving cards, wherein: the media source is configured to send a global virtual canvas to the plurality of receiving cards; each receiving card includes: a positioning register configured to record position parameters and pixel driving range of the receiving card corresponding to a region in the LED screen; a microprocessor configured to calculate a global scaling factor based on the resolution of the global virtual canvas and the resolution of the LED screen; and a hardware extraction engine configured to calculate the pixel region to be displayed in a received video frame corresponding to the receiving card based on the global scaling factor, the position parameters, and the pixel driving range.

[0007] In one possible implementation, the global scaling factor includes a horizontal scaling ratio and a vertical scaling ratio; the microprocessor is configured to: determine the horizontal scaling ratio based on the ratio of the width of the global virtual canvas to the width of the original video corresponding to the global virtual canvas; and determine the vertical scaling ratio based on the ratio of the height of the global virtual canvas to the height of the original video corresponding to the global virtual canvas.

[0008] In one possible implementation, the hardware extraction engine is used to: calculate the corresponding pixel coordinate range from the global virtual canvas by inverse mapping based on the position parameters and pixel driving range, combined with the global scaling factor, so as to obtain the start and end coordinates of the pixel area to be displayed.

[0009] In one possible implementation, the hardware extraction engine is specifically used to: divide the x-coordinate value and y-coordinate value in the position parameter by the global scaling factor of the corresponding dimension to obtain the starting coordinate; and divide the sum of the position parameter and the pixel driving range by the global scaling factor of the corresponding dimension to obtain the ending coordinate.

[0010] In one possible implementation, the hardware extraction engine is further configured to: calculate the expansion boundary margin based on the filter order of the image scaling algorithm; expand the pixel region to be displayed outward according to the expansion boundary margin to obtain an expansion region containing redundant pixels; perform image scaling interpolation processing based on the pixel data in the expansion region; and truncate and output the image after image scaling interpolation processing according to the pixel driving range.

[0011] According to another aspect of this disclosure, a display device is provided, including a plurality of display units and at least one of the above-described systems.

[0012] In one possible implementation, the display unit includes a display panel, which includes at least one of a liquid crystal display panel, a micro light-emitting diode display panel, a light-emitting diode display panel, a mini light-emitting diode display panel, a quantum dot light-emitting diode display panel, an organic light-emitting diode display panel, a cathode ray tube display panel, a digital light processing display panel, a field emission display panel, a plasma display panel, an electrophoretic display panel, an electrowetting display panel, and a small-pitch display panel.

[0013] According to another aspect of this disclosure, an electronic device is provided, including the display device described above.

[0014] According to another aspect of this disclosure, an electronic device is provided, comprising:

[0015] processor;

[0016] Memory used to store processor-executable instructions;

[0017] The processor is configured to implement any of the above-described systems when executing instructions stored in the memory.

[0018] According to another aspect of this disclosure, a chip is provided that includes the system described above.

[0019] The LED display system of this disclosure includes: a media source and multiple receiving cards, wherein: the media source is used to send a global virtual canvas to the multiple receiving cards; each receiving card includes: a positioning register for recording position parameters and pixel driving range of the receiving card corresponding to a region in the LED screen; a microprocessor for calculating a global scaling factor based on the resolution of the global virtual canvas and the resolution of the LED screen; and a hardware extraction engine for calculating the pixel area to be displayed in the received video frame corresponding to the receiving card based on the global scaling factor, the position parameters, and the pixel driving range. By using the system of this disclosure, adaptive scaling of dynamic video streams at the receiving card end can be achieved.

[0020] In this embodiment of the disclosure, each receiving card can calculate the corresponding pixel area to be displayed for each received video frame in real time based on the global scaling factor, position parameters and the pixel driving range, so that each receiving card can independently capture and scale a part of the global image, thereby realizing adaptive scaling of the dynamic video stream at the receiving card end. Attached Figure Description

[0021] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments, features, and aspects of this disclosure together with the specification and serve to explain the principles of this disclosure.

[0022] Figure 1 A block diagram of a light-emitting diode display system according to an embodiment of the present disclosure is shown. Detailed Implementation

[0023] Various exemplary embodiments, features, and aspects of this disclosure will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0024] As used herein, the terms “comprising,” “including,” “having,” or variations thereof are open-ended and include one or more of the stated features, integrals, elements, steps, components, or functions, but do not exclude the presence or addition of one or more other features, integrals, elements, steps, components, functions, or groups thereof.

[0025] When an element is referred to as “connected,” “coupled,” “responding,” or a variation thereof relative to another element, it may be directly connected, coupled, or responding to another element, or there may be an intermediate element present.

[0026] Although the terms first, second, third, etc., may be used herein to describe various elements / operations, these elements / operations should not be limited by these terms. These terms are only used to distinguish one element / operation from another. Therefore, without departing from the teachings of the inventive concept, a first element / operation in some embodiments may be referred to as a second element / operation in other embodiments.

[0027] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0028] Furthermore, to better illustrate this disclosure, numerous specific details are set forth in the following detailed description. Those skilled in the art will understand that this disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art have not been described in detail in order to highlight the main points of this disclosure.

[0029] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, data stored, data displayed, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant regions.

[0030] The LED display system of this disclosure includes: a media source and multiple receiving cards, wherein: the media source is used to send a global virtual canvas to the multiple receiving cards; each receiving card includes: a positioning register for recording position parameters and pixel driving range of the receiving card corresponding to a region in the LED screen; a microprocessor for calculating a global scaling factor based on the resolution of the global virtual canvas and the resolution of the LED screen; and a hardware extraction engine for calculating the pixel area to be displayed in the received video frame corresponding to the receiving card based on the global scaling factor, the position parameters, and the pixel driving range. By using the system of this disclosure, adaptive scaling of dynamic video streams at the receiving card end can be achieved.

[0031] Figure 1 A block diagram of a light-emitting diode display system according to an embodiment of the present disclosure is shown. Figure 1As shown, the system includes: a media source 11 and multiple receiving cards 12, wherein: the media source is used to send a global virtual canvas to the multiple receiving cards; each receiving card includes: a positioning register 13, used to record the position parameters and pixel driving range of the receiving card corresponding to the area in the LED screen; a microprocessor 14, used to calculate a global scaling factor based on the resolution of the global virtual canvas and the resolution of the LED screen; and a hardware extraction engine 15, used to calculate the pixel area to be displayed in the received video frame corresponding to the receiving card based on the global scaling factor, the position parameters, and the pixel driving range.

[0032] A media source can be a signal source used in an LED display system to provide raw video data, and its output is a continuous sequence of video frames, which serves as the input signal for the entire display system.

[0033] A global virtual canvas is a logically constructed, complete canvas with a preset size in an LED display system, meaning it can have a preset pixel width. and pixel height .

[0034] The system's media source can broadcast complete global virtual canvas data via wired or wireless communication networks. After the data stream is transmitted over the network, it can reach all receiving cards connected to the network.

[0035] Each receiving card may include a positioning register, which may be a globally unique spatial positioning register. The positioning register may record the position parameters and pixel driving range of the receiving card corresponding to the area in the LED screen. The position parameters may be the absolute starting coordinates of the receiving card in the physical topology of the LED screen. , The pixel driving range can be the size of the LED pixel matrix actually driven by the receiver card. , ).

[0036] Each receiver card also includes a microprocessor that can calculate a global scaling factor in real time for each received video frame based on the resolution of the global virtual canvas and the resolution of the LED screen.

[0037] Each receiver card's hardware extraction engine can calculate the pixel region to be displayed in the received video frame corresponding to its own receiver card, based on the global scaling factor, the position parameters, and the pixel driving range. The pixel region to be displayed can be a portion of the pixel region that the receiver card identifies from the complete video frame and is responsible for processing by that receiver card.

[0038] In this embodiment of the disclosure, each receiving card can calculate the corresponding pixel area to be displayed for each received video frame in real time based on the global scaling factor, position parameters and the pixel driving range, so that each receiving card can independently capture and scale a part of the global image, thereby realizing adaptive scaling of the dynamic video stream at the receiving card end.

[0039] In one possible implementation, the global scaling factor includes a horizontal scaling ratio and a vertical scaling ratio; the microprocessor is configured to: determine the horizontal scaling ratio based on the ratio of the width of the global virtual canvas to the width of the original video corresponding to the global virtual canvas; and determine the vertical scaling ratio based on the ratio of the height of the global virtual canvas to the height of the original video corresponding to the global virtual canvas.

[0040] The global scaling factor can include the horizontal scaling ratio. and vertical scaling ratio The microprocessor can base its operation on the width of the global virtual canvas. Width of the original video corresponding to the global virtual canvas The ratio determines the horizontal scaling ratio. Horizontal scaling ratio The formula can be found in formula (1). The microprocessor can base its calculations on the height of the global virtual canvas. The height of the original video corresponding to the global virtual canvas The ratio is used to determine the vertical scaling ratio. Vertical scaling ratio The formula can be found in formula (2).

[0041] (1)

[0042] (2)

[0043] In this embodiment of the disclosure, by calculating the horizontal scaling ratio and the vertical scaling ratio respectively, it is ensured that the receiving card is accurately corresponding in the horizontal and vertical directions respectively, thus avoiding positioning offset when mapping from the original video to the canvas.

[0044] In one possible implementation, the hardware extraction engine is used to: calculate the corresponding pixel coordinate range from the global virtual canvas by inverse mapping based on the position parameters and pixel driving range, combined with the global scaling factor, so as to obtain the start and end coordinates of the pixel area to be displayed.

[0045] In this embodiment of the disclosure, when the global video stream data packet arrives at the network port of the receiving card, the hardware extraction engine of the receiving card may not cache the entire frame image, but instead use the global scaling factor, its own position parameters, and pixel driving range to perform reverse mapping. Then, through reverse mapping, the corresponding pixel coordinate range is derived from the global virtual canvas to obtain the starting coordinates of the pixel area to be displayed. , ) and end coordinates ( , ).

[0046] In this embodiment of the disclosure, by using the global scaling factor to perform inverse mapping with its own position parameters and pixel driving range, the receiving card does not need to process the entire frame of original video data, but only needs to accurately extract the required pixels based on its own coordinates and the global scaling factor, thus avoiding the computational overhead caused by scaling the entire frame of the image.

[0047] In one possible implementation, the hardware extraction engine is specifically used to: divide the x-coordinate value and y-coordinate value in the position parameter by the global scaling factor of the corresponding dimension to obtain the starting coordinate; and divide the sum of the position parameter and the pixel driving range by the global scaling factor of the corresponding dimension to obtain the ending coordinate.

[0048] Specifically, the starting coordinates ( , The formula for () can be found in formula (3), and the ending coordinate is ( , The formula for ) can be found in formula (4).

[0049] (3)

[0050] (4)

[0051] in, The x-coordinate of the starting coordinate. The ordinate of the starting coordinate. The horizontal coordinate of the receiving card's starting point on the LED screen. The vertical coordinate of the receiving card's starting point on the LED screen. This refers to the number of horizontal pixels. This refers to the number of vertical pixels. The x-coordinate of the ending coordinate. The ordinate is the end coordinate.

[0052] In this embodiment of the disclosure, each receiving card can calculate the corresponding pixel area to be displayed for each received video frame in real time based on the global scaling factor, position parameters and the pixel driving range, so that each receiving card can independently capture and scale a part of the global image, thereby realizing adaptive scaling of the dynamic video stream at the receiving card end.

[0053] In centralized systems, image scaling is performed by the processor feeding the entire source image into the processing engine for filtering and interpolation. Multiphase filtering algorithms, such as Bicubic interpolation and the Lanczos algorithm, require referencing a surrounding pixel to calculate the value of a target pixel. The number of source pixels in the matrix. In the distributed scaling system described in this embodiment, each receiving card independently scales the image fragments it is responsible for. At this time, edge pixels located on the physical boundary of the receiving card will face the problem of missing source data when performing scaling calculations, because the data of its adjacent source pixels belongs to another adjacent receiving card in terms of physical jurisdiction. If no processing is done, the algorithm will use a crude method of mirroring or truncation and zero padding at the boundary, resulting in severe uneven brightness and texture discontinuity (i.e., "scaling boundary artifacts") at the junction of the multiple receiving cards in the final image.

[0054] In one possible implementation of this disclosure, the hardware extraction engine is further configured to: calculate the expansion boundary margin based on the filter order of the image scaling algorithm; expand the pixel region to be displayed outward according to the expansion boundary margin to obtain an expansion region containing redundant pixels; perform image scaling interpolation processing based on the pixel data within the expansion region; and truncate and output the image after image scaling interpolation processing according to the pixel driving range.

[0055] In image scaling, the hardware extraction engine can automatically calculate an expansion margin based on the filter order of the selected scaling algorithm before scaling. This allows edge pixels to obtain sufficient reference data from the extended region during calculation. Based on this boundary margin, the area of ​​pixels to be displayed can be expanded outwards to obtain an extended region containing redundant pixels; that is, the starting coordinates can be derived from […]. [Expanded to] The ending coordinates can be obtained from [ , [Expanded to] .

[0056] In this embodiment, image scaling interpolation can be performed based on pixel data within the extended region. When finally generating the image, the scaled and interpolated image can be truncated and output according to the pixel-driven range. The computational domain expansion and display domain convergence mechanism in this embodiment ensures that the scaling results of all receiving cards are perfectly continuous on the mathematical boundaries. Without requiring any horizontal communication between nodes, it completely eliminates the disjointed image stitching caused by distributed scaling, guaranteeing the optical consistency of the ultra-high resolution display matrix.

[0057] Application scenario examples

[0058] In this embodiment of the disclosure, the system's media source broadcasts a global virtual canvas to the network, which has the original video's resolution specifications (assuming a width of...). The height is The total physical display area of ​​the LED screen is also mapped to a logical resolution (assuming a total width of...). Total height is Each LED receiver card in the network is assigned a globally unique spatial positioning register, which records the absolute starting coordinates of the receiver card in the screen's physical topology. , ), and the actual size of the LED pixel matrix driven by the receiver card ( , ).

[0059] The microprocessor built into the receiver card calculates the global scaling factor in real time: the formula for the horizontal scaling ratio can be seen in formula (1), and the formula for the vertical scaling ratio can be seen in formula (2). When the global video stream data packet arrives at the network port of the receiver card, the hardware extraction engine of the receiver card does not cache the entire frame image, but uses the scaling factor to perform reverse mapping with its own physical coordinates to calculate the start and end coordinate areas of the original video data required by itself in the source canvas in real time. The specific formulas can be seen in formula (3) and formula (4).

[0060] In this embodiment of the disclosure, the adaptive local scaling mechanism enables a large number of receiving cards to independently capture and scale a fragment of the global image, and finally seamlessly stitch them together in the physical world to form a large image, completely eliminating the computing load on the front-end device.

[0061] In order to break down the data silos between nodes in distributed computing and avoid the synchronization overhead and delay caused by massive peer-to-peer communication between receiving cards, this patent introduces an overlap margin sniffing strategy in the data packet sniffing module of the receiving card.

[0062] The receiving card calculates the coordinate range of the pixel area to be displayed in the source video through reverse mapping: [ ] arrive[ , Furthermore, the hardware engine can automatically calculate an extended boundary margin based on the filter order (Taps) of the selected scaling algorithm. The range of data packets actually captured by the receiving card in the network stream is extended to: , arrive .

[0063] This means that each receiving card will capture an extra ring of source video pixels that originally belonged to its physical neighbors. These extra redundant pixels are fed into the receiving card's image scaling engine as a context reference for edge computing. However, when the scaling engine outputs the final generated physical pixels, it will determine the appropriate scaling parameters based on its own... , The calculation results are precisely truncated at the real physical boundary, discarding the results of calculations in the extended region. This mechanism of "computation domain expansion and display domain convergence" ensures that the scaling results of all receiving cards are perfectly continuous at the mathematical boundary. Without the need for any horizontal communication between nodes, it completely eliminates the sense of screen splicing caused by distributed scaling and ensures the optical consistency of the ultra-high resolution display matrix.

[0064] This disclosure also provides a chip that includes the system described above.

[0065] This disclosure also provides an electronic device, including the system described above.

[0066] This disclosure also provides a display device, including a plurality of display units and at least one of the systems described above.

[0067] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0068] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A light-emitting diode display system, characterized in that, include: Media source and multiple receiving cards, including: The media source is used to send a global virtual canvas to the multiple receiving cards; The single receiver card includes: The positioning register is used to record the position parameters and pixel driving range of this receiver card corresponding to the area in the LED screen; A microprocessor is used to calculate a global scaling factor based on the resolution of the global virtual canvas and the resolution of the LED screen; A hardware extraction engine is used to calculate the pixel region to be displayed in the received video frame corresponding to the receiving card, based on the global scaling factor, the position parameters, and the pixel driving range.

2. The system according to claim 1, characterized in that, The global scaling factor includes a horizontal scaling ratio and a vertical scaling ratio; the microprocessor is used for: The horizontal scaling ratio is determined based on the ratio of the width of the global virtual canvas to the width of the original video corresponding to the global virtual canvas. The vertical scaling ratio is determined based on the ratio of the height of the global virtual canvas to the height of the original video corresponding to the global virtual canvas.

3. The system according to claim 1, characterized in that, The hardware extraction engine is used for: Based on the position parameters and pixel driving range, and combined with the global scaling factor, the corresponding pixel coordinate range is calculated from the global virtual canvas through inverse mapping to obtain the start and end coordinates of the pixel area to be displayed.

4. The system according to claim 3, characterized in that, The hardware extraction engine is specifically used for: The starting coordinates are obtained by dividing the x-coordinate and y-coordinate values ​​in the position parameters by the global scaling factor of the corresponding dimension. The end coordinates are obtained by dividing the sum of the position parameters and the pixel driving range by the global scaling factor of the corresponding dimension.

5. The system according to claim 1, characterized in that, The hardware extraction engine is also used for: Calculate the extended boundary margin based on the filter order of the image scaling algorithm; Based on the aforementioned expansion boundary margin, the area of ​​pixels to be displayed is expanded outward to obtain an expanded area containing redundant pixels; Based on the pixel data within the extended region, image scaling and interpolation processing is performed; According to the pixel driving range, the image after scaling and interpolation is truncated and output.

6. A display device, characterized in that, It includes multiple display units and at least one system according to claims 1 to 5.

7. The display device according to claim 6, characterized in that, The display unit includes a display panel, which includes at least one of the following: liquid crystal display panel, micro light-emitting diode display panel, light-emitting diode display panel, mini light-emitting diode display panel, quantum dot light-emitting diode display panel, organic light-emitting diode display panel, cathode ray tube display panel, digital light processing display panel, field emission display panel, plasma display panel, electrophoretic display panel, electrowetting display panel, and small-pitch display panel.

8. An electronic device, characterized in that, Includes the display device according to claim 6 or 7.

9. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to implement the system according to any one of claims 1 to 5 when executing instructions stored in the memory.

10. A chip, characterized in that, The chip includes the system described in claims 1 to 5.

Images