FPGA-based control device, method and display equipment

Abstract

The present application provides a control device, method and display device based on FPGA, which relates to video processing technology and can be applied to a liquid crystal display screen including a liquid crystal panel, a backlight plate and a driver chip of the backlight plate. The control device includes: a first communication unit electrically connected to the SOC, used to obtain source video data from the SOC; a first processing unit electrically connected to the first communication unit, used to extract backlight data from the source video data, and transmit the backlight data to a second processing unit and a third processing unit respectively; the second processing unit is used to optimize the backlight data, and transmit the optimized backlight data to the driver chip to control the backlight display; the third processing unit is used to obtain first image data according to the backlight data and the source video data, and transmit the first image data to the liquid crystal panel to display the image. The present application can reduce the requirements for the SOC.

Description

Technical Field

[0001] The present application relates to video processing technology, and in particular to a control device, method and display device based on FPGA. Background Art

[0002] With the continuous advancement of video processing technology, the application of LCD screens is becoming more and more extensive. From the perspective of technology development trend, through the combination of local dimming and light-emitting diode (LED) backlight technology, it is easy to achieve the effects of reducing power consumption, improving the contrast value of the display screen, increasing the number of grayscales and reducing afterimages.

[0003] At present, the implementation architecture of local backlight adjustment includes a low-partition local backlight adjustment scheme and a high-partition local backlight adjustment scheme. Among them, in the low-partition local backlight adjustment scheme, the system on chip (System on Chip, referred to as SOC) outputs image data to the timing control circuit (timing controller, abbreviated as TCON) board, and outputs the backlight data to the light-emitting diode driver (LED Driver, i.e., the driver chip of the backlight panel) according to the driving mode of the light-emitting diode driver; then, the TCON board drives the liquid crystal display, and the driver chip of the backlight panel drives the LED light on the backlight panel. In the high-partition local backlight adjustment scheme, a microcontroller unit (Microcontroller Unit, referred to as MCU) or a field programmable gate array (Field Programmable Gate Array, referred to as FPGA) is added between the SOC and the backlight panel to process the work of the driver chip of the backlight panel, thereby improving some processing capabilities and increasing the number of partitions.

[0004] During the research, the inventors found that the above-mentioned local backlight adjustment implementation architecture has at least the following defects:

[0005] The SOC function is fixed, and the back-end driving method is relatively fixed. It is very difficult to replace the type of driver chip of the backlight panel. A new SOC needs to be remade, which is not flexible in matching and has high cost of re-investing. With too many models, it is difficult to reach a certain level to reduce costs. Summary of the invention

[0006] The present application provides a control device, method and display apparatus based on FPGA to reduce the requirements on SOC.

[0007] In a first aspect, an embodiment of the present application provides a control device based on FPGA, which is applied to a liquid crystal display screen, wherein the liquid crystal display screen includes a liquid crystal panel, a backlight plate and a driver chip of the backlight plate. The control device includes: a first processing unit, a second processing unit, a third processing unit and a first communication unit. Among them, the first communication unit is electrically connected to the SOC, the first processing unit is electrically connected to the first communication unit, and the second processing unit and the third processing unit are electrically connected to the first processing unit respectively. The first communication unit is used to obtain source video data from the SOC. The first processing unit is used to extract backlight data from the source video data, and transmit the backlight data to the second processing unit and the third processing unit respectively. The second processing unit is used to optimize the backlight data, and transmit the optimized backlight data to the driver chip to control the backlight display. The third processing unit is used to obtain first image data based on the backlight data and the source video data, and transmit the first image data to the liquid crystal panel to display the image corresponding to the first image data.

[0008] In a possible implementation, the second processing unit may include a first processing subunit and a first communication subunit. The first processing subunit is connected between the first processing unit and the first communication subunit. The first processing subunit is used to optimize the backlight data using a preset backlight optimization algorithm to obtain the optimized backlight data. The first communication subunit is used to transmit the optimized backlight data to the driver chip according to the driving mode of the backlight panel.

[0009] In a possible implementation, the third processing unit may include a second processing subunit, a third processing subunit, and a second communication subunit. The second processing subunit is electrically connected to the first processing unit, and the third processing subunit is connected between the second processing subunit and the second communication subunit. The second processing subunit is used to obtain image compensation data according to backlight data and a preset backlight smoothing algorithm. The third processing subunit is used to perform fusion processing on the image compensation data and the source video data to obtain the first image data. The second communication subunit is used to transmit the first image data to the liquid crystal panel.

[0010] In a possible implementation, the liquid crystal display screen may further include a touch chip, which is used to detect touch operations on the liquid crystal display screen and obtain touch data based on the touch operations. Accordingly, the above-mentioned control device may further include: a fourth processing unit and a second communication unit. Among them, the second communication unit is electrically connected to the touch chip, and the fourth processing unit is electrically connected between the second communication unit and the third processing unit. The second communication unit is used to obtain touch data from the touch chip. The fourth processing unit is used to obtain second image data corresponding to the liquid crystal panel based on the touch data. The third processing unit can also be used to superimpose the first image data and the second image data, and transmit the superimposed data to the liquid crystal panel.

[0011] In a possible implementation manner, the fourth processing unit may be specifically configured to: store the touch data into a storage space corresponding to the liquid crystal panel according to the coordinates to obtain the second image data.

[0012] In a possible implementation manner, the third processing unit may be specifically configured to: perform superposition processing on the first image data and the second image data based on a preset superposition ratio, and transmit the superimposed data to the liquid crystal panel.

[0013] In a possible implementation manner, the control device may further include: a storage unit, which is electrically connected to the first communication unit and the third processing unit. The storage unit may be used to store source video data.

[0014] In a possible implementation manner, the control device may further include: a control unit, wherein the control unit is used to control the second processing unit and the third processing unit to synchronously send the optimized backlight data or the first image data.

[0015] In a second aspect, an embodiment of the present application provides a control method based on FPGA, which is applied to a liquid crystal display. The liquid crystal display includes a liquid crystal panel, a backlight plate, and a driver chip for the backlight plate. The control method includes:

[0016] Get source video data from SOC;

[0017] extracting backlight data from source video data;

[0018] Optimizing the backlight data and transmitting the optimized backlight data to the driver chip of the backlight panel to control the backlight display;

[0019] First image data is obtained according to the backlight data and the source video data, and the first image data is transmitted to the liquid crystal panel to display an image.

[0020] In a third aspect, an embodiment of the present application provides a display device, comprising: a SOC, a liquid crystal display screen, and a control device as described in any one of the first aspects, wherein the liquid crystal display screen comprises a liquid crystal panel, a backlight panel, and a driving chip of the backlight panel.

[0021] In a possible implementation manner, the display device may further include: a memory electrically connected to the first communication unit and the third processing unit, and configured to store source video data.

[0022] In a possible implementation, the LCD screen also includes: a touch chip for detecting touch operations on the LCD screen, obtaining touch data based on the touch operations, and transmitting the touch data to an FPGA-based control device so that the FPGA-based control device generates a corresponding image according to the touch data.

[0023] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon; when the computer program is executed, the method as described in any one of the second aspects is implemented.

[0024] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program; when the computer program is executed, it implements the method as described in any one of the second aspects.

[0025] The FPGA-based control device, method and display device provided in the embodiment of the present application relate to video processing technology and can be applied to a liquid crystal display screen including a liquid crystal panel, a backlight plate and a driver chip of the backlight plate. Among them, the control device includes: a first communication unit electrically connected to the SOC, used to obtain source video data from the SOC; a first processing unit electrically connected to the first communication unit, used to extract backlight data from the source video data, and transmit the backlight data to the second processing unit and the third processing unit respectively; the second processing unit is used to optimize the backlight data, and transmit the optimized backlight data to the driver chip to control the backlight display; the third processing unit is used to obtain the first image data according to the backlight data and the source video data, and transmit the first image data to the liquid crystal panel to display the image. Since the present application implements backlight extraction, backlight display and image display based on FPGA, the requirements for SOC, such as selection requirements and processing power requirements, are weakened, and the internal logic of the FPGA can be changed according to project requirements, and the driving method of the driver chip of the backlight plate can be more flexibly matched. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0027] Figure 1a It is a schematic diagram of the architecture of the low-partition local backlight adjustment solution;

[0028] Figure 1b It is a schematic diagram of the architecture of the high-partition local backlight adjustment solution;

[0029] Figure 2 An example diagram of an application scenario provided in an embodiment of the present application;

[0030] Figure 3a A schematic diagram of a control device based on FPGA provided in one embodiment of the present application;

[0031] Figure 3b for Figure 3a The data flow diagram of the FPGA-based control device shown;

[0032] Figure 4 A schematic diagram of a control device based on FPGA provided in another embodiment of the present application;

[0033] Figure 5 A schematic diagram of a control device based on FPGA provided in another embodiment of the present application;

[0034] Figure 6 A schematic diagram of a control device based on FPGA provided in another embodiment of the present application;

[0035] Figure 7 A flow chart of a control method based on FPGA provided in one embodiment of the present application;

[0036] Figure 8 A schematic diagram of the structure of a display device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0037] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0038] The terms "first" and "second" etc. in the specification, claims and the above-mentioned drawings of the embodiments of the present application are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, the process, method, system, product or equipment comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0039] It should be understood that the term "and / or" used in this article is only a way to describe the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. " / " means the relationship of "or".

[0040] Local backlight adjustment uses LED backlight instead of CCFL backlight to adjust according to the brightness of the image so that the highlight part of the image on the display screen can be maximized, while the dark part can reduce the brightness or even turn off to achieve the best contrast.

[0041] Taking LED backlight TV as an example, LED backlight TV partitions can be divided into low partitions and high partitions, and their architectures are slightly different. Low partitions mainly refer to partitions within dozens of partitions, and high partitions generally refer to partitions above 100 partitions. At present, high partitions can generally reach more than 300 partitions, which is relatively cost-effective, and the highest supported partitions are developing towards more than 10,000 partitions.

[0042] The current local backlight adjustment implementation architecture is as described above, including low-partition local backlight adjustment solutions (such as Figure 1a As shown) and high-partition local backlight adjustment solution (as shown Figure 1b The implementation architecture of the local backlight adjustment has at least the following defects:

[0043] refer to Figure 1a In this low-partition local backlight adjustment solution, the SOC not only needs to use the local backlight adjustment algorithm to obtain backlight data, but also needs to drive the driver chip of the backlight panel. Its processing power cannot support too high a partition, which is generally within 32 partitions. The advantage is low cost, and the disadvantage is that the SOC function is fixed, and the back-end driving method is relatively fixed. If you want to replace the type of driver chip of the backlight panel, it is very difficult and you need to customize a new SOC, which is not flexible. In addition, there are too few partitions, and the picture effect that can be improved is relatively small.

[0044] refer to Figure 1b In this high-partition local backlight adjustment solution, if you want to increase the number of partitions, you must increase the processing power of the SOC, which leads to an increase in the cost of the SOC; and the SOC model is relatively fixed, and the cost of re-customizing the SOC is high; in addition, it is difficult to reach a certain level to reduce costs when there are too many SOC models. Although the processing power requirements of the SOC are alleviated by processing the work of the backlight driver chip through the MCU or FPGA, the cost is increased compared to the direct drive method of the low partition; in addition, the communication speed of the serial peripheral interface (SPI) between the SOC and the MCU / FPGA also limits the effect and the upper limit of the number of partitions.

[0045] In summary, the current local backlight adjustment implementation architecture has fixed SOC functions and a relatively fixed back-end driving method. It is very difficult to replace the type of driver chip for the backlight panel, and a new SOC needs to be remade. The combination is not flexible, and the cost of re-investing is high. With too many models, it is difficult to reach a certain level to reduce costs.

[0046] Based on the above problems, the present application provides a control device, method and display device based on FPGA, which implements backlight processing and display processing of source video data based on FPGA to obtain optimized backlight data and first image data output to the liquid crystal panel for image display, thereby alleviating the problem of insufficient processing power of the SOC, and further reducing the requirements for the SOC, such as selection requirements and processing power requirements, and more flexibly matching the driving method of the backlight panel driver chip.

[0047] Next, the application scenarios involved in this application are illustrated.

[0048] Figure 2 This is an example diagram of an application scenario provided by an embodiment of the present application. Figure 2 As shown, the user can write on the LCD screen 11 of the display device 10 using a stylus (not shown) or a finger. The touch chip (not shown) in the display device 10 responds to the touch operation detected on the LCD screen 11, obtains touch data corresponding to the touch operation, and transmits the touch data to an FPGA-based control device (not shown). The FPGA-based control device overlays the touch data and the image data, and finally displays the image corresponding to the image data and the trajectory corresponding to the touch data on the LCD screen 11.

[0049] like Figure 2 It is also shown that the display device 10 also communicates data with the server 20 through various communication methods. The display device 10 can be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN) and other networks. The server 20 can provide various content and interactions to the display device 10. The server 20 can be a cluster or multiple clusters, and can include one or more types of servers. Other network service content such as video on demand and advertising services are provided through the server 20.

[0050] The embodiment of the present application does not limit the type, size, resolution, etc. of the specific display device 10. Those skilled in the art will appreciate that the display device 10 may be modified in terms of performance and configuration as needed.

[0051] The FPGA-based control device provided in the present application is explained below in conjunction with specific embodiments.

[0052] Figure 3aThis is a schematic diagram of the principle structure of an FPGA-based control device provided in an embodiment of the present application. This embodiment of the present application provides an FPGA-based control device, which is applied to a liquid crystal display screen, wherein the liquid crystal display screen includes a liquid crystal panel, a backlight plate, and a driver chip for the backlight plate. Figure 3a The FPGA-based control device 30 includes: a first processing unit 31, a second processing unit 32, a third processing unit 33 and a first communication unit 34. Wherein:

[0053] The first communication unit 34 is electrically connected to the SOC, the first processing unit 31 is electrically connected to the first communication unit 34 , and the second processing unit 32 and the third processing unit 33 are electrically connected to the first processing unit 31 , respectively.

[0054] The first communication unit 34 is used to obtain source video data from the SOC. The first processing unit 31 is used to extract backlight data from the source video data, and transmit the backlight data to the second processing unit 32 and the third processing unit 33 respectively. The second processing unit 32 is used to optimize the backlight data, and transmit the optimized backlight data to the driver chip (not shown) to control the backlight display. The third processing unit 33 is used to obtain the first image data according to the backlight data and the source video data, and transmit the first image data to the liquid crystal panel (not shown) to display the image corresponding to the first image data.

[0055] For example, the source video data generated by the SOC is sent to the FPGA-based control device 30 through V-By-One (video by one, referred to as VBO) VBO, or the SOC sends the source video data from the external video source through VBO to the FPGA-based control device 30. Among them, VBO is a digital interface standard technology for image information transmission. Because this technology can support 4.0Gbps high-speed signal transmission at most, and because its unique encoding method avoids the time lag problem between the receiving end data and the clock, VBO is widely used in the field of ultra-high-definition LCD TVs, making ultra-thin and ultra-narrow TVs possible.

[0056] The specific implementation adopted by the first processing unit 31 to extract backlight data from the source video data is not limited in the embodiment of the present application. For example, the first processing unit 31 extracts backlight data from the source video data using a preset backlight data extraction algorithm. Among them, the preset backlight data extraction algorithm may include at least one of the backlight data extraction algorithms such as the mean method, the histogram weighted method, the mean combined with the maximum method, or the histogram inverse mapping function. For the specific implementation of each backlight data extraction algorithm, the following example is used to illustrate the mean method as an example:

[0057] Assume that from a 4K display device, 384 partitions (or called "backlight partitions") are taken as an example, where the resolution of the display device is 3840*2160. In this case, each partition corresponds to 160*135 pixels. At this time, the mean method takes the average of the pixel values ​​of 160*135 pixels as the pixel value of the corresponding partition.

[0058] The specific implementation of other backlight data extraction algorithms can refer to related technologies and will not be described here.

[0059] It should be supplemented that different backlight data extraction algorithms have different processing effects on the same source video data, or in other words, the same backlight data extraction algorithm has different processing effects on different source video data; and, considering that the internal logic of the FPGA can be changed according to project requirements and can support at least one algorithm scheme, therefore, in practical applications, the corresponding backlight data extraction algorithm can be selected based on the characteristics of the source video data. In this way, after the FPGA parses each frame of source video data, it can select the optimal algorithm according to the image content to present the best results.

[0060] like Figure 3b As shown, the flow of video data is:

[0061] The source video data from the SOC is transmitted to the first communication unit 34, which transmits the source video data to the first processing unit 31; the first processing unit 31 extracts the backlight data from the source video data and divides the backlight data into two paths:

[0062] The first backlight data is transmitted from the first processing unit 31 to the second processing unit 32. The second processing unit 32 optimizes the backlight data and transmits the optimized backlight data to the driver chip to control the backlight display.

[0063] The second backlight data is transmitted from the first processing unit 31 to the third processing unit 33. The third processing unit 33 obtains the first image data according to the backlight data and the source video data, and transmits the first image data to the liquid crystal panel for liquid crystal display.

[0064] In the embodiment of the present application, the control device based on FPGA includes: a first communication unit electrically connected to the SOC, used to obtain source video data from the SOC; a first processing unit electrically connected to the first communication unit, used to extract backlight data from the source video data, and transmit the backlight data to the second processing unit and the third processing unit respectively; the second processing unit is used to optimize the backlight data, and transmit the optimized backlight data to the driver chip to control the backlight display; the third processing unit is used to obtain the first image data according to the backlight data and the source video data, and transmit the first image data to the liquid crystal panel to display the image. Since the present application is based on FPGA to realize backlight extraction (i.e. "extracting backlight data from source video data"), backlight display (i.e. "transmitting optimized backlight data to the driver chip to control backlight display") and image display (i.e. "transmitting the first image data to the liquid crystal panel to display the image"), the requirements for SOC, such as selection requirements and processing power requirements, are weakened, and the internal logic of the FPGA can be changed according to the project requirements, and the driving mode of the driver chip of the backlight panel can be more flexibly matched.

[0065] Based on the above embodiment, as a possible implementation method, Figure 4 As shown, in the FPGA-based control device 40, the second processing unit 32 may include a first processing subunit 321 and a first communication subunit 322. Among them, the first processing subunit 321 is connected between the first processing unit 31 and the first communication subunit 322. The first processing subunit 321 is used to optimize the backlight data using a preset backlight optimization algorithm to obtain the optimized backlight data. The first communication subunit 322 is used to transmit the optimized backlight data to the driver chip according to the driving mode of the backlight panel. In this embodiment, the preset backlight optimization algorithm can refer to the current backlight optimization algorithm, which will not be repeated here.

[0066] Still refer to Figure 4In some embodiments, the third processing unit 33 may include a second processing subunit 331, a third processing subunit 332, and a second communication subunit 333. The second processing subunit 331 is electrically connected to the first processing unit 31, and the third processing subunit 332 is connected between the second processing subunit 331 and the second communication subunit 333. The second processing subunit 331 is used to obtain image compensation data according to the backlight data and the preset backlight smoothing algorithm. The third processing subunit 332 is used to fuse the image compensation data and the source video data to obtain the first image data. The second communication subunit 333 is used to transmit the first image data to the liquid crystal panel. In this embodiment, the second processing subunit 331 expands the backlight data again into image compensation data of the same size as the source video data through the preset backlight smoothing algorithm, and the third processing subunit 332 fuses the image compensation data and the source video data to obtain the first image data. For example, the second processing subunit 331 expands the backlight data of the 384 partitions again into 4K image compensation data through a preset backlight smoothing algorithm, and the third processing subunit 332 performs fusion processing on the 4K image compensation data and the 4K source video data to obtain the 4K first image data, which is transmitted to the liquid crystal panel for display through the second communication subunit 333 and the LCD display interface of the liquid crystal display. In addition, the preset backlight smoothing algorithm can refer to the current backlight smoothing algorithm, which will not be repeated here.

[0067] Furthermore, if Figure 1a and Figure 1b The implementation architecture of the local backlight adjustment shown still has an unresolved problem, that is, the LCD display and LED backlight control cannot be synchronized. The SOC transmits the image data to the TCON board, and the TCON board transmits the image data to the LCD panel. There is a delay of more than 1 frame from the time the SOC generates image A to the time the LCD panel displays image A. It takes at least 1 frame for the SOC to convert the image data of image A into backlight data, and then transmit it to the MCU or FPGA for processing, which requires a delay of 1 to 2 frames, and then transmit it to the driver chip of the backlight panel. The driver chip of the backlight panel delays 1 to 2 frames before transmitting it to the LED light for display. In this case, the image A displayed by the LED light will be 2 to 3 frames later than the image A displayed by the LCD. When playing images with fast changes, the "tailing" phenomenon of the backlight can be seen. This is a problem that has not been solved in the industry yet. In response to this problem, the present application makes the following improvements:

[0068] The LCD screen may also include a touch chip, which is used to detect touch operations on the LCD screen and obtain touch data based on the touch operations. Figure 5 As shown, in Figure 3aOn the basis of the structure shown, the FPGA-based control device 50 may further include: a fourth processing unit 51 and a second communication unit 52. The second communication unit 52 is electrically connected to the touch chip, and the fourth processing unit 51 is electrically connected between the second communication unit 52 and the third processing unit 33. The second communication unit 52 is used to obtain touch data from the touch chip 53. The fourth processing unit 51 is used to obtain second image data corresponding to the liquid crystal panel according to the touch data. The third processing unit 33 may also be used to perform superposition processing on the first image data and the second image data, and transmit the superimposed data to the liquid crystal panel.

[0069] It can be understood that if there is a touch operation acting on the LCD screen, the image data output by the FPGA-based control device will be the data after the first image data and the second image data are superimposed; if there is no touch operation acting on the LCD screen, the image data output by the FPGA-based control device will be the first image data.

[0070] In this embodiment, the FPGA-based control device adds integrated processing of touch data, and the touch data is sent to the FPGA-based control device through the touch chip. After parsing the touch data, the FPGA-based control device obtains second image data corresponding to the liquid crystal panel, and superimposes the first image data and the second image data and transmits the superimposed data to the liquid crystal panel to realize the display of the image and the trajectory of the touch operation on the liquid crystal display screen.

[0071] In one implementation, the fourth processing unit 51 may be specifically configured to: store the touch data in a storage space corresponding to the liquid crystal panel according to the coordinates to obtain the second image data. For example, the fourth processing unit 51 stores the touch data containing the coordinate information in a storage space corresponding to the 4K display image according to the coordinates to obtain the second image data. In this example, the image size corresponding to the second image data is 4K.

[0072] Optionally, the third processing unit 33 can be specifically used to: based on a preset superposition ratio, perform superposition processing on the first image data and the second image data, and transmit the superimposed data to the liquid crystal panel. The preset superposition ratio can be selected according to transparency, and the transparency can be set by the system.

[0073] Still refer to Figure 5 In some implementations, the FPGA-based control device 50 may further include: a control unit (not shown). The control unit is used to control the second processing unit 32 and the third processing unit 33 to synchronously send the optimized backlight data or the first image data.

[0074] refer to Figure 6 In some embodiments, Figure 5Based on the structure shown, the FPGA-based control device 60 may further include: a storage unit 61, which is electrically connected to the first communication unit 34 and the third processing unit 33. The storage unit 61 may be used to store source video data. Here, the backup of the source video data is achieved through the storage unit.

[0075] In summary, the FPGA-based control device provided by this application has at least the following advantages:

[0076] 1) Use FPGA to realize the functions of backlight extraction, backlight display, touch fusion and LCD display, eliminate the existence of TCON board and MCU, and weaken the requirements for SOC. SOC no longer undertakes the work of picture processing and touch data fusion. The selection and cost of SOC can be reduced, and the internal logic of FPGA can be changed according to project requirements.

[0077] 2) Both backlight data and image data are generated and sent by the same hardware of FPGA, and no longer belong to different devices, so the synchronization of the two data is more accurate and can be flexibly adjusted. The FPGA design algorithm dynamic transformation function selects a more suitable backlight extraction algorithm according to different display screens.

[0078] 3) In the traditional solution, the backlight data and the source video data are superimposed to form new video data, which is then delayed, cached, and processed by various algorithms in sequence, and finally displayed on the LCD panel. Therefore, there will be at least 2 frames of screen delay from the generation to the final display of the touch data. In this application, the FPGA superimposes the touch data and the processed image data (such as the second image data described above) and outputs them to the liquid crystal panel (i.e., LCD display) for display, and the delay from generation to display is within 1 frame. This greatly reduces the screen delay when touching and writing, and has the same experience as writing on a book.

[0079] 4) Partitions can be arbitrarily deployed. FPGA is a parallel processing mechanism. Unlike TCON boards or SOCs, which have fixed IO settings and limited output port functions, FPGA can arbitrarily define output port functions. When increasing partitions, you can configure the idle IO to drive partitions. One board can be used for multiple purposes, and it is highly versatile and flexible.

[0080] The above embodiments explain the structure and function of the FPGA-based control device provided in the embodiments of the present application. The following is a method embodiment of the present application, which can be executed by the FPGA-based control device described in the above device embodiment of the present application. For details not disclosed in the method embodiment of the present application, reference can be made to the device embodiment of the present application described above.

[0081] Figure 7 This is a flow chart of a control method based on FPGA provided in one embodiment of the present application. Figure 7 As shown, the FPGA-based control method includes:

[0082] S701 , obtaining source video data from SOC.

[0083] S702, extracting backlight data from source video data;

[0084] S703, optimizing the backlight data, and transmitting the optimized backlight data to the driver chip of the backlight panel to control the backlight display;

[0085] S704 , obtaining first image data according to the backlight data and the source video data, and transmitting the first image data to the liquid crystal panel to display an image.

[0086] Optionally, performing optimization processing on the backlight data may include: performing optimization processing on the backlight data using a preset backlight optimization algorithm to obtain optimized backlight data.

[0087] Furthermore, obtaining the first image data according to the backlight data and the source video data may include: obtaining image compensation data according to the backlight data and a preset backlight smoothing algorithm; and fusing the image compensation data and the source video data to obtain the first image data.

[0088] In some embodiments, the liquid crystal display screen may further include a touch chip, which is used to detect touch operations on the liquid crystal display screen and obtain touch data based on the touch operations. Correspondingly, the control method may further include: obtaining touch data from the touch chip; obtaining second image data corresponding to the liquid crystal panel according to the touch data; superimposing the first image data and the second image data, and transmitting the superimposed data to the liquid crystal panel.

[0089] Furthermore, obtaining second image data corresponding to the liquid crystal panel according to the touch data may include: storing the touch data in a location of a storage space corresponding to the liquid crystal panel according to coordinates to obtain the second image data.

[0090] In some embodiments, performing the overlay process on the first image data and the second image data may include: performing the overlay process on the first image data and the second image data based on a preset overlay ratio.

[0091] Optionally, after acquiring the source video data from the SOC, the method may further include: storing the source video data in a storage unit. Accordingly, before obtaining the first image data according to the backlight data and the source video data, the method may further include: acquiring the source video data from the storage unit.

[0092] The optimized backlight data and the first image data are sent at the same time.

[0093] Figure 8 This is a schematic diagram of the structure of a display device provided in one embodiment of the present application. Figure 8 As shown, the display device 80 includes: a SOC 81, a liquid crystal display screen 82, and a FPGA-based control device 83. The liquid crystal display screen 82 includes a liquid crystal panel 821, a backlight panel 822, and a driver chip 823 of the backlight panel 822. The FPGA-based control device 83 can be specifically a FPGA-based control device as described in any of the above embodiments.

[0094] For example, the display device 80 may be an electronic device with display function such as a liquid crystal television, an interactive whiteboard, a mobile phone or a tablet computer, etc. The interactive whiteboard may integrate any one or more functions of a projector, an electronic whiteboard, a screen, a sound system, a television, and a video conferencing terminal.

[0095] In some embodiments, the LCD screen 82 may further include a touch chip 824. The touch chip 824 is used to detect touch operations on the LCD screen 82, obtain touch data based on the touch operations, and transmit the touch data to the FPGA-based control device 83, so that the FPGA-based control device 83 generates a corresponding image according to the touch data.

[0096] In some embodiments, the display device 80 may further include: a memory 84 for storing source video data. If the FPGA-based control device 83 does not include a storage unit, the FPGA-based control device 83 may store the source video data in the memory 84 after acquiring the source video data, so as to acquire the source video data from the memory 84 during the subsequent video processing. The memory 84 may specifically be a double data rate synchronous dynamic random access memory (DDR SDRAM or DDR for short). This embodiment replaces the current hardware architecture of the TCON board or the TCON board and the FPGA / MCU with a hardware combination of the FPGA-based control device 83 and the memory 84.

[0097] In addition, the memory 84 can also be used to store computer programs, including computer programs corresponding to the FPGA-based control method. The memory 84 may include a program storage area and a data storage area. The program storage area may store an operating system, an application required for at least one function, etc. The data storage area may store data (such as audio and video data, etc.) created during the use of the display device 80.

[0098] The display device of this embodiment can be used to execute the technical solution in the above method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0099] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored; when the computer program is executed, a solution provided by any of the above method embodiments is implemented.

[0100] The present application also provides a computer program product, which includes: a computer program. The computer program can be stored in a readable storage medium, and at least one processor of the display device can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the display device executes the solution provided by any of the above method embodiments.

[0101] In the above-mentioned embodiments, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or modules, which can be electrical, mechanical or other forms.

[0102] In addition, each functional module in each embodiment of the present application can be integrated into one processing unit, or each module can exist physically separately, or two or more modules can be integrated into one unit. The above-mentioned module-composed unit can be implemented in the form of hardware or in the form of hardware plus software functional units.

[0103] The above-mentioned integrated module implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform some steps of the method described in each embodiment of the present application.

[0104] The above storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk, etc. The storage medium can be any available medium that can be accessed by a general or special-purpose computer.

[0105] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to the computer program. The above-mentioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the above-mentioned storage medium includes: ROM, RAM, magnetic disk or optical disk, etc., various media that can store program codes.

[0106] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A control device based on FPGA, applied to a liquid crystal display screen, wherein the liquid crystal display screen comprises a liquid crystal panel, a backlight plate and a driving chip of the backlight plate, characterized in that: The FPGA-based control device includes: a first processing unit, a second processing unit, a third processing unit and a first communication unit; The first communication unit is electrically connected to a system-on-chip (SOC), the first processing unit is electrically connected to the first communication unit, and the second processing unit and the third processing unit are electrically connected to the first processing unit respectively; The first communication unit is used to obtain source video data from the SOC; The first processing unit is used to extract backlight data from the source video data, and divide the backlight data into two paths: a first path of backlight data and a second path of backlight data, and transmit the first path of backlight data and the second path of backlight data to the second processing unit and the third processing unit respectively; The second processing unit is used to optimize the first-channel backlight data and transmit the optimized first-channel backlight data to the driving chip to control the backlight display; The third processing unit is used to obtain first image data according to the second backlight data and the source video data, and transmit the first image data to the liquid crystal panel to display an image; The liquid crystal display screen further includes a touch chip, and the touch chip is used to detect a touch operation on the liquid crystal display screen and obtain touch data based on the touch operation. The FPGA-based control device further includes: a fourth processing unit and a second communication unit; The second communication unit is electrically connected to the touch chip, and the fourth processing unit is electrically connected between the second communication unit and the third processing unit; The second communication unit is used to obtain the touch data from the touch chip; The fourth processing unit is configured to obtain second image data corresponding to the liquid crystal panel according to the touch data; The third processing unit is further used to perform superposition processing on the first image data and the second image data, and transmit the superimposed data to the liquid crystal panel; The fourth processing unit is specifically configured to: The touch data is stored in a storage space corresponding to the liquid crystal panel according to the coordinates to obtain the second image data.

2. The FPGA-based control device according to claim 1, characterized in that: The second processing unit includes a first processing subunit and a first communication subunit; The first processing subunit is connected between the first processing unit and the first communication subunit; The first processing sub-unit is used to optimize the first channel of backlight data using a preset backlight optimization algorithm to obtain the first channel of backlight data after optimization; The first communication subunit is used to transmit the optimized first-channel backlight data to the driving chip according to the driving mode of the backlight panel.

3. The FPGA-based control device according to claim 1, characterized in that: The third processing unit includes a second processing subunit, a third processing subunit and a second communication subunit; The second processing subunit is electrically connected to the first processing unit, and the third processing subunit is connected between the second processing subunit and the second communication subunit; The second processing subunit is used to obtain image compensation data according to the second backlight data and a preset backlight smoothing algorithm; The third processing subunit is used to perform fusion processing on the image compensation data and the source video data to obtain the first image data; The second communication subunit is used to transmit the first image data to the liquid crystal panel.

4. The FPGA-based control device according to claim 3, characterized in that: The third processing unit is specifically used for: Based on a preset superposition ratio, the first image data and the second image data are superimposed, and the superimposed data are transmitted to the liquid crystal panel.

5. The FPGA-based control device according to any one of claims 1 to 3, characterized in that: The control device based on FPGA also includes: a storage unit; The storage unit is electrically connected to the first communication unit and the third processing unit; The storage unit is used to store the source video data.

6. The FPGA-based control device according to any one of claims 1 to 3, characterized in that: The control device based on FPGA also includes: a control unit; The control unit is used to control the second processing unit and the third processing unit to synchronously send the first-channel backlight data or the first image data after the optimization processing.

7. A display device, characterized in that: include: A system-on-chip (SOC), a liquid crystal display screen, and a FPGA-based control device as claimed in any one of claims 1 to 6, wherein the liquid crystal display screen comprises a liquid crystal panel, a backlight plate, and a driver chip for the backlight plate.

8. The display device according to claim 7, characterized in that Also includes: A memory electrically connected to the first communication unit and the third processing unit is used to store the source video data.

9. The display device according to claim 7 or 8, characterized in that: The LCD screen also includes: a touch chip for detecting touch operations on the LCD screen, obtaining touch data based on the touch operations, and transmitting the touch data to the FPGA-based control device so that the FPGA-based control device generates a corresponding image according to the touch data.

Images