Data processing device, control method thereof, and display device

Abstract

The present disclosure provides a data processing device, a control method thereof, and a display device. The data processing device includes: a write controller configured to write video image data and human-computer interaction interface information into a memory; a first read controller configured to read the video image data from the memory; a second read controller configured to read the human-computer interaction interface information from the memory; an overlay configured to overlay the video image data received from the first read controller and the human-computer interaction interface information received from the second read controller to obtain target image information; and a command controller configured to control the write controller to write the human-computer interaction interface information into the memory and start the overlay upon receiving an on command, and to control the write controller to stop writing the human-computer interaction interface information into the memory and close the overlay upon receiving a off command.

Description

Technical Field

[0001] The present disclosure relates to the field of display technology, and in particular to a data processing device and a control method thereof, and a display device. Background Art

[0002] Because monitor systems can replace film and provide high-quality images, their application in broadcasting, medical, and other fields has become increasingly popular in recent years. In related technologies, the processing mode of monitor systems is that the human-computer interface synchronizes with the video image data through memory, and the SOC (System on Chip) controls whether to display the image. During the monitor system's non-display period, the human-computer interface still accesses the memory in real time, resulting in relatively high power consumption of the monitor system's FPGA (Field Programmable Gate Array). Summary of the Invention

[0003] According to one aspect of an embodiment of the present disclosure, a data processing device is provided, including: a write controller configured to write video image data and human-computer interaction interface information into a memory; a first read controller configured to read the video image data from the memory; a second read controller configured to read the human-computer interaction interface information from the memory; an overlay controller configured to overlay the video image data received from the first read controller and the human-computer interaction interface information received from the second read controller to obtain target image information; and a command controller configured to control the write controller to write the human-computer interaction interface information into the memory and start the overlay controller after receiving an open command, and to control the write controller to stop writing the human-computer interaction interface information into the memory and close the overlay controller after receiving a close command.

[0004] In some embodiments, the data processing device also includes: a first timing generator configured to generate a first timing control signal for controlling the read operation of the first read controller; and a second timing generator configured to generate a second timing control signal for controlling the read operation of the second read controller.

[0005] In some embodiments, the command controller includes: a command detection module, configured to receive the start command and output a start signal; a first counter, configured to count the frame synchronization signal of the human-computer interaction interface information in a first counting method in response to the start signal, and control the write controller to write the human-computer interaction interface information into the memory according to the first count value; and a second counter, configured to count the frame synchronization signal of the first timing control signal in a second counting method in response to the start signal, and start the second timing generator and the superimposer according to the second count value and the first count value received from the first counter.

[0006] In some embodiments, the command detection module is further configured to receive the shutdown command and output a shutdown signal; the first counter is further configured to count the frame synchronization signal of the human-computer interaction interface information in accordance with a third counting method in response to the shutdown signal, and control the write controller to stop writing the human-computer interaction interface information to the memory according to the third count value; and the second counter is further configured to count the frame synchronization signal of the first timing control signal in accordance with a fourth counting method in response to the shutdown signal, and shut down the second timing generator and the superimposer according to the fourth count value.

[0007] In some embodiments, the superimposer is further configured to delay the video image data by a predetermined time during the process of superimposing the video image data and the human-computer interaction interface information so that the time of the video image data is aligned with the time of the human-computer interaction interface information, and superimpose the delayed video image data on the human-computer interaction interface information.

[0008] In some embodiments, the write controller includes: a first write controller configured to write video image data into a memory; and a second write controller configured to write human-computer interaction interface information into the memory.

[0009] In some embodiments, the first counter is configured to turn on the second write controller when the first count value is a first preset value, and to turn off the second write controller when the third count value is a second preset value; the second counter is configured to turn on the second timing generator and the superimposer when the first count value is greater than the first preset value and the second count value changes, and to turn off the second timing generator and the superimposer when the fourth count value is a third preset value.

[0010] In some embodiments, the first counting method is the same as the second counting method, the third counting method is the same as the fourth counting method, and the first counting method is opposite to the third counting method.

[0011] In some embodiments, the data processing device also includes: a first receiving module, configured to receive the video image data and transmit the video image data to the first write controller; a second receiving module, configured to receive the human-computer interaction interface information, and transmit the human-computer interaction interface information to the second write controller, and transmit the frame synchronization signal of the human-computer interaction interface information to the first counter; a third receiving module, configured to receive the open command or the close command, and transmit the open command or the close command to the command detection module.

[0012] In some embodiments, the data processing device further includes: a sending module configured to send the target image information to a display panel.

[0013] According to another aspect of an embodiment of the present disclosure, a display device is provided, including: the data processing device as described above.

[0014] According to another aspect of an embodiment of the present disclosure, a control method for a data processing device is provided, comprising: using a command controller to control a write controller to write human-computer interaction interface information into a memory and start a superimposer after receiving a start command; using a first read controller to read the video image data from the memory; using a second read controller to read the human-computer interaction interface information from the memory; using a superimposer to superimpose the video image data received from the first read controller and the human-computer interaction interface information received from the second read controller to obtain target image information; and using the command controller to control the write controller to stop writing the human-computer interaction interface information into the memory and to close the superimposer after receiving a close command.

[0015] In some embodiments, the control method further includes: before using the first read controller to read the video image data from the memory, using a first timing generator to generate a first timing control signal for controlling the read operation of the first read controller; and before using the second read controller to read the human-computer interaction interface information from the memory, using a second timing generator to generate a second timing control signal for controlling the read operation of the second read controller.

[0016] In some embodiments, the steps of using the command controller to control the write controller to write the human-computer interaction interface information into the memory and start the superimposer after receiving the start command include: using the command detection module to receive the start command and output a start signal; using a first counter to count the frame synchronization signal of the human-computer interaction interface information in a first counting method in response to the start signal, and controlling the write controller to write the human-computer interaction interface information into the memory according to the first count value; and using a second counter to count the frame synchronization signal of the first timing control signal in a second counting method in response to the start signal, and starting the second timing generator and the superimposer according to the second count value and the first count value received from the first counter.

[0017] In some embodiments, the steps of using the command controller to control the write controller to stop writing the human-computer interaction interface information to the memory and closing the superimposer after receiving a shutdown command include: using the command detection module to receive the shutdown command and output a shutdown signal; using the first counter to count the frame synchronization signal of the human-computer interaction interface information according to a third counting method in response to the shutdown signal, and controlling the write controller to stop writing the human-computer interaction interface information to the memory according to the third count value; and using the second counter to count the frame synchronization signal of the first timing control signal according to a fourth counting method in response to the shutdown signal, and closing the second timing generator and the superimposer according to the fourth count value.

[0018] In some embodiments, the step of using the superimposer to overlay the video image data and the human-computer interaction interface information includes: using the superimposer to delay the video image data for a predetermined time during the overlay processing of the video image data and the human-computer interaction interface information so that the time of the video image data is aligned with the time of the human-computer interaction interface information, and superimposing the delayed video image data and the human-computer interaction interface information.

[0019] In some embodiments, the step of controlling the write controller to write the human-computer interaction interface information into a memory includes: using a first write controller to write video image data into a memory; and using a second write controller to write the human-computer interaction interface information into the memory.

[0020] In some embodiments, the first counter is used to turn on the second write controller when the first count value is a first preset value, and to turn off the second write controller when the third count value is a second preset value; the second counter is used to turn on the second timing generator and the superimposer when the first count value is greater than the first preset value and the second count value changes, and to turn off the second timing generator and the superimposer when the fourth count value is a third preset value.

[0021] According to another aspect of an embodiment of the present disclosure, a data processing device is provided, including: a memory; and a processor coupled to the memory, wherein the processor is configured to execute the aforementioned method based on instructions stored in the memory.

[0022] According to another aspect of the embodiments of the present disclosure, a non-transitory computer-readable storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method as described above is implemented.

[0023] Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0025] The present disclosure can be more clearly understood from the following detailed description with reference to the accompanying drawings, in which:

[0026] Figure 1 is a schematic structural diagram showing a data processing device according to an embodiment of the present disclosure;

[0027] Figure 2 is a schematic structural diagram showing a display device according to an embodiment of the present disclosure;

[0028] Figure 3 is a timing control diagram showing relevant signals according to some embodiments of the present disclosure;

[0029] Figure 4 is a timing control diagram showing relevant signals according to other embodiments of the present disclosure;

[0030] Figure 5 is a flowchart illustrating a control method for a data processing device according to one embodiment of the present disclosure;

[0031] Figure 6 is a schematic structural diagram illustrating a data processing device according to another embodiment of the present disclosure;

[0032] Figure 7 FIG. 4 is a schematic structural diagram showing a data processing device according to another embodiment of the present disclosure.

[0033] It should be understood that the dimensions of the various parts shown in the accompanying drawings are not necessarily drawn according to actual proportional relationships. In addition, identical or similar reference numerals represent identical or similar components. DETAILED DESCRIPTION

[0034] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. The description of the exemplary embodiments is merely illustrative and is in no way intended to limit the present disclosure, its application, or use. The present disclosure can be implemented in many different forms and is not limited to the embodiments described herein. These embodiments are provided to make the present disclosure thorough and complete and to fully convey the scope of the present disclosure to those skilled in the art. It should be noted that unless otherwise specifically stated, the relative arrangement of parts and steps, the composition of materials, numerical expressions, and numerical values ​​set forth in these embodiments should be interpreted as being merely exemplary and not as limiting.

[0035] The terms "first", "second" and similar terms used in this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different parts. The terms "include" or "comprises" and similar terms mean that the elements before the term include the elements listed after the term, and do not exclude the possibility of also including other elements. The terms "upper", "lower", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0036] In the present disclosure, when a specific device is described as being located between a first device and a second device, an intervening device may or may not be present between the specific device and the first device or the second device. When a specific device is described as being connected to another device, the specific device may be directly connected to the other device without an intervening device, or may be not directly connected to the other device but with an intervening device.

[0037] All terms (including technical or scientific terms) used in this disclosure have the same meaning as those understood by one of ordinary skill in the art to which this disclosure belongs, unless otherwise specifically defined. It should also be understood that terms defined in, for example, general dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an idealized or highly formal sense, unless explicitly defined herein.

[0038] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered part of the specification.

[0039] Figure 1 1 is a schematic diagram showing the structure of a data processing device according to an embodiment of the present disclosure. For example, the data processing device is an FPGA device.

[0040] like Figure 1 As shown, the data processing device 10 includes a write controller 180, a first read controller 111, a second read controller 112, a superimposer 130 and a command controller 140. In addition, Figure 1 Also shown is a memory 20. Figure 1 As shown, the write controller 180 is electrically connected to the command controller 140 and the memory 20. The first read controller 111, the second read controller 112 and the command controller 140 are electrically connected to the stacker 130, respectively.

[0041] The write controller 180 is configured to write the video image data and the human-computer interaction interface information into the memory 20 .

[0042] The first read controller 111 is configured to read video image data from the memory 20. For example, the first read controller 111 is a DDR (Double Data Rate) read control module.

[0043] The second read controller 112 is configured to read the human-computer interaction interface information from the memory 20. For example, the second read controller 112 is a read DDR control module.

[0044] The superimposer 130 is configured to superimpose the video image data received from the first read controller 111 and the human-machine interface information received from the second read controller 112 to obtain target image information. That is, the superimposer 130 can superimpose the video image with the human-machine interface.

[0045] The command controller 140 is configured to, upon receiving an on command, control the write controller 180 to write the human-computer interaction interface information into the memory 20 and start the overlay 130, and upon receiving a off command, control the write controller 180 to stop writing the human-computer interaction interface information into the memory 20 and to stop the overlay 130. Here, when the command controller receives an on command, it indicates that a display operation has begun, thereby entering a display period; and when it receives a off command, it indicates that display is no longer being performed, and the non-display period has begun.

[0046] So far, a data processing device according to some embodiments of the present disclosure is provided. The data processing device includes a write controller, a first read controller, a second read controller, an overlay, and a command controller. In the data processing device, the command controller is used to control the write controller to write human-computer interaction interface information into the memory and start the overlay during the display period, and the command controller is used to control the write controller to stop writing the human-computer interaction interface information into the memory and turn off the overlay during the non-display period. In this way, the human-computer interaction interface information and the video image can be superimposed on each other during the display period of the display device, and the memory occupied by the human-computer interaction interface information can be released during the non-display period of the display device, thereby reducing the power consumption of the data processing device (such as an FPGA device) during the non-display period without affecting the display of the human-computer interaction interface information.

[0047] Figure 2 FIG1 is a schematic structural diagram showing a display device according to an embodiment of the present disclosure.

[0048] like Figure 2 As shown, the display device includes a data processing device 10 ′. Similar to the aforementioned data processing device 10 , the data processing device 10 ′ includes a write controller 180 , a first read controller 111 , a second read controller 112 , an overlay 130 , and a command controller 140 .

[0049] In some embodiments, the write controller 180 includes a first write controller 101 and a second write controller 102. The first write controller 101 and the second write controller 102 are electrically connected to the memory 20, respectively.

[0050] The first write controller 101 is configured to write the video image data into the memory 20. Here, the first write controller can write the video image data into the memory 20 in real time. For example, the first write controller 101 is a write DDR control module.

[0051] The second write controller 102 is configured to write the human-computer interaction interface information into the memory 20. For example, the second write controller 102 is a write DDR control module.

[0052] In some embodiments, the data processing device 10' further includes a first timing generator 121 and a second timing generator 122. The first timing generator 121 is electrically connected to the first read controller 111 and the command controller 140, respectively. The second timing generator 122 is electrically connected to the second read controller 112 and the command controller 140, respectively.

[0053] The first timing generator 121 is configured to generate a first timing control signal for controlling a read operation of the first read controller 111. The first timing generator 121 is an output-side timing generation module.

[0054] The second timing generator 122 is configured to generate a second timing control signal for controlling the read operation of the second read controller 112. The second timing generator 122 is an output-side timing generation module.

[0055] In some embodiments, the command controller 140 is configured to turn on the second write controller 102, the second timing generator 122, and the superimposer 130 upon receiving a turn-on command, and to turn off the second write controller 102, the second timing generator 121, and the superimposer 130 upon receiving a turn-off command. As previously described, when the command controller receives a turn-on command, it indicates that a display operation has begun, thereby entering a display period. When the command controller receives a turn-off command, it indicates that display is no longer being performed, thereby entering a non-display period.

[0056] Here, by turning on the second write controller 102, the second write controller 102 can write the human-computer interaction interface information into the memory 20; by turning on the second timing generator 122, the second timing generator 122 can generate a second timing control signal, which is sent to the second read controller 112, thereby causing the second read controller 112 to start performing a read operation; and by turning on the superimposer 130, the superimposer 130 can perform a superimposition operation. In this way, the human-computer interaction interface information and the video image can be superimposed during the display period of the display device.

[0057] Furthermore, by shutting down the second write controller 102, the second write controller 102 can stop writing the human-computer interaction interface information into the memory 20, thereby releasing the memory occupation by the second write controller; by shutting down the second timing generator 121, the second timing generator 122 can stop sending the second timing control signal to the second read controller 112, thereby causing the second read controller 112 to stop reading; and by shutting down the overlay 130, the overlay 130 can stop the overlay operation. In this way, the human-computer interaction interface information can be released from the memory during the non-display period of the display device, thereby reducing the power consumption of the data processing device (e.g., FPGA device) during the non-display period.

[0058] Therefore, the above-mentioned embodiment can realize the superimposed display of human-computer interaction interface information and video images during the display period of the display device, and release the memory occupied by the human-computer interaction interface information during the non-display period of the display device, thereby reducing the power consumption of the data processing device (such as FPGA device) during the non-display period without affecting the display of the human-computer interaction interface information.

[0059] In some embodiments, during the process of the first reading controller 111 reading the video image data and the second reading controller 112 reading the human-computer interaction interface information, the reading time of the human-computer interaction interface information may be delayed compared to the reading time of the video image data, so that when the two image data are superimposed, the two image data may not be aligned. In view of this, the superimposer 130 can also be configured to delay the video image data by a predetermined time during the superimposition processing of the video image data and the human-computer interaction interface information so that the time of the video image data is aligned with the time of the human-computer interaction interface information, and superimpose the delayed video image data and the human-computer interaction interface information. This can solve the problem that the time of the video image data and the time of the human-computer interaction interface information cannot be aligned, which affects the superposition effect. It should be noted that the predetermined time described here can be set according to actual needs or actual conditions.

[0060] In some embodiments, the command controller 140 includes a command detection module 143, a first counter 141, and a second counter 142. The command detection module 143 is electrically connected to the first counter 141 and the second counter 142, respectively. The first counter 141 is electrically connected to the second write controller 102 and the second counter 142, respectively. The second counter 142 is electrically connected to the first timing generator 121, the second timing generator 122, and the superimposer 130, respectively.

[0061] The command detection module 143 is configured to receive a start command and output a start signal.

[0062] The first counter 141 is configured to count the frame synchronization signal of the human-computer interaction interface information according to a first counting method in response to the start signal, and control the write controller 180 to write the human-computer interaction interface information into the memory 20 based on the first count value. For example, the first counter 141 can activate the second write controller 102 based on the first count value, thereby causing the second write controller 102 to write the human-computer interaction interface information into the memory 20. For example, the first counter can be a frame synchronization signal counter. Here, the human-computer interaction interface information includes a frame synchronization signal, and the presence of the frame synchronization signal indicates the presence of a frame of the human-computer interaction interface image.

[0063] The second counter 142 is configured to count the frame synchronization signal of the first timing control signal according to a second counting method in response to the start signal, and to enable the second timing generator 122 and the superimposer 130 based on the second count value and the first count value received from the first counter 141. For example, the second counter can be a frame synchronization signal counter. Similarly, the first timing control signal also includes a frame synchronization signal. When the frame synchronization signal appears, it indicates the presence of a frame of video image.

[0064] In some embodiments, the first counting method is the same as the second counting method. For example, the first counting method and the second counting method are both methods of gradually increasing the count.

[0065] Through the above embodiment, the command controller configures the write controller to write the human-computer interaction interface information into the memory and activate the second timing generator and the superimposer after receiving the start command. Here, activating the second timing generator can cause the second read controller to perform a read operation on the human-computer interaction interface information.

[0066] The command detection module 143 is further configured to receive a shutdown command and output a shutdown signal.

[0067] The first counter 141 is further configured to count the frame synchronization signal of the human-computer interaction interface information according to a third counting method in response to the shutdown signal, and control the write controller 180 to stop writing the human-computer interaction interface information to the memory 20 based on the third count value. For example, the first counter 141 can shut down the second write controller 102 based on the third count value, thereby causing the second write controller 102 to stop writing the human-computer interaction interface information to the memory 20.

[0068] The second counter 142 is further configured to count the frame synchronization signal of the first timing control signal in a fourth counting manner in response to the shutdown signal, and shut down the second timing generator and the superimposer according to the fourth count value.

[0069] In some embodiments, the third counting mode is the same as the fourth counting mode, and the first counting mode is opposite to the third counting mode. For example, the third counting mode and the fourth counting mode are both a gradually decreasing counting mode.

[0070] Through the above embodiment, the command controller configures the write controller to stop writing human-computer interaction interface information to the memory and shut down the second timing generator and the superimposer after receiving the start command. Here, shutting down the second timing generator can prevent the second read controller from performing the read operation on the human-computer interaction interface information.

[0071] In some embodiments, the first counter 141 is configured to enable the second write controller when the first count value reaches a first preset value, and to disable the second write controller when the third count value reaches a second preset value. For example, the first preset value is less than the second preset value. For example, the first preset value is 1, and the second preset value is 14. Of course, those skilled in the art will appreciate that the first preset value and the second preset value are merely exemplary, and the first preset value and the second preset value may also be set to other values, as needed. Therefore, the scope of the present disclosure is not limited thereto.

[0072] In some embodiments, the second counter 142 is configured to turn on the second timing generator and the adder when the first count value is greater than the first preset value and the second count value changes, and to turn off the second timing generator and the adder when the fourth count value is the third preset value. In some embodiments, the second preset value is equal to the third preset value. For example, the second preset value and the third preset value are both 14. Of course, those skilled in the art will understand that here, the second preset value and the third preset value are merely exemplary, and the second preset value and the third preset value can also be set to other values, which can be determined according to actual needs. Therefore, the scope of the present disclosure is not limited to this. In this embodiment, by turning on the second timing generator, the second read controller can be turned on, so that the second read controller can perform a read operation. Similarly, by turning off the second timing generator, the second read controller can be stopped from performing a read operation.

[0073] In the above embodiment, the control of the command detection module, the first counter and the second counter can realize multiple dynamic synchronizations of the human-computer interaction interface information and the video image data, thereby reducing power consumption of the display device without affecting the display effect.

[0074] In some embodiments, as Figure 2 As shown, the data processing device 10' may further include a first receiving module 151. The first receiving module 151 is electrically connected to the first write controller 101. The first receiving module 151 is configured to receive video image data and transmit the video image data to the first write controller 101. For example, the first receiving module 151 is an SDI (Serial Digital Interface) receiving module. The SDI receiving module is used to receive professional SDI signals in the broadcasting and television field, and the SDI signals include video image data.

[0075] In some embodiments, as Figure 2 As shown, the data processing device 10' may further include a second receiving module 152. The second receiving module 152 is electrically connected to the second write controller 102 and the first counter 140. The second receiving module 152 is configured to receive human-computer interaction interface information, transmit the human-computer interaction interface information to the second write controller 102, and transmit the frame synchronization signal of the human-computer interaction interface information to the first counter 140. For example, the second receiving module 152 is an LVDS (Low-Voltage Differential Signaling) receiving module. The LVDS receiving module is used to receive an LVDS video signal, which includes the human-computer interaction interface information.

[0076] In some embodiments, as Figure 2As shown, the data processing device 10' may further include a third receiving module 153. The third receiving module 153 is electrically connected to the command detection module 143. The third receiving module 153 is configured to receive an on command or a off command and transmit the on command or the off command to the command detection module 143. For example, the third receiving module 153 may be an IIC (Inter-Integrated Circuit) module.

[0077] In some embodiments, as Figure 2 As shown, the data processing device 10' may further include a transmitting module 160. The transmitting module 160 is electrically connected to the superimposer 130 and the display panel 40. The transmitting module 160 is configured to transmit the target image information received from the superimposer 130 to the display panel 40. In this way, the display panel 40 can display the superimposed target image information. For example, the transmitting module is a V-by-One (VBO) transmitting module.

[0078] In some embodiments, as Figure 2 As shown, the data processing device 10' may further include a bus module 170. The bus module 170 is electrically connected to the memory 20, the first write controller 101, the second write controller 102, the first read controller 111, and the second read controller 112. That is, the first write controller 101, the second write controller 102, the first read controller 111, and the second read controller 112 are electrically connected to the memory 20 via the bus module 170. For example, the bus module 170 may be an AXI (Advanced eXtensible Interface) bus arbitration module.

[0079] Thus, data processing devices according to other embodiments of the present disclosure are provided. This data processing device (e.g., an FPGA device) can enable a display device to superimpose human-computer interaction interface information and video images during display periods, release the memory occupied by the human-computer interaction interface information during non-display periods, and achieve multiple dynamic synchronizations of the human-computer interaction interface information and video image data, thereby reducing the power consumption of the data processing device during non-display periods without affecting the display of the human-computer interaction interface information.

[0080] In some embodiments, as Figure 2 As shown, the display device further includes a control unit 30. The control unit 30 is electrically connected to the second receiving module 152 and the third receiving module 153. The control unit 30 is configured to output human-computer interaction interface information, start commands, and shutdown commands to the data processing device 10'. For example, the control unit is a SOC chip.

[0081] In some embodiments, as Figure 2 As shown, the display device further includes a memory 20. The memory 20 is electrically connected to the bus module 170. The memory 20 is configured to store human-computer interaction interface information and video image data. In some embodiments, the memory is an internal memory. For example, the internal memory is a third-generation double data rate synchronous dynamic random access memory (Double Data Rate 3, referred to as DDR3).

[0082] In some embodiments, as Figure 2 As shown, the display device further includes a display panel 40. The display panel 40 is configured to display target image information.

[0083] In some embodiments, the display device is a display device for a monitor.

[0084] Figure 3 is a timing control diagram illustrating relevant signals according to some embodiments of the present disclosure. Figure 4 1 is a timing control diagram showing related signals according to other embodiments of the present disclosure. Figures 2 to 4 The working process of the data processing device according to some embodiments of the present disclosure is described in detail.

[0085] First, the video image data is received, written into the memory, and read out from the memory. Figure 2 As shown, the serial video image data is converted into parallel video image data with a standard timing by the first receiving module 151, and the video image data is written into the memory 20 by the first write controller 101 using the accompanying clock signal. The first timing control signal generated by the first timing generator 121 (the first timing control signal is a local clock signal) is transmitted to the first read controller 111, so that the first read controller 111 reads the video image data from the memory 20.

[0086] For example, the above method can use standard 4K timing, with the following parameters: HTT: 4400; VTT: 2250; HAC: 3840; VAC: 2160; HFP: 176; VFP: 8; HSW: 88; VSW: 10; HBP: 296; VBP: 72.

[0087] Here, HTT represents the total number of pixel clocks per row in the horizontal direction; HAC is the number of effective pixel clocks per row in the horizontal direction, that is, the number of clocks during the high level period of the effective data selection signal DE; HFP is the number of leading edge clocks in the horizontal direction, that is, the number of clocks between the falling edge of the DE signal and the rising edge of the line synchronization signal HSYNC (indicating the start of scanning a row); HSW is the number of clocks during the high level period of the HSYNC signal in the horizontal direction; HBP is the number of trailing edge clocks in the horizontal direction, that is, the number of clocks between the falling edge of the HSYNC signal and the rising edge of the DE signal. The number of clocks between rising edges; VTT is the total number of lines in each frame image in the vertical direction; VAC is the number of valid lines in each frame image in the vertical direction; VFP is the number of leading lines in the vertical direction, that is, the number of lines between the falling edge of the last DE signal of each frame image to the rising edge of the frame synchronization signal VSYNC (indicating the start of scanning a frame image); VSW is the number of lines during the high level period of the VSYNC signal in the vertical direction; VBP is the number of trailing lines in the vertical direction, that is, the number of lines between the falling edge of the VSYNC signal to the rising edge of the first DE signal of each frame image.

[0088] Next, the human-computer interface commands are parsed and related timing signals are generated. Typically, the human-computer interface does not need to be displayed most of the time. This step allows the human-computer interface to access memory 20 on demand. That is, when the human-computer interface is not needed for display, the memory is released. When it is needed for display, the memory is restored and dynamically synchronized with the video image data. This reduces the memory usage of the human-computer interface, thereby reducing the power consumption of the data processing device.

[0089] The control unit 30 sends a command (i.e., an on or off command) to determine whether the human-computer interaction interface is displayed via the third receiving module 153. The third receiving module 153 starts operating when the user operates the interface, the human-computer interaction interface starts operating when the control unit 30 is powered on and initialized, and the first timing generator starts operating when the data processing device is initialized. These three times do not have a fixed time relationship. Therefore, upon receiving the on command (i.e., the ON command), the first counter 141 begins counting up (i.e., counting from small to large, e.g., starting from 0) the frame synchronization signal of the human-computer interaction interface information, and stops counting when it reaches 15. Upon receiving the off command (i.e., the OFF command), the first counter 141 begins counting down (i.e., counting from large to small, e.g., starting from 15) the frame synchronization signal of the human-computer interaction interface information, and stops counting when it reaches 0. Upon receiving the on command, the second counter 142 begins counting up (i.e., counting from small to large, e.g., starting from 0) the frame synchronization signal of the first timing control signal of the first timing generator 121, and stops counting when it reaches 15. After receiving the shutdown command, the second counter 142 starts to count down the frame synchronization signal of the first timing control signal (i.e., count from large to small, for example, start counting from 15), and stops counting when the count reaches 0. Figure 3 shown.

[0090] The above steps distinguish the following two situations:

[0091] (1) The human-computer interaction interface is usually displayed by a user issuing a command. The human-computer interaction command changes from a non-display command to a display command, that is, from a close command to an open command. When the command detection module 143 detects the open command, the first counter 141 starts counting the frame synchronization signal of the human-computer interaction interface information, and the second counter 142 starts counting the frame synchronization signal of the first timing control signal of the first timing generator 121. Based on the counting results of the first counter 141 and the second counter 142, the second write controller 102, the second timing generator 122, and the superimposer 130 are started in sequence.

[0092] For example, when the first count value of the first counter is 1, the second write controller 102 is activated, and the second write controller 102 begins to write the data of the human-computer interaction interface information into the memory 20. When the first count value is greater than 1 (i.e., after a complete frame of the human-computer interaction interface image is written into the memory) and the second count value of the second counter changes (indicating that the first read controller 111 has read a frame of video image data from the memory 20), the second timing generator 122 and the superimposer 130 are synchronously activated. By activating the second timing generator 122, the second read controller 112 is activated, thereby causing the second read controller 112 to read the human-computer interaction interface image from the memory 20. In this way, the activated superimposer 130 can superimpose the frame of video image read by the first read controller 111 and the frame of human-computer interaction interface image read by the second read controller 112.

[0093] For example, the resolution of the video image displayed by reading the video image data using the first timing control signal is 3840 × 2160, and the resolution of the human-computer interaction interface image displayed by reading the human-computer interaction interface information using the second timing control signal is 1920 × 1080. For example, when displayed, the human-computer interaction interface image can be located in the middle of the video image and close to the edge.

[0094] (2) The human-computer interaction command changes from a display command to a non-display command, that is, from an on command to a off command. When the command detection module 143 detects the off command, the first counter 141 begins to count the frame synchronization signal of the human-computer interaction interface information, and the second counter 142 begins to count the frame synchronization signal of the first timing control signal of the first timing generator. Based on the counting results of the first counter 141 and the second counter 142, the superimposer 130, the second timing generator 122, and the second write controller 102 are turned off in sequence.

[0095] For example, Figure 4 As shown, when the third count value of the first counter reaches the second preset value (e.g., the second preset value = 14), the second write controller 102 is turned off, causing the second write controller 102 to stop writing human-computer interaction interface image data into the memory 20. When the fourth count value of the second counter reaches the third preset value (e.g., the third preset value = 14), the second timing generator 122 and the superimposer 130 are turned off. Since the second timing generator 122 is turned off, the second timing generator 122 no longer sends the second timing control signal to the second read controller 112, causing the second read controller 112 to no longer read human-computer interaction interface information from the memory 20. In addition, the superimposer 130 no longer performs the superimposition process after being turned off.

[0096] Next, the sending module 160 sends the superimposed target image information to the display panel 40 for display.

[0097] Thus, the operating process of a data processing device according to some embodiments of the present disclosure is provided. Through this operating process, the data processing device can enable a display device to superimpose human-computer interaction interface information and video images during display periods, release the memory occupied by the human-computer interaction interface information during non-display periods, and achieve multiple dynamic synchronizations of the human-computer interaction interface information and video image data, thereby reducing the power consumption of the data processing device during non-display periods without affecting the display of the human-computer interaction interface information.

[0098] Figure 5 FIG. 1 is a flow chart illustrating a control method for a data processing device according to an embodiment of the present disclosure. Figure 5 As shown, the control method includes steps 502 to S510.

[0099] In step S502, after receiving the start command, the command controller controls the write controller to write the human-computer interaction interface information into the memory and start the superimposer.

[0100] In step S504 , the video image data is read from the memory using a first read controller.

[0101] In step S506, the human-computer interaction interface information is read from the memory using a second reading controller.

[0102] In step S508 , a superimposer is used to superimpose the video image data received from the first read controller and the human-computer interaction interface information received from the second read controller to obtain target image information.

[0103] In some embodiments, step S508 includes: using an overlay device to delay the video image data for a predetermined time during the overlay processing of the video image data and the human-computer interaction interface information so that the time of the video image data is aligned with the time of the human-computer interaction interface information, and overlaying the delayed video image data and the human-computer interaction interface information.

[0104] In step S510, after receiving the close command, the command controller controls the write controller to stop writing the human-computer interaction interface information into the memory and close the overlay.

[0105] Thus, a control method for a data processing device according to some embodiments of the present disclosure is provided. This control method can enable a display device to superimpose human-computer interaction interface information and video images during display periods, and relieve the memory occupied by the human-computer interaction interface information during non-display periods, thereby reducing the power consumption of the data processing device (e.g., an FPGA device) during non-display periods without affecting the display of the human-computer interaction interface information.

[0106] In some embodiments, the control method may further include: using a sending module to send the target image information to the display panel.

[0107] In some embodiments, the control method further includes: before using the first read controller to read video image data from the memory, using the first timing generator to generate a first timing control signal for controlling the read operation of the first read controller; and before using the second read controller to read human-computer interaction interface information from the memory, using the second timing generator to generate a second timing control signal for controlling the read operation of the second read controller.

[0108] In some embodiments, step S502 includes: using a command detection module to receive a start command and output a start signal; using a first counter to count the frame synchronization signal of the human-computer interaction interface information in accordance with a first counting method in response to the start signal, and controlling the write controller to write the human-computer interaction interface information into the memory according to the first count value; and using a second counter to count the frame synchronization signal of the first timing control signal in accordance with a second counting method in response to the start signal, and starting the second timing generator and the superimposer according to the second count value and the first count value received from the first counter.

[0109] In some embodiments, step S510 includes: using a command detection module to receive a shutdown command and output a shutdown signal; using a first counter to count the frame synchronization signal of the human-computer interaction interface information in accordance with a third counting method in response to the shutdown signal, and controlling the write controller to stop writing the human-computer interaction interface information to the memory according to the third count value; and using a second counter to count the frame synchronization signal of the first timing control signal in accordance with a fourth counting method in response to the shutdown signal, and shutting down the second timing generator and the superimposer according to the fourth count value.

[0110] In some embodiments, the step of controlling the write controller to write the human-computer interaction interface information into the memory includes: using a first write controller to write the video image data into the memory; and using a second write controller to write the human-computer interaction interface information into the memory.

[0111] In some embodiments, a first counter is used to turn on a second write controller when a first count value is a first preset value, and to turn off the second write controller when a third count value is a second preset value; a second counter is used to turn on a second timing generator and an adder when the first count value is greater than the first preset value and the second count value changes, and to turn off the second timing generator and the adder when a fourth count value is a third preset value.

[0112] Figure 6 6 is a schematic diagram showing the structure of a data processing device according to another embodiment of the present disclosure. The data processing device includes a memory 610 and a processor 620.

[0113] The memory 610 can be a disk, a flash memory or any other non-volatile storage medium. Figure 5 The instructions in the corresponding embodiment.

[0114] The processor 620 is coupled to the memory 610 and can be implemented as one or more integrated circuits, such as a microprocessor or microcontroller. The processor 620 is configured to execute instructions stored in the memory, enabling the display device to overlay the human-computer interaction interface information with the video image during display time, and to release the human-computer interaction interface information from the memory during non-display time, thereby reducing the power consumption of the data processing device during non-display time without affecting the display of the human-computer interaction interface information.

[0115] In some embodiments, it is also possible to Figure 7 As shown, data processing device 700 includes memory 710 and processor 720. Processor 720 is coupled to memory 710 via BUS 730. Data processing device 700 can also be connected to an external storage device 750 via a storage interface 740 to access external data, and can also be connected to a network or another computer system (not shown) via a network interface 760, which will not be described in detail here.

[0116] In this embodiment, by storing data instructions in a memory and then processing the above instructions through a processor, the display device can realize the superimposed display of human-computer interaction interface information and video images during the display period, and release the human-computer interaction interface information from occupying the memory during the non-display period, thereby reducing the power consumption of the data processing device during the non-display period without affecting the display of the human-computer interaction interface information.

[0117] In other embodiments, the present disclosure further provides a computer-readable storage medium having computer program instructions stored thereon, which are executed by a processor to implement Figure 5 The steps of the method in the corresponding embodiment. Those skilled in the art will understand that the embodiments of the present disclosure can be provided as methods, devices, or computer program products. Therefore, the present disclosure can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present disclosure can take the form of a computer program product implemented on one or more computer-usable non-transitory storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0118] The present disclosure is described with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present disclosure. It should be understood that each process and / or block in the flowchart and / or block diagram and the combination of processes and / or blocks in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0119] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0120] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0121] Thus far, various embodiments of the present disclosure have been described in detail. To avoid obscuring the concept of the present disclosure, some details known in the art have not been described. Based on the above description, those skilled in the art can fully understand how to implement the technical solutions disclosed herein.

[0122] Although some specific embodiments of the present disclosure have been described in detail through examples, those skilled in the art will understand that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. Those skilled in the art will understand that the above embodiments may be modified or some technical features may be replaced with equivalents without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A data processing device, comprising: a write controller configured to write video image data and human-computer interaction interface information into a memory; a first read controller configured to read the video image data from the memory; a second reading controller, configured to read the human-computer interaction interface information from the memory; a superimposer configured to superimpose the video image data received from the first read controller and the human-computer interaction interface information received from the second read controller to obtain target image information; a command controller configured to control the write controller to write the human-computer interaction interface information into the memory and start the overlay after receiving an open command, and to control the write controller to stop writing the human-computer interaction interface information into the memory and close the overlay after receiving a close command; a first timing generator configured to generate a first timing control signal for controlling a read operation of the first read controller; and a second timing generator configured to generate a second timing control signal for controlling a read operation of the second read controller; Wherein, the command controller includes: a command detection module, configured to receive the start command and output a start signal; a first counter configured to count the frame synchronization signal of the human-computer interaction interface information in a first counting manner in response to the start signal, and control the write controller to write the human-computer interaction interface information into the memory according to the first count value; and The second counter is configured to count the frame synchronization signal of the first timing control signal in a second counting manner in response to the start signal, and to start the second timing generator and the superimposer according to a second count value and the first count value received from the first counter.

2. The data processing apparatus according to claim 1, wherein: The command detection module is further configured to receive the shutdown command and output a shutdown signal; The first counter is further configured to count the frame synchronization signal of the human-computer interaction interface information according to a third counting method in response to the shutdown signal, and control the write controller to stop writing the human-computer interaction interface information into the memory according to the third count value; and The second counter is further configured to count the frame synchronization signal of the first timing control signal in a fourth counting manner in response to the shutdown signal, and shut down the second timing generator and the superimposer according to a fourth count value.

3. The data processing apparatus according to claim 1, wherein: The superimposer is also configured to delay the video image data for a predetermined time during the process of superimposing the video image data and the human-computer interaction interface information so that the time of the video image data is aligned with the time of the human-computer interaction interface information, and superimpose the delayed video image data and the human-computer interaction interface information.

4. The data processing apparatus according to claim 2, wherein: The write controller includes: a first write controller configured to write video image data into the memory; and The second write controller is configured to write the human-computer interaction interface information into the memory.

5. The data processing apparatus according to claim 4, wherein: The first counter is configured to turn on the second write controller when the first count value is a first preset value, and to turn off the second write controller when the third count value is a second preset value; as well as The second counter is configured to turn on the second timing generator and the adder when the first count value is greater than the first preset value and the second count value changes, and to turn off the second timing generator and the adder when the fourth count value is a third preset value. The data processing apparatus according to claim 2 , wherein: The first counting mode is the same as the second counting mode, the third counting mode is the same as the fourth counting mode, and the first counting mode is opposite to the third counting mode.

7. The data processing apparatus according to claim 4 , further comprising: a first receiving module, configured to receive the video image data and transmit the video image data to the first write controller; a second receiving module configured to receive the human-computer interaction interface information, transmit the human-computer interaction interface information to the second write controller, and transmit a frame synchronization signal of the human-computer interaction interface information to the first counter; as well as The third receiving module is configured to receive the opening command or the closing command and transmit the opening command or the closing command to the command detecting module.

8. The data processing apparatus according to claim 1, further comprising: The sending module is configured to send the target image information to the display panel.

9. A display device comprising: A data processing device according to any one of claims 1 to 8.

10. A control method for a data processing device, comprising: After receiving the start command, the command controller controls the write controller to write the human-computer interaction interface information into the memory and start the superimposer; reading the video image data from the memory using a first read controller; Reading the human-computer interaction interface information from the memory using a second reading controller; Using a superimposer, the video image data received from the first read controller and the human-computer interaction interface information received from the second read controller are superimposed to obtain target image information; and After receiving a close command, the command controller controls the write controller to stop writing the human-computer interaction interface information into the memory and close the superimposer; The control method further includes: Before reading the video image data from the memory using the first read controller, generating a first timing control signal for controlling a read operation of the first read controller using a first timing generator; and Before using the second read controller to read the human-computer interaction interface information from the memory, using a second timing generator to generate a second timing control signal for controlling a read operation of the second read controller; The steps of using the command controller to control the write controller to write the human-computer interaction interface information into the memory and start the superimposer after receiving the start command include: Utilizing a command detection module to receive the start command and output a start signal; Counting the frame synchronization signal of the human-computer interaction interface information in a first counting manner in response to the start signal using a first counter, and controlling the write controller to write the human-computer interaction interface information into the memory according to the first count value; and The frame synchronization signal of the first timing control signal is counted by a second counter in response to the start signal in a second counting manner, and the second timing generator and the superimposer are turned on according to a second count value and the first count value received from the first counter.

11. The control method according to claim 10, wherein: The step of using the command controller to control the write controller to stop writing the human-computer interaction interface information into the memory and closing the superimposer after receiving the close command includes: Utilizing the command detection module to receive the shutdown command and output a shutdown signal; Counting the frame synchronization signal of the human-computer interaction interface information in a third counting manner using the first counter in response to the shutdown signal, and controlling the write controller to stop writing the human-computer interaction interface information into the memory according to the third count value; and The frame synchronization signal of the first timing control signal is counted by the second counter in response to the shutdown signal according to a fourth counting method, and the second timing generator and the superimposer are turned off according to a fourth count value.

12. The control method according to claim 10, wherein: The step of using the superimposer to superimpose the video image data and the human-computer interaction interface information includes: In the process of superimposing the video image data and the human-computer interaction interface information using the superimposer, the video image data is delayed for a predetermined time so that the time of the video image data is aligned with the time of the human-computer interaction interface information, and the delayed video image data and the human-computer interaction interface information are superimposed.

13. The control method according to claim 11, wherein: The step of controlling the write controller to write the human-computer interaction interface information into the memory includes: writing the video image data into the memory using a first write controller; and The human-computer interaction interface information is written into the memory using a second write controller.

14. The control method according to claim 13, wherein: using the first counter to enable the second write controller when the first count value is a first preset value, and to disable the second write controller when the third count value is a second preset value; The second counter is used to turn on the second timing generator and the adder when the first count value is greater than the first preset value and the second count value changes, and to turn off the second timing generator and the adder when the fourth count value is a third preset value.

15. A data processing device comprising: Memory; as well as A processor coupled to the memory, wherein the processor is configured to execute the method according to any one of claims 10 to 14 based on instructions stored in the memory.

16. A non-transitory computer-readable storage medium having computer program instructions stored thereon, wherein the computer program instructions implement the method according to any one of claims 10 to 14 when executed by a processor.

Images