Touch display control device, touch display device, apparatus and method

Abstract

A touch display control device, a touch display device, an electronic device and a touch display control method. The touch display control device comprises a touch drawing buffer unit and a superimposition unit. The touch drawing buffer unit is configured to process touch position information to obtain current second image data corresponding to a touch operation in a current processing cycle. The superimposition unit is configured to receive previous first image data corresponding to a touch operation in a previous processing cycle from a system processing device, and superimpose the current second image data and the previous first image data to obtain third image data. By superimposing the image data generated by the touch display control device onto the image data generated by the system processing device for display, since the image data generated by the touch display control device does not need to undergo the delay caused by multi-layer data processing in the system processing device, the delay time from touch to display is shortened.

Description

TECHNICAL FIELD

[0001] Embodiments of the present disclosure relate to a touch display control apparatus, a touch display apparatus, an electronic device, and a touch display control method. BACKGROUND

[0002] With the development of computer technology, the input method of computer has experienced four stages from paper tape input to keyboard input, to mouse input, and to touch input. Touch display technology is an interactive input technology, which combines the functions of "touch" and "display", and is widely used in handheld consumer electronic devices, medical application devices, vending machines / ticket machines / ATM machines, industrial and process control devices, and other fields, and has the characteristics of simple operation and flexible use. SUMMARY

[0003] At least one embodiment of the present disclosure provides a touch display control apparatus, comprising: a touch drawing buffer unit configured to process touch position information to obtain current second image data corresponding to a touch operation in a current processing period; and a superposition unit configured to receive, from a system processing apparatus, previous first image data corresponding to a touch operation in a previous processing period, and superimpose the current second image data and the previous first image data to obtain third image data.

[0004] For example, in the touch display control apparatus provided by at least one embodiment of the present disclosure, the touch drawing buffer unit comprises a touch drawing part and a drawing frame storage part, the touch drawing part is configured to process the touch position information to generate second intermediate image data and write the second intermediate image data into the drawing frame storage part, and the drawing frame storage part is configured to update at least one frame buffer of the drawing frame storage part using the second intermediate image data to obtain the current second image data.

[0005] For example, the touch display control apparatus provided by at least one embodiment of the present disclosure further comprises: a touch sensing unit configured to receive a touch signal corresponding to a touch operation in the current processing period to obtain the touch position information and provide the touch position information to the system processing apparatus; and a display driving unit configured to generate a display driving signal for display using the third image data.

[0006] At least one embodiment of the present disclosure provides a touch display apparatus, comprising the touch display control apparatus provided by any one of the embodiments of the present disclosure.

[0007] For example, the touch display device provided by at least one embodiment of the present disclosure further comprises: a touch display panel configured to detect a touch operation in the current processing period to generate a touch signal and configured to receive a display driving signal generated by the touch display control device for display; and a system processing device configured to receive and process touch position information corresponding to the previous processing period to obtain the previous first image data.

[0008] For example, in the touch display device provided by at least one embodiment of the present disclosure, the touch display panel comprises a touch panel and a display panel, the touch panel is configured to detect a touch operation in the current processing period to generate the touch signal, and the display panel is configured to receive the display driving signal generated by the touch display control device for display.

[0009] For example, in the touch display device provided by at least one embodiment of the present disclosure, the system processing device is further configured to issue a drawing control command or an erasing control command according to a drawing application program, so that the touch drawing buffer unit obtains the current second image data or erases the previous second image data.

[0010] For example, in the touch display device provided by at least one embodiment of the present disclosure, the system processing device is further configured to issue the erasing control command according to the drawing application program, so that the touch drawing buffer unit erases a part of the previous second image data that is identical to the previous first image data and a drawing result corresponding to the previous second image data.

[0011] For example, in the touch display device provided by at least one embodiment of the present disclosure, the system processing device is further configured to issue an overlay control command according to the drawing application program, so that the overlay unit starts or stops the function of overlaying the current second image data and the previous first image data to obtain the third image data.

[0012] For example, in the touch display device provided by at least one embodiment of the present disclosure, the system processing device comprises a touch drawing unit, a frame buffer management unit and a display management unit, the touch drawing unit is configured to receive and process the touch position information corresponding to the previous processing period to generate first intermediate image data and write the first intermediate image data into the frame buffer management unit, the frame buffer management unit is configured to update at least one frame buffer of the frame buffer management unit using the first intermediate image data to obtain the previous first image data, and the display management unit is configured to output the previous first image data to the overlay unit.

[0013] At least one embodiment of the present disclosure further provides an electronic device comprising the touch display device provided by any one of the embodiments of the present disclosure.

[0014] The touch display control method provided by at least one embodiment of the present disclosure further comprises: receiving a touch signal corresponding to the touch operation in the current processing period to obtain the touch position information and providing the touch position information to the system processing device.

[0015] For example, the touch display control method provided by at least one embodiment of the present disclosure further comprises receiving a touch signal corresponding to the touch operation in the current processing period to obtain the touch position information and providing the touch position information to the system processing device.

[0016] For example, in the touch display control method provided by at least one embodiment of the present disclosure, the processing of the touch position information to obtain the current second image data corresponding to the touch operation in the current processing period comprises: processing the touch position information to generate second intermediate image data and writing the second intermediate image data into a drawing frame memory; and updating at least one frame buffer of the drawing frame memory using the second intermediate image data to obtain the current second image data.

[0017] For example, the touch display control method provided by at least one embodiment of the present disclosure further comprises receiving and processing the touch position information corresponding to the previous processing period by the system processing device to obtain the previous first image data. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings of the embodiments will be briefly introduced as follows. Obviously, the drawings in the following description are merely some embodiments of the present disclosure, and not a limitation of the present disclosure.

[0019] Figure 1 A flowchart from touch to display;

[0020] Figure 2A A schematic diagram of the delay time from touch to display;

[0021] Figure 2B A schematic diagram of the delay time of different models of mobile phones in different transmission paths;

[0022] Figure 3 A schematic diagram of the display process described in the display frame as the time base;

[0023] Figure 4A A schematic block diagram of a touch display control device provided by at least one embodiment of the present disclosure;

[0024] Figure 4B Another schematic block diagram of a touch display control device provided in at least one embodiment of the present disclosure is shown in FIG. 6;

[0025] Figure 5 A schematic block diagram of a touch display device provided in at least one embodiment of the present disclosure is shown in FIG. 7;

[0026] Figure 6 A schematic diagram of a specific example of a touch display device and its working flow is shown in FIG. 8; Figure 5

[0027] Figure 7 A schematic diagram of a touch display device provided in at least one embodiment of the present disclosure is shown in FIG. 9;

[0028] Figure 8A A schematic diagram of a touch display device provided in at least one embodiment of the present disclosure is shown in FIG. 10;

[0029] Figure 8B A schematic diagram of a touch display device provided in at least one embodiment of the present disclosure is shown in FIG. 11;

[0030] Figure 9 A schematic block diagram of an electronic device provided in at least one embodiment of the present disclosure is shown in FIG. 12;

[0031] Figure 10 Another schematic block diagram of an electronic device provided in at least one embodiment of the present disclosure is shown in FIG. 13;

[0032] Figure 11 A flowchart of a touch display control method provided in at least one embodiment of the present disclosure is shown in FIG. 14; and

[0033] Figure 12 A schematic diagram of a specific example of step S120 in the method is shown in FIG. 15. Figure 11 DETAILED DESCRIPTION

[0034] In order to make the objects, technical solutions and advantages of the embodiments of the present disclosure clearer, the technical solutions of the embodiments of the present disclosure will be described clearly and completely below with reference to the drawings of the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments of the present disclosure. Based on the described embodiments of the present disclosure, all other embodiments obtained by a person of ordinary skill in the art without any creative effort fall within the scope of protection of the present disclosure.

[0035] ​​Unless otherwise defined, technical terms or scientific terms used in the present disclosure shall have the same meaning as commonly understood by one of ordinary skill in the art to which this present disclosure belongs. Unless specifically stated otherwise, the terms "first", "second", and like terms referring to a single aspect do not imply that the aspects so designated must be in any particular sequence or order, but, instead, are used merely to distinguish various elements. Also, the terms "a", "an", or "the" used in the context of the present disclosure are to be construed to cover both the singular and the plural, unless otherwise indicated by the context. The term "comprises" or "comprising" or the like means that the elements listed after the word are present, but does not exclude the presence of one or more other elements or quantities. The term "connected" or "coupled" or the like does not necessarily mean that two members so connected or coupled are directly connected or coupled, but rather it can mean that two members, so connected or coupled, can be indirectly connected or coupled via one or more other members. The terms "upper", "lower", "left", "right", and the like are used for description only and do not connote any plan view or spatial orientation of the device, structure, or element described.

[0036] The present disclosure will now be described by way of specific examples. In order to maintain the clarity and conciseness of the following description of the present disclosure, detailed descriptions of known functions and known components will be omitted. When any component of the present disclosure appears in more than one figure, the component is denoted by the same or similar reference numeral in each figure.

[0037] Touch display is a common application that combines touch device and display device. In this application, touch device extracts touch position (x and y axis) on the plane where display image is located. The continuous movement of the touch position represents the user's action command, and the display frame will be updated according to the action command. The display response of the display device under the action command can be one of scrolling, zooming, and page turning.

[0038] In a touch display application such as free drawing (e.g., line, curve, or character) on a touch display device using a touch pen, the stroke drawn on the touch screen will be synchronously displayed on the display screen, in which the corresponding space of the touch device and the corresponding space of the display device are aligned with each other. Touch position data is extracted from the touch device and sent to the system processing device. The system processing device will update the drawing (e.g., part of the line, curve, or character) to combine it into the main display frame memory, and send the updated drawing to the display driving unit. The display driving unit outputs a control signal to the display device to display the updated drawing.

[0039] Figure 1 A flowchart of a process from touch to display. For example, as shown in Figure 1As shown, the touch display control device includes a touch sensing unit and a display driving unit, which are implemented as a touch display driving integrated (TDDI) chip for example; the touch display control device is configured to drive a touch display device, which includes a touch panel and a display panel arranged in an overlapping manner for example. More specifically, the touch sensing unit is configured to drive the touch panel, and the display driving unit is configured to drive the display panel. The system processing device includes a processor corresponding to the touch display device, and an operating system, application software, and the like running on the processor.

[0040] In a process in which a user performs a drawing operation or the like on the touch display device (e.g., in an operation interface of an application) using a stylus or a finger for example, the touch sensing unit receives touch signals generated by the touch panel according to the user's touch operation, processes the touch signals (e.g., analog signals) to obtain touch position information, and reports the touch position information to the system processing device, while a certain image application (e.g., a drawing or writing application) is running on the system processing device. Figure 1 As shown, the system processing device includes a window drawing and system processing unit, a frame buffer management unit, and a display management unit to process image data in a plurality of different frame buffers. The window drawing and system processing unit converts the touch position information reported by the touch sensing unit into image data related to the action of the touch operation. The frame buffer management unit updates existing image data in the plurality of frame buffers using the image data to obtain updated image data, e.g., in combination with image data of the operation interface. The display management unit outputs the updated image data to the display driving unit of the touch display control device. The display driving unit obtains display data from the image data, and outputs the display data to a data driving unit (or a source driving unit) of the display panel and a gate driving signal to a gate driving circuit of the display panel, which in combination drive a pixel array in the display panel to display a picture on the display panel, which includes a stroke or the like due to the touch operation.

[0041] For example, in an optimal case, the touch sensing unit reports the touch position information received by the system processing device within a certain Nth frame. At an N+1th frame, the touch position information is converted into image data in the system processing device. At an N+2th frame, the system processing device outputs the updated image data in the frame buffer management unit for display. Therefore, in the optimal case, at least 3 frames of delay time are required from the detection of the touch operation on the touch panel to the display of the image portion corresponding to the touch operation on the display panel.

[0042] For example, the delay time from touch to display mainly includes two parts: touch display control part and system processing part. The touch display control part samples the touch signal obtained on the touch panel and extracts the touch position through some filtering algorithm, and the delay time of this part is represented as N0. N0 is a physical delay and thus is indispensable. The system processing part is usually implemented and executed in a complex operating system (OS), and the operating system is usually implemented through a hierarchical structure, so the delay will be caused in the multi-layer processing of the operating system:

[0043] (1) The driver layer and the kernel layer contain driver code, OS code, rendering code, synthesis code, etc., obtain input commands from the touch panel, and make system calls to user code, and output image data to the display panel. This series of processes requires a delay time N1.

[0044] (2) The running layer and the framework layer are composed of some dynamic application programming interface (API) libraries to integrate input, output and kernel functions. This series of processes requires a delay time N2, and the delay time N2 of different operating systems (such as Android system or Linux system, etc.) may also be different.

[0045] (3) The application layer will operate multiple applications (APPs) at the same time, and multiple APPs have multiple correlations, so the multiple APP codes are very complex, and this part is prone to delay time N3.

[0046] As can be seen from the above, the sum of the delay time from touch to display is at least (N0+N1+N2+N3).

[0047] Figure 2A is a schematic diagram of the delay time from touch to display. For example, in combination with Figure 2A and the above system processing process from touch to display, in the example shown in the diagram, the sum of the delay time from touch to display (N0+N1+N2+N3) is 58 milliseconds (ms). For example, as shown in Figure 2A , since N0 (such as the input scanning and display change part in Figure 2A ) is an indispensable delay part of touch display, the sum of the delay times (N1+N2+N3) other than N0 exceeds 40 ms, which is about 3 display frame time delays.

[0048] Figure 2B is a schematic diagram of the delay time in different transmission paths of exemplary different models of mobile phones, which use, for example, a capacitive touch display device (i.e. a capacitive touch display screen) and an Android operating system. For example, as shown inFigure 2B As shown in the table, the delay time from touch to display is divided into the delay time from touch detection to the system kernel part, the delay time from the system kernel to the callback part, and the delay time from the setColor() operation to the screen display. The delay time from touch to display of the model 1 mobile phone is about 78 ms, and the delay time from touch to display of the model 2 mobile phone is about 88 ms, both of which have a large display delay problem.

[0049] Figure 3 FIG. 1 is a schematic diagram of a display process described by a display frame as a time base. For example, as shown in FIG. 1, a touch display device is taken as an example. At the Nth frame, a touch sensing unit receives a touch signal generated by a touch panel according to a user touch operation to obtain touch position information. At the N+1th frame, the touch sensing unit reports the touch position information to a system processing device. A window drawing and system processing unit of the system processing device converts the touch position information into image data. At the N+2th and N+3th frames, a frame buffer management unit updates existing image data in a plurality of frame buffers using the image data. At the N+4th frame, a display management unit outputs the updated image data to a display driving unit of the touch display control device. The display driving unit drives a display panel to display. As shown in the example of FIG. 1, the delay time from touch to display usually needs at least 5 frames. Figure 3 Figure 1 Figure 3 As shown in the example of FIG. 1, the delay time from touch to display usually needs at least 5 frames.

[0050] The above delay time from touch to display affects the user experience for applications that need instant feedback, such as drawing or writing applications.

[0051] At least one embodiment of the present disclosure provides a touch display control device, which includes a touch drawing buffer unit and a superposition unit. The touch drawing buffer unit is configured to process touch position information to obtain current second image data corresponding to a touch operation in a current processing period. The superposition unit is configured to receive, from a system processing device, previous first image data corresponding to the touch operation in a previous processing period, and superimpose the current second image data and the previous first image data to obtain third image data.

[0052] Some embodiments of the present disclosure also provide a touch display device corresponding to the above-mentioned touch display control device, an electronic device, and a touch display control method corresponding to the above-mentioned touch display control device.

[0053] ​​The touch display control device, touch display device, electronic device, and touch display control method provided in at least one embodiment of this disclosure, by providing a touch drawing section and a frame buffer storage section in the touch display control device, for example, by copying the touch drawing section and frame buffer storage section of the system processing device into the touch display control device, and by using a superimposing unit to superimpose image data generated by the touch display control device onto the image data generated by the system processing device to obtain superimposed image data for display. In the same processing cycle, since the image data generated by the touch display control device does not need to undergo the delay caused by multiple layers of data processing in the system processing device (including the operating system), the image data generated by the touch display control device can be generated earlier than the image data generated by the system processing device. Therefore, the superimposed image data is also generated earlier than the image data generated by the system processing device, thus shortening the delay time from touch to display, improving system processing speed, and enhancing the user experience.

[0054] At least one embodiment of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the same reference numerals will be used to refer to the same elements described in different drawings.

[0055] Figure 4A This is a schematic block diagram of a touch display control device provided for at least one embodiment of the present disclosure.

[0056] For example, such as Figure 4A As shown, the touch display control device 100 includes a touch drawing buffer unit 110 and an overlay unit 120. The touch drawing buffer unit 110 is configured to process touch position information to obtain second image data corresponding to a touch operation, for example, processing touch position information to obtain current second image data corresponding to a touch operation in the current processing cycle. The overlay unit 120 is configured to receive first image data corresponding to a prior touch operation from a system processing device, and overlay the second image data obtained in the touch display control device 100 with the first image data to obtain third image data, for example, receiving prior first image data corresponding to a touch operation in a prior processing cycle from a system processing device, and overlaying the current second image data with the prior first image data to obtain third image data. This third image data will be used to drive the display panel for display, thereby realizing the extraction and display of the image portion caused by the touch operation. For example, the touch display control device 100 can be implemented by a combination of hardware and software or by firmware, such as by a driver chip (IC) and a driver program running on the driver chip, and the embodiments disclosed herein are not limited thereto; for example, the touch drawing buffer unit 110 and the overlay unit 120 can be implemented separately and communicate with each other, or integrated in the same hardware (e.g., integrated circuit).

[0057] For example, the image superimposition operation of the superimposition unit 120 can be to overlay the second image part to be presented by the second image data on a predetermined position of the first image part to be presented by the first image data in the same (virtual) coordinate system corresponding to the touch operation and the display operation, for example, taking the first image part as background and the second image part as foreground.

[0058] Figure 4B Another schematic block diagram of a touch display control apparatus provided for at least one embodiment of the present disclosure.

[0059] For example, as shown in FIG. 1, the touch display control apparatus 100 includes a touch drawing buffer unit 110 and a superimposition unit 120. Figure 4B For example, as shown in FIG. 1, the touch display control apparatus 100 includes a touch drawing buffer unit 110 and a superimposition unit 120. Figure 4A For example, as shown in FIG. 1, the touch display control apparatus 100 includes a touch drawing buffer unit 110 and a superimposition unit 120. The touch drawing buffer unit 110 is configured to receive the touch position information corresponding to the touch operation to obtain the second intermediate image data and write the second intermediate image data into the drawing frame storage unit 112. The drawing frame storage unit 112 is configured to update at least one frame buffer of the drawing frame storage unit using the second intermediate image data to obtain the current second image data.

[0060] For example, as shown in FIG. 1, the touch display control apparatus 100 includes a touch drawing buffer unit 110 and a superimposition unit 120. The touch drawing buffer unit 110 is configured to receive the touch position information corresponding to the touch operation to obtain the second intermediate image data and write the second intermediate image data into the drawing frame storage unit 112. The drawing frame storage unit 112 is configured to update at least one frame buffer of the drawing frame storage unit using the second intermediate image data to obtain the current second image data. Figure 4B

[0061] Figure 5 Another schematic block diagram of a touch display control apparatus provided for at least one embodiment of the present disclosure.

[0062] For example, as shown in FIG. 1, the touch display control apparatus 100 includes a touch drawing buffer unit 110 and a superimposition unit 120. The touch drawing buffer unit 110 is configured to receive the touch position information corresponding to the touch operation to obtain the second intermediate image data and write the second intermediate image data into the drawing frame storage unit 112. The drawing frame storage unit 112 is configured to update at least one frame buffer of the drawing frame storage unit using the second intermediate image data to obtain the current second image data. Figure 5 Figure 4A or Figure 4B For example, as shown in FIG. 1, the touch display control apparatus 100 includes a touch drawing buffer unit 110 and a superimposition unit 120. The touch drawing buffer unit 110 is configured to receive the touch position information corresponding to the touch operation to obtain the second intermediate image data and write the second intermediate image data into the drawing frame storage unit 112. The drawing frame storage unit 112 is configured to update at least one frame buffer of the drawing frame storage unit using the second intermediate image data to obtain the current second image data.

[0063] ​​For example, the system processing apparatus 210 includes a processor and software running on the processor, which includes an operating system, an application, etc., and can further include a memory, a communication device, etc. as needed; embodiments of the present disclosure do not limit the type, structure, etc. of the processor, and do not limit the software system running on the processor. The system processing apparatus 210 is configured to receive and process touch position information to obtain first image data, for example, to receive and process touch position information corresponding to a previous processing period to obtain previous first image data.

[0064] The touch display panel 220 is configured to detect a touch operation to generate a touch signal and to receive a display driving signal generated by the touch display control apparatus 100 for display, for example, to detect a touch operation in a current processing period to generate a touch signal and to receive a display driving signal generated by the touch display control apparatus 100 for display. For example, the display mode of the touch display panel 220 can be liquid crystal display, electronic paper display, organic light-emitting display, or quantum dot display, etc., and the touch mode can be resistance type, capacitance type, infrared type, or surface acoustic wave type, etc., for example, the capacitance type can be further self-capacitance type or mutual-capacitance type, etc.; the combination mode of the touch structure and the display structure can be an On-Cell or In-Cell touch display panel, etc. For example, for the On-Cell, the touch display panel can be divided into a touch panel and a display panel, and for the In-Cell, the touch display panel can not be obviously divided into a touch panel and a display panel. Embodiments of the present disclosure do not limit the implementation of the touch display panel 220.

[0065] Figure 6 For Figure 5 A specific example of a touch display apparatus and a schematic diagram of its workflow.

[0066] For example, as Figure 6 shown, the touch display panel 220 includes a display panel 221 and a touch panel 222, for example, the touch panel 222 is stacked on the display panel 221. The touch panel 222 is configured to detect a touch operation in a processing period to generate a touch signal, for example, a touch operation in a current processing period to generate a touch signal. The display panel 221 is configured to receive a display driving signal generated by the touch display control apparatus 100 for display.

[0067] For example, as Figure 6As shown, the system processing device 210 includes a touch drawing unit 211, a frame buffer management unit 212, and a display management unit 213. The touch drawing unit 211 is configured to receive and process touch position information provided by the touch sensing unit 130 to generate first intermediate image data and write the first intermediate image data to the frame buffer management unit 212. For example, it receives and processes touch position information corresponding to a prior processing cycle provided by the touch sensing unit 130 to generate first intermediate image data and writes the first intermediate image data to the frame buffer management unit 212. The frame buffer management unit 212 is configured to update at least one frame buffer of the frame buffer management unit 212 using the first intermediate image data to obtain the prior first image data. The display management unit 213 is configured to output the prior first image data to the overlay unit 120.

[0068] It should be noted that at least one frame buffer of the frame buffer management unit 212 may include, for example... Figure 6 The drawing frame buffer 2121, touch object frame buffer 2122, and main frame buffer 2123 shown may also be combinations of other types of frame buffers in other examples, and the embodiments of this disclosure are not limited thereto.

[0069] For example, such as Figure 6 As shown, the touch panel 222 detects a user's touch operation in the current processing cycle (e.g., the N+2th frame) to generate a touch signal. The touch sensing unit 130 receives the touch signal to obtain touch position information and provides the touch position information to the system processing device 210. The touch drawing unit 111 processes the touch position information to generate second intermediate image data and writes the second intermediate image data to the drawing frame storage unit 112. The drawing frame storage unit 112 uses the second intermediate image data to update at least one frame buffer of the drawing frame storage unit 112 to obtain current second image data. This current second image data corresponds to the user's touch operation in the current processing cycle (e.g., the N+2th frame).

[0070] For example, such as Figure 6 As shown, the touch panel 222 detects a user's touch operation in a previous processing cycle (e.g., the Nth frame in the previous cycle) to generate a touch signal. The touch sensing unit 130 receives the touch signal to obtain touch position information and provides this information to the system processing device 210. The touch drawing unit 211 receives and processes the touch position information to generate first intermediate image data and writes the first intermediate image data to the frame buffer management unit 212. The frame buffer management unit 212 uses the first intermediate image data to update at least one frame buffer (e.g., ...) of its own frame buffer. Figure 6The drawing frame buffer 2121, touch object frame buffer 2122, and main frame buffer 2123 shown are used to obtain prior first image data. The display management unit 213 outputs the prior first image data to the overlay unit 120. Therefore, the prior first image data corresponds to the user's touch operation in the prior processing cycle (e.g., the Nth frame).

[0071] For example, such as Figure 6 As shown, the overlay unit 120 overlays the current second image data with the prior first image data to obtain third image data. The display driving unit 140 uses the third image data to generate a display driving signal for display. The display panel 221 receives the display driving signal to perform display.

[0072] like Figure 6 In the example shown, the touch drawing unit 111 can be a copy of the touch drawing unit 211, meaning they have the same function and can be implemented in the same way; or, the drawing frame storage unit 112 can be a copy of the frame buffer management unit 212, meaning they have the same function and can be implemented in the same way. In the same processing cycle, since the touch drawing buffer unit 110 does not need to experience the delay caused by multi-layer data processing in the system processing device to generate the second image data, the second image data for touch operation is generated earlier than the first image data for the entire displayed image (e.g., including both the image portion of the strokes caused by the touch operation and the image portion of the application's user interface, etc.). Therefore, the third image data generated by the overlay unit is also generated earlier than the first image data, thereby shortening the delay time from touch to display.

[0073] For example, such as Figure 6In the example shown, the system processing device 210 also runs a drawing application 214, which for example allows a user to write or draw on the user interface by touch operation using a drawing pen (stylus), and the system processing device 210 is configured to issue a command 1 according to the drawing application 214, for example, the command 1 is a drawing control command or an erasing control command. For example, when the command 1 is a drawing control command, the system processing device 210 controls the touch drawing buffer unit 110 to obtain the current second image data. For example, when the command 1 is an erasing control command, the system processing device 210 controls the touch drawing buffer unit 110 to erase the part of the second image data that is identical to the first image data and the drawing result corresponding to the second image data, so as to avoid repeated or superimposed display; for another example, when the command 1 is an erasing control command, the system processing device 210 controls the touch drawing buffer unit 110 to erase the second image data related to the touch operation stored therein and clear the touch drawing buffer unit 110, so that the superimposed display in the superimposed unit 120 is no longer superimposed; for another example, when the command 1 is an erasing control command, other previous image data related to the touch operation cached in the system processing device 210 can also be further erased according to the content to be erased.

[0074] For example, the command interface of the drawing application 214 for the command 1 needs to select a drawing pen of the same type, color and thickness, so that the drawing result corresponding to the first image data and the second image data is the same except for the different processing periods. For example, the size of the image plane and the color palette need to be matched with the first image data and the second image data.

[0075] For example, since the current second image data is the same as the previous first image data except for the predetermined frames ahead of the previous first image data, when the received command 1 is an erasing command, the part of the second image data that is repeated with the first image data can be partially or completely erased, and the number of the predetermined frames is usually small (for example, 2 frames or 3 frames), so the visual effect on the user is not great.

[0076] For example, as shown in Figure 6 The system processing device 210 is also configured to issue a command 2 according to the drawing application 214, and the command 2 is a superimposed control command. The system processing device 210 controls the superimposed unit 120 to start or stop the function of superimposing the current second image data with the previous first image data to obtain the third image data through the command 2.

[0077] Figure 7 A schematic diagram of the delay time of a touch display device from touch to display provided by at least one embodiment of the present disclosure.

[0078] For example, as shown in Figure 7As shown in FIG. 1, the touch display device 100 includes a touch panel 222, a touch sensing unit 130, a system processing device 210, a superimposition unit 120, a drawing unit 110, a drawing frame storage unit 112, a display driving unit 140, and a display panel 221. Figure 6 As shown in FIG. 1, the touch display device 100 includes a touch panel 222, a touch sensing unit 130, a system processing device 210, a superimposition unit 120, a drawing unit 110, a drawing frame storage unit 112, a display driving unit 140, and a display panel 221.

[0079] For example, as shown in FIG. 1, the touch display device 100 includes a touch panel 222, a touch sensing unit 130, a system processing device 210, a superimposition unit 120, a drawing unit 110, a drawing frame storage unit 112, a display driving unit 140, and a display panel 221. Figure 7 As shown in FIG. 1, the touch display device 100 includes a touch panel 222, a touch sensing unit 130, a system processing device 210, a superimposition unit 120, a drawing unit 110, a drawing frame storage unit 112, a display driving unit 140, and a display panel 221. Figure 6Taking the touch display device shown as an example, at frame N+2, the touch panel 222 detects the user's touch operation (N+2) in frame N+2 to generate a touch signal (N+2). At frame N+3, the touch sensing unit 130 receives and processes the touch signal (N+2) to report the touch position information (N+2) obtained from the touch signal (N+2) to the system processing unit 210 (N+2); simultaneously, the touch drawing unit 111 processes the touch position information (N+2) to generate second intermediate image data (N+2) and writes the second intermediate image data (N+2) into the drawing frame storage unit 112. At frame N+4, the drawing frame storage unit 112 uses the second intermediate image data (N+2) to update at least one frame buffer of the drawing frame storage unit 112 to obtain the second image data (N+2). At this time, after receiving the touch position information corresponding to the touch operation (N) and experiencing a delay of N+4 frames, the system processing device 210 generates first image data (N) through, for example, multi-layer processing. This first image data (N) includes, for example, the image portion corresponding to the touch operation of the Nth frame (equivalent to the second image data (N)) and the image portion that other parts of the application need to display. The overlay unit 120 receives the first image data (N) from the system processing device 210 and overlays the second image data (N+2) with the first image data (N) to obtain third image data (N+2). This third image data (N+2) is sent to the display driving unit 140 to drive the display panel 221 for display. Since the system processing device 210 has generated the first image data (N) at this time, the system processing device 210 issues an erase command to erase the second image data (N) (i.e., the portion equivalent to the first image data (N)) and its corresponding drawing result, avoiding repeated or overlaid display, thereby obtaining the drawing result (N+2) corresponding to the third image data (N+2) on the display panel 221. Similarly, the display driving unit 140 receives the sequentially generated third image data (N+3), third image data (N+4), etc., to perform continuous display driving operations, thereby obtaining the corresponding drawing results (N+3), drawing results (N+4), etc. on the display panel 221.

[0080] For example, such as Figure 7 As shown, in, for example Figure 6 In the touch display device shown, the touch display control device 100 generates the second image data with a delay of 2 frames less than that generated by the system processing device 210 for the first image data. It should be noted that in other examples, the delay time reduced by 1 frame or more than 2 frames compared to the generation of the first image data may be used for generating the second image data; the embodiments of this disclosure do not impose this limitation.

[0081] Figure 8A This is a schematic diagram of the drawing result of the N+4th frame of a touch display device provided in at least one embodiment of the present disclosure;Figure 8B FIG. 7 is a schematic diagram of the drawing result of the N+6th frame of the touch display device according to an embodiment of the present disclosure. Figure 8A and Figure 8B The application of drawing a curve on a whiteboard by a touch pen (drawing pen) is taken as an example for illustration.

[0082] For example, as shown in FIG. 1, the touch display device is taken as an example, and the delay time of the touch display device is as shown in FIG. 2. Figure 8A Figure 6 For example, as shown in FIG. 1, the touch display device is taken as an example, and the delay time of the touch display device is as shown in FIG. 2. Figure 7 At the N+4th frame, the system processing device 210 generates the first image data (N), and the drawing result corresponding to the first image data (N) is the first drawing result (N); the touch drawing buffer unit 110 obtains the second image data (N+2), and the drawing result corresponding to the second image data (N+2) is the second drawing result (N+2). Here, the first drawing result (N) includes the second drawing result (N) and the line drawn before the Nth frame, that is, the first drawing result omits the image part except the strokes caused by the touch operation.

[0083] For example, as shown in FIG. 1, the touch display device is taken as an example, and the delay time of the touch display device is as shown in FIG. 2. Figure 8A For example, as shown in FIG. 1, the touch display device is taken as an example, and the delay time of the touch display device is as shown in FIG. 2. Figure 8A For example, as shown in FIG. 1, the touch display device is taken as an example, and the delay time of the touch display device is as shown in FIG. 2.

[0084] For example, as shown in FIG. 1, the touch display device is taken as an example, and the delay time of the touch display device is as shown in FIG. 2. Figure 8B For example, as shown in FIG. 1, the touch display device is taken as an example, and the delay time of the touch display device is as shown in FIG. 2. Figure 6 For example, as shown in FIG. 1, the touch display device is taken as an example, and the delay time of the touch display device is as shown in FIG. 2. Figure 7 ​For example, as shown in FIG. 6, at the N+6 frame time, the system processing device 210 generates the first image data (N+2), and the drawing result corresponding to the first image data (N+2) includes the previous first drawing result (N) and the corresponding part of the second drawing result (N+2); the touch drawing buffer unit 110 obtains the second image data (N+2), and the drawing result corresponding to the second image data (N+2) includes the second drawing result (N+4).

[0085] For example, as shown in FIG. 6, at the N+6 frame time, the system processing device 210 generates the first image data (N+2), and the drawing result corresponding to the first image data (N+2) includes the previous first drawing result (N) and the corresponding part of the second drawing result (N+2); the touch drawing buffer unit 110 obtains the second image data (N+2), and the drawing result corresponding to the second image data (N+2) includes the second drawing result (N+4). Figure 8B For example, as shown in FIG. 6, at the N+6 frame time, the system processing device 210 generates the first image data (N+2), and the drawing result corresponding to the first image data (N+2) includes the previous first drawing result (N) and the corresponding part of the second drawing result (N+2); the touch drawing buffer unit 110 obtains the second image data (N+2), and the drawing result corresponding to the second image data (N+2) includes the second drawing result (N+4). Figure 8B For example, as shown in FIG. 6, at the N+6 frame time, the system processing device 210 generates the first image data (N+2), and the drawing result corresponding to the first image data (N+2) includes the previous first drawing result (N) and the corresponding part of the second drawing result (N+2); the touch drawing buffer unit 110 obtains the second image data (N+2), and the drawing result corresponding to the second image data (N+2) includes the second drawing result (N+4).

[0086] For example, as shown in FIG. 6, at the N+6 frame time, the system processing device 210 generates the first image data (N+2), and the drawing result corresponding to the first image data (N+2) includes the previous first drawing result (N) and the corresponding part of the second drawing result (N+2); the touch drawing buffer unit 110 obtains the second image data (N+2), and the drawing result corresponding to the second image data (N+2) includes the second drawing result (N+4).

[0087] In at least one embodiment of the present disclosure, in the same processing period, the second image data generated by the touch display control device does not need to go through the delay caused by multi-layer data processing in the operating system, and the second image data is generated in advance of the first image data, so that the third image data generated by the superposition unit is also in advance of the first image data, thereby shortening the delay time from touch to display.

[0088] Figure 9 A schematic block diagram of an electronic device provided in at least one embodiment of the present disclosure.

[0089] For example, as shown in Figure 9 The electronic device 10 includes a touch display device 200, which is a touch display device provided in any embodiment of the present disclosure, for example, the touch display device 200 shown in Figure 5 .

[0090] For example, the electronic device 10 can be a DDR digital system, or a mobile phone, a tablet computer, a notebook computer, an e-book, a game console, a television, a digital photo frame, a navigation device, or any device, and can also be any combination of electronic devices and hardware, and the embodiments of the present disclosure do not limit this.

[0091] It should be noted that, for the sake of clarity and simplicity, the present disclosure does not show all the components of the electronic device 10. To achieve the necessary functions of the electronic device, those skilled in the art can provide and set other components not shown according to specific needs, such as a communication unit (for example, a network communication unit), an input / output unit (for example, a keyboard, a loudspeaker, etc.), and the embodiments of the present disclosure do not limit this. The related description and technical effects of the electronic device 10 can refer to the related description and technical effects of the touch display control device provided in the embodiments of the present disclosure, which will not be repeated here.

[0092] Figure 10 A schematic block diagram of another electronic device provided in at least one embodiment of the present disclosure.

[0093] For example, as shown in Figure 10 The electronic device 400, for example, includes a touch display device provided in the embodiments of the present disclosure. The electronic device 400 can be a terminal device or a server, etc. It should be noted that, Figure 10 The electronic device 400 shown is only an example, which does not limit the functions and use range of the embodiments of the present disclosure.

[0094] For example, as shown in Figure 10As shown, the electronic device 400 can include a processing apparatus (e.g., a central processor, a graphics processor, etc.) 41, which for example includes a touch display apparatus according to any embodiment of the present disclosure, and which can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 42 or loaded into a random access memory (RAM) 43 from a storage apparatus 48. Various programs and data required by the electronic device 400 to operate are also stored in the RAM 43. The processing apparatus 41, the ROM 42, and the RAM 43 are connected to each other through a bus 44. An input / output (I / O) interface 45 is also connected to the bus 44. Generally, the following apparatuses can be connected to the I / O interface 45: input apparatuses 46 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output apparatuses 47 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage apparatus 48 including, for example, a magnetic tape, a hard disk, etc.; and a communication apparatus 49. The communication apparatus 49 can allow the electronic device 400 to communicate wirelessly or wiredly with other electronic devices to exchange data.

[0095] Although Figure 10 The electronic device 400 is shown with various apparatuses, but it should be understood that not all of the shown apparatuses are required to be implemented or possessed, and the electronic device 400 can instead be implemented or possess more or fewer apparatuses.

[0096] Detailed descriptions and technical effects of the electronic device 10 / 400 can be referred to in the art, and will not be repeated here.

[0097] Figure 11 A flowchart of a touch display control method is provided for at least one embodiment of the present disclosure, for example, the touch display control method corresponds to the display control apparatus described above.

[0098] For example, as Figure 11 As shown, in at least one embodiment of the present disclosure, the touch display control method includes the following steps S110-S140.

[0099] Step S110: receiving a touch signal corresponding to a touch operation in a current processing period to obtain touch position information and providing the touch position information to a system processing apparatus;

[0100] Step S120: processing the touch position information to obtain second image data corresponding to the touch operation in the current processing period;

[0101] Step S130: receiving first image data corresponding to the touch operation in a previous processing period from the system processing apparatus;

[0102] Step S140: Overlay the current second image data with the previous first image data to obtain the third image data.

[0103] For example, in such Figure 6 In the illustrated embodiment, for step S110, the touch sensing unit 130 can receive the touch signal corresponding to the touch operation in the current processing cycle (e.g., the N+2th frame) to obtain touch position information, and provide the touch position information to the system processing device 210. For step S120, the touch drawing buffer unit 110 can process the touch position information to obtain second image data corresponding to the touch operation in the current processing cycle (e.g., the N+2th frame). For step S130, the overlay unit 120 can receive first image data corresponding to the touch operation in a previous processing cycle (e.g., the Nth frame) from the system processing device 210. For step S140, the overlay unit 120 can overlay the current second image data with the previous first image data to obtain third image data.

[0104] For example, in at least one embodiment of this disclosure, the touch display control method further includes receiving and processing touch position information corresponding to a prior processing cycle through a system processing device to obtain prior first image data. For example, in such... Figure 6 In the illustrated embodiment, the touch drawing unit 211 of the system processing device 210 receives and processes touch position information corresponding to a previous processing cycle (e.g., the Nth frame) to generate first intermediate image data, and writes the first intermediate image data into the frame buffer management unit 212. The frame buffer management unit 212 uses the first intermediate image data to update at least one frame buffer of the frame buffer management unit 212 to obtain the prior first image data.

[0105] Figure 12 for Figure 11 An exemplary flowchart of step S120.

[0106] For example, such as Figure 12 As shown, in Figure 11 In one example of step S120, the touch position information is processed to obtain second image data corresponding to the touch operation in the current processing cycle, including the following steps S121 to S122.

[0107] Step S121: Process the touch position information to generate second intermediate image data and write the second intermediate image data into the drawing frame storage unit;

[0108] Step S122: Update at least one frame buffer of the drawing frame storage unit with the second intermediate image data to obtain the current second image data.

[0109] For example, in such Figure 6In the illustrated embodiment, for step S121, the touch position information can be processed by the touch drawing unit 111 to generate second intermediate image data, and the second intermediate image data can be written into the drawing frame storage unit 112. For step S122, the second intermediate image data can be used by the drawing frame storage unit 112 to update at least one frame buffer of the drawing frame storage unit 112 to obtain current second image data.

[0110] In at least one embodiment of the present disclosure, in the same processing cycle, since the second image data is generated by the touch display control device without going through the delay caused by multi-layer data processing in the system processing device, the second image data is generated in advance of the first image data, and thus the third image data generated by superimposition is also generated in advance of the first image data, thereby shortening the delay time from touch to display.

[0111] For the present disclosure, the following points need to be explained:

[0112] (1) In the drawings of the embodiments of the present disclosure, only the structures related to the embodiments of the present disclosure are involved, and other structures can be referred to the general design.

[0113] (2) In the case of no conflict, the features in the same embodiment and different embodiments of the present disclosure can be combined with each other.

[0114] The above is only a specific embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto, any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present disclosure, which should be covered within the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims

1. A touch display control device, comprising: A touch drawing buffer unit is configured to process touch position information to obtain current second image data corresponding to a touch operation in the current processing cycle, wherein the current second image data is obtained before the system processing device obtains the first image data in the current processing cycle; The overlay unit is configured to receive prior first image data corresponding to a touch operation in a prior processing cycle from a system processing device, and to overlay a second image portion to be displayed by the current second image data onto a predetermined position of the first image portion to be displayed by the prior first image data at a predetermined position, so as to overlay the prior first image data to obtain third image data, wherein the third image data is used to drive a display panel for display. The system processing unit includes a touch drawing unit, a frame buffer management unit, and a display management unit. The touch drawing unit is configured to receive and process the touch position information corresponding to the prior processing cycle to generate first intermediate image data and write the first intermediate image data into the frame buffer management unit. The frame buffer management unit is configured to update at least one frame buffer of the frame buffer management unit using the first intermediate image data to obtain the prior first image data. The display management unit is configured to output the prior first image data to the overlay unit.

2. The touch display control device according to claim 1, wherein, The touch drawing buffer unit includes a touch drawing section and a drawing frame storage section. The touch drawing unit is configured to process the touch position information to generate second intermediate image data and write the second intermediate image data into the drawing frame storage unit. The drawing frame storage unit is configured to update at least one frame buffer of the drawing frame storage unit using the second intermediate image data to obtain the current second image data.

3. The touch display control device according to claim 1, further comprising: A touch sensing unit is configured to receive a touch signal corresponding to a touch operation in the current processing cycle to obtain the touch position information and provide the touch position information to the system processing device; The display driving unit is configured to use the third image data to generate a display driving signal for display.

4. A touch display device, comprising: The touch display control device as described in any one of claims 1-3.

5. The touch display device according to claim 4, further comprising: A touch display panel is configured to detect touch operations in the current processing cycle to generate touch signals and to receive display drive signals generated by the touch display control device for display.

6. The touch display device according to claim 5, wherein, The touch display panel includes a touch panel and a display panel. The touch panel is configured to detect touch operations in the current processing cycle to generate the touch signal. The display panel is configured to receive the display driving signal generated by the touch display control device for display.

7. The touch display device according to claim 4, wherein, The system processing device is further configured to issue drawing control commands or erasure control commands according to the drawing application, so that the touch drawing buffer unit obtains the current second image data or erases the prior second image data.

8. The touch display device according to claim 7, wherein, The system processing device is further configured to issue the erase control command according to the drawing application, so that the touch drawing buffer unit erases the portion of the prior second image data that is equivalent to the prior first image data and the drawing result corresponding to the prior second image data.

9. The touch display device according to claim 4, wherein, The system processing device is further configured to issue an overlay control command according to the drawing application, so that the overlay unit starts or stops the function of overlaying the current second image data with the prior first image data to obtain the third image data.

10. An electronic device comprising a touch display device as described in any one of claims 4-9.

11. A touch display control method, comprising: The touch position information is processed to obtain current second image data corresponding to the touch operation in the current processing cycle, wherein the current second image data is obtained before the system processing device obtains the first image data in the current processing cycle; Receive prior first image data corresponding to the touch operation in a prior processing cycle from the system processing device; The second image portion to be displayed in the current second image data is overlaid on a predetermined position of the first image portion to be displayed in the prior first image data, so as to superimpose the prior first image data to obtain third image data, wherein the third image data is used to generate a display driving signal; The step of receiving the prior first image data corresponding to the touch operation in a prior processing cycle from the system processing device includes: The touch drawing unit of the system processing device receives and processes the touch position information corresponding to the prior processing cycle to generate first intermediate image data, and writes the first intermediate image data into the frame buffer management unit of the system processing device. The frame buffer management unit updates at least one frame buffer of the frame buffer management unit using the first intermediate image data to obtain the prior first image data.

12. The touch display control method according to claim 11, further comprising: The system receives a touch signal corresponding to the touch operation in the current processing cycle to obtain the touch position information and provides the touch position information to the system processing device.

13. The touch display control method according to claim 11, wherein, The process of processing touch position information to obtain current second image data corresponding to the touch operation in the current processing cycle includes: The touch position information is processed to generate second intermediate image data and the second intermediate image data is written to the drawing frame storage unit; At least one frame buffer of the drawing frame storage unit is updated using the second intermediate image data to obtain the current second image data.

Images