Touch and display control device, display device and operating method thereof, electronic system

Abstract

The present disclosure provides a touch and display control device having a touch screen controller and a display driver. The touch screen controller receives a touch sensing signal, generates touch raw data based on the touch sensing signal, and extracts touch information based on the touch raw data. The display driver receives an initial image from a host processor, receives the touch information directly from the touch screen controller, generates touch trajectory information by accumulating the touch information, internally generates a touch image to be displayed together with the initial image based on the touch trajectory information, generates a composite image by compositing the initial image and the touch image, and controls a display panel to display the composite image. The display driver includes a memory that stores the touch trajectory information.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority to Korean Patent Application No. 10-2020-0055916, filed with the Korean Intellectual Property Office (KIPO) on May 11, 2020, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The example embodiments generally relate to semiconductor integrated circuits, and more specifically to touch and display control devices with fast touch response, display devices including touch and display control devices, methods of operating display devices, and electronic systems including display devices. Background Technology

[0004] A display device is a device used to convey information to a user in electronic devices such as televisions, mobile phones, or computers. A display device may include multiple light-emitting pixels. In some cases, a display device can also be used to receive user input. For example, a user can use a touch input device such as a stylus to create artwork, take notes, or edit photos on the display device.

[0005] However, when using a display device for handwriting input, users may experience a lag between the input and the display change. This delay is due to the long signal transmission path between the touch input device and its display response. For example, the signal transmission path may include sending the touch input to the processor and then to the display controller.

[0006] The lag between input and the corresponding display change can frustrate users attempting to draw, write, or edit on a monitor. Therefore, a fast response or short latency is desired to improve the user's writing experience. Consequently, there is a need in the art for display devices with reduced latency between touch input and the displayed response. Summary of the Invention

[0007] At least one example embodiment of this disclosure provides a touch and display control device with fast touch response.

[0008] At least one example embodiment of this disclosure provides a display device including a touch and display control device, and an electronic system including the display device.

[0009] At least one example embodiment of this disclosure provides a method of operating a display device.

[0010] According to an example embodiment, the touch and display control device includes a touchscreen controller and a display driver. The touchscreen controller receives touch sensing signals from a touchscreen panel, generates raw touch data based on the touch sensing signals, and extracts touch coordinate information and first touch attribute information based on the raw touch data. The display driver receives an initial image from a host processor, directly receives touch coordinate information and first touch attribute information from the touchscreen controller, generates touch trajectory information by accumulating the touch coordinate information and first touch attribute information, internally generates a touch image to be displayed along with the initial image based on the touch trajectory information, generates a composite image by synthesizing the initial image and the touch image, and controls the display panel to display the composite image. The display driver includes a memory for storing the touch trajectory information.

[0011] According to an example embodiment, the display device includes a touchscreen panel, a display panel, and a touch and display control device. The touchscreen panel detects touch events. The display panel displays an initial image and a touch image corresponding to the touch event. The touch and display control device controls the operation of the touchscreen panel and the display panel. The touch and display control device includes a touchscreen controller and a display driver. The touchscreen controller receives touch sensing signals corresponding to touch events from the touchscreen panel, generates raw touch data based on the touch sensing signals, and extracts touch coordinate information and first touch attribute information based on the raw touch data. The display driver receives the initial image from a host processor, directly receives touch coordinate information and first touch attribute information from the touchscreen controller, generates touch trajectory information by accumulating the touch coordinate information and first touch attribute information, internally generates a touch image to be displayed along with the initial image based on the touch trajectory information, generates a composite image by synthesizing the initial image and the touch image, and controls the display panel to display the composite image. The display driver includes a memory for storing the touch trajectory information.

[0012] According to an example embodiment, in an operation method of a display device, a display driver receives an initial image from a host processor. A touchscreen controller extracts touch coordinate information and first touch attribute information by detecting touch events on the touchscreen panel. The display driver receives the touch coordinate information and first touch attribute information directly from the touchscreen controller, without going through the host processor. The display driver generates touch trajectory information by accumulating the touch coordinate information and the first touch attribute information. The display driver stores the touch trajectory information in internal memory. The display driver internally generates a touch image to be displayed together with the initial image based on the touch trajectory information. The display driver generates a composite image by combining the initial image and the touch image. The display driver controls the display panel to display the composite image.

[0013] According to an example embodiment, an electronic system includes a display device and a host processor configured to control the display device. The display device includes a touchscreen panel, a display panel, and a touch and display control device. The touchscreen panel detects touch events. The display panel displays an initial image and a touch image corresponding to the touch event. The touch and display control device controls the operation of the touchscreen panel and the display panel. The touch and display control device includes a readout circuit, a touch coordinate calculator, a display controller, a memory, an image buffer, an image processor, and a source driver. The readout circuit receives touch sensing signals corresponding to touch events from the touchscreen panel and generates raw touch data based on the touch sensing signals. The touch coordinate calculator extracts touch coordinate information and first touch attribute information based on the raw touch data. The display controller receives touch coordinate information and first touch attribute information directly from the touch coordinate calculator without going through the host processor, receives the initial image and second touch attribute information from the host processor, and generates touch trajectory information by accumulating the touch coordinate information, the first touch attribute information, and the second touch attribute information. The memory stores the touch trajectory information. The image buffer stores the initial image. The image processor internally generates a touch image to be displayed together with the initial image based on the touch trajectory information, and generates a composite image by synthesizing the initial image and the touch image. The source driver generates multiple data voltages for the display panel based on the composite image. Touch coordinate information and first touch attribute information are not sent from the touch coordinate calculator to the host processor. The touch image is not generated by the host processor, but by the touch and display control device. When the initial image is a still image, the host processor enters a power-down mode after sending the initial image to the touch and display control device. The touch and display control device periodically, or depending on the memory state, or when receiving a request from the host processor, sends touch trajectory information stored in memory to the host processor.

[0014] In the touch and display control device, display device, electronic system, and operation method of the display device according to the example embodiments, it can be implemented as including a display controller that generates touch trajectory information, a memory that stores the touch trajectory information, and an image synthesizer that generates touch images and composite images. Touch coordinate information can be provided directly to the display controller without going through a host processor, and touch images and composite images can be generated internally and / or by the touch trajectory information including touch coordinate information and touch attribute information.

[0015] According to an example embodiment, a method for displaying an image includes: receiving an initial image from a host processor; detecting a touch event; sending touch event information from a touchscreen controller to a display driver using a transmission path that excludes the host processor; generating a composite image using the display driver based on the initial image and the touch event information; and displaying the composite image in response to the touch event.

[0016] Therefore, by eliminating the time spent processing and generating images by the host processor, touch responsiveness can be significantly improved or enhanced. Furthermore, when only the touch image is reflected without altering the initial image, such as when writing in a notebook, image processing can be performed solely by the display driver. This also reduces the power consumption of image processing, generation, and compositing performed via the host processor's display control path. Attached Figure Description

[0017] The illustrative, non-limiting exemplary embodiments will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings.

[0018] Figure 1 This is a block diagram illustrating a touch and display control device, a display device, and an electronic system according to an example embodiment.

[0019] Figure 2 It is shown Figure 1 A block diagram illustrating examples of touch and display control devices, display devices, and electronic systems.

[0020] Figure 3A , Figure 3B , Figure 3C and Figure 3D It is used to describe Figure 2 A diagram illustrating the operation of touch and display control devices, display devices, and electronic systems.

[0021] Figure 4A and Figure 4B This is a diagram used to describe the operation of generating and storing touch trajectory information in a touch and display control device according to an example embodiment.

[0022] Figure 5A , Figure 5B , Figure 5C , Figure 6 , Figure 7A , Figure 7B , Figure 7C and Figure 8 This diagram is used to describe the operations of generating touch images and composite images in a touch and display control device according to an example embodiment.

[0023] Figure 9A and Figure 9BThis is a diagram used to describe the operation of generating and storing touch trajectory information in a touch and display control device according to an example embodiment.

[0024] Figure 10 , Figure 11 and Figure 12 It is shown Figure 1 Figures show other examples of touch and display control devices, display devices, and electronic systems.

[0025] Figure 13 This is a flowchart illustrating a method of operating a display device according to an example embodiment.

[0026] Figure 14 It is shown Figure 13 A flowchart of an example of step S100.

[0027] Figure 15 It is shown Figure 13 The flowchart is an example of step S200.

[0028] Figure 16 It is shown Figure 15 The flowchart for an example of step S250 in the example.

[0029] Figure 17 It is shown Figure 15 The flowchart shows an example of steps S250 and S260.

[0030] Figure 18 This is a block diagram illustrating an electronic system according to an example embodiment. Detailed Implementation

[0031] This disclosure generally relates to semiconductor integrated circuits, and more specifically to touch and display control devices with fast touch response. Embodiments of this disclosure include touch and display control devices, methods of operating display devices, and electronic systems including display devices.

[0032] Embodiments of this disclosure provide touch coordinate information directly to the display controller without going through a host processor. Additionally, touch images and composite images can be generated using touch trajectory information, which includes touch coordinate information and touch attribute information.

[0033] During writing operations (e.g., using a finger or stylus), the delay between touch input and the touch display can be relatively long due to the long signal transmission path from the touch input to the display driver. For example, the transmission path may pass through the host processor. This delay can interfere with the writing process and result in a poor writing experience for the user.

[0034] Therefore, the touchscreen controller of this disclosure receives touch sensing signals, generates raw touch data based on the touch sensing signals, and extracts touch information based on the raw touch data. The display driver of this disclosure receives an initial image from a host processor, receives touch information directly from the touchscreen controller, generates touch trajectory information by accumulating the touch information, internally generates a touch image to be displayed along with the initial image based on the touch trajectory information, generates a composite image by compositing the initial image and the touch image, and controls the display panel to display the composite image. The display driver includes a memory for storing touch trajectory information.

[0035] Various exemplary embodiments will be described more fully with reference to the accompanying drawings, in which embodiments are illustrated. However, this disclosure may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Throughout this disclosure, the same reference numerals denote the same elements.

[0036] Figure 1 This is a block diagram illustrating a touch and display control device, a display device, and an electronic system according to an example embodiment.

[0037] Reference Figure 1 The electronic system 100 includes a host processor 200 and a display device 300. In some embodiments, the host processor 200 includes an external host processor located outside the display device 300. The electronic system 100 may also include a memory 600.

[0038] The display device 300 is configured to display images based on control from the host processor 200. According to embodiments of this disclosure, the display device 300 is also configured to display internally generated images, or internally generated portions of images. The display device 300 includes a panel 400 for user interface and a touch and display control device 500 for the control panel 400.

[0039] Panel 400 includes a touchscreen panel 410 for sensing user touch input and a display panel 450 for outputting visual information to the user. Electronic system 100 can display information output from itself via panel 400. A user of electronic system 100 can input signals to the electronic system via panel 400. Touchscreen panel 410 may be referred to as a touch sensor panel.

[0040] The touchscreen panel 410 can sense the touch or proximity of an object (e.g., a user's finger or a stylus). The touchscreen panel 410 can generate a sensing signal in response to the touch or proximity of an object. For example, the touchscreen panel 410 can be implemented as capacitive and can include multiple sensing capacitors formed along rows and columns. Figure 1An example sensing capacitor CS is shown. The capacitance value of the sensing capacitor can change in response to the contact or proximity of an object. However, the example embodiment is not limited to this, and the touch screen panel 410 can be implemented in various types, such as resistive, optical, inductive, infrared (IR), surface acoustic wave (SAW), etc.

[0041] Display panel 450 can output visual information to the user. Display panel 450 may include multiple pixels arranged along rows and columns to display images. Figure 1 An example pixel PX is shown. Each pixel can be configured to emit light of a specific color to form an image. When multiple pixels emit light together, the display panel 450 can display the desired or anticipated image.

[0042] In some example embodiments, display panel 450 may be an electroluminescent display panel. Light-emitting diodes (LEDs) or organic light-emitting diodes (OLEDs) that generate light through the recombination of electrons and holes can be used to drive the electroluminescent display panel for its fast response speed and low power consumption. However, the example embodiments are not limited thereto, and display panel 450 may be any display panel implemented in various types.

[0043] Each coordinate on the touchscreen panel 410 can be matched with each coordinate on the display panel 450. For example, the display panel 450 can display interface information on a specific area P. A user can touch or approach a specific area Q on the touchscreen panel 410 to input commands through the displayed interface information. Here, the coordinates of the specific area Q can be matched with the coordinates of the specific area P. Therefore, touching or approaching the specific area Q can be processed in association with the interface information displayed on the specific area P.

[0044] In some example embodiments, the touchscreen panel 410 may be implemented separately from the display panel 450. For example, as Figure 1 As shown, the touchscreen panel 410 can be placed on or above the display panel 450. However, the example embodiment is not limited to this. For another example, with Figure 1 Depending on the illustration, the display panel 450 can be placed on or above the touchscreen panel 410. Alternatively, the touchscreen panel 410 and the display panel 450 can be implemented in a single panel.

[0045] The touch and display control device 500 includes: a touch screen controller 510 for controlling a touch screen panel 410; and a display actuator 550 for controlling a display panel 450.

[0046] The touchscreen controller 510 can control the operation of the touchscreen panel 410. The touchscreen controller 510 can process operations associated with contact or proximity of an object based on sensing signals output from the touchscreen panel 410. For example, the touchscreen controller 510 can identify contact or proximity of an object based on changes in the capacitance value of a sensing capacitor. For example, when the sensing signals are associated with the execution or operation of a specific application, the touchscreen controller 510 can output commands or touch information to the host processor 200, causing the specific application to be executed or operated.

[0047] The display driver 550 can control the operation of the display panel 450 and can drive the display panel 450. For example, the display driver 550 can appropriately drive each pixel of the display panel 450 in response to commands from the host processor 200, so that the desired or anticipated image is displayed on the display panel 450.

[0048] Reference Figures 2 to 12 The detailed configuration and operation of a touch and display control device 500 according to an example embodiment are described, including the configuration and operation of a touch screen controller 510 and a display driver 550.

[0049] In some example embodiments, the touch and display control device 500 may be formed from a single chip or two or more separate chips, or implemented as a single chip or two or more separate chips. (See also...) Figure 2 , Figure 11 and Figure 12 Describe the chip configuration of the touch and display control device 500.

[0050] The host processor 200 can control the overall operation of the electronic system 100. The host processor 200 can process / execute various arithmetic / logic operations to provide the functions of the electronic system 100.

[0051] The host processor 200 can communicate with the touchscreen controller 510, the display driver 550, and the memory 600. The host processor 200 can control the operation of the touchscreen controller 510, the display driver 550, and the memory 600. The host processor 200 can process commands, requests, responses, and / or the like. Commands can be associated with the operation of the touchscreen controller 510, the display driver 550, and the memory 600.

[0052] For example, host processor 200 can process commands received from touchscreen controller 510 to determine user commands entered through touchscreen panel 410. For example, host processor 200 can provide information to display driver 550 to display a desired or anticipated image on display panel 450. For example, host processor 200 can store or load associated or related data into memory 600.

[0053] In some example embodiments, host processor 200 may include one or more special-purpose circuits (e.g., field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), and / or the like) to perform various operations. For example, host processor 200 may include one or more processor cores capable of performing various operations. For example, host processor 200 may be implemented using a general-purpose processor (e.g., a central processing unit (CPU)), a special-purpose processor, or an application processor (AP).

[0054] The memory 600 may store data associated with or related to the operation of the electronic system 100. In some example embodiments, the memory 600 may include at least one of various volatile memories, such as dynamic random access memory (DRAM), static random access memory (SRAM), etc. In some example embodiments, the memory 600 may include at least one of various non-volatile memories, such as flash memory, phase-change random access memory (PRAM), resistive random access memory (RRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), nanofloating gate memory (NFGM), polymer random access memory (PoRAM), etc.

[0055] In some example embodiments, the touchscreen controller 510, display driver 550, host processor 200, and memory 600 may be implemented using separate circuits / modules / chips. In other example embodiments, based on functionality, some of the touchscreen controller 510, display driver 550, host processor 200, and memory 600 may be combined into a single circuit / module / chip, or may be further separated into multiple circuits / modules / chips.

[0056] In some example embodiments, electronic system 100 may be any mobile system or include any mobile system, such as mobile phones, smartphones, tablet computers, laptop computers, personal digital assistants (PDAs), portable multimedia players (PMPs), digital cameras, portable game consoles, music players, camcorders, video players, navigation devices, wearable devices, Internet of Things (IoT) devices, Internet of Everything (IoE) devices, e-book readers, virtual reality (VR) devices, augmented reality (AR) devices, robotic devices, drones, etc.

[0057] According to an example embodiment, a method for displaying an image includes: receiving an initial image from a host processor 200; detecting a touch event at a touchscreen controller 510; sending touch event information from the touchscreen controller 510 to a display driver 550 using a transmission path that excludes the host processor 200; generating a composite image using the display driver 550 based on the initial image and the touch event information; and displaying the composite image in response to the touch event.

[0058] In some examples, the touch event information includes touch coordinate information and touch attribute information. In some examples, the method also includes generating touch trajectory information using a display driver, wherein a composite image is generated based on the touch trajectory information. In some examples, the method also includes sending the touch trajectory information to a host processor. In some examples, the method also includes generating a touch image based on the touch event information and combining the touch image with an initial image to produce a composite image.

[0059] Figure 2 It is shown Figure 1 A block diagram illustrating examples of touch and display control devices, display devices, and electronic systems. (The following will be omitted: [The text abruptly ends here, likely due to an incomplete sentence or missing information.]) Figure 1 Repeated description.

[0060] Reference Figure 2 The electronic system 100a includes a host processor 200, a display device, and a memory 600. The display device includes a panel, which includes a touch screen panel 410 and a display panel 450. The display device also includes touch and display control devices, which include a touch screen controller 510a and a display driver 550a.

[0061] The description will focus on the configuration and operation of touch and display control devices with touch screen controller 510a and display driver 550a. Figure 2 Examples. Figure 2 An example is shown in which the touchscreen controller 510a and display driver 550a are formed or implemented as a single chip. The host processor 200, touchscreen panel 410, display panel 450, and memory 600 can be compared with the reference... Figure 1The descriptions are basically the same.

[0062] The touch screen controller 510a receives the touch sensing signal TSEN from the touch screen panel 410, generates raw touch data TRDAT based on the touch sensing signal TSEN, and extracts touch coordinate information TCOOR and first touch attribute information TA1 based on the raw touch data TRDAT.

[0063] The touchscreen controller 510a may include a readout circuit 520 and a touch coordinate calculator 530.

[0064] The readout circuit 520 can receive the touch sensing signal TSEN and can generate touch raw data TRDAT based on the touch sensing signal TSEN. The touch sensing signal TSEN can be an analog signal, and the touch raw data TRDAT can be digital data. For example, when a touch event TE occurs on the touchscreen panel 410, the readout circuit 520 can receive the touch sensing signal TSEN from the touchscreen panel 410. For example, the touch event TE can include a writing function, in which a statement such as “This is heaven!” is written on the touchscreen panel 410 using a stylus 110. However, the example embodiment is not limited to this, and the touch event TE can include any touch event using any object.

[0065] The touch coordinate calculator 530 can extract touch coordinate information TCOOR and first touch attribute information TA1 based on the raw touch data TRDAT. For example, the touch coordinate information TCOOR can represent coordinate information (e.g., position information) on the touchscreen panel 410 corresponding to the touch event TE. For example, the first touch attribute information TA1 can include at least one of the shape, size, orientation, and writing pressure associated with the touch event TE.

[0066] The display driver 550a receives the initial image OIMG from the host processor 200, and directly receives touch coordinate information TCOOR and first touch attribute information TA1 from the touch screen controller 510a. It generates touch trajectory information TTRAJ by accumulating the touch coordinate information TCOOR and the first touch attribute information TA1, stores the touch trajectory information TTRAJ, generates a touch image TIMG to be displayed together with the initial image OIMG internally based on the touch trajectory information TTRAJ, generates a composite image CIMG by compositing the initial image OIMG and the touch image TIMG, and controls the display panel 450 to display the composite image CIMG.

[0067] According to embodiments of this disclosure, when the display driver 550a receives touch coordinate information TCOOR and first touch attribute information TA1 from the touchscreen controller 510a, the display driver 550a receives the information via a transmission path that excludes the host processor 200. By receiving the touch coordinate information TCOOR and the first touch attribute information TA1 directly (i.e., without via the host processor), the time period for processing the touch coordinate information TCOOR and the first touch attribute information TA1 and generating the display change can be shortened.

[0068] The display driver 550a can also receive second touch attribute information TA2, which is different from the first touch attribute information TA1, from the host processor 200, and can also output touch trajectory information TTRAJ to the host processor 200.

[0069] Display driver 550a may include memory 560, display controller 570, image processor 580, and source driver 590. Display driver 550a may also include image buffer 562 and interface (or display interface) 572.

[0070] Interface 572 may be an interface for communicating with host processor 200. For example, interface 572 may be a Display Serial Interface (DSI) included in a Mobile Industrial Processor Interface (MIPI). However, the example embodiment is not limited to this, and interface 572 may be any interface implemented in various ways.

[0071] Display driver 550a can receive an initial image OIMG and can also receive second touch attribute information TA2 from host processor 200 via interface 572. Additionally or alternatively, display driver 550a can periodically or upon request from host processor 200 send or provide touch trajectory information TTRAJ to host processor 200 via interface 572. Additionally or alternatively, depending on the state of memory 560, display driver 550a can send or provide touch trajectory information TTRAJ to host processor 200 via interface 572. For example, when memory 560 is full, display driver 550a can send touch trajectory information TTRAJ to host processor 200, host processor 200 can generate a composite image reflecting the touch trajectory so far, and can send the composite image as a second initial image to display driver 550a, and display driver 550a can synthesize the second initial image and the subsequently formed additional touch trajectory. Therefore, handwriting continuity can be achieved without problems (e.g., in cases where a large amount of handwriting is continuously written across the entire screen without changing the operating mode).

[0072] Display controller 570 can control the overall operation of display driver 550a. Display controller 570 can directly receive touch coordinate information TCOOR and first touch attribute information TA1 from touchscreen controller 510a, and can generate touch trajectory information TTRAJ by accumulating the touch coordinate information TCOOR and the first touch attribute information TA1, and can send or provide the touch trajectory information TTRAJ to memory 560. In some example embodiments, when second touch attribute information TA2 is also received, display controller 570 can generate touch trajectory information TTRAJ by accumulating touch coordinate information TCOOR, first touch attribute information TA1, and second touch attribute information TA2. For example, the second touch attribute information TA2 may include at least one of a tool and a color defined for touch event TE.

[0073] Memory 560 can store touch trajectory information TTRAJ received from display controller 570. For example, the touch trajectory information TTRAJ can be provided and stored in the form of a table. Memory 560 can be referred to as a memory for storing touch trajectories. (See reference...) Figure 4A , Figure 4B , Figure 9A and Figure 9B Describe the configuration of TTRAJ for touch trajectory information in detail.

[0074] In some example embodiments, memory 560 may include at least one of various volatile memories such as dynamic random access memory (DRAM) and static random access memory (SRAM), and / or at least one of various non-volatile memories such as electrically erasable programmable read-only memory (EEPROM), flash memory, phase-change random access memory (PRAM), resistive random access memory (RRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), nanofloating gate memory (NFGM), and polymer random access memory (PoRAM). Alternatively, memory 560 may include any register, buffer, etc.

[0075] Image buffer 562 may store the initial image OIMG received from host processor 200. For example, image buffer 562 may store the entire or a portion of the image to be displayed in a compressed or uncompressed state. For example, image buffer 562 may include at least one frame buffer and / or line buffer, or may include SRAM, registers, etc. Image buffer 562 may be referred to as an image buffer for display. In some example embodiments, image buffer 562 may be omitted.

[0076] The image processor 580 can internally generate a touch image TIMG based on the touch trajectory information TTRAJ, and can generate a composite image CIMG by synthesizing the initial image OIMG and the touch image TIMG.

[0077] The image processor 580 may include a first processing unit 582, an image synthesizer 584, and a second processing unit 586.

[0078] The first processing unit 582 may be disposed in front of the image synthesizer 584 and may perform preprocessing on the initial image OIMG. The first processing unit 582 may be referred to as a preprocessing unit. For example, when the initial image OIMG is a compressed image, the first processing unit 582 may perform a decompression operation on the compressed image. For another example, when the initial image OIMG does not match the resolution of the display panel 450, the first processing unit 582 may perform an operation to adjust (e.g., enlarge / reduce) the resolution of the initial image OIMG. However, the example embodiment is not limited to this, and the first processing unit 582 may perform various other preprocessing operations.

[0079] Image synthesizer 584 can internally generate a touch image TIMG based on touch trajectory information TTRAJ. Image synthesizer 584 can also generate a composite image CIMG by synthesizing an initial image OIMG and the touch image TIMG. In some example embodiments, the operation of generating the touch image TIMG can be performed first, and then the operation of generating the composite image CIMG can be performed later. In other example embodiments, the operations of generating the touch image TIMG and generating the composite image CIMG can be performed substantially simultaneously or concurrently (or once). (See reference...) Figures 5A to 8 Describe in detail the operation of image synthesis.

[0080] The second processing unit 586 may be located at the back end of the image synthesizer 584 and may perform post-processing on the composite image CIMG. The second processing unit 586 may be referred to as a post-processing unit. For example, the second processing unit 586 may perform functions to enhance or supplement the analog characteristics of the display panel 450. For example, the second processing unit 586 may perform functions such as compensating for voltage drop (or IR drop), compensating for mura (or demura), compensating for the threshold voltage of the driving transistors in the pixels, etc. However, the example embodiment is not limited to this, and the second processing unit 586 may perform various other post-processing operations.

[0081] although Figure 2An image processor 580 is shown with two processing units 582 and 586 arranged at the front and rear ends of an image synthesizer 584, but the example embodiment is not limited thereto. According to the example embodiment, the number and arrangement of the processing units included in the image processor 580 can be varied.

[0082] The source driver 590 can generate multiple data voltages VD to be supplied to the display panel 450 based on the composite image CIMG. The composite image CIMG can be displayed on the display panel 450 based on the multiple data voltages VD.

[0083] Despite Figure 2 It is not shown in the figure, but the display driver 550a may also include a scan driver (or gate driver), gamma circuitry, etc.

[0084] Figure 3A , Figure 3B , Figure 3C and Figure 3D It is used to describe Figure 2 A diagram illustrating the operation of touch and display control devices, display devices, and electronic systems. (The diagram will be omitted.) Figure 1 Repeated description.

[0085] Reference Figure 3A When the initial image OIMG is displayed on the display panel 450, the touch and display control device can receive the initial image OIMG from the host processor 200. The display controller 570 can manage timing and can control commands for the components included in the display driver 550a to display the initial image OIMG.

[0086] When a touch event TE occurs during the display of the initial image OIMG, the display controller 570 can directly receive touch coordinate information TCOOR and first touch attribute information TA1 from the touchscreen controller 510a, and can receive second touch attribute information TA2 from the host processor 200. It can generate touch trajectory information TTRAJ based on the touch coordinate information TCOOR, the first touch attribute information TA1, and the second touch attribute information TA2, and can store the touch trajectory information TTRAJ in the memory 560. The image synthesizer 584 can generate a touch image TIMG, and can generate a composite image CIMG by synthesizing the initial image OIMG and the touch image TIMG. The display controller 570 can manage timing and control commands for the components included in the display driver 550a to display the composite image CIMG.

[0087] When a touch event TE occurs in the display device according to the example embodiment, the touch coordinate information TCOOR and the first touch attribute information TA1 may not be sent from the touchscreen controller 510a to the host processor 200. Therefore, the touch image TIMG may not be generated by the host processor 200, but may be generated internally and / or by the display driver 550a itself. However, the example embodiment is not limited to this. For example, in a normal operating mode that may differ from the operating mode of the example embodiment, the touch coordinates and touch attributes may be sent from the touchscreen controller to the host processor, and / or the operation of generating the touch image in the display driver may be performed simultaneously or in parallel with the operation of generating the touch image in the host processor.

[0088] Reference Figure 3B When the initial image OIMG is a still image (or a stopped image or a static image), the continuous transmission of the initial image OIMG from the host processor 200 to the display driver 550a can be omitted. Therefore, after the host processor 200 sends the initial image OIMG to the display driver 550a during the initial operation time, the host processor 200 can enter a power-down mode. Additionally or alternatively, the memory 600 that exchanges data with the host processor 200 can also enter a power-down mode. Figure 3B In the diagram, components with shaded lines can represent power-down modes.

[0089] Power-down mode can also be referred to as idle mode, sleep mode, power-saving mode, etc. Power-down mode can represent an operating mode in which the operation of the host processor 200 and memory 600 is stopped to reduce the power consumption of the host processor 200 and memory 600. In power-down mode, the display driver 550a can use the initial image OIMG stored in the image buffer 562 to display an image. In other words, in power-down mode, image processing can be performed using the display driver 550a. In some examples, the host processor 200 and memory 600 do not perform operations associated with image processing.

[0090] In this disclosure, the term "power-down mode" can refer to an operating mode that reduces power consumption for operations associated with image processing. When the electronic system 100a needs to perform operations other than image processing, the host processor 200 and memory 600 can be enabled or activated to perform the corresponding operations.

[0091] Reference Figure 3C and Figure 3DThe display driver 550a can send the touch trajectory information TTRAJ stored in the memory 560 to the host processor 200. The touch trajectory information TTRAJ sent to the host processor 200 can be sent to the memory 600 and stored there. The image displayed on the display panel 450 can be communicated to the host processor 200. Therefore, appropriate image processing can be performed so that the displayed image does not contradict or mismatch with the image generated by the host processor 200 based on the touch trajectory information TTRAJ and by reflecting complex graphic features.

[0092] In some example embodiments, such as Figure 3C As shown, the display driver 550a can send touch trajectory information TTRAJ to the host processor 200 without a request from the host processor 200. For example, the display driver 550a can send the touch trajectory information TTRAJ to the host processor 200 periodically, regularly, or depending on the state of the memory 560. For example, although in Figure 3C Not shown, but the display driver 550a may include a timer or counter for setting the time period or interval for sending touch trajectory information TTRAJ.

[0093] In other example embodiments, such as Figure 3D As shown, when a request REQ is received from the host processor 200, the display driver 550a can send touch trajectory information TTRAJ to the host processor 200. For example, when the operating mode of the electronic system 100a is changed or when the mode of the application executed by the electronic system 100a is changed, the host processor 200 can generate a request REQ, and the touch trajectory information TTRAJ can be sent from the memory 560 to the host processor 200.

[0094] The touch and display control device according to the example embodiment may include: a display controller 570 that generates touch trajectory information TTRAJ, a memory 560 that stores the touch trajectory information TTRAJ, and an image synthesizer 584 that generates touch image TIMG and composite image CIMG. Touch coordinate information TCOOR can be provided directly to the display controller 570 without going through the host processor 200. By using the touch trajectory information TTRAJ having touch coordinate information TCOOR and touch attribute information TA1 and TA2, touch image TIMG and composite image CIMG can be generated internally and / or by itself. Therefore, by eliminating the time for processing and generating images by the host processor 200, touch responsiveness can be significantly improved or enhanced. Additionally or alternatively, when reflecting the touch image TIMG without changing the initial image IMG, such as when writing on a note, image processing can be performed by the display driver 550a. Therefore, the power consumption of image processing, generation, synthesis, etc., performed through the display control path of the host processor 200 can also be reduced.

[0095] Figure 4A and Figure 4B This is a diagram used to describe the operation of generating and storing touch trajectory information in a touch and display control device according to an example embodiment.

[0096] Reference Figure 4A This illustrates an example of a first touch event TE1 occurring on the touchscreen panel 410. The first touch event TE1 could indicate that a first object has moved to the right.

[0097] Each position of the touch screen panel 410 can have coordinates. For example, the coordinates of the lower left corner of the touch screen panel 410 can be (0, 0), and the coordinates of the upper right corner of the touch screen panel 410 can be (1000, 1500).

[0098] Reference Figure 4B This shows that the memory 560 is stored and is related to Figure 4A The touch trajectory information TTRAJ corresponds to the first touch event TE1. The touch trajectory information TTRAJ can be generated by accumulating and storing the first touch attribute information TA1 and touch coordinate information TCOOR extracted from the touch coordinate calculator 530 over time (e.g., in chronological order), and by accumulating and storing the second touch attribute information TA2 received from the host processor 200 over time. For example, the chronological order can represent the order of image frames. For example, the touch coordinate information TCOOR can represent the coordinates of the X, Y, and Z axes.

[0099] In some example embodiments, the first touch attribute information TA1 may include the shape, size, orientation (or angle), and writing pressure associated with the first touch event TE1, and the second touch attribute information TA2 may include the tool and color defined for the first touch event TE1. For example, the first touch event TE1 may represent the action of drawing a line in black with a pencil using a 4×4 circular pointer. However, the example embodiments are not limited to this, and the touch attribute information TA1 and TA2 may also include more complex and varied functions, such as grayscale effects and shadow effects for colors.

[0100] Figure 5A , Figure 5B , Figure 5C , Figure 6 , Figure 7A , Figure 7B , Figure 7C and Figure 8 This diagram is used to describe the operations of generating touch images and composite images in a touch and display control device according to an example embodiment.

[0101] Reference Figure 5A , Figure 5B and Figure 5C This shows that for Figure 4A and Figure 4B An example of how the first touch event TE1 generates the first touch image TIMG1. Figure 5A , Figure 5B and Figure 5C In the example, a first touch image TIMG1 can be generated first, and then the first touch image TIMG1 and the first initial image can be synthesized later.

[0102] like Figure 5A As shown, the first pixel PX_T can be set based on the touch coordinate information TCOOR included in the touch trajectory information TTRAJ. For example, it can be selected from a blank image or screen (e.g., an image without any pixel values). Figure 4B The first pixel PX_T corresponding to the coordinates in the graph.

[0103] like Figure 5B As shown, the first target pixel PX_TGT associated with the first touch image TIMG1 can be set based on the touch coordinate information TCOOR and the first touch attribute information TA1 included in the touch trajectory information TTRAJ. Figure 5A Each first pixel PX_T in the image can represent a pixel corresponding to the touch coordinates. The shape, size, orientation, and writing pressure of the first touch event TE1 can be considered to generate the first touch image TIMG1. Therefore, it is possible to reflect the... Figure 4B The first target pixel PX_TGT is selected by using the first touch attribute information TA1 corresponding to the coordinates in the coordinates.

[0104] like Figure 5C As shown, a first touch image TIMG1 can be generated by setting the pixel data of the first target pixel PX_TGT based on the second touch attribute information TA2 included in the touch trajectory information TTRAJ. For example, the first touch event TE1 can represent the action of drawing a black line with a pencil. Therefore, it can be generated by reflecting the action of drawing a black line with a pencil. Figure 4B The first touch image TIMG1 is obtained by using the second touch attribute information TA2 corresponding to the coordinates in the image.

[0105] In other words, when generating the first touch image TIMG1, the range of pixels to be transformed can first be set based on the touch coordinates. For example, the number of pixels to be changed in the left, right, up, and down directions starting from the touch coordinates can be determined based on the thickness and shape of the handwriting. Then, the pixel data can be set by determining which state of the pixel to change. For example, the most important feature could be a color-related attribute, and the pixel data of the corresponding pixel can be set based on the grayscale information of the corresponding color.

[0106] After generating the first touch image TIMG1 as described above, the image synthesizer 584 can generate a first composite image by synthesizing the first touch image TIMG1 and the first initial image. For example, the first touch image TIMG1 can be temporarily stored in a memory that is different from and separate from the image buffer 562. The image synthesizer 584 can then synthesize the first touch image TIMG1 with the first initial image.

[0107] Reference Figure 6 The generation is shown Figure 2 An example of a composite image CIMG. (Compared to...) Figure 5A , Figure 5B and Figure 5C Similar to the example, in Figure 6 In the example, a touch image TIMG corresponding to the touch event TE can be generated first, and then a composite image CIMG can be generated by compositing the touch image TIMG and the initial image OIMG. In other words, Figure 6 The operations of generating a touch image, storing the touch image in a separate memory, and combining the touch image with an initial image are shown.

[0108] Reference Figure 7A , Figure 7B and Figure 7C This shows that for Figure 4A and Figure 4B Another example of how the first touch event TE1 generates the first touch image TIMG1. Figure 7A , Figure 7B and Figure 7CIn the example, the operation of generating the first touch image TIMG1 and the operation of generating the first composite image CIMG1 by synthesizing the first touch image TIMG1 and the first initial image OIMG1 can be performed substantially simultaneously.

[0109] like Figure 7A As shown, the first pixel PX_T can be set in the first initial image OIMG1 based on the touch coordinate information TCOOR included in the touch trajectory information TTRAJ. Next, as... Figure 7B As shown, the first target pixel PX_TGT associated with the first touch image TIMG1 can be set in the first initial image OIMG1 based on the touch coordinate information TCOOR and the first touch attribute information TA1 included in the touch trajectory information TTRAJ. Next, as... Figure 7C As shown, the first composite image CIMG1 can be generated by changing or setting the pixel data of the first target pixel PX_TGT in the first initial image OIMG1, based on the second touch attribute information TA2 included in the touch trajectory information TTRAJ.

[0110] Unlike Figure 5A , Figure 5B and Figure 5C In the example where the image synthesizer 584 first generates a first touch image TIMG1, and then synthesizes the first touch image TIMG1 and the first initial image OIMG1, in Figure 7A , Figure 7B and Figure 7C In this process, the image synthesizer 584 can modify some pixel data of the first initial image OIMG1 that has passed through the image buffer 562 and the first processing unit 582. Therefore, in Figure 7A , Figure 7B and Figure 7C In the example, the operations of generating the touch image and compositing the image can be performed essentially simultaneously or at one time.

[0111] Reference Figure 8 The generation is shown Figure 2 Another example of a composite image CIMG. (Compared to...) Figure 7A , Figure 7B and Figure 7C Similar to the example, in Figure 8 In the example, image synthesizer 584 can generate composite image CIMG by modifying the pixel data in the initial image OIMG corresponding to the touch event TE. In other words, Figure 8 This illustrates the operation of simultaneously generating a touch image and modifying the pixel data of the initial image passed through image buffer 562 and the first processing unit. The signal corresponding to the composite image is then output to the source driver 590.

[0112] In some example embodiments, reference is made to Figure 5A , Figure 5B , Figure 5C , Figure 6 , Figure 7A , Figure 7B , Figure 7C and Figure 8 The operations described for generating touch images and compositing images can be performed by image synthesizer 584. For example, image synthesizer 584 can transform the grayscale information of each pixel in the initial image (or base image) by reflecting the touch trajectory and attributes. Attributes or characteristics of the images to be merged (e.g., writing tools such as brush, pen, pencil, eraser, image size, color, shadow effects, etc.) can be provided and stored in advance. When the application wants to change the attributes of the corresponding function, the attributes can be received and stored again. Additionally or alternatively, image synthesizer 584 can have specific functions for generating various image characteristics. For example, image synthesizer 584 can have functions to form a handwriting thickness of about 2 to 3 pixels around the touch coordinates, functions to add grayscale, and other more complex functions.

[0113] The operation of generating a composite image (CIMG) is not limited to the examples described above and can be modified according to the example embodiments. For example, when the image buffer 562 has uncompressed data, the operation of generating a composite image (CIMG) can be implemented by directly storing the touch image into the image buffer 562. In another example, the operation of generating a composite image (CIMG) can be implemented by additionally arranging a second image buffer at the rear end of the second processing unit 586, storing the composite image (CIMG) in the second image buffer, and outputting a signal corresponding to the composite image (CIMG) to the source driver 590 based on the second image buffer.

[0114] Figure 9A and Figure 9B This is a diagram illustrating the operations of generating and storing touch trajectory information in a touch and display control device according to an example embodiment. (The symbols and symbols are omitted.) Figure 4A and Figure 4B Repeated description.

[0115] Reference Figure 9A This illustrates an example of a multi-touch scenario (or environment) where multiple touch events TE1, TE2, and TE3 occur on the touchscreen panel 410. The first touch event TE1 can be associated with... Figure 4A The first touch event TE1 is basically the same. The second touch event TE2 can indicate that the second object moves diagonally to the upper right. The third touch event TE3 can indicate that the third object moves to the left.

[0116] In some examples, a multi-touch event can be interpreted as a single event (e.g., when two fingers pinch at different points on the screen). Alternatively, a multi-touch event can represent independent events (e.g., drawing with two different brushes at the same time or using a brush and eraser tool simultaneously).

[0117] Reference Figure 9B It shows that the memory 560 is stored and connected with Figure 9A The multiple touch events TE1, TE2, and TE3 in the text correspond to multiple touch trajectory information TTRAJ. For example... Figure 9B As shown, a touch trajectory table including multiple touch trajectory information TTRAJ can be generated by accumulating and storing the touch coordinate information TCOOR, the first touch attribute information TA1, and the second touch attribute information TA2 of each touch event in multiple touch events TE1, TE2, and TE3. Figure 9B In the touch trajectory table, touch identifiers (IDs) can be assigned or distributed according to the order of touch events. For example, touch ID 1 can be assigned to the first touch event TE1 that occurs first.

[0118] For example, the second touch event TE2 can represent the action of using a 4×6 oval pointer to draw a red line with a brush. For example, the third touch event TE3 can represent the action of using a 15×15 circular pointer to erase the line with an eraser.

[0119] Figure 10 , Figure 11 and Figure 12 It is shown Figure 1 Figures showing other examples of touch and display control devices, display devices, and electronic systems. (The remaining text will be omitted.) Figure 2 Repeated description.

[0120] Reference Figure 10 The electronic system 100b includes a host processor 200, a display device, and a memory 600. The display device includes: a panel, including a touch screen panel 410 and a display panel 450; and a touch and display control device, having a touch screen controller 510a and a display driver 550b.

[0121] Display driver 550b may include memory 560, display controller 570, image processor 580, and source driver 590. Display driver 550b may also include image buffer 562, image generator 564, pixel-based trajectory table 566, and interface 572.

[0122] Apart from the configuration changes of the display driver 550b, Figure 10 Electronic system 100b can be connected with Figure 2The electronic system 100a is basically the same. Except for the display driver 550b, it also includes an image generator 564 and a pixel-based trajectory table 566. Figure 10 The display driver 550b in the middle can be used with Figure 2 The display driver in the 550a is basically the same.

[0123] The pixel-based trajectory table 566 can be implemented in a form that stores the grayscale information of pixels to be displayed in the touch area based on trajectory coordinates. For example, it can be implemented as follows: Figure 9B The implementation shown is a pixel-based trajectory table 566. The image generator 564 can perform at least a portion of the image generation operations performed by the image processor 580. In other words, Figure 10 An example is shown in which a block or intellectual property (IP) core that performs some operations or functions of the image processor 580 is arranged outside the image processor 580.

[0124] Reference Figure 11 The electronic system 100c includes a host processor 200, a display device, and a memory 600. The display device includes: a panel, including a touch screen panel 410 and a display panel 450; and touch and display control devices, including a touch screen controller 510c and a display driver 550c.

[0125] Figure 11 An example is shown in which the touchscreen controller 510c and the display driver 550c are formed from separate chips. In other words, apart from the touchscreen controller 510c and the display driver 550c being divided into separate chips, Figure 11 Electronic system 100c can be with Figure 2 The electronic system is basically the same as that of the 100a.

[0126] In some example embodiments, the interface used to transmit touch coordinate information TCOOR and first touch attribute information TA1 from the touchscreen controller 510c to the display driver 550c may be a relatively low-speed interface. The speed of the interface to the display driver 550c may be lower compared to the transmission path within the touchscreen controller 510c. In some embodiments, this interface may be an inter-integrated circuit (I2C) interface or a serial peripheral interface (SPI). However, the example embodiments are not limited to these, and the interface may be any interface implemented in various ways.

[0127] Reference Figure 12 The electronic system 100d includes a host processor 200, a display device, and a memory 600. The display device includes: a panel, including a touch screen panel 410 and a display panel 450; and touch and display control devices, including a touch screen controller 510d and a display driver 550d.

[0128] Figure 12 An example is shown where a portion of the touchscreen controller 510d and a portion of the display driver 550d are formed from one chip, and another portion of the touchscreen controller 510d and another portion of the display driver 550d are formed from another chip. In other words, apart from the touchscreen controller 510d and the display driver 550d being implemented from two separate chips, Figure 12 The electronic system 100d can be connected with Figure 2 The electronic system is basically the same as that of the 100a.

[0129] In some example embodiments, the readout circuitry 520 and the source driver 590 may be formed from a single chip, and as components other than the readout circuitry 520 and the source driver 590, the touch coordinate calculator 530, memory 560, image buffer 562, display controller 570, interface 572, and image processor 580 may be formed from additional single chips. The readout circuitry 520 and the source driver 590 may correspond to analog circuitry, and the touch coordinate calculator 530, memory 560, image buffer 562, display controller 570, interface 572, and image processor 580 may correspond to digital circuitry. Therefore, analog circuitry can be implemented with one chip, while digital circuitry can be implemented with another chip. Alternatively, the readout circuitry 520 and the source driver 590 may be manufactured separately and may be formed from separate chips.

[0130] exist Figure 11 and Figure 12 In the example, the host processor 200 can directly receive touch-related information from the touchscreen controllers 510c and 510d, and receive touch trajectory information TTRAJ from the display drivers 550c and 550d. For example, as Figure 11 As shown, the host processor 200 can generate a coordinate request signal REQC, and the touchscreen controller 510c can send touch coordinate information TCOOR and first touch attribute information TA1 to the host processor 200 based on the coordinate request signal REQC. For another example, such as... Figure 12 As shown, the host processor 200 can generate a raw data request signal REQR, and the touchscreen controller 510d can send raw touch data TRDAT to the host processor 200 based on the raw data request signal REQR. However, even in these cases, according to the example embodiment, the touch image TIMG and composite image CIMG can also be generated and processed internally and / or by themselves.

[0131] In some example embodiments, although in Figure 11 and Figure 12 Not shown in the image, but Figure 11 and Figure 12The display drivers 550c and 550d may also include references Figure 10 The image generator 564 and the pixel-based trajectory table 566 are mentioned.

[0132] The various example embodiments described above may be implemented by hardware components, software components, or combinations of hardware and software components. Examples of hardware components that can be used to perform the operations described in this disclosure include controllers, sensors, generators, drivers, memories, comparators, arithmetic logic units, adders, subtractors, multipliers, dividers, integrators, and any other electronic components configured to perform the operations described in this disclosure. In other examples, one or more hardware components performing the operations described in this disclosure are implemented by computing hardware, such as one or more processors or computers. A processor or computer may be implemented by one or more processing elements, such as logic gate arrays, controllers and arithmetic logic units, digital signal processors, microcomputers, programmable logic controllers, field-programmable gate arrays, programmable logic arrays, microprocessors, or any other device or combination of devices configured to respond to and execute instructions in a defined manner to achieve a desired result. In one example, a processor or computer includes or is connected to one or more memories storing instructions or software that can be executed by the processor or computer. Hardware components implemented by a processor or computer may execute instructions or software (such as an operating system (OS) and one or more software applications running on the OS) to perform the operations described in this disclosure. In response to the execution of instructions or software, hardware components can also access, operate, process, create, and store data. For simplicity, the singular terms "processor" or "computer" may be used in the description of the examples described in this disclosure, but in other examples multiple processors or computers may be used, or a processor or computer may include multiple processing elements or multiple types of processing elements or both. For example, a single hardware component or two or more hardware components may be implemented by a single processor or two or more processors or a processor and a controller. One or more hardware components may be implemented by one or more processors, or a processor and a controller, and one or more other hardware components may be implemented by one or more other processors, or another processor and another controller. One or more processors, or a processor and a controller, may implement a single hardware component, or two or more hardware components.

[0133] Figure 13 This is a flowchart illustrating a method of operating a display device according to an example embodiment.

[0134] Reference Figure 13The display device according to an example embodiment includes a touchscreen panel, a display panel, and a touch and display control device. The touch and display control device includes a touchscreen controller and a display driver. The configuration and operation of the display device can be compared with those in the reference... Figures 1 to 12 The descriptions are basically the same.

[0135] In the operation method of the display device according to the example embodiment, the touch screen controller extracts touch coordinate information and touch attribute information by detecting touch events on the touch screen panel (step S100). (Refer to...) Figure 14 Describe step S100.

[0136] The display driver generates and stores touch trajectory information by accumulating touch attribute information and touch coordinate information received without going through the host processor. Based on the touch trajectory information, it internally generates a touch image to be displayed together with the initial image, and generates and displays a composite image by compositing the initial image and the touch image (step S200). (Refer to...) Figures 15 to 17 Describe step S200.

[0137] Figure 14 It is shown Figure 13 A flowchart of an example of step S100.

[0138] Reference Figure 13 and Figure 14 When touch coordinate information and touch attribute information are extracted through the touch screen controller (step S100), touch sensing signals can be received from the touch screen panel (step S110). Raw touch data can be generated based on the touch sensing signals (step S120). For example, steps S110 and S120 can be accomplished by a readout circuit included in the touch screen controller (e.g., ...). Figure 2 The readout circuit 520 in the middle is executed.

[0139] Touch coordinate information and first touch attribute information can be extracted based on the raw touch data (step S130). For example, step S130 can be performed by a touch coordinate calculator included in the touchscreen controller (e.g., Figure 2 The Touch Coordinates Calculator 530 is executed.

[0140] Figure 15 It is shown Figure 13 The flowchart is an example of step S200.

[0141] Reference Figure 13 and Figure 15When the display driver generates and stores touch trajectory information, generates a touch image internally, and generates and displays a composite image (step S200), the touch coordinate information and the first touch attribute information can be received directly from the touchscreen controller without going through the host processor (step S210). An initial image can be received from the host processor (step S220). Touch trajectory information can be generated by accumulating the touch coordinate information and the first touch attribute information (step S230). For example, steps S210, S220, and S230 can be performed by a display controller included in the display driver (e.g., ...). Figure 2 The display controller 570 in the middle is executed.

[0142] In some example embodiments, in step S220, second touch attribute information may also be received from the host processor. In step S230, touch trajectory information may be generated by accumulating touch coordinate information, first touch attribute information, and second touch attribute information.

[0143] Touch trajectory information can be stored in internal memory (step S240). For example, step S240 can be performed by memory included in the display driver (e.g., ...). Figure 2 The memory in the 560) is used for execution.

[0144] A touch image to be displayed together with the initial image can be generated internally based on touch trajectory information (step S250). A composite image can be generated by combining the initial image and the touch image (step S260). The display panel can be controlled to display the composite image (step S270). For example, steps S250 and S260 can be performed by an image compositer included in the display driver (e.g., ...). Figure 2 The image compositer 584 in the display driver is used for execution, and step S270 can be performed by the source driver included in the display driver (e.g., Figure 2 The source driver 590 in the middle is executed.

[0145] Figure 16 It is shown Figure 15 The flowchart for an example of step S250 in the example. Figure 16 An example is shown in which the operation of generating a composite image is performed after the operation of generating a touch image internally is performed.

[0146] Reference Figure 15 and Figure 16 When generating a touch image internally (step S250), a target pixel associated with the touch image can be set (step S252). The touch image can be generated by setting the pixel data of the target pixel (step S254). Thereafter, a composite image can be generated by compositing the initial image and the touch image. Figure 16 The example can correspond to the reference Figure 5A , Figure 5B , Figure 5C and Figure 6 The described operation.

[0147] Figure 17 It is shown Figure 15 The flowchart shows an example of steps S250 and S260. Figure 17 An example is shown that essentially the operations of generating a touch image internally and generating a composite image are performed simultaneously.

[0148] Reference Figure 15 and Figure 17 When generating a touch image internally (step S250), target pixels associated with the touch image can be set in the initial image (step S253). When generating a composite image (step S260), the composite image can be generated by changing the pixel data of the target pixels in the initial image (step S262). Figure 17 The example can correspond to the reference Figure 7A , Figure 7B , Figure 7C and Figure 8 The described operation.

[0149] As those skilled in the art will recognize, the inventive concept can be embodied as a system, method, computer program product, and / or a computer program product embodied in one or more computer-readable media, on which computer-readable program code is implemented. The computer-readable program code can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be any tangible medium that can contain or store a program used by or associated with an instruction execution system, apparatus, or device. For example, a computer-readable medium can be a non-transitory computer-readable medium.

[0150] Figure 18 This is a block diagram illustrating an electronic system according to an example embodiment.

[0151] Reference Figure 18 The electronic system 1000 may include a processor 1010, a storage device 1020, a connection device 1030, an input / output (I / O) device 1040, a power supply 1050, and a display device 1060. The electronic system 1000 may also include multiple ports for communicating with video cards, sound cards, memory cards, universal serial bus (USB) devices, and other electronic devices.

[0152] Processor 1010 controls the operation of electronic system 1000. Processor 1010 can execute an operating system and at least one application to provide an internet browser, games, videos, etc. Storage device 1020 can store data used for the operation of electronic system 1000. Connection device 1030 can communicate with external systems (not shown) using wired and / or wireless communication. I / O device 1040 can include input devices such as a keyboard, keypad, mouse, remote control, etc., and output devices such as a printer, speaker, etc. Power supply 1050 can provide power for the operation of electronic system 1000.

[0153] Display device 1060 may be a display device according to an example embodiment. According to the example embodiment, display device 1060 may include a touchscreen panel, a display panel, and a touch and display control device. Processor 1010, display device 1060, and storage device 1020 may respectively correspond to... Figure 1 The host processor 200, display device 300, and memory 600 are included.

[0154] This invention can be applied to a variety of devices and systems, including display devices with touchscreen panels. For example, it can be applied to systems such as: personal computers (PCs), server computers, data centers, workstations, mobile phones, smartphones, tablets, laptops, personal digital assistants (PDAs), portable multimedia players (PMPs), digital cameras, portable game consoles, music players, camcorders, video players, navigation devices, wearable devices, Internet of Things (IoT) devices, Internet of Everything (IoE) devices, e-book readers, virtual reality (VR) devices, augmented reality (AR) devices, robotic devices, drones, etc.

[0155] The foregoing is illustrative of exemplary embodiments and should not be construed as limiting them. Although some exemplary embodiments have been described, those skilled in the art will readily understand that various modifications may be made to the exemplary embodiments without substantially departing from the novel doctrine and advantages of the exemplary embodiments. Therefore, all such modifications are intended to be included within the scope of the exemplary embodiments as defined in the claims. Accordingly, it should be understood that the foregoing is illustrative of various exemplary embodiments and should not be construed as limiting to the specific exemplary embodiments disclosed, and modifications to the disclosed exemplary embodiments and other exemplary embodiments are intended to be included within the scope of the appended claims.

Claims

1. A touch and display control device, comprising: A touchscreen controller is configured to receive touch sensing signals from a touchscreen panel, generate raw touch data based on the touch sensing signals, and extract touch coordinate information and first touch attribute information based on the raw touch data. as well as A display driver is configured to receive an initial image from a host processor, receive touch coordinate information and first touch attribute information directly from the touchscreen controller, generate touch trajectory information by accumulating the touch coordinate information and the first touch attribute information, send the generated touch trajectory information to the host processor, internally generate a touch image to be displayed together with the initial image based on the touch trajectory information, generate a composite image by combining the initial image and the touch image, and control the display panel to display the composite image. The display driver includes a memory for storing the touch trajectory information. Specifically, the touch coordinate information and the first touch attribute information are not sent from the touchscreen controller to the host processor.

2. The touch and display control device according to claim 1, wherein: The touch image is generated by the display driver, not the host processor.

3. The touch and display control device according to claim 1, wherein, When the initial image is a still image, the host processor enters a power-down mode after sending the initial image to the display driver.

4. The touch and display control device according to claim 3, wherein, The display driver also includes: An image buffer is configured to store the initial image.

5. The touch and display control device according to claim 1, wherein, The display driver is also configured to periodically send the touch trajectory information stored in the memory to the host processor.

6. The touch and display control device according to claim 1, wherein, The display driver is also configured to send the touch trajectory information stored in the memory to the host processor when a request is received from the host processor or depending on the state of the memory.

7. The touch and display control device according to claim 1, wherein, The display driver is also configured to: The host processor receives second touch attribute information that is different from the first touch attribute information, and The touch trajectory information is generated by accumulating the touch coordinate information, the first touch attribute information, and the second touch attribute information.

8. The touch and display control device according to claim 7, wherein: The first touch attribute information includes at least one of shape, size, orientation, and writing pressure associated with a touch event corresponding to the touch sensing signal, and The second touch attribute information includes at least one of a tool and a color defined for the touch event.

9. The touch and display control device according to claim 7, wherein, The display driver is also configured to: Based on the touch trajectory information, target pixels associated with the touch image are set, and The touch image is generated by setting the pixel data of the target pixel based on the second touch attribute information.

10. The touch and display control device according to claim 7, wherein, The display driver is also configured to: Based on the touch trajectory information, the target pixels in the initial image associated with the touch image are set, and The composite image is generated by changing the pixel data of the target pixel in the initial image based on the second touch attribute information, wherein the operation of generating the touch image internally and the operation of generating the composite image are performed simultaneously.

11. The touch and display control device according to claim 7, wherein, The display driver is further configured to generate a touch trajectory table including multiple touch trajectory information by accumulating the touch coordinate information, first touch attribute information and second touch attribute of each of the multiple touch events when multiple touch events occur simultaneously.

12. The touch and display control device according to claim 1, wherein, The touchscreen controller includes: The readout circuit is configured to generate the raw touch data based on the touch sensing signal; and The touch coordinate calculator is configured to extract the touch coordinate information and the first touch attribute information based on the raw touch data.

13. The touch and display control device according to claim 12, wherein, The display driver also includes: The display controller is configured to generate the touch trajectory information by accumulating the touch coordinate information and the first touch attribute information, and to provide the touch trajectory information to the memory; An image processor is configured to internally generate the touch image based on the touch trajectory information, and to generate the composite image by synthesizing the initial image and the touch image; and The source driver is configured to generate multiple data voltages to be supplied to the display panel based on the composite image.

14. The touch and display control device according to claim 13, wherein: The readout circuit and the source driver are formed from a single chip, and The touch coordinate calculator, the display controller, and the image processor are formed from another chip.

15. The touch and display control device according to claim 1, wherein, The touchscreen controller and the display driver are formed from a single chip.

16. The touch and display control device according to claim 1, wherein, The touchscreen controller and the display driver are formed from separate chips.

17. A method of operating a display device, the method comprising: The display driver receives the initial image from the host processor; The touchscreen controller extracts touch coordinate information and first touch attribute information by detecting touch events on the touchscreen panel; The display driver receives the touch coordinate information and the first touch attribute information directly from the touch screen controller, without going through the host processor; The display driver generates touch trajectory information by accumulating the touch coordinate information and the first touch attribute information; The touch trajectory information is stored in the internal memory by the display driver; The display driver sends the generated touch trajectory information to the host processor; The display driver internally generates a touch image to be displayed along with the initial image based on the touch trajectory information; The display driver generates a composite image by combining the initial image and the touch image; as well as The display driver controls the display panel to display the composite image. Specifically, the touch coordinate information and the first touch attribute information are not sent from the touchscreen controller to the host processor.

18. The method of claim 17, wherein: After performing the operation of generating the touch image internally, the operation of generating the composite image is performed, and Generating the touch image internally includes: Set the target pixel associated with the touch image; and The touch image is generated by setting the pixel data of the target pixel.

19. The method of claim 17, wherein: Simultaneously, the operations of generating the touch image internally and generating the composite image are performed, and Generating the touch image and generating the composite image internally includes: Set the target pixel in the initial image associated with the touch image; and The composite image is generated by changing the pixel data of the target pixels in the initial image.

20. An electronic system comprising: Display devices, and A host processor is configured to control the display device; and The display device includes: The touchscreen panel is configured to detect touch events; A display panel is configured to display an initial image and a touch image corresponding to the touch event; and A touch and display control device is configured to control the operation of the touch screen panel and the display panel. The touch and display control device includes: The readout circuit is configured to receive a touch sensing signal corresponding to the touch event from the touch screen panel, and generate raw touch data based on the touch sensing signal; A touch coordinate calculator is configured to extract touch coordinate information and first touch attribute information based on the raw touch data; The display controller is configured to receive the touch coordinate information and the first touch attribute information directly from the touch coordinate calculator without going through the host processor, receive the initial image and the second touch attribute information from the host processor, and generate touch trajectory information by accumulating the touch coordinate information, the first touch attribute information and the second touch attribute information; The memory is configured to store the touch trajectory information; An image buffer is configured to store the initial image; An image processor is configured to internally generate a touch image to be displayed together with the initial image based on the touch trajectory information, and to generate a composite image by synthesizing the initial image and the touch image; and The source driver is configured to generate multiple data voltages supplied to the display panel based on the composite image. Specifically, the touch coordinate information and the first touch attribute information are not sent from the touch coordinate calculator to the host processor. The touch image is not generated by the host processor, but by the touch and display control device. Specifically, when the initial image is a still image, after the host processor sends the initial image to the touch and display control device, the host processor enters a power-down mode, and The touch and display control device is configured to periodically send the touch trajectory information stored in the memory to the host processor, or depending on the state of the memory, or when a request is received from the host processor.

Images