Integrated circuit

Abstract

To allow a touch IC to detect a pen on the basis of control from an external processor.SOLUTION: An integrated circuit executes pen detection to detect a pen signal transmitted from a pen on the basis of electrical charges induced in a sensor electrode group. The integrated circuit is configured to: transmit pen data including information indicating a state of the pen detected by the pen detection to an external processor; receive, from the external processor, pen control data including control content of various pen-detection parameters to be used by the integrated circuit for the pen detection, the pen control data being generated by the external processor on the basis of the pen data; and control the various pen-detection parameters on the basis of the control content included in the pen control data received from the external processor.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a method implemented in a system that includes a touch IC and an external processor. [Background technology]

[0002] In a position detection system that detects the position of a finger or electronic pen on a touch surface, the position detection process is usually performed by a touch IC. However, in recent years, there has been a demand for position detection processes including complex processes such as gesture recognition, and it is becoming difficult for touch ICs with simple configurations that have few computer resources such as memory capacity and processor processing power to handle this demand. Therefore, studies have begun on systems that add an external processor (an integrated circuit different from the touch IC, such as a CPU, GPU, DSP, or AI processor) and have the external processor take over the position detection process that was previously performed by the touch IC. This type of system makes it possible to use the abundant computer resources of the external processor to perform advanced processes such as gesture recognition based on frame data (detection data for one touch surface) acquired by the touch IC.

[0003] Patent Documents 1 and 2 disclose examples of such a system. Specifically, Fig. 3 of Patent Document 1 discloses a system in which frame data is supplied from a touch IC (304) to an external processor, a GPU (308), and the touch position is calculated by the GPU (308). Fig. 1 of Patent Document 2 discloses a system having a touch data communication interface in which the touch IC is on the source side and the external processor, a DSP, is on the sink side. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] US Patent Application Publication No. 2017 / 0255320 [Patent Document 2] US Patent Application Publication No. 2016 / 0170548 Summary of the Invention [Problem to be solved by the invention]

[0005] However, in the systems described in Patent Documents 1 and 2, the results of processing by the external processor are not returned to the touch IC. This means that the results of processing by the external processor cannot be used for touch detection or pen detection operations by the touch IC, and therefore improvement is required.

[0006] In addition, data such as position and pen pressure detected by the touch IC is sent to the downstream host processor, where it is used to generate ink data, but when an external processor is added, the host processor must obtain some of the data that it previously obtained in bulk from the touch IC from the external processor. This affects the implementation of the host processor, so there is a need to make it possible to add an external processor without changing the implementation of the host processor. [Means for solving the problem]

[0007] A method according to a first aspect of the present invention is a method executed in a system including a touch IC that performs touch detection and an external processor different from the touch IC, the system further including a sensor electrode group connected to the touch IC and a first bus connecting the touch IC and the external processor, the touch IC generates frame data indicating a detection level for each two-dimensional position of the sensor electrode group and supplies the frame data to the external processor via the first bus, the external processor returns judgment data to the touch IC, which is the result of performing a predetermined processing based on the frame data, and the touch IC performs an operation based on the judgment data.

[0008] A method according to a second aspect of the present invention is a method according to the first aspect, wherein the external processor returns the judgment data to the touch IC via the first bus, the external processor is an AI coprocessor for assisting the touch IC, the system further includes a second bus connecting the touch IC and a host processor, and the touch IC reports touch coordinates included in the judgment data to the host processor via the second bus. Effect of the Invention

[0009] According to the first aspect of the present invention, the determination data resulting from the processing by the external processor is returned from the external processor to the touch IC, so that the touch IC can utilize the results of the processing by the external processor.

[0010] According to the second aspect of the present invention, since the touch coordinates derived by the AI ​​coprocessor are supplied to the host processor via the touch IC, it becomes possible to add an external processor without changing the implementation of the host processor. [Brief description of the drawings]

[0011] [Figure 1] 1 is a diagram showing a configuration of a system 1 according to a first embodiment of the present invention. [Diagram 2] 2 is a process flow diagram showing details of touch detection performed by the touch detection unit 32 shown in FIG. 1. [Diagram 3] 2 is a process flow diagram showing details of pen detection performed by pen detection unit 33 shown in FIG. 1. [Figure 4] 1A is a diagram illustrating the palm area derivation process performed by the touch IC compatible firmware 51 shown in FIG. 1, and FIG. 1B is a diagram illustrating an example of determining a user's dominant hand by the touch IC compatible firmware 51. [Diagram 5] 2 is a sequence diagram showing the operation of the system 1 shown in FIG. [Figure 6]6 is a process flow diagram showing details of the determination process performed in step S3 shown in FIG. 5. [Figure 7] 6 is a process flow diagram showing details of a part related to touch detection among the processes based on the determination data performed in step S4 shown in FIG. 5. FIG. [Figure 8] 6 is a process flow diagram showing details of a portion relating to pen detection among the processes based on the determination data performed in step S4 shown in FIG. 5. FIG. [Figure 9] FIG. 2 is a diagram showing a configuration of a system 1 according to a second embodiment of the present invention. [Figure 10] 10 is a sequence diagram showing the operation of the system 1 shown in FIG. [Figure 11] 11 is a process flow diagram showing details of the determination process performed in step S3a shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

[0013] 1 is a diagram showing the configuration of a system 1 according to a first embodiment of the present invention. As shown in the figure, the system 1 includes a sensor electrode group 2, a touch IC 3, a dedicated bus 4a (first bus), a peripheral device bus 4b (second bus), bus interfaces 40 and 41, a memory 42, a host processor 5, and an internal bus 6.

[0014] The sensor electrode group 2 is a plurality of sensor electrodes arranged directly under the touch surface. For example, when the system 1 is a tablet terminal, the sensor electrode group 2 is arranged directly under the display surface which is the touch surface. The plurality of sensor electrodes constituting the sensor electrode group 2 include a plurality of X electrodes 2x each extending in the y direction shown in the figure and arranged at equal intervals in the x direction (direction perpendicular to the y direction), and a plurality of Y electrodes 2y each extending in the x direction shown in the figure and arranged at equal intervals in the y direction.

[0015] The touch IC 3 is an integrated circuit configured to be able to execute firmware 31, and is connected to each sensor electrode constituting the sensor electrode group 2. The firmware 31 is configured to realize a touch detection unit 32 that performs an operation of detecting a finger 8 shown in the figure (hereinafter referred to as "touch detection"), and a pen detection unit 33 that performs an operation of detecting an electronic pen 7 shown in the figure by detecting a pen signal based on an electric charge induced in the sensor electrode group 2 (hereinafter referred to as "pen detection").

[0016] 2 is a process flow diagram showing details of touch detection performed by the touch detection unit 32. As shown in the figure, the touch detection unit 32 first transmits a touch detection signal to each X electrode 2x (step S10), and then receives the touch detection signal at each Y electrode 2y (step S11). Then, based on the reception result, a heat map showing the detection level for each two-dimensional position of the sensor electrode group 2 is created (step S12).

[0017] The processes of steps S1 to S3 will be described in more detail. The touch detection signal is a signal consisting of a train of K pulses, each of which includes K pulses (data of "1" or "-1"). Here, K is the number of X electrodes 2x. Moreover, the contents of the train of K pulses (i.e., combinations of K pulses) are all different.

[0018] The touch detection unit 32 inputs the K pulse trains one by one in parallel to each X electrode 2x (step S10). Then, each time the pulses are input, the value of the current flowing out from each Y electrode 2y is acquired (step S11). The current value thus acquired is the inner product of the K pulses constituting the input pulse train and the K capacitances formed at the intersections of the Y electrode 2y and each X electrode 2x.

[0019] Through the above process, the touch detection unit 32 acquires K current values ​​for each Y electrode 2y. For each of the K pulse trains, the touch detection unit 32 calculates the inner product of the K pulses constituting the pulse train and the acquired K current values ​​to calculate the detection level for each two-dimensional position of the sensor electrode group 2 (i.e., each intersection of each X electrode 2x and each Y electrode 2y) (step S12). In this way, the above-mentioned heat map is completed.

[0020] After generating the heat map, the touch detection unit 32 generates frame data including the generated heat map and transmits the frame data to the host processor 5 (step S13).

[0021] The touch detection unit 32 also performs a process of deriving a touch area, which is an area touched by the finger 8, and a palm area, which is an area touched by the palm or fist of the user, not by the finger 8, based on the generated heat map (step S14). Specifically, first, an area with a capacitance larger than a predetermined threshold is determined, and if the area of ​​the area is equal to or smaller than the predetermined threshold, it is determined to be a touch area, and if not, it is determined to be a palm area. A series of processes up to this point completes one touch detection operation. The touch detection unit 32 may also transmit the touch area and palm area acquired in step S14 to the host processor 5.

[0022] Here, the above-mentioned threshold values ​​used by the touch detection unit 32 to acquire the touch area and the palm area constitute a part of various parameters for touch detection used by the touch detection unit 32 to perform touch detection. The various parameters for touch detection may also include a parameter serving as a criterion for labeling (a process for recognizing adjacent touch areas as the same area) (for example, n in the case of setting a criterion that adjacent touch areas in n directions out of a total of eight directions, i.e., two vertical directions, two horizontal directions, and four diagonal directions, are regarded as one touch area), a parameter for controlling the contents of the touch detection signal, a parameter for controlling the area to be targeted for touch detection, a parameter for controlling one or more sensor electrodes to be used in touch detection among the sensor electrode group 2, a parameter for determining a tracking target in the case of multi-touch, a parameter for controlling a method for determining the palm area, a parameter for controlling the contents of data to be transmitted from the touch detection unit 32 to the host processor 5, a parameter for controlling a method for driving the sensor electrode group 2 (for example, a waveform, a voltage, a transmission frequency of the touch detection signal), and the like. Although the details will be described later, the touch detection unit 32 is configured to control various parameters for touch detection based on touch control data included in the determination data returned from the host processor 5.

[0023] FIG. 3 is a process flow diagram showing details of pen detection performed by the pen detection unit 33. As shown in the figure, the pen detection unit 33 first performs a process of generating an uplink signal and inputting it to each X electrode 2x to transmit the uplink signal to the electronic pen 7 (step S20). The uplink signal is a signal for synchronizing the electronic pen 7 with the system 1 and transmitting an instruction (command) to the electronic pen 7. In response to receiving this uplink signal, the electronic pen 7 is configured to transmit a pen signal including, in this order, an unmodulated burst signal and a data signal modulated by various data acquired in the electronic pen 7 (pen pressure, on-on information of the side switch, pen ID, etc.; hereinafter, referred to as "pen acquired data"). The command transmitted by the uplink signal plays a role of instructing the electronic pen 7 on the content of the data to be transmitted by the data signal.

[0024] Next, the pen detection unit 33 judges whether or not to perform a global scan (step S21). This judgment is made based on the pen control data included in the judgment data returned from the host processor 5, and this point will be described later.

[0025] When it is determined in step S21 that a global scan is to be performed, the pen detection unit 33 performs a process of scanning all of the sensor electrodes constituting the sensor electrode group 2 (global scan) at the timing when the electronic pen 7 is transmitting a pen signal (step S22), and as a result, determines whether or not a pen signal has been detected (step S23). In the global scan, no demodulation process of the data signal is performed, and in step S23, it is simply determined whether or not a pen signal has been detected. When it is determined in step S23 that a pen signal has not been detected, the pen detection unit 33 transmits pen data indicating that the pen has not been detected to the host processor 5 (step S32), and ends the pen detection operation.

[0026] On the other hand, if it is determined in step S23 that a pen signal has been detected, the pen detection unit 33 derives pen coordinates based on the detection level of the pen signal in each sensor electrode (step S24), and transmits pen data indicating the derived pen coordinates to the host processor 5 (step S25), thereby completing the pen detection operation.

[0027] When it is determined in step S21 that a global scan is not to be performed, the pen detection unit 33 performs a process (sector scan) of scanning only a predetermined number of sensor electrodes located near the immediately preceding pen coordinate among the multiple sensor electrodes constituting the sensor electrode group 2 at the timing when the electronic pen 7 is transmitting a burst signal (step S26), and determines whether or not a pen signal has been detected as a result (step S27). When it is determined that a pen signal has not been detected, the pen detection unit 33 transmits pen data indicating that the pen has not been detected to the host processor 5 (step S32), and ends the pen detection operation.

[0028] On the other hand, if the pen detection unit 33 determines in step S27 that the pen signal has been detected, it derives the pen coordinates based on the detection level of the pen signal in each sensor electrode (step S28). After that, it receives the data signal using the sensor electrode closest to the derived pen coordinates, and demodulates it to receive the pen acquisition data transmitted by the electronic pen 7 (step S29).

[0029] Next, the pen detection unit 33 performs a process of acquiring pen status information (step S30). The pen status information is information indicating that the electronic pen 7 has come into contact with the touch surface (pen up), that the electronic pen 7 that has come into contact with the touch surface continues to come into contact with the touch surface (pen move), or that the electronic pen 7 has been removed from the touch surface (pen down). The determination of whether the electronic pen 7 is in contact with the touch surface is based on whether the writing pressure acquired in step S30 exceeds a predetermined threshold value (hereinafter referred to as "writing pressure ON load").

[0030] The pen state information acquired in step S30 may include tilt information indicating the tilt of the electronic pen 7. To explain in detail, the electronic pen 7 capable of tilt detection is configured to transmit a pen signal from each of two transmission electrodes. The pen detection unit 33 is configured to obtain two pen coordinates by deriving pen coordinates based on each of the two pen signals thus transmitted, and to derive the tilt of the electronic pen 7 based on the distance between these two pen coordinates.

[0031] After completing step S30, the pen detection unit 33 transmits the derived pen coordinates, the received pen acquisition data, and the pen data indicating the acquired pen state information to the host processor 5 (step S31), and ends the pen detection operation.

[0032] Here, the writing pressure ON load used by the pen detection unit 33 to acquire pen state information constitutes a part of various parameters for pen detection used by the pen detection unit 33 to perform pen detection. The various parameters for pen detection may include a parameter indicating the operation ratio of a global scan and a sector scan for forcibly executing a global scan, a parameter which is a detection level of a pen signal for determining that a pen signal has been detected in steps S23 and S27 of Fig. 3, a parameter which is a frequency of the pen signal, a parameter which is a transmission strength (amplification level) of an uplink signal, a parameter for correcting the pen coordinates derived by the pen detection unit 33, and a parameter for correcting the inclination of the electronic pen 7 derived by the pen detection unit 33. The details will be described later, but the pen detection unit 33 is configured to control these various parameters for pen detection based on pen control data included in the determination data returned from the host processor 5.

[0033] Returning to Fig. 1, the host processor 5 is the central processing unit (CPU) of the system 1, and is responsible for controlling the entire system 1 by executing a predetermined operating system (OS) 52. The host processor 5 may include a GPU (Graphics Processing Unit). A GPU is a processing device that can generally perform calculations faster than a CPU, and is responsible for processing that requires high-speed calculations, such as real-time image processing.

[0034] The host processor 5 is connected to the bus interfaces 40, 41 and the memory 42 via the internal bus 6. The memory 42 stores a program that defines the operation of the host processor 5, and the host processor 5 performs each process described below by reading and executing this program. The memory 42 also serves to temporarily or permanently store various data used by the host processor 5 during processing.

[0035] The bus interface 40 is connected to the touch IC 3 via a dedicated bus 4a, and the bus interface 41 is connected to the touch IC 3 via a peripheral device bus 4b. Thus, the host processor 5 is connected to the touch IC 3 in two systems, via the dedicated bus 4a and the peripheral device bus 4b.

[0036] The peripheral bus 4b is a bus that is generally used inside the system 1, and is configured, for example, by a universal serial bus (USB). The touch coordinates and palm coordinates derived by the touch detection unit 32, and the pen data acquired by the pen detection unit 33 are preferably transmitted from the touch IC 3 to the host processor 5 via the peripheral bus 4b. On the other hand, the dedicated bus 4a is specially provided for transmitting and receiving frame data and judgment data including a heat map, and is configured, for example, by a serial peripheral interface (SPI) so as to be able to transmit and receive large amounts of data. Note that, since the amount of data for the judgment data is not as large as that for the heat map, it may be transmitted from the host processor 5 to the touch IC 3 via the peripheral bus 4b.

[0037] In the host processor 5, in addition to the operating system 52, touch IC compatible firmware (FW) 51 (external processor) is also executed. The touch IC compatible firmware 51 is a program that runs on, for example, a GPU, and performs a predetermined process based on the frame data (heat map) and pen data supplied from the touch IC 3 to generate the above-mentioned judgment data, and performs a process of returning the generated judgment data to the touch IC 3. The generation and return of the judgment data will be described in more detail later with reference to a sequence diagram and a process flow diagram.

[0038] The predetermined processing performed by the touch IC compatible firmware 51 includes processing to derive the touch area and palm area based on the heat map and pen coordinates supplied from the touch IC 3. The touch IC compatible firmware 51 supplies the derived touch area and palm area to a touch driver 53 of the operating system 52.

[0039] 4(a) is a diagram for explaining the palm area derivation process performed by the touch IC compatible firmware 51. This figure shows a case where four touch areas A to D are derived by the touch IC compatible firmware 51 and one pen coordinate is supplied from the touch IC 3.

[0040] When a user performs input using the electronic pen 7, the hand of the user holding the electronic pen 7 may touch the touch surface and may be derived as a touch area. The touch area that may be derived in this way should be located on the right side of the pen coordinates if the user is right-handed, and on the left side of the pen coordinates if the user is left-handed. Therefore, if the user is right-handed, the touch IC compatible firmware 51 provisionally sets a palm area of ​​a predetermined shape (the range indicated by the dashed line in FIG. 4(a)) on the right side of the pen coordinates, and acquires the touch area included therein as the palm area. In the example of FIG. 4(a), the touch areas C and D are acquired as the palm area. Also, if the user is left-handed, a palm area of ​​a predetermined shape is provisionally set on the left side of the pen coordinates, and the touch area included therein is acquired as the palm area.

[0041] In order for the touch IC compatible firmware 51 to perform such processing, it is necessary to obtain information indicating the user's handedness in advance. In one example, this can be realized by setting a parameter indicating the user's handedness (right-handed or left-handed) in the touch IC compatible firmware 51 through a previous user setting. In another example, this can also be realized by the touch IC compatible firmware 51 determining the user's handedness from the positional relationship between the touch area and the pen coordinates.

[0042] FIG. 4(b) is a diagram for explaining an example of determination of a user's handedness by the touch IC compatible firmware 51. In the example of the figure, two touch areas A and B are present on the left side of the pen coordinates. If the positional relationship between the touch areas A and B and the pen coordinates continues in this state for a certain period of time or more, the touch IC compatible firmware 51 can determine that the user's handedness is the left hand. In this way, the touch IC compatible firmware 51 can also determine the user's handedness.

[0043] Note that, although an example of deriving the palm area based on the positional relationship with the pen coordinates has been described here, the touch IC compatible firmware 51 may, for example, acquire a touch area whose area is equal to or greater than a predetermined value as the palm area.

[0044] Returning to FIG. 1, the operating system 52 includes a touch driver 53 and a pen driver 54. The touch driver 53 receives the touch area and palm area derived by the touch IC compatible firmware 51, performs a predetermined process, and passes the data to a drawing application or the like operating on the operating system 52. The pen driver 54 receives pen data from the touch IC 3, performs a predetermined process, and passes the data to the drawing application or the like. Based on the data received from the touch driver 53 and the pen driver 54, the drawing application generates and renders ink data indicating the trajectory of the finger 8 or electronic pen 7 on the touch surface. This allows the user to check the results of input with the electronic pen 7 or finger 8 on the screen.

[0045] Next, the generation and return of the determination data by the touch IC compatible firmware 51 will be described in detail with reference to FIGS.

[0046] Fig. 5 is a sequence diagram showing the operation of the system 1 shown in Fig. 1. The touch IC 3 is configured to repeatedly execute pen detection by the pen detection unit 33 (step S1) and touch detection by the touch detection unit 32 (step S2). Note that, although details will be described later, the execution ratio (scan scenario) of steps S1 and S2 is instructed to the touch IC 3 by the touch IC compatible firmware 51 using pen control data (data for controlling the operation of pen detection) included in the determination data returned from the touch IC compatible firmware 51 to the touch IC 3. The touch IC 3 is configured to execute steps S1 and S2 according to this instruction.

[0047] When the touch IC 3 executes pen detection by the pen detection unit 33 (step S1), it supplies pen data to the touch IC compatible firmware 51 and the operating system 52 (more specifically, the pen driver 54). This supply is performed via the peripheral device bus 4b. When the touch IC 3 executes touch detection by the touch detection unit 32 (step S2), it supplies frame data including a heat map to the touch IC compatible firmware 51. This supply is performed via the dedicated bus 4a.

[0048] The touch IC compatible firmware 51 that has received the pen data and the frame data executes a judgment process (step S3). This process generates judgment data including touch control data including the touch area and the palm area, and pen control data. The generated judgment data is returned to the touch IC 3 via the dedicated bus 4a or the peripheral device bus 4b. The touch area and the palm area are also supplied to the operating system 52 (more specifically, the touch driver 53).

[0049] 6 is a process flow diagram showing details of the determination process performed in step S3. As shown in the figure, the touch IC compatible firmware 51 first determines whether the pen data includes pen coordinates or data indicating no pen detection (step S40). If it is determined that the pen coordinates are included, then it generates pen control data specifying a scan scenario when the pen is detected and a sector scan position (step S41). On the other hand, if it is determined that the data indicating no pen detection is included, then it generates pen control data specifying a scan scenario when the pen is not detected and execution of a global scan (step S42).

[0050] Here, the scan scenario when a pen is detected is a scenario that includes pen detection more frequently than the scan scenario when a pen is not detected. By doing so, the frequency with which the touch IC 3 receives pen signals can be increased when a pen is detected, so that the position of the electronic pen 7 can be detected more frequently and larger data can be transmitted from the electronic pen 7 to the touch IC 3. On the other hand, when a pen is not detected, the touch area and palm area can be acquired more frequently.

[0051] Next, the touch IC compatible firmware 51 extracts a heat map from the received frame data, and derives a touch area based on the extracted heat map (step S43). The touch IC compatible firmware 51 further derives a palm area based on the pen coordinates included in the received pen data and the touch area derived in step S43 (step S44). The details of this derivation are as described with reference to FIG. 4(a). If the pen coordinates are not received, the palm area may not be derived, or a touch area whose area is equal to or larger than a predetermined value may be derived as the palm area. The touch IC compatible firmware 51 supplies the touch area and palm area thus derived to the operating system 52 (more specifically, the touch driver 53) (step S45).

[0052] Next, the touch IC compatible firmware 51 generates touch control data including the derived touch area and palm area (step S46), and generates control contents of the various parameters for pen detection described above based on the received pen coordinates and the derived touch area and palm area, etc., and adds them to the pen control data (step S47).Then, the touch IC compatible firmware 51 generates judgment data including the touch control data and pen control data, and transmits it to the touch IC 3 (step S48), and ends the judgment process.

[0053] Returning to Fig. 5, upon receiving the determination data, the touch IC 3 causes the touch detection unit 32 and the pen detection unit 33 to execute processing based on the determination data (step S4).

[0054] 7 is a process flow diagram showing details of the touch detection part of the process based on the judgment data performed in step S4. As shown in the figure, the touch detection unit 32 first obtains touch control data from the judgment data (step S50), and compares the touch area and palm area contained therein with the touch area and palm area derived inside the touch IC 3 (step S51). Then, based on the result of the comparison, the touch detection unit 32 controls the various parameters for touch detection described above so that the touch area and palm area derived inside the touch IC 3 approach the touch area and palm area derived by the touch IC compatible firmware 51 (step S52), and ends the process.

[0055] The control in step 52 may include a control to lower a threshold value (capacitance threshold value) for detecting a touch in order to increase the touch detection sensitivity when five fingers are detected on the touch IC compatible firmware 51 side but only four fingers are detected on the touch IC 3 side, and a control to raise a threshold value (area threshold value) for detecting a palm in order to make it easier to detect a palm when a palm is detected on the touch IC compatible firmware 51 side but not on the touch IC 3 side. In addition, a plurality of operation modes (for example, a glove mode, a mode with foreign matter such as water droplets) each having one or more preset various parameters for touch detection may be stored in advance in each of the touch IC compatible firmware 51 and the touch detection unit 32, and the touch IC compatible firmware 51 may determine an optimal operation mode based on a heat map, and the touch IC 3 may control various parameters for touch detection so as to operate in the determined operation mode. Of course, other parameters described above may be controlled in step S52.

[0056] 8 is a process flow diagram showing details of the part related to pen detection among the processes based on the judgment data performed in step S4. First, the pen detection unit 33 acquires pen control data from the judgment data (step S60). Then, according to the designation of the acquired pen control data, it sets the pen (step S61). Subsequent pen detection operations and touch detection operations are executed according to the scan scenario set here.

[0057] Next, the pen detection unit 33 determines whether the pen control data specifies a global scan execution or a sector scan position (step S62). If it is determined that a global scan execution is specified, the pen detection unit 33 sets the next pen detection to global scan (step S63). As a result, the determination result of step S21 in FIG. 3 becomes positive in the next pen detection. On the other hand, if it is determined in step S62 that a sector scan position is specified, the pen detection unit 33 sets the next pen detection to sector scan and sets the position (step S64). As a result, the determination result of step S21 in FIG. 3 becomes negative in the next pen detection, and the sensor electrodes to be scanned are determined in step S26 in FIG. 3.

[0058] Finally, the pen detection unit 33 controls various parameters for pen detection based on the control contents of the various parameters for pen detection included in the pen control data (step S65), and ends the process. The control in step 65 may include control to increase or decrease the detection level of the pen signal for determining that the pen signal has been detected in steps S23 and S27 of Fig. 3, or control to change the operation ratio of the global scan and the sector scan, depending on whether or not the electronic pen 7 has been detected in each of the touch IC compatible firmware 51 and the touch IC 3. Of course, other parameters as described above may also be controlled in step S65.

[0059] As described above, according to the method executed by the system 1 of this embodiment, the determination data resulting from the processing by the host processor 5 is returned from the touch IC compatible firmware 51 to the touch IC 3, so that the touch IC 3 can use the results of the processing by the host processor 5. As a result, for example, the touch IC 3 can derive the touch area and palm area with higher accuracy, and can perform pen detection based on the control from the touch IC compatible firmware 51.

[0060] In addition, since the heat map, which has a large data size, is transmitted via the dedicated bus 4a, it becomes possible to supply the heat map from the touch IC 3 to the host processor 5 without straining the communication resources of the peripheral device bus 4b.

[0061] In this embodiment, the pen data is supplied to the touch IC compatible firmware 51 every time the pen detection unit 33 executes pen detection, but when a scan scenario is adopted in which, for example, one touch detection is executed after multiple pen detections are executed, only the pen data obtained as a result of the pen detection executed immediately before the touch detection may be supplied to the touch IC compatible firmware 51. In this way, it is possible to reduce the processing of the touch IC compatible firmware 51 without affecting the determination processing in step S3 in FIG. 5.

[0062] In addition, in the present embodiment, the touch area and palm area are provided from the touch IC compatible firmware 51 to the operating system 52, but more advanced processing such as gesture recognition based on a heat map may be performed in the touch IC compatible firmware 51, and the result may also be provided to the operating system 52. The result of the advanced processing may also be included in the determination data returned to the touch IC 3. This makes it possible to utilize the touch IC compatible firmware 51 more meaningfully.

[0063] In the present embodiment, only the touch area and palm area derived by the touch IC compatible firmware 51 are included in the touch control data, but similar to the various parameters for pen detection, specific control contents of various parameters for touch detection may be generated in the touch IC compatible firmware 51 and included in the touch control data. In this way, it becomes possible to specifically control various parameters for touch detection used in the touch detection unit 32 from the touch IC compatible firmware 51.

[0064] 9 is a diagram showing the configuration of system 1 according to the second embodiment of the present invention. System 1 according to this embodiment differs from system 1 according to the first embodiment in that an AI (Artificial Intelligence) coprocessor 9 provided separately from the host processor 5 is used as an external processor for the touch IC 3, and pen data is not supplied to the AI ​​coprocessor 9 which is an external processor. Since the system is otherwise similar to system 1 according to the first embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the following description will focus on the differences from system 1 according to the first embodiment.

[0065] 9, the system 1 according to the present embodiment is configured to include an AI coprocessor 9. The touch IC compatible firmware 51 shown in FIG. 1 is not provided in the system 1 according to the present embodiment. In addition, the bus interface 40 is provided in the AI ​​coprocessor 9, and is not connected to the internal bus 6.

[0066] The AI ​​coprocessor 9 is an auxiliary processor with built-in artificial intelligence, and is connected to the touch IC 3 via the dedicated bus 4a. The AI ​​coprocessor 9 receives frame data including a heat map from the touch IC 3 via the dedicated bus 4a, derives touch coordinates and palm coordinates based on the received heat map, and returns judgment data including the results to the touch IC 3 via the dedicated bus 4a.

[0067] The touch detection unit 32 according to this embodiment is configured to extract touch coordinates and palm coordinates from the reduced judgment data, and report them to the host processor 5 via the peripheral device bus 4b. This allows the host processor 5 to obtain the touch area and palm area derived by the AI ​​coprocessor 9 without communicating with the AI ​​coprocessor 9. In other words, since the AI ​​coprocessor 9 is hidden from the perspective of the host processor 5, it is possible to add the AI ​​coprocessor 9, which is an external processor, without changing the implementation of the host processor 5.

[0068] 10 is a sequence diagram showing the operation of the system 1 according to this embodiment. As shown in the figure, in this embodiment, the pen data obtained as a result of pen detection by the pen detection unit 33 (step S1) is supplied only to the operating system 52 (more specifically, the pen driver 54), and is not supplied to the AI ​​coprocessor 9. Also, instead of the determination process of step S3, a determination process of step S3a is executed.

[0069] Fig. 11 is a process flow diagram showing details of the determination process performed in step S3a. As shown in the figure, the determination process performed in step S3a is the same as the determination process shown in Fig. 6 except that steps S40 to S42, S45, and S47 are omitted and steps S44 and S48 are changed to steps S44a and S48a, respectively.

[0070] Step S44a differs from step S44 shown in FIG. 6 in that pen coordinates are not used. That is, the AI ​​coprocessor 9 is configured to derive the palm area based only on the touch area derived in step S43. In a specific example, a touch area whose area is equal to or larger than a predetermined value may be derived as the palm area. Step S48a differs from step S48 shown in FIG. 6 in that pen control data is not included in the judgment data.

[0071] Returning to Fig. 10, the touch detection unit 32 reports the touch area and palm area included in the determination data received from the AI ​​coprocessor 9 to the host processor 5 as the touch area and palm area derived by the touch detection unit 32. This makes it possible to add the AI ​​coprocessor 9, which is an external processor, without changing the implementation of the host processor 5, as described above.

[0072] As described above, according to the method executed in the system 1 of this embodiment, the touch coordinates and palm coordinates derived by the AI ​​coprocessor 9 are supplied to the host processor 5 via the touch IC 3, making it possible to add an external processor without changing the implementation of the host processor 5.

[0073] In addition, the touch detection unit 32 according to the present embodiment may also execute the process shown in Fig. 7. By doing so, the touch IC 3 can derive the touch area and palm area with higher accuracy also in the present embodiment.

[0074] Also in this embodiment, pen data obtained as a result of pen detection by pen detection unit 33 (step S1) may be supplied to AI coprocessor 9. In this way, also in this embodiment, pen detection unit 33 can perform pen detection based on control from host processor 5. Also, in AI coprocessor 9, it becomes possible to derive the palm area based on the pen coordinates.

[0075] Also in this embodiment, more advanced processing such as gesture recognition based on a heat map may be performed in the AI ​​coprocessor 9, and the result may be included in the determination data returned to the touch IC 3. In this case, it is preferable that the touch IC 3 also reports the result of the advanced processing thus returned to the host processor 5. This allows the AI ​​coprocessor 9 to be used more meaningfully.

[0076] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and it goes without saying that the present invention can be embodied in various forms without departing from the spirit of the present invention. [Explanation of symbols]

[0077] 1 System 2 Sensor electrodes 2x X electrodes 2y Y electrode 3 Touch IC 4a Private bus 4b Peripheral Bus 5 Host Processor 6 Internal Bus 7 Electronic pen 8 fingers 9 AI Coprocessor 31 Firmware 32 Touch detection section 33 Pen detection unit 40,41 Bus Interface 42 Memory 51 Touch IC compatible firmware 52 Operating Systems 53 Touch Driver 54 Pen Driver

Claims

1. An integrated circuit for performing pen detection that detects a pen signal transmitted from a pen based on charges induced on a group of sensor electrodes, transmitting pen data including information indicating a state of the pen detected by the pen detection to an external processor; receiving pen control data from the external processor, the pen control data including control contents of various pen detection parameters used by the integrated circuit to perform the pen detection, the control data being generated by the external processor based on the pen data; controlling the various parameters for pen detection based on the control content included in the pen control data received from the external processor; Integrated circuits.

2. acquiring two pen coordinates by deriving pen coordinates based on two pen signals transmitted by the pen from two transmission electrodes, respectively, and deriving a tilt of the pen based on the two acquired pen coordinates; the information indicating the state of the pen includes tilt information indicating a tilt of the pen, The various parameters for pen detection include a parameter for correcting the inclination of the pen.

10. The integrated circuit of claim 1.

3. the pen control data includes data specifying a sector scan position; the integrated circuit sets the next position of the pen detection in accordance with data designating the sector scan position included in the pen control data; 10. The integrated circuit of claim 1.

4. the pen control data includes a scan scenario indicating an execution ratio of touch detection for detecting a finger and the pen detection, the integrated circuit performs the touch detection and the pen detection according to the scan scenario included in the pen control data; 10. The integrated circuit of claim 1.

Images