Touch operation detection device and touch operation detection method

Abstract

To provide a touch operation detection device and a touch operation detection method that are capable of improving the operability of a touch operation on a display panel.SOLUTION: A display device includes: a grouping processing unit that groups a plurality of drive lines into a plurality of groups each having a set grouped number of adjacent drive lines; a setting processing unit that sets a display magnification of a display screen according to the grouped number; a display processing unit that causes a display panel to display the display screen at the display magnification; and a determination processing unit that determines, in a state where the display screen is displayed on the display panel at the display magnification, a position of a touch operation on the display screen that is displayed at the display magnification based on output signals output from a plurality of sense lines in response to input signals that are input to each of the grouped number of drive lines.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present disclosure relates to a touch operation detection device and a touch operation detection method for detecting a touch operation on a display panel.

Background Art

[0002] Conventionally, a touch operation device capable of performing touch operations (screen operations) such as contact operations and non-contact operations on the display screen of a display panel is known. For example, in order to improve the detection sensitivity of a hover operation, a touch operation device is known in which each of a plurality of electrodes is connected to each other to form an electrode block, and a drive signal is input for each electrode block to detect an input position (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the conventional technology, since the input position is detected for each electrode block in which each of a plurality of electrodes is connected to each other, the spatial resolution is lower than when the input position is detected for each electrode, and the position detection accuracy of the touch operation is reduced. Therefore, when a user performs a touch operation on the display panel, the error between the touch operation position intended by the user and the touch operation position detected by the touch operation device becomes large, and there is a problem that the operability of the touch operation on the display panel is reduced.

[0005] An object of the present disclosure is to provide a touch operation detection device and a touch operation detection method capable of improving the operability of a touch operation on a display panel.

Means for Solving the Problems

[0006] A touch operation detection device according to one aspect of the present disclosure is a touch operation detection device that inputs an input signal to a plurality of drive lines arranged in parallel on a display panel and detects the position of a touch operation on a display screen displayed on the display panel based on output signals detected from a plurality of sense lines arranged in parallel and intersecting the plurality of drive lines on the display panel. The touch operation detection device comprises a grouping processing unit, a drive processing unit, a detection processing unit, a setting processing unit, a display processing unit, and a determination processing unit. The grouping processing unit groups the plurality of drive lines into a plurality of groups for each set number of adjacent drive lines. The drive processing unit inputs the input signal to each of the grouped drive lines grouped by the grouping processing unit. The detection processing unit detects the output signals output from the plurality of sense lines. The setting processing unit sets the display magnification of the display screen according to the number of groups. The display processing unit causes the display panel to display the display screen at the display magnification. The determination processing unit determines the position of the touch operation on the display screen displayed at the display magnification, based on the output signals output from the plurality of sense lines corresponding to the input signals input for each drive line of the group number, when the display screen is displayed on the display panel at the display magnification by the display processing unit.

[0007] Another aspect of the present disclosure is a touch operation detection method that inputs an input signal to a plurality of drive lines arranged in parallel on a display panel and detects the position of a touch operation on a display screen displayed on the display panel based on output signals detected from a plurality of sense lines arranged in parallel and intersecting the plurality of drive lines on the display panel. In the touch operation detection method, one or more processors perform the following: group the plurality of drive lines into a plurality of groups for each set number of adjacent drive lines; input the input signal to each of the grouped drive lines; detect the output signals output from the plurality of sense lines; set the display magnification of the display screen according to the number of groups; display the display screen on the display panel at the display magnification; and, while the display screen is displayed on the display panel at the display magnification, determine the position of the touch operation on the display screen displayed at the display magnification based on the output signals output from the plurality of sense lines corresponding to the input signals input to each of the grouped drive lines. [Effects of the Invention]

[0008] This disclosure provides a touch operation detection device and a touch operation detection method that can improve the operability of touch operations on a display panel. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a block diagram showing the configuration of a display device according to an embodiment of this disclosure. [Figure 2] Figure 2 is a schematic diagram showing an example of hover operation in a display device according to an embodiment of this disclosure. [Figure 3] Figure 3 is a schematic diagram showing an example of hover operation in a display device according to an embodiment of this disclosure. [Figure 4] Figure 4 shows the configuration of a touch sensor according to an embodiment of this disclosure. [Figure 5] Figure 5 is a schematic diagram showing an example of matrix operations in a display device according to the embodiment of this disclosure. [Figure 6] Figure 6 is a schematic diagram showing an example of an input signal in a display device according to the present disclosure. [Figure 7] Figure 7 is a schematic diagram showing an example of an input signal in a display device according to the embodiment of this disclosure. [Figure 8] Figure 8 is a schematic diagram showing an example of matrix operations in a display device according to the embodiment of this disclosure. [Figure 9] Figure 9 shows an example of a display screen of a display device according to the present disclosure. [Figure 10] Figure 10 shows an example of a display screen of a display device according to the present disclosure. [Figure 11] Figure 11 is a flowchart illustrating an example of the procedure for touch operation detection processing performed in the display device according to the embodiment of this disclosure. [Figure 12] Figure 12 shows an example of a display screen of a display device according to the present disclosure. [Modes for carrying out the invention]

[0010] The embodiments of this disclosure will be described below with reference to the attached drawings. Note that the following embodiments are merely examples of the embodiments of this disclosure and do not limit the technical scope of this disclosure.

[0011] As shown in Figure 1, the display device 1 according to the embodiment of this disclosure comprises a control unit 11, a storage unit 12, a display panel 13, an operation unit 14, and a touch sensor 15. The display device 1 is an example of a touch operation detection device according to this disclosure.

[0012] The display device 1 is a capacitive display device that can accept touch operations (hereinafter referred to as contact operations) caused by a user's contact with the display screen 13A and non-contact touch operations (hereinafter referred to as hover operations). For example, in the hover operation, as shown in FIGS. 2 and 3, when the user's finger approaches the display screen 13A and the distance L between the finger and the display screen 13A becomes less than or equal to a predetermined distance, the display device 1 detects the finger and detects a touch operation corresponding to the position of the finger. Then, the display device 1 executes input processing corresponding to the touch operation of the user on the display screen 13A. For example, when the user touches a predetermined position on the display screen 13A, the display device 1 detects the position on the display screen 13A corresponding to the position of the touch operation and accepts a selection operation for selecting a selection target by the input operation icon P1 displayed on the display screen 13A.

[0013] The hover operation refers to an operation corresponding to an operation of aligning an input operation icon P1 (such as a cursor) with a specific element (such as an object image of a selection target) by an input means (such as the user's hand, fingertip, stylus pen, support rod, etc.) on the display screen 13A, and refers to an operation in a state before touching the display screen 13A (hover state with the input means floating). The hover state refers to a state where the input means is at a distance of less than or equal to a predetermined distance from the display screen 13A and the input means and the display screen 13A are not in contact, that is, a state where the input means is in proximity.

[0014] The display device 1 may be configured to accept both the touch operation and the hover operation, or may be configured to accept either the touch operation or the hover operation.

[0015] The display panel 13 is a display for displaying images, for example, a liquid crystal display. The operation unit 14 is an operation device such as a mouse or a keyboard. Note that the operation unit 14 may be configured as a touch panel.

[0016] The touch sensor 15 is, for example, a surface-type or projection-type capacitance sensor. Note that the touch sensor 15 may be constituted by a touch panel superimposed on the surface of the display panel 13. FIG. 4 shows the configuration of the touch sensor 15. In the touch sensor 15, a plurality of drive electrodes arranged in a plurality in the Y direction and a plurality of sense electrodes arranged in a plurality in the X direction are arranged so as to intersect. Further, the touch sensor 15 includes a plurality of drive lines DL including a plurality of drive electrodes and arranged in parallel in the X direction, and a plurality of sense lines SL including a plurality of sense electrodes and arranged in parallel in the Y direction.

[0017] The control unit 11 inputs input signals represented by the matrix (1, -1) to the plurality of drive lines DL in parallel for driving (parallel driving) (see FIG. 4), detects the output signals from the plurality of sense lines SL in parallel, and based on the matrix operation of the input sequence corresponding to the magnitude of the input signal and the output sequence corresponding to the magnitude of the output signal, detects the touch operation (input position) on the display screen 13A based on the linear element sequence corresponding to the magnitude of the capacitance at each intersection of the plurality of drive lines DL and the plurality of sense lines SL. The specific method for detecting the touch operation based on the linear element sequence will be described later.

[0018] The storage unit 12 is a non-volatile storage unit such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) that stores various types of information. In the storage unit 12, control programs such as a touch operation detection program for causing the control unit 11 to execute a touch operation detection process (see FIG. 11) described later are stored. For example, the touch operation detection program is non-temporarily recorded on a computer-readable recording medium such as a CD or a DVD, and is read by a reading device (not shown) such as a CD drive or a DVD drive provided in the display device 1 and stored in the storage unit 12. Note that the touch operation detection program may be distributed from a cloud server and stored in the storage unit 12.

[0019] The control unit 11 includes control devices such as a CPU, ROM, and RAM. The CPU is a processor that performs various arithmetic operations. The ROM is a non-volatile memory unit that stores control programs such as a BIOS and OS in advance to cause the CPU to perform various arithmetic operations. The RAM is a volatile or non-volatile memory unit that stores various information and is used as a temporary memory (work area) for the various processes performed by the CPU. The control unit 11 controls the display device 1 by executing various control programs that have been stored in advance in the ROM or memory unit 12 using the CPU.

[0020] Specifically, as shown in Figure 1, the control unit 11 includes various processing units such as a drive processing unit 111, a detection processing unit 112, a determination processing unit 113, a grouping processing unit 114, a setting processing unit 115, and a display processing unit 116. The control unit 11 functions as the drive processing unit 111, detection processing unit 112, determination processing unit 113, grouping processing unit 114, setting processing unit 115, and display processing unit 116 by executing the touch operation detection program and various processing operations in accordance with it using the CPU. Furthermore, some or all of the processing units included in the control unit 11 may be composed of electronic circuits. The touch operation detection program may also be a program that causes multiple processors to function as the various processing units.

[0021] The drive processing unit 111 inputs input signals (drive signals) to multiple drive lines DL. Specifically, the drive processing unit 111 drives all drive lines DL in parallel using an input sequence matrix corresponding to the magnitude of the input signals. For example, the drive processing unit 111 drives all drive lines DL in parallel using a code sequence consisting of Hadamard matrices as the input sequence corresponding to the magnitude of the input signals.

[0022] The detection processing unit 112 detects the output signals (detection signals) that are output from multiple sense lines SL. Specifically, the detection processing unit 112 detects the output signals from multiple sense lines SL in parallel.

[0023] The determination processing unit 113 determines the position of the touch operation on the display screen 13A. Specifically, the determination processing unit 113 detects the touch operation on the touch sensor 15 based on a linear element sequence (capacitance sequence) calculated by matrix operation between an input sequence corresponding to the magnitude of the input signal and an output sequence corresponding to the magnitude of the output signal. The method for detecting the touch operation based on the linear element sequence can be, for example, the method disclosed in Japanese Patent No. 4927216. An example of the method for detecting the touch operation will be explained with reference to Figure 5.

[0024] In Figure 5, for the sake of simplicity, the touch sensor 15 is assumed to have four drive lines DL1 to DL4 and four sense lines SL1 to SL4. Capacitors C11 to C44 are formed at each intersection of the drive lines DL1 to DL4 and the sense lines SL1 to SL4. Furthermore, here we show an example in which the code sequence corresponding to the input sequence is composed of a 4th-order Hadamard matrix generated by the Sylvester method.

[0025] Each sense line SL is connected to an analog integrator 16, which comprises an operational amplifier with one input coupled to a reference voltage, an integral capacitor placed between the output of the operational amplifier and the other input, three other integral capacitors connected in parallel to the integral capacitor, and three switches provided between each of the three other integral capacitors and the output of the operational amplifier.

[0026] For example, at the first drive timing, the drive processing unit 111 inputs the input signals of code sequences d1 to d4 (1,1,1,1) to each of the drive lines DL1 to DL4, and the detection processing unit 112 detects the output signals (s11, s21, s31, s41) output from the sense lines SL1 to SL4. Next, at the second drive timing, the drive processing unit 111 inputs the input signals of code sequences d1 to d4 (1,-1,1,-1) to each of the drive lines DL1 to DL4, and the detection processing unit 112 detects the output signals (s12, s22, s32, s42) output from the sense lines SL1 to SL4. Next, at the third drive timing, the drive processing unit 111 inputs the code sequence d1 to d4 (1,1,-1,-1) to each of the drive lines DL1 to DL4, and the detection processing unit 112 detects the output signals (s13, s23, s33, s43) output from the sense lines SL1 to SL4. Next, at the fourth drive timing, the drive processing unit 111 inputs the code sequence d1 to d4 (1,-1,-1,1) to each of the drive lines DL1 to DL4, and the detection processing unit 112 detects the output signals (s14, s24, s34, s44) output from the sense lines SL1 to SL4.

[0027] The determination processing unit 113 calculates the capacitance value C based on the inner product operation between the output S of the capacitance sequence and the Hadamard matrix H corresponding to the code sequence, and detects a touch operation (input position) based on the change in the capacitance value C. For example, the determination processing unit 113 calculates the capacitance value C using the matrix operation formula "CH=GS" (where G is the proportionality constant).

[0028] In the example shown in Figure 5, the determination processing unit 113 receives the output s1=(s11,s12,s13,s14) from the first capacitance sequence C1 between drive lines DL1~DL4 and sense line SL1, the output s2=(s21,s22,s23,s24) from the second capacitance sequence C2 between drive lines DL1~DL4 and sense line SL2, the output s3=(s31,s32,s33,s34) from the third capacitance sequence C3 between drive lines DL1~DL4 and sense line SL3, and the output s1=(s31,s32,s33,s34) from drive lines DL1~DL4 and sense line SL3. Each capacitance value is calculated based on the inner product operation between the output S, which consists of the output s4=(s41,s42,s43,s44) from the fourth capacitance sequence C4 between drive lines SL4, and the Hadamard matrix H, which consists of the code sequence d1(1,1,1,1) input to drive line DL1, the code sequence d2(1,-1,1,-1) input to drive line DL2, the code sequence d3(1,1,-1,-1) input to drive line DL3, and the code sequence d4(1,-1,-1,1) input to drive line DL4. For example, the matrix operation formula is expressed as shown in equation (1) below.

[0029]

number

[0030] In this way, the control unit 11 drives all drive lines DL in parallel using a matrix (1,-1) and detects touch operations (input positions) by performing matrix operations. When multiple drive lines DL are driven in parallel using an n-th order Hadamard matrix, n times the signal strength can be obtained compared to when drive line DL1 is driven sequentially one by one (corresponding to the identity matrix).

[0031] In order to accurately detect the minute change in capacitance value caused by the touch operation in the display device 1, it is necessary to further increase the signal strength of the detection signal. Therefore, the display device 1 according to this embodiment further includes a grouping processing unit 114.

[0032] The grouping processing unit 114 groups a plurality of drive lines DL into a plurality of groups for each of the set number of grouped drive lines DL that are adjacent to each other. Specifically, the grouping processing unit 114 sets the number of groupings based on the signal intensity of the output signal detected by the detection processing unit 112. For example, when the signal intensity of the output signal is greater than or equal to a threshold value, the grouping processing unit 114 sets the number of groupings to M, and when the signal intensity of the output signal is less than the threshold value, the grouping processing unit 114 sets the number of groupings to N (where M and N are natural numbers and M < N).

[0033] The drive processing unit 111 inputs the input signal of the same pattern for each of the number of drive lines DL grouped by the grouping processing unit 114. For example, when the grouping processing unit 114 sets the number of groupings to M, the drive processing unit 111 inputs an input signal of the same code sequence for each M drive lines DL, and when the grouping processing unit 114 sets the number of groupings to N, the drive processing unit 111 inputs an input signal of the same code sequence for each N drive lines DL.

[0034] A specific example is described below. For example, when the user performs a touch operation (e.g., a hover operation), when the user's hand performs a touch operation at a position close to the touch panel (touch sensor 15), the signal intensity of the output signal detected by the detection processing unit 112 increases. On the other hand, when the user's hand performs a touch operation at a position far from the touch panel (touch sensor 15), the signal intensity of the output signal detected by the detection processing unit 112 decreases.

[0035] The grouping processing unit 114 sets the number of groups to "2" (M=2) when the user's hand is close to the touch panel and the signal strength of the output signal is above a threshold. In this case, the drive processing unit 111 inputs the same code sequence input signal to each of two adjacent drive lines DL, as shown in Figure 6. For example, at each drive timing, the drive processing unit 111 inputs the same code sequence input signal to drive lines DL1 and DL2, to drive lines DL3 and DL4, to drive lines DL5 and DL6, to drive lines DL7 and DL8, and to drive lines DL9 and DL10. In this case, the control unit 11 treats two adjacent drive lines DL as one drive line DL and detects the touch operation. This driving method makes it possible to improve the accuracy of touch operation position detection, for example, when a user brings their hand close to the touch panel to perform a touch operation.

[0036] In response to this, the grouping processing unit 114 sets the number of groups to "3" (N=3) when the user's hand is far from the touch panel and the signal strength of the output signal is below a threshold. In this case, the drive processing unit 111 inputs the same code sequence to each of the three adjacent drive lines DL, as shown in Figure 7. For example, at each drive timing, the drive processing unit 111 inputs the same code sequence to drive lines DL1, DL2, DL3, the same code sequence to drive lines DL4, DL5, DL6, and the same code sequence to drive lines DL7, DL8, DL9. In this case, the control unit 11 treats the three adjacent drive lines DL as a single drive line DL and detects the touch operation. With this driving method, the three drive lines DL can be used as a single drive electrode, so that the electric field lines formed between the drive electrode and the sense electrode can be extended to a position far from the touch panel. For this reason, for example, even when the user moves their hand away from the touch panel, it is possible to reliably detect the position of the touch operation.

[0037] In another embodiment, the drive processing unit 111 may switch between a first drive mode in which the same pattern of input signal is input to each of the M drive lines, and a second drive mode in which the same pattern of input signal is input to each of the N drive lines. For example, the drive processing unit 111 may switch to the first drive mode when the operation mode is a first operation mode (contact operation mode) that accepts touch operation by contacting the touch panel, and switch to the second drive mode when the operation mode is a second operation mode (hover operation mode) that accepts touch operation by non-contacting the touch panel. For example, when the operation mode is set to contact operation mode, the drive processing unit 111 inputs the same pattern of input signal to each of the 1 drive line, and when the operation mode is set to hover operation mode, the drive processing unit 111 inputs the same pattern of input signal to each of the 3 drive lines.

[0038] In another embodiment, the grouping processing unit 114 may set the number of groups to a smaller value as the user's hand moves closer to the touch panel, and set the number of groups to a larger value as the user's hand moves further away from the touch panel.

[0039] Here, we will explain an example of a matrix operation method when multiple drive lines DL are grouped together. Figure 8 shows an example where two drive lines DL are grouped together (an example where M=2). The control unit 11 treats the two grouped drive lines DL as a single drive line DL and performs matrix operations.

[0040] As shown in Figure 8, the drive processing unit 111 inputs the same code sequence d1,d2(1,1) to drive lines DL1 and DL2, and the same code sequence d3,d4(1,1) to drive lines DL3 and DL4 during the first drive timing. In this case, the input signals are represented as a 2x2 Hadamard matrix H (see equation (2) below).

[0041] The determination processing unit 113 treats the matrix of linear element sequences (capacitance sequences) as follows: the sum of capacitances C11 and C21 (C11+C21) is treated as one capacitance; the sum of capacitances C31 and C41 (C31+C41) is treated as one capacitance; the sum of capacitances C12 and C22 (C12+C22) is treated as one capacitance; and the sum of capacitances C32 and C42 (C32+C42) is treated as one capacitance. The determination processing unit 113 calculates each capacitance value based on the dot product operation between the output S, which consists of the output s1=(s11,s12) from the first capacitance sequence C1 between drive lines DL1~DL4 and sense line SL1, and the output s2=(s21,s22) from the second capacitance sequence C2 between drive lines DL1~DL4 and sense line SL2, and the 2x2 Hadamard matrix H. For example, matrix operations can be expressed as shown in equation (2) below.

[0042]

number

[0043] Furthermore, as shown in Figure 8, the drive processing unit 111 inputs the same code sequence d1,d2(1,1) to drive lines DL1,DL2 and the same code sequence d3,d4(-1,-1) to drive lines DL3,DL4 during the second drive timing. In this case, the input signals are represented as a 2x2 Hadamard matrix H (see equation (3) below).

[0044] The determination processing unit 113 treats the matrix of linear element sequences (capacitance sequences) as follows: the sum of capacitances C13 and C23 (C13 + C23) is treated as one capacitance; the sum of capacitances C33 and C43 (C33 + C43) is treated as one capacitance; the sum of capacitances C14 and C24 (C14 + C24) is treated as one capacitance; and the sum of capacitances C34 and C44 (C34 + C44) is treated as one capacitance. The determination processing unit 113 calculates each capacitance value based on the inner product operation of the output S, which consists of the output s3=(s31, s32) from the third capacitance sequence C3 between drive lines DL1~DL4 and sense line SL3, and the output s4=(s41, s42) from the fourth capacitance sequence C4 between drive lines DL1~DL4 and sense line SL4, with the 2x2 Hadamard matrix H. For example, matrix operations can be expressed as shown in equation (3) below.

[0045]

number

[0046] In this way, the determination processing unit 113 considers multiple components in the input sequence and the capacitance sequence that correspond to each of the grouped driveline DLs as a single component, and calculates the capacitance sequence based on matrix operations between the input sequence and the output sequence. With the above configuration, since driveline DLs can be grouped in pairs and treated as one driveline DL, the required matrix size is halved.

[0047] Furthermore, in the display device 1 according to this embodiment, the setting processing unit 115 sets the display magnification of the display screen 13A according to the number of groups, and the display processing unit 116 causes the display screen 13A to be displayed on the display panel 13 at the specified display magnification.

[0048] Figure 9 shows an example of the display screen 13A. As shown in Figure 9, in the first operation mode (contact operation mode), the setting processing unit 115 sets the display magnification of the display screen 13A to 100%, and the display processing unit 116 displays the display screen 13A at 100% magnification. In this case, the user touches the selected item (the "5" on the numeric keypad shown in Figure 9) on the display screen 13A.

[0049] In contrast, if the grouping processing unit 114 sets the number of groups to "2" or "3", the setting processing unit 115 sets the display magnification of the display screen 13A to a magnification exceeding 100% (for example, 200%), and the display processing unit 116 displays the display screen 13A at a display magnification exceeding 100% (for example, 200%), as shown in Figure 10. In this case, the user hovers over the selected item (the "5" on the numeric keypad shown in Figure 10) on the display screen 13A.

[0050] The determination processing unit 113 determines the position of the touch operation on the display screen 13A displayed at the display magnification, based on the output signals output from multiple sense lines SL corresponding to the input signals input for each drive line DL of the group number, when the display screen 13A is displayed on the display panel 13 by the display processing unit 116.

[0051] In this manner, when the grouping processing unit 114 groups multiple drivelines DL into multiple groups based on a set number of adjacent drivelines DL, the setting processing unit 115 sets the display magnification of the display screen 13A according to the number of groups, and the display processing unit 116 displays the display screen 13A on the display panel 13 at the specified display magnification. This reduces the error between the touch position intended by the user and the detected touch position when the user performs a touch operation on the display panel 13. Thus, the operability of touch operations on the display panel 13 can be improved.

[0052] Here, the setting processing unit 115 may set the display magnification in the second drive mode to a value greater than the display magnification in the first drive mode. For example, the setting processing unit 115 sets the display magnification in the second operation mode (hover operation mode) to a value greater than the display magnification in the first operation mode (contact operation mode).

[0053] In another embodiment, the setting processing unit 115 sets the display magnification to a larger value as the number of groups increases, and brings the display magnification closer to 100% as the number of groups decreases.

[0054] In another embodiment, the setting processing unit 115 may set the display magnification according to the distance (operating distance) from the display panel 13 to the input means (user's hand, fingertip, stylus pen, support rod, etc.). The operating distance is determined, for example, based on the user's past hover operation history information. Alternatively, the operating distance may be a distance set by the user. The setting processing unit 115 sets the display magnification to a larger value as the operating distance is greater, and sets the display magnification closer to 100% as the operating distance is closer.

[0055] Furthermore, if the setting processing unit 115 changes the display magnification and the determination processing unit 113 determines the position of the touch operation, the setting processing unit 115 may return the display magnification to the original magnification (for example, 100%).

[0056] [Touch operation detection process] The touch operation detection process performed by the control unit 11 of the display device 1 will be described below with reference to Figure 11.

[0057] Note that the present disclosure can be regarded as a touch operation detection method for executing one or more steps included in the touch operation detection process, and one or more steps included in the touch operation detection process described herein may be appropriately omitted. In addition, the execution order of each step in the touch operation detection process may be different as long as the same operational effects are produced. Further, here, the case where the control unit 11 executes each step in the touch operation detection process is taken as an example for explanation, but a touch operation detection method in which a plurality of processors execute each step in the touch operation detection process in a distributed manner is also conceivable as another embodiment.

[0058] First, in step S11, the control unit 11 detects an output signal. Specifically, the control unit 11 simultaneously inputs (parallel drives) input signals of a code sequence to a plurality of drive lines DL, and detects the output signals output from the sense lines SL1 to SL4.

[0059] Next, in step S12, the control unit 11 determines whether or not the signal intensity of the output signal is equal to or greater than a threshold value. The signal intensity is, for example, the magnitude of the integral sum of currents flowing through the capacitances of a linear element series (capacitance series). When the control unit 11 determines that the signal intensity of the output signal is equal to or greater than the threshold value (S12: Yes), the process proceeds to step S13. On the other hand, when the control unit 11 determines that the signal intensity of the output signal is less than the threshold value (S12: No), the process proceeds to step S121.

[0060] In step S13, the control unit 11 sets the number of grouped drive lines DL to M. For example, the control unit 11 sets the number of grouped drive lines DL to "two". On the other hand, in step S121, the control unit 11 sets the number of grouped drive lines DL to N (where M and N are natural numbers and M < N). For example, the control unit 11 sets the number of grouped drive lines DL to "three".

[0061] Next, in step S14, the control unit 11 sets the display magnification of the display screen 13A based on the set number of groupings. For example, if the number of drive line DLs to be grouped is set to "2", the control unit 11 sets the display magnification of the display screen 13A to 150%, and if the number of drive line DLs to be grouped is set to "3", it sets the display magnification of the display screen 13A to 200%.

[0062] In another embodiment, the control unit 11 sets the display magnification to 100% in the first drive mode corresponding to the contact operation mode that accepts contact operations (see Figure 9), and sets the display magnification to 200% in the second drive mode corresponding to the hover operation mode that accepts hover operations (see Figure 10).

[0063] Furthermore, when the display magnification is set, the control unit 11 displays the display screen 13A at the set display magnification.

[0064] Next, in step S15, the control unit 11 inputs an input signal based on the set number of groupings. For example, if the control unit 11 sets the number of drive line DLs to "2", it inputs the same code sequence of input signals to each of two adjacent drive line DLs, as shown in Figure 6. Alternatively, if the control unit 11 sets the number of drive line DLs to "3", it inputs the same code sequence of input signals to each of three adjacent drive line DLs, as shown in Figure 7.

[0065] Next, in step S16, the control unit 11 detects a touch operation. Specifically, the control unit 11 calculates a capacitance value C based on the inner product of the output S of the capacitance sequence and the Hadamard matrix H corresponding to the code sequence, and detects a touch operation (input position) based on the change in the capacitance value C (see Figures 6 and 7, and equations (2) and (3)).

[0066] Next, in step S17, the control unit 11 determines whether the touch operation has ended. If the user ends the touch operation on the touch panel (display screen 13A), the control unit 11 determines that the touch operation has ended (S17: Yes) and terminates the touch operation detection process. On the other hand, if the user continues the touch operation on the touch panel, the control unit 11 determines that the touch operation has not ended (S17: No) and proceeds to step S11. In this manner, the control unit 11 executes the touch operation detection process.

[0067] As described above, the display device 1 according to this embodiment inputs input signals to a plurality of drive lines DL arranged in parallel on the display panel 13, and detects the position of a touch operation on the display screen 13A displayed on the display panel 13 based on output signals detected from a plurality of sense lines SL arranged in parallel and intersecting the plurality of drive lines DL on the display panel 13. The display device 1 also groups the plurality of drive lines DL into a plurality of groups of adjacent drive lines DL according to a set number of groups, inputs the input signals to each of the grouped drive lines DL, and detects the output signals output from the plurality of sense lines SL. The display device 1 also sets the display magnification of the display screen 13A according to the number of groups and displays the display screen 13A at the display magnification. Furthermore, when the display screen 13A is displayed on the display panel 13 at the display magnification, the display device 1 determines the position of the touch operation on the display screen 13A displayed at the display magnification based on the output signals output from the plurality of sense lines SL corresponding to the input signals input to each of the grouped drive lines DL.

[0068] With the above configuration, the user can perform touch operations on the enlarged display screen 13A. Therefore, when the user performs a touch operation on the display panel 13, the error between the touch operation position intended by the user and the touch operation position detected can be reduced, thereby improving the operability of touch operations on the display panel 13.

[0069] Furthermore, the display device 1 according to this embodiment is a touch panel having a plurality of drive lines DL arranged in parallel and a plurality of sense lines SL arranged in parallel intersecting the plurality of drive lines DL. It drives the plurality of drive lines DL by inputting an input signal in parallel, detects output signals from the plurality of sense lines SL in parallel, and detects touch operations on the touch panel based on a linear element sequence corresponding to the capacitance at each intersection of the plurality of drive lines DL and the plurality of sense lines SL, which is calculated based on a matrix operation between an input sequence corresponding to the magnitude of the input signal and an output sequence corresponding to the magnitude of the output signal.

[0070] Furthermore, the display device 1 inputs the input signal to multiple drive lines DL and detects the output signals output from multiple sense lines SL. The display device 1 also groups the multiple drive lines DL into multiple groups of a set number of adjacent drive lines DL, and inputs the same pattern of input signal to each of the grouped drive lines DL. Then, the display device 1 detects touch operations on the touch panel based on a linear element sequence calculated by matrix operations between the input sequence and the output sequence.

[0071] With the above configuration, for example, when a user brings their hand close to the touch panel to perform a touch operation, the spatial resolution can be increased by setting a small number of driveline DL groups, thereby improving the accuracy of touch operation position detection. Also, for example, when a user moves their hand away from the touch panel to perform a touch operation, by setting a large number of driveline DL groups, the electric field lines formed between the drive electrode and sense electrode can be extended to a position far from the touch panel, increasing the signal strength, and thus enabling reliable detection of touch operations at a distance from the touch panel. In other words, the distance from the touch panel at which touch operations can be detected (hover distance) can be increased. Therefore, it is possible to achieve both securing the hover distance and improving position detection accuracy.

[0072] Furthermore, with the above configuration, touch operations can be detected by adjusting the number of groups without adding any hardware, thus avoiding any increase in costs.

[0073] Furthermore, the control unit 11 may dynamically (in real time) change the number of groups based on the signal strength of the output signal when the user is performing a touch operation. The control unit 11 may also be able to accept an operation from the user to set the number of groups.

[0074] Also, as another embodiment, when the control unit 11 sets a display magnification according to the grouping number, the control unit 11 may cause a partial area of the display screen 13A to be displayed on the display panel 13 at the display magnification, and cause other areas to be displayed at the original display magnification. For example, as shown in FIG. 12, when the control unit 11 sets the grouping number to "2" or "3" and sets the display magnification to "200%", the control unit 11 causes the "5" that is the selection target among the display screens 13A to be displayed at 200% on the display panel 13, and causes other areas to be displayed at 100%. Thereby, since it becomes easy for the user to focus only on the selection target, the operability of the touch operation can be improved. Note that the control unit 11 may increase the display magnification of the selection target as the user's fingertip moves away from the display screen 13A.

[0075] Also, as another embodiment, when the distance L (operation distance) between the user's finger and the display screen 13A (see FIG. 3) is less than a predetermined distance, the control unit 11 sets the grouping number to M, and when the distance L is greater than or equal to the predetermined distance, the control unit 11 sets the grouping number to N (where M and N are natural numbers and M < N).

[0076] The touch operation detection device of this disclosure can also be applied to a display device that inputs an input signal (drive signal) to a group of drive lines, including some adjacent drive lines DL, among a plurality of drive lines arranged in parallel on a display panel 13, and determines the position of the touch operation based on an output signal (detection signal) corresponding to the input signal input to the drive line group. In the display device, for example, the control unit 11 inputs a first input signal to a first drive line DL group, including a plurality of drive lines DL, at a first timing, and at a second timing following the first timing, inputs a second input signal to a second drive line DL group, including some electrodes included in the first drive line group and one or more drive lines DL adjacent to the first drive line DL group, and detects the position of the touch operation based on a first output signal corresponding to the first input signal and a second output signal corresponding to the second input signal. Thus, the touch operation detection device of this disclosure can also be applied to a bundled drive system in which a plurality of adjacent drive lines DL are bundled together and driven sequentially for each of the plurality of drive lines DL.

[0077] Furthermore, the touch operation detection device of this disclosure may be a display device 1, or a control unit 11 (control device) which is a component of the display device 1. In other words, the touch operation detection device of this disclosure may include a control unit 11 and may not include a display panel 13 and a touch sensor 15 (touch panel). [Explanation of Symbols]

[0078] 1:Display device 11: Control Unit 12: Storage section 13: Display Panel 13A:Display screen 14:Operation section 15: Touch sensor 16: Analog Integrator 111: Drive Unit 112: Detection Processing Unit 113: Determination Processing Unit 114: Grouping Processing Unit 115: Configuration Processing Unit 116: Display processing department DL: ドライブライン SL :センスライン C1: No. 1 electrostatic capacity column C2: 2nd electrostatic capacity column C3: The third electrostatic capacity column C4: The 4th electrostatic capacity column d1: Symbol series d2: Symbol series d3: Symbol Series d4: Symbol Series

Claims

1. A touch operation detection device that inputs input signals to a plurality of drive lines arranged in parallel on a display panel and detects the position of a touch operation on a display screen displayed on the display panel based on output signals detected from a plurality of sense lines arranged in parallel and intersecting the plurality of drive lines on the display panel, A grouping processing unit that groups the aforementioned multiple drive lines into multiple groups for each set number of adjacent drive lines, A drive processing unit that inputs the input signal for each of the number of drive lines grouped by the grouping processing unit, A detection processing unit for detecting the output signals output from the plurality of sense lines, A setting processing unit that sets the display magnification of the display screen according to the number of groups, A display processing unit that displays the display screen on the display panel at the display magnification, When the display screen is displayed on the display panel at the display magnification by the display processing unit, a determination processing unit determines the position of the touch operation on the display screen displayed at the display magnification based on the output signals output from the plurality of sense lines corresponding to the input signals input for each drive line of the group number, Equipped with, The drive processing unit switches between a first drive mode in which the input signal is input to each M drive line when the number of groups is set to M by the grouping processing unit, and a second drive mode in which the input signal is input to each N drive line when the number of groups is set to N by the grouping processing unit (where M and N are natural numbers and M < N). The setting processing unit sets the display magnification in the second drive mode to a value greater than the display magnification in the first drive mode.

2. The drive processing unit, In the first operation mode, which accepts touch operations by contact with the display panel, the system switches to the first drive mode. In a second operation mode that accepts non-contact touch operations on the display panel, the system switches to the second drive mode. The touch operation detection device according to claim 1.

3. The determination processing unit detects the position of the touch operation based on a linear element sequence corresponding to the capacitance at each intersection of the multiple drive lines and the multiple sense lines, which is calculated based on a matrix operation between an input sequence corresponding to the magnitude of the input signals input in parallel to the multiple drive lines and an output sequence corresponding to the magnitude of the output signals output in parallel from the multiple sense lines. The touch operation detection device according to claim 1 or 2.

4. The drive processing unit drives the plurality of drive lines in parallel using a code sequence consisting of an Hadamard matrix as the input sequence. The touch operation detection device according to claim 3.

5. A touch operation detection method that inputs input signals to a plurality of drive lines arranged in parallel on a display panel and detects the position of a touch operation on a display screen displayed on the display panel based on output signals detected from a plurality of sense lines arranged in parallel and intersecting the plurality of drive lines on the display panel, One or more processors The aforementioned multiple drive lines are grouped into multiple groups, each group consisting of a set number of adjacent drive lines. The input signal is input to each of the grouped drive lines of the specified number of groups, The process involves detecting the output signals that are output from the plurality of sense lines, The display magnification of the display screen is set according to the number of groups, The display panel is to display the display screen at the display magnification, With the display screen displayed on the display panel at the display magnification, the position of the touch operation on the display screen displayed at the display magnification is determined based on the output signals output from the plurality of sense lines corresponding to the input signals input for each drive line of the group number, The system switches between a first drive mode in which the input signal is input to each of the M drive lines when the number of groups is set to M, and a second drive mode in which the input signal is input to each of the N drive lines when the number of groups is set to N (where M and N are natural numbers and M < N). Setting the display magnification in the second drive mode to a value greater than the display magnification in the first drive mode, A method for detecting touch operations to perform this action.

Images