Input display device

Abstract

To provide an input display device which can prevent unintended rotation on a three-dimensional operation section from being detected.SOLUTION: An input display device 100 includes: a display 110 for displaying an image; a capacitive touch panel 120 mounted on the display 110 and including at least one three-dimensional UI section (knob) 130 formed on a surface; a touch detection section 150 which measures capacitance of the touch panel 120 and detects an operation on the touch panel 120 on the basis of the measured capacitance; and an operation determination section 160 which detects a touch operation on the touch panel based on the result measured by the touch detection section or a rotation operation on the three-dimensional UI section. The touch detection section detects a rotation on the three-dimensional UI section from the change in coordinates of a finger touching the three-dimensional UI section. The operation determination section determines that the rotation detected while a finger distance is decreasing is valid, and determines that the rotation detected while the finger distance is not decreasing is invalid.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an input display device having an interface function between a human and a machine, and more particularly to an input display device including a three-dimensional operation unit.

Background Art

[0002] An input display device is disclosed in which convex portions are provided on a touch panel disposed so as to overlap a display, and an image such as an operation icon is displayed at a position overlapping the convex portions (for example, Patent Document 1). The user inputs by touching the convex portions.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In a display device that performs capacitive touch operations, a user interface (hereinafter referred to as a three-dimensional UI) has been proposed in which the touch position can be tactilely recognized by giving the cover glass an uneven shape, and the touch position can be understood without looking.

[0005] FIG. 1(A) shows an operation example of a conventional flat touch panel. The user U visually recognizes the operation icon 12 displayed on the display 10 and inputs by performing a touch operation on the position of the operation icon 12 (the example in the figure is a musical note).

[0006] Figure 1(B) shows an example of operation of a touch panel with a three-dimensional UI, and Figure 1(C) is a schematic cross-sectional view of the three-dimensional UI. A transparent cover lens 26 with an uneven surface is attached to the touch panel 24, and the display 20 displays operation icons 22 in a position that overlaps with the cover lens 26. User U performs input by touching the cover glass 26 with their finger. A highly sensitive electrostatic sensor is used for touch detection, which can detect the capacitance (distance) of the finger even when it is far from the sensor, making it possible to determine whether or not a touch has been made even through the thick cover lens 26. This makes it possible to reduce touch errors (operation errors) in situations where it is difficult to pay attention to the in-vehicle display while driving.

[0007] The 3D UI also includes cylindrical knobs. Operation of the knobs involves sliding a fingertip along their sides to rotate them; the knobs themselves do not actually rotate. For example, as shown in Figure 2(A), an icon 40 representing a function assigned to the operation of knob 30 (e.g., volume) is displayed below knob 30, and a gauge 50 indicating the amount of rotation of knob 30 is displayed around it.

[0008] The user grasps the cylindrical knob 30 with their finger U, similar to a mechanical switch knob, and then rotates their finger U by sliding their fingertip along the side of the knob 30, as shown in Figure 2(B). The user refers to the gauge 50, and if further rotation is required, they return their finger U to its original position and rotate their finger U again by sliding their fingertip along the side of the knob 30, as shown in Figure 2(C). The user repeats the rotation operations in Figures 2(B) and 2(C) until the input amount of rotation reaches the desired value.

[0009] However, in an algorithm that simply detects tracing (slipping) the side of the knob, when moving finger U from Figure 2(B) to Figure 2(C), if finger U is moved sufficiently away from the side of the knob and returned to its original position, the operation will not be detected. However, even if only a part of finger U brushes against the side of the knob, reverse rotation will be detected, which causes malfunctions. When reverse rotation is detected, the rotation operation on the knob is reversed, even though a rotation operation is being performed on the knob. With a normal mechanical switch, rotation will not occur unless a certain amount of force is applied, so such malfunctions are less likely to occur.

[0010] To prevent false detection of reverse rotation of the knob, the user must take care to keep their fingers sufficiently away from the side of the knob and avoid brushing against it each time they perform the operation shown in Figure 2(C), which reduces the operability of the knob. Given this situation, it is desirable to prevent the detection of unintended rotation caused by fingertips brushing against the side of the knob.

[0011] The present invention aims to solve these conventional problems and to provide an input display device that can prevent the detection of unintended rotation of a three-dimensional operating section. [Means for solving the problem]

[0012] The input display device according to the present invention comprises a display for displaying an image, a capacitive touch panel mounted on the display and having at least one three-dimensional operating part on its surface, and a detection means for measuring the capacitance of the touch panel and detecting an operation on the touch panel based on the measured capacitance. The detection means detects rotation to the operating part from a change in the coordinate position of a finger touching the operating part, and determines that the detected rotation is valid when the distance between the finger and the touch panel decreases, and determines that the detected rotation is invalid when the distance does not decrease.

[0013] In one embodiment, the detection means determines that a detected rotation is valid when the measured capacitance is increasing, and determines that a detected rotation is invalid when the measured capacitance is not increasing. In another embodiment, the detection means compares the capacitance before detecting rotation to the operating unit with the capacitance after detecting the rotation, and determines that the detected rotation is valid if the difference in capacitance is greater than or equal to a threshold, and determines that the detected rotation is invalid if it is not greater than or equal to a threshold. In another embodiment, the input display device further includes a display means for displaying a gauge representing the amount of rotation detected around the operating unit of the display. In another embodiment, the display means for displaying an icon representing an input operation at a corresponding position on the operating unit of the display. In another embodiment, the operating unit has the shape of a cylindrical knob or thumb. [Effects of the Invention]

[0014] According to the present invention, rotation detected when the distance between the finger and the touch panel decreases is determined to be valid, and rotation detected when the distance does not decrease is determined to be invalid, thereby preventing false detections caused by unintended rotation operations by the user. [Brief explanation of the drawing]

[0015] [Figure 1] Figure 1(A) shows an example of operation of a flat touch panel, Figure 1(B) shows an example of operation of a touch panel with a 3D UI, and Figure 1(C) is a schematic cross-sectional view of the 3D UI. [Figure 2] This diagram illustrates the challenges of rotating knobs in conventional 3D UIs. [Figure 3] This is a block diagram showing the configuration of an input display device according to an embodiment of the present invention. [Figure 4] This figure illustrates an overview of an input display device according to an embodiment of the present invention. [Figure 5] This is a flowchart illustrating the operation of an input display device according to an embodiment of the present invention. [Figure 6]A table showing a detection example of a rotation operation when applying the algorithm according to an embodiment of the present invention and a detection example of a conventional rotation operation. [Figure 7] A diagram showing another configuration example of the three-dimensional UI unit of the input display device according to an embodiment of the present invention.

Mode for Carrying Out the Invention

[0016] Next, embodiments of the present invention will be described. The input display device of the present invention provides an interface between a human and a machine. The input display device of the present invention is not particularly limited, but is applied to, for example, an electronic device equipped with a display with a touch panel. An electronic device equipped with a display with a touch panel is, for example, an in-vehicle device having a navigation function, an audio-visual function, a television function, and the like.

Example

[0017] Next, an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 3 is a block diagram showing the configuration of an input display device according to an embodiment of the present invention. The input display device 100 of the present embodiment includes a display 110 for displaying images and videos, a capacitive touch panel 120 mounted on the display 110, a three-dimensional UI unit (or operation unit) 130 having one or more three-dimensional shapes attached to the surface of the touch panel 120, and a controller 140 for controlling image display of the display 110, touch detection of the touch panel 110, and the like.

[0018] The display 110 is not particularly limited, but includes, for example, a liquid crystal panel or an organic EL panel, and displays image data provided from the controller 140. For example, below the three-dimensional UI unit 130, an icon representing an input operation of the three-dimensional UI unit 130 is displayed.

[0019] The touch panel 120 includes, for example, a plurality of detection units (sensors) formed at positions where a plurality of X-side and Y-side electrode lines intersect. When a user's finger, hand, etc. approaches or touches the touch panel 110, these detection units change the capacitance. The touch panel 120 is mounted on the display 110 and provides an input interface for the user to input to icons and the like displayed on the display 110.

[0020] The touch panel 120 further includes one or more three-dimensional UI parts (operation parts) 130 on the surface of the transparent panel. In FIG. 3, an example is shown where four three-dimensional UI parts 130 are attached below the touch panel 120, but the number and size of the three-dimensional UI parts 130 are not particularly limited. The three-dimensional UI part 130 is made of a transparent material (such as acrylic, polycarbonate, glass, etc.) so that icons displayed on the display 110 can be visually recognized. The bottom surface of the three-dimensional UI part 130 is attached to a determined position of the touch panel 120 using, for example, a double-sided adhesive. Information indicating the attachment position and shape of the three-dimensional UI part 130 is registered in the controller 140 in advance. For example, if the three-dimensional UI part 130 is cylindrical, the coordinates of its center, radius, and height are registered, and if it is rectangular, the coordinates of the intersection of its diagonals, the coordinates of its corners, and height, etc. are registered.

[0021] In this embodiment, the three-dimensional UI part 130 is a three-dimensional shape that can be rotated by the user and is composed of a cylindrical knob or a dial as shown in FIG. 2 (hereinafter, the three-dimensional UI part may be referred to as the knob 130). When the user performs a rotation operation on the knob 130, the user pinches the knob 130 with one or more fingers and performs an operation such as sliding the side surface of the knob with the finger pad. When such a rotation operation is performed, first, the coordinates of the touch position on the knob 130 are detected, and the rotation angle of the finger is detected from the change in the coordinates of the touch position.

[0022] Next, the invention overview of the input display device 100 of this embodiment will be described. In this embodiment, by detecting the change in capacitance corresponding to the change in the distance from the finger to the detection unit (sensor) of the touch panel when the knob 130 is rotated (hereinafter referred to as finger distance), it is determined whether the rotation was intended by the user and the detection of erroneous operation of reverse rotation of the knob is prevented.

[0023] Figure 4 shows a graph illustrating the finger distance (capacitance value) after performing five rotations of the knob. The top of the graph shows the finger distance D at the start of the rotation and the finger distance D1 at the end of the rotation. The vertical axis of the graph represents the capacitance value, and the horizontal axis represents the time of the rotation.

[0024] As can be seen from the graph, when a user intentionally rotates the knob 130, a phenomenon occurs where the finger distance decreases. In other words, the finger distance D when touching the knob 130 to start the rotation operation gradually decreases as the rotation operation progresses, decreasing to the finger distance D1 (D>D1) when the rotation operation ends. The capacitance of the sensor part of the touch panel 120 increases as the finger distance decreases. Therefore, as shown in the graph, the capacitance value is relatively small when the rotation of the knob 130 begins, and then increases as the knob 130 rotates. This tendency for the finger distance to decrease is the same for both left and right rotation, and also occurs similarly for both the right and left hands.

[0025] In contrast, when the finger is returned to its original position (for example, between the first and second rotations), the capacitance value clearly decreases. Therefore, by observing the change in capacitance value during rotation, it is possible to determine whether the rotation was intentional or unintentional, simply due to the finger brushing against the knob as it was being returned to its original position. This phenomenon of finger distance is presumed to occur because the finger slides (slids into) the sensor side when the user applies some force while turning the knob.

[0026] The rotation detection algorithm of this embodiment utilizes the finger distance phenomenon described above and improves the accuracy of rotation detection by ignoring or disabling rotation determination and detection when capacitance decreases during the rotation operation period, thereby preventing the detection of unintended reverse rotation.

[0027] Next, the controller 140 will be described in detail. The controller 140 is electrically connected to the display 110 and the touch panel 120, and controls the image of the display 110 and the touch of the touch panel 120. The controller 140 holds data such as the height, shape, position, and video display area of ​​the 3D UI section 130, and is responsible for all processing of the input display device, including display area correction processing, touch detection and operation determination (touch coordinate detection, finger distance / capacitance detection) from the output values ​​of the touch panel 120, and corresponding video display / video switching processing. The processing of the controller 140 is executed by hardware and / or software, for example, using a microcontroller including an arithmetic processing unit and ROM / RAM.

[0028] As shown in Figure 3, the controller 140 is composed of a touch detection unit 150, an operation determination unit 160, and a display control unit 170. The touch detection unit 150 drives multiple electrode lines on the X and / or Y sides of the touch panel 120, measures the capacitance of each detection unit (sensor) on the driven electrode lines, and provides the measurement results to the operation determination unit 160.

[0029] The operation determination unit 160 detects touch operations on the touch panel 120 and rotation operations on the 3D UI unit 130 based on the measurement results of the touch detection unit 150. Here, "touch" includes not only contact between the user's finger and the touch panel 120, but also when the finger approaches within a certain distance of the touch panel 120. For example, when the user's finger touches or approaches the flat surface of the touch panel 120, the operation determination unit 160 determines that a touch operation has occurred based on the change in capacitance of the corresponding detection unit. Similarly, when the user's finger touches or approaches the 3D UI unit 130, the capacitance of the detection unit corresponding to the 3D UI unit 130 changes, and this change in capacitance determines that a touch operation has occurred on the 3D UI unit 130. If multiple fingers touch or approach the 3D UI unit 130, the touch operations (touch positions) of multiple fingers are detected.

[0030] Furthermore, when the operation determination unit 160 detects a finger touch on the knob 130 as shown in Figure 4, it detects the rotation angle or amount of rotation of the knob based on the change in the coordinates of the touch position. If a rotation operation on the knob is detected, the operation determination unit 160 further detects an increase or decrease in the capacitance value and determines whether or not it is an intended rotation operation based on that increase or decrease. In other words, as explained in Figure 4, if the capacitance increases in response to the finger getting closer, it is determined to be an intended rotation operation, and if the capacitance decreases, it is determined to be an unintended rotation operation. Once the operation determination unit 160 determines a touch operation or a rotation operation, the controller 140 provides the input to other electronic devices or performs display control or the like in response to the input.

[0031] The display control unit 170 displays images or videos on the display 110 and icons at corresponding positions on the 3D UI unit 130. The icons are designs that represent user input operations. When the 3D UI unit 130 is a knob, the display control unit 170 displays, for example, an icon representing volume operation below the knob, and also displays a gauge (scale) around the knob that represents the rotation angle or amount of rotation detected by the rotation operation on the knob. In addition, the display control unit 170 switches the image displayed on the display 120 to a different image when the operation determination unit 160 determines that a touch operation or rotation operation has occurred.

[0032] Next, an example of the operation of the input display device of this embodiment will be described with reference to the flow chart in Figure 5. The touch detection unit 150 measures the capacitance of the sensor part of the touch panel 120 at a constant measurement period (for example, 80 fps (frames / second)) and provides this measurement result to the operation determination unit 160. The operation determination unit 160 detects whether or not a finger has touched the knob 130 from this measurement result (S100). The coordinate position of the knob 130 is registered in advance, and the operation determination unit 160 determines that it is a touch to the knob 130 if the finger touch position corresponds to the coordinate position or coordinate range of the knob 130. If multiple fingers touch the knob, the touch positions of multiple fingers are detected, and for example, if the touch position of any one finger corresponds to the coordinate position or coordinate range of the knob, it is determined that it is a touch to the knob.

[0033] Next, the operation determination unit 160 detects the finger distance from the finger touching the knob 130 (S110). In the example in Figure 4, this is the detection of finger distance D. Finger distance detection is the detection of the magnitude of the capacitance value. Next, the operation determination unit 160 determines whether the finger distance is greater than or equal to a threshold (S120). The height of the knob 130 is registered in advance, and the operation determination unit 160 determines that a finger is touching the knob 130 if the finger distance is less than the height of the knob 130. If the finger distance is greater than or equal to the threshold, the operation determination unit 160 stores the detected finger distance in memory (S130).

[0034] If the operation determination unit 160 determines that a finger is touching the knob, it monitors the capacitance obtained at each measurement cycle of the touch panel 120, detects the rotation angle of the finger to the knob (hereinafter referred to as the finger angle) from the change in coordinates indicating the finger's touch position, and stores the detected finger angle in memory (S140). The finger angle is calculated from the change in coordinates of the touch position during the period in which the capacitance value is increasing.

[0035] Next, the operation determination unit 160 determines whether the finger angle is above a threshold (S150). That is, it determines whether the amount of rotation of the knob is above a certain level (for example, whether the amount of rotation of the knob is 15 degrees or more). If it determines that the finger angle is above the threshold, the operation determination unit 160 obtains the finger distance from the capacitance value at the time the finger angle was detected and stores it in memory (S160). In the example in Figure 4, this is the detection of the finger distance D1.

[0036] Next, the operation determination unit 160 compares the finger distance before and after detecting the finger angle and determines whether the finger distance has increased by a threshold or more compared to the previously acquired value (S170). In other words, it compares the finger distance stored in memory in step S130 (finger distance D in Figure 4) with the finger distance stored in memory in step S160 (finger distance D1 in Figure 4) and determines that D-D1 ≥ threshold.

[0037] The operation determination unit 160 determines that the detected finger angle is a rotation operation intended by the user if the finger distance is less than or equal to a threshold (S180). Therefore, the display control unit 170 determines that the detected finger angle is a valid rotation operation and displays the amount of rotation corresponding to the finger angle on the gauge based on the determination result of the operation determination unit 160.

[0038] On the other hand, if the finger distance is not smaller than a threshold, or if the finger distance is larger, the detected finger angle is determined to be an unintended rotational operation by the user (for example, a scraping motion when returning the finger to its original position), and the detected finger angle is determined to be invalid or ignored (S190).

[0039] Figure 6 shows the evaluation results of an example of rotation operation detection using the algorithm of this embodiment and an example of rotation operation detection using a conventional algorithm. In this evaluation, subjects A to E were measured as follows: how many times they rotated the knob until the volume gauge reached its maximum (number of rotation operations), how many times reverse rotation occurred before the rotation operation was completed (number of reverse rotations), and the rate of reverse rotation (reverse rotation rate).

[0040] When the algorithm of this embodiment is applied, it can be seen that the occurrence of reverse rotation is significantly reduced. Consequently, it becomes possible to rotate the volume smoothly, the number of rotation operations is reduced, and operability is improved. The rate of reverse rotation was reduced by about 60% from the overall average.

[0041] Next, a modified example of the three-dimensional UI section of this embodiment will be described. In the example described above, the knob used as the three-dimensional UI section was configured in a cylindrical shape, but it is not limited to this. By using a trapezoidal knob with a slope that makes it easier for fingers to slide, the phenomenon of fingers sliding further in during rotational operation can be made more pronounced, the capacitance value can be changed more smoothly (without noise), and the stability of detecting rotational operation can be improved. For example, as shown in Figure 7(A), an inverted frustoconical knob 200 with a diameter that gradually increases upwards may be used, or as shown in Figure 7(B), a frustoconical knob 210 with a diameter that gradually decreases upwards may be used. Regardless of the shape of the knob, as shown in Figure 4, it was confirmed that the distance between the fingers decreases when the user performs the rotational operation they intend. Also, as shown in Figure 7(C), a spiral 222 may be formed on the side of the knob 220 to make it easier for fingers to slide further in during rotational operation.

[0042] In the above embodiment, a cylindrical knob was used as an example of the three-dimensional UI part, but this is just one example, and the shape of the knob or knob is not particularly limited as long as it reduces the distance between the fingers when performing rotational operations and produces the desired effect.

[0043] Although preferred embodiments of the present invention have been described in detail above, the present invention is not limited to any particular embodiment, and various modifications and changes are possible within the scope of the gist of the invention as described in the claims. [Explanation of symbols]

[0044] 30: Nobu 40: Icon 50: Gauge 100: Input display device 110: Display 120: Touch panel 130: 3D UI section (knob) 140: Controller U:Finger D, D1: Finger distance

Claims

1. A display for displaying images, A capacitive touch panel mounted on the aforementioned display, having at least one three-dimensional operating section on its surface, The system includes a detection means for measuring the capacitance of the touch panel and detecting an operation on the touch panel based on the measured capacitance. The detection means detects rotation to the operation unit from a change in the coordinate position of a finger touching the operation unit, and determines that the detected rotation is valid when the distance between the finger and the touch panel decreases, and determines that the detected rotation is invalid when the distance does not decrease.

2. The input display device according to claim 1, wherein the detection means determines that the detected rotation is valid when the measured capacitance is increasing, and determines that the detected rotation is invalid when the measured capacitance is not increasing.

3. The input display device according to claim 2, wherein the detection means compares the capacitance before detecting rotation to the operating unit with the capacitance after detecting the rotation, determines that the detected rotation is valid if the difference in capacitance is greater than or equal to a threshold, and determines that the detected rotation is invalid if it is not greater than or equal to a threshold.

4. The input display device according to claim 1, further comprising display means for displaying a gauge representing the detected amount of rotation around the operation section of the display.

5. The input display device according to claim 4, wherein the display means causes icons representing input operations to be displayed at corresponding positions on the operation section of the display.

6. The input display device according to claim 1, wherein the operating section has the shape of a cylindrical knob or dial.

Images