Input display device

Abstract

The present invention addresses the problem of providing an input display device capable of detecting a side press operation on a three-dimensional operation unit without using a pressure sensor. A solution is provided. This input display device (100) is provided with: a display (110) for displaying an image; a capacitance-type touch sensor (120) attached to the display (110); a three-dimensional operation unit (132) attached to the touch sensor (120); and a touch detection unit (150) for detecting the touch position of a finger (F) on the three-dimensional operation unit (132). And an operation determination unit (160) for determining the presence or absence of a side pressing operation to the three-dimensional operation unit on the basis of the detected amount of movement of the touch position.

Description

Technical Field

[0001] The present invention relates to an input display device having a human-machine interface function, and more particularly to an input display device including a three-dimensional operating portion. Background Art

[0002] An input display device is disclosed in which a convex portion is provided on a touch panel arranged to overlap a display, and an image such as an operation icon is displayed at a position overlapping the convex portion (for example, Patent Document 1). The user performs input by touching the convex portion.

[0003] Prior art literature:

[0004] Patent Literature:

[0005] Patent Document 1: Japanese Patent Application Publication No. 2020-190832 Summary of the invention

[0006] Problems to be solved by the invention:

[0007] In a capacitive touch-operated display device, a user interface (hereinafter referred to as a three-dimensional UI) has been proposed in which a protective glass has a concave-convex shape so that a touch position can be recognized tactilely and the touch position can be understood without looking at it.

[0008] Figure 1 (A) is an operation example of a conventional flat touch panel, in which the user U visually recognizes the operation icon 12 displayed on the display 10 and performs input by touching the position of the operation icon 12 (a musical note in the example shown in the figure).

[0009] Figure 1 (B) is an operation example of a touch panel having a three-dimensional operation unit (three-dimensional parts) based on a three-dimensional UI. Figure 1 (C) is a schematic cross-sectional view of a three-dimensional operating unit. A transparent protective lens 26 including a concave-convex three-dimensional operating unit is installed on a touch sensor (touch panel) 24 including an electrostatic capacitance type sensor, and the display 20 displays an operation icon 22 at a position overlapping with the protective lens 26. The user U inputs by touching the protective lens 26 with a finger. When detecting a touch, a highly sensitive electrostatic sensor that can detect the electrostatic capacitance (distance) of a finger even if the distance is away from the sensor is used, and it is possible to determine whether a touch is present even from above the thick protective lens 26. As a result, in a situation where it is difficult to look at the vehicle-mounted display while driving, it is possible to reduce false touches (false operations).

[0010] In a stereoscopic UI, by analyzing touch gestures, a concave and convex button can have various operation methods. Figure 2 The knob 60 of the knob type rotating shape shown in (A) can be operated to be pinched and rotated by fingers F, and can also be operated as follows Figure 2 As shown in (B), the top surface is touched / pressed with a finger F in the direction of the arrow. Figure 2 As shown in (C), use finger F to flick / swipe the top surface in the direction of the arrow. Figure 2 As shown in (D), by pressing the side of the knob horizontally with a finger F (hereinafter referred to as the side pressing (tilt) operation of pressing the side of the three-dimensional operating unit), a variety of gesture operations can be detected and responses corresponding to the gestures can be made.

[0011] Such multifunctionalization of the concave and convex buttons helps to improve operability or reduce the number of three-dimensional parts attached to the touch panel. The more diverse the gestures that can be detected, the more multifunctionality of a button is improved.

[0012] In the above-mentioned rotary knob, the gesture is judged by referring to the movement of the touch detection point or the change of the detection capacitance, but Figure 2 The side pressing operation shown in (D) is an operation in which a force is applied in the upward / downward / leftward / rightward direction while the operating finger F is pressed (fixed) against the side of the knob. As a simple detection method for the side pressing operation, for example, Figure 3 The method of using a pressure sensing sensor is shown.

[0013] Figure 3 (A) is a schematic top view of the input display device. Figure 3 (B) and (C) are schematic cross-sectional views thereof. An image display unit 40 including a display or a touch sensor and a protective glass 50 mounted thereon are housed in a rectangular housing 30. A rotary knob 60 is mounted on the protective glass 50, for example, via an adhesive. Figure 3 (B) is a configuration example in which a pressure sensing sensor 70 is provided on the side of the image display unit 40. Figure 3 (C) is a configuration example in which a pressure sensitive sensor 70 is provided at the bottom of the image display unit 40. The pressure sensitive sensor 70 detects a change in resistance according to pressure, or detects the distance to an object by a photo reflector including a light emitting element and a light receiving element.

[0014] During the side pressing operation, if the side surface of the knob 60 is pressed horizontally by the operating finger F, the pressure sensor 70 detects the pressure or the distance from the finger F. However, adding the pressure sensor 70 to detect the side pressing operation will increase the cost of components or increase the number of negative factors such as the need to optimize the setting structure, and a detection method that does not rely on additional components such as a pressure sensor is desired.

[0015] The present invention is to solve such conventional problems, and an object of the present invention is to provide an input display device capable of detecting a side pressing operation on a three-dimensional operating unit without using a pressure sensitive sensor.

[0016] Means used to solve the problem:

[0017] The input display device involved in the present invention comprises: a display for displaying images, an electrostatic capacitive touch sensor installed on the display, a three-dimensional operating unit installed on the touch sensor and capacitively coupled to the touch sensor, a detection mechanism for detecting a touch position of an operating finger directed to the three-dimensional operating unit, and a judgment mechanism for judging whether a side press operation is performed on the three-dimensional operating unit based on the amount of movement in a specific direction of the touch position detected by the detection mechanism.

[0018] In one embodiment, the specific direction is determined based on a touch position of an operating finger directed toward the three-dimensional operating portion. In one embodiment, the judgment mechanism judges a side press operation when the amount of movement in the specific direction is greater than a threshold value. In one embodiment, the three-dimensional operating portion is mounted on the touch sensor via an elastic component that can be elastically deformed in a horizontal direction. In one embodiment, the three-dimensional operating portion is mounted on a protective glass, and the protective glass is mounted on the touch sensor via an elastic component that can be elastically deformed in a horizontal direction. In one embodiment, the detection mechanism detects a touch position of an operating finger directed toward a side surface of the three-dimensional operating portion, and the judgment mechanism judges whether a side press operation is present based on the amount of movement of the touch position caused by the operating finger being flattened when the side surface of the three-dimensional operating portion is pressed by the operating finger.

[0019] Effect of the invention:

[0020] According to the present invention, whether or not a side pressing operation is performed on the three-dimensional operating portion is judged based on the amount of movement of the touch position of the operating finger. Therefore, the side pressing operation can be detected with a low cost and simple structure without using a pressure sensing sensor. Thus, further multifunctionality of the operation of the three-dimensional operating portion can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 (A) shows an operation example of a flat touch panel. Figure 1 (B) shows an operation example of the touch panel of the three-dimensional operation unit. Figure 1 (C) is a schematic cross-sectional view of the three-dimensional operating unit.

[0022] Figure 2 The diagram shows a plurality of gesture examples assigned to a rotational knob.

[0023] Figure 3The diagram shows the structure of an input display device provided with a pressure-sensitive sensor for detecting a side-pressing operation on a rotary knob.

[0024] Figure 4 It is a diagram for explaining the outline of the input display device of the present invention.

[0025] Figure 5 It is a block diagram showing the structure of an input display device according to an embodiment of the present invention.

[0026] Figure 6 This is a flow chart showing an algorithm for detecting a side-pressing operation on a stereoscopic operating unit according to an embodiment of the present invention.

[0027] Figure 7 This is a diagram for explaining the relationship between the touch position on the three-dimensional operation unit and the movement direction of the finger.

[0028] Figure 8 The diagram shows an example of movement of a touch position detected when a rotary knob is pressed sideways in four directions: up, down, left, and right.

[0029] Fig. 9 It is a diagram showing an example of a three-dimensional operating unit with a side pressing function involved in another embodiment of the present invention.

[0030] Description of reference numerals:

[0031] 100: Input display device

[0032] 110: Display

[0033] 120: Touch sensor

[0034] 130: Protective glass

[0035] 132: Three-dimensional operation part (rotating knob)

[0036] 134: Adhesive

[0037] 140: Controller

[0038] 200, 210: cushion material DETAILED DESCRIPTION

[0039] The input display device of the present invention provides an interface between a human and a machine. The input display device of the present invention is not particularly limited, and is applicable to, for example, an electronic device equipped with a touch panel display. The electronic device equipped with a touch panel display is, for example, a vehicle-mounted device having a navigation function, an audio / video function, a television function, etc.

[0040] Next, an embodiment of the present invention is described. In this embodiment, when a side-pressing operation is performed on a three-dimensional operating portion (three-dimensional component), the side-pressing operation is detected by utilizing the fact that the finger is squeezed by pressing the three-dimensional operating portion. Figure 4 (A) and (B) show the principle. A protective glass 130 is mounted on the touch sensor 120, and a rotary knob 132 is mounted on the protective glass 130. The electrostatic capacitance type touch sensor 120 is arranged directly below the protective glass 130, and detects the touch position of the protective glass 130 or the touch position of the knob 132 based on the change of electrostatic capacitance.

[0041] Figure 4 (A) indicates a state where the side of the knob 132 is touched by the finger F (the state of touching). At this time, the touch sensor 120 detects the coordinates (detection point) P1 of the finger F touching the side of the knob 132. When the user performs a side pressing operation on the knob 132, Figure 4 As shown in (B), the finger F is pressed in the Q direction by the side of the knob 132. The touch sensor 120 detects the coordinates (detection point) P2 of the flattened finger F. By observing the movement amount (|P1-P2|) of the detection point (coordinate) caused by the flattening of the finger during the side pressing operation, the side pressing operation can be detected only by the touch sensor 120.

[0042] In addition, the three-dimensional operating part is not limited to the rotating shape of the knob type, and can also be other shapes that can be operated by side pressing. In addition, the three-dimensional operating part (knob 132) can be integrally formed with the protective glass 130, or can be fixed to the protective glass 130 via an adhesive or the like.

[0043] [Example]

[0044] Next, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Figure 5 1 is a block diagram showing the structure of an input display device according to an embodiment of the present invention. The input display device 100 of this embodiment is configured to include: a display 110 for displaying images or videos, a touch sensor 120 including an electrostatic capacitance type sensor mounted on the display 110, a protective glass 130 mounted on the touch sensor 120, a three-dimensional operation unit (three-dimensional component) 132 as a three-dimensional UI mounted on the protective glass 130, and a controller 140 for controlling image display of the display 110 or touch detection / operation judgment of the touch sensor 120.

[0045] The display 110 is not particularly limited, and includes, for example, a liquid crystal panel or an organic EL panel, and displays image data supplied from the controller 140. For example, an operation icon representing an input operation may be displayed at a corresponding position of the stereoscopic operation unit 132.

[0046] The touch sensor 120 includes, for example, a plurality of sensors (detection units) formed at positions where a plurality of electrode lines on the X side and the Y side intersect, and detects electrostatic capacitance when a user's finger or hand approaches or contacts the protective glass 130 or the three-dimensional operation unit 132. The touch sensor 120 provides an input interface for the user to input an icon or the like displayed on the display 110.

[0047] The protective glass 130 mounted on the surface of the touch sensor 120 may be a part of the touch sensor 120 or may be prepared separately from the touch sensor 120 .

[0048] A stereoscopic operation unit 132 as a stereoscopic UI is mounted on the cover glass 130 . The stereoscopic operation unit 132 is made of a material that is capacitively coupled to the touch sensor 120 , and an operation to the stereoscopic operation unit 132 is detected by the touch sensor 120 .

[0049] The three-dimensional operating unit 132 includes a portion protruding from the surface of the protective glass 130, and the protruding portion enables the user to perform gesture operations at a position away from the protective glass 130. The three-dimensional operating unit 132 is not particularly limited in shape, size, thickness, etc. as long as it can be operated by side pressing. The three-dimensional operating unit 132 is, for example, a rotating knob, a rectangular protruding slider, a concave-convex button, a keyboard-shaped protrusion, etc., and the side pressing operation is performed by pressing the side of these three-dimensional parts with a finger. In addition, the three-dimensional operating unit 132 does not necessarily have to be transparent, and characters, symbols, graphics, etc. that express the content of the input operation can also be drawn on it.

[0050] The stereoscopic operation unit 132 can be used as Figure 5 As shown in (B), it is formed integrally with the protective glass 130, or it can be Figure 5 As shown in (C), the bottom surface of the three-dimensional operation unit 132 can be attached to the protective glass 130 by a double-sided adhesive 134. In this case, the three-dimensional operation unit 132 can be made of a material different from the protective glass 130, such as acrylic, polycarbonate, etc.

[0051] The installation position (coordinates) of the stereoscopic operation unit 132 on the touch sensor 120 is registered in the memory of the controller 140. When the controller 140 detects the position of the finger approaching or touching the touch sensor 120, it determines whether it is an operation to the stereoscopic operation unit 132. In addition, the controller 140 can also register information related to the shape, size, height, etc. of the stereoscopic operation unit 132. The controller 140 can also display an icon representing the input operation near the stereoscopic operation unit 132 via the display 110, and the user visually recognizes the icon drawn on the stereoscopic operation unit 132 or the icon displayed on the display 110, and performs the input operation via the stereoscopic operation unit 132.

[0052] The controller 140 includes hardware and / or software resources, such as a microcontroller including a processing unit, ROM / RAM, etc., to perform overall processing of the input display device. For example, the controller 140 performs display processing of the display 110, performs touch detection or operation judgment (touch position detection, side press operation judgment, etc.) according to the output value of the touch sensor 120, or performs image display / image switching processing accordingly.

[0053] In one embodiment, the controller 140 Figure 5 As shown, the touch sensor 120 is configured to include a touch detection unit 150, an operation determination unit 160, and a display control unit 170. The touch detection unit 150 drives a plurality of electrode lines on the X side and / or the Y side of the touch sensor 120, measures the electrostatic capacitance of each detection unit (sensor) of the driven electrode line, and detects a touch position based on the measurement result.

[0054] The operation determination unit 160 determines a touch operation on the display 110 or an operation on the stereoscopic operation unit 132 based on the detection result of the touch detection unit 150. For example, the operation determination unit 160 determines a touch operation on the display 110, a touch operation on the stereoscopic operation unit 132, or a side press operation.

[0055] The display control unit 170 displays an image or video on the display 110, or displays an icon at a position corresponding to the stereoscopic operation unit 132 as needed. If no icon is drawn on the operation surface of the stereoscopic operation unit 132, the display 110 can display an icon representing the operation content of the stereoscopic operation unit 132. In addition, the display control unit 170 can also switch the image displayed on the display 110 to another image in response to the operation judgment unit 160 judging the operation.

[0056] Next, refer to Figure 6The process of the present embodiment describes the detection algorithm of the side pressing operation of the stereoscopic operation unit of the input display device. First, the touch detection unit 150 determines whether a touch is detected based on the measured electrostatic capacitance (S100). Specifically, when the electrostatic capacitance is greater than a threshold value, it is determined that a touch is detected.

[0057] The detection result of the touch detection unit 150 is provided to the operation determination unit 160. When the touch is detected, the operation determination unit 160 determines whether there is one or more operating fingers around the three-dimensional operation unit 132 (S110). Figure 4 As shown in (A), the coordinates P1 of the finger F touching the side of the three-dimensional operating unit 132 are compared with the outline of the three-dimensional operating unit 132 (the outline is known based on the installation coordinates, shape, and size of the three-dimensional operating unit 132). If the coordinates P1 are located near the outline, it is determined that the finger F is located around the three-dimensional operating unit 132. In addition, in the case of a multi-touch function for detecting multiple fingers, it is determined for each finger whether there is a finger around the three-dimensional operating unit.

[0058] When it is determined that there is an operating finger around the three-dimensional operating unit 132, the operation determination unit 160 determines whether the distance (the amount of movement of the finger) of the continuous touch detection points (coordinates P1) of a certain operating finger is below the threshold value (S120). This process determines whether the finger is in a state of being pressed against (fixed) on the three-dimensional operating unit 132, thereby excluding the situation where the three-dimensional operating unit is rotated or the finger touches only during groping. In a certain method, whether the finger is fixed is determined based on the discreteness of the detection coordinates recorded in a certain period of time according to the performance of the sensor, or whether the finger is fixed is determined by comparing the average value of the distance between two points, etc.

[0059] When it is determined that the finger is in a state of being pressed against the three-dimensional operating unit 132, the operation determination unit 160 determines whether the detection point of a certain operating finger has moved a distance greater than a threshold in one direction of up, down, left, or right (S130). In other words, it is determined whether a side press operation has been performed. In a certain embodiment, as a threshold value for the amount of movement for determining a side press operation, for example, the load of a push-type mechanical switch (a load of about 3N is applied when lightly gripped) is used as a reference, and for example, the amount of movement generated when a load of about 4N is applied is set as the threshold value so that no reaction occurs when only the knob is gripped.

[0060] In addition, it is necessary to predetermine the direction of the detection point coordinates to be detected according to the position of the finger touching the three-dimensional operation unit 132. This is to prevent the rotation operation on the three-dimensional operation unit 132 from being mistakenly judged as a side pressing operation.

[0061] For example, Figure 7As shown, the touch position of the finger is divided into four areas A, B, C, and D at intervals of 90 degrees from the center of the knob 132, and the three-dimensional operation unit 160 determines whether the movement distance of the finger in the directions Da, Db, Dc, and Dd corresponding to the areas A, B, C, and D is greater than the threshold. For example, if the finger is placed against the area B and the movement distance of the finger in the direction Db is greater than the threshold, it is determined to be a side press operation, but in the case of rotating the finger clockwise, even if the movement distance in the direction Da becomes greater than the threshold, it is not determined to be a downward side press operation because it is different from the direction Db of the touch position B.

[0062] If the operation determination unit 160 determines that the operation is a side pressing operation, the display control unit 170 performs feedback corresponding to the side pressing operation ( S140 ), for example, by drawing a GUI on the display 110 or outputting sound or vibration via a driving unit (not shown).

[0063] Next, the operation judgment unit 160 judges whether the detection point has moved more than a certain distance from the position after the side press is judged (S150). This is a judgment on whether the side press operation is completed. In the case of moving more than a certain distance, the side press operation continues, so it returns to step S100. In the case of not moving more than a certain distance, it is judged that the side press operation is completed. Next, the operation judgment unit 160 judges whether a touch is detected based on the detection result of the touch detection unit 150 (S160). If the touch is continuously detected, it returns to step S150. If the touch is not detected (the finger is removed), the process ends.

[0064] On the other hand, when a touch is not detected in step S100 , when one or more fingers are not detected in step S110 , and when the movement amount of the finger is smaller than the threshold in step S120 , the process ends.

[0065] Figure 8 The diagram shows the changes in the detection point when the knob-type rotating part is actually pressed in four directions, up, down, left, and right, as a three-dimensional operating unit. The dotted line shows the outer shape of the knob, and the solid line shows the detection point (coordinate). It can be determined from the figure that the detection point moves toward the inside of the knob rotating part during the side-pressing operation.

[0066] As described above, according to this embodiment, the side pressing operation to the three-dimensional operating part is judged based on the movement amount of the detection point (coordinate) caused by the finger being squeezed. Therefore, there is no need for a pressure sensing sensor to judge the side pressing operation. The operation of the three-dimensional operating part can be further multifunctionalized and the operability can be improved with a low-cost and simple structure.

[0067] Next, another embodiment of the present invention is described. In the above-mentioned embodiment, the presence or absence of a side press operation is determined based on the amount of movement of the detection coordinates caused by the fingers being squeezed flat. However, depending on the performance of the touch sensor, it is sometimes impossible to accurately determine the side press based on the amount of movement of the detection coordinates caused by the fingers being squeezed flat. Therefore, in this other embodiment, in order to more accurately detect the side press operation, a structure is adopted that amplifies the amount of movement of the detection coordinates caused by the fingers being squeezed flat.

[0068] For example, Fig. 9 As shown in (A) and (B) of FIG. 1 , a cushion material 200 capable of elastic deformation in the horizontal direction is sandwiched at the joint between the three-dimensional operating part (e.g., a rotary knob) 132 and the protective glass 130. The cushion material 200 is not particularly limited in material as long as it can be capacitively coupled with the touch sensor 120. The cushion material 200 is fixed between the three-dimensional operating part 132 and the protective glass 130 using, for example, an adhesive. Fig. 9 As shown in (A), from the state where the side of the three-dimensional operating unit 132 is touched with the finger F, during the side pressing operation, as shown in Fig. 9 As shown in (B), the three-dimensional operating part 132 is pressed in the horizontal direction Q with a finger F, so that the finger F is flattened, and the pad material 200 is elastically deformed in the horizontal direction Q. The movement amount of the detection point (coordinate) detected by the touch sensor 120 is amplified, and it is easy to set the threshold for judging the side press operation.

[0069] In addition, if Fig. 9 As shown in (C) and (D) of FIG. 1 , a structure in which an elastically deformable cushion material 210 is sandwiched between the protective glass 130 and the touch sensor 120 may also be adopted. In this case, Fig. 9 From the state (C), when the side is pressed, Fig. 9 As shown in (D), the finger F is pressed in the horizontal direction Q, so that the finger F is flattened, and the mat material 210 is elastically deformed in the horizontal direction Q, and the movement amount of the detection point (coordinate) detected by the touch sensor 120 is magnified. The number, configuration, and shape of the mat material 210 are appropriately selected according to the degree of magnification of the movement amount of the detection point.

[0070] Although specific embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments, and various modifications and changes can be made within the scope of the gist of the invention described in the claims.

Claims

1. An input display device, wherein: have: A display for displaying images; An electrostatic capacitive touch sensor is mounted on the display; a three-dimensional operating unit, mounted on the touch sensor and capacitively coupled to the touch sensor; A detection mechanism for detecting a touch position of an operating finger pointing to the three-dimensional operating part; as well as The determination means determines whether a side pressing operation on the three-dimensional operation unit is performed based on the movement amount in the specific direction of the touch position detected by the detection means.

2. The input display device according to claim 1, wherein: The specific direction is determined according to a touch position of the operating finger pointing to the three-dimensional operating unit.

3. The input display device according to claim 1, wherein: The determination unit determines that the movement in the specific direction is a side pressing operation when the movement amount in the specific direction is equal to or greater than a threshold value.

4. The input display device according to claim 1, wherein: The three-dimensional operation unit is mounted on the touch sensor via an elastic member that is elastically deformable in a horizontal direction.

5. The input display device according to claim 1, wherein: The three-dimensional operation unit is mounted on a protection glass, and the protection glass is mounted on the touch sensor via an elastic member that can elastically deform in a horizontal direction.

6. The input display device according to claim 1, wherein: The detection mechanism detects a touch position of the operating finger directed toward the side surface of the three-dimensional operating unit. The determination means determines whether or not the side pressing operation is performed based on an amount of movement of a touch position due to squeezing of the operating finger when the operating finger presses the side surface of the three-dimensional operating portion.

Images