Tactile presentation device

Abstract

To present an appropriate haptic sense to a finger of a user which is touching a vibration surface.SOLUTION: The haptic sense presentation device includes: a touch surface; an actuator for vibrating the touch surface along one axis in the touch surface; and a controller for controlling the vibration along the axis of the actuator and presenting a haptic sense to the finger touching the touch surface. The controller controls the actuator so that the actuator will estimate the direction in which the finger touching the touch surface was projected on the touch surface and change the intensity of the vibration according to the direction of the projection.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a tactile presentation device. [Background technology]

[0002] In recent years, electronic devices equipped with touch panels, such as smartphones and car navigation systems, have become widespread. When a user operates an object, such as an icon, included in a user interface displayed via the touch panel, the electronic device activates a function corresponding to the object.

[0003] Since the surface of a touch panel is uniformly hard, the same tactile sensation is given to the user regardless of where the user's finger touches the touch panel. Therefore, there is known a technique for providing feedback to the user, which allows the user to perceive the presence of an object, or, when a function corresponding to an object is activated, allows the user to perceive that an operation for that function has been accepted. This technique presents a tactile sensation to the touching finger by vibrating the touch panel in the in-plane direction of the touch panel. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] US Patent Application Publication No. 2012 / 0262394 [Patent Document 2] JP 2013-97438 A Summary of the Invention [Problem to be solved by the invention]

[0005] The inventors discovered that the strength of the stimulus perceived by the user changes depending on the relationship between the direction of the in-plane vibration of the vibration surface and the axis of the touching finger. Specifically, they found that vibration in a direction perpendicular to the long axis of the finger (the axis along which the finger extends) can only cause the user to perceive a weaker stimulus than the same vibration in a parallel direction. When the stimulus given to the finger becomes weaker, the user has a harder time perceiving a certain tactile sensation (e.g., a clicking sensation). [Means for solving the problem]

[0006] A tactile presentation device according to one aspect of the present disclosure includes a touch surface having a fixed orientation, an actuator for vibrating the touch surface along one axis in the surface, and a control device for controlling the vibration of the actuator along the one axis to present a tactile sensation to a finger in contact with the touch surface. The control device controls the actuator so that the start direction of vibration for presenting a tactile sensation to the finger is within a range of minus 43° to plus 43° with respect to a direction in which a vertical direction is projected onto the touch surface or the opposite direction.

[0007] A tactile presentation device according to another aspect of the present disclosure includes a touch surface, an actuator for vibrating the touch surface along one axis in the surface, and a control device for controlling the vibration of the actuator along the one axis to present a tactile sensation to a finger in contact with the touch surface. The control device estimates an orientation of the finger in contact with the touch surface when projected onto the touch surface, and controls the actuator to change an intensity of the vibration according to the projection orientation.

[0008] A tactile presentation device according to yet another aspect of the present disclosure includes a touch surface, a display device whose position relative to the touch surface is fixed, an actuator that vibrates the touch surface along one axis in the surface, and a control device that controls the vibration of the actuator along the one axis to present a tactile sensation to a finger in contact with the touch surface. The control device controls the actuator so that the starting direction of vibration for presenting a tactile sensation to the finger is within a range of minus 43 degrees to plus 43 degrees with respect to the vertical direction of an image displayed on the display device.

[0009] A tactile presentation device according to yet another aspect of the present disclosure includes a touch surface, an actuator for vibrating the touch surface along one axis in the plane, a spring for defining a neutral position of vibration of the touch surface, and a control device for controlling the vibration of the actuator along the one axis to present a tactile sensation to a finger in contact with the touch surface. The actuator is a solenoid, and the control device applies first and second drive pulses to the solenoid, the first and second drive pulses having equal voltage amplitudes and a width of the second drive pulse narrower than a width of the first drive pulse.

[0010] A tactile presentation device according to yet another embodiment of the present disclosure includes a touch surface having a fixed orientation, an actuator that vibrates the touch surface along one axis within the surface, and a control device that controls the vibration of the actuator along the one axis to present a tactile sensation to a finger in contact with the touch surface, wherein the control device controls the actuator so that the starting direction of vibration for presenting a tactile sensation to the finger is within a range of minus 43° to plus 43° with respect to the direction from the tip to the base of the finger projected onto the touch surface or the opposite direction. Effect of the Invention

[0011] A tactile presentation device according to an aspect of the present disclosure can present an appropriate tactile sensation to a user's finger touching a vibrating surface. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of an electronic device according to a first embodiment. [Diagram 2] 1 shows a state in which a user's finger touches an area corresponding to an object image on the touch surface of a touch panel in the first embodiment. [Diagram 3] 4 is a flowchart illustrating an example of processing executed by the electronic device in the first embodiment. [Figure 4A] In the first embodiment, the state in which the long axis of the finger and the vibration direction (vibration axis) are approximately parallel is shown. [Figure 4B] In the first embodiment, the state in which the long axis of the finger and the vibration direction (vibration axis) are approximately perpendicular is shown. [Diagram 5] 3A and 3B show schematic diagrams of the drive voltage applied to the linear solenoid actuator and the vibration of the vibrator in measurement in the first embodiment. [Figure 6] Indicates the vibration direction of the actuator used in the measurements. [Figure 7] In the first embodiment, the subjective evaluation results in the measurement are shown. [Figure 8] In the first embodiment, an analysis of variance table of the evaluation results shown in FIG. [Figure 9] In the first embodiment, the relationship between the psychological scale value and the yardstick Y0.01 for each of the four vibration directions is shown. [Figure 10] In the first embodiment, a graph of the measurement results is shown, which shows the frequency distribution of the vibration direction in which the vibration was felt to be the "strongest" and the frequency distribution of the vibration direction in which the vibration was felt to be the "weakest." [Figure 11] In the first embodiment, a graph of the measurement results is shown, along with a frequency distribution of the vibration direction in which the vibration was felt to be "strongest" and a normal distribution curve fitted to the frequency distribution. [Figure 12] FIG. 11 is a diagram illustrating an example of a configuration of an electronic device according to a second embodiment. [Figure 13] 13 is a schematic diagram illustrating an example of a logical configuration of a control device according to a third embodiment. [Figure 14A]13 shows an example of the acceleration of the lateral actuator controlled by the haptic control unit according to the angle between the long axis of the finger and the in-plane vibration direction in the third embodiment. [Figure 14B] 13 shows an example of the acceleration of the lateral actuator controlled by the haptic control unit according to the angle between the long axis of the finger and the in-plane vibration direction in the third embodiment. [Figure 14C] 13 shows an example of the acceleration of the lateral actuator controlled by the haptic control unit according to the angle between the long axis of the finger and the in-plane vibration direction in the third embodiment. [Figure 15] In the third embodiment, another graph of the measurement results described in the first embodiment is shown. [Figure 16A] In embodiment 3, a finger and its contact area are shown in contact with the touch surface. [Figure 16B] In embodiment 3, the contact area of ​​the finger and the axis parallel to the major axis of the ellipse fitted to the contact area are shown. [Figure 17] In the third embodiment, the relationship between the touch surface and the vertical direction (the direction of gravity) is shown. [Figure 18] 13A and 13B are schematic diagrams illustrating the relationship between a face image of a user captured by a built-in camera of an electronic device and a touch surface in a third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present disclosure will be described with reference to the accompanying drawings. It should be noted that the embodiment is merely an example for implementing the present disclosure and does not limit the technical scope. <Embodiment 1> 1 is a diagram showing an example of the configuration of an electronic device 10 of embodiment 1. The electronic device 10 (tactile presentation device) includes a tactile presentation panel 100 and a control device 110. The tactile presentation panel 100 and the control device 110 are connected via a connection line.

[0014] The tactile presentation panel 100 presents a UI (user interface) including at least one object (image) to a user and accepts operations via the UI. The tactile presentation panel 100 also provides the user with a tactile sensation for perceiving operations of objects included in the UI.

[0015] The tactile presentation panel 100 includes a touch panel 101, a liquid crystal display 103, a carrier 104, a base 105, a lateral actuator 106, and a leaf spring 107. The components of the tactile presentation panel 100 may be housed in, for example, any housing. The touch panel 101 and the liquid crystal display 103 are components that realize a display screen that displays a UI, and the carrier 104, the lateral actuator 106, and the leaf spring 107 are components that realize mechanical vibration.

[0016] The base 105 is a member that serves as the foundation of the tactile presentation panel 100. A lateral actuator 106 and a leaf spring 107 are installed on the base 105. In addition, a carrier 104 that vibrates due to the action of the lateral actuator 106 and the leaf spring 107 is provided on the base 105. The carrier 104 vibrates along a specific axis relative to the base 105 by the lateral actuator 106 (also called lateral motion). The vibration of the carrier 104 achieved by the lateral actuator 106 and the leaf spring 107 is mechanical vibration. In the following description, the vibration for tactile presentation is one or more reciprocating motions.

[0017] The lateral actuator 106 is a device that generates a movement along one axis parallel to the touch surface of the tactile presentation panel 100. The touch surface is the main surface of the touch panel 101 that is in contact with a finger, and is a tactile presentation surface that presents (feeds back) a tactile sensation to the finger. The leaf spring 107 is used as a mechanism for generating vibration in accordance with the movement of the lateral actuator 106. The leaf spring 107 defines a neutral position of vibration of the touch surface. The carrier 104 is a member that serves as a base for stacking members that constitute a display screen. The liquid crystal display 103 and the touch panel 101 are provided on the carrier 104. FIG. 1 shows an example of the configuration of the tactile presentation panel 100, and the tactile presentation panel 100 may have another configuration. For example, the carrier 104 may be omitted, and the liquid crystal display 103 may be directly connected to the lateral actuator 106 and the leaf spring 107.

[0018] The liquid crystal display 103 and the touch panel 101 are installed so as to be approximately parallel to the base 105. The touch panel 101 is disposed on the front side of the liquid crystal display 103. In the following, the side on which a user using the tactile presentation panel 100 is positioned is referred to as the front side. The side opposite the front side is referred to as the rear side.

[0019] The touch panel 101 detects the position of a user's finger touching the touch surface, which is the front surface of the touch panel. Any type of touch panel can be used for the touch panel 101, and for example, a resistive film type, a surface capacitance type, or a projected capacitance type touch panel can be used. Also, a panel having both a touch panel function and a function of presenting a tactile sensation by static electricity may be used.

[0020] The liquid crystal display 103 displays a UI image including objects. Any type of display different from a liquid crystal display, such as an OLED (Organic Light Emitting Diode) display or a micro LED display, can be used.

[0021] The control device 110 may include one or more arithmetic devices that execute programs and one or more storage devices. The arithmetic devices may include, for example, a processor, a GPU (Graphics Processing Unit), and an FPGA (Field Programmable Gate Array). The storage device stores programs and data used by the control device 110. The storage device may include volatile or non-volatile memory. The storage device includes a work area used by the programs.

[0022] The control device 110 operates as a functional unit (module) for controlling the tactile presentation panel 100. Specifically, the control device 110 operates as a display control unit 111 and a tactile control unit. The display control unit 111 controls the display of the UI on the display screen. Specifically, the display control unit 111 acquires setting information for the UI from a storage device, and controls the liquid crystal display 103 based on the information so that a UI including at least one object is displayed.

[0023] The touch detection unit 115 detects contact of the user's finger with the touch panel 101 based on the output from the touch panel 101, and also identifies the touch position of the user's finger on the touch panel 101. For example, when the touch detection unit 115 detects a touch at a position corresponding to a specific object image, the touch detection unit 115 outputs a request for generating mechanical vibration to the haptic control unit 113. In response to the touch detection unit 115, the haptic control unit 113 controls the lateral actuator 106 to generate mechanical vibration.

[0024] The driving pulse applied to the lateral actuator 106 is composed of a first pulse and a second pulse, and the first pulse and the second pulse have the same voltage amplitude. The lateral actuator shifts the touch surface in one direction from the initial state by application of the first pulse, and then starts shifting in the opposite direction and starts reciprocating motion when the application of the first pulse ends.

[0025] Next, by applying a second pulse after a predetermined non-application time, the shift is stopped when the touch surface returns to the initial state. In order to present a crisp tactile sensation such as a clicking sensation to the user, the non-application time and the second pulse width may be set so that the lateral actuator stops after shifting only once from the initial state. Also, the non-application time may be set longer than in the case of only one reciprocation described above so that the lateral actuator stops after multiple reciprocations from the initial state. In this way, a tactile sensation with a long duration of vibration can be presented.

[0026] The tactile presentation panel 100 may further include a force sensor. The force sensor detects a force applied by a user in a direction perpendicular to a main surface of the tactile presentation panel 100 (touch panel 101). For example, when a specific area is touched on the touch panel 101 and the value detected by the force sensor exceeds a threshold, the tactile control unit 113 vibrates the lateral actuator 106. Note that, regarding each functional unit of the control device 110, multiple functional units may be integrated into one functional unit, or one functional unit may be divided into multiple functional units for each function.

[0027] Next, an example of processing executed by the electronic device 10 will be described. Fig. 2 shows a state in which the user's finger 205 touches an area corresponding to the object image 201 on the touch surface 150 of the touch panel 101. When the user's finger 205 (or other pointing objects) touches an area of ​​a specific object image 201, the electronic device 10 vibrates the touch panel 101 (the tactile presentation panel 100) in vibration directions (two mutually opposite directions) 161. This makes it possible to give the user's finger 205, for example, a clicking sensation.

[0028] 3 is a flowchart for explaining an example of processing executed by the electronic device 10. The display control unit 111 selects a UI image based on an operation state and the like, and controls the liquid crystal display 103 to display the new UI image (step S101). The display control unit 111 stores, in a storage device, position information of an area of ​​an object image that provides a tactile sensation by in-plane vibration of the touch panel 101.

[0029] The touch detection unit 115 executes a detection process (step S102). The detection process detects a touch of the user's finger on the touch panel 101 and identifies the position of a touch area on the touch panel 101. Specifically, the touch detection unit 115 detects a signal indicating a touch of the user's finger from the touch panel 101. For example, the touch detection unit 115 detects a change in the capacitance of the touch panel 101 as a signal.

[0030] The touch detection unit 115 calculates coordinates indicating the contact position of the user's finger on the touch panel 101. For example, the coordinates are calculated based on the position of an electrode where a change in capacitance is detected. The touch detection unit 115 stores the calculated coordinates in a storage device. The touch detection unit 115 notifies the tactile control unit 113 that the touch panel 101 has been touched.

[0031] If the tactile object is touched (S103: YES), the tactile control unit 113 executes a tactile presentation process (S104). Specifically, upon receiving a notification from the touch detection unit 115, the tactile control unit 113 acquires position information of the object image presenting the tactile sensation and position information of the touch area from the storage device, and compares them. If the touch area at least partially overlaps with the area of ​​the object image, the tactile control unit 113 vibrates the tactile presentation panel 100 (touch panel 101) along one axis in the plane, providing the user with feedback by mechanical vibration.

[0032] Specifically, the haptic control unit 113 generates mechanical vibrations by controlling the lateral actuator 106. This causes the carrier 104 to vibrate along a specific axis (in a specific direction). The liquid crystal display 103 and the touch panel 101 are placed on the carrier 104, and the liquid crystal display 103 and the touch panel 101 vibrate together with the carrier 104.

[0033] The touch detection unit 115 notifies the display control unit 111 that the touch panel 101 has been touched. The display control unit 111 acquires position information of the touch area from the storage device, and identifies the relationship between the position of the touch area and the currently displayed UI image. If a UI image switching object is selected (S105: YES), the display control unit 111 switches to a new UI image (S101).

[0034] Next, the presentation of tactile sensation by the tactile control unit 113 and the lateral actuator 106 will be described. The tactile control unit 113 vibrates the touch panel 101 (tactile presentation panel 100) along one axis along the touch surface (main surface), thereby giving a tactile sensation (for example, a clicking sensation) to the touching finger. From the study of the inventors, it was found that the tactile intensity felt by the user changes depending on the angle between the in-plane vibration direction of the touch surface and the long axis of the finger (axis along the extending finger) as viewed in the normal direction to the touch surface. In the following description, the explanation of the angle between the axis of the finger and the in-plane vibration direction (in-plane vibration axis) means the angle as viewed in the normal direction to the touch surface, that is, the angle between the axis of the finger projected on the touch surface and the vibration direction (vibration axis).

[0035] For example, Fig. 4A shows a state in which the long axis of finger 205 and vibration direction 161A (vibration axis) are substantially parallel, that is, the angle between the long axis along the direction in which finger 205 extends and vibration direction 161A is substantially 0° or 180°. Fig. 4B shows a state in which the long axis of finger 205 and vibration direction (vibration axis) 161B are substantially perpendicular, that is, the angle between the long axis along the direction in which finger 205 extends and vibration direction 161B is substantially 90° or 270°. According to research by the inventors, it has been found that for the same vibration, a user feels a stronger tactile sensation in the state shown in Fig. 4A than in the state shown in Fig. 4B.

[0036] The inventors performed measurements on the tactile intensity felt by the user depending on the angle between the vibration axis of the tactile presentation panel and the long axis of the finger. The measurement results are described below. The device used for the measurements was a linear solenoid actuator as a lateral actuator. Figure 5 shows a schematic diagram of the drive voltage applied to the linear solenoid actuator and the horizontal displacement of the touch surface in the measurements. The vibrator performed one reciprocating motion for one tactile presentation.

[0037] For the measurement, while a finger was touching the touch surface, a drive voltage as shown in Figure 5 was applied to the linear solenoid actuator. The linear solenoid actuator gave the evaluator a tactile sensation (click sensation) with one reciprocating motion. Specifically, the linear solenoid actuator shifted the touch surface from its initial state in one direction according to the drive voltage, and then shifted it in the opposite direction to return it to its initial state.

[0038] More specifically, the driving voltage used in the measurement was two square wave pulses with a voltage of 13 V. First, a first pulse with a width of 10.0 ms was applied, followed by a non-application time of 4.1 ms, followed by a second pulse with a width of 2.1 ms, which was shorter than the first pulse. The linear solenoid actuator shifts the touch surface in one direction from the initial state by application of the first pulse, and then starts shifting in the opposite direction when application of the first pulse ends. The shift is stopped when the touch surface returns to the initial state by application of the subsequent second pulse.

[0039] That is, in one tactile sensation operation, the touch surface shifts in one direction from the initial state, and then shifts in the opposite direction to return to the initial state. The measurement evaluated the intensity felt by the user by this one tactile sensation operation. Note that the measurement results described below can also be obtained by any type of lateral actuator that can provide similar vibrations.

[0040] Fig. 6 shows the vibration direction of the actuator used in the measurement. As shown in Fig. 6, the measurement was performed by applying vibrations of 0°, 90°, 180°, and 270° clockwise from the direction from the tip to the base of finger 205 as a reference, with the vibration (reciprocating motion) starting direction being set as the reference. Multiple evaluators subjectively evaluated the strength of the vibration at each angle. The evaluation used Scheffe's paired comparison method, and evaluated the strength of the vibration at a later angle relative to the strength of the vibration at a previous angle.

[0041] Figure 7 shows the subjective evaluation results from the measurements. The score was 2 if the vibration at the later angle was stronger than the vibration at the earlier angle, 1 if the later vibration was slightly stronger, 0 if there was no difference, -1 if the later vibration was slightly weaker, and -2 if the later vibration was weak. The psychological scale value is given by (average evaluation value (early) - average evaluation value (later)) / 2. Figure 8 shows an analysis of variance table of the evaluation results shown in Figure 7. The results of this experiment show that there is a significant difference at a risk level of 1% for the "residual error E" in the "main effect of subject α."

[0042] Figure 9 shows the psychological scale values ​​for each of the four vibration directions and the Yardstick Y 0.01 The relationship between Yardstick Y 0.01 is expressed by the following formula. In the formula, q is the studentized range, V E is the unbiased variance of the residual E, m is the number of evaluation subjects (=4), and r is the number of evaluators. This is the number of evaluators in this experiment.

[0043]

number

[0044] From the evaluation results of the above measurements, a significant difference was found at a risk rate of 1% between vibration of displacement in the long axis direction of the finger (0° and 180°) and vibration of displacement in the short axis direction of the finger (perpendicular to the long axis) (90° and 270°). In other words, it was found that the vibration of displacement in the long axis direction of the finger is perceived as stronger than the vibration of displacement in the short axis direction of the finger. On the other hand, no significant difference in perceived intensity was found between vibration at 0° and vibration at 180°.

[0045] Furthermore, the inventors have studied the vibration direction in which the user feels the vibration stronger. The evaluators subjectively determined the vibration direction in which the vibration was felt to be the "strongest" and the vibration direction in which the vibration was felt to be the "weakest." The measurement was performed by measuring the relationship between the strongest and weakest vibration directions determined by each evaluator and the longitudinal axis direction of the touched finger.

[0046] FIG. 10 shows a graph of the measurement results, showing the frequency distribution of the vibration direction in which the vibration was felt to be the "strongest" and the frequency distribution of the vibration direction in which the vibration was felt to be the "weakest". The graph also shows normal distribution curves fitted to each frequency distribution. In the graph of FIG. 10, the angle of the vibration direction at which the probability density is reversed (the normal distribution curves intersect) is 43°. It was found that the vibration stimulus was felt to be strong relatively often when the angle between the direction from the tip to the base along the long axis of the finger and the starting direction of the reciprocating motion (vibration) was in the range of 0°±43°. Also, as described above, since no significant difference in perceived intensity was observed between vibration at 0° and vibration at 180°, it can be said that the same is true in the range of 180°±43°.

[0047] FIG. 11 shows a graph of the measurement results, including the frequency distribution of the vibration directions in which the vibration was felt to be the "strongest" and a normal distribution curve fitted to the frequency distribution. The central 50% range of the distribution shown by the normal distribution curve is the range of 0°±19°. It was found that the vibration stimulus was felt to be strong more often when the angle between the direction from the tip to the base along the long axis of the finger and the starting direction of the reciprocating motion was in the range of 0°±19°. As mentioned above, since no significant difference in perceived intensity was observed between vibration at 0° and vibration at 180°, it can be said that the same is true in the range of 180°±19°.

[0048] From the above measurement results, it can be seen that suitable tactile feedback can be given to the finger when the angle between the starting direction of the reciprocating motion (vibration) for tactile feedback and one direction along the long axis of the finger is within a predetermined angle range. Among the many electronic devices including touch panels in use, there are electronic devices in which the orientation of the touch surface is fixed and installed, and it is assumed that the user will use the touch surface facing directly. ATMs (Automatic Teller Machines) and ticket vending machines installed in stations are examples of such electronic devices.

[0049] In electronic devices that are intended for use by a user facing the device, the user generally touches the touch surface with the index finger or middle finger. The tip of the finger in contact with the touch surface generally faces the upper side of the touch surface, that is, the direction from the tip to the base of the finger projected onto the touch surface approximately coincides with the direction vertical to the touch surface.

[0050] Therefore, in an example of a tactile presentation device having a fixed touch surface (tactile presentation surface) such as an ATM or ticket machine that is intended to be touched by a user's finger facing directly at the touch surface, the starting direction of vibration for tactile presentation is within a range of minus 43° to plus 43° with respect to the direction (0°) where the vertical direction is projected onto the touch surface or the opposite direction (180°). In other words, the vibration axis is within a range of minus 43° to plus 43° from the axis where the vertical axis is projected onto the touch surface.

[0051] In a more preferred example, the starting direction of vibration for presenting a tactile sensation is in the range of minus 19° to plus 19° with respect to the direction (0°) of the vertical direction projected onto the touch surface or the opposite direction (180°). In other words, the vibration axis is in the range of minus 19° to plus 19° from the axis of the vertical axis projected onto the touch surface. With such vibration, as described above, it is possible to present an appropriate tactile sensation to more users.

[0052] As described above, the electronic device 10, which is a tactile presentation device, may include a touch surface 150 with a fixed orientation, a lateral actuator 106 that vibrates the touch surface 150 along one axis in the plane, and a control device 110 that controls the vibration of the lateral actuator 106 along one axis to present a tactile sensation to a finger in contact with the touch surface.

[0053] The control device 110 may control the lateral actuator so that the start direction of vibration for presenting a tactile sensation to the finger is within a range of minus 43° to plus 43° with respect to the direction of the vertical direction projected onto the touch surface or the opposite direction. The control device 110 may also control the lateral actuator so that the start direction of vibration for presenting a tactile sensation to the finger is within a range of minus 19° to plus 19° with respect to the direction of the vertical direction projected onto the touch surface or the opposite direction.

[0054] The above configuration can be applied to a device in which the orientation of the touch surface is not fixed like a mobile terminal, but the orientation of the display screen and its display image is fixed relative to the touch surface. The orientation of the display image relative to the display screen can be fixed, for example, always or in the initial setting. The direction in which the vertical direction is projected onto the touch surface and the opposite direction can be rephrased as the direction from the top to the bottom of the display image (display screen) and the opposite direction, respectively. In general use of the device, the direction from the top to the bottom of the display image is approximately parallel to the direction in which the vertical direction is projected onto the display screen. Therefore, this configuration can present an appropriate tactile sensation to the user.

[0055] <Embodiment 2> 12 is a diagram showing an example of the configuration of an electronic device 10 of embodiment 2. Description will be omitted for the same configuration as in embodiment 1. The tactile presentation panel 100 includes a touch panel 101, a liquid crystal display 103, a carrier 104, a base 105, a lateral actuator 106, and a leaf spring 107.

[0056] The liquid crystal display 103 and the touch panel 101 are provided on the carrier 104. Fig. 12 shows an example of the configuration of the tactile presentation panel 100, and the tactile presentation panel 100 may have other configurations. For example, the carrier 104 may be omitted, and the liquid crystal display 103 may be directly connected to the lateral actuator 106 and the leaf spring 107.

[0057] The liquid crystal display 103 and the touch panel 101 are placed approximately parallel to the base 105. The touch panel 101 is disposed in front of the liquid crystal display 103. In the following, the side of the tactile presentation panel 100 on which the UI is presented is referred to as the front side. The side opposite the front side is referred to as the rear side.

[0058] The touch panel 101 may be fixed to the liquid crystal display 103 with an adhesive (OCA or OCR), so that the touch panel 101 displaces together with the liquid crystal display 103, or the touch panel 101 and the liquid crystal display 103 may be separated, so that only the touch panel 101 displaces.

[0059] The liquid crystal display 103 displays a UI image including an object. The liquid crystal display 103 may use a liquid crystal display as in the first embodiment, or may use any type of display other than a liquid crystal display, such as an OLED display or a micro LED display.

[0060] The control device 110 has a display direction determination unit 116 in addition to the components of the first embodiment. The display direction determination unit 116 detects the inclination of the electronic device 10 and determines the up-down direction of the UI image (display) with respect to the display screen. The display direction determination unit 116 can determine the up-down direction of the display using a conventional technique that uses, for example, a three-axis acceleration sensor that senses acceleration in three-axis directions. The display control unit 111 controls the liquid crystal display 103 based on the determination result of the display direction determination unit 116 to display the UI image on the display screen.

[0061] When using an electronic device that includes a touch panel and accepts operations via a UI displayed on a display screen, such as in embodiment 2, a user generally touches the touch surface with the tip of his or her finger facing upward in the displayed image. In other words, the direction from the tip to the base of the finger projected onto the touch surface approximately coincides with the up-down direction of the display.

[0062] Therefore, from the measurement results described in the first embodiment, when providing suitable tactile feedback to a user's finger, in an example of a tactile presentation device having a touch surface (tactile presentation surface) on which a user is expected to perform a touch operation on a UI displayed on a display screen, the starting direction of vibration for tactile presentation is within a range of minus 43° to plus 43° with respect to the top-to-bottom direction of the displayed image (0°) or the opposite direction (180°). In other words, the vibration axis is within a range of minus 43° to plus 43° from the vertical axis 102 of the display.

[0063] In a more preferred example, the starting direction of vibration for tactile presentation is within a range of minus 19° to plus 19° from the top-to-bottom direction of the displayed image (0°) or the opposite direction (180°). In other words, the vibration axis is within a range of minus 19° to plus 19° from the vertical axis 102 of the display. With such vibration, it is possible to present an appropriate tactile sensation to more users, as in the first embodiment.

[0064] As described above, the electronic device 10, which is a tactile presentation device, can include a touch surface, a liquid crystal display 103 whose position relative to the touch surface is fixed, a lateral actuator 106 that vibrates the touch surface along one axis in the plane, and a control device 110 that controls the vibration of the lateral actuator 106 along one axis to present a tactile sensation to a finger in contact with the touch surface.

[0065] The control device 110 may control the lateral actuator so that the start direction of vibration for presenting a tactile sensation to the finger is within a range of minus 43° to plus 43° with respect to the top-to-bottom direction of the display image or the opposite direction. The control device 110 may also control the lateral actuator so that the start direction of vibration for presenting a tactile sensation to the finger is within a range of minus 19° to plus 19° with respect to the top-to-bottom direction of the display image or the opposite direction.

[0066] In addition, the display device of this embodiment is configured such that the inclination of the electronic device 10 is variable, and the up-down direction of the display changes. In this case, the vibration direction is also changed according to the change in the display direction. To achieve this, for example, the conventional technology described in Japanese Patent No. 6489120 can be used to configure the movable part (carrier) to vibrate along multiple axes parallel to the touch surface. Alternatively, in FIG. 12, it can also be achieved by adding a second base equipped with an actuator to the front or rear side of the base 105 so as to vibrate in a direction perpendicular to the vibration direction of the lateral actuator 106.

[0067] <Embodiment 3> As described in the first embodiment, the tactile intensity felt varies depending on the angle between the in-plane vibration direction of the tactile presentation panel and the long axis of the finger. Specifically, the tactile intensity is strong when the vibration direction is parallel to the long axis of the finger, and weak when the vibration direction is perpendicular to the long axis of the finger. Moreover, the tactile intensity decreases as the vibration direction changes from parallel to perpendicular to the long axis of the finger.

[0068] The tactile presentation device of this embodiment estimates the orientation of a finger in contact with a touch surface when projected onto the touch surface, and controls the intensity of in-plane vibration (lateral motion) based on the estimated orientation. When the intensity of the in-plane vibration increases, the intensity of the tactile sensation (stimulus) perceived by the user from the finger increases when the angle of the finger is fixed. The tactile presentation device can increase or decrease the vibration intensity, for example, by increasing or decreasing the displacement (amplitude), speed and / or acceleration of the vibration.

[0069] 12 is a schematic diagram showing an example of a logical configuration of the control device 110 of this embodiment. In addition to the components of the first embodiment, a finger direction estimation unit 117 is included. The finger direction estimation unit 117 detects the direction of the long axis of the finger in contact with the touch surface or the angle between the in-plane vibration axis and the long axis of the finger, and estimates the direction of the finger. An example of a method in which the finger direction estimation unit 117 detects the direction of the long axis of the finger will be described later. The tactile control unit 113 controls the lateral actuator 106 based on the direction of the long axis of the finger detected by the finger direction estimation unit 117.

[0070] 14A, 14B, and 14C each show an example of the acceleration of the lateral actuator 106 controlled by the haptic control unit 113 according to the angle between the long axis of the finger and the in-plane vibration direction. In the graphs of FIG. 14A, 13B, and 13C, the horizontal axis indicates the angle between the long axis of the finger and the in-plane vibration axis, respectively. The vertical axis indicates the acceleration. Therefore, two directions of the long axis of the finger correspond to each angle other than 0° and 180°. As described in the first embodiment, the finger direction estimation unit 117 may detect the angle between the vibration start direction and the direction from the tip to the base of the finger, and the haptic control unit 113 may control the vibration intensity of the lateral actuator 106 according to the detected angle (0° to 360°).

[0071] In the control example shown in Fig. 14A, the minimum acceleration is applied at 0° and 180°, where the stimulus is easily perceived, and the maximum acceleration is applied at 90°, where the stimulus is difficult to perceive. The acceleration increases proportionally from 0° to 90°, and decreases proportionally from 90° to 0°. In the example of Fig. 14A, the proportional constants of increase and decrease are the same, but they may be different.

[0072] In the control example shown in FIG. 14B, the minimum acceleration is applied at 0° and 180°, where the stimulus is easily perceived, and the maximum acceleration is applied at 90°, where the stimulus is difficult to perceive. The acceleration is constant from 0° to 19°, increases proportionally from 19° to 69°, and is constant from 69° to 90°. The acceleration is also constant from 90° to 111°, decreases proportionally from 111° to 161°, and is constant from 161° to 180°. In the example of FIG. 14B, the change in acceleration is symmetrical with respect to 90°. The proportional coefficients of increase and decrease may be different.

[0073] The angles 19° and 161° correspond to the values ​​that define the range in which the vibration stimulus is felt to be stronger than other angles, as described in the first embodiment. The angles 69° and 111° are determined as follows. FIG. 15 shows another graph of the measurement results described in the first embodiment. The graph shows the frequency distribution of the vibration start direction in which the vibration was felt to be the "weakest" and a normal distribution curve fitted to the frequency distribution. The central 50% range of the distribution shown by the normal distribution curve is the range of 90°±21°. In this range, the vibration stimulus is more often felt to be weak. Therefore, the highest acceleration is given in this range. Since no significant difference in perceived intensity is observed between the vibration at 90° and the vibration at 270°, the same can be said for -90°±21°.

[0074] In the control example shown in FIG. 14C, the minimum acceleration is applied at 0° and 180°, where the stimulus is easily perceived, and the maximum acceleration is applied at 90°, where the stimulus is difficult to perceive. The acceleration increases from 0° to 90°, and decreases from 90° to 180°. The rate of increase and decrease of the acceleration is not constant, but follows a predetermined function. In the example of FIG. 14C, the change in acceleration is shown by a curve. In the example of FIG. 14C, the change in acceleration is symmetrical around 90°, but may be asymmetrical.

[0075] As described above, the control device 110 can control the lateral actuator 106 so that the vibration strength is stronger when the direction of the finger projected onto the touch surface is perpendicular to the vibration axis of the lateral actuator 106 than when the direction is parallel to the axis. Also, as in the examples of Figures 14A, 14B, and 14C, the control device 110 may control the lateral actuator 106 so that the vibration strength gradually increases from a direction horizontal to a direction perpendicular to the vibration within a specific range of directions.

[0076] Next, an example of a method for detecting the direction of the long axis of a finger will be described. One known method estimates the orientation of a finger from the contact surface of the finger on the touch surface 150 of the touch panel 101. For example, the touch panel 101 is a capacitive touch panel. FIG. 16A shows a finger 205 and its contact area 220 in contact with the touch surface 150. The touch detection unit 115 stores information on the shape of the contact area 220 of the finger 205 in a storage device.

[0077] The finger direction estimation unit 117 obtains information on the contact area 220 from the storage device, and fits an ellipse to the contact area 220. The finger direction estimation unit 117 estimates that the major axis of the fitted ellipse is parallel to the major axis of the finger. FIG. 16B shows the contact area 220 of the finger 205 and an axis 225 parallel to the major axis of the ellipse fitted to the contact area 220. The finger direction estimation unit 117 stores information on the angle of the axis 225 on the touch surface 150 in the storage device. The haptic control unit 113 controls the lateral actuator 106 based on the angle θ between the vibration axis 165 on the touch surface 150 and the estimated major axis 225 of the finger.

[0078] The finger direction estimation unit 117 may determine the direction from the tip of the finger to the base on the axis 225. For example, when the touch surface 150 is fixed, such as in an ATM machine or a ticket vending machine described in the first embodiment, the direction from the tip of the finger to the base may be determined by referring to a reference direction predefined on the touch surface 150, for example, a direction from the upper side to the lower side of the touch surface 150. Also, as described later, when the electronic device 10 is portable and the orientation of the touch surface 150 (its reference direction) based on the vertical direction can be determined, the finger direction estimation unit 117 can determine the direction from the tip of the finger to the base based on these directions.

[0079] Another method for detecting the direction of the long axis of the finger is to estimate the direction of the finger projected onto the touch surface 150 based on the output of a three-axis acceleration sensor (gravity sensor) implemented in the electronic device 10. Figure 17 shows the relationship between the touch surface 150 and the vertical direction (direction of gravity). The electronic device 10 is a mobile terminal, and the user can freely change its orientation.

[0080] As shown in FIG. 17, the touch surface 150 is defined as an xy plane, and the normal to the touch surface 150 is defined as the z axis. In this example, the vibration direction 161 (vibration axis) of the lateral actuator 106 is parallel to the y axis. Gravity detected by an acceleration sensor mounted on the electronic device 10 is represented by vector g. The finger direction estimation unit 117 can estimate the orientation of the touch surface 150 with respect to vector g from the acceleration values ​​of each of the three axes. The finger direction estimation unit 117 calculates the xy plane component g of the vector g. xy is estimated as the direction from the tip to the base of the touching finger.

[0081] The haptic control unit 113 is configured to detect the xy plane component g xy The lateral actuator 106 is controlled based on the angle θ (0° to 180°) between the y-axis and the tactile sense control unit 113. As described in the first embodiment, the tactile sense control unit 113 controls the xy plane component g xy The angle between the y-axis and the vibration start direction along the y-axis may be specified in the range of 0° to 360°, and the lateral actuator 106 may be controlled based on that angle.

[0082] Another method for detecting the direction of the long axis of the finger is to estimate the direction of the finger projected onto the touch surface based on the direction of the user's face captured by a camera mounted on the electronic device 10. Fig. 18 shows a schematic diagram of the relationship between a user's face image 230 captured by the built-in camera 108 of the electronic device 10 and the touch surface 150.

[0083] The finger direction estimation unit 117 performs recognition processing on the user's face image 230 captured by the camera 108, and determines an axis 235 in the up-down direction of the face image 230. The axis 235 can be specified, for example, from the positions of the two eyes in the face image 230. The up-down direction of the face image 230 along the axis 235 can also be specified from the relationship between the eyes of the face image 230 and other features. The finger direction estimation unit 117 stores information on the angle of the axis 235 in a storage device. Furthermore, information on the up-down direction of the face along the axis 235 is stored if necessary.

[0084] The haptic control unit 113 controls the lateral actuator 106 based on the angle θ (0° to 180°) between the vibration axis 165 on the touch surface 150 and the axis 235 of the face image 230. As described in the first embodiment, the haptic control unit 113 may specify the angle between the downward direction on the axis 235 of the face image 230 and the vibration start direction along the vibration axis 165 in the range of 0° to 360°, and control the lateral actuator 106 based on the angle.

[0085] Although the embodiments of the present application have been described above, the present disclosure is not limited to the above embodiments. A person skilled in the art can easily change, add, or convert each element of the above embodiments within the scope of the present disclosure. It is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. [Explanation of symbols]

[0086] 10 Electronic device, 100 Tactile presentation panel, 101 Touch panel, 103 Liquid crystal display, 104 Carrier, 105 Base, 106 Lateral actuator, 107 Leaf spring, 108 Camera, 110 Control device, 111 Display control unit, 113 Tactile control unit, 115 Touch detection unit, 117 Finger direction estimation unit, 150 Touch surface, 161, 161A, 161B Vibration direction, 165 Vibration axis, 201 Object image, 205 Finger, 220 Contact area, 225 Long axis, 230 Face image, 235 Up-down axis of face image

Claims

1. A touch surface and an actuator that vibrates the touch surface along one axis in the plane; a control device that controls vibration of the actuator along the one axis to present a tactile sensation to a finger in contact with the touch surface when an object displayed on the touch surface is selected; Including, The control device includes: estimating a direction in which the finger in contact with the touch surface is projected onto the touch surface, and controlling the actuator so that, when the projected direction is perpendicular to the one axis, the intensity of the vibration is stronger than when the projected direction is parallel to the one axis; Tactile presentation device.

2. A tactile presentation device as described in claim 1, the control device controls the actuator so as to gradually increase the intensity of the vibration from a direction parallel to the one axis toward a direction perpendicular to the one axis within a specific range of the projected orientation. Tactile presentation device.

3. A touch surface; an actuator that vibrates the touch surface along one axis in the plane; a control device that controls vibration of the actuator along the one axis to present a tactile sensation to a finger in contact with the touch surface when an object displayed on the touch surface is selected; a camera that captures an image of a user's face having said finger; Including, The control device includes: estimating a direction in which the finger in contact with the touch surface is projected onto the touch surface based on the direction of the face, and controlling the actuator so as to change the intensity of the vibration according to the projected direction. Tactile presentation device.

Images