Vibrotactile interface with force-dependent haptic feedback
The described haptic interface dynamically controls vibration patterns based on finger pressure and position, addressing the limitations of existing vibrotactile interfaces by providing adaptive and precise tactile feedback.
Patent Information
- Application Number
- FR2023015178
- Authority / Receiving Office
- FR · FR
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-12-22
- Publication Date
- 2025-06-27
- Estimated Expiration
- 2043-12-22
AI Technical Summary
Existing vibrotactile interfaces lack the ability to provide haptic feedback that is dynamically controlled based on the pressure force exerted by multiple fingers, limiting their effectiveness in applications requiring precise tactile feedback.
A method and haptic interface that utilize a slab with integrated actuators and detectors to measure the position and pressure force of multiple fingers, allowing for the dynamic control of haptic feedback by adjusting the vibration patterns based on the force and position data.
Enables precise and dynamic haptic feedback that adapts to the pressure force and position of multiple fingers, enhancing the user experience in applications such as touch screens and interfaces for visually impaired individuals.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Title of the invention: Vibrotactile interface with haptic feedback dependent on the pressure force Technical field
[0001] The technical field of the invention relates to tactile interfaces of the vibrotactile type. PREVIOUS ART
[0002] Vibrotactile interfaces are vibrating interfaces, allowing a user to perceive tactile sensations by simply applying the finger to the interface. A vibration on a rigid interface can in fact intuitively encode information to the user, via a sensation felt at the finger. This constitutes an important issue when visual information is non-existent or degraded. This is for example the case of tactile interfaces intended for visually impaired users, or tactile interfaces located outside the field of observation of the user, for example a driver of a vehicle. A vibrotactile interface makes it possible to transmit precise spatial and temporal information.
[0003] A vibrotactile interface exploits the sensitivity of skin mechanoreceptors to vibratory stimuli, the latter producing a deformation of the skin. Mechanoreceptors are generally sensitive to vibrations in frequencies typically between 10 Hz and 1 kHz, with high sensitivity being observed between 200 Hz and 300 Hz. The amplitude of the vibration is also an important parameter, the minimum amplitude to trigger tactile stimulation depending on the vibration frequency. It is considered that the lower the frequency, the higher the amplitude must be for the vibration to be perceived. The amplitude can for example be a few pm or a few tens of pm. Another important parameter, conditioning the tactile stimulation, is the shape of the vibration wave, as well as the duration, the latter being able to be between 0.1 s and a few seconds.The time delay between two consecutive vibrations can also affect the stimulation perceived by the user.
[0004] Thus, tactile interfaces make it possible to provide haptic feedback, by means of vibratory patterns, triggered by the tactile interface being touched by a finger. The vibratory patterns are previously determined, so that the tactile sensations created are easily detectable. These can, for example, mimic sensations induced by mechanical devices, for example a cursor, wheel, or button. Developments have also made it possible to develop “tactons”, contraction of the Anglo-Saxon terms “tactile” and “icons”, which are localized and structured sensory information.
[0005] Certain touch interfaces allow measurement of the pressure force exerted by a finger. Such interfaces have for example been described in documents US5241308 or US55210813, the position and pressure force of a finger being estimated by capacitive effect. Document US201000053116 describes a touch screen combining capacitive detection of the position of a finger with specific force sensors, so as to discriminate between intentional contact of a finger, exerted with a certain force, and accidental contact.
[0006] The inventor has designed a more sophisticated touch interface, making it possible to measure a force simultaneously exerted by several fingers, and making it possible to control haptic feedback depending on the force exerted. Statement of the invention
[0007] A first object of the invention is a method for controlling a haptic interface, the haptic interface comprising: - a slab, configured to be touched by one or more contact members, at one or more contact points, - actuators, arranged against the slab, each actuator being configured to induce a vibration of the slab when it is subjected to a control signal; - detectors, coupled to the slab, each detector being configured to produce a detection signal dependent on an intensity of a force exerted on the slab, at each point of contact;
[0008] the method comprising: a. determination of a position of each point of contact on the slab, at a measurement time; b. from the detection signal generated by different detectors, at the measurement time; estimation of a force exerted on the slab, at each point of contact; c. from the position of each contact point and the force exerted at each contact point, definition of haptic feedback from the slab, the haptic feedback comprising a target displacement assigned to each contact point of the slab; d. from the haptic feedback of the slab, defined during c), determination of a control signal to be applied to the actuators, so as to obtain the target displacements assigned to each point of contact; e. addressing a control signal to each actuator, based on each control signal determined in step d); f. repeating steps a) to e) by incrementing the measurement time, steps a) to e) being repeated until a criterion for stopping the iterations is reached;
[0009] steps a) to f) being implemented by a processing unit connected to a memory, the memory comprising response functions of a set formed by the slab, each actuator and each detector.
[0010] According to one possibility, step b) comprises an inversion of a direct detection model, the direct detection model determining, for each detector, a detection signal as a function of a force exerted at each point of the slab. The direct detection model can take into account the control signal addressed to each actuator.
[0011] Step b) may include: - bi) extraction, from the memory, of a detection matrix, each term of which corresponds to a detection signal generated, in a detector, by a unitary support exerted in a position on the slab, the unitary support being a predetermined support force, the detection matrix being stored in the memory; - bii) formation of a detection vector, comprising the detection signal resulting from the detectors; - biii) from the detection matrix and the detection vector, estimation of a force vector, each term of which corresponds to an estimate of the force exerted at each point of contact.
[0012] Step b) may include taking into account a time delay applied to the detection matrix.
[0013] According to one possibility, the detection matrix is stored, in the memory, in the frequency domain, in different frequency bands.
[0014] According to one possibility: - sub-step bi) comprises an extraction, from the memory, of a charge transfer matrix, each term of which corresponds to a charge generated, in a detector, by a unit voltage applied to an actuator, the unit voltage being predetermined. - sub-step bii) comprises a formation of a control vector, comprising the actuation signal of each actuator of a previous iteration; - sub-step biii) comprises an estimation of the force vector from the load transfer matrix and the control vector.
[0015] Step c) may comprise an inversion of a direct control model, the direct control model determining, for each actuator, the control signal as a function of each target displacement. The direct control model may take into account the force exerted on the plate at each point of contact.
[0016] According to one possibility, step c) comprises: - ci) extraction, from the memory, of a displacement matrix, each term of which corresponds to a displacement of the slab induced, at a point, by a unit voltage applied to an actuator, the unit voltage being a predetermined voltage, the displacement matrix being stored in the memory; - cii) formation of a displacement vector, comprising the target displacements; - ciii) from the displacement matrix and the displacement vector, estimation of a control vector, each term of which corresponds to a control signal to be applied to each actuator.
[0017] Step c) may include taking into account a time delay applied to the displacement matrix.
[0018] The displacement matrix can be stored, in the memory, in the frequency domain, in different frequency bands;
[0019] According to one possibility - sub-step ci) comprises an extraction, from the memory, of a charge transfer matrix, each term of which corresponds to a charge generated, in a detector, by a voltage applied to an actuation transducer; - sub-step cii) comprises a formation of a force vector, comprising the force estimated at each point of contact during step b); - sub-step ciii) comprises an estimation of the control vector from the load transfer matrix and the force vector.
[0020] Following step e) of an iteration and step b) of a following iteration, the method may comprise an estimation of an impedance of the contact member.
[0021] A second object of the invention is a haptic interface comprising: - a panel, configured to be touched by one or more contact members, at one or more contact points, - actuators, arranged against the slab, each actuator being configured to cause a vibration of the slab when it is subjected to a control signal; - detectors, coupled to the slab, each detector being configured to produce a detection signal dependent on an intensity of a force exerted on the slab, at each point of contact; - a processing unit, configured to implement steps a) to f) of a method according to the first subject of the invention.
[0022] The invention will be better understood upon reading the description of the exemplary embodiments presented in the remainder of the description, in conjunction with the figures listed below. FIGURES
[0023] [Fig.l] shows a general view of a haptic interface allowing an implementation of the invention.
[0024] [Fig.2A] shows a configuration of a haptic interface, in which each actuator and each detector forms the same piezoelectric transducer.
[0025] [Fig.2B] shows another configuration of a haptic interface, in which each actuator and each detector forms the same piezoelectric transducer.
[0026] [Fig.2C] shows a configuration of a haptic interface, in which the actuators and detectors are piezoelectric transducers different from each other and are two by two concentric.
[0027] [Fig.2D] shows another configuration of a haptic interface, in which the actuators and detectors are piezoelectric transducers different from each other.
[0028] [Fig.2E] shows a configuration of a piezoelectric transducer, which can operate as an actuator or as a detector.
[0029] [Fig.2F] shows another configuration of a piezoelectric transducer, which can function as an actuator and as a detector.
[0030] [Fig.3A] diagrams the main components of an example of a haptic interface according to the invention.
[0031] [Fig.3B] represents the main steps implemented by the haptic interface described in connection with [Fig.3A].
[0032] [Fig.3C] is a detail of a force estimation step, described in the [Fig.3B]
[0033] [Fig.3D] is a detail of a step of determining a control signal, described in [Fig.3B].
[0034] [Fig.4A] illustrates an extraction of a reduced detection matrix, by extracting certain columns of a tensor stored in a memory, in the frequency domain.
[0035] [Fig.4B] illustrates an extraction of a displacement matrix, by extracting certain lines from a tensor stored in the memory, in the frequency domain.
[0036] [Fig.4C] illustrates an extraction of a reduced displacement transfer matrix, by extracting certain columns from a tensor stored in the memory. DISCLOSURE OF PARTICULAR EMBODIMENTS
[0037] [Fig.l] represents a haptic interface 1, intended to be touched by an external organ 3, for example a finger, to control a device 2. The device may be, in a non-limiting manner, a consumer appliance, the dashboard of a vehicle, a device for identifying a person, or a device for assisting a visually impaired or disabled person.
[0038] In the examples shown in this application, the external member 3 is a finger, which corresponds to most of the applications envisaged. Alternatively, the external member 3 may be a stylus, or any other means making it possible to act on the interface 1.
[0039] The haptic interface comprises a slab 10, rigid, transparent or opaque. The slab 10 may for example comprise glass or a metal, or an organic compound, for example plexiglass. The slab 10 is delimited by a contact surface 11, intended to be touched by an external organ, in particular a finger. The thickness e of the slab 10 is preferably less than 10 mm, or even less than 5 mm. The thickness e is adjusted according to the dimensions of the slab, and the mechanical properties of the material forming the slab (rigidity, solidity). It is for example between 1 and 5 mm for glass or a material such as plexiglass.
[0040] The slab can form a touch screen, comprising light sources, for example of the OLED (organic light-emitting diode) type.
[0041] The slab 10 is coupled to 12p actuators, for example piezoelectric actuators, p being an integer designating each actuator. Each actuator is configured to move the slab, by generating a vibration of variable amplitude and frequency, preferably in a frequency range between 10Hz and 1KHz, preferably including a frequency band between 200Hz and 300Hz, which is a frequency band at which the tactile sensation is particularly felt. Each 12p actuator is powered by a control signal Vp, so as to generate a vibration whose characteristics (amplitude, frequency) are configured to produce haptic feedback from the interface. The control signals Vp are transmitted, via a control circuit 13 to each 12p actuator.
[0042] In this example, each 12p piezoelectric actuator comprises a piezoelectric material, for example AIN, ZnO or PZT, arranged between two electrodes. Each actuator can be connected to the slab by gluing. According to a variant, the 12p actuators can be electromagnetic, electromechanical or piezoresistive actuators.
[0043] The slab 10 is coupled to detectors 14;, for example piezoelectric transducers, i being an integer designating each detector. Each detector 14; is configured to form a detection signal Q. as a function of an intensity of a pressing force exerted by the finger. The detection signal Q. is collected by a circuit of detection 15. The detection signal Q. is formed by charges induced by finger pressure on the detector 14;. Each detector 14; may be formed of a piezoelectric material as described in connection with the actuators 12p.
[0044] The touch surface 11 comprises a position sensor 17, for example of the capacitive type. The position sensor 17 is connected to conductive tracks 16, arranged in a two-dimensional network. The conductive tracks 16 are adjacent to the contact surface 11. The conductive tracks extend parallel to the slab 10, or in the slab 10, below the contact surface 11. When the slab 10 is opaque, the conductive tracks 16 may be made from a standard conductive material, for example a metal. When the slab 10 is transparent, the conductive tracks 16 are preferably made from a transparent conductive material, for example a conductive oxide, a standard material being ITO (Indium Tin Oxide). The conductive tracks 16 extend, for example, in rows and columns. Conductive tracks can be biased according to a bias voltage.The interface comprises an insulating layer extending between the conductive tracks 16 and the contact surface 11, so as to allow detection, by capacitive effect, of contact with the finger 3 of a user, or any other type of external organ. The position sensor 16 is configured to generate a position signal Sm comprising the number and position of contact points on the detection surface 11. The conductive tracks 16 make it possible to form a mesh on the slab, defining N mesh points, each point of the mesh corresponding to a position capable of being detected by the position sensor. The number N of positions is determined as a function of the spatial resolution of the position sensor. It is possible to take into account a number of positions lower than that determined by the spatial resolution of the position sensor.This involves taking into account the support surface of a finger, extending along a diameter of a few mm, for example 5 mm. Thus, the spatial resolution of the position sensor and the conductive tracks makes it possible to define a maximum number of positions Nmax. The haptic interface I takes into account a number N of different positions, likely to be occupied by the finger on the contact surface 11, with N < Nmax.
[0045] The device comprises a processing unit 20, supplied, at different measurement times, by the detection signals Q. generated by the detection circuit 15 and by the position signal Sm generated by the position sensor 17. The processing unit 20 is intended to address a control signal Vp to the control circuit 13, so that the latter transmits each control signal Vp respectively to each actuator 12p.
[0046] The processing unit 20 is configured to determine a haptic pattern as a function of the position of each finger 3 contacting the contact surface 11, but also as a function of the pressing force exerted by each finger 3. The processing unit 20 comprises a microprocessor, connected to a memory 25 in which instructions are stored allowing implementation, by the microprocessor, of certain steps described in connection with [Fig.3A].
[0047] Preferably, the actuators and detectors are distributed under the slab, advantageously forming a regular mesh. The actuators and detectors can be arranged according to different configurations, shown diagrammatically in Figures 2A to 2D. These figures represent a top view of the actuators and detectors, the slab being shown in transparency.
[0048] In Figure 2A, a configuration is shown in which each transducer acts as an actuator and a detector. Each upper electrode is connected, via a resistor R, to the output of a voltage amplifier A. The resistor R and the voltage amplifier are part of the actuation circuit and the measuring circuit. Under the effect of a voltage Vp, forming the control signal, applied to the terminals of the amplifier A, a voltage is established between the upper electrode and the lower electrode, which induces a vibration of the actuator. An application of a pressing force on the upper electrode compresses the transducer, which generates a detection signal by integration of a charge Q._ resulting from the compression. However, in such a configuration, the charge Q; resulting from the compression may be small compared to the electrical charge generated by the polarization of the amplifier by the control signal Vp.
[0049] A first alternative, shown in [Fig.2B], consists of using a switch C, the switching of which allows a connection of the upper electrode either to the voltage amplifier previously described, in which case the transducer operates as an actuator, or to a charge amplifier A', to form the detection signal. The switch allows a physical separation between the control signal and the detection signal.
[0050] Figures 2C to 2D show alternatives, in which the actuators 12p are separated from the detectors 14;. In Figure 2C, a configuration is shown comprising pairs formed by an actuator 12p and a detector 14; =p arranged concentrically. The upper electrode of the actuator is annular, and extends along a surface greater than the upper electrode of the detector, the latter being disc-shaped. A voltage amplifier A is arranged to allow the excitation of the upper electrode of the actuator by the control signal Vp. A charge amplifier A' is used to form a detection signal from charges formed at the upper electrode of the detector.
[0051] In [Fig.2D], a configuration is shown comprising actuators 12; separated from the detectors 14p.
[0052] Figures 2E and 2F show possible transducer configurations. In [Fig.2E], a transducer is shown comprising a PZT piezoelectric material, on either side of which extend two electrodes E1 and E0. Electrode E0 extends between the plate 10 and the PZT material. Electrode E0 can be connected to ground while a potential is measured or applied to electrode E1. Alternatively, electrode E0 and electrodes E1 are connected to two opposite potentials.
[0053] In [Fig.2E], two electrodes E1 and E2, electrically insulated from each other, are opposite the electrode E0. The electrode E1 is annular and the electrode E2 is arranged in the center of the electrode EL. An electrode, for example E1, can be used to apply a potential to the PZT, while the electrode E2 allows a measurement to be carried out. This corresponds to the configuration shown in [Fig.2C].
[0054] Whatever the embodiment, it is preferable that the upper electrode of an actuator 12p extends over a surface area greater than that of a detector 14;. The diameter of the upper electrode of the actuator 12p may be of the order of 10 mm to 30 mm, so as to allow sufficient deformation of the slab to be felt by the finger. Since the production of electrical charges by compression is easier to measure, the upper electrode of the detectors may be smaller, for example a diameter of the order of or less than 5 to 10 mm.
[0055] Preferably, the actuators 12p extend, between the upper electrode and the lower electrode, with a thickness of between 100 μm and 500 μm. The detectors 14; are thicker, the thickness being for example greater than 500 μm or greater than 1 mm, so as to limit their intrinsic capacity.
[0056] The actuation 13 and detection 15 circuits are connected to the processing unit 20, the latter being configured to generate control signals, addressed to the actuation circuit 13, so that the actuators produce vibrations forming a haptic pattern conferring a predetermined haptic feedback. Each haptic pattern depends on the position of the contact on the contact surface and the force exerted on the latter.
[0057] The invention takes advantage of an independent measurement of the pressure exerted at the level of each finger contacting the slab 10, and of a possibility of modulating the vibration pattern so that the haptic feedback depends on the pressure exerted.
[0058] [Fig.3A] shows the main components of the haptic interface. The slab 10 includes: - P actuators 12p, P being an integer greater than or equal to 2, controlled by the control circuit 13, the latter transmitting a signal to each actuator as a function of a control signal Vp addressed by the processing unit 20; - the detectors 14, connected to the detection circuit 15, the latter producing a detection signal i depending on a pressing force Fm exerted by each finger applied against the slab. - the conductive tracks 16, connected to the position sensor 17, the latter producing a position signal Sm depending on the position of each contactm on the slab.
[0059] The processing unit 20 is connected to the detection circuit 15 and to the position sensor 17, from which it receives the detection signal Q. and the position signal Sm respectively. The processing unit 20 comprises three processing blocks: - a processing block 21 makes it possible to estimate a force Fm applied at each contact pointm from the position signal Sm and each detection signal Q., possibly taking into account a control signal Vp, - a haptic block 22, configured to define a target displacement {j at the level of each finger contacting the slab 10. The haptic block comprises a haptic memory, in which the vibration patterns are stored for different configurations of each finger touching the slab. Each configuration is defined according to parameters such as: number of fingers in contact with the slab, position of each finger contacting the slab and intensity of the pressing force exerted by each of the fingers contacting the slab. - a control block 23, configured to generate a control signal Vp addressed to the control circuit 13 of the actuators 12p, so as to obtain, in each finger contacting the slab 10, a displacement Um conferring the haptic feedback defined by the haptic block 22. The displacement Uin of the slab, at each point of contact, must be as close as possible to the target displacement Ù. The control signal Vp is established from the target displacements Üm defined by the haptic block 22, possibly taking into account the force exerted by each finger contacting the slab.
[0060] Each block may be implemented by one or more microprocessors. Each block may be formed of functions programmed in a computer environment. specific, for example Matlab or Python. Processing block 21 and control block 23 may implement inverse filtering, as described later.
[0061] [Fig.3B] illustrates the main steps of an iterative process implemented by the haptic interface 1:
[0062] Step 100: at a measurement time, one or more fingers m touch the slab. M is an integer designating the number of fingers simultaneously touching the plate.
[0063] Step 110: the position of each finger touching the slab is determined by the position sensor 17. This results in the formation of a position signal Sm for each position.
[0064] Step 120: the pressure exerted by each finger is converted into a detection signal Q. by the detectors 14;. The detection signal corresponds for example to a quantity of charges generated by each detector.
[0065] Step 130: this step is implemented by the processing block 21 of the processing unit 20. This involves estimating a support force p exerted at the measurement time by each finger m. This step is described in more detail below, in connection with [Fig.3C].
[0066] Step 140: this step is implemented by the haptic block 22 of the processing unit 20. This involves determining a target displacement [Jm for each finger, so as to form haptic feedback from the interface and provide sensory information to the user which depends on the number of fingers, their positions on the panel and the pressure force they exert.
[0067] Step 150: this step is implemented by the control block 23 of the processing unit 20. This involves defining a control signal Vp for each actuator 12p, so as to obtain the displacement Um of the slab in each finger, as close as possible to the target displacement l / m. This step is described in more detail below, in connection with [Fig.3D].
[0068] Step 160: activation of each actuator 12p according to the control signals defined in step 150, to produce haptic feedback resulting from the movement of the plate at each contact point. The haptic feedback can be associated with other types of stimulation, for example an emission of an audible or visual signal. When the slab forms a touch screen, the image formed on the screen can vary according to the haptic feedback.
[0069] Following step 160, steps 100 to 160 are repeated, the measurement time being incremented.
[0070] Steps 130, 140 and 150 are carried out by the processing unit 20, preferably in the time domain. They assume taking into account functions of response of the slab, some of which are stored in memory 25 in the frequency domain.
[0071] A first frequency response function is a detection matrix Hc, each term n) of which corresponds to a complex detection signal generated, in a detector 14, by a unit harmonic support exerted at a position n on the slab. The unit harmonic support, of unit amplitude, is a support force exerted at a predetermined frequency whose intensity is predetermined, for example 1 N. The detection matrix Hc is stored in the memory 25 of the processing unit 20. The detection matrix Hc has a dimension where I corresponds to the number of detectors and N corresponds to the number of positions considered. All or part of the detection matrix He, and more particularly its inverse Hc'- is used in step 130, Hc 1 denotes the inverse or a pseudo inverse, for example a Moore-Penrose pseudo inverse.
[0072] A second frequency response function is a displacement matrix Ha, each term of which hJjl p) corresponds to a displacement of the slab induced, at a point, by a unit voltage exerted on an actuator 12p. The unit voltage is a predetermined voltage, for example IV. The displacement matrix Ha has a dimension (V,P), where P corresponds to the number of actuators and N corresponds to the number of positions considered. The displacement matrix Ha is stored in the memory 25 of the processing unit 20. All or part of the displacement matrix Ha, and more particularly its inverse Ha \ is used in step 150. When the displacement matrix Ha is not invertible, Ha 1 denotes a pseudo inverse, for example a Moore-Penrose pseudo inverse.
[0073] A third, optional, response function is a charge transfer matrix G, each term (pp. / ) of which corresponds to a charge generated, in a detector 14;, by a unit voltage applied to an actuator 12p. The charge transfer matrix is stored in a memory 25 of the processing unit 20. The charge transfer matrix G has a dimension (PJ). The charge transfer matrix G is stored in the memory 25 of the processing unit 20. The charge transfer matrix G can be used in step 130.
[0074] A fourth, optional, response function is a displacement transfer matrix Æ, each term ^(n, ti) of which corresponds to a displacement induced, at a position n of the slab 10, by a unit force exerted at a contact point located at another position. The displacement transfer matrix is stored in the memory 25 of the processing unit 20. The displacement transfer matrix has a dimension (^,^). The displacement transfer matrix Æ is stored in the memory 25 of the processing unit 20. All or part of the displacement transfer matrix can be used in step 150.
[0075] In this example, the matrices Ha, Hc previously described are stored in the memory 25 in frequency form for W frequency bands w. The matrices F and G are stored in the memory 25 in time form.
[0076] The operation of the haptic interface 1 is governed by expressions, describing relationships between the movements generated at the level of each finger in contact with the slab, the force exerted on the fingers, as well as the measured detection signals and the control signals addressed to the actuators.
[0077] The displacement of the slab Un at a point n is such that:
[0078] u = ZLjhVp + .KnmFm (1) n JF finished m
[0079] where: - Hanp is a term of the displacement matrix Ha addressing the point of the slab of rank n and the actuator of rank - Vp is the control signal addressed to the 12p actuator. - ^nm is a term of the matrix F addressing the point of the slab of rank n and the finger in contact with the slab of rank m.
[0080] Fm corresponds to the force applied by the finger at position m on the slab.
[0081] Expressed in matrix form, (1) becomes:
[0082] U = HaV+KF(2)
[0083] V is a control vector, each term of which corresponds to the control signal Vp addressed to each actuator 12p. V is of dimension (P, 1).
[0084] The detection signal Q. detected by a detector 14; is such that: 100851 - Gip is a term of the G matrix addressing the 12p actuator and the 14 i* detector - ^cin is a term of the detection matrix Hc addressing the detector 14; and each point of the mesh of rank n.
[0086] Expressed in matrix form, (3) becomes
[0087] Q = GV + HCF(4.)
[0088] Expressions (1) to (4) define a direct model, translating the effect, on the slab, of constraints exerted on the latter, the constraints being able to include both a constraint of an electrical nature (the control signals V addressed to each actuator), and a mechanical one (the force F exerted on the slab by each finger in contact).
[0089] The matrices Hc, K, G determine the responses of the slab, both the mechanical response, in this case a displacement of the slab at different points, and the electrical response, in this case the detection signal of each detector. Expressions (1) and (2) correspond to a direct control model, because it makes it possible to determine the displacement of the slab in response to a control signal. Expressions (3) and (4) correspond to a direct detection model, because it translates the detection of loads under the effect of a force exerted on the slab.
[0090] The direct models defined in connection with expression (1) to (4) use matrices Ha, Hc, K defined for the points of the mesh corresponding to each detected contact point. Knowing the position of the contact points, the matrices Ha, K are formed from tensors K, defined for each mesh point and stored in memory 25.
[0091] Memory 25 stores the set of tensors K for each point of the mesh. During steps 130 and 150, terms of these tensors which correspond to each position m detected by the position sensor 17 can be extracted from the memory 25. The extractions from the tensors K are described by the continued, in connection with figures 4A to 4C.
[0092] Figure 3C describes the sub-steps of step 130. During step 130, the direct detection model is inverted, so as to estimate the force F exerted by each finger in contact with the slab, the number M of which and the position on the slab is provided by the position sensor 17. F is a vector, of dimension (Af, 1) of which each term Pm is an estimate of the force Fm applied by the finger at the position m.
[0093] The inversion of the direct detection model can be established by determining g1. For this, during a sub-step 131, columns of the tensor Hc corresponding to each position m contacted by a finger are extracted from the memory 25. Figure 4A represents such an extraction. In the example shown in Figure 4A, the tensor Hc of dimensions (Z, N, W) is represented. W detection matrices Hc of dimensions (Z, M) are extracted from the tensor Hc, each column of which is associated with a position m detected by the position sensor 17. In other words, a detection matrix Hc formed from the column or columns whose index n corresponds to a detected position m is used in each frequency band.
[0094] During a sub-step 132, a pseudo inverse of each matrix Hc is calculated in each frequency band w.
[0095] During a step 133, the delay term is applied, translating, in the frequency domain, a time delay between the application of the force and its measurement. T corresponds to a time delay, of the order of a few milliseconds. Working in the frequency domain facilitates the formalization of the time delay r.
[0096] During a sub-step 134, a charge vector Q is formed, of dimension ( / ,1) of which each term is the detection signal Q. of a detector 14;.
[0097] During a sub-step 135, the mechanical effect, on the slab, of the control signal V applied to the actuators is taken into account. During the first iteration, an initial control signal, resulting from an initialization, is taken into account. The initial control signal may for example be predetermined, or zero in all frequency bands. During the following iterations, the control signal ^ resulting from the previous iteration is taken into account. Sub-step 135 is optional. Preferably, it is not implemented during the first iteration.
[0098] During a sub-step 136, the matrix G is taken into account.
[0099] During a sub-step step 137, the direct control model is inverted. According to one possibility, the inversion of the direct control model is carried out by estimating the inverse of the matrix Hc resulting from step 134, for example a pseudo inverse as previously described. Expression (5) is a way of inverting the direct control model, according to a first approach
[0100] F = ej^Hc\Q-GV) (5)
[0101] According to a variant, a simplified direct control model is implemented, neglecting the influence of the actuators on each detection signal. The simplified electrical model is thus:
[0102] Q = HCF(6)
[0103] and its inversion is:
[0104] F = e^ <! *He] Q (7)Onestime que l’expression (5) est préférable, car moins entachée of error.
[0105] Compared to the actual force exerted at each point, forming a vector F, F = e^^F- In other words, the estimation error is a temporal error
[0106] The implementation of expression (7) leads to a larger error, because:
[0107] F^e^H^ÇQ+GV) (8)
[0108] The matrix product GV corresponds to an estimation error of F.
[0109] Each exerted force can be expressed in the time domain by an inverse Fourier transform, for example an inverse fast Fourier transform (IFFT),
[0110] f = IFFT(F)(9)
[0111] The transition to the time domain is optional. It corresponds to sub-step 138.
[0112] Figure 3D describes the sub-steps of step 150. During step 150, the direct detection model is inverted, so as to estimate the control signal Vp to be addressed to each actuator to obtain the target displacement {J determined by the haptic block 22.
[0113] The inversion of the direct detection model can be established by determining Ha- For this, during a sub-step 151, lines of the tensor Ha corresponding to each position m contacted by a finger are extracted from the memory 25. Figure 4B represents such an extraction. In the example shown in Figure 4B, the tensor Ha of dimension (N, P, W) is represented, defined for different spectral bands w. B matrices Ha of dimensions (Af, P) are extracted from the tensor Ha, each line of which is associated with a position m detected by the position sensor 17. In other words, a matrix Ha formed from the line or lines whose index n corresponds to a detected position m is used in each frequency band.
[0114] During a sub-step 152, a pseudo inverse H^ of each matrix Ha is calculated, in each frequency band
[0115] During a step 153, the delay term e~jürr is applied, translating, in the frequency domain, a time delay between the generation of the control signal and the formation of the vibrations on the slab. The delay ' is as defined in step 133.
[0116] During a sub-step 154, a vector of target displacements U, of dimension (1), is formed, each term of which corresponds to a target displacement to be applied in the position m.
[0117] During a sub-step 155, the electrical effect on the slab of the force applied in each contact position is taken into account, in the form of the force vector F defined in step 137. Sub-step 156 is optional.
[0118] During a step 156, the terms corresponding to each position m are extracted from the tensor K, as illustrated in FIG. 4C. This allows the formation of a matrix K,
[0119] During a sub-step 157, the direct control model is inverted. According to one possibility, the inversion of the direct control model is carried out using the inverse of the matrix Ha, for example a pseudo inverse as previously described. Expression (10) is a way of inverting the direct control model, according to a first approach.
[0120] v = Ù-KF)^ (10)
[0121] According to a variant, a simplified direct control model is implemented, neglecting the influence of the actuators on each detection signal. The simplified electrical model is thus:
[0122] U = HaV(ll)
[0123] and its inversion is:
[0124] ^^><^(12)
[0125] Expression (10) is considered preferable because it is less subject to error. Compared to the determined target displacement, the displacement actually exerted is U — In other words, the estimation error is simple delay.
[0126] The implementation of expression (12) leads to a larger error, since
[0127] U = e^^V + KF (13). KF corresponds to an error term.
[0128] Finally, the signals are expressed in the time domain by an inverse Fourier transform, for example an inverse fast Fourier transform (IFFT).
[0129] v = IFFT(V) (14)
[0130] The transition to the time domain corresponds to sub-step 138. This makes it possible to address control signals to each actuator, defined in the time domain.
[0131] The invention can be applied for identity control type applications. As soon as at least one finger is detected on the contact surface, the vibratory pattern (or haptic pattern) emits vibrations of certain amplitudes. The force exerted by the finger, in reaction to this vibration, can be considered as a mechanical impedance, which depends on the finger. The invention allows an estimation of the mechanical impedance simultaneously on several fingers. Such control can also allow discrimination between a finger and another object contacting the interface.
Claims
1. Claims Method for controlling a haptic interface, the haptic interface comprising - a slab (10), configured to be touched by one or more contact members (3), at one or more contact points, - actuators (12p), arranged against the slab, each actuator being configured to induce a vibration of the slab when it is subjected to a control signal (Vp); - detectors (14;), coupled to the slab, each detector being configured to produce a detection signal (Q.) depending on an intensity of a force exerted on the slab, at each point of contact; the process comprising: a. determination of a position of each point of contact on the slab, at a measurement time; b. from the detection signal generated by different detectors, at the measurement time; estimation of a force (F» F ) exerted on the slab, at each point of contact; c. from the position of each contact point and the force exerted at each contact point, definition of a haptic feedback from the slab, the haptic feedback comprising a target displacement Ü) assigned to each contact point of the slab; d. from the haptic feedback of the slab, defined during c), determination of a control signal (Vp, V) to be applied to the actuators, so as to obtain the target displacements assigned to each point of contact; e. addressing a control signal to each actuator, based on each control signal determined in step d); f. repeating steps a) to e) by incrementing the measurement time, steps a) to e) being repeated until a criterion for stopping the iterations is reached; steps a) to f) being implemented by a processing unit (20) connected to a memory (25), the memory comprising response functions of a set formed by the slab, each actuator and each detector.
2. Method according to claim 1, in which step b) comprises an inversion of a direct detection model, the direct detection model determining, for each detector, a detection signal (Qr Q) as a function of a force exerted at each point of the slab.
3. Method according to claim 2, in which the direct detection model takes into account the control signal addressed to each actuator.
4. Method according to any one of claims 2 or 3, in which step b) comprises: - bi) extraction, from the memory (25), of a detection matrix (Hc), each term of which corresponds to a detection signal generated, in a detector, by a unitary support exerted in a position on the slab, the unitary support being a predetermined support force, the detection matrix being stored in the memory; - bii) formation of a detection vector (Q), comprising the detection signal resulting from the detectors; - biii) from the detection matrix and the detection vector, estimation of a force vector (F), each term of which corresponds to an estimation of the force exerted at each point of contact.
5. Method according to claim 4, in which step b) comprises taking into account a time delay applied to the detection matrix.
6. A method according to claim 5, wherein the detection matrix is stored, in the memory, in the frequency domain, in different frequency bands.
7. Method according to any one of claims 2 to 6, in which: - sub-step bi) comprises an extraction, from the memory, of a charge transfer matrix (G), each term of which corresponds to a generated charge, in a detector, by a unit voltage applied to an actuator, the unit voltage being predetermined. - sub-step step bii) comprises a formation of a control vector (V), comprising the actuation signal of each actuator (12p) from a previous iteration; - sub-step step biii) comprises an estimation of the force vector from the load transfer matrix and the control vector.
8. Method according to any one of the preceding claims, in which step c) comprises an inversion of a direct control model, the direct control model determining, for each actuator, the control signal (Vp) as a function of each target displacement.
9. A method according to claim 8, wherein the direct control model takes into account the force exerted on the plate at each point of contact.
10. Method according to any one of claims 8 or 9, in which step c) comprises: - ci) extraction, from the memory, of a displacement matrix, each term of which corresponds to a displacement of the slab induced, at a point, by a unit voltage applied to an actuator, the unit voltage being a predetermined voltage, the displacement matrix being stored in the memory; - cii) formation of a displacement vector (£ / ), comprising the target displacements; - ciii) from the displacement matrix and the displacement vector, estimation of a control vector (V), each term of which corresponds to a control signal (Vp) to be applied to each actuator.
11. Method according to claim 10, in which step c) comprises taking into account a time delay applied to the displacement matrix.
12. A method according to any one of claims 10 or 11, wherein - the displacement matrix is stored, in the memory, in the frequency domain, in different frequency bands.
13. Method according to any one of claims 10 to 12, in which: - sub-step ci) comprises an extraction, from the memory, of a charge transfer matrix, each term of which corresponds to a charge generated, in a detector, by a voltage applied to an actuating transducer; - sub-step cii) comprises a formation of a force vector, comprising the force estimated at each contact point during step b); - sub-step ciii) comprises an estimation of the control vector from the charge transfer matrix and the force vector.
14. Method according to any one of the preceding claims comprising, following step e) of an iteration and step b) of a following iteration, an estimation of an impedance of the contact member.
15. Haptic interface comprising: - a slab (10), configured to be touched by one or more contact members (3), at one or more contact points, - actuators (12p), arranged against the slab, each actuator being configured to cause a vibration of the slab when it is subjected to a control signal - detectors (140, coupled to the slab, each detector being configured to produce a detection signal (Q.) depending on an intensity of a force exerted on the slab, at each contact point; - a processing unit (20), configured to implement steps a) to f) of a method according to any one of the preceding claims.
Citation Information
Patent Citations
Multi-touch force sensing touch-screen devices and methods
US20100053116A1
Force sensitive touch panel
US5241308A
Portable electronic device including touch-sensitive display and method of controlling same
US20160313841A1
Faulty pressure sensor determination of a portable communication device touch display
US20210255751A1
US55210813B1