User interface with optical detection device

EP4466595A1Pending Publication Date: 2024-11-27UNIV DAIX MARSEILLE +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
EP2023701883
Authority / Receiving Office
EP · EP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-01-21
Filing Date
2023-01-20
Publication Date
2024-11-27

AI Technical Summary

Technical Problem

Existing user interfaces are limited in their ability to detect user interactions without physical devices, lacking precision and being sensitive to electromagnetic disturbances, while also requiring significant physical equipment and being non-intuitive.

Method used

An optical detection device with a linear detection bar and photosensors that weigh light sensitivity based on position, allowing for contactless, precise detection of objects like fingers or hands without physical devices, using weighted sum calculations and overlapping sensitivity cones to determine object position.

Benefits of technology

Enables precise, contactless, and electromagnetic disturbance-immune object detection, reducing required equipment and enhancing user interaction intuitiveness, with improved reliability and simplicity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 1.1
    Figure 1.1
Patent Text Reader

Abstract

The invention relates to a user interface with a device for optically detecting the presence and position of an object (2) in a detection zone (3), the user interface comprising: - an illumination means (7) for illuminating the detection zone (3); - a linear detection array (5) oriented toward the detection zone (3) and comprising a row of photodetectors (6) that are able to measure the brightness of the light emitted by the illumination means (7), the light sensitivity of each photodetector (6) being weighted according to the position of the photodetector (6) along the row of photodetectors (6).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] DESCRIPTION

[0002] Title: Optical Sensing Device User Interface

[0003] TECHNICAL FIELD

[0004] The invention relates to the field of interfaces enabling a user to interact with a machine. The invention relates more particularly to devices enabling the detection of instructions or indications physically expressed by a user.

[0005] PRIOR ART

[0006] Many interfaces allow a user to interact with a machine such as a computer. Among the most common, keyboards allow text to be entered by pressing physical keys. Similarly, mice allow the movement of an on-screen pointer to be controlled by the physical movement of the mouse.

[0007] User interfaces are undergoing significant development, particularly to keep pace with the evolution of computer hardware and software. One direction of these developments is the detection of user input by directly interpreting their movements, without them having to grasp a physical element.

[0008] STATEMENT OF THE INVENTION

[0009] The invention aims to improve the user interfaces of the prior art.

[0010] To this end, the invention relates to a user interface with a device for optically detecting the presence and position of an object in a detection zone, this interface comprising:

[0011] - a means of lighting the detection zone;

[0012] - a linear detection bar, oriented towards the detection zone, and comprising a line of photosensors adapted to measure the luminous intensity of the light emitted by the lighting means, the luminous sensitivity of each photosensor being weighted according to the position of the photosensor along the line of photosensors.

[0013] The user interface according to the invention makes it possible to detect the presence and position of an object such as a user's finger, hand, or other body part, without requiring any physical, tactile, or camera device. The position detection is done absolutely, and with great precision.

[0014] The device according to the invention can be used in any environment, minimizing the physical equipment required, and in a more intuitive way for the user.

[0015] Position detection is done without contact, in a manner that is not sensitive to electromagnetic interference, and without generating electromagnetic interference. Optical detection offers the advantages expected in optical position detection technologies: reliability, simplicity, electromagnetic compatibility.

[0016] The optical detection device according to the invention may include the following additional characteristics, alone or in combination:

[0017] - the light sensitivity of each photosensor is weighted so that the light sensitivity of the photosensors increases with the ordinal position of the photosensors along the line of photosensors;

[0018] - the light sensitivity of each photosensor is weighted by applying a weighting coefficient to the output signal of each photosensor;

[0019] - the photosensors each have a sensitivity cone defining the angles in which the photosensor manages to capture light radiation, the photosensors having sensitivity cones which overlap;

[0020] - the coverage rate of the sensitivity cones of the photosensors is at least 15%;

[0021] - the interface is adapted to determine the position of said object from the sum of the weighted values ​​of the output signals of each photosensor; - the light sensitivity of the photosensors is weighted according to at least two weightings in parallel: a first weighting considering all the photosensors, and a second weighting considering only a portion of the photosensors;

[0022] - according to the second weighting, the light sensitivity of each photosensor, which is considered according to the second weighting, is weighted so that the light sensitivity of these photosensors increases with the ordinal position of these photosensors along the line of photosensors;

[0023] - the light sensitivity of each photosensor is weighted, according to the second weighting, by applying a weighting coefficient to the output signal of each photosensor;

[0024] - the interface is adapted to determine the position of said object from the sum of the weighted values ​​of the output signals of each photosensor, according to the first weighting or the second weighting, depending on the distance between said object and the linear detection bar. In other words, the interface is thus adapted to determine the position of said object from the sum of the weighted values ​​of the output signals of each photosensor: according to the first weighting when the distance between said object and the linear detection bar is less than a predetermined value; and according to the second weighting when the distance between said object and the linear detection bar is greater than a predetermined value;

[0025] - the sum of the weighted values ​​is divided by an average of the sum of the values ​​weighted according to the first weighting and the sum of the values ​​weighted according to the second weighting;

[0026] - the interface includes an additional distance sensor adapted to determine the distance between said object and the linear detection bar;

[0027] - the photosensors are regularly distributed along the line of photosensors according to a step p, the second weighting considering only the photosensors according to a step 2p;

[0028] - the interface comprises a control module which comprises a first calculation element adapted to calculate the sum of the light intensity values ​​detected by the photosensors, by applying a weighting coefficient to each;

[0029] - the control module comprises a second calculation element adapted to calculate the sum of the light intensity values ​​detected by the photosensors considered according to the second weighting, by applying a weighting coefficient to each;

[0030] - the lighting means comprises a plurality of light emitters inserted regularly between the photosensors and oriented towards the detection zone;

[0031] - the light emitters each have a cone of brightness defining the angles in which the light emitter emits light radiation, the light emitters having cones of brightness which overlap;

[0032] - the lighting means is adapted to flicker at a frequency, and the output signals of each photosensor are demodulated at this same frequency.

[0033] PRESENTATION OF FIGURES

[0034] Other characteristics and advantages of the invention will emerge from the non-limiting description which follows, with reference to the appended drawings in which:

[0035] - figure 1 is a schematic illustration of an optical detection device according to the invention;

[0036] - Figure 2, Figure 3, Figure 4, Figure 5, and Figure 6 are graphs illustrating the signal processing enabling optical detection;

[0037] - Figure 7 is an illustrative view of the parameters involved in optical detection.

[0038] Elements similar and common to the various embodiments bear the same reference numbers in the figures.

[0039] DETAILED DESCRIPTION

[0040] Figure 1 schematically illustrates an optical detection device 1 according to the invention. In this example, this device is part of an interface allowing a user to transmit commands to a computer device by presenting his finger 2 at one or more given positions in a detection zone 3. The detection zone 3 can for example be a virtual keyboard or a virtual desk, materialized or not by an element visible in two or three dimensions.

[0041] In Figure 1, the user's finger 2 is shown diagrammatically from the front and the device 1 is capable of locating the position of this finger along a detection axis 4 which extends along the double arrow shown in Figure 1. The detection of the finger 2 at a given abscissa along the detection axis 4 will correspond to an instruction given by the user to the machine.

[0042] The device 1 comprises a linear detection bar 5 which comprises photosensors 6 aligned along the detection axis 4, and therefore forming a line of photosensors 6. The distance between the linear detection bar 5 and the finger 2 is noted D.

[0043] The photosensors are generally designated by the reference 6 in the figures, and are individually numbered Ph1, Ph2, Ph3,..., Ph5 in Figure 1. The photosensors can be of any known type, such as photodiodes, photoresistors, etc., and have a Gaussian type angular light sensitivity. In Figure 1, the Gaussian sensitivity curve is illustrated above each photosensor 6.

[0044] The linear detection bar 5 is oriented towards the detection zone 3, i.e. the photosensors 6 are turned towards the detection zone 3.

[0045] The device 1 further comprises a means 7 for illuminating the detection zone 3. An advantageous example consists of forming the lighting means 7 with light emitters (for example LED diodes) inserted regularly between the photosensors 6, and oriented towards the detection zone 3. These light emitters each have a cone of brightness defining the angles in which the light emitter emits light radiation. Preferably, these cones of brightness overlap. In this example, a light emitter is inserted every two photosensors 6, on the line of photosensors 6.

[0046] On the linear detection bar 5, the photosensors 6 are regularly distributed according to a constant spacing corresponding to a pitch noted p in FIG. 1. Along the line of photosensors 6, the value of the light sensitivity of each photosensor 6 is weighted according to the position of the photosensor along the line. This weighting is here achieved by designing a line of photosensors 6 consisting of photosensors of light sensitivity which increases along the line of photosensors 6. The light sensitivity of each photosensor 6 is thus weighted so that the light sensitivity of the photosensors 6 increases with the ordinal position of the photosensors 6 along the line of photosensors 6.In other words: the second photosensor 6 (along the line of photosensors 6) has a greater light sensitivity than that of the first photosensor 6; the third photosensor 6 has a greater light sensitivity than that of this second photosensor 6; the fourth photosensor 6 has a greater light sensitivity than that of this third photosensor 6; and so on.

[0047] In this example, each photosensor 6 is assigned a weighting coefficient, which multiplies the value of the light sensitivity that it measures, this coefficient corresponding to the ordinal position of the photosensor along the line.

[0048] The device 1 comprises a control module 8 formed by any suitable analog or digital electronic means, such as a microcontroller.

[0049] The control module 8 comprises a first calculation element 9 adapted to calculate the sum of the light intensity values ​​detected by the photosensors, by applying to each a weighting coefficient which is equal to the ordinal position of the photosensor in the line of photosensors.

[0050] In Figure 1, the first calculation element 9:

[0051] - receives the light intensity from the first photosensor Ph1, applying the weighting coefficient 1 to it;

[0052] - receives the light intensity from the second photosensor Ph2, applying the weighting coefficient 2 to it;

[0053] - receives the light intensity from the third photosensor Ph3, applying the weighting coefficient 3.

[0054] In the schematic illustration of figure 1, only three photosensors 6 are concerned by the first calculation element 9, it being understood that the linear detection bar can however comprise as many photosensors 6 as necessary to cover a detection axis 4 of a desired length.

[0055] The weighted sum Sj of the output values ​​of the photosensors 6 is defined as follows:

[0056] With i=1,2,3..., n being the number of photosensors 6, and Ph, the output signal corresponding to the photosensor phi.

[0057] In the present example, the control module 8 also carries out a second weighting in parallel with the first, which can optionally improve the measurement. In addition to the weighting described above, the control module 8 is adapted to weight the outputs of the photosensors 6 which are separated by a distance 2p. The control module 8 thus comprises a second calculation element 10 adapted to calculate the sum of the light intensity values ​​detected by the photosensors 6 concerned by this second weighting, that is to say one photosensor 6 out of two with respect to the first weighting, by applying to each of these photosensors 6 a weighting according to the ordinal position of each.Thus, according to this second weighting, only the photosensors 6 spaced at a pitch of 2p are considered to form a line of photosensors 6, and the light intensity measured by each is multiplied by a coefficient corresponding to the ordinal position of each on this line of photosensors 6.

[0058] In Figure 1, the second calculation element 10:

[0059] - receives the light intensity from the first photosensor Ph1, applying the weighting coefficient 1 to it;

[0060] - receives the light intensity from the third photosensor Ph3, applying the weighting coefficient 2;

[0061] - receives the light intensity from a fifth photosensor Ph5, applying the weighting coefficient 3 to it. The weighted sum S2 of the output values ​​of only the photosensors 6 considered by the second weighting, is defined as follows:

[0062] With i=1,2,3..., n being the total number of photosensors (on this new line of photosensors considered), and Ph 2i the output signal of photosensor 6 having a gap of 2p with its neighbor.

[0063] When the user positions his finger 2 at a specific location in the detection zone 3, the finger 2 is illuminated by the lighting means 7. The finger 2 then has a brightness greater than the ambient brightness. The presence of this object thus illuminated provides each of the photosensors 6 with a light intensity decreasing with the distance between the photosensor 6 and the finger 2.

[0064] The photosensors 6 have a sensitivity cone defining the angles in which the photosensor 6 is able to capture light radiation. The photosensors 6 are chosen and positioned so that their sensitivity cones overlap. The photosensors 6 preferably have an overlap rate of these sensitivity cones of 15% or more.

[0065] Figure 2 illustrates the weighted sum as a function of the linear position of finger 2 along the detection axis 4, in centimeters around a position 0. Figure 2 shows four curves corresponding to four different distances: - a curve 11 representing the weighted sum for a distance D between finger 2 and linear detection bar 5 of 5 cm;

[0066] - a curve 12 representing the weighted sum Sj for a distance D of 10 cm;

[0067] - a curve 13 representing the weighted sum S xfor a distance D of 15 cm;

[0068] - a curve 14 representing the weighted sum Sj for a distance D of 20 cm.

[0069] In this example, the step p is 2 cm, the angular width (angle at mid-height) of each Gaussian (characteristic of the sensitivity cone of the photosensors 6) is 20°, and the width of finger 2 is 2 cm. Figure 2 shows that the localization of finger 2 can be done linearly with high precision over a range from almost - 5 cm to almost + 5 cm. Indeed, over this range, the curve of the position of finger 2 as a function of the weighted sum S xoutput data from the first calculation element 9 is very close to a straight line. In other words, the control module 8 can directly determine the position of the finger 2 on the detection axis 4 from a simple numerical value to be converted by a linear application (slope of the corresponding straight line). This conversion is fast and requires very little computing resources, in particular much less than the processing of images collected by camera. This simple operation nevertheless provides a highly precise positioning of the finger 2.

[0070] Figure 3 is a graph similar to that of Figure 2, but relating to the weighted sum S2. Figure 3 thus illustrates the weighted sum S2 as a function of the linear position of finger 2 along the detection axis 4, in centimeters around a position 0. Figure 2 presents four curves corresponding to the same four distances of Figure 2:

[0071] - a curve 15 representing the weighted sum S2 for a distance D of 5 cm;

[0072] - a curve 16 representing the weighted sum S2 for a distance D of 10 cm;

[0073] - a curve 17 representing the weighted sum S2 for a distance D of 15 cm;

[0074] - a curve 18 representing the weighted sum S2 for a distance D of 20 cm.

[0075] Figure 3 shows that the location of finger 2 can be done linearly with great precision over a wider range than for the weighted sum Sj but only for the distances corresponding to curves 17 and 18. In addition, for these curves 17, 18, the gain is almost constant as a function of the distance D which allows a correspondence between the weighted sum S2, given at the output of the second calculation element 10, and the linear position of the finger on the detection axis 4, which is given by a single straight line, whatever the distance between finger 2 and the linear detection bar 5.

[0076] On the other hand, for the case of distances less than 15 cm (curves 15 and 16), the measurement becomes less and less linear, with the appearance of undulations no longer allowing a one-to-one correspondence between the weighted sum and the position of the finger. The weighted sum S2 can thus, as a variant, be used to complete the correspondence given by the weighted sum to improve the measurement range and provide a constant gain measurement, for the distances D on which the weighted sum S2 is usable. Figure 4 illustrates this combination in which the control module 8 selects the weighted sum S x or the weighted sum S2, depending on the distance D between finger 2 and the linear detection bar 5. The weighted sum S2 is used for distances D of more than 10 cm up to 20 cm, and the weighted sum S x remains used for distances D up to 10 cm.

[0077] The interface is thus adapted to determine the position of said object 2 from the sum of the weighted values ​​of the output signals of each photosensor 6:

[0078] - according to the first weighting when the distance between said object 2 and the linear detection bar 5 is less than a predetermined value;

[0079] - according to the second weighting when the distance between said object 2 and the linear detection bar 5 is greater than a predetermined value.

[0080] Optionally, a corrective gain can be applied to obtain a substantially identical slope for each range.

[0081] To implement this solution combining the weighted sums S x and S2, the distance D can be obtained for example by using additional distance sensors of the ToF (“Time of Flight” type) or of the rangefinder type.

[0082] The light sensitivity of the photosensors 6 of the line of photosensors 6 is thus weighted according to at least two weightings in parallel: a first weighting considering all the photosensors (according to the step p), and a second weighting considering only a portion of the photosensors 6 (here the photosensors 6 according to a step 2p).

[0083] In the present example, the weighted sum S2 is relative to a 2p pitch, that is to say that it only considers one photosensor 6 out of two. However, as a variant, the weighted sum S2 can be calculated for a different choice of pitch, it can for example consider one photosensor 6 out of three (corresponding to a 3p pitch), or one photosensor 6 out of four (corresponding to a 4p pitch), depending on the distance to be provided for finger 2.

[0084] Figure 5 also relates to this combination of Figure 4. Figure 5 illustrates the projected Gaussian curves as a function of the distance D and the position of the finger (Gaussian curves of this example, with a mid-height angle of 20°).

[0085] As for the weighted sum S b the three curves 19, 20, 21 illustrate, for a distance D of 5 cm, the Gaussian curves of three photosensors 6 positioned respectively at 0, 2 and 4 cm.

[0086] As for the weighted sum S2, the three curves 22, 23, 24 illustrate, for a distance D of 20 cm, the Gaussian curves of three photosensors 6 positioned respectively at 0, 4 and 8 cm.

[0087] Figure 5 shows the advantage of selecting either the distribution of curves 19, 20, 21, or curves 22, 23, 24, as a function of the distance D because this makes it possible to maintain sufficient Gaussian overlap to ensure good linearity of the finger location.

[0088] Furthermore, it is possible to match the photosensors 6 and the light emitted by the lighting means 7, so as to overcome ambient disturbances. For example, it is possible to make the lighting means 7 flicker at a certain frequency and to recover this modulation signal to demodulate by synchronous detection the output signals of each photosensor 6. Thus it is possible to overcome variations in ambient lighting due for example to the sun or artificial lighting. A selective filter (rejector) can also be added to reject lighting disturbances due to flickering ambient lighting (for example 100 Hz fluorescent tubes, or certain LED lighting).

[0089] Alternatively, other additional weighted sums, in addition to the weighted sum S2, can be used to supplement the weighted sum S bconsidering a selection of photosensors with a pitch other than p and 2p. Also alternatively, in addition to the weighted sums S x and S 21 it is possible to calculate an average sum S moy and divide S x by S moy and S2 by S moyi which amounts to normalizing the sums.

[0090] In this case, the weighted sums Si and S2 thus normalized would be written:

[0091] Figure 6 shows the shapes of the sums S x and S2normalized in this way:

[0092] - a curve 25 represents the weighted sum thus standardized, for a distance D of 5 cm;

[0093] - a curve 26 represents the weighted sum S x thus standardized, for a distance D of 10 cm;

[0094] - a curve 27 represents the weighted sum S2 thus normalized, for a distance D of 15 cm;

[0095] - a curve 28 represents the weighted sum S2 thus normalized, for a distance D of 20 cm.

[0096] We obtain an interesting odd curve for localization, with a limited variation in slope. The normalized sum S2 is selected here for distances of 15 and 20 cm, and the normalized sum S x for distances of 5 and 10 cm.

[0097] An example of a model used to define the position of finger 2 is presented below, with reference to Figure 7.

[0098] Finger 2 is considered as a contrasting bar of intensity h placed on a background of intensity l2. The width of the bar is noted A f Finger 2 is at a distance D from the linear detection bar 5, and its abscissa on the detection axis 4 is X b. The abscissa of the photosensors 6 (their position along the detection axis 4) is noted Xpi. Li and L2 are the detection angles of the edges of the finger 2. The equation of the Gaussian angular sensitivity s^) is written: with A p the mid-height angle of the Gaussian curve.

[0099] It is then necessary to integrate over the entire angular width of the Gaussian (from minus infinity to plus infinity) to calculate the total intensity of the signal from the photosensor placed under the finger: and with X p the abscissa of the photosensor concerned.

[0100] Which gives:

[0101] With erf: the error function (integral of a Gaussian); and the angles Li and L2 defined as follows:

[0102] Variant embodiments of the device can be implemented. For example, the lighting means 7 and the associated photosensors 6 can work in any appropriate wavelength, visible or invisible and in particular infrared.

[0103] The example given here concerns the detection of the position of a finger 2 but this detection can be done on the hand, the foot or another part of the body, as well as on an object held by the user.

[0104] Furthermore, the linear detection bar 5 presented as an example is rectilinear, it being understood that the latter, and therefore the line of photosensors 6 and the detection axis 4, can also be curved, in particular semi-circular.

[0105] In addition, multiple linear detection bars 5 can be combined to detect the position of the object along different detection axes. For example, multiple linear detection bars 5 arranged along different axes enable detection of the finger 2 in a multi-dimensional space.

Claims

DEMANDS 1. User interface for an optical detection device for the presence and position of an object (2) in a detection zone (3), characterized in that it comprises: - a means of lighting (7) the detection area (3); - a linear detection bar (5), oriented towards the detection zone (3), and comprising a line of photosensors (6) adapted to measure the luminous intensity of the light emitted by the lighting means (7), the luminous sensitivity of each photosensor (6) being weighted according to the position of the photosensor (6) along the line of photosensors (6).

2. Interface according to claim 1, characterized in that the light sensitivity of each photosensor (6) is weighted so that the light sensitivity of the photosensors (6) increases with the ordinal position of the photosensors (6) along the line of photosensors (6).

3. Interface according to any one of the preceding claims, characterized in that the light sensitivity of each photosensor (6) is weighted by applying a weighting coefficient to the output signal of each photosensor (6).

4. Interface according to any one of the preceding claims, characterized in that the photosensors (6) each have a cone of sensitivity defining the angles in which the photosensor (6) manages to capture light radiation, the photosensors (6) having cones of sensitivity which overlap.

5. Interface according to claim 4, characterized in that the coverage rate of the sensitivity cones of the photosensors (6) is at least 15%.

6. Interface according to any one of the preceding claims, characterized in that it is adapted to determine the position of said object (2) from the sum of the weighted values ​​of the output signals of each photosensor (6).

7. Interface according to any one of the preceding claims, characterized in that the light sensitivity of the photosensors (6) is weighted according to at least two weightings in parallel: a first weighting considering all the photosensors (6), and a second weighting considering only a portion of the photosensors (6).

8. Interface according to claim 7, characterized in that, according to the second weighting, the light sensitivity of each photosensor (6), which is considered according to the second weighting, is weighted so that the light sensitivity of these photosensors (6) increases with the ordinal position of these photosensors (6) along the line of photosensors (6).

9. Interface according to any one of claims 7 or 8, characterized in that the light sensitivity of each photosensor (6) is weighted, according to the second weighting, by applying a weighting coefficient to the output signal of each photosensor (6).

10. Interface according to any one of claims 7 to 9, characterized in that it is adapted to determine the position of said object (2) from the sum of the weighted values ​​(Si, S2) of the output signals of each photosensor (6), according to the first weighting or the second weighting, depending on the distance between said object (2) and the linear detection bar (5).

11. Interface according to claim 10, characterized in that the sum of the weighted values ​​is divided by an average of the sum of the weighted values ​​according to the first weighting and the sum of the weighted values ​​according to the second weighting.

12. Interface according to any one of claims 10 or 11, characterized in that it comprises an additional distance sensor adapted to determine the distance between said object and the linear detection bar (5).

13. Interface according to any one of claims 7 to 12, characterized in that the photosensors (6) are regularly distributed along the line of photosensors (6) according to a step p, the second weighting considering only the photosensors (6) according to a step 2p.

14. Interface according to any one of the preceding claims, characterized in that it comprises a control module (8) which includes a first calculation element (9) adapted to calculate the sum (Si) of the light intensity values ​​detected by the photosensors (6), by applying a weighting coefficient to each.

15. Interface according to claim 14 when it depends on claim 7, characterized in that the control module (8) includes a second calculation element (10) adapted to calculate the sum (S2) of the light intensity values ​​detected by the photosensors (6) considered according to the second weighting, by applying a weighting coefficient to each.

16. Interface according to any one of the preceding claims, characterized in that the lighting means (7) comprises a plurality of light emitters inserted regularly between the photosensors (6) and directed towards the detection area.

17. Interface according to claim 16, characterized in that the light emitters each have a cone of brightness defining the angles in which the light emitter emits light radiation, the light emitters having cones of brightness which overlap.

18. Interface according to any one of the preceding claims, characterized in that the lighting means (7) is adapted to flicker at a frequency, and in that the output signals of each photosensor (6) are demodulated at this same frequency.