Method for gesture control with improved feedback to the gesture speaker using optical, non-camera-based gesture recognition systems

DE102015002813B4Active Publication Date: 2025-03-20ELMOS SEMICON AG
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
DE102015002813
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2014-05-30
Filing Date
2015-02-25
Publication Date
2025-03-20
Estimated Expiration
2035-02-25

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for providing feedback during a gesture recognition process by a gesture recognition system, comprising the steps a. Measuring the distance between a first system and a gesture recognition object (O), b. wherein the measurement result is in the form of a first amplifier output signal (S4a); c. Measuring the distance between a second system and the gesture recognition object (O), d. wherein the measurement result is in the form of a second amplifier output signal (S4b); e. Generating a first transmit signal (S5a); f. Generating a second transmit signal (S5b); g. Radiation of the first transmitted signal (S5a) by a first transmitter (Ha) into a first optical transmission link (I1), h. where the gesture recognition object (O) is located at the end of the first transmission path (I1) and i. wherein the gesture recognition object (O) reflects the optical signal from the first transmission path (I1) through a further second transmission path (I2) to a first receiver (Da); j. Radiation of the second transmitted signal (S5b) by a second transmitter (Hb) into a fourth optical transmission path (I4), k. wherein the gesture recognition object (O) is located at the end of the fourth transmission path (I1) and I. wherein the gesture recognition object (O) reflects the optical signal from the fourth transmission path (I4) through a further third transmission path (I3) to a second receiver (Db); m. linearly superimposed radiation from a first compensation transmitter (Ka) via a known transmission path to the first receiver (Da); n. linearly superimposed radiation from a second compensation transmitter (Kb) via a known transmission path to the second receiver (Db); o. Conversion of the sum signal received in the first receiver (Da) to a first receiver output signal (S0a); p. Conversion of the sum signal received in the second receiver (Db) to a second receiver output signal (S0b); q. Optional amplification of the first receiver output signal (S0a) to a first modified receiver output signal (S1a); r. Optional amplification of the second receiver output signal (S0b) to a second modified receiver output signal (S1b); s. Multiplying the first modified receiver output signal (S1a) or the first receiver output signal (S0a) with the first transmit signal (S5a) to obtain the first filter input signal (S10a); t. Multiplying the second modified receiver output signal (S1b) or the second receiver output signal (S0b) with the second transmit signal (S5b) to obtain the second filter input signal (S10b); u. Filtering the first filter input signal (S10a) to the first filter output signal (S9a); v. Filtering the second filter input signal (S10b) to the second filter output signal (S9b); w. Amplification of the first filter output signal (S9a) to the first amplifier output signal (S4a); x. Amplification of the second filter output signal (S9a) to the second amplifier output signal (S4b); y. Multiplication of the first transmit signal (S5a) with the first amplifier output signal (S4a) to obtain the first compensation pre-signal (S6a); e.g. Multiplication of the second transmitted signal (S5b) with the second Amplifier output signal (S4b) to the second compensation pre-signal (S6b); aa. Addition of a first constant value (B1a) with the first Compensation pre-signal (S6a) to form the first compensation send signal (S3a); bb. Addition of a second constant value (B1b) with the second Compensation pre-signal (S6b) for the formation of the second compensation send signal (S3b); cc. Control of the first compensation transmitter (Ka) using the first compensation transmission signal (S3a); dd. Control of the second compensation transmitter (Kb) using the second compensation transmission signal (S3b); ee. Formation of the difference (S4m) of the first amplifier output signal (S4a) and the second amplifier output signal (S4b); ff. Formation of the sum (S4p) of the first amplifier output signal (S4a) and the second amplifier output signal (S4b); gg. Amplifying the difference (S4m) of the first amplifier output signal (S4a) and of the second amplifier output signal (S4b) to an output signal (out), hh, where the gain is determined by the sum (S4p) of the first amplifier output signal (S4b). depends on the amplifier output signal (S4a) and the second amplifier output signal (S4b); ii. Use of the output signal (out) as a measure of a coordinate of the position of the gesture recognition object; jj. Performing a gesture, kk. where a gesture begins at a time t0 and lasts a period of time T and II. wherein at a time t0+t1 before the end of the gesture at time t0+T the gesture speaker or user is given feedback by the gesture recognition system about the likely gesture recognition result and mm. where t1
Need to check novelty before this filing date? Find Prior Art

Description

Introduction

[0001] Using optical transmitters and receivers, the number of which is typically application-specific and amounts to at least two, a gesture or the movement of an object at a distance from the gesture recognition system is detected. The radiation field generated by the transmitter is modified by an object performing the gesture. This can occur through reflection and / or transmission. The change in the radiation field caused by the object performing the gesture, for example, a hand, is detected and evaluated by the receiver. A typical receiver measures, for example, the amplitude of the reflected light and / or its travel time since transmission by the transmitter. The object performing the gesture, for example, a hand, is also referred to in this disclosure as the gesture recognition object.

[0002] The device according to the invention should have at least two transmitters which are arranged along a first straight connecting line with at least a distance d between these at least two transmitters.

[0003] Each of these at least two transmitters generates a radiation field that undergoes a temporal change due to the respective gesture. This is recorded by the receiver system and converted into a temporal output signal (L i ) is used for the evaluation. First, the case of two receiving systems is considered, which are also arranged along a second straight connecting line, whereby this second connecting line is typically parallel or equal to the first connecting line. These receiving systems are initially distinguished here by the indices a and b. The two output signals of the two exemplary receiving systems are then L a and L b .

[0004] In ultrasound technology, a method for directional beam formation is known from DE19648327A1, in which two ultrasound beams are formed by forming a signal X'=|La|+|Lb||La−Lb| in their directivity in the ultrasonic far field. The two output signals of the two exemplary receiving systems, the signal L a and L btreated as complex quantities. It is obvious to the person skilled in the art that the use of the technology disclosed in DE 196 48 327 A1 in an optical application requires a coherent light beam, hence a laser. For the intended gesture recognition, however, simple, non-coherent light sources are to be used. Furthermore, the distance of the gesture recognition object with which the gesture is performed, for example a hand, should be of a comparable order of magnitude to the distance d between the two receivers. In contrast to the directional beam formation according to the directional beam formation known from DE 196 48 327 A1, in the case of gesture recognition the exact opposite desire applies: the widest possible detection field along the connecting line between the two optical transmitters.However, applying the above formula to an optical gesture recognition system would result in a very narrow sensitivity beam, which, due to the resulting small detection range, would not allow gesture recognition using the typically relatively wide gestures. Furthermore, the above formula is based on the evaluation of phase information, which is not available in a non-coherent system.

[0005] For gesture recognition, however, the task of determining a coordinate must be solved, where this coordinate corresponds to a parameter (X) of a parameterized connecting line between at least two receivers. This task cannot be solved with the technology of DE 196 48 327 A1, since it only involves beam focusing based on coherent sound waves, which does not solve the inventive problem described below.

[0006] One problem with gesture recognition is that a definitive decision regarding the recognized gesture can only be made after the gesture has been completely executed. Only then are all the data available, and the probability of incorrectly accepting an unexecuted gesture and / or incorrectly rejecting a correctly executed gesture is minimized. This results from the fact that the change detected by only one receiver in its reception range, the field (f1, f2), is not sufficiently meaningful for reliable gesture recognition. This lack of information can be mitigated by the aforementioned use of multiple receivers and / or transmitters. For example, detecting an approach is possible with just one transmitter / receiver pair.In this case, the signal amplitude depends not only on the distance to be measured, but also on other variables, such as the object size and / or the object reflectivity.

[0007] The fact that a gesture can only be evaluated once it has been fully displayed is extremely detrimental to an intuitive user interface and reduces usability. It hinders the realization of a user-intuitive interaction option.

[0008] Devices and methods for gesture recognition are also known from the documents US 2011 / 0 119 216 A1, US 2011 / 0 279 249 A1, US 2011 / 0 035 666 A1, US 2011 / 0 320 949 A1 and US 2011 0 239 118 A1. Object of the invention

[0009] The goal is to provide the operator, i.e., the gesture speaker, with immediate feedback on the gesture being performed, even before it is completed. The ability to provide immediate feedback on the gesture being performed should allow the operator to correct their movements while executing the gesture. Furthermore, the gesture recognition device should deliver a result independent of the size and reflectivity of the object.

[0010] This object is achieved by means of a method according to claim 1. Description of the invention

[0011] The invention is explained with reference to the figures, without being limited to them. The claims are decisive.

[0012] A key fundamental idea of ​​the invention is to allow the neighboring radiation fields of neighboring transmitters and the reception lobes of neighboring receivers to overlap. This creates three clearly detectable areas between any two receivers. This enables pre-recognition of a gesture, also referred to below as pre-detection or gesture hypothesis formation. This pre-recognition determines the gesture likely to be recognized up to that point in time as a gesture hypothesis and presents this gesture hypothesis in a suitable manner. For example, feedback can be provided such that, upon the intended selection of one of several objects on a screen, the object with the highest selection probability is displayed largest, and the objects with a lower selection probability are displayed proportionally smaller according to their respective selection probability.At the same time, the object with the highest selection probability can, for example, be framed and thus marked in a first color, while being marked in a second color after the selection has been made. It is therefore worth noting that the different marking options that can be used to represent the selection probability can also be used to mark the selected objects themselves and their properties. However, it is highly recommended that these markings be different in each case.

[0013] Another example is scrolling through a text or image file using gesture control. The middle zone displays the direction of the page turn, and the user can stop the gesture before the page is turned.

[0014] For better manageability, more than three zones, and thus more than two receivers, are required. Such a design can be realized using narrow-beam transmitters and receivers with narrow receiver beams. However, this significantly increases the complexity of such a system. The fields—that is, the overlap of the transmit and receive beams—are shaped and superimposed in such a way that continuous gesture detection is ensured.

[0015] In Fig. Figure 1 shows the sensitivity curves of two exemplary fields (f1, f2), i.e., the respective superposition of the transmit and receive lobes, for a one-dimensional gesture recognizer as a function of a one-dimensional coordinate (X), which represents a coordinate of the object position, for example, the position of the hand. The two output signals L are shown as the ordinate. a and L b two receiving systems.

[0016] The abscissa is the position of the object when moving along the line connecting the two receivers at positions X1 and X2 at a distance d.

[0017] The measurement result X' is now obtained by dividing the difference between the two output signals by their sum. X'=La−LbLa+Lb

[0018] The result of this operation is in Fig. 2 as a function. The result is a preferably linearized range in which the position and direction of movement of the object can be clearly determined and the evaluation of the gesture can take place continuously. In the evaluation range (mf), the reached position of the object is unambiguous and independent of other properties of the object such as reflectance, size, etc., which is the essential difference from the prior art. According to the invention, it was recognized that it is not the obvious Euclidean distance, which corresponds to a triangulation, that is to be determined, but rather the normalized difference.

[0019] The evaluation range (mf) is characterized by the fact that in this range the function is monotonically decreasing or alternatively monotonically increasing.

[0020] If a wider detection range is required, several transmitters and / or receivers can be used in such a way that several overlapping fields (f1 to f n ). In the case of a one-dimensional recognition task, the multiple overlapping fields (f1 to f n ) by weighting the output signals (L1 to L n ) by weighting factors (g1 to g n ) are summed to a first subtotal and a second weighted subtotal.

[0021] The first subtotal (ZS1) is calculated as follows: ZS1=∑i=1ngiLi

[0022] The second subtotal (ZS2) is calculated as follows: ZS2=∑i=1ngn+1−iLi

[0023] The measurement result X' is now obtained by dividing the difference between the first and second subtotals by their sum. X'=ZS1−ZS2ZS1+ZS2

[0024] Experience has shown that the edge areas should not be included in the evaluation area (mf) because there is ambiguity in these areas.

[0025] This method can be extended to two-dimensional recognition: If a more extensive two-dimensional detection area is required, several transmitters and / or receivers can be used in such a way that several overlapping fields (f 1,1 to f n,m ). In the case of a two-dimensional recognition task, the multiple overlapping fields (f 1,1 to f n,m ) again by weighting the corresponding output signals (L 1,1 to L n.m ) by weighting factors (g 1,1 up to g n,m ) are weighted together to form a first subtotal, a second subtotal, a third subtotal, and a fourth subtotal.

[0026] The first subtotal (ZS1) is calculated as follows: ZS1=∑i=1n∑j=1mgi,jLi,j

[0027] The second subtotal (ZS2) is calculated as follows: ZS2=∑i=1n∑j=1mgn+1−i,jLi,j

[0028] The third subtotal (ZS3) is calculated as follows: ZS3=∑i=1n∑j=1mgi,m+1−jLi,j

[0029] The fourth subtotal (ZS4) is calculated as follows: ZS4=∑i=1n∑j=1mgn+1−i,m+1−jLi,j

[0030] The first intermediate measurement result X'1 is now obtained by dividing the difference between the first and second intermediate sums by their sum. X1'=ZS1−ZS2ZS1+ZS2

[0031] The second intermediate measurement result X'2 is now obtained by dividing the difference between the third and fourth intermediate sums by their sum. X'2=ZS3−ZS4ZS3+ZS4

[0032] The measured value in the Y direction is then obtained by subtracting the second intermediate measurement result X'2 from the first intermediate measurement result X'1: Y'=X1'−X2'=12[ZS1−ZS2ZS1+ZS2−ZS3−ZS4ZS3+ZS4]

[0033] The measured value in the X-direction is then calculated by averaging the second intermediate measurement result X'2 and the first intermediate measurement result X'1: X'=X1'+X2'=12[ZS1−ZS2ZS1+ZS2+ZS3−ZS4ZS3+ZS4] Experience has shown that the edge areas should not be included in the evaluation area (mf) because there is ambiguity in these areas.

[0034] By way of example, the following describes an implementation of the method according to the invention by means of a concrete system implementation based on the Fig. 4 to 6.

[0035] Fig. Figure 4 depicts the unclaimed combination of two Halios systems according to the prior art. These measure the distance between the respective systems and the object (O). The measurement results are available in the form of amplifier output signals (S4). Each signal generator (G1a, G1b) generates a transmission signal (S5a, S5b), which is radiated by a transmitter (Ha, Hb) into a respective optical transmission path (I1, I4). At the end of these transmission paths (I1, I4) is the object (O), for example a hand performing the gesture, which reflects the optical signal from each of the two transmission paths (I1, I2) through a respective further transmission path (I2, I3) to a respective receiver (Da, Db). At the same time, a compensation transmitter (Ka, Kb) radiates in a linearly superimposed manner into the respective receiver (Da, Db), also via a respective known transmission path.The respective receiver (Da, Db) converts the thus received, modified, and superimposed sum signal into a respective receiver output signal (S0a). This is amplified in a respective optional first amplifier (V1a, V1b) to a modified receiver output signal (S1a, S1b).

[0036] The respective modified receiver output signal (S1a, S1b) or the receiver output signal (S0a, S0b) is multiplied in a respective first multiplier (M1a, M1b) by the respective transmission signal (S5a, S5b) to form the respective filter input signal (S10a, S10b). The respective filters (Fa, Fb) filter the respective filter input signal (S10a, S10b) to form the respective filter output signal (S9a, S9b). Typically, the filter characteristics are selected to be identical for the filters (Fa, Fb). The multiplication in the respective first multiplier (M1a, M1b) and the subsequent filtering in the respective filter (Fa, Fb) correspond to a scalar product formation of the respective modified receiver output signal (S1a, S1b) on the one hand with the respective transmission signal (S5a, S5b) on the other hand.If the transmission signals (S5a, S5b) are selected orthogonally with respect to this scalar product, the signal components of each transmission signal (S5a, S5b) are suppressed in the other filter output signal (S9b, S9a). The respective filter output signals (S9a, S9b) are amplified by a second amplifier (V2a, V2b) to form the amplifier output signal (S4a, S4b), which also represents the respective measurement result. The sign is selected to ensure stability in the control loop. In a second multiplier (M2a, M2b), the respective transmission signal (S5a) is multiplied by the respective amplifier output signal (S4a, S4b) to form the respective compensation pre-signal (S6a, S6b). The respective compensation transmission signal (S3a, S3b) obtained by adding a constant value (B1a, B1b) from the respective compensation pre-signal (S6a, S6b) controls, as already mentioned, the respective compensation transmitter (Ka, Kb).This closes the two control loops. Once stability is achieved, the respective receiver output signals (S0a, S0b) no longer contain any signal components of the respective transmit signal (S5a, S5b) except for a control error and system noise.

[0037] According to the invention, the two measured values ​​thus determined can be output in the form of two output signals (L a , L b ) of a receiver system for carrying out a gesture recognition method using this optical gesture recognition system. The output signals (L a , L b ) the two amplifier output signals (S4a, S4b).

[0038] The receivers (Da, Db) are preferably arranged at a distance from each other.

[0039] In Fig. Figure 5 shows how the difference between these two output signals (La, Lb) is divided by their sum and used as the output signal (out) and thus as a measure of a coordinate of the position of a gesture recognition object. For this purpose, a subtractor (Sub1) calculates the difference (S4m) between the two amplifier output signals (S4a, S4b). At the same time, a second adder (A2p) calculates the sum (S4p) of the two amplifier output signals (S4a, S4b). The gain of the third amplifier (V3) is now controlled by the sum (S4p) of the two amplifier output signals (S4a, S4b) in such a way that its gain correlates, at least at certain operating points, with the inverse of the sum (S4p) of the two amplifier output signals (S4a, S4b).

[0040] Since this amplifier is difficult to implement in analog circuit technology, Fig. 6 an alternative methodology is given which leads to the same result.

[0041] Behind the first amplifiers (V1a, V1b), the receiver input difference signal (S1m) is formed as the difference between the receiver output signals (S1a, S1b) by a second subtractor (Sub2).

[0042] At the same time, behind the first amplifiers (V1a, V1b), the receiver input sum signal (S1p) is formed as the sum of the receiver output signals (S1a, S1b) by a third adder (A3).

[0043] A fourth subtractor (Sub4) forms a differential transmission signal (S5m) from the transmission signals (S5a, S5b) by forming the difference between these signals.

[0044] At the same time, a fourth adder (A4) forms a sum transmission signal (S5p) from the transmission signals (S5a, S5b) by summing these signals.

[0045] These signals (S5m, S5p, S1m, S1p) are now used instead of the transmission signals (S5a, S5b) and the modified receiver output signals (S1a, S1b) for multiplication in a respective first multiplier (M1m, M1p) to form a respective filter input signal (S10m, S10p). The respective filters (Fm, Fp) then filter the respective filter input signal (S10m, S10p) to form a respective filter output signal (S9m, S9p). These are each amplified again by a respective second amplifier (V2m, V2p) to form a respective amplifier output signal (S4m, S4p), each of which represents one of two measurement signals.

[0046] By multiplying the differential transmission signal (S5m) or the sum transmission signal (S5p) in a second multiplier (M2m, M2p) with the respective amplifier output signal (S4m, S4p), a compensation pre-signal (S6m, S6p) is obtained.

[0047] By adding the two compensation pre-signals (S6m, S6p) one obtains the second compensation pre-signal (S6b) from the Fig. 5 the second compensation transmission signal (S3b) is generated.

[0048] To generate the first compensation transmission signal (S3a), the compensation pre-signal (S6m), which a second multiplication unit (M2m) has generated from the differential transmission signal (S5m), is amplified by a third amplifier (V3m), whose gain is preferably proportional to the other amplifier output signal (S4p). Its amplifier output signal (S6v) is subtracted from the other compensation pre-signal (S6p) in a fifth subtractor (Sub5). The subtraction result (S6a) is then Fig. 5 explains further.

[0049] Fig. Figure 7 shows a typical usage situation. It is the Fig. The object of the invention, as shown in Figure 7, is to determine a parameter X' corresponding to a position along the connecting line between the two receivers (Da, Db). This connecting line can also extend beyond the two receivers (Da, Db) to the left and right, beyond the direct connecting line between these two receivers (Da, Db). The reverse case with multiple transmitters and one receiver is shown in Figure 7. Fig. 8 drawn.

[0050] It is now important that the previously described procedure determines a measured value (X') that can be uniquely assigned to the parameter (X) used to parameterize the connecting line on which the two receivers (Da, Db) are located. This assignment function should preferably be strongly monotonically decreasing or increasing. The corresponding applies to Fig. 8.

[0051] This principle can be extended to n receivers and / or m transmitters. This is shown in Fig. 9 for the case of multiple recipients.

[0052] Instead of a one-dimensional connection line, a two-dimensional connection line can also be used. In this case, the connection plane is parameterized by two parameters (X, Y). In this case, the device should have at least three receivers (Da, Db, Dc) and one transmitter (Ha) and / or at least three transmitters (Ha, Hb, Hc) and one receiver (Da). This case is in Fig. 10 for three transmitters (Ha, Hb, Hc).

[0053] Because the system can now provide a coordinate very quickly in this way, the system can now provide feedback during a gesture recognition process while the gesture is being executed. For example, a gesture begins at a time t0 and lasts for a period of time T. At a time t0+t1 before the gesture ends at time t0+T, the gesture speaker or user can now be given feedback about the likely gesture recognition result. This gives them the opportunity to correct their gesture input. This makes operation significantly more intuitive and attractive for customers. The key features for these times are: t1 <T.

[0054] Typically, said feedback is provided via a screen. If the task of the gesture recognition system is to enable the selection of individual virtual objects, some of these virtual objects are preferentially displayed on this screen. The gesture recognition system then determines the probability of selection by the gesture recognition system for the displayed virtual objects based on the measurement result, for example, a measured X or Y coordinate of the gesture input object. Typically, the object most likely to be selected by the gesture recognition system is specifically marked by the gesture recognition system. The probability of this selection should be above a predefined threshold. The gesture recognition system typically checks whether the calculated probability is above or below this threshold.If this threshold is exceeded, the gesture recognition system marks the virtual object on the screen. It is useful if the gesture recognition system not only marks the virtual object with the highest selection probability, but also other objects whose selection probabilities typically exceed the threshold. In order to still identify the most likely object, it is useful for the virtual objects to be marked differently according to the probability of selection before the end of the gesture or gesture sequence. For example, the gesture recognition system could provide each of these objects with a border when displayed on the screen, the size and / or structure and / or color and / or pattern of which depends on the probability of selection.Instead, the size, shape, and orientation of the object itself can also be changed in this way. It is particularly important and therefore preferred if the marking in question changes even after the marking has already occurred, if a change in the probability of selection occurs before the end of the gesture or gesture sequence.

[0055] In general, the gesture recognition system can therefore make the shape of the marking during the execution of the gesture itself and thus during the gesture recognition process depend on the probability of selection.

[0056] The term "form" is defined very broadly in the context of this disclosure. It refers to all changes in the object that are perceptible to a human being. These include, in particular, but not exclusively, • the outer shape, namely the border of the virtual object on the screen, • the external form, namely the three-dimensional shape of the virtual object on the screen underlying the two-dimensional screen projection, • the size of the virtual object on the screen, • the color and / or coloring of the virtual object on the screen, • the transparency of the virtual object on the screen, • a color palette used to display the virtual object, • the orientation of the virtual object on the screen, • the coloring and / or tiling of a screen area near the virtual object on the screen, • the size and / or shape of a colored screen area near the virtual object on the screen.

Claims

[1] A method for providing feedback during a gesture recognition process by a gesture recognition system, comprising the steps of a. Measuring the distance between a first system and a gesture recognition object (O), b. the measurement result being in the form of a first amplifier output signal (S4a); c. Measuring the distance between a second system and the gesture recognition object (O), d. the measurement result being in the form of a second amplifier output signal (S4b); e. generating a first transmission signal (S5a); f. generating a second transmission signal (S5b); g. Radiating the first transmission signal (S5a) by a first transmitter (Ha) into a first optical transmission path (I1), h. where the gesture recognition object (O) is located at the end of the first transmission path (I1) and i. wherein the gesture recognition object (O) reflects the optical signal from the first transmission path (I1) through a further second transmission path (I2) to a first receiver (Da); j. Radiating the second transmission signal (S5b) by a second transmitter (Hb) into a fourth optical transmission path (I4), k. wherein the gesture recognition object (O) is located at the end of the fourth transmission path (I1) and I. wherein the gesture recognition object (O) reflects the optical signal from the fourth transmission path (I4) through a further third transmission path (I3) to a second receiver (Db); m. linearly superimposed radiation of a first compensation transmitter (Ka) via a known transmission path into the first receiver (Da); n. linearly superimposed radiation of a second compensation transmitter (Kb) via a known transmission path into the second receiver (Db); o. Conversion of the sum signal received in the first receiver (Da) to a first receiver output signal (S0a); p. Converting the sum signal received in the second receiver (Db) into a second receiver output signal (S0b); q. Optionally amplifying the first receiver output signal (S0a) to a first modified receiver output signal (S1a); r. Optionally amplifying the second receiver output signal (S0b) to a second modified receiver output signal (S1b); s. Multiplying the first modified receiver output signal (S1a) or the first receiver output signal (S0a) by the first transmission signal (S5a) to the first filter input signal (S10a); t. Multiplying the second modified receiver output signal (S1b) or the second receiver output signal (S0b) by the second transmission signal (S5b) to form the second filter input signal (S10b); u. filtering the first filter input signal (S10a) to the first filter output signal (S9a); v. filtering the second filter input signal (S10b) to the second filter output signal (S9b); w. amplifying the first filter output signal (S9a) to the first amplifier output signal (S4a); x. Amplifying the second filter output signal (S9a) to the second amplifier output signal (S4b); y. Multiplying the first transmission signal (S5a) by the first amplifier output signal (S4a) to form the first compensation pre-signal (S6a); z. Multiplication of the second transmission signal (S5b) with the second Amplifier output signal (S4b) to the second compensation pre-signal (S6b); aa. Addition of a first constant value (B1a) to the first Compensation pre-signal (S6a) for forming the first compensation transmission signal (S3a); bb. Addition of a second constant value (B1b) to the second Compensation pre-signal (S6b) for forming the second compensation transmission signal (S3b); cc. Controlling the first compensation transmitter (Ka) by means of the first compensation transmission signal (S3a); dd. Controlling the second compensation transmitter (Kb) by means of the second compensation transmission signal (S3b); ee. Forming the difference (S4m) between the first amplifier output signal (S4a) and the second amplifier output signal (S4b); ff. Formation of the sum (S4p) of the first amplifier output signal (S4a) and the second amplifier output signal (S4b); amplifying the difference (S4m) of the first amplifier output signal (S4a) and of the second amplifier output signal (S4b) to an output signal (out), hh. wherein the gain is determined by the S sum (S4p) of the first amplifier output signal (S4a) and the second amplifier output signal (S4b); ii. Using the output signal (out) as a measure of a coordinate of the position of the gesture recognition object; jj. Performing a gesture, kk. where a gesture starts at a time t0 and lasts a period T and II. wherein at a time t0+t1 before the completion of the gesture at time t0+T, the gesture speaker or user is given feedback about the probable gesture recognition result by the gesture recognition system and mm. where t1 <T ist. [2] A method for providing feedback during a gesture recognition process by a gesture recognition system, comprising the steps of a. Measuring the distance between a first system and a gesture recognition object (O), b. the measurement result being in the form of a first amplifier output signal (S4a); c. Measuring the distance between a second system and the gesture recognition object (O), d. the measurement result being in the form of a second amplifier output signal (S4b); e. generating a first transmission signal (S5a); f. generating a second transmission signal (S5b); g. Radiating the first transmission signal (S5a) by a first transmitter (Ha) into a first optical transmission path (I1), h. where the gesture recognition object (O) is located at the end of the first transmission path (I1) and i. wherein the gesture recognition object (O) reflects the optical signal from the first transmission path (I1) through a further second transmission path (I2) to a first receiver (Da); j. Radiating the second transmission signal (S5b) by a second transmitter (Hb) into a fourth optical transmission path (I4), k. wherein the gesture recognition object (O) is located at the end of the fourth transmission path (I1) and I. wherein the gesture recognition object (O) reflects the optical signal from the fourth transmission path (I4) through a further third transmission path (I3) to a second receiver (Db); m. linearly superimposed radiation of a first compensation transmitter (Ka) via a known transmission path into the first receiver (Da); n. linearly superimposed radiation of a second compensation transmitter (Kb) via a known transmission path into the second receiver (Db); o. Conversion of the sum signal received in the first receiver (Da) to a first receiver output signal (S0a); p. Converting the sum signal received in the second receiver (Db) into a second receiver output signal (S0b); q. Optionally amplifying the first receiver output signal (S0a) to a first modified receiver output signal (S1a); r. Optionally amplifying the second receiver output signal (S0b) to a second modified receiver output signal (S1b); s. subtracting the first modified receiver output signal (S1a) from the second modified receiver output signal (S1b) and forming a receiver input difference signal (S1m); t. Adding the first modified receiver output signal (S1a) and the second modified receiver output signal (S1b) and forming a receiver input sum signal (S1p); u. Subtracting the first transmission signal (S5a) and the second transmission signal (S5b) to form a differential transmission signal (S5m); v. adding the first transmission signal (S5a) and the second transmission signal (S5b) to form a sum transmission signal (S5p); w. Multiplying the receiver input difference signal (S1m) by the difference transmit signal (S5m) to the first filter input signal (S10m); x. Multiplying the receiver input sum signal (S1p) by the sum transmit signal (S5p) to form the second filter input signal (S10p); y. Filtering the first filter input signal (S10m) to the first filter output signal (S9m); z. Filtering the second filter input signal (S10p) to the second filter output signal (S9p); aa. Amplifying the first filter output signal (S9m) to the first amplifier output signal (S4m); bb. Amplification of the second filter output signal (S9p) to the second amplifier output signal (S4p); cc. Multiplying the differential transmit signal (S5m) by the first amplifier output signal (S4m) to form the first compensation pre-signal (S6m); dd. Multiplication of the sum transmission signal (S5p) by the second amplifier output signal (S4p) to form the second compensation pre-signal (S6p); ee. amplifying the first compensation pre-signal (S6m) to the further amplifier output signal (S6v), wherein the amplification depends on the second amplifier output signal (S4p); ff. Subtracting the amplifier output signal (S6v) from the second compensation pre-signal (S6p) to produce a subtraction result (S6a); gg. Formation of the first compensation transmission signal (S3a) from the subtraction result (S6a); hh. Addition of the first compensation pre-signal (S6m) and the second first compensation pre-signal (S6p) to the addition result (S6b); ii. Formation of the second compensation transmission signal (S3b) from the addition result (S6b); jj. Controlling the first compensation transmitter (Ka) by means of the first compensation transmission signal (S3a); kk. Controlling the second compensation transmitter (Kb) by means of the second compensation transmission signal (S3b); Ii. Using the further amplifier output signal (S6v) as a measure of a coordinate of the position of the gesture recognition object; mm. Performing a gesture, nn. where a gesture starts at a time t0 and lasts a period T and oo. where at a time t0+t1 before the completion of the gesture at time t0+T, the gesture speaker or user is given feedback about the probable gesture recognition result by the gesture recognition system and pp. where t1 <T ist.

Citation Information

Patent Citations

  • Method for generating directional beams in direction-finding systems and device for carrying out the method

    DE19648327A1

  • Show body position

    US20110035666A1

  • Natural input trainer for gestural instruction

    US20110119216A1

  • Gesture input device, gesture input method, and program

    US20110239118A1

  • Systems and methods for immersive interaction with virtual objects

    US20110279249A1