Sensor arrangement

Abstract

The invention relates to a sensor assembly (1c) for mounting on an arm (37) of a user. The sensor assembly (1c) comprises a first laser feedback interferometric sensor (32), a carrier structure (30) and a first computing unit (38). The support structure (30) is configured for supporting the first laser feedback interferometric sensor (32) on an arm (37) of a user such that the first laser feedback interferometric sensor (32) can detect a position of a first tendon (34) of a hand back (35) or forearm of the user. The first computing unit (38) is designed to determine a gesture of the user as a function of the detected position of the first tendon (34) of the hand back (35) or forearm of the user.

Description

Technical Field

[0001] The present invention relates to a sensor assembly for mounting on an arm, in particular a forearm, of a user. The invention also relates to an optical system for displaying virtual reality or augmented reality to a user of the system, and a method for detecting a user's hand gestures using the sensor assembly arranged on an arm, in particular a forearm, of a user. Background Art

[0002] US Pat. No. 11,409,365 B2 describes a sensor assembly for attachment to a finger of a user of the sensor assembly. The sensor assembly comprises an SMI sensor, also known as a laser feedback interferometry sensor. With the aid of the RFI sensor, gestures of the user of the sensor assembly, in particular finger gestures, can be detected. Summary of the Invention

[0003] Starting from this, the object of the present invention is to develop a sensor arrangement which detects the gestures of a user in a simpler manner.

[0004] To achieve this object, a sensor arrangement for attachment to an arm, in particular a forearm, of a user is proposed according to claim 1. Furthermore, an optical system for displaying virtual reality or augmented reality to a user of the system is proposed according to claim 10, as well as a method for ascertaining a user's hand gestures by means of a sensor arrangement arranged on an arm, in particular a forearm, of a user according to claim 13.

[0005] The sensor assembly for mounting on a user's arm (especially a forearm) includes at least one first laser feedback interferometry sensor. The sensor assembly also includes a support structure and a first computing unit. The support structure is configured to support the first laser feedback interferometry sensor, especially to mount it on the user's arm, especially the forearm, so that the first laser feedback interferometry sensor is configured to detect the position, especially the posture, of a first tendon of the back of the hand or forearm of the user. Here, the back of the hand has corresponding tendons assigned to corresponding fingers. The forearm has significant tendons, especially in the transition to the hand. The first computing unit is configured to determine the user's gesture based on the detected position, especially the posture, of the first tendon of the back of the hand or forearm of the user. By detecting the posture or position of the first tendon, the gesture can be determined in an accurate and simple manner.

[0006] Preferably, the first laser feedback interferometry sensor is configured to detect a first position, in particular a first state, of a first tendon of the back of the hand or forearm of the user at a first point in time. Furthermore, the first laser feedback interferometry sensor is configured to detect a second position, in particular a second state, of the first tendon of the back of the hand or forearm of the user at a second point in time subsequent to the first point in time. In this case, the first computing unit is configured to determine the user's gesture based on the detected first and second positions, in particular states. The movement of the first tendon thus determined can also be detected as a gesture.

[0007] Preferably, the support structure is configured to support, in particular, mount the first laser feedback interferometry sensor on an arm, in particular a forearm, of a user, such that the first light beam emitted by the first laser feedback interferometry sensor is emitted in the direction of the back of the hand or forearm of the user. In this way, the emitted first light beam can be reflected back in the direction of the first laser feedback interferometry sensor by the first tendon in the corresponding state or position.

[0008] Preferably, the support structure is configured as a wristband. Preferably, in this case, it is provided that the first laser feedback interferometry sensor is integrated on the outside of the wristband. The outside of the wristband refers in particular to the side of the wristband facing away from the user's skin. By means of this elevated mounting of the first laser feedback interferometry sensor relative to the user's arm, it is prevented that the first light beam emitted by means of the first laser feedback interferometry sensor is possibly reflected by the user's arm hair. In addition, the sensor assembly preferably has a deflection unit, in particular a static one, integrated into the wristband, which is configured to deflect the first light beam emitted by means of the laser feedback interferometry sensor in the direction of the back of the hand or forearm of the user. In particular, the deflection device is a static reflector, which is arranged in the cavity of the first laser feedback interferometry sensor. In this case, the wristband preferably also has an optical window for coupling out the first light beam generated by means of the first laser feedback interferometry sensor.

[0009] Preferably, the sensor assembly has a plurality of laser feedback interferometry sensors. In this case, each tendon on the back of the hand is assigned to at least one laser feedback interferometry sensor. Alternatively or additionally, at least one tendon on the forearm is assigned to another laser feedback interferometry sensor. In this case, the support structure is configured to support each laser feedback interferometry sensor, in particular to be mounted on the user's arm, in particular on the forearm, so that each laser feedback interferometry sensor can be configured to detect the position, in particular the posture, of the tendon on the back of the hand or forearm respectively assigned thereto. In this way, it is possible to obtain more complex gestures made by the user using multiple fingers and / or a tilted hand.

[0010] The sensor assembly preferably includes a transmission unit configured to transmit the user's gestures ascertained by means of the first computing unit to the optical system. The optical system, in turn, is used to display virtual reality or augmented reality content, in particular image content, to the user of the sensor assembly. This allows the ascertained user gestures to be used to control the virtual image content of the optical system.

[0011] Another subject matter of the present invention is an optical system for displaying virtual reality or augmented reality to a user of the system. The optical system is preferably glasses, in particular data glasses or virtual reality glasses. The optical system includes a receiving unit for receiving user gestures, which are detected using a sensor assembly disposed on the user's arm (in particular, forearm). Alternatively, the receiving unit may simply receive measurement data acquired using the sensor assembly. The sensor assembly is in particular the sensor assembly described above. The system includes a second computing unit configured to control the image content of the virtual reality or augmented reality based on the received user gestures. Alternatively, the second computing unit is configured to itself determine the user gestures in advance based on the received measurement data. For example, in the case of data glasses, a downward-tilted hand indicates that the next virtual image should be projected into the user's field of view. In the case of video data, a raised index finger can indicate a pause. In the case of virtual reality glasses as the optical system, the second computing unit is preferably configured to control an avatar, in particular a virtual avatar, based on the gestures received from the user. In particular, the received gestures can be used to control the avatar's virtual hand so that it also performs the gesture. The received data is accordingly used to model the virtual hand of the avatar, thereby enabling the user of the optical system to move the avatar's hand in the virtual world.

[0012] Another subject matter of the present invention is a method for determining a user's hand gesture using a sensor assembly disposed on the user's arm, particularly the forearm. The sensor assembly is particularly the sensor assembly described above. In this method, the position, particularly the position, of a first tendon of the back of the user's hand or forearm is first detected using a first laser feedback interferometry sensor of the sensor assembly. Furthermore, based on the detected position, particularly the position, of the first tendon of the back of the user's hand or forearm, the user's hand gesture is determined using a computing unit of the sensor assembly.

[0013] Preferably, at a first point in time, a first position, in particular a first state, of a first tendon of the back of the hand or forearm of the user is detected by means of a first laser feedback interferometry sensor of the sensor assembly. Subsequently, at a second point in time after the first point in time, a second position, in particular a second state, of the first tendon of the back of the hand or forearm of the user is detected by means of the first laser feedback interferometry sensor of the sensor assembly. Furthermore, based on the detected first and second positions (in particular states) of the back of the hand or forearm of the user, a gesture of the user is determined by means of a first computing unit of the sensor assembly.

[0014] The ascertained gesture is preferably transmitted to the optical system by means of a transmission unit of the sensor arrangement in order to display virtual reality or augmented reality to a user of the optical system.

[0015] Preferably, the method is performed by a device for data processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 A first embodiment of a sensor assembly for mounting on a user's arm is shown.

[0017] Figure 2 A second embodiment of a sensor assembly for mounting on a user's arm is shown.

[0018] Figure 3 A third embodiment of a sensor assembly for mounting on a user's arm is shown,

[0019] and an optical system for displaying virtual reality or augmented reality to a user of the system.

[0020] Figure 4 A method for ascertaining a gesture of a user of a sensor assembly is shown. DETAILED DESCRIPTION

[0021] Figure 1A first embodiment of the sensor assembly 1a is schematically shown, which is used to be installed on the arm 18 of the user of the sensor assembly 1a. In this case, the sensor assembly 1a is installed on the forearm of the user at the wrist position. The sensor assembly 1a has a first laser feedback interferometry sensor 15, a support structure 10 and a first computing unit 14. The support structure 14 is constructed as a wristband in this case, and the support structure is configured to support the first laser feedback interferometry sensor 15, especially to be installed on the arm 18 of the user, so that the first laser feedback interferometry sensor 15 is configured to detect the position, especially the posture, of the first tendon 13 of the back of the hand 19 of the user. The first computing unit 14 is further configured to determine the user's gesture based on the detected position, especially the posture, of the first tendon 13 of the back of the hand 19. To this end, in the first embodiment, different positions of the first tendon and the gestures corresponding to the different positions are stored in the first computing unit 14 in the form of a lookup table.

[0022] In this first embodiment, first laser feedback interferometry sensor 15 is configured to detect a first position, in particular a first state, of first tendon 13 on the back of the hand at a first point in time. Furthermore, first laser feedback interferometry sensor 15 is configured to detect a second position, in particular a second state, of first tendon 13 on the back of the hand at a second point in time subsequent to the first point in time. In this case, first computing unit 14 is again configured to determine the user's gesture based on the detected first and second positions.

[0023] In addition, in the first embodiment, the support structure 10 is configured to support the first laser feedback interferometry measurement sensor 15, in particular to be installed on the user's arm 19, so that the first light beam 12 emitted by the first laser feedback interferometry measurement sensor 15 is emitted in the direction of the back of the hand 19.

[0024] Furthermore, in the first embodiment, sensor assembly 1a includes multiple additional laser feedback interferometry sensors 11. Here, each tendon 16 on the back of the hand is assigned a laser feedback interferometry sensor 11. In this case, support structure 10 is configured to support each laser feedback interferometry sensor 11, in particular, to mount it on the user's arm, such that each laser feedback interferometry sensor 11 is configured to detect the position, in particular, the state, of the tendon 16 on the back of the hand 19 to which it is assigned. To this end, each additional laser feedback interferometry sensor 11 emits a corresponding additional light beam 17 in the direction of the back of the hand 19 or the corresponding tendon 16.

[0025] Figure 2A second embodiment of a sensor assembly 1b is schematically shown, which is intended to be mounted on an arm 25 of a user of the sensor assembly 1b. Here, the sensor assembly 1b is also arranged on the user's forearm. Unlike the first embodiment, the first laser feedback interferometry sensor 21 of the sensor assembly 1b is configured to detect the position, in particular the position, of a first tendon 23 of the user's forearm. To this end, the first laser feedback interferometry sensor 21 emits a first light beam 22 in the direction of the first tendon 23 of the forearm. A first computing unit 26 is in turn configured to determine the user's hand gesture based on the detected position, in particular the position, of the first tendon 23 of the user's forearm.

[0026] Figure 3 A third embodiment of a sensor assembly 1 c for mounting on an arm 37 of a user and an optical system 40 for displaying virtual reality or augmented reality to a user of the optical system 40 is schematically shown.

[0027] The first sensor assembly 1c also has a first laser feedback interferometry sensor 32, a support structure 30 in the form of a wristband and a first computing unit 38. The first laser feedback interferometry sensor 32 is integrated here on the outside of the wristband serving as the support structure 30. The sensor assembly additionally has a deflection unit 31, which is integrated into the wristband and is in particular static, and is designed to deflect a first light beam 33 emitted by means of the laser feedback interferometry sensor in the direction of a first tendon 34 on the back of the hand 35. In addition, the sensor assembly 1c has an optical window 36 for coupling out the first light beam. In the embodiment shown, the user's gesture includes an extended index finger, so that the first tendon 34 protrudes upward in a certain state or position. The first light beam 33 emitted from the first tendon 34 is reflected back in the direction of the first laser feedback interferometry sensor 32.

[0028] Sensor assembly 1c also has a transmission unit 39, which is designed to transmit the user gestures determined by means of first computing unit 38 to an optical system 40. Optical system 40 is designed here as a virtual reality system, designed to display virtual content, particularly image content, to a user of sensor assembly 1c. Optical system 40 has a receiving unit 42 for receiving gestures, or even simply receiving detected measured values. Furthermore, optical system 40 has a second computing unit 43, which is designed to control the virtual reality image content based on the received user gestures. In this case, in the present embodiment, second computing unit 43 is designed to control a virtual avatar of the user of optical system 40 based on the received user gestures. In particular, second computing unit 43 is designed to control a hand 41 of the avatar based on the gestures. In particular, the avatar's hand performs the determined gestures and can thereby move virtually.

[0029] Figure 4 A method for ascertaining a user's hand gesture using a sensor assembly arranged on the user's arm (particularly the forearm) is presented in the form of a flow chart. The sensor assembly is particularly the embodiment of the sensor assembly described above. In a first method step 100, the position, in particular the position, of a first tendon of the back of the user's hand or forearm is detected using a first laser feedback interferometry sensor of the sensor assembly. Following method step 100, in method step 130, the user's hand gesture is ascertained based on the detected position, in particular the position, of the back of the user's hand or forearm using a first computing unit of the sensor assembly. The method is terminated.

[0030] In an optional method step 110 following method step 100, a first position, in particular a first state, of a first tendon of the back of the hand or forearm of the user is detected at a first point in time by means of a first laser feedback interferometry sensor of the sensor assembly. In a subsequent method step 120, a second position, in particular a second state, of a first tendon of the back of the hand or forearm of the user is detected at a second point in time after the first point in time by means of the first laser feedback interferometry sensor of the sensor assembly. In a subsequent method step 150, a gesture of the user is determined based on the detected first and second positions (in particular states) of the back of the hand or forearm of the user by means of a first computing unit of the sensor assembly.

[0031] In a further optional method step 150 , the ascertained gesture is transmitted to the optical system by means of a transmission unit of the sensor arrangement in order to display the virtual or augmented reality to a user of the optical system.

Claims

1. A sensor assembly (1a, 1b, 1c) for mounting on an arm (18, 25, 37), in particular a forearm, of a user, comprising at least: - a first laser feedback interferometry sensor (15, 21, 32), - a support structure (10, 30), and - a first calculation unit (14, 26, 38), The support structure (10, 30) is configured to support, in particular install, the first laser feedback interferometry sensor (15, 21, 32) on the arm, in particular the forearm, of the user, so that the first laser feedback interferometry sensor (15, 21, 32) is configured to detect the position, in particular the posture, of the back of the hand (19, 35) of the user or the first tendon (13, 23, 34) of the forearm, and the first computing unit (14, 26, 38) is configured to determine the gesture of the user based on the detected position, in particular the posture, of the back of the hand (19, 35) of the user or the first tendon (13, 23, 34) of the forearm.

2. The sensor assembly (1a, 1b, 1c) according to claim 1, characterized in that The first laser feedback interferometry sensor (1a, 1b, 1c) is configured to detect a first position, in particular a first state, of the back of the hand (19, 35) or the first tendon (13, 23, 34) of the user's forearm at a first point in time, and to detect a second position, in particular a second state, of the back of the hand (19, 35) or the first tendon (13, 23, 34) of the user's forearm at a second point in time after the first point in time, wherein the first computing unit (14, 26, 38) is configured to determine the user's gesture based on the detected first and second positions, in particular states.

3. The sensor assembly (1a, 1b, 1c) according to any one of claims 1 or 2, characterized in that The support structure (10, 30) is constructed to support, in particular install, the first laser feedback interferometry sensor (15, 21, 32) on the arm, in particular the forearm, of the user, so that the first light beam (12, 22, 33) emitted by the first laser feedback interferometry sensor (15, 21, 32) is emitted in the direction of the back of the hand (19, 35) or the forearm of the user.

4. The sensor assembly (1a, 1b, 1c) according to any one of claims 1 to 3, characterized in that The support structure (10, 30) is configured as a wristband.

5. The sensor assembly (1a, 1b, 1c) according to claim 4, characterized in that The first laser feedback interferometry sensor (15, 21, 32) is integrated on the outside of the wristband.

6. The sensor assembly (1a, 1b, 1c) according to any one of claims 4 or 5, characterized in that The sensor assembly (1a, 1b, 1c) additionally has a deflection unit (31) integrated into the wristband, in particular a static one, which is designed to deflect a first light beam (12, 22, 33) emitted by means of the laser feedback interferometry sensor (15, 21, 32) in the direction of the back of the hand (35) or the forearm of the user.

7. The sensor assembly (1a, 1b, 1c) according to any one of claims 4 to 6, characterized in that The wristband comprises an optical window (36) for coupling out a first light beam (33) generated by means of the first laser feedback interferometry sensor (15, 21, 32).

8. The sensor assembly (1a, 1b, 1c) according to any one of claims 1 to 7, characterized in that The sensor assembly (1a, 1b, 1c) has a plurality of laser feedback interferometry sensors (11), wherein each tendon (16) of the back of the hand (19, 35) is assigned at least one laser feedback interferometry sensor (11), and / or at least one tendon of the forearm is assigned another laser feedback interferometry sensor, wherein the support structure (10, 30) is constructed to support each laser feedback interferometry sensor (11), in particular to install it on the arm (18, 25, 37), in particular the forearm, of the user, so that each laser feedback interferometry sensor (11) is constructed to detect the position, in particular the posture, of the tendon (16) of the back of the hand (19, 35) or the forearm respectively assigned thereto.

9. The sensor assembly (1a, 1b, 1c) according to any one of claims 1 to 8, characterized in that The sensor assembly (1a, 1b, 1c) additionally has a transmission unit (39), wherein the transmission unit (39) is designed to transmit the gesture of the user determined by means of the first computing unit (14, 26, 38) to an optical system (40), and the optical system (40) is designed to display virtual reality or augmented reality content, in particular image content, to a user of the sensor assembly (1a, 1b, 1c).

10. An optical system (40) for displaying virtual reality or augmented reality to a user of the system (40), wherein The system comprises a receiving unit (42) for receiving a gesture of the user determined by means of a sensor assembly (1a, 1b, 1c) arranged on an arm (18, 25, 37), in particular a forearm, of the user, in particular a sensor assembly (1a, 1b, 1c) according to any one of claims 1 to 9, wherein the system (40) comprises a second computing unit (43) configured to control image content of the virtual reality or augmented reality based on the received gesture of the user.

11. The optical system (40) according to claim 10, characterized in that The second computing unit (43) is designed to control, in particular a virtual avatar, as a function of received gestures of the user.

12. The optical system (40) according to any one of claims 10 or 11, characterized in that The optical system (40) is configured as spectacles.

13. A method for ascertaining a user's hand gestures, the method being performed by means of a sensor arrangement (1a, 1b, 1c) arranged on an arm, in particular a forearm, of the user, in particular a sensor arrangement (1a, 1b, 1c) according to any one of claims 1 to 9, wherein: The method comprises the following method steps: - detecting (100) the position, in particular the posture, of a first tendon of the back of the hand (19, 35) or forearm of the user by means of a first laser feedback interferometry sensor (15, 21, 32) of the sensor assembly (1a, 1b, 1c), - Based on the detected position, in particular the posture, of the back of the hand (19, 35) or the first tendon of the forearm of the user, the gesture of the user is determined (130) by means of a first computing unit (14, 26, 38) of the sensor assembly (1a, 1b, 1c).

14. The method according to claim 13, characterized in that The method further comprises the following additional method steps: - detecting (110) a first position, in particular a first state, of the back of the hand (19, 35) or the first tendon (13, 23, 34) of the forearm of the user at a first point in time by means of the first laser feedback interferometry sensor (15, 21, 32) of the sensor assembly (1a, 1b, 1c), and - detecting (120) a second position, in particular a second state, of the back of the hand (19, 35) or the first tendon (13, 23, 34) of the forearm of the user at a second point in time after the first point in time by means of the first laser feedback interferometry sensor (15, 21, 32) of the sensor assembly (1a, 1b, 1c), and - Based on the detected first and second positions, in particular postures, of the back of the hand (19, 35) or the forearm of the user, the user's gesture is determined (140) by means of the first computing unit (14, 26, 38) of the sensor assembly (1a, 1b, 1c).

15. The method according to any one of claims 13 or 14, characterized in that The method further comprises the following additional method steps: The ascertained gesture is transmitted (150) to an optical system (40) by means of a transmission unit (39) of the sensor arrangement (1a, 1b, 1c) for displaying a virtual or augmented reality to a user of the optical system (40).

Images