SELF-MIXING INTERFEROMETRY SENSOR MODULE, ELECTRONIC DEVICE AND METHOD FOR DETECTING MOTIONS
The self-mixing interferometry sensor module addresses the limitations of mechanical and optoelectronic buttons in consumer electronics by using self-mixing interference for compact, efficient, and durable motion detection, enabling advanced control features in electronic devices.
Patent Information
- Application Number
- DE112023000321
- Authority / Receiving Office
- DE · DE
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-02-15
- Filing Date
- 2023-02-14
- Publication Date
- 2024-11-14
AI Technical Summary
Existing consumer electronic devices face challenges with mechanical buttons that require space, are prone to damage, and have limited lifespan, while optoelectronic modules are bulky due to the need for multiple components like light emitters and receivers.
A self-mixing interferometry sensor module using a light emitter with a cavity resonator and an electronic control unit to detect movements based on self-mixing interference, eliminating the need for collimation optics and photodiodes, and integrating with a CMOS integrated circuit for compact and efficient motion detection.
The solution provides a compact, cost-effective motion detection system that accurately detects finger movements for controlling electronic devices, offering additional functionality and durability without the space and durability issues of mechanical buttons and bulkiness of traditional optoelectronic modules.
Smart Images

Figure 00000000_0003_ABST 
Figure 00000000_0002_ABST 
Figure 00000000_0000_ABST 
Figure 00000000_0001_ABST
Abstract
Description
[0001] The present invention relates to a self-mixing interferometry sensor module, an electronic device and a method for detecting movements. BACKGROUND OF THE INVENTION
[0002] Modern consumer electronics devices such as mobile phones, radios, tablet computers, wearable devices, and TV remote controls contain mechanical means, such as buttons or other interfaces, that allow the user to control various functions such as volume adjustment and channel selection. In addition, modern in-ear speakers have sensors designed to detect when the user taps the housing with their finger. This signal is in turn used for some, albeit limited, controls, such as pausing or resuming music playback or skipping to the next or previous song in a playlist. However, to date there has been no way for the user to adjust the volume of the sound output, i.e., to increase or decrease it, or to specifically fast-forward to another part of the currently playing audio medium, such as an audio book.
[0003] Furthermore, the integration of mechanical control buttons into an electronic device and into the device's casing can be complicated and poses additional quality risks, especially in the case of very small devices. Mechanical buttons, in particular, typically require a lot of space, which is often at a premium in compact devices such as smartphones or wearable devices. Furthermore, the openings in the casing required for the mechanical buttons pose a risk of dust and water ingress, which can cause permanent damage to the device. Such problems are usually solved by additional sealing or protective parts, which, however, further increase the complexity and cost of the device. In addition, the lifetime of mechanical push-button systems is notoriously limited, for example due to mechanical springs connected to the push-buttons, which wear out over time.
[0004] Existing approaches to overcome these limitations include optoelectronic modules operable to respond to the user's finger movement to control the device. These approaches have the disadvantage that such modules require numerous components, for example, at least one light emitter and preferably two or more light-receiving elements such as photodiodes to detect the light reflected from the user's finger. Therefore, these modules are quite bulky and even larger than mechanical pushbutton modules.
[0005] One object is therefore to provide a sensor module for electronic devices that overcomes the aforementioned limitations of existing solutions. A further object is to provide an electronic device comprising such a sensor module and a method for detecting movements.
[0006] These objects are achieved by the subject matter of the independent claims. Further developments and embodiments are described in the dependent claims. SUMMARY OF THE INVENTION
[0007] The improved concept is based on the idea of providing a self-mixing interferometry sensor module operable to respond to various finger and / or gesture movements of the user to control an electronic device. Motion detection is based on the occurrence of self-mixing or back-injection interference, in which at least a portion of the emitted light from a target external to the module, such as a user's finger, is reflected back into a cavity of the light emitter, causing a modulation of the frequency of the emitted optical beam, which in turn also modulates an electrical property of the emitter. In other words, the light emitter itself becomes a distance and / or speed sensor, since a degree of the resulting modulation depends on these properties of the moving object.The advantage over conventional sensor modules lies in the significantly smaller footprint of the sensor and the lower costs, since no complicated collimation optics and photodiodes are required, for example in the case of a pure voltage readout.
[0008] In one embodiment, a self-mixing interferometry sensor module according to the improved concept comprises a light emitter configured to emit coherent electromagnetic radiation from the sensor module and to be subject to self-mixing interference (SMI) caused by reflections of the emitted electromagnetic radiation from an object outside the sensor module. The self-mixing interferometry sensor module further comprises an electronic control unit coupled to the light emitter and configured to detect a change in an electrical property of the light emitter caused by the SMI. The electronic control unit is further configured to determine a movement of the object outside the sensor module from the detected change and to generate an output signal comprising information about the determined movement.
[0009] The light emitter for enabling self-mixing interference has a cavity resonator into which at least a portion of the light emitted by the light emitter is reflected or backscattered by an object outside the module. The light emitter is, for example, a laser diode and has a laser cavity. The light emitter is configured to emit coherent light, for example, in the infrared (IR), visible, or ultraviolet (UV) range of the electromagnetic spectrum, from the sensor module. The light emitter is configured, for example, to generate a continuous emission or to emit light in a pulsed mode, the latter of which can contribute to reducing energy consumption.
[0010] If the emitted light is re-injected into the cavity as described above and the light is reflected due to movement of the object outside the module, the light emitter is set up to experience self-mixing interference (SMI). SMI changes a property, such as a wavelength, of the light in or emitted from the laser cavity. For example, it causes a modulation of the frequency of the emitted light, thereby generating a periodic fringing signal. The modulation, in turn, causes a change in an electrical property of the light emitter. For example, a diode current and / or a voltage are similarly modulated. If there is no target outside the module in the emission field of the light source that collects and reflects its light, no self-mixing interference occurs in the light emitter.
[0011] The electronic control unit has means, for example active or passive circuits, for measuring said change in an electrical property. Since the change in the electrical property depends on the movement of the object, the electronic control unit has a further circuit for deriving a movement of the object from the change in the electrical property, for example in the form of a change in position, direction, and / or speed. Based on the detected movement, the electronic control unit further has means for generating an output signal containing information about the detected movement. For example, the movement is a movement perpendicular or parallel to an emission direction of the light emitter.The output signal includes information about the movement, for example information about speed, duration and / or direction of the movement as well as a distance of the object, for example measured in an emission direction of the light emitter.
[0012] For example, the light emitter and the electronic control unit form an integrated semiconductor device, such as a CMOS integrated circuit device, on a common substrate. In particular, a sensor module according to the improved concept is free of dedicated photodetectors for detecting reflected or backscattered light.
[0013] An electronic device may use such a self-mixing interferometry sensor module as part of the detection of a displacement, distance, movement, speed, or velocity of an object external to the module, for example, a gesture at a distance from the sensor module or a movement relative to an input surface of the module, i.e., a so-called swipe or tap motion. Hereinafter, all such potentially measured parameters will be referred to simply as "motion." In particular, such a self-mixing interferometry sensor module may be used with a wide range of consumer electronics and other electronic devices, serving as an input module that replaces mechanical buttons and has additional degrees of freedom, facilitating user control of functions such as volume, as well as track, channel, or page selection, depending on the application.
[0014] In some embodiments, the light emitter is a vertical cavity surface-emitting laser diode (VCSEL). VCSELs are characterized by beam emission perpendicular to a main plane of extension of a top surface of the VCSEL. The VCSEL may be formed from semiconductor layers on a substrate, wherein the semiconductor layers have two distributed Bragg reflectors (DBRs) sandwiching active region layers therebetween, thus forming a cavity. VCSELs and their operating principle are a well-known concept and will not be further explained in this disclosure. The VCSEL is configured, for example, to have an emission wavelength of 940 nm, 850 nm, or another natural wavelength. The VCSEL may be configured to emit coherent laser light when forward biased, for example.Suitable alternative light emitters are semiconductor lasers such as edge emitters, quantum cascade and quantum dot lasers.
[0015] In some embodiments, the electronic control unit is configured to detect a change in the junction voltage of the light emitter and to determine the movement of the object from the change in the junction voltage. A quantity other than the wavelength (and optical power, since it is related to the emission frequency) that is influenced by self-mixing is typically the junction voltage of the laser. It should be noted that both the output frequency and, consequently, the junction voltage are dependent on the movement.
[0016] Measuring the junction voltage, for example, the junction voltage of a VCSEL, therefore offers a convenient way to detect movement of an object, such as a finger, because its signature is transferred directly and essentially instantaneously to the junction voltage of the light emitter, such as the VCSEL diode. Alternatively, a modulation of the bias current can be detected as the changing electrical property of the light emitter.
[0017] In some embodiments, the electronic control unit is configured to detect a frequency modulation of the electrical property caused by the SMI and to determine the movement of the object from the detected frequency modulation. Detecting a frequency modulation not only offers the possibility of detecting movement of the object but can also provide further details about these movements. The amplitude of the resulting modulation signal can indicate a position of the object within the emission area, for example, a light cone or beam, of the light emitter, while a comparison of the rising and falling edges of the modulation signal can indicate, for example, a direction of movement.If the object is a user's finger, the modulation signal can even reveal which of the user's fingers is being moved over or within the light emitter's emission region due to the unique pattern of friction grooves on each finger that form the human fingerprint. However, it should be noted that even a seemingly smooth object, such as a slider, has sufficient topography to enable interferometric displacement measurements using SMI.
[0018] In some embodiments, the electronic control unit is further configured to determine a speed of movement from the detected change and to generate the output signal containing information about the determined speed. Since optical interferometry is an extremely sensitive means of detecting displacements, the modulation signal caused by the SMI of a slowly moving object differs significantly from that of a faster moving object. In particular, in the case of human fingers, the pattern formed by the friction grooves is sufficient to resolve even a difference in the speed of the object's movement. In such embodiments, the change in the electrical property of the light emitter is therefore linked to information about the speed of the object's movement.This information can be incorporated into the generation of the output signal, so it can be used to adjust a property of an electronic device depending on the detected speed. For example, a playback speed or the speed of fast forward / rewind can be adjusted depending on the detected speed.
[0019] In some embodiments, the electronic control unit is further configured to determine a direction of movement along a movement axis from the detected change and to generate the output signal containing information about the determined direction. In addition to or as an alternative to the aforementioned detection of the speed, optical interferometry is ideal for displacement measurement. Thus, analogous to the aforementioned determination of a movement speed, a modulation based on SMI can also carry information about a movement direction. For example, the resulting change in the signal of the electrical property of the light emitter can be analyzed in the form of the rising and falling edges of an amplitude modulation.For example, a rising edge that is steeper than the falling edge may indicate forward motion along a particular axis, such as an x-axis perpendicular to an emission direction of the light emitter, while a steeper falling edge of the signal may indicate backward motion along the first axis. Furthermore, the resulting modulation signal of the electrical property may carry information about backward or forward motion along a second axis that is perpendicular to both the first axis and an emission direction, as well as along a third axis that is perpendicular to the first and second axes and parallel to an emission direction, such as tapping.
[0020] In some embodiments, the electronic control unit is further configured to determine an orientation of the movement with respect to a first axis and a second axis from the detected change and to generate the output signal comprising information about the determined orientation. In addition or alternatively to the aforementioned detection of whether the movement occurs in a first or second direction along a specific axis, the resulting signal can also be distinguished based on the SMI as to whether the movement is oriented along a first axis, for example an x-axis, or along a second axis, for example a y-axis, wherein the first and second axes are, for example, perpendicular to one another and to an emission direction of the light emitter.Likewise, the electronic control unit can further be configured to determine, from the detected change, an orientation of the movement with respect to a third axis that is parallel to an emission direction of the light emitter, for example, a z-axis. Furthermore, the electronic control unit can be configured to determine a deviation of an orientation of the movement with respect to the first and second axes. In particular, a single light emitter is sufficient to determine a direction and an orientation of the movement along all three main axes of movement of the object.
[0021] In some embodiments, the electronic control unit is configured to determine, from the detected change, a movement of a user's finger outside the sensor module. In other words, the object is a finger. As described above, the friction grooves of a human finger represent an excellent reflection target for generating self-mixing interference. Since optical interference is capable of resolving shifts on the order of fractions of the optical wavelength of light, the grooves of the fingers, which are several tens of micrometers thick, are more than sufficient to generate an interference signal with a sufficiently high signal-to-noise ratio to accurately determine aspects of the movement, such as direction of movement or speed.Since fingers are the most common input device in modern electronic devices, an SMI sensor module configured to detect finger movement outside the sensor module offers an efficient and highly accurate way to capture user input. Compared to existing capacitive technologies, such as those used in touch screens, SMI sensing offers additional capabilities such as gesture recognition or finger-dependent output signal generation due to its extreme sensitivity.
[0022] In some embodiments, the electronic control unit is further configured to identify a user's finger from the detected change and generate the output signal comprising information about the identified finger. In addition to determining aspects of the movement itself, the modulation signal is strong enough, due to the self-mixing interference from the finger grooves, to also distinguish individual fingers of a user. For example, the output signal may comprise information about which of a user's fingers (i.e., thumb, index finger, ring finger, etc.) of which hand is moving through or within the emission field of the light emitter. This information may be included in the generation of the output signal and used to adjust a function of an electronic device depending on the identified finger.For example, an index finger can adjust the volume, while a middle finger swipe in the same direction / orientation can skip to the next or previous item in a playlist. Furthermore, swipe sequences can be used for security purposes, such as unlocking or locking an electronic device. A specific swipe or sequence of swipes can be used to lock a wearable device or smartphone to prevent accidental touch inputs, for example, when it is stored in a pocket or during exercise. Another specific swipe or sequence of swipes can be used to unlock the device and allow touch inputs.For this purpose, the output signal may include information about a movement of a first finger, e.g., a movement of an index finger in a first direction along a first orientation, and a second finger, e.g., a movement of a middle finger in a second direction along a second orientation, etc. For this purpose, the electronic device may include a memory containing information about the user's fingers, e.g., acquired during an initial training procedure.
[0023] In some embodiments, the self-mixing interferometry sensor module further comprises a transmissive cover arranged at a distance from the light emitter in an emission direction of the light emitter, wherein the transmissive cover serves as a surface for the movement of the object. In general, a moving object to be detected, for example a user's finger, should preferably remain at approximately the same height above the sensor module, i.e., the light emitter, when the user moves the finger through or within the emission range of the light emitter. Therefore, a cover that is transmissive at an emission wavelength of the light emitter can serve as a support and / or protection surface of the sensor module. In particular, tapping movements, i.e., movements in an emission direction of the light source, can be restricted by the transmissive cover.In this context, "transparent" refers to the emission wavelength of the light emitter. The transmissive cover is, for example, a glass or plastic cover that is transparent in the UV, visible, and / or infrared range.
[0024] In some further embodiments, a main extension plane of the transmissive cover is arranged perpendicularly or at an angle to the emission direction. A perpendicular arrangement can be advantageous from the point of view of saving space, since with this arrangement the overall dimensions of the sensor module can be minimized. Furthermore, the sensor module can have means for preventing back reflections through a cover glass. These means can comprise an anti-reflective coating on the cover, which works most effectively at an angle of incidence of approximately 90 degrees. An angled arrangement of the cover, on the other hand, can help suppress back reflections without additional coatings and thus increase the sensitivity of the sensor module to smooth object surfaces, for example a finger covered by a leather glove.An angled arrangement can also be chosen for non-trivial housing shapes of an electronic device in which the sensor module is to be used.
[0025] In some embodiments, the self-mixing interferometry sensor module further includes an optical lens positioned remote from the light emitter in an emission direction of the light emitter. A lens can be used to define an emission region of the light sensor and thus configure a detection region of the sensor module. The lens can be positioned remotely or directly above a top surface of the light emitter. For example, the lens is positioned between the light emitter and an optional transmissive cover of the sensor module.
[0026] Furthermore, an electronic device is provided, wherein the electronic device comprises a self-mixing interferometry sensor module according to one of the aforementioned embodiments and a processing unit coupled to the sensor module. The processing unit is configured to receive the output signal from the sensor module and extract the information about the detected movement of the object from the output signal. The processing unit is further configured to select a feature of the electronic device and control the feature based on the information.The electronic device may be a handheld device such as a smartphone, a tablet computer, a television remote control, a wearable device such as a smartwatch or fitness tracker, or any other electronic device that allows user input via gestures and / or touch, such as laptop computers, car infotainment systems, home appliances, and the like.
[0027] The processing unit can be a central processing unit (CPU) of the electronic device or a system-on-a-chip (SOC), which is designed, for example, to process user input. The processing unit is coupled to the sensor module and receives the output signal from the latter. The output signal contains information about a detected movement, such as a direction, distance, and / or speed of the movement, as well as other optional data, such as an identified finger. The processing unit is configured to interpret the output signal as input for a function of the device, such as volume control, display control, channel selection, etc.For this purpose, the processing unit converts the output signal into a control signal and forwards this control signal to the respective component of the electronic device, for example a sound control device.
[0028] In some embodiments, the processing unit is further configured to select the feature based on the extracted information. In contrast to embodiments where the sensor module serves to replace mechanical buttons for a specific purpose, such as volume control, in these embodiments the processing unit may add additional functionality. For example, the processing unit may be configured to interpret the detected movement as input for various functions of the electronic device depending on a property of a movement, such as speed, orientation, or direction. For example, if the processing unit extracts and recognizes a particular aspect of the detected movement, the component or function to be controlled may be selected based on that aspect.
[0029] In some embodiments, the processing unit is further configured to compare the information with a first and a second movement pattern, select and control the feature if the information matches the first movement pattern, and select and control another feature of the electronic device if the information matches the second movement pattern. The processing unit extracts, for example, information about an orientation of the movement with respect to the main axes from the output signals. The processing unit then compares this orientation with the first movement pattern, which indicates, for example, a movement along a first axis, and with a second movement pattern, which indicates, for example, a movement along a second axis that differs from the first axis.The processing unit can be configured to interpret a movement along a first axis, for example an x-axis, as an input request for a first feature, for example a volume of the sound, and a movement along a second axis, for example a y-axis, as an input request for a second feature, for example the selection of a next / previous item in a playlist of stored media items. Furthermore, the processing unit can compare the detected orientation of the movement with other axes, for example with an orientation along a third axis such as a z-axis, which indicates knocking, and associate a movement along the third axis with an input request for a further feature, for example a play / pause request for media played via a loudspeaker.
[0030] In some embodiments, the processing unit is further configured to extract a determined direction of movement from the output signal and to control the feature depending on this direction. Movements along a particular axis can differ with regard to the sense or direction of movement along the axis, i.e., forward or backward along the axis. Thus, the processing unit can be configured to extract information about a direction of the detected movement along a particular axis from the output signal and to interpret a movement in a forward direction as an input query of a first feature in a first sense and a movement in a backward direction as an input query of a first feature in a second sense.For example, a forward direction triggers an increase in volume or selection of a next item in a playlist, while a forward direction triggers a decrease in volume or selection of a previous item in a playlist.
[0031] In some embodiments, the processing unit is further configured to extract a determined orientation of the movement from the output signal and to control the feature depending on the orientation. For example, the processing unit can be configured to extract information about an orientation of the detected movement relative to the main axes from the output signal and to interpret a movement along a first orientation as an input query for a first feature and a movement along a second orientation as an input query for a second feature. For example, a movement along the first orientation triggers a change in volume, while a movement along the second orientation triggers a change in other sound properties, such as bass.
[0032] In some embodiments, the processing unit is further configured to extract a determined speed of movement from the output signal and to control the feature depending on the speed. Like a sense of direction, the speed of movement can also be extracted and used in an analogous manner. For example, a slow movement in a certain direction is interpreted as a prompt to fast-forward a currently playing media at a first speed, while a slow movement in a certain direction is interpreted as a prompt to fast-forward the media at a second, higher speed. Alternatively, the volume can be increased or decreased depending on the detected speed of movement.
[0033] In some embodiments, the processing unit is further configured to extract information about the detected movement of a user's finger from the output signal, extract information about an identified user's finger from the output signal, and select and control the feature depending on the identified finger and the detected movement. As mentioned above, the processing unit may be configured to output a control signal for various features of the electronic device depending on which finger was detected by the SMI sensor module.For example, the processing unit is configured to interpret a movement of the index finger along a specific orientation as a query to set a first feature, for example a volume, and a movement of the middle finger along the same orientation as a query to set a second feature, for example to set a bass of the sound output via a loudspeaker.
[0034] In some embodiments, the electronic device further comprises a speaker operable to generate sound, wherein the characteristic corresponds to a volume of the sound generated by the speaker, and wherein the processing unit is configured to increase or decrease the volume depending on a direction of the detected movement. In such embodiments, the conventional mechanical buttons for volume control are replaced by an SMI sensor module, which can provide the additional functionalities and advantages described above. Furthermore, some electronic devices, such as in-ear speakers, typically do not have a function for adjusting parameters of the output sound or only have a single adjustment option, for example, by tapping, which is not suitable for adjusting features such as volume or bass of the music.
[0035] In some embodiments, the electronic device further comprises a memory for storing a playlist of media items, e.g., songs, wherein the feature corresponds to selecting a next or previous media item in the playlist, and wherein the processing unit is configured to select the next or previous media item depending on a direction of the detected movement. For example, a sensor module may be configured to detect movements along the three main axes, e.g., a swipe on a device surface or a tap, and the processing unit translates the detected movement into the setting of certain features.A first axis can be used for volume control, a second axis for fast forward or rewind, while the third axis, representing a tap gesture, for example, could be used for discrete inputs such as play / pause, answering a call, or activating a voice assistant.
[0036] Further embodiments of the electronic device will become apparent to the person skilled in the art from the aforementioned embodiments of the self-mixing interferometry sensor module and vice versa.
[0037] Furthermore, a method for detecting movements is provided, the method comprising emitting coherent electromagnetic radiation from a sensor module by means of a light emitter and inducing self-mixing interference (SMI) within the light emitter caused by reflections of the emitted electromagnetic radiation from an object outside the sensor module. The method further comprises detecting a change in an electrical property of the light emitter caused by the SMI, determining a movement of the object outside the sensor module from the detected change, and generating an output signal containing information about the determined movement.
[0038] Further embodiments of the method will become apparent to the person skilled in the art from the aforementioned embodiments of the self-mixing interferometry sensor module and the electronic device, and vice versa. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] The following description of the figures may further illustrate and explain aspects of the self-mixing interferometry sensor module and the method for detecting motion. Components and parts of the self-mixing interferometry sensor module that are functionally identical or have an identical effect are identified by identical reference numerals. Identical or effectively identical components and parts may only be described with reference to those figures in which they first appear. Their description is not necessarily repeated in subsequent figures. DETAILED DESCRIPTION
[0040] In the figures: Fig. 1 to 3 show various embodiments of a self-mixing interferometry sensor module according to the improved concept; Fig. Figure 4 shows a detailed schematic diagram of a self-mixing interferometry sensor module; Fig. 5 to 9 show exemplary electronic signals caused by self-mixing interferometry in a sensor module; and Fig. 10 shows various embodiments of an electronic device having a self-mixing interferometry sensor module.
[0041] Fig. Figure 1 shows, in panels 1a to 1d, a first embodiment of a self-mixing interferometry sensor module 1, SMI, according to the improved concept. Fig. 1a, the SMI sensor module 1 comprises a light emitter 10 configured to emit coherent electromagnetic radiation 11 from the sensor module. The light emitter 10 may be a laser light source, such as a vertical cavity surface-emitting laser (VCSEL), which emits light in a vertical direction relative to a main extension plane of the VCSEL, i.e., a bottom or top surface. The light emitter 10 may be configured to emit light in the infrared (IR), visible, or ultraviolet (UV) range of the electromagnetic spectrum. The light emitter 10 is based, for example, on GaAs / AlGaAs materials and emits light in the range of 750-980 nm, in particular around 850 nm. Other, longer wavelengths of, for example, 1.3 µm, 1.55 µm or more than 2 µm can be achieved with a VCSEL made of alternative materials, such as indium phosphide.The light emitter is coupled to a voltage or current source 401, which is, for example, part of a diode driver circuit.
[0042] The emitted electromagnetic radiation 11 can be a collimated or a diverging beam, the latter being shown in the figure. A divergent beam profile can be advantageous for achieving a larger emission area and thus being susceptible to reflections from a target within a wider range. In other words, the effective field of view of the sensor module is determined by the divergence of the emitted light 11.
[0043] The SMI sensor module 1 is further configured to inject reflected light 12 back into a cavity of the light emitter 10, for example, a laser cavity. The reflected light 12, shown in the figure as a dashed arrow, is reflected by an object 30 moving with a motion vector 31 through the field of view of the sensor module 1. The object 30 can be a body part of a user, such as a finger or the face, or a component of an electronic device in which the sensor module 1 is used, for example, a stylus or a slider. In particular, the object 30 is at least partially opaque with respect to an emission wavelength of the light emitter 10, so that at least a portion of the emitted light 11 is reflected by a surface of the object 30.
[0044] Since the emitted light 11 is coherent, the reflected light 12 interferes with the light in the laser cavity, depending on the phase shift caused by the round trip to and from the object 30. This, in turn, leads to changes in the properties of the light emitted by the light emitter 10, including the output frequency, linewidth, threshold gain, and consequently the output power. Thus, the resulting self-mixing interference modulates the frequency (and optionally the amplitude) of the laser oscillation field within the cavity. Movement of the object 30 along the motion vector 31, for example, a hand movement, causes a fluctuation in the distance between the reflective surfaces 32 of the object 30, effectively forming a vibrating target. Even the smallest topographical features on the reflective surface 32 are sufficient for the formation of SMI inside the light emitter 10.In other words, the self-mixing interference is caused even in the illustrated case where the reflection surface 32 of the object 30 lies along a motion vector 31 that is substantially perpendicular to an emission direction of the light emitter 10.
[0045] The SMI sensor module 1 further comprises an electronic control unit 20 coupled to the light emitter 10, so that an electrical property of the light emitter 10 can be detected using the electronic control unit 20. The electronic control unit 20 comprises, for example, means for monitoring and detecting a junction voltage of the light emitter 10, for example, a VCSEL junction voltage. In addition to the optical power of the light emitter 10, the junction voltage is also affected by self-mixing and also exhibits a modulation behavior upon movement of the object 30. However, it should be noted that while the output power varies proportionally to the change in the target position, the junction voltage exhibits an inverse relationship. In other words, an increase in laser power is accompanied by a decrease in the junction voltage.Alternatively, the electronic control unit 20 may include means for monitoring and detecting changes in the laser current of the light emitter 10 that exhibit a similar modulation due to a moving object 30.
[0046] The electronic control unit 20 further comprises means for analyzing the electrical property and for determining the movement of the object 30 from a detected change in the electrical property and for generating an output signal that contains information about the movement vector 31. A schematic representation of an electronic control unit 20 is shown in Fig. 4 shown and described.
[0047] Panels 1b and 1c show that the SMI sensor module 1 can detect movements of the object 30 even when the emitted light 11 is incident on the reflective surface 32 not perpendicularly, but at an angle. For example, the reflective surface 32 can have an angle α with respect to a main extension plane of the light emitter 10, or the light emitter 10 itself can be arranged at an angle β with respect to the reflective surface 32. Due to a finite, but non-zero, roughness of the reflective surface 32, these arrangements also meet the requirement that at least a portion of the emitted light 11 is reflected back into a cavity of the light emitter 10. It should be noted that self-mixing interferometry can even be realized for shifts of only approximately 2% of the emission wavelength of the light emitter 10.
[0048] Panel 1d shows the sensor module 1, with the emitted light 11 reflected by a finger 30a. The friction grooves of the finger 30a have a surface roughness large enough to enable efficient operation of the sensor module 1 due to a high SMI value. The sensor module 1 can detect a movement of the finger 30a along different motion vectors 31a, 31b, for example, in opposite directions. In panels 1b to 1d and in the following figures, the electronic control unit 20 is omitted for illustrative purposes.
[0049] Fig. Figure 2 shows, in panels 2a to 2c, a second embodiment of a self-mixing interferometry sensor module 1, SMI. In this embodiment, the sensor module 1 further comprises a transmissive cover 13, which is arranged at a distance from the light emitter 10 in an emission direction. In other words, the transmissive cover 13 is arranged at a distance from a main extension plane of the emitter 10. The term "transmissive" in this context refers to an emission wavelength of the light emitter 10. For example, no emitted light 11 is reflected by a surface of the transmissive cover 13, so that the reflected light 12 is exclusively light reflected by the object 30.
[0050] The object 30 may comprise the sensor module 1 or it may be a component of an electronic device in which the sensor module 1 is used. The object is, for example, an opaque plastic element or a pin that is configured to slide along the plane defined by a surface of the transmissive cover 13, as shown in the Fig. 2a and Fig. 2b. The object 30 can be in contact with the transmissive slider during the movement or can be arranged at a distance from it. In particular in the latter case, a tapping movement of the object towards the light emitter 10, as in Fig. 2c, and also induces SMI within the cavity of the light emitter 10.
[0051] Fig. Figure 3 shows, in panels 3a to 3d, a third embodiment of a self-mixing interferometry sensor module 1, SMI. Similar to the second embodiment, the sensor module 1 has a transmissive cover 13 that serves as a touch surface. As before, the emitted light 11 is reflected only or substantially only at the reflective surface 32 of the object 30, in this case a finger 30a. The electronic control unit 20 of the sensor module 1 is thus configured to detect a movement of the finger 30a along a movement vector 31a, 31b on a surface of the transmissive cover 13, for example, a cover glass or a transparent dielectric. The movement vector 31a, 31b can be aligned with a first axis, as indicated, or with a second axis perpendicular to an emission direction of the light emitter 10 and the first axis, i.e., the second axis is arranged perpendicular to the plane of the drawing.The electronic control unit 20 can be configured to determine a deviation of the motion vector 31 from the first and second axes. Additionally, the electronic control unit 20 can be configured to determine a tapping motion oriented along a third axis that runs parallel to the emission direction of the light emitter, i.e., perpendicular to the upper surface of the transmissive cover 13.
[0052] The embodiments of the Fig. 3b and Fig. 3c comprise an additional lens element 14 arranged between the light emitter 10 and the transmissive cover 13. The lens element 14 can be configured to perform beam shaping to define a spot size of the emitted light 11 and thus a field of view of the sensor module 1 at an upper surface of the transmissive cover 13. As shown in Fig. As shown in Figure 3c, the transmissive cover 13 can be arranged at an angle β with respect to a main extension plane of the light emitter 10. Accordingly, the lens element 14 can be arranged at a corresponding angle to direct the emitted light 11 onto the intended part of the transmissive cover 13. Fig. 3d shows a Fig. 1c shows an arrangement analogous to that shown in FIG. 1c, in which the cover 13 is arranged at an angle γ to an emission direction of the light source 10. Such angled arrangements can be advantageous for applications in which a surface of the housing of the electronic device is not parallel to a main extension plane of the sensor module 1.
[0053] Fig. Figure 4 shows a detailed schematic representation of a self-mixing interferometry sensor module 1, in particular the electronic control unit 20. The sensor module 1 comprises a VCSEL as light emitter 10, which has an active region 10a arranged between the lower and upper mirrors 10b, 10c. The light propagates in the vertical direction, which is orthogonal to the plane of the active region. The current 402 is fed from the mirrors via a driver circuit comprising a supply source 401 and a resistor 403. To measure the electrical property of the light emitter 10, in this case a modulation of the junction voltage, the electronic control unit 20 comprises AC coupling and DC blocking capacitors 404a, 404b, which couple the light source to an amplifier 405 for amplifying the signal.
[0054] Optionally, the amplifier 405 can also be configured as a filter, for example, as a bandpass filter, so that an output of the amplifier 405 essentially only contains frequency contributions of the SMI induced by the light 12 injected back into the light emitter 10. The output of the amplifier 405 can be coupled to an analog-to-digital converter (ADC) 406 before the digitized signal is forwarded to a processor 407 for generating the output signal. For this purpose, the processor 407 analyzes the digitized signal, for example, by extracting frequencies and / or amplitudes of the modulation caused by the SMI, and generates the output signal containing information about this modulation and thus about the detected movement.
[0055] For example, the electronic control unit 20 may form an integrated circuit together with the light emitter 10 on a common chip substrate. Therefore, the self-mixing interferometry sensor module 1 may be a CMOS integrated circuit.
[0056] Fig. Figure 5 illustrates the operating principle of a self-mixing interferometry sensor module 1 according to the improved concept. For this purpose, Fig. Figure 5 shows the resulting signal of the electrical property, for example, the junction voltage, of the light emitter 10 when an object 30 is moved along a motion vector 31 across the field of view of the sensor module 1. In panel (a), the moving object 30 is moving toward the field of view of the light emitter 10, defined by its beam divergence of the emitted light 11, but has not yet entered the field. In other words, no emitted light 11 is incident on the object 30. Thus, the junction voltage signal is dominated by noise and shows no further contributions due to SMI.
[0057] In panel (b), the object 30 enters the field of view of the sensor module 1 in such a way that a portion of the light from the object 30, i.e., from a reflective surface 32, is reflected back to the light emitter 10 (dashed line), where it is reradiated into the cavity and causes self-mixing interference as described above. This results in amplitude and / or frequency modulation of the junction voltage, resulting in a sinusoidal behavior. As the object 30 moves further into the field of view of the sensor module, as shown in panel (c), a larger portion of the emitted light 11 strikes the object 30 and is reflected back to the light emitter 10, resulting in an even stronger SMI and thus a stronger modulation of the junction voltage signal monitored by the electronic control unit.
[0058] Finally, the object 30 is moved out of the field of view so that the modulation signal initially decreases due to the weaker backreflection (panel (d)) before the object is again outside the emission area of the light emitter in panel (e), similar to panel (a).
[0059] Fig. 6 compares the resulting junction voltage signal of the third embodiment of the SMI sensor module 1 due to different movements of the object 30, in this case a finger 30a. Fig. Figure 6a shows the resulting signal for a finger 30a moving in a first direction along an axis, while Fig. Figure 6b shows the resulting signal for a finger 30a moving in a second direction along said axis, the second direction being opposite to the first direction. For example, the first movement is to the left and the second movement is to the right. The middle diagram in the respective figures shows the resulting signal for repeated movements, while the respective lower diagram represents an enlargement of a feature of the resulting signal with respect to the x-axis, which forms the time axis. As can be seen, the resulting signal when the finger moves to the left is significantly different from that when the finger moves to the right. Therefore, the electronic control unit 20 can easily distinguish in which direction along a particular axis an object 30 is moved.Thus, a correspondingly generated output signal can contain information about the axis, direction, and optionally the speed of the movement in the resulting modulation signal through pattern recognition and / or gradient analysis. This signal could, in turn, be used to increase or decrease the volume of an electronic device in which the sensor module 1 is used.
[0060] Fig. Figure 6c shows the resulting signal of a repeated tapping motion, i.e., a movement of the finger 30a along the emission axis of the light emitter 10. Again, the middle plot shows the resulting junction voltage signal for a repeated tapping motion, while the lower plot shows a zoom in on a feature of the middle plot. It can be seen that the tapping motion also causes a modulated signal, which differs slightly from the signals in the Fig. 6a and Fig. 6b. It is therefore emphasized that a sensor module 1 with a single light emitter 10 is sufficient to detect the direction and orientation of the movement 31.
[0061] The Fig. 6d and Fig. 6e show the resulting signal for the case where no object is located in the emission area of the light source, or for the case where a finger 30a rests on a surface of the transmissive cover 13. In the first case, essentially no part of the emitted light 11 is reflected back into the light emitter 10, so that the junction voltage signal is constant over time and exhibits only little noise, for example, due to electronic noise. With a stationary finger 30a, the signal also remains constant, with no visible modulation by SMI, since no movement occurs; however, the noise contribution is greater because part of the emitted light 11 is reflected and injected back into the cavity of the light emitter 10.
[0062] Fig. 7a and Fig. 7b compare an angle of the rising edge α', α'' and that of the falling edge β', β'' in the resulting modulated junction voltage signal in the applications of Fig. 6a or 6b. If you move in Fig. 6a to the left, you will see Fig. When zooming into a single modulation strip of the junction voltage signal, an angle α' of the rising edge is smaller than an angle β' of the falling edge. When moving to the right of Fig. Figure 6a shows an enlargement into a single modulation strip of the junction voltage signal in Fig. 7b, on the other hand, an angle α'' of the rising edge that is greater than an angle β'' of the falling edge. A correspondingly generated output signal can therefore contain information about the direction of the movement by comparing the angles of the rising and falling edges of the resulting modulation signal.
[0063] The Fig. 8a to 8e compare the resulting junction voltage signal of the third embodiment of the SMI sensor module 1 due to a movement along the same motion vector 31a, but performed with different fingers 30a-e of a user. As can be seen from the respective resulting signals of the Fig. As can be seen in Figures 8a to 8e, the individual finger used for the movement can be clearly distinguished due to the unique fingerprints, as the resulting signals differ significantly in terms of frequency and / or amplitude modulation. It should be noted that a movement with a different finger is already recognizable independently of the fingerprint due to human anatomy itself. A movement with the middle finger may indicate a different elbow position than a movement with the index finger, and thus, for example, a slightly different movement sequence.
[0064] For example, an electronic device in which the sensor module is used can be configured to collect a series of training data in which the user is asked to move various fingers over the sensor module so that the finger 30a-30e can be identified for detection purposes and information about the finger 30a-30e used for the movement can be included in the output signal. This signal can be used, for example, to increase or decrease the volume when the index finger is moved along a specific orientation, or to skip forward or backward through an item in a playlist of an electronic device in which the sensor module 1 is used, when the middle finger is moved along the same orientation.
[0065] Fig. 9 shows an embodiment in which multiple light emitters 10 are arranged on a common substrate or in a common module housing 50. By using multiple light emitters, each of which may be subject to self-mixing interference, movement can be monitored over a greater distance if the fields of view are arranged adjacent to one another along an axis of the motion vector 31. Fig. 9a shows an example with two light emitters 10. The operation of each of these light emitters is analogous to the embodiments of the sensor module 1 according to the embodiments discussed above.
[0066] However, the use of two modules also offers a convenient way to monitor a speed of movement by measuring a time difference of a feature of the resulting modulation signals of the first light emitter 10 (upper graph of Fig. 9b) and the second light emitter 10 (lower graph of Fig. 9b) is monitored.
[0067] Fig. 10 shows embodiments of electronic devices 100 comprising an SMI sensor module 1 according to the improved concept. Fig. 10a shows an electronic device 100 with a plurality of sensor modules 1 arranged side by side, wherein each of the sensor modules 1 can be configured to control a characteristic feature of the electronic device upon detecting movement within its respective detection area. For example, each of the sensor modules 1 is configured to trigger one of the following actions: increasing or decreasing the volume of a sound, switching to a next or previous item in a playlist or channel in a channel list, or confirming a selection.For this purpose, the output signals generated by the sensor modules 1 are fed to a processing unit 101 which is coupled to the sensor modules 1 and is configured to extract information about the detected movements from the output signals received from one or more of the sensor modules 1 and to initiate an adaptation of the desired property of the electronic device 100 in a manner corresponding to the detected movement.
[0068] Such a sensor arrangement can be used, for example, in a TV remote control as in Fig. 10b, a smartphone, a laptop, a wearable device, or any other device based on user input. Alternatively, as described, a single sensor module 1 can also distinguish between movements of an object 30 in different directions, along different axes, and / or at different speeds, so that, particularly for smaller devices, such as in-ear headphones or wearable devices, the use of a single sensor module 1 according to the improved concept is sufficient to enable the detection of different movements. This is in contrast to conventional mechanical buttons, which only allow one or two use cases, for example, a single and a double press. However, these conventional solutions do not allow for the continuous adjustment of properties such as volume with a single button module.
[0069] The embodiment of the electronic device 100 in Fig. Figure 10c shows a system with a plurality of sensor modules arranged in a grid-like pattern. On such a device, for example, a laptop touchpad or a touchscreen, movement along different axes and at different speeds can be monitored over larger distances than in applications where only a single sensor module 1 is used, thus making the detection of movements over large areas even more accurate.
[0070] The embodiment of the electronic device 100 of Fig. Figure 10d shows a system with a single sensor module 1 used in an in-ear speaker. A single sensor module 1 with a single light emitter 10 can be used to detect a movement along a first orientation, for example, to adjust a sound level, along a second orientation, for example, to select a next or previous item in a playlist, or a tapping movement to switch between a play / pause state and / or to activate additional functions such as a voice assistant. The determined speed of the movement can be used, for example, to adjust the degree of adjustment of the respective property. For more precise measurements, depending on space and energy requirements, multiple sensor modules 1 could be used, for example, according to the arrangement in Fig. 10a, can be used.
[0071] This patent application claims priority to U.S. Patent Application No. 63 / 310,233, the disclosure of which is hereby incorporated by reference.
[0072] The embodiments of the self-mixing interferometry sensor module and method for detecting the motion of an object disclosed herein have been discussed to familiarize the reader with the novel aspects of the concept. Although preferred embodiments have been shown and described, changes, modifications, equivalents, and substitutions of the disclosed concepts may be made by one skilled in the art without unnecessarily departing from the scope of the claims.
[0073] It is clear that the disclosure is not limited to the disclosed embodiments and to what has been specifically shown and described herein. Rather, features listed in individual dependent claims or in the description may be advantageously combined. Furthermore, the scope of the disclosure includes those variations and modifications that would be obvious to one skilled in the art and fall within the scope of the appended claims.
[0074] The term "comprising," as used in the claims or the description, does not exclude other elements or steps of a corresponding feature or method. If the terms "a" or "an" are used in conjunction with features, they do not exclude a plurality of such features. Furthermore, all reference signs in the claims are not to be construed as limiting the scope of application. Reference symbol 1 self-mixing interferometry module 10 light emitters 10a active area 10b, 10c End mirror 11 emitted light 12 reflected light 13 permeable cover 14 lens 20 electronic control unit 30 objects 30a-e fingers 31, 31a, 32b Motion vector 50 common housing 100 electronic devices 101 processing unit 401 Source 402 Electricity 403 Resistance 404a, 404b capacitor 405 amplifiers 406 analog-to-digital converter 407 processor α, β, γ angles QUOTES CONTAINED IN THE DESCRIPTION
[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature
[0000] US Patent Application No. 63 / 310,233
[0071]
Claims
[1] A self-mixing interferometry sensor module (1), comprising - a light emitter (10) which is designed to - to emit coherent electromagnetic radiation (11) from the sensor module; and - to be subject to self-mixing interference, SMI, caused by reflections (12) of the emitted electromagnetic radiation from an object (30) outside the sensor module (1); and - an electronic control unit (20) coupled to the light emitter (10) and configured to - to detect a change in an electrical property of the light emitter caused by the SMI; - to determine a movement (31) of the object (30) outside the sensor module (1) from the detected change; and - to generate an output signal containing information about the detected movement. [2] The self-mixing interferometry sensor module (1) according to claim 1, wherein the light emitter (10) is a vertical cavity surface emitting laser diode, VCSEL. [3] The self-mixing interferometry sensor module (1) according to claim 1 or 2, wherein the electronic control unit (20) is configured to detect a change in a junction voltage of the light emitter (10) and to determine the movement (31) of the object (30) from the change in the junction voltage. [4] The self-mixing interferometry sensor module (1) according to one of claims 1 to 3, wherein the electronic control unit (20) is further configured to - to determine a speed of movement (31) from the detected change; and - to generate the output signal containing information about the detected speed. [5] The self-mixing interferometry sensor module (1) according to one of claims 1 to 4, wherein the electronic control unit (20) is further configured to - to determine a direction of movement (31) along a movement axis from the detected change; and - to generate the output signal containing information about the determined direction. [6] The self-mixing interferometry sensor module (1) according to one of claims 1 to 5, wherein the electronic control unit (20) is further configured to - to determine an orientation of the movement (31) with respect to a first axis and a second axis from the detected change; and - to generate the output signal containing information about the determined orientation. [7] The self-mixing interferometry sensor module (1) according to one of claims 1 to 6, wherein the electronic control unit (20) is configured to determine a movement (31) of a finger (30a, 30b, 30c, 30d, 30e) of a user outside the sensor module (1) from the detected change. [8] The self-mixing interferometry sensor module (1) according to claim 7, wherein the electronic control unit (20) is further configured to - to identify a finger (30a, 30b, 30c, 30d, 30e) of the user from the detected change; and - to generate the output signal comprising information about the identified finger (30a, 30b, 30c, 30d, 30e). [9] The self-mixing interferometry sensor module (1) according to one of claims 1 to 8, further comprising a transmissive cover (13) arranged spaced apart from the light emitter (10) in an emission direction of the light emitter (10), wherein the transmissive cover (13) serves as a surface for the movement (31) of the object (30). [10] The self-mixing interferometry sensor module (1) according to claim 9, wherein a main extension plane of the transmissive cover (13) is arranged perpendicular or at an angle to the emission direction. [11] The self-mixing interferometry sensor module (1) according to any one of claims 1 to 10, further comprising an optical lens (14) arranged away from the light emitter (10) in an emission direction of the light emitter (10). [12] An electronic device (100) comprising a self-mixing interferometry sensor module (1) according to any one of claims 1 to 11 and a processing unit (101) coupled to the sensor module (1), wherein the processing unit (101) is configured to - to receive the output signal from the sensor module (1); - extracting the information about the detected movement (31) of the object (30) from the output signal; - select a feature of the electronic device (100); and - to control the feature based on the information. [13] The electronic device (100) according to claim 12, wherein the processing unit (101) is further configured to select the feature based on the extracted information. [14] The electronic device (100) according to claim 12 or 13, wherein the processing unit (101) is further configured to - to compare the information with a first and a second movement pattern; - to select and control the feature if the information matches the first movement pattern; and - selecting and controlling another feature of the electronic device (100) when the information matches the second movement pattern. [15] The electronic device (100) according to any one of claims 12 to 14, wherein the processing unit (101) is further configured to - to extract a determined direction of movement (31) from the output signal; and - to control the feature depending on the direction. [16] The electronic device (100) according to any one of claims 12 to 15, wherein the processing unit (101) is further configured to - to extract a determined speed of movement (31) from the output signal; and - to control the feature depending on the speed. [17] The electronic device (100) according to any one of claims 12 to 16, wherein the processing unit (101) is further configured to - extracting from the output signal the information about the detected movement (31) of the finger of a user (30a, 30b, 30c, 30d, 30e); - extracting information about an identified finger (30a, 30b, 30c, 30d, 30e) of the user from the output signal; and - to select and control the feature depending on the identified finger (30a, 30b, 30c, 30d, 30e) and the determined movement (31). [18] The electronic device (100) according to any one of claims 12 to 17, further comprising a speaker (102) operable to generate sound, wherein - the characteristic corresponds to a volume of the sound generated by the loudspeaker (102); and - the processing unit (101) is configured to increase or decrease the volume depending on a direction of the detected movement (31). [19] The electronic device (100) according to any one of claims 12 to 18, further comprising a memory (103) for storing a playlist of media items, wherein - the feature corresponds to the selection of a next or previous media item in the playlist; and - the processing unit (101) is configured to select the next or previous media element in the memory (103) depending on the direction of the detected movement (31). [20] A method for detecting movements (31), comprising: - Emitting coherent electromagnetic radiation (10) from a sensor module (1) by means of a light emitter (10); - inducing self-mixing interference, SMI, within the light emitter (10) caused by reflections (12) of the emitted electromagnetic radiation (11) from an object (30) outside the sensor module (1); - detecting a change in an electrical property of the light emitter (10) caused by the SMI; - Determining a movement (31) of the object (30) outside the sensor module (1) from the detected change; and - generating an output signal containing information about the detected movement (31).
Citation Information
Patent Citations
Laser motion detector
GB2443662A
Data input devices and methods for detecting movement of a tracking surface by detecting laser doppler self-mixing effects of a frequency modulated laser light beam
US20060072102A1
US63310233B2
Cited By
Operating device for an electronic device, electronic device and method for gesture recognition
DE102025102161A1
