Method and apparatus for movement detection

Abstract

According to the present invention, a method for detecting contact-based motion of an object (20) on an object (8) includes the following steps: - providing a device (1) configured to detect contact-based motion of the object (20) on an object (8) integral with the device (1), the device (1) comprising: - at least two self-mixed interferometry (SMI) sensors (4), (6) emitting light beams toward portions (16), (18) of the object (8) integral with the device; - an object (8) integral with the device (1) and arranged above the two SMI sensors (4, 6), wherein the object (8) includes a user input surface (14) and a monitoring surface (12) arranged opposite to the user input surface (14) and facing the direction of the at least two SMI sensors (4, 6); and - a processor operatively connected to the at least two SMI sensors (4, 6); - The detection process includes: detecting the undisplaced state of the object (8), where SMI sensor signals SMI1 and SMI2 are zero; detecting at least two displacements in a portion of the object (8) using at least two SMI sensors (4, 6); positioning the position on the object (8) with the largest displacement as the starting point of the contact-based motion and positioning the position with the second largest displacement as the following point of the contact-based motion; and identifying the contact-based motion direction of the object (20) on the user input surface (14) from the starting point to the following point. Furthermore, a corresponding device is disclosed, configured to detect contact-based motion of an object on an object integral with the device.

Description

Technical Field

[0001] The present invention relates to a method for detecting contact-based motion of an object on an object, and to a device configured for detecting contact-based motion of an object on an object integrated with the device. Background Technology

[0002] Motion detection is a fundamental aspect of many modern technologies, from security systems to mobile devices. It involves recognizing and interpreting motion in a variety of contexts.

[0003] In the field of touch-sensitive devices, motion detection is crucial for interpreting user interactions. Users can perform various gestures, such as swiping, pinching, and tapping, each involving different movements. The ability to accurately detect and interpret these movements enables a wide range of interactive functions.

[0004] Slide detection represents the specialized field of motion detection on user-input surfaces and is a key component of user interaction with touch-sensitive devices such as earphones, smartphones, tablets, and touchpads. It involves recognizing specific gestures—slides—which are typically defined as approximately linear movements across a touch-sensitive surface from one point to another.

[0005] The ability to accurately detect and interpret swipe gestures enables a wide range of interactive functions on touchscreen devices. For example, users can browse lists, switch between pages, or delete items with a simple swipe of their finger. In some cases, the speed and direction of the swipe can also be used to provide additional functionality, such as navigation or game controls, and more.

[0006] From a technical perspective, touch detection is a complex process involving a series of technical steps and components. It begins with continuously monitoring any changes in contact with a touch-sensitive surface. This monitoring is achieved using sensors embedded within the device. The type of sensor used can vary depending on the specific device and its design. Some devices use capacitive sensors, which detect changes in the electric field when a finger touches the surface. Other devices use optical sensors, which use a beam of light and a sensor to detect the position and movement of the touch.

[0007] When a user places their finger on a surface and moves it in a linear direction without lifting it, this is recognized as a swipe gesture. Sensors in the device detect this movement and can collect a series of data and record the initial point of contact when the finger first touches the surface, the direction of movement, the swipe speed (the speed at which the finger moves across the surface), and the final point of contact when the finger leaves the surface.

[0008] The sensor tracks changes in current (for capacitive sensors) or light intensity (for optical sensors) caused by finger contact and movement.

[0009] In this context, self-mixing interferometry (SMI) is also commonly used in swiping techniques to detect and interpret the movement of a finger or stylus across a surface. The process begins with an SMI sensor emitting a light beam towards the surface where the swiping action occurs. As the finger moves across the surface, it alters the path of the light beam. The reflected light re-enters the laser cavity of the SMI sensor. This re-entering light interferes with the outgoing light, causing a change in the laser output or terminal voltage. These changes are detected and processed by the sensor to generate an interference signal. This signal is a periodic function of the phase of the backscattered field. By counting the number of visible fringes, the magnitude of the displacement can be calculated. The processed signal is then used to accurately detect and interpret the swiping action.

[0010] However, accurately detecting swipe gestures can be challenging. One challenge is requiring sensors, such as self-mixed interferometry (SMI) sensors, to be oriented towards the touchpad segment for accurate movement detection. This orientation constraint limits the design and placement options of the sensor within the device, which is the biggest drawback and constraint in this context. Furthermore, this can potentially affect the device's durability and susceptibility to damage due to the increased exposure of the sensor to external factors.

[0011] Another challenge is that when using, for example, a self-mixing interferometry (SMI) sensor as an optical sensor, the sensor's optical window needs to function correctly (this SMI sensor uses a light beam to detect the location and movement of a touch). The optical window allows the sensor to receive the necessary light signal for motion detection. However, including an optical window complicates the design and manufacturing process of the device, potentially leading to increased costs and affecting the device's aesthetic appeal.

[0012] The performance of the sensor can also be affected by environmental factors such as dust, dirt, and moisture on the optical window. These elements may obstruct the optical window or interfere with the sensor's ability to detect movement. Furthermore, the optical window and sensor may require regular cleaning and maintenance, which can be disadvantageous for the user.

[0013] Furthermore, when using capacitive sensors for slip detection, a metal plate must be used. However, these plates require additional space, which can be challenging for space-constrained systems and for dealing with radio frequency (RF) interference.

[0014] When using optical sensors that operate on the principle of light reflection, it is crucial that the object being sensed is very close to the sensor. This is because the sensor works by emitting light towards the object and then detecting the reflected light. If the object is too far away, the sensor's performance may be affected. Specifically, the sensor typically emits two separate beams of light. When the object is close enough, these beams illuminate the object and are reflected back without interfering with each other. This allows the sensor to accurately detect changes in the signal used to gather information about the object. However, such sensors only work at short distances and fail to function when the sensor is angled at a distance that is not perpendicular to or nearly perpendicular to the object.

[0015] However, if the object is too far away, the two beams may overlap at the moment they reach the object. This overlap can cause the beams to interfere with each other, resulting in a phenomenon called phase shift. This phase shift distorts the signal received by the sensor, making it difficult for the sensor to accurately interpret the information. Therefore, the sensor's ability to accurately detect and measure the characteristics of the object will be significantly reduced. Therefore, maintaining an appropriate distance between the sensor and the object is crucial for obtaining optimal sensor performance.

[0016] These challenges highlight the need for more robust, cost-effective, and user-friendly methods and systems for motion detection. This invention aims to address these challenges and enhance the accuracy and reliability of motion detection. Summary of the Invention

[0017] Therefore, the object of the present invention is to provide a method for detecting contact-based motion of an object on an object and an apparatus configured for detecting contact-based motion of an object integrated with the device, the method and apparatus solving the aforementioned problems and providing a more robust and cost-effective method and system for the aforementioned motion detection.

[0018] According to the invention, this objective is achieved by a method having the steps described in claim 1 and by the apparatus described in claim 13.

[0019] Therefore, this invention proposes a method for detecting contact-based motion of an object on a surface, the method comprising the following steps:

[0020] - Provide a device configured to detect contact-based motion of an object on an object integral with the device, the device comprising:

[0021] - At least two self-mixing interferometry (SMI) sensors, said at least two SMI sensors emitting light beams toward a portion of the object integrated with the device.

[0022] - An object integrated with the device and positioned above the two SMI sensors.

[0023] The objects include a user input surface and a monitoring surface, wherein the monitoring surface is arranged opposite to the user input surface and faces the direction of at least two SMI sensors, and

[0024] - A processor that is operatively connected to at least two SMI sensors.

[0025] - The object being detected is in its undisplaced state, where the SMI sensor signals (SMI1, SMI2) are zero.

[0026] - Use at least two SMI sensors to detect at least two displacements in a portion of the object.

[0027] - Position the location on the object with the largest displacement as the starting point of the contact-based motion, and position the location with the second largest displacement as the following point of the contact-based motion.

[0028] - Identify the contact-based motion direction of an object on a user-input surface, from the starting point to the following point.

[0029] With this arrangement, even in cases where, for example, there is no optical window or the object is optically opaque, the displacement of an object, such as a user-input surface, can be sensed, which constitutes a slide.

[0030] Sliding is detected by the displacement of an object, such as a housing, and not directly by the light reflected from the object being slid. At the start of a slide, the displacements at the two ends of the user-input surface are different. This difference is detected by using the two SMI channels of two SMI sensors, and the direction of the slide can be determined. In some applications, the displacement exists not only in the sliding area but also in other adjacent areas. Due to the high sensitivity of the SMI sensor, it can also detect sliding from the displacement of adjacent areas.

[0031] Furthermore, sliding can be detected even when the sensor is not facing the user input surface. This reduces design limitations, as the sensor can face directions other than directly towards the user input surface. Additionally, this arrangement provides a wider operating range.

[0032] In the context of a user input surface, swiping is a touch gesture involving a user placing their finger or stylus on the user input surface and moving the finger or stylus in a specific direction.

[0033] Furthermore, SMI sensors can include VCSELs or edge-emitting lasers (EELs) configured to emit light. Vertical-cavity surface-emitting lasers (VCSELs) and edge-emitting lasers (EELs) offer an economical solution due to their cost-effectiveness. Additionally, their compact size makes them a wise choice for applications where space is a consideration.

[0034] Additionally, when using an SMI sensor (which can have half-wavelength resolution), very small displacements, such as 5 μm, can be detected in the method.

[0035] It should be noted that the steps given above do not necessarily have to be performed in the given order. The steps provided can be performed in any other suitable order, or even some or all of them can be performed simultaneously.

[0036] In another preferred embodiment, the method may include the following steps:

[0037] - The step of detecting the unshifted state of an object also includes the following steps:

[0038] - Set the first distance between the first portion of the monitoring surface and the first SMI sensor as the first undisplaced distance, and

[0039] - Set the second distance between the second portion of the monitoring surface and the second SMI sensor as the second undisplaced distance, and

[0040] - The step of detecting at least two displacements in a portion of an object using at least two SMI sensors also includes the following steps:

[0041] - Measure the first distance between a first portion of the monitoring surface and the first SMI sensor.

[0042] - Calculate the first displacement as the difference between the first undisplaced distance and the first distance.

[0043] - Measure the second distance between the second portion of the monitoring surface and the second SMI sensor.

[0044] - Calculate the second displacement as the difference between the second undisplaced distance and the second distance, and

[0045] - If both the first and second displacements are equal to zero: then repeat the steps described above, and

[0046] - If one of the two displacements is not zero, the step of positioning the position on the object with the largest displacement as the starting point of the contact-based motion and positioning the position with the second largest displacement as the following point of the contact-based motion further includes the following steps:

[0047] - Displacements greater than the other displacement are identified as maximum displacements, and the relevant portions on the monitored surface are identified as the starting points of contact-based motion, where positive values ​​are considered greater than negative values, and

[0048] - Identify the other displacement as the second largest displacement, and identify the relevant part of the monitored surface as the follow point of the contact-based motion.

[0049] Through these additional steps, the method proposed by this invention uses the measurement of the corresponding distance as the detection standard for motion detection.

[0050] The method proposed by this invention, which includes additional steps and uses the measurement of the corresponding distance as the detection standard for motion detection, is easy to implement and economical.

[0051] In another preferred alternative embodiment, the method may include the following steps:

[0052] - The step of detecting at least two displacements in a portion of the object also includes:

[0053] - Measure the first frequency of the first SMI sensor signal.

[0054] - Measure the second frequency of the second SMI sensor signal, and

[0055] - If both the first and second frequencies are equal to zero:

[0056] Then repeat the above steps.

[0057] - The steps of positioning the position on the object with the largest displacement as the starting point of the contact-based motion and positioning the position with the second largest displacement as the following point of the contact-based motion further include:

[0058] - If either the first frequency or the second frequency is different from zero:

[0059] - Then, a frequency greater than another frequency is identified, wherein the following portion on the monitoring surface is identified as the location on the object with the maximum displacement and is therefore identified as the starting point of contact-based motion: the SMI sensor generating that frequency is emitting a beam of light toward that portion.

[0060] - Identify the following other part on the monitoring surface as the contact-based motion tracking point: another SMI sensor generating another frequency is emitting its beam toward this other part.

[0061] In conjunction with these additional steps, the method introduced by this invention utilizes comparisons of corresponding frequencies as the detection criterion for motion detection. The method proposed by this invention is easy to implement and cost-effective. It includes additional steps and employs comparisons of corresponding frequencies as the detection criterion for motion detection.

[0062] In another preferred alternative embodiment, the method may include the following steps:

[0063] - The step of detecting at least two displacements in a portion of the object also includes:

[0064] - Detect the first peak of the SMI signal from the first sensor.

[0065] - Detect the first peak of the SMI signal from the second sensor, and

[0066] - The steps of positioning the position on the object with the largest displacement as the starting point of the contact-based motion and positioning the position with the second largest displacement as the following point of the contact-based motion further include:

[0067] - Identify the sensor signal with an earlier first peak, wherein the following portion on the monitored surface is identified as the location on the object with the maximum displacement and is therefore identified as the starting point of contact-based motion: the SMI sensor generating this signal is emitting a beam of light toward this portion.

[0068] - Identify sensor signals with a later first peak, wherein the following portion on the monitored surface is identified as the location on the object with the second largest displacement and is therefore identified as the follower point of contact-based motion: the SMI sensor that is generating the signal is emitting a beam toward this portion.

[0069] By including these supplementary steps, the method proposed by this invention uses the temporal sequence of the first peak of the sensor signal as a criterion for detecting movement. The method proposed by this invention is easy to implement and cost-effective.

[0070] Several advantages are available when at least one SMI sensor can be configured such that the emitted light is oriented so that the emitted light is incident perpendicular to the monitoring surface.

[0071] This perpendicular incidence ensures that the maximum amount of light or radiation is reflected back to the sensor. This maximizes the signal strength, thereby enhancing measurement accuracy.

[0072] Furthermore, this configuration significantly reduces the likelihood of signal distortion that may be caused by character dispersion. This results in more reliable and trustworthy data, which is crucial in many applications.

[0073] Finally, perpendicular incidence simplifies signal processing requirements. This is because reflection characteristics become more predictable when the emitted light is incident perpendicularly. This predictability simplifies the design and operation of sensor systems, making them more efficient and easier to manage.

[0074] In another preferred embodiment, at least one SMI sensor is configured such that the emitted light is tilted relative to the monitoring surface at a predetermined angle, wherein the predetermined angle (α1, α2) is greater than 90° and / or not greater than 180°.

[0075] This configuration is particularly advantageous in scenarios where space is limited and sensor design is constrained. Despite these constraints, the sensor can still effectively detect and measure changes in surface properties, thus ensuring accurate and reliable readings.

[0076] In technical terms, the angle of incidence refers to the angle at which the emitted light strikes the monitoring surface. If the light strikes the surface perpendicularly, the angle of incidence is 90°.

[0077] This configuration is highly space-efficient when the angle is greater than 90°. In space-constrained scenarios, the sensor can be mounted in a way that minimizes its space footprint while still maintaining its functionality. This is particularly beneficial in compact devices or structures.

[0078] In addition, this configuration offers a high degree of design flexibility. Sensors can be integrated into a wide variety of structures or devices, even when design requirements present significant challenges.

[0079] Finally, the sensor exhibits a high level of adaptability due to its ability to adjust to different surface orientations. This is particularly useful when the monitored surface is not parallel to the base on which the sensor is mounted. Despite this orientation, the sensor can adapt and continue to provide accurate measurements. This adaptability makes the sensor versatile and effective in a wide range of scenarios.

[0080] Contact-based motion offers the advantage of immediate response when it involves direct contact between an object and the user input surface. This is because direct contact enables precise tracking of object movement, resulting in real-time and accurate input recognition. It also eliminates the need for additional hardware or sensors to detect the position or movement of objects, simplifying system design and operation. Furthermore, direct contact can provide tactile feedback to the user, enhancing the user experience.

[0081] The object can be the user's finger or stylus, providing a user-friendly and intuitive input interface.

[0082] These interaction methods allow users to apply their inherent understanding of physical movement to the digital context. Furthermore, the use of fingers or styluses unlocks a wide range of possibilities for more complex interactions.

[0083] By faithfully replicating the physical interactions that users are accustomed to, these input methods simplify interaction with digital devices, making it instinctive and familiar, while also enabling a wide range of possibilities for more complex interactions.

[0084] In a preferred embodiment of the invention, the object is optically opaque to electromagnetic radiation and / or light.

[0085] Optically opaque objects possess the inherent property of reflecting most incident light or electromagnetic radiation, rather than allowing it to pass through. This property significantly maximizes signal strength, thereby improving measurement accuracy. Furthermore, the object's opacity plays a crucial role in minimizing additional signal loss that might occur due to transmission through the object. This results in more reliable and dependable data.

[0086] Proper operation of the SMI sensors is ensured when the distance between the object and at least one of the at least two SMI sensors can be at least 0.2 mm.

[0087] In addition, in a preferred embodiment, the distance between the object and at least one of the at least two SMI sensors is less than 2.0 mm.

[0088] This not only ensures high precision and accuracy in motion detection but also provides greater design flexibility. While the proximity of the sensor enhances the system's sensitivity and reliability, the distance of less than 2.0 mm also allows for greater freedom in system design.

[0089] While maintaining the proper functionality of the method, a greater spacing between the SMI sensor and the object provides greater flexibility in the design possibilities for positioning the sensor and the object, especially in positioning the sensor and the object in confined spaces. This setup is made possible by the high sensitivity of the SMI sensor in use.

[0090] In another preferred embodiment of the invention, the object includes a curved surface and / or a bent surface. This opens up possibilities in terms of object design. However, the invention works with all types of surfaces, which can be bent, curved, flat, etc.

[0091] Furthermore, the present invention proposes a device configured to detect contact-based motion of an object on an object integral with the device, the device comprising:

[0092] - At least two self-mixing interferometric measurement sensors,

[0093] - An object that is integrated with the device and positioned above the two SMI sensors.

[0094] The objects include a user input surface and a monitoring surface, wherein the monitoring surface is arranged opposite to the user input surface and faces the direction of at least two SMI sensors, and

[0095] - A processor that is operatively connected to at least two SMI sensors.

[0096] By using a self-mixing interferometry (SMI) sensor, the device operates without any external optical components, simplifying its structure. This design choice reduces complexity and potential points of failure, enhancing the sensor's reliability and ease of use. Such a sensor is self-aligning, eliminating the need for complex alignment procedures. This improves operational efficiency and reduces setup time.

[0097] Furthermore, the content described regarding this method can be similarly applied to the device, and therefore need not be repeated here. Device implementation methods and details are correspondingly described in the method, and vice versa.

[0098] In addition, the present invention proposes a user equipment comprising at least one device configured to detect contact-based motion of an object on an object integral with the device.

[0099] In a preferred embodiment, the user equipment can be, for example, an earbud, or any other user equipment such as a wearable device or a smartphone. The sensor is a key component, for example, in the earbud, and plays a crucial role in its operation. Therefore, the ability to reduce the size of the sensor without compromising its performance is a substantial advantage. It allows for a more efficient allocation of available space within the earbud, potentially providing room for additional features or enhancements in other areas. Attached Figure Description

[0100] In the following description, the invention will be further detailed with reference to the accompanying drawings, in which:

[0101] Figure 1 The arrangement of two SMI sensors and an object in an undisplaced / idle state according to an embodiment of the present invention is depicted, and

[0102] Figure 2 The illustration depicts an arrangement of two SMI sensors and an object in which a hand performs a sliding motion from left to right, according to an embodiment of the invention.

[0103] Figure 3 The illustration depicts an arrangement of two SMI sensors and an object in which a hand performs a right-to-left sliding motion, according to an embodiment of the invention.

[0104] Figure 4a A graph depicting the SMI sensor signal in the unshifted / idle state is shown, and

[0105] Figure 4b depicts a graph showing the SMI sensor signals during the sliding motion from left to right, and

[0106] Figure 4c A graph depicting the SMI sensor signals during a sliding motion from right to left is presented.

[0107] Identical parts are indicated by the same reference numerals. Detailed Implementation

[0108] exist Figure 1 Embodiments of the present invention are shown in the figure. Figure 1 The text describes a method for detecting objects 20 ( Figure 1 (Not shown) Device 1 for detecting contact-based motion of object 20 on object 8. In this embodiment, device 1 is an earpiece, but it can also be any other user device in which sliding produces displacement.

[0109] Furthermore, a sensor device 2 is depicted, comprising two sensors 4 and 6 (which in this embodiment are a first sensor 4 and a second sensor 6) and an object 8 having a plane 10, a user input surface 14, and a monitoring surface 12. The monitoring surface 12 is arranged opposite to the user input surface 14 and facing at least the two sensors 4 and 6.

[0110] Furthermore, object 8, and therefore user input surface 14 and monitoring surface 12, may be optically opaque to electromagnetic radiation and / or light and / or infrared light.

[0111] When a material is described as optically opaque, it means that it does not allow any light to pass through. This is because materials have the ability to absorb, reflect, or scatter all light that comes into contact with them. When light comes into contact with a surface, it can be reflected, absorbed, scattered, or transmitted. However, in the case of optically opaque materials, no light is transmitted because all light is reflected, scattered, or absorbed.

[0112] Object 8 may also include a curved or bent surface, or a portion of the object may be shaped differently, such as curved or bent.

[0113] These sensors 4 and 6 are self-mixing interferometric measurement sensors configured to emit light, and include vertical cavity surface-emitting lasers (VCSELs) configured to emit light.

[0114] Self-mixing interferometry (SMI) is a method of redirecting light reflected from a moving object back to a laser source. This results in changes in both the amplitude and frequency of the laser beam. These changes can be analyzed to determine certain properties of the object.

[0115] A vertical-cavity surface-emitting laser (VCSEL) is a semiconductor laser diode. Unlike other edge-emitting lasers, VCSELs have a different emission orientation; they emit light perpendicular to the plane of the semiconductor chip.

[0116] Each sensor 4, 6 includes a sensor channel (not depicted in the figure). In the context of SMI sensors, a channel is generally understood as a path or medium through which the sensor processes or examines signals. For example, an SMI sensor can project a laser beam that is reflected back into a laser cavity by a target. This reflection causes variations in the amplitude and frequency of the emitted beam, enabling the laser to respond to the distance covered by the reflected beam. Each channel represents a separate path for analyzing and processing signals to a processor (not depicted in the figure), which is operatively connected to at least two SMI sensors 4, 6.

[0117] In this embodiment, the two sensors 4 and 6 are arranged such that the light beam is oriented so that it is incident perpendicular to the monitoring surface 12.

[0118] The two sensors 4 and 6 can also be arranged such that their beams are tilted relative to the monitoring surface 12 at predetermined angles α1 and α2. In this context, α1 is the angle between the beam of sensor 4 and the plane 10, and α2 is the angle between the beam of sensor 6 and the plane 10.

[0119] In this embodiment, such as Figure 1 As depicted, α1 and α2 are set to 90° for both sensors 4 and 6, which are perpendicular to the monitoring surface 12 in this context. However, it can also be equivalently predetermined for both sensors to any value between 91° and 180°, or predetermined to different values ​​for each of sensors 4 and 6 respectively.

[0120] Object 8 is integrated with device 1 and is positioned above the group of sensors 4 and 6.

[0121] The processor is not shown in the figure, but it is operatively connected to at least two sensors 4 and 6.

[0122] Device 1 can be any device in which multiple sensors 4 and 6 detect contact-based motion of an object on user input surface 14. In particular, device 1 can be an earphone, but it can also be a smartphone, a smartwatch, a screen with a touchpad, or any other device that operates using swipe detection (i.e., contact-based motion detection of an object on a device).

[0123] exist Figure 1 The image shows an undisplaced or idle state where there is no surface displacement and no sensor signal is generated. Two sensors, 4 and 6, monitor the area on object 8 located on monitoring surface 12.

[0124] An unshifted / idle state refers to a condition where a system, device, or resource is currently not being utilized or is awaiting operation. In this context, an unshifted or idle state refers to the following state of device 1: a portion of object 8 has not been shifted based on contact-based motion, and therefore no SMI signal is generated.

[0125] Figure 4a The diagram depicts graphs showing the sensor signals generated by sensor 4 (signal SMI1) and sensor 6 (signal SMI2) under the unshifted states SMI1 and SMI2. In this embodiment, the sensors are self-mixing interferometry sensors configured to emit beams of light.

[0126] exist Figure 4a Figure 4b and Figure 4c In the diagram, sensor signals SMI1 and SMI2 are described with respect to the signal amplitude as S and with respect to the time t.

[0127] As in Figure 4a As can be seen, no sensor signal is generated, and the device configured to detect contact-based motion of an object on object 8 is in an undisplaced / idle state in which no surface displacement is detected and therefore no sensor signal is generated.

[0128] In this undisplaced state, the first distance between the undisplaced first portion 16 of the monitoring surface 12 and the sensor 4 is set as the first undisplaced distance d. i1 And the second distance between the undisplaced second portion 18 of the monitoring surface 12 and the sensor 6 is set as the second undisplaced distance d. i2 .

[0129] Distance d was measured using two SMI sensors, 4 and 6. i1 and d i2 The two distances d i1 and d i2 It is the distance when object 8 (i.e., its plane 10) is not shifted.

[0130] After this, the first distance d1 between the first portion 16 of the monitoring surface 12 and the sensor 4 is measured.

[0131] After this, the first unshifted distance d is calculated. i1 The first displacement Δd1 is the difference between the first distance d1 and the first displacement d1.

[0132] The same operation is performed on the second part 18 of the monitoring surface 12 and the sensor 6, wherein a second distance d2 between the second part 18 of the monitoring surface 12 and the sensor 6 is measured.

[0133] Then, calculate the second unshifted distance d. i2 The second displacement Δd2 is the difference between the second distance d2 and the second displacement d2.

[0134] In addition, check whether the first displacement Δd1 is different from zero and whether the second displacement Δd2 is different from zero.

[0135] When both the first displacement Δd1 and the second displacement Δd2 are equal to zero, no displacement occurs compared to the undisplaced / idle state, and the following steps are repeated: measure distance d1, calculate the first displacement Δd1, measure distance d2, calculate the second displacement Δd2, and check whether displacements Δd1 and Δd2 are both different from zero.

[0136] When one of the two displacements Δd1 and Δd2 is not zero: identify the displacement Δd1 or Δd2 that is greater than the other displacement Δd1 or Δd2. Here, positive values ​​are considered greater than negative values.

[0137] The relevant portions (16, 18) of the larger displacement on the monitored surface (12) are further identified as the starting points of contact-based motion.

[0138] Additionally, the displacements Δd1 and Δd2 that are less than the other displacement Δd1 and Δd2 are identified, and the relevant portion of the monitoring surface 12 is identified as the follow point of the contact-based motion relative to the starting point of the contact-based motion.

[0139] Subsequently, the contact-based motion direction of object 20 on object 8 on user input surface 14 is identified. Therefore, the contact-based motion direction of object 20 on user input surface 14 is from the starting point to the following point.

[0140] In addition, the contact-based motion direction of the object 20 on the user input surface 14 is identified, which is from the starting point to the following point.

[0141] exist Figure 2 In the image, the fingers of the hand, which is the object 20, are shown performing contact-based motion on the user input surface 14.

[0142] In this case, the contact-based motion is from the starting point 16 on the user input surface 12 to the following point 18.

[0143] Figure 4b depicts a graph showing the sensor signals SMI1 and SMI2 generated by sensor 4 (whose signal is SMI1) and sensor 6 (whose signal is SMI2) in the stated case.

[0144] As can be seen in Figure 4b, the Doppler frequency of SMI1 is greater than that of SMI2. Therefore, the displacement at the first portion 16 of the monitoring surface 16 is greater than the displacement at the second portion 18 of the monitoring surface 18. Therefore, the sliding direction must be from the first portion 16 of the monitoring surface 16 (forming the starting point) to the second portion 18 of the monitoring surface 18 (forming the following point).

[0145] In an alternative to the method described above, a first frequency f1 of the first SMI sensor signal SMI1 and a second frequency f2 of the second SMI sensor signal SMI2 can be measured, and if both the first frequency f1 and the second frequency f2 are equal to zero, the above is repeated.

[0146] Subsequently, if one of the first frequency f1 and the second frequency f2 is not zero, frequencies f1 and f2 greater than the other frequency are identified, and the following portions 16 and 18 on the monitoring surface 12 are identified as the positions of the maximum displacement on the object 8 and thus as the starting points of contact-based motion: SMI sensors 4 and 6 generating this frequency emit beams toward these portions 16 and 18. Furthermore, the following other portions 16 and 18 on the monitoring surface 12 are identified as the following points of contact-based motion: another SMI sensor 4 and 6 generating another frequency emits its beam toward this other portion 16 and 18.

[0147] Alternatively, in another alternative, after detecting at least two displacements, the first peak of the first sensor SMI signal SMI1 and the first peak of the second sensor SMI signal SMI2 are detected. Subsequently, the sensor signal with the earlier first peak is identified, and the following portions 16 and 18 on the monitoring surface 12 are identified as the locations of the maximum displacement on the object 8 and thus as the starting points of contact-based motion: the SMI sensors 4 and 6 that are generating the signals SMI1 and SMI2 are emitting beams toward these portions 16 and 18.

[0148] Furthermore, the sensor signal with a later first peak is identified, and the following portions 16 and 18 on the monitoring surface 12 are identified as the location of the second largest displacement on the object 8 and thus as the follow point of the contact-based motion: the SMI sensors 4 and 6 that are generating the signals SMI1 and SMI2 are emitting beams toward these portions 16 and 18.

[0149] Combining the three methods, or even combining two of the three methods, can enhance the robustness of the method and the system.

[0150] exist Figure 3 In the image, the fingers of the hand, which is the object 20, are shown performing contact-based movements on the user input surface 14 and sliding from right to left, i.e. from the starting point (i.e., the second part 18 of the monitoring surface 18) to the following point (i.e., the first part 16 of the monitoring surface 16).

[0151] exist Figure 4c The diagram depicts a corresponding graph illustrating the sensor signals under the stated conditions. (See also...) Figure 4c As can be seen, the Doppler frequency of SMI2 is greater than that of SMI1. Therefore, the displacement at the second part 18 of the monitoring surface 18 is greater than the displacement at the first part 16 of the monitoring surface 16. Therefore, the sliding direction must be from the second part 18 of the monitoring surface 18 (forming the starting point) to the first part 16 of the monitoring surface (forming the following point).

[0152] In this embodiment, contact-based motion involves direct contact between object 20 and user input surface 14. Direct contact in contact-based motion can be as follows: Figure 2 and Figure 3 The actions described herein can be performed using the fingers of the hand, or using a stylus or any other tool suitable for the application.

[0153] It should be noted that the steps given above do not necessarily have to be performed in the given order. The steps provided can be performed in any other suitable order, or even some or all of them can be performed simultaneously.

[0154] List of abbreviations:

[0155]

[0156] List of reference numerals

[0157] Contact-based motion detection device 1

[0158] Sensor device 2

[0159] First SMI sensor 4

[0160] Second SMI sensor 6

[0161] Object 8

[0162] Plane 10

[0163] First distance d1

[0164] Second distance d2

[0165] Monitoring surface 12

[0166] User input surface 14

[0167] Sensor signal SMI1 of sensor 4

[0168] Sensor signal SMI2 of sensor 6

[0169] Signal strength S

[0170] Time t

[0171] First unshifted distance di1

[0172] Second unshifted distance di2

[0173] The angle α1 between the beam from the first sensor and the object

[0174] The angle α2 between the beam from the second sensor and the object

[0175] The first part of the monitoring surface 16

[0176] The second part of the monitoring surface 18

[0177] Object 20

[0178] Sensor signal SMI1

[0179] Sensor signal SMI2

Claims

1. A method for detecting contact-based motion of an object (20) on an object (8), the method comprising the steps of: - Provide a device (1) configured to detect contact-based motion of an object (20) on an object (8) integral with the device (1), the device (1) comprising: - At least two self-mixing interferometry (SMI) sensors (4, 6) emit light beams toward portions (16, 18) of an object (8) integrated with the device. - An object (8) that is integrated with the device (1) and arranged above the two SMI sensors (4, 6). The object (8) includes a user input surface (14) and a monitoring surface (12), wherein the monitoring surface (12) is arranged opposite to the user input surface (14) and faces the direction of the at least two SMI sensors (4, 6), and - A processor operatively connected to the at least two SMI sensors (4, 6), - Detect the undisplaced state of the object (8), wherein the SMI sensor signals (SMI1, SMI2) are zero. - Detect at least two displacements in a portion of the object (8) using the at least two SMI sensors (4, 6). - Position the location on the object (8) with the largest displacement as the starting point of the contact-based motion and position the location with the second largest displacement as the following point of the contact-based motion, and - Identify the contact-based motion direction of the object (20) on the user input surface (14), the contact-based motion direction being from the starting point to the following point.

2. The method for detecting contact-based motion of an object (20) on an object (8) according to claim 1, wherein: - The step of detecting the unshifted state of the object (8) further includes the following steps: - The first distance between the first portion (16) of the monitoring surface (12) and the first SMI sensor (4) is set as the first undisplaced distance (d). i1 ),as well as - Set the second distance between the second portion (18) of the monitoring surface (12) and the second SMI sensor as the second undisplaced distance (d). i2 ),as well as - The step of detecting at least two displacements in a portion of the object (8) using the at least two SMI sensors (4, 6) further includes the following steps: - Measure the first distance (d1) between the first portion (16) of the monitoring surface (12) and the first SMI sensor (4). - Calculate as the first unshifted distance (d) i1 The first displacement (Δd1) is the difference between the first distance (d1) and the first displacement (d2). - Measure the second distance (d2) between the second portion (18) of the monitoring surface (12) and the second SMI sensor (6). - Calculate as the second unshifted distance (d) i2 The second displacement (Δd2) is the difference between the second distance (d2) and the second displacement (d2), and - If both the first displacement (Δd1) and the second displacement (Δd2) are equal to zero: then repeat the above steps, and - If one of the two displacements (Δd1, Δd2) is not zero, the step of positioning the position on the object (8) with the largest displacement as the starting point of the contact-based motion and positioning the position with the second largest displacement as the following point of the contact-based motion further includes the following steps: - Displacements (Δd1, Δd2) greater than the other displacement (Δd1, Δd2) are identified as the maximum displacement, and the relevant portions (16, 18) on the monitoring surface (12) are identified as the starting points of the contact-based motion, wherein positive values ​​are considered greater than negative values, and - The other displacement (Δd1, Δd2) is identified as the second largest displacement, and the relevant portion (16, 18) of the monitoring surface (12) is identified as the follow point of the contact-based motion.

3. The method for detecting contact-based motion of an object (20) on an object (8) according to claim 1, wherein: - The step of detecting at least two displacements in a portion of the object (8) using the at least two SMI sensors (4, 6) further includes: - Measure the first frequency (f1) of the first SMI sensor signal (SMI1). - Measure the second frequency (f2) of the second SMI sensor signal (SMI2), and - If both the first frequency (f1) and the second frequency (f2) are equal to zero: Then repeat the above steps. The step of positioning the position on the object (8) with the largest displacement as the starting point of the contact-based motion and positioning the position with the second largest displacement as the following point of the contact-based motion further includes: - If either the first frequency (f1) or the second frequency (f2) is different from zero: - Then, frequencies greater than another frequency (f1, f2) are identified, wherein the following portions (16, 18) on the monitoring surface (12) are identified as the positions with the maximum displacement on the object (8) and are therefore identified as the starting points of the contact-based motion: the SMI sensor (4, 6) generating this frequency is emitting a beam of light toward the portions (16, 18), - Identify the following other portion (16, 18) on the monitoring surface (12) as the following point of the contact-based motion: the other SMI sensor (4, 6) that generates the other frequency emits its beam toward the other portion (16, 18).

4. The method for detecting contact-based motion of an object (20) on an object (8) according to claim 1, wherein: - The step of detecting at least two displacements in a portion of the object (8) using the at least two SMI sensors (4, 6) further includes: - Detect the first peak of the SMI signal (SMI1) from the first sensor. - Detect the first peak of the second sensor SMI signal (SMI2), and The step of positioning the position on the object (8) with the largest displacement as the starting point of the contact-based motion and positioning the position with the second largest displacement as the following point of the contact-based motion further includes: - Identify the sensor signal with an earlier first peak, wherein the following portions (16, 18) on the monitoring surface (12) are identified as the positions with the maximum displacement on the object (8) and are therefore identified as the starting points of the contact-based motion: the SMI sensors (4, 6) that are generating the signals (SMI1, SMI2) are emitting beams toward the portions (16, 18), - Identify sensor signals with a later first peak, wherein the following portions (16, 18) on the monitoring surface (12) are identified as positions on the object (8) with a second largest displacement and are therefore identified as the following points of the contact-based motion: the SMI sensors (4, 6) that are generating the signals (SMI1, SMI2) are emitting beams toward the portions (16, 18).

5. The method for detecting contact-based motion of an object (20) on an object (8) according to any one of the preceding claims, in, At least one SMI sensor (4, 6) is configured such that the emitted light is directed such that the light is incident perpendicular to the monitoring surface (12).

6. The method for detecting contact-based motion of an object (20) on an object (8) according to any one of claims 1 to 4, in, At least one SMI sensor (4, 6) is configured such that the emitted light is tilted relative to the monitoring surface (12) at a predetermined angle (α1, α2), and Wherein, the predetermined angle (α1, α2) is greater than 90° and / or not greater than 180°.

7. The method for detecting contact-based motion of an object (20) on an object (8) according to any one of the preceding claims, in, The contact-based motion involves direct contact between the object (20) and the user input surface (14).

8. The method for detecting contact-based motion of an object (20) on an object (8) according to any one of the preceding claims, in, The object (20) is the user's finger or stylus.

9. The method for detecting contact-based motion of an object (20) on an object (8) according to any one of the preceding claims, in, The object (8) is optically opaque to electromagnetic radiation and / or light.

10. The method for detecting contact-based motion of an object (20) on an object (8) according to any one of the preceding claims, in, The distance between the object (8) and at least one of the at least two SMI sensors (4, 6) is at least 0.2 mm.

11. The method for detecting contact-based motion of an object (20) on an object (8) according to any one of the preceding claims, wherein, The distance between the object (8) and at least one of the at least two SMI sensors (4, 6) is less than 2.0 mm.

12. The method for detecting contact-based motion of an object (20) on an object (8) according to any one of the preceding claims, in, The object (8) includes curved surfaces and / or bent surfaces.

13. A device (1) configured to detect contact-based motion of an object (20) on an object (8) integral with the device (1), the device (1) comprising: - At least two self-mixing interferometry (SMI) sensors (4, 6). - An object (8) that is integrated with the device (1) and arranged above the two SMI sensors (4, 6). The object (8) includes a user input surface (14) and a monitoring surface (12), wherein the monitoring surface (12) is arranged opposite to the user input surface (14) and faces the direction of the at least two SMI sensors (4, 6), and - A processor operatively connected to the at least two SMI sensors (4, 6).

14. A user equipment comprising at least one device (1) configured to detect contact-based motion of an object (20) on an object (8) integral with the device (1) according to claim 13.

15. The user equipment according to claim 14, wherein, The user equipment is an earphone.

Images