Method for motion detection by means of ble channel sounding

Abstract

The invention relates to a method for motion detection inside and / or outside a vehicle (F) by means of a sensor system (S) having: a first BLE sensor (S1); and a second BLE sensor (S2), wherein one of the two BLE sensors (S1, S2) is used as initiator and the other of the two BLE sensors (S1, S2) is used as reflector in order to perform a BLE channel sounding, in particular comprising two distance measurement methods: a primary phase-based distance measurement (PBR); and a secondary round-trip-time (RTT)-based distance measurement, and the measured values in the BLE channel sounding are used for enabling motion detection inside and / or outside the vehicle (F), in particular without using a mobile device and without using further sensors, such as UWB sensors and / or ultrasonic sensors.

Description

Technical Field

[0001] This invention relates to a method for motion detection inside and / or outside a vehicle. Furthermore, this invention relates to a corresponding computer program product, a corresponding control unit, and a corresponding sensor system. Background Technology

[0002] For smart vehicle access, UWB sensors are typically used, which can achieve the following functions: - Smartphone / key location (passive entry); and / or - UWB radar functionality for interior spaces (so-called "child presence detection", "intrusion detection" or similar functions) and UWB radar functionality for exterior spaces (kick sensors (e.g. for opening suitcases)).

[0003] Essentially, a BLE (Bluetooth Low Energy) transmitter / receiver unit, also known as a BLE sensor, is used, for example, to activate a UWB (Ultra-Wideband) sensor on a vehicle according to a standard method (CCC protocol). Here, the user-side mobile device acts as the initiator, while the vehicle-side BLE sensor acts as a reflector to determine the distance between the mobile device and the BLE sensor. Once the distance is determined, the corresponding UWB sensor can be activated for motion detection or distance measurement to a smartphone or wireless key equipped with the appropriate technology.

[0004] UWB sensors are also used for functions in interior spaces, such as: - Intrusion detection; - Children were detected; - Occupancy detection, etc.

[0005] UWB sensors have relatively high energy consumption and computational overhead. Summary of the Invention

[0006] The objective of this invention is to at least partially overcome the aforementioned drawbacks. In particular, the objective of this invention is to provide an improved method for motion detection inside and / or outside a vehicle, which can be performed with reduced energy and computational overhead, provides reliable results, and enables extended functionality in motion detection. Furthermore, the objective of this invention is to provide a corresponding computer program product, a corresponding control unit, and an improved sensor system for motion detection inside and / or outside a vehicle, wherein the latter can have a simple structure, utilize a small number of inexpensive sensors, and operate safely and reliably.

[0007] This task is solved by a method having the features of claim 1. Furthermore, this task is solved by a corresponding computer program product, a corresponding control unit, and a corresponding sensor system having the features of the independent claim. Here, the features and details described in conjunction with different embodiments and / or aspects of the invention are of course also applicable to other embodiments and / or aspects, and vice versa; therefore, the disclosures regarding various embodiments and / or aspects can always be referenced mutually.

[0008] According to the first aspect, the present invention specifies: A method for motion detection inside a vehicle (meaning in the interior space) and / or outside (meaning in the vicinity) via a sensor system, said sensor system having: - The first BLE sensor; and - Second BLE sensor, In this configuration, one of the two BLE sensors acts as the initiator, and the other acts as the reflector, in order to perform BLE channel sensing, which may include two distance measurement methods: - Primarily phase-based distance measurements; and - Secondary distance measurement based on round-trip time, Furthermore, the measurements from BLE channel detection are used to achieve motion detection inside and / or outside the vehicle, especially without the need for mobile devices and other sensors such as UWB sensors and / or ultrasonic sensors.

[0009] The concept described here is to utilize existing BLE sensors in an advantageous manner to perform BLE channel sensing. Valuable measurements can be collected, enabling motion detection and even motion classification.

[0010] This invention recognizes that no mobile device is required to perform BLE channel probing. Existing BLE sensors can be used as initiators for establishing BLE channels. Another existing BLE sensor can be used as a reflector.

[0011] By using BLE sensors for motion detection, the expensive, energy- and computationally intensive UWB sensors can be omitted.

[0012] Measurements taken in BLE channel probing can provide valuable insights for motion detection and even motion classification, as well as other useful functions.

[0013] This invention recognizes that measurements in BLE channel probing can possess characteristic structures that indicate motion and its type. These characteristic structures can be analyzed to determine the motion itself and its type.

[0014] These characteristic structures can advantageously enable the identification, and preferably the differentiation, of different types of motion inside and / or outside the vehicle: - No exercise; - Walking outside the vehicle and / or touching the vehicle from the outside, especially when the windows are open; - Movement inside the vehicle; - Rapid movement inside the vehicle; - Normal movement inside the vehicle; - Calm movement inside a vehicle, such as while sleeping.

[0015] Therefore, an improved method for motion detection inside and / or outside a vehicle can be provided, which can be performed with reduced energy and computational overhead, provides reliable results, and enables extended functionality in motion detection. For this purpose, a simple and inexpensive BLE sensor system can be used, which is safe and reliable in operation.

[0016] For example, it can be specified that motion detection inside and / or outside the vehicle is achieved (potentially only) using the amplitude difference between the initiator and the reflector. When motion occurs inside and / or outside the vehicle, the measured amplitude difference can reveal characteristic structures that can be easily and reliably identified. Furthermore, the measured amplitude difference can reveal characteristic structures that can be easily and reliably distinguished to identify different types of motion.

[0017] Furthermore, it can be specified that the phase difference between the initiator and the reflector is used to achieve motion detection inside and / or outside the vehicle. The measured value of the phase difference can reveal characteristic structures that can be easily and reliably identified, especially when motion occurs inside the vehicle.

[0018] Furthermore, it can be specified that motion detection inside and / or outside the vehicle is achieved using signal strength at the initiator and / or at the reflector. Measurements of signal strength allow for a simple and reliable distinction between motion and no motion, particularly inside the vehicle.

[0019] Essentially, a set of time-series measurements along a particular selected BLE channel is sufficient for motion detection inside and / or outside the vehicle. This reduces computational overhead while achieving relatively high reliability in motion recognition. For a single-channel probe sub-event, an F1 score of 0.96 can be achieved, where 1 indicates always correct.

[0020] Furthermore, multiple sets of time-series measurements along several, particularly selected, BLE channels—for example, along 2, 3, 4, or 5 particularly selected BLE channels—are sufficient to achieve motion detection inside and / or outside the vehicle. In this way, very high reliability in motion recognition can be achieved. For a 5-channel probe sub-event, an F1 score of 1 can be achieved, where 1 indicates that it is always correct.

[0021] Advantageously, the desired accuracy in motion detection can be set by a specific number, particularly selected, BLE channels, and the measurements from these BLE channels can be analyzed.

[0022] This method can provide a variety of beneficial functions: - Intrusion detection (motion detection inside the vehicle when the vehicle is locked and / or locked). - Identify the presence of people inside and / or outside the vehicle (motion recognition inside and / or outside the vehicle). - Detect the presence of children inside the vehicle (calm movement when the vehicle is locked and / or locked). - Occupancy detection inside the vehicle (Where is the movement located inside the vehicle?). - Motion classification (What types of motion do the interior and exterior of a vehicle belong to?); - Even health monitoring (frantic exercise versus normal exercise), etc.

[0023] This method can be executed by a control unit (e.g., supported by an AI model). The control unit can be implemented in a single BLE sensor or in each BLE sensor. Essentially, only one BLE sensor can be equipped with such a control unit, which can then act as an initiator in BLE channel sensing. Alternatively, each BLE sensor can be equipped with such a control unit, allowing each BLE sensor to act as an initiator in BLE channel sensing.

[0024] According to another aspect, the present invention specifies: A corresponding computer program product includes instructions that, when executed by a computer, cause the computer to perform the methods described above. Here, the same advantages described in conjunction with the method can be achieved.

[0025] According to another aspect, the present invention specifies: A corresponding control unit has a computing unit and a storage unit, in which code is stored, which, when executed at least partially by the computing unit, performs the methods described above. Here, the same advantages described in conjunction with this method can be achieved.

[0026] According to another aspect, the present invention specifies: A corresponding sensor system for motion detection inside and / or outside a vehicle, having a corresponding control unit, can be implemented here, achieving the same advantages described in conjunction with this method.

[0027] The first and second BLE sensors can be advantageously positioned inside the vehicle, for example, under the roof, or above the first and / or second rows of seats. This allows for motion recognition both inside and / or outside the vehicle (especially when the windows are open).

[0028] The first BLE sensor and the second BLE sensor can, for example, form a 2×2 antenna configuration, thereby providing four antenna paths in BLE channel detection.

[0029] Basically, the control unit for performing motion detection can be implemented in one of two BLE sensors that acts as the initiator in BLE channel probing, wherein specifically only one or each BLE sensor can be designed to act as the initiator. Furthermore, the control unit for performing motion detection can be provided as a separate unit. Attached Figure Description

[0030] The invention will now be explained in more detail with the aid of the accompanying drawings.

[0031] The following figures illustrate: Figure 1 An exemplary vehicle with two BLE sensors is shown; Figure 2 This illustrates an exemplary procedure in BLE channel probing; Figure 3 Exemplary measurements of amplitude difference are shown; Figure 4 Exemplary measurements of the phase difference are shown; Figure 5 Exemplary measurements of signal strength are shown; and Figure 6 Exemplary results for phase difference and amplitude difference are shown. Detailed Implementation

[0032] Figures 1 to 6 This is used to explain the concept of the present invention, which specifies that: A method for motion detection inside (or within the interior space of a vehicle) and / or outside (but nearby, such as when a window is open) a (BLE) sensor system S.

[0033] like Figure 1 As shown, the sensor system S has: - First BLE sensor S1; and - Second BLE sensor S2, In this system, one of the two BLE sensors S1 and S2 is used as the initiator, and the other BLE sensor is used as the reflector to perform BLE channel detection.

[0034] like Figure 1 As shown, the first BLE sensor S1 and the second BLE sensor S2 can be positioned, for example, below the roof, above the first row of seats and / or above the second row of seats. The first BLE sensor S1 and the second BLE sensor S2 can, for example, form a 2×2 antenna configuration, thereby providing four antenna paths for BLE channel detection.

[0035] like Figure 2 It is also shown that BLE channel detection can use two distance measurement methods: - The primary phase-based distance measurement method, PBR; and - Secondary distance measurement based on round-trip time (RTT).

[0036] like Figures 3 to 6 As illustrated, the measurements in BLE channel detection are used in a favorable manner to achieve motion detection inside and / or outside the vehicle F.

[0037] The motion detection can preferably be achieved without the use of mobile devices and without the use of additional sensors (such as UWB sensors and / or ultrasonic sensors).

[0038] like Figure 1 As indicated, the existing BLE sensors S1 and S2 can be used to perform BLE channel probing without a mobile phone as the initiator. One (or substantially each) BLE sensor S1 and / or S2 can be used as an initiator for establishing a BLE channel.

[0039] like Figures 3 to 6 As illustrated, measurements in BLE channel probing (e.g., dA, dPhi, and / or RSSI) can exhibit characteristic structures that indicate motion and its type. These characteristic structures can be analyzed to determine the motion itself and its type.

[0040] like Figure 3 As shown, motion detection inside and / or outside the vehicle F can be achieved using (in particular, using only) the amplitude difference dA between the initiator and the reflector. When motion occurs inside and / or outside the vehicle, the measured value of the amplitude difference dA can reveal characteristic structures that are easily and reliably identified, and can be used to identify different types of motion, such as: 1) Empty vehicle or no movement inside vehicle F, 2) Walking outside vehicle F and / or touching vehicle F from the outside, especially when the windows are open, and / or 3) Movement inside vehicle F.

[0041] like Figure 4 As shown, motion detection inside and / or outside the vehicle F can be achieved using the phase difference dPhi between the initiator and the reflector. Measurements of the phase difference dPhi can also reveal identifiable characteristic structures to identify motion, at least within the vehicle F, for example: 1) Empty vehicle or no movement inside vehicle F, 2) Walking outside vehicle F and / or touching vehicle F from the outside, especially when the windows are open, and / or 3) Movement inside vehicle F.

[0042] like Figure 5 As shown, motion detection inside and / or outside the vehicle F can be achieved using the signal strength RSSI at the initiator and / or at the reflector, for example: 1) Empty vehicle or no movement inside vehicle F; 2) Walking outside vehicle F and / or touching vehicle F from the outside, especially when the windows are open; 3) Movement within vehicle F; and / or 4) Calm movement inside vehicle F, such as while sleeping.

[0043] like Figure 6 As illustrated, motion recognition can also achieve motion classification to identify different types of motion inside and / or outside the vehicle F, and preferably distinguish them, such as the following motion types: 1) No exercise; 2) Walking outside vehicle F and / or touching vehicle F from the outside, especially when the windows are open; 3) Movement inside vehicle F; 4) Calm movement inside vehicle F, such as while sleeping, etc.

[0044] Essentially, a set of time-series measurements along a particularly selected BLE channel is sufficient to achieve motion detection inside and / or outside the vehicle F. In this way, relatively high reliability in motion recognition can be achieved. For a single-channel probe sub-event, an F1 score of 0.96 can be achieved, where 1 indicates that the motion is always correct.

[0045] Furthermore, multiple sets of time-series measurements along several, particularly selected, BLE channels—for example, along 2, 3, 4, or 5 particularly selected BLE channels—can be used to achieve motion detection inside and / or outside the vehicle F. In this way, very high reliability in motion recognition can be achieved. For a 5-channel probe sub-event, an F1 score of 1 can be achieved, where 1 indicates that it is always correct.

[0046] Therefore, the desired accuracy in motion detection can be set by determining the number (in particular, selected) of BLE channels whose measurements are analyzed.

[0047] This method can provide a variety of beneficial functions: - Intrusion detection (motion detection inside vehicle F when the vehicle is locked and / or locked). - Identify the presence of persons inside and / or outside vehicle F (motion identification inside and / or outside vehicle F). - Identify the presence of a child inside vehicle F (calm movement while vehicle F is locked and / or locked). - Occupancy detection inside vehicle F (Where is the movement located inside vehicle F?). - Motion classification (What types of motion do the interior and exterior motions of vehicle F belong to?); - Even health monitoring (frantic exercise versus normal exercise), etc.

[0048] This method can be executed by a control unit ECU (e.g., with the support of an AI model). The control unit ECU can be implemented in a single BLE sensor, in each BLE sensor S1 and / or S2, or provided as a separate unit. Essentially, only one BLE sensor S1 or S2 can be equipped with such a control unit ECU, which can then act as an initiator in BLE channel detection. Furthermore, each BLE sensor S1 and S2 can be individually equipped with such a control unit, allowing each BLE sensor to act as an initiator in BLE channel detection.

[0049] A corresponding computer program product, a corresponding control unit ECU, and a corresponding sensor system S also constitute aspects of the present invention.

[0050] List of reference numerals in the attached diagram: S BLE sensor system S1 BLE sensor S2 BLE sensor Vehicle F ECU control unit PBR-based distance measurement RTT round trip time f1 frequency f2 frequency t time dA amplitude difference dPhi phase difference RSSI signal strength.

Claims

1. A method for motion detection inside and / or outside a vehicle (F) via a sensor system (S), said sensor system having: - First BLE sensor (S1); and - Second BLE sensor (S2) in, One of the two BLE sensors (S1, S2) acts as the initiator, and the other BLE sensor (S1, S2) acts as the reflector, in order to perform BLE channel sensing, specifically including two distance measurement methods: - Primarily phase-based distance measurement (PBR); and - Secondary distance measurements based on round-trip time (RTT), Furthermore, the measurements from BLE channel detection are used to achieve motion detection inside and / or outside the vehicle (F), particularly without the need for mobile devices and additional sensors such as UWB sensors and / or ultrasonic sensors.

2. The method according to claim 1, wherein, The measurements in BLE channel detection include the amplitude difference (dA) between the initiator and the reflector, which are used to achieve motion detection inside and / or outside the vehicle (F).

3. The method according to claim 1 or 2, wherein, The measurements in BLE channel detection include the phase difference (dPhi) between the initiator and the reflector, which is used to achieve motion detection inside and / or outside the vehicle (F).

4. The method according to any one of the preceding claims, wherein, Measurements in BLE channel detection include measurements of signal strength (RSSI) at the initiator and / or at the reflector, which are used to achieve motion detection inside and / or outside the vehicle (F).

5. The method according to any one of the preceding claims, wherein, Measurements in BLE channel detection include a set of time-series measurements along a particularly selected BLE channel, which are analyzed to enable motion detection inside and / or outside the vehicle (F).

6. The method according to any one of the preceding claims, wherein, Measurements in BLE channel detection include multiple sets of time-series measurements along several, particularly selected, BLE channels, such as 2, 3, 4, or 5 particularly selected BLE channels, which are analyzed to achieve motion detection inside and / or outside the vehicle (F).

7. The method according to any one of the preceding claims, wherein, The desired accuracy in motion detection is set by using a specific number, particularly selected, BLE channels, and the measurements from these BLE channels are analyzed.

8. The method according to any one of the preceding claims, wherein, The method is used to provide at least one of the following functions based on motion detection: - Intrusion detection; - Identify the presence of people inside and / or outside the vehicle; - Identify the presence of children inside the vehicle; - Occupancy detection inside the vehicle; - Sports classification; and / or - Health monitoring.

9. The method according to any one of the preceding claims, wherein, Measurements in BLE channel detection are analyzed by the control unit (ECU) with the help of, for example, an AI model, to enable motion detection inside and / or outside the vehicle (F).

10. A computer program product, comprising instructions that, when executed by a computer, cause the computer to perform the method according to any one of the preceding method claims.

11. A control unit (ECU) having a computing unit and a storage unit, wherein code is stored in the storage unit, the code executing the method according to any one of claims 1 to 9 when executed at least in part by the computing unit.

12. A sensor system (S) for motion detection inside and / or outside a vehicle (F), said sensor system having a control unit (ECU) according to the preceding system claims.

13. The sensor system (S) according to any one of the preceding system claims, wherein, The first BLE sensor (S1) and the second BLE sensor (S2) are designed to be arranged inside the vehicle (F), for example, under the roof, or above the first row of seats and / or above the second row of seats.

14. The sensor system (S) according to any one of the preceding system claims, wherein, The first BLE sensor (S1) and the second BLE sensor (S2) have a 2×2 antenna configuration to provide 4 antenna paths in BLE channel detection.

15. The sensor system (S) according to any one of the preceding system claims, wherein, The control unit (ECU) for performing motion detection is implemented in the BLE sensor (S1, S2) that serves as the initiator in BLE channel probing. And / or each of the two BLE sensors (S1, S2) can be designed to act as an initiator in BLE channel probing; And / or the control unit (ECU) used to perform motion detection is provided as a separate unit.

Images