Method for detecting a footwell occupancy state

Abstract

In a method for detecting a footwell occupancy state for a seat arrangement having at least one seat, a data record for a footwell occupancy state is acquired on the basis of a radar scan of a spatial region at least partially surrounding the seat arrangement including at least one footwell, wherein the radar scan is carried out by means of a radar sensor which is arranged above the seat arrangement. A footwell occupancy state is then determined on the basis of an evaluation model. The measurement data are acquired for at least two successive points in time, including the current point in time, wherein, for the current point in time and at least one further of the successive points in time, a confidence value for a footwell occupancy state of the at least one footwell is determined, which confidence value indicates the probability with which the actual footwell occupancy state is 'occupied' or 'not occupied'. The measurement data are used with respect to the point in time for which a footwell occupancy state determined by means of the evaluation model corresponds to the actual footwell occupancy state with a higher probability.

Description

[0001] gestigon GmbH 10.12.2025

[0002] 1

[0003] METHOD FOR DETECTING A FOOTSPACE OCCUPANCY STATE

[0004] The present invention relates to a method, a system configured to carry out the method and a computer program, each for detecting a footwell occupancy state for a seating arrangement with at least one seat, in particular in a vehicle.

[0005] In various situations, it may be necessary to automatically determine the current occupancy status of a seating arrangement with at least one seat. Such a situation can occur particularly in vehicles, for example, in motor vehicles, where vehicle configuration or the activation, deactivation, and / or control of one or more vehicle functionalities is to be carried out depending on the current occupancy status. For example, it is known in motor vehicles to issue an acoustic or visual warning to vehicle occupants to fasten their seat belts or to control the activation or deactivation of airbags, depending on a detected occupancy status.

[0006] Methods using radar technology are known for the automated detection of the current occupancy status of one or more seats, particularly the arrangement of seats in a vehicle. Radar sensors scan the vehicle interior, generating measurement data in the form of radar point clouds. The current seat occupancy can then be determined from the measured radar point cloud.

[0007] In addition to monitoring seat occupancy, it may also be necessary to monitor the footwell, or even the individual footwells assigned to each seat in the seating arrangement. This could be used to check whether objects or people are in the rear footwell before a front seat is automatically adjusted. This prevents objects or people's feet / legs from being trapped during automatic seat adjustment. It can also simply help detect the presence of an object, such as a bag, left in a footwell.

[0008] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0009] 2

[0010] Due to the distance to a radar sensor, which is usually mounted on the ceiling of the vehicle interior above the seating, and the obstruction caused by the passengers themselves, this part of the vehicle interior is more difficult to monitor and is easily affected by noise. This is why existing solutions use separate radar sensors in the footwell. However, this increases the cost of such a system. Therefore, it is often only possible to monitor the footwells of individual seats as a whole. This, however, results in the loss of information about which footwell is occupied or unoccupied.

[0011] It is an object of the present invention to provide an improved solution for detecting the occupancy status of the footwell in a seating arrangement with at least one seat, particularly in a vehicle. In particular, the improved solution is intended to achieve reliable monitoring of the footwells without additional radar sensors in the footwells.

[0012] The solution to this problem is achieved according to the teaching of the independent claims. Various embodiments and further developments of the invention are the subject of the dependent claims.

[0013] A first aspect of the solution presented here concerns a method, particularly a computer-implemented one, for detecting the footwell occupancy status of a seating arrangement with at least one seat, especially in or for a vehicle, such as an automobile (e.g., truck, car, or bus). The method involves acquiring a data set for the footwell occupancy status, where the data set represents measurement data for at least a current point in time. This measurement data represents an associated radar point cloud, which was or is obtained based on a radar scan of a spatial area surrounding the seating arrangement, including at least a section of the footwell. The radar scan is performed using a radar sensor located above the seating arrangement.A footwell occupancy state is determined using an evaluation model, whereby the data set forms input data for the evaluation model and the evaluation model determines a footwell occupancy state based on the radar point cloud and the recorded data set.

[0014] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0015] 3. The output of at least one footwell at the current time is then displayed. Footwell occupancy status information, defined based on the evaluation result, is then output.

[0016] The measurement data are recorded for at least two consecutive time points, including the current time point, whereby a confidence value for a footwell occupancy state of the at least one footwell is determined for the current time point and at least one further of the consecutive time points, which indicates the probability with which the actual footwell occupancy state is "occupied" or "unoccupied", wherein the measurement data of the time point for which a footwell occupancy state determined by means of the evaluation model corresponds with a higher probability to an actual footwell occupancy state are used as input data for the evaluation model for determining the footwell occupancy state.

[0017] The term "footwell occupancy status" used here refers specifically to information indicating whether or to what extent a footwell or footwells are occupied by an object, particularly an item such as a bag, or by a person or their feet or legs. Specifically, each seat in the seating arrangement is assigned a footwell, and the "footwell occupancy status" can indicate individually for each footwell whether it is occupied or free. Since a footwell is typically assigned to a seat, the footwell occupancy status can be described as "for a seating arrangement with at least one seat."

[0018] The term "seat occupancy status" used here refers specifically to information indicating whether, or to what extent, the seating arrangement, or at least one of its seats, is occupied by an object, particularly a thing or a person. In a simple example, the seat occupancy status can simply indicate the presence or absence of an object, or, in a more advanced example, it can indicate the presence of at least one object on the seat.

[0019] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0020] 4

[0021] The seating arrangement or one or more of its seats, a statement about the type or other characteristic, such as a spatial extent, of the object.

[0022] The term "radar point cloud" as used here refers specifically to a set of points in a vector space obtained by radar scanning of at least one object's surface, exhibiting a typically unorganized spatial structure ("cloud"). In the case of a radar point cloud, the points within the radar point cloud can be called "radar points." A (radar) point cloud can be described, in particular, by the (radar) points it contains. The radar points, in turn, can each be described, in particular, by their spatial coordinates, which specify, for each radar point, the location of the reflection of an emitted radar signal from an object's surface, as measured during the radar scan. Additional attributes, such as the measured Doppler velocity or the signal-to-noise ratio (SNR), can be recorded for each radar point.

[0023] The term "evaluation model" used here refers to a model, particularly a mathematical one, that uses a radar point cloud or one or more characteristics or parameters describing it as input(s) to deliver an evaluation result based on these parameters, in this case, one of several predefined possible seat occupancy states of the seating arrangement. The evaluation model can, in particular, be a mathematical estimator, where the radar point cloud represents empirical data as a sample and the evaluation result is an estimated value determined based on this sample. The evaluation model can, in particular, be a "machine learning model" (or...The term "machine learning model" (ML model) is synonymous with "machine learning model," which, in this context, refers specifically to a mathematical, particularly statistical, model created using at least one machine learning algorithm based on example data referred to as training data. This model is used to make predictions or decisions without the algorithm(s) being explicitly programmed to make such predictions or decisions. Decision tree-based machine learning models and artificial neural networks are particularly relevant examples of machine learning models.

[0024] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0025] 5

[0026] The terms “comprises”, “includes”, “includes”, “has”, “with”, or any other variant thereof, as used, are intended to cover non-exclusive inclusion. For example, a method or apparatus that includes or has a list of elements is not necessarily limited to those elements, but may include other elements not expressly listed or inherent in such method or apparatus.

[0027] Furthermore, unless explicitly stated otherwise, "or" refers to an inclusive or and not an exclusive "or". For example, a condition A or B is satisfied by any of the following: A is true (or present) and B is false (or not present), A is false (or not present) and B is true (or present), and both A and B are true (or present).

[0028] The terms "ein" or "eine," as used here, are defined as "one or more." The terms "ein anderer" and "ein Weitere," as well as any other variant thereof, are to be understood as "at least one more."

[0029] The term “plural” or “several”, as used here, is to be understood in the sense of “two or more”.

[0030] The terms "configured" or "set up" (and any variations thereof) used in connection with the invention mean that the device is already in a configuration or setting in which it can perform the function, or at least is adjustable—i.e., configurable—so that it can perform the function after appropriate adjustment. This configuration can be achieved, for example, by adjusting parameters of a process sequence or by using switches or similar devices to activate or deactivate functionalities or settings. In particular, the device can have several predetermined configurations or operating modes, so that the

[0031] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0032] 6

[0033] Configuration can be done by selecting one of these configurations or operating modes.

[0034] The method according to the first aspect is therefore based in particular on the fact that a footwell occupancy state for a seating arrangement with at least one seat can be detected without requiring one or more additional radar sensors in the footwell. In other words, the footwell occupancy state can be detected even though only one or more radar sensors, preferably a single radar sensor above the seating arrangement, are used.

[0035] Although the radar signal, as described earlier, can be affected by the distance to the radar sensor and potential obstructions, for example by a person, this is mitigated by recording the measurement data for at least two consecutive time points. The measurement data from the time point for which the result of the evaluation model most likely corresponds to the actual footwell occupancy is then used. In this way, the risk of information being lost, for example through an averaging filter, even with a weak or noisy signal, can be reduced. The reliability of detecting footwell occupancy can thus be increased, even though only one radar sensor (or several radar sensors) above the seating arrangement is used. In particular, no additional radar sensor in the footwell area is necessary.

[0036] The following describes various exemplary embodiments of the method, which, unless expressly excluded or technically impossible, can be combined with each other and with the other described aspects of the present solution.

[0037] In some embodiments, the confidence value is a value in the range of 0 to 1. This normalization of the confidence values ​​simplifies the statement of the probability that the actual footwell occupancy state is "occupied" or "unoccupied".

[0038] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0039] 7

[0040] In some related embodiments, if the confidence values ​​are greater than or equal to 0.5, the measurement data from the time point at which the confidence value is at its maximum is used as input data for the evaluation model. Specifically, confidence values ​​greater than 0.5 indicate that a footwell is likely occupied. Therefore, if the confidence values ​​are greater than or equal to 0.5, the measurement data from the time point at which the confidence value is highest—that is, with the greatest probability that a footwell is occupied—is used. This increases the reliability in detecting that the footwell is occupied.

[0041] In some related embodiments, if the confidence values ​​are less than 0.5, the measurement data from the time point for which the confidence value is at its minimum is used as input data for the evaluation model. Conversely to the situation just described, confidence values ​​less than 0.5 indicate that a footwell is probably unoccupied, i.e., free. Therefore, by using the measurement data from the time point for which the confidence value is lowest, the reliability in detecting that a footwell is unoccupied can be increased.

[0042] In some related embodiments, if the confidence values ​​are both greater than and less than 0.5, the confidence values ​​of at least three consecutive time points, including the current time, are determined. If the majority of the confidence values ​​are greater than 0.5, the measurement data from the time point for which the confidence value is a maximum of the confidence values ​​is used as input for the evaluation model. If the majority of the confidence values ​​are less than 0.5, the measurement data from the time point for which the confidence value is a minimum of the confidence values ​​is used as input for the evaluation model. There may also be cases where confidence values ​​are both less than and greater than 0.5.Then, measurements from at least three consecutive time points are determined, and finally, the highest or lowest confidence level is selected, depending on whether more confidence levels are less than or greater than 0.5. This can increase the reliability in detecting whether a footwell is free or occupied.

[0043] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0044] 8

[0045] In some embodiments, the seating arrangement comprises multiple seats, each with an associated footwell, and an individual footwell occupancy status is determined for each footwell. By using a radar sensor positioned above the seating arrangement, the footwells of several, and in particular all, seats—for example, the seats in the rear row of a vehicle—can be monitored. By selectively assigning radar points to a specific footwell, an occupancy status can be determined for each footwell individually.

[0046] In some embodiments, the method further includes detecting the occupancy status of the seating arrangement. A data set for a seat occupancy status is acquired, wherein the data set represents measurement data for at least a current point in time, and the measurement data represents the associated radar point cloud, which was or is acquired based on radar scanning. The occupancy status of the seating arrangement is determined using the evaluation model, where the data set forms input data for the evaluation model. Depending on the radar point cloud and the acquired data set, the evaluation model provides an output indicating the occupancy status of the seating arrangement at the current point in time. Seat occupancy status information, defined based on the evaluation result, is then output.Since the radar sensor is located above the seating arrangement, its field of view includes not only the footwells but also the seats. Therefore, a single measurement can determine not only the occupancy of the footwells but also the occupancy of the seats.

[0047] In some related embodiments, i.e., in the detection of seat occupancy, the measurement data are acquired for at least two consecutive time points, including the current time point. An average value is determined for the current time point and at least one further of the consecutive time points. The input data for the evaluation model for determining the seat occupancy includes this determined average value. In this way, outliers in the measurement data can be eliminated.

[0048] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0049] 9

[0050] It should be noted that a different filter is used for the measurement data from different time points when detecting seat occupancy than when detecting footwell occupancy. While, as described above, it is advantageous for detecting footwell occupancy not to eliminate outliers, but rather to use them as input data for the evaluation model, the comparatively strong signal for detecting seat occupancy (especially due to the shorter distance to the radar sensor and the greater mass of a person's body compared to their feet or legs) makes it advantageous to eliminate outliers to avoid, for example, flickering.

[0051] Overall, the method described in the first aspect, based on the radar point cloud obtained by radar scanning of a spatial area surrounding the seating arrangement, allows for the generation of stable evaluation results (particularly in terms of prediction or classification) that characterize not only the footwell occupancy status but also the seat occupancy status of the seating arrangement. This enables the implementation of radar-based solutions, especially in the vehicle context (particularly for automobiles), that can reliably detect footwell and seat occupancy status (particularly exclusively) using radar.

[0052] In some embodiments, the determined seat occupancy status is also taken into account when determining the footwell occupancy status. For example, the probability that a seat's footwell is occupied may be increased if the corresponding seat is also occupied by a person. However, it is also possible that a person has placed their legs / feet in the footwell of an adjacent seat. Particularly in the case of a middle seat in the rear row, due to the limited footwell of this seat, it can often happen that a person places their legs / feet in one or both of the adjacent footwells. It is also possible that a footwell is occupied by an object, while the corresponding seat is then free. For this reason, considering the seat occupancy status when determining the footwell occupancy status can be advantageous.

[0053] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0054] 10

[0055] Detecting the footwell occupancy status can be helpful, but it cannot be used as the sole criterion.

[0056] In some embodiments, a measure of motion activity at the current time is determined from Doppler shift values ​​in the measurement data, with the data set containing this determined measure of motion activity as input data for the evaluation model. Since a change in the footwell occupancy state or seat occupancy state is generally only possible if a minimum level of motion activity is detected at the current time, the probability of a change in the respective occupancy state can be reduced if no motion is detected. Motion activity can refer in particular to the movement activity within a vehicle, especially of one or more people. For example, a high level of motion activity occurs when getting in and out of a vehicle, whereas passengers in a vehicle typically move very little while it is in motion.

[0057] In some embodiments, the radar point cloud is segmented into several clusters by assigning a subset of the radar points from the respective radar point cloud to each seat and each footwell as a cluster, depending on their respective position, such that the radar points of the cluster lie within a defined closed spatial area, in particular a cuboid, in the vicinity of the footwell or seat. This enables particularly simple and computationally efficient cluster formation and thus seat-specific detection of the occupancy of the footwells or seats, whereby the location (position and orientation) and the shape of the spatial area are or can be defined such that they strongly overlap the spatial area typically occupied by a typical object to be detected, in particular a person, on a seat of the seating arrangement.In addition to the seating arrangement, a separate area for the footwells is also planned to be defined as a cluster, for example also in the form of a cuboid.

[0058] Clustering thus enables seat-specific, i.e., individual seat-to-seat, occupancy detection or individual footwell occupancy detection in the case of a multi-seat seating arrangement, which is particularly useful when

[0059] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0060] 11. This is advantageous or even necessary if a seat-specific response is required based on the detected occupancy status, for example, by preventing automatic seat adjustment when the footwell is occupied, and / or if a specific functionality or system, such as a seat-specific airbag system, a seat-specific seatbelt warning, or a seat-specific seat heating system, is to be activated, deactivated, or otherwise controlled for a particular seat depending on its detected occupancy. In some embodiments, the clustering can be carried out in such a way that the clusters are disjoint, so that no radar point is assigned to two different clusters.

[0061] In some embodiments, features (characteristic parameters) of the radar point cloud are used for evaluation and provided in the form of a feature vector. The evaluation model is thus defined in such a way that an evaluation result is determined depending on the respective values ​​of the features for the radar point clouds. In this way, the evaluation model can be defined and applied in a simplified manner, since only the values ​​of the features need to be considered as input variables instead of entire radar point clouds. In particular, the temporal progression of the values ​​can reflect a movement or a specific movement pattern of one or more objects in a footwell or on the seating arrangement, so that the evaluation model can determine the footwell occupancy status or the seat occupancy status of the seating arrangement in a particularly reliable manner.

[0062] In some embodiments, the individual radar points of the radar point cloud are each represented by a position of the respective radar point in three-dimensional space and by at least one of the following parameters: (i) a Doppler shift value of the radar signal relative to the respective radar point; (ii) a signal-to-noise ratio value of the radar signal relative to the respective radar point. These parameters can be used, in particular, for pre-filtering the radar point cloud as part of a pre-processing step preceding feature determination.

[0063] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0064] 12

[0065] The information to be output can, in particular, represent the evaluation result itself. It can also be a detectable signal, especially one perceptible to a human sense, such as a warning, a control signal for activating a signal source, or a data signal carrying the information.

[0066] In some embodiments, outputting the information includes controlling a signal source based on the information, causing the signal source to output a defined signal in response to the control. The signal source can be, in particular, an audio source, an optical signal source (especially a display device for images or text), and / or a haptic actuator, or a combination of at least two of the aforementioned signal sources. Thus, the detected footwell occupancy or seat occupancy status can be communicated to a user or used to control another technical system.

[0067] In particular, the signal source can be controlled depending on the information so that it outputs a signal, defined in particular by the control, when the information results from an evaluation result according to which at least one footwell or seat of the seating arrangement is occupied and / or a selected predetermined footwell occupancy state or seat occupancy state exists.

[0068] In some embodiments, the at least one footwell includes at least one footwell assigned to a rear seat of the seating arrangement, wherein a signal source is controlled depending on the information from the evaluation result such that a signal output by the signal source prevents an automatic rearward adjustment of a seat in the seating arrangement that is located directly in front of the footwell of the rear seat. In this way, information about the footwell occupancy status can be taken into account during automatic (i.e., motorized) seat adjustment. In particular, this prevents an object or a person's feet from becoming trapped. A warning, for example, can then be displayed simultaneously.

[0069] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0070] 13. An acoustic or optical signal will be emitted indicating that the footwell behind the seat to be adjusted is occupied.

[0071] It goes without saying that the evaluation model, which is primarily a machine learning model, can be trained before its actual use. Datasets representing at least a radar point cloud or values ​​of one or more specific features at different times are provided to the machine learning model as input data. This allows for a particularly flexible and adaptable implementation of the evaluation model, whereby machine learning can be used to continuously improve the evaluation model and thus the quality and reliability of the process according to the first aspect. The machine learning model can, in particular, be based on an artificial neural network.

[0072] A second aspect of the present solution relates to a system for detecting a footwell occupancy state for a seating arrangement with at least one seat, wherein the system comprises a data processing device which is configured, in particular by means of a corresponding computer program, to detect a footwell occupancy state for a seating arrangement and, if applicable, to perform the method according to one of the preceding claims.

[0073] A third aspect of the present solution concerns a computer program or computer program product comprising instructions which, when executed on the data processing device of the system according to the second aspect, cause the system to execute the procedure according to the first aspect.

[0074] The computer program can be stored, in particular, on a non-volatile data carrier. Preferably, this is a data carrier in the form of an optical data carrier or a flash memory module. This can be advantageous if the computer program itself is to be handled independently of a processor platform on which the one or more programs are to be executed. In another implementation, the computer program can be stored as a file on a

[0075] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0076] 14

[0077] A computer program must reside on a data processing unit, particularly on a server, and be downloadable via a data connection, such as the internet or a dedicated data connection like a proprietary or local network. Furthermore, the computer program can comprise multiple interacting individual program modules. These modules can be configured, or at least deployable, to run on different devices (computers or processor units) that are geographically separated and interconnected via a data network, in accordance with the principles of distributed computing.

[0078] The system described in the second aspect may accordingly have a program memory in which the computer program is stored. Alternatively, the system may also be configured to access an external computer program, for example on one or more servers or other data processing units, via a communication link, in particular to exchange data with it that is used during the execution of the procedure or computer program or represents outputs of the computer program.

[0079] A fourth aspect of the present solution relates to a vehicle comprising: (i) a seating arrangement with at least one seat; (ii) a radar sensor for at least sectional radar scanning of the seating arrangement including at least one footwell of the seating arrangement, wherein the radar sensor is arranged above the seating arrangement; and (iii) a system according to the second aspect.

[0080] The features and advantages explained in relation to the first aspect of the present solution also apply accordingly to the other aspects of the solution.

[0081] Further advantages, features and application possibilities of the present solution will become apparent from the following detailed description in conjunction with the drawings.

[0082] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0083] 15

[0084] This shows:

[0085] Fig. 1 schematically shows an exemplary embodiment of a vehicle equipped with a system for the automated detection of a footwell occupancy state and a seat occupancy state of a seating arrangement in the vehicle;

[0086] Fig. 2 schematically shows the vehicle from Fig. 1, where the passenger seat is occupied;

[0087] Fig. 3A is an exemplary two-dimensional representation of a radar point cloud recorded by a radar sensor of the vehicle from Fig. 2;

[0088] Fig. 3B is an exemplary representation of a clustering of the radar point cloud from Fig. 3A according to the positions of the individual seats of the seating arrangement;

[0089] Fig. 4 schematically shows a view of the rear seat from the vehicle shown in Fig. 1;

[0090] Fig. 5A is an exemplary three-dimensional representation of a radar point cloud of the rear seat recorded by a radar sensor of the vehicle from Fig. 1 in a front view, where the rear left seat is occupied, including a clustering;

[0091] Fig. 5B shows an exemplary three-dimensional representation of the radar point cloud from Fig. 5A in a view from the left;

[0092] Fig. 6 is a flowchart illustrating an exemplary embodiment of a method for the automated detection of a footwell occupancy state and a seat occupancy state of a seating arrangement.

[0093] In the figures, identical reference symbols denote identical, similar, or corresponding elements. Elements depicted in the figures are not necessarily shown to scale. Rather, the various elements depicted in the figures are represented in such a way that their function and general purpose are understandable to a person skilled in the art. Connections and couplings between functional units and elements shown in the figures can, unless expressly stated otherwise, also be implemented as indirect connections or couplings. Functional units can, in particular, be implemented as hardware, software, or a combination of hardware and software.

[0094] The exemplary embodiment of a vehicle 100, schematically depicted in Fig. 1, has a seating arrangement 105 with five individual seats or seating positions 105a to 105e. Each of the seats 105a to 105e is suitable for a person as a passenger of the

[0095] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0096] 16

[0097] Vehicle 100. The vehicle 100 also has a radar sensor 110, which is mounted inside the vehicle cabin on its ceiling, i.e., above the seating arrangement 105, and is configured so that it can scan the seating arrangement 105, at least substantially, using radar beams. Accordingly, the seats 105a to 105e, in particular their seating surfaces, are located, at least predominantly, within a detection field 110a that can be detected by the radar sensor 110. Furthermore, the corresponding footwells, in particular the footwells 405c to 405e of the seats 105c to 105e of the rear bench, are located in the detection field 110a, as shown in Fig. 4.

[0098] Furthermore, the vehicle 100 has a system 115 for the automated detection of a footwell occupancy state and a seat occupancy state of the seating arrangement 105 depending on a radar scan of the seating arrangement 105, including the footwells, carried out by the radar sensor 110, at least sectionally with respect to the observation field 110a.

[0099] System 115 comprises, in particular, a data processing unit 115a with at least one microprocessor and a signal-connected memory 115b, in which a computer program configured to carry out the method for automatically detecting the footwell and seat occupancy status of the seating arrangement 105, as described below with reference to Fig. 6, is stored. Furthermore, the sensor data generated by the radar sensor 110 during radar scanning, or information already obtained from it through further processing, may be stored or be stored in the memory 115b.

[0100] The vehicle 100 shown in Fig. 2 corresponds to the vehicle in Fig. 1, except that here the passenger seat 105b is occupied by a person P. The subsequent discussion of Figs. 3A and 3B refers to the configuration in Fig. 2.

[0101] Reference is now made to Figures 3A and 3B, which each represent a radar point cloud, whereby, for the purpose of representation, the respective, inherently three-dimensional radar point cloud is created by projecting the positions of the

[0102] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0103] 17

[0104] The radar points of the radar point cloud were reduced to a two-dimensional plane spanned by two of its dimensions. Corresponding radar point clouds for the rear seat, i.e., seats 105c to 105e, including the associated footwells 405c to 405e, are shown in Figures 5A and 5B, where seat 105c (rear left) is occupied. The following explanations regarding Figures 3A and 3B therefore also apply to Figures 5A and 5B.

[0105] Figure 3A illustrates an exemplary radar point cloud 305, as it was acquired as a result of a radar scan of the seating arrangement 105 by the radar sensor 110 during a defined time interval (measurement period). The position of the individual radar points within the radar point cloud 305 can be represented by spatial coordinates; for example, Cartesian coordinates X and Y can be assigned to the plane of the drawing and to each individual point. In reality, if the dimensional reduction due to the drawing is disregarded, a third coordinate Z for the third spatial dimension is also required.

[0106] If, during radar scanning, not only the spatial positions of the points where the radar beam is reflected by the scanned objects are recorded as coordinates, but also a corresponding Doppler shift is measured, then the individual radar points can be classified according to the magnitude of this Doppler shift, in particular divided into two different classes. The latter can be done, for example, by comparing the Doppler shift with a predefined shift threshold that corresponds to a specific displacement velocity. Depending on the result of the comparison, those radar points 310 that, according to the value of their associated Doppler shift, exhibit no velocity or a surface velocity at the reflection point that is below the displacement wave, can be classified as "static" radar points (in the Fig.3A and 3B are each represented by a filled black circle). Conversely, those radar points 315 that exhibit a Doppler shift above the shift threshold can be classified as “dynamic” radar points 315 (represented by a black ring in Figs. 3A and 3B).

[0107] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0108] 18

[0109] Classifying radar points 310 and 315 according to their Doppler shift is not strictly necessary; however, it can be used to process radar point cloud 305, particularly as part of preprocessing prior to evaluation, and especially to filter based on the classification. For example, such filtering could be performed to consider only dynamic radar points 315 for evaluation, in order to detect only moving objects.

[0110] Figure 3B shows the same radar point cloud 305 as Figure 3A. However, in addition, selected spatial regions 325a to 325e, which are cuboid (in the 3D case) or rectangular (in the present 2D representation), are shown here. These spatial regions correspond to the respective locations of the individual seats 105a to 105e. The definition of these spatial regions 325a to 325e can now be used to cluster the radar point cloud 305, whereby each radar point 310 or 315 is assigned, where possible, to the spatial region 325a to 325e in which it lies. All radar points not located in one of the spatial regions 325a to 325e can be disregarded. It can be seen in particular that the regions 320 with a particularly high radar point density are located in the area of ​​the front passenger seat 105b, where, according to Figure 2, person P is located.

[0111] Accordingly, additional spatial areas 525c to 525e of the associated footwells 405c to 405e are shown (as a 3D representation) in Figures 5A and 5B. Areas with a particularly high radar point density are visible here in the area of ​​seat 105c.

[0112] Fig. 6 shows a flowchart illustrating an exemplary embodiment 600 of a method for automatically detecting the footwell and seat occupancy status of a seating arrangement. The method can, in particular, be designed as a computer-implemented method. For this purpose, it can, in particular, be stored as a computer program in memory 115b of system 115 and be executable on the data processing unit 115a.

[0113] In method 600, a radar point cloud 305 is acquired by processing radar measurement data in a process 610, in this example from the radar sensor 110 of the

[0114] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0115] 19

[0116] Vehicle 100, are received and further processed to form one or more radar point clouds.

[0117] The resulting radar point cloud 305 can then be clustered in a further process 620 by checking for each of its radar points whether it lies within one of the defined spatial regions 325a to 325e (see Fig. 3B) or 525c to 525e (see Figs. 5A and 5B) and, if so, in which one. Thus, each point can be assigned either to one of the spatial regions 325a to 325e (or 525c to 525e) or to the other observation field. All radar points that lie within the same spatial region 325a to 325e (or 525c to 525e) are grouped into a respective cluster. As a result, each of the seats 105a to 105e and each of the footwells 405c to 405e of seats 105c to 105e of the rear row of seats is assigned a corresponding cluster of radar point cloud 305.This forms the basis for the subsequent individual evaluation of each seat 105a to 105e and each footwell 405c to 405e to determine whether the respective seat 105a to 105e or footwell 405c to 405e is or was occupied or not while radar point cloud 305 was formed.

[0118] In process 630, the clusters of room areas 325c to 325e and 525c to 525e are classified according to which of these room areas belongs to a seat 105c to 105e or to a footwell 405c to 405e. Depending on the type, i.e., "seat" or "footwell," the measurement data is evaluated differently, as described below.

[0119] In process 640a, the clusters of room areas 325c to 325e, which were classified as belonging to seats 105c to 105e, are evaluated, as is the cluster for room areas 325a and 325b of the front seats 105a and 105b. In particular, features can be determined for each of the clusters for the subsequent evaluation of the clustered radar point cloud 305. These features can include, in particular, the number of radar points in the cluster. If no filtering according to the Doppler shift value has taken place, this can involve a combined count of both the static and the dynamic radar points 310 and 315, respectively. However, if

[0120] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0121] Since the static radar points 310 were previously filtered out, the remaining count is solely of the dynamic radar points 315. Further features can include the position of a cluster's centroid, the point density within a cluster, or the mean Doppler value of a cluster. These features are each summarized in a feature vector for each cluster, as will be explained in more detail below.

[0122] The features for the cluster corresponding to seat 105b can now be evaluated (the same can be done analogously for the respective clusters for the other seats). For this purpose, the feature vector (or a temporal progression of the features in a single vector, su) is provided as input to a trained evaluation model. This can be, in particular, a machine learning-based model, such as an artificial neural network.

[0123] To eliminate outliers, the aforementioned processes are not only performed for a single point in time (frame), but an average is calculated over multiple points in time (frames). This represents the key difference in the evaluation of the clusters assigned to seats 105a to 105e on the one hand, and those assigned to footwells 405c to 405e on the other. Otherwise, the evaluation can be carried out in the same way.

[0124] In process 640b, the clusters of room areas 525c to 525e, which have been classified as belonging to footwells 405c to 405e, are therefore evaluated. Reference is made to the explanations for process 640a. However, no averaging over multiple time points (frames) takes place here. Instead, the measurement data from the time point (or the corresponding feature vectors) for which a footwell occupancy state determined by the evaluation model is more likely to correspond to the actual footwell occupancy state are used as input data for the evaluation model. Corresponding confidence values ​​are then calculated.

[0125] In particular, a confidence value in the range of 0 to 1 is determined for each footwell 405c to 405e, indicating the probability that a footwell is occupied or not. A confidence value less than 0.5 means that the

[0126] RGTH G251156WO12616PT gestigon GmbH 10.12.2025

[0127] 21. The corresponding footwell is unoccupied. Accordingly, a confidence value of 0.5 or higher indicates that the respective footwell is occupied. For confidence values ​​greater than or equal to 0.5, the measurements from the time point with the highest confidence value are used. Conversely, for confidence values ​​less than 0.5, the measurements from the time point with the lowest confidence value are used. In other words, the measurements that indicate with a higher probability that a footwell is occupied or unoccupied are used, instead of balancing these values ​​by averaging. This can increase the reliability of detecting footwell occupancy, especially given the potentially weaker and noisier radar signal in the footwell (compared to the radar signal for the seats).While the monitoring described here applies to the footwells 405c to 405e of seats 105c to 105e in the rear seat row, it should be noted that this also applies equally to the footwells of the front seats 105a and 105b. With a suitable radar sensor in an appropriate position above the seat arrangement 105, preferably a single radar sensor, it may also be possible to monitor both seat rows, including all footwells.

[0128] In both process 640a and process 640b, information is ultimately output as to whether a seat or footwell is occupied or not.

[0129] In the present example, in a process 650a, this information about the seat occupancy status is to be used in particular to check whether, depending on the seat occupancy status of a respective seat 105a to 105e and the result of a check as to whether a corresponding seat belt has been fitted for this seat or not, a seat belt warning signal should be issued or not.

[0130] This can involve checking whether the seat belt is fastened for the relevant seat (here, for example, seat 105b) and controlling a function of vehicle 100 depending on the seat occupancy information output in process 640a and the specific status of the seat belt. In particular, this can be done by activating a signal source to output a seat belt status signal, especially an optical and / or acoustic one, in order to

[0131] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0132] 22 to signal to one or more other occupants of the vehicle, if necessary, that a seat is occupied but the seat belt is not fastened.

[0133] In a 650b process, information about the footwell occupancy status is used to prevent automatic seat adjustment. Specifically, this can be achieved by activating a signal source to prevent a seat adjustment, particularly a rearward adjustment, if the footwell directly behind the seat is occupied. This prevents an object or a person's foot from being trapped. Simultaneously, a signal source can be activated to output a warning signal, particularly visual and / or audible, indicating that the footwell is occupied. Alternatively, a corresponding message can simply appear on a display when the footwell is occupied, which can be useful, for example, if an object like a bag would otherwise be left behind.

[0134] Finally, it should be noted that the training and, if applicable, validation data used for prior training of the evaluation model can be structured in such a way that each data entry contains a corresponding, correct class for a classification of possible footwell or seat occupancy states. This allows the model to be trained and validated using supervised learning. In the simplest case, footwell or seat occupancy states indicate whether the footwell or seat is occupied or not. However, more sophisticated classifications are also conceivable, in which, if an object is present, the respective class additionally indicates the type of object, for example, whether it is moving or stationary, and, in the case of a moving object, specifically whether it is a person (generally recognizable based on a breathing pattern over the course of the features).

[0135] While at least one exemplary embodiment has been described above, it should be noted that a large number of variations exist. It should also be noted that the described exemplary embodiments are only non-limiting examples, and it is not intended to thereby exhaust the possibilities of the invention.

[0136] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0137] 23

[0138] The scope, applicability, or configuration of the devices and methods described herein is not to be limited. Rather, the preceding description will provide the person skilled in the art with guidance for implementing at least one exemplary embodiment, whereby it is understood that various changes in the function and arrangement of the elements described in an exemplary embodiment may be made without derogating from the subject matter defined in the appended claims and their legal equivalents.

[0139] RGTH G251156WO12616PT gestigon GmbH 12 / 10 / 2025

[0140] 24

[0141] REFERENCE MARK LIST

[0142] P Person in the front passenger seat

[0143] 100 vehicles

[0144] 105 Seating arrangement

[0145] 105a-e seats or seating places

[0146] 110 radar sensor

[0147] 110a Observation field of the radar sensor 110

[0148] 115 System for detecting footwell and seat occupancy status

[0149] 115a Data processing unit

[0150] 115b memory

[0151] 305 radar point cloud

[0152] 310 static radar points

[0153] 315 dynamic radar points

[0154] 320 areas of radar point cloud 305 with high radar point density

[0155] 325a-e Room areas for cluster definition (seating capacity)

[0156] 405c-e Footwells

[0157] 525c-e Room areas for cluster definition (foot spaces)

[0158] 600 methods for detecting footwell and seat occupancy status

[0159] 610-650b individual processes or procedural steps within the framework of procedure 600

[0160] RGTH G251156WO12616PT

Claims

gestigon GmbH 10.12.2025 25 REQUIREMENTS 1. Method (600) for detecting a footwell occupancy state for a seating arrangement (105) with at least one seat (105a-e), the method comprising: - Acquiring a data set for a footwell occupancy state, wherein the data set represents measurement data at least for a current time, wherein the measurement data represent an associated radar point cloud (305) which was or is obtained on the basis of a radar scan of a spatial area surrounding the seating arrangement (105) including at least a footwell (405c-e) at least sectionally, wherein the radar scan is carried out by means of a radar sensor (110) which is arranged above the seating arrangement (105); - Determining a footwell occupancy state using an evaluation model, wherein the data set forms input data for the evaluation model and the evaluation model, depending on the radar point cloud (305), provides a footwell occupancy state of at least one footwell (405c-e) at the current time as output based on the acquired data set; and - Outputting footwell occupancy status information defined as a function of the evaluation result, wherein the measurement data are recorded for at least two consecutive time points, including the current time point, wherein a confidence value for a footwell occupancy status of the at least one footwell (405c-e) is determined for the current time point and at least one further of the consecutive time points, which indicates the probability that the actual footwell occupancy status is "occupied" or "unoccupied", wherein the measurement data of the time point for which a footwell occupancy status determined by means of the evaluation model is more likely to correspond to the actual footwell occupancy status are used as input data for the evaluation model for determining the footwell occupancy status. RGTH G251156WO12616PT gestigon GmbH 10.12.2025 26 2. The method of claim 1, wherein the confidence value is a value in the range of 0 to 1.

3. Method according to claim 2, wherein, if the confidence values ​​are greater than or equal to 0.5, the measurement data of the time point for which the confidence value is a maximum of the confidence values ​​are used as input data for the evaluation model.

4. Method according to claim 2 or 3, wherein, if the confidence values ​​are less than 0.5, the measurement data of the time point for which the confidence value is a minimum of the confidence values ​​are used as input data for the evaluation model.

5. A method according to any one of claims 2 to 4, wherein, if the confidence values ​​are both greater than and less than 0.5, the confidence values ​​of at least three consecutive time points, including the current time point, are determined, wherein, if the majority of the confidence values ​​are greater than 0.5, the measurement data of the time point for which the confidence value is a maximum of the confidence values ​​are used as input data for the evaluation model, or, if the majority of the confidence values ​​are less than 0.5, the measurement data of the time point for which the confidence value is a minimum of the confidence values ​​are used as input data for the evaluation model.

6. Method according to one of the preceding claims, wherein the seating arrangement (105) comprises several seats (105a-e), wherein each of the seats is assigned a foot space (405c-e), and wherein an individual foot space occupancy state is determined for each of the foot spaces (405c-e).

7. Method according to one of the preceding claims, further comprising a detection of a seat occupancy state of the seat arrangement (105), wherein the detection of the seat occupancy state comprises: RGTH G251156WO12616PT gestigon GmbH 10.12.2025 27 - Acquiring a data set for a seat occupancy status, wherein the data set represents measurement data at least for a current time, wherein the measurement data represent the associated radar point cloud (305) which was or is obtained on the basis of radar scanning; - Determining a seat occupancy state of the seating arrangement (105) using the evaluation model, wherein the data set forms input data for the evaluation model and the evaluation model, depending on the radar point cloud (305), provides a seat occupancy state of the seating arrangement (105) at the current time as output based on the acquired data set; and - Outputting seat occupancy status information defined based on the evaluation result.

8. Method according to claim 7, wherein the measurement data are recorded for at least two successive time points, including the current time point, wherein an average value is determined for the current time point and at least one further of the successive time points, wherein the input data for the evaluation model for determining the seat occupancy state includes the determined average value.

9. Method according to claim 7 or 8, wherein the determination of the footwell occupancy state takes into account the determined seat occupancy state.

10. Method according to one of the preceding claims, wherein a measure of movement activity at the current time is determined from Doppler shift values ​​from the measurement data, wherein the data set contains the determined measure of movement activity as input data for the evaluation model.

11. Method according to one of the preceding claims, wherein the radar point cloud (305) is segmented into several clusters by assigning to each of the seats (105a-e) and each of the footwells (405c-e) as a cluster a subset of the radar points of the respective radar point cloud (305) RGTH G251156WO12616PT gestigon GmbH 10.12.2025 28 Depending on their respective positions, the radar points of the cluster are assigned in such a way that they lie in a defined closed spatial area (325a-e, 525c-e) in the vicinity of the seat (105a-e) or the foot space (405c-e).

12. Method according to one of the preceding claims, wherein the at least one footwell (405c-e) comprises at least one footwell which is assigned to a rear seat (105c-e) of the seating arrangement (105), wherein a signal source is controlled in such a way as to depend on the information from the evaluation result, such that a signal output by the signal source prevents an automatic seat adjustment to the rear of a seat (105a-b) of the seating arrangement which is located directly in front of the footwell (405c-e) of the rear seat (105c-e).

13. System (115) for detecting a footwell occupancy state for a seating arrangement (105) with at least one seat (105a-e), wherein the system (115) comprises a data processing device configured to perform the method according to one of the preceding claims for detecting a footwell occupancy state for a seating arrangement (105).

14. Computer program or computer program product comprising instructions which, when executed on the data processing device of the system (115) according to claim 13, cause the system (115) to execute the method according to any one of claims 1 to 12.

15. Vehicle (100) comprising: a seating arrangement (105) with at least one seat (105a-e); a radar sensor (110) for at least partial radar scanning of the seating arrangement (105) including at least one footwell (405c-e) of the seating arrangement (105), wherein the radar sensor (110) is arranged above the seating arrangement (105); and a system (115) according to claim 13. RGTH G251156WO12616PT

Images