System and method for simple and flexible control of vehicle functions

Abstract

System (100) for simple and flexible control of vehicle functions of a vehicle (110), comprising: a mobile device (120) that is set up to collect sensor data; a computing unit (114, 124) that is set up, - to process the captured sensor data; - to determine a temporal and functional relationship between the processed sensor data and the vehicle (110), wherein the temporal and functional relationship also includes a spatial relationship and wherein the spatial relationship includes a position of a user of the mobile device in or on the vehicle (110); and - to determine an assignment of the processed sensor data to a predefined vehicle function; wherein the vehicle (110) includes a control unit (112) which is configured to control or regulate the predefinable vehicle function according to the determined assignment.

Description

[0001] The present invention relates to a system and a method for the simple and flexible control of vehicle functions.

[0002] Comfort features related to the user's ability to operate vehicle functions are well-known. For example, so-called keyless entry systems are known, which allow a vehicle to be unlocked and / or started without actively using the vehicle key. This is achieved using a capacitive or optical proximity sensor on the vehicle. Another example of a comfort vehicle feature is automatic or electric tailgate operation. This enables contactless opening and closing of the tailgate by using sensors on the vehicle that detect a predetermined movement and, upon detection, trigger the opening or closing of the tailgate. Additionally or alternatively, one or more control elements can be installed on the vehicle and / or the vehicle key, which, when activated, open or close the tailgate.Furthermore, it is known to enable additional vehicle functions, such as opening or closing the sunroof, activating or deactivating lighting elements, etc., using appropriate controls within the vehicle. Gesture control in the vehicle is another example of a comfort vehicle function. For this, an interior camera in the vehicle, for instance, recognizes a predefined hand movement of a vehicle occupant. Depending on the recognized hand movement, a vehicle function can be triggered that is temporally related to one or more predefined vehicle functions, such as changing radio stations, accepting or rejecting an incoming call, adjusting the volume, etc. A disadvantage of this is that the aforementioned vehicle functions require the costly integration of the necessary sensors and / or controls within the vehicle.Furthermore, operating the corresponding vehicle functions can be unreliable and / or inconvenient. Retrofitting the aforementioned comfort functions is also only possible with considerable effort, as the corresponding sensors and / or controls must be retrofitted into the vehicle. Built-in sensors have the additional disadvantage of requiring energy consumption in the vehicle.

[0003] Publication DE 10 2009 052 079 A1 discloses a portable remote control device for a vehicle with an acceleration sensor for detecting movement of the remote control device and for outputting corresponding acceleration data.

[0004] Furthermore, the portable remote control device includes a conversion device for transforming the acceleration data into a motion curve and / or rotation of the device. An evaluation device for analyzing the motion curve and / or rotation is also disclosed in order to derive a control command. Finally, the portable remote control device has a switching device designed to determine, in response to a user action, the start and / or end of the detection of a movement by the remote control device. In this way, a concept for remotely controlling a vehicle can be created in which a large number of control commands can be triggered with a reduced number of actuation elements.

[0005] Publication DE 10 2014 017 173 A1 discloses a method for operating a mobile computing unit in a vehicle, in which the mobile computing unit is connected to the vehicle and integrated into an operating logic of the vehicle, wherein information to be output by the mobile computing unit is output on at least one output unit included by the vehicle and wherein a functionality of the mobile computing unit is extended by at least one vehicle-specific function.

[0006] Publication DE 10 2016 211 215 A1 discloses a method for operating a motor vehicle in which a mobile device and the motor vehicle communicate with each other. The method is characterized by the fact that the mobile device functions as an external control unit during the vehicle's operation, which automatically controls one or more components of the motor vehicle via communication with the vehicle.

[0007] German patent application DE 10 2017 108 658 A1 discloses a system for controlling a vehicle from a remote device, such as a mobile device. In one embodiment, the mobile device comprises a mobile phone; in other embodiments, any device capable of receiving user input can be used to control the movement. In one embodiment, the system comprises a user input receiving module coupled to a processor and designed to receive fluctuations in user input forces applied to a touch-sensitive user interface over a period of time, wherein the intentional or unintentional fluctuations in user input forces over that period indicate a user's intention to control the vehicle.

[0008] The object of the invention is to provide a solution that enables improved, cost-effective and flexible provision of vehicle functions in the vehicle.

[0009] This problem is solved according to the invention by the features of the independent claims. Preferred embodiments are the subject of the dependent claims.

[0010] The aforementioned task is solved by a system for the simple and flexible control of vehicle functions, comprising: a mobile device that is set up to collect sensor data; a computing unit that is set up, - to process the captured sensor data; - to determine a temporal and functional relationship between the processed sensor data and the vehicle, wherein the temporal and functional relationship also includes a spatial relationship, and wherein the spatial relationship includes the position of a user of the mobile device in or on the vehicle; and - to determine an assignment of the processed sensor data to a predefined vehicle function; wherein the vehicle includes a control unit which is set up to control or regulate the predefinable vehicle function according to the determined assignment.

[0011] The system includes at least one mobile device. For the purposes of this document, the term "mobile device" refers in particular to modern smartphones, smartwatches and tablet PCs, smart glasses, etc., which have a variety of sensors capable of capturing movement data of the user of the mobile device and transmitting it wirelessly – for example, via an air interface such as Bluetooth Low Energy (BLE).

[0012] The mobile device includes a sensor unit configured to collect sensor data. Specifically, this sensor data can correspond to movement data and / or gesture data of the user or carrier of the mobile device. Movement data includes data relating to the movements of the user or carrier of the mobile device, while gesture data includes data relating to the gestures of the user or carrier of the mobile device. In the following, the terms "movement data" and "movement" are used to refer to movement data and / or gesture data. The sensor unit can collect sensor data from one or more of the following sensors: - an accelerometer that determines acceleration by measuring an inertial force acting on a mass or test mass, so that it can determine the acceleration, an increase or decrease in velocity and / or the direction of movement of the mobile device; and / or - A position sensor or position determination unit for acquiring or determining the geographic position or current position data using a navigation satellite system. The navigation satellite system can be any current or future global navigation satellite system (GNSS) for position determination and navigation by receiving signals from navigation satellites and / or pseudolites. Examples include the Global Positioning System (GPS), GLONASS, Galileo, and / or BeiDou Navigation Satellite System. In the case of GPS, the position sensor or position determination unit can include a GPS module configured to determine current GPS position data from the mobile device; and / or - a gyroscope, which is an acceleration and / or position sensor configured to detect minute accelerations, rotational movements, and / or changes in position of a mass or test mass. Gyroscope data can be combined with position data from a navigation module, whereby the combination of gyroscope and position data allows, for example, changes in direction to be determined very precisely; and / or - a magnetic field sensor configured to detect the current orientation or direction of movement of the mobile device; and / or - a proximity sensor for activating or deactivating the display of the mobile device; and / or - at least one additional sensor that is set up to record movement data from the mobile device.

[0013] The system comprises at least one vehicle. For the purposes of this document, the term "vehicle" encompasses mobile means of transport used for the transport of persons (passenger transport), goods (freight transport), or tools (machinery or equipment). In particular, the term "vehicle" includes motor vehicles as well as motor vehicles that may be at least partially electrically powered (electric cars, hybrid vehicles).

[0014] The vehicle can be controlled by a driver. Alternatively, or in addition, the vehicle can be at least partially automated. Within the context of this document, the terms "automated vehicle" and "automated driving" can refer to driving with automated longitudinal or lateral control, or autonomous driving with automated longitudinal and lateral control. Automated driving can, for example, involve extended periods of driving on the highway or limited-time driving during parking or maneuvering. The term "automated driving" encompasses automated driving at any level of automation. Examples of automation levels include assisted, partially automated, highly automated, and fully automated driving.These levels of automation were defined by the Federal Highway Research Institute (BASt) (see BASt publication "Research Compact", issue 11 / 2012). In assisted driving, the driver continuously performs longitudinal or lateral control, while the system takes over the other function within certain limits. In partially automated driving, the system takes over longitudinal and lateral control for a certain period and / or in specific situations, whereby the driver must continuously monitor the system, as with assisted driving. In highly automated driving, the system takes over longitudinal and lateral control for a certain period without the driver having to continuously monitor the system; however, the driver must be able to take over vehicle control within a certain timeframe.In fully automated driving, the system can automatically handle driving in all situations for a specific use case; no driver is required for this use case. The four automation levels mentioned above correspond to SAE Levels 1 to 4 of the SAE J3016 standard (SAE - Society of Automotive Engineering). Furthermore, SAE J3016 also includes SAE Level 5 as the highest level of automation, which is not included in the BASt definition. SAE Level 5 corresponds to driverless driving, in which the system can automatically handle all situations like a human driver throughout the entire journey.

[0015] The system includes at least one processing unit. This processing unit is configured to process the acquired sensor data. Processing the sensor data may include preprocessing the raw sensor data.

[0016] Furthermore, processing the sensor data can include determining a predefined movement of the mobile device user. This data is also referred to as motion data and / or gesture data in this document. Examples of a predefined movement or gesture, or motion data or gesture data of the mobile device user, include a step to the side, a jump, a sequence of jumps, or any other predefined movement or gesture detectable by the sensors.

[0017] Determining the predefined or predefined conscious movement, gesture, or action of the mobile device user can be achieved using suitable machine learning algorithms, for example, models created using machine learning methods – such as supervised or unsupervised learning. The machine learning algorithms can be trained on predefined or predefined movements or gestures that are performed consciously. In other words, the movement or gesture must be performed consciously so that an action cannot be triggered or executed by a random movement or gesture. This can include the movement or gesture being completed within a predefined or predefined time frame and / or being executed at a predefined or predefined speed.

[0018] The predefinable or predefined movement or gesture thus determined can be assigned to a predefinable or predefined vehicle function.

[0019] Furthermore, the computing unit is designed to determine a temporal and functional relationship between the processed sensor data and the vehicle.

[0020] The temporal and functional reference also includes a spatial reference, which arises in particular from: - Position of the mobile device user in or on the vehicle; and optionally additionally by one or more of the following conditions: - Condition of the vehicle or the respective vehicle function; - Position of the vehicle, wherein the vehicle includes a GPS sensor; - Available vehicle functions; - detected movement or sequence of movements of the user of the mobile device; - Time; - etc.

[0021] Furthermore, the processing unit is configured – upon detection of a temporal and functional relationship – to determine the assignment of the processed sensor data to a predefined vehicle function. This can be achieved, for example, using a permanently updatable assignment stored in a suitable memory unit.

[0022] The vehicle includes a control unit. The control unit is configured to control or regulate the predefined vehicle function according to the determined assignment.

[0023] Advantageously, this allows for flexible control and / or regulation of a multitude of vehicle functions without the need for expensive sensors and / or controls within the vehicle. This enables improved usability of functions in and around the vehicle by utilizing the latest mobile device technologies, which already provide the necessary sensor data. Furthermore, energy savings are achieved by eliminating vehicle-side sensors. New vehicle functions can be added, adapted, or modified as needed without requiring complex and expensive modifications or installations within the vehicle.

[0024] Preferably, the predefinable or predefined vehicle function includes: - Opening the vehicle's tailgate; and / or - Closing the vehicle's tailgate; and / or - Opening a vehicle door; and / or - Closing a vehicle door; and / or - Opening a vehicle's roller blind; and / or - Closing a vehicle's roller blind; and / or - Activating a vehicle lighting unit; and / or - Deactivating a vehicle lighting unit; and / or - Activating the vehicle's horn; and / or - Disabling the vehicle's horn; and / or - Opening a window of the vehicle; and / or - Closing a window of the vehicle; and / or - Rules of a function of a vehicle's infotainment system; and / or - Regulating the interior temperature of the vehicle; and / or - Controlling or regulating the vehicle's seat heating; and / or - Answering a phone call in the vehicle; and / or - Rejecting a phone call in the vehicle; and / or - Controlling and / or regulating one or more other vehicle functions.

[0025] In general, any predefinable or predefined vehicle function can be included.

[0026] In particular, if the vehicle supports the SAE Level 5 defined above as the highest level of automation, the predefinable or predefined vehicle function can also include starting and / or stopping the vehicle. For example, the aforementioned movement could be recognized as a 'raising and lowering of both heels' or a slight bending and straightening of the knees' by the user of the mobile device. Additionally, or alternatively, the aforementioned movement could be a 'step backward' from a standing position by the user of the mobile device. Furthermore, or alternatively – especially if the mobile device is a smartwatch – the aforementioned movement could be a 'raising of the hand' by the user of the mobile device. This can be assigned to the vehicle function 'holding the vehicle', which could, for example, be an autonomous taxi.

[0027] For example, the aforementioned movement could be a "rapidly circling arm of the mobile device user above their head." This could be assigned to the vehicle function "activating the horn." Furthermore, additional conditions for executing the vehicle function could be stored in the aforementioned memory unit; these conditions must be met for the vehicle function to be executed. In this example, it could be defined that—depending on the time of day and / or the vehicle's geographical location (e.g., geographical locations where horn use is prohibited)—the vehicle function "activating the horn" is not executed, even though the movement "rapidly circling arm of the mobile device user above their head" has been detected.

[0028] In another example, the aforementioned movement can be detected as a single arm swing by the mobile device user. This can be assigned to the vehicle function of opening the vehicle's tailgate and / or opening a vehicle door. In this example, the sensor data can also be used to determine the direction of the mobile device user's arm movement relative to the vehicle and the user's exact position relative to the vehicle. Based on this, the vehicle function can be executed accordingly. In yet another example, the aforementioned movement can be detected as raising and lowering the heels or slightly bending and straightening the knees by the mobile device user. This can be assigned to the vehicle function of opening or closing the tailgate and / or opening or closing a vehicle door and / or opening or closing a vehicle blind and / or opening or closing the rear window.The movement can be assigned to the vehicle's automatic side door, such as closing it. This assignment can be based on the relative position of the mobile device user to the vehicle. This is particularly advantageous if the mobile device user is holding an object or subject in both hands, as the movement can still be performed very comfortably. In another example, the aforementioned movement could be the user approaching the tailgate or the respective vehicle door and taking a short step back. This step could then be assigned to the vehicle function of opening or closing the tailgate, opening or closing a vehicle door, opening or closing a vehicle blind, and / or opening or closing an automatic side door.In the event that the mobile device is a smartwatch, the aforementioned movement can be recognized as a "movement of the user's arm, on which the smartwatch is worn, at a rapid speed in the direction of opening / closing the vehicle's door or tailgate." This can be assigned to the vehicle function "opening or closing the corresponding door or tailgate of the vehicle."

[0029] In another example, the aforementioned movement can be recognized as a 'single turn around the user's own axis' or a 'rotation of the upper body to the left and right' by the user of the mobile device. This can be assigned to the vehicle function 'activating or deactivating the parking lights' and / or 'activating or deactivating other vehicle lighting'.

[0030] The above examples are merely intended to illustrate the complexity and maximum flexibility. It is understood that every assignment of a detected user movement or sequence of movements, with regard to its functional and temporal context, is unambiguously assigned to a vehicle function.

[0031] For each vehicle function, a feedback channel can be established to the user of the mobile device. This feedback channel signals to the user whether a vehicle function was successfully executed or not. This can be done, for example, through visual and / or haptic feedback. Alternatively, or in addition, this can be done by outputting text and / or symbols to the user via an output unit.

[0032] Preferably, the mobile device includes the computing unit, wherein the mobile device transmits the determined assignment of the vehicle function to the vehicle.

[0033] In this case, the raw data from the sensor(s) of the sensor unit can be preprocessed by the processing unit, for example, using a suitable application or app. Furthermore, the user's movement or sequence of movements is determined by processing the sensor data and assigned to the predefined vehicle function on the mobile device. In this case, only the detected movement or sequence of movements of the mobile device user and / or the determined, assigned vehicle function are transmitted to the vehicle. Mobile devices can already determine movement data using appropriate machine learning functions. This framework can be used and / or extended to determine the user's movements or sequences of movements and transmit them to the vehicle.Advantageously, functions already embedded in the operating system and / or ecosystem of the mobile device can be used or extended. Alternatively, the functionality can be provided via a native application or app that is downloaded and executed on the mobile device.

[0034] Preferably, the mobile device transmits the captured sensor data to the vehicle, the vehicle comprising the computing unit.

[0035] In this example, the raw data from the sensor(s) of the mobile device's sensor unit can either be preprocessed on the mobile device and transmitted to the vehicle in this preprocessed state. Alternatively, the raw data can be transmitted directly to the vehicle. Further processing of the sensor data then takes place within the vehicle itself.

[0036] Data transmission from the mobile device to the vehicle can be achieved, for example, via Bluetooth or ultra-wideband (UWB) technology. UWB is a short-range radio communication technology that utilizes extremely large frequency ranges with a bandwidth of at least 500 MHz or at least 20% of the arithmetic mean of the lower and upper cutoff frequencies of the frequency band used. UWB can be used, in particular, for locating the mobile device on the vehicle. It can also be used for highly precise determination of the mobile device's position relative to the vehicle. The data can be transmitted locally from the mobile device to the vehicle via a suitable radio interface, such as Bluetooth Low Energy (BLE). BLE is a radio technology that enables communication between two devices within a range of approximately 10 meters. Compared to conventional Bluetooth, BLE has very low power consumption.In another example – particularly if the mobile device is not within UWB range of the vehicle – the movement or gesture can be detected by the mobile device, which can then transmit the captured sensor data to a backend. The backend can then transmit this data to the vehicle. This data transmission can be carried out via the mobile network using methods known from the prior art.

[0037] According to a second aspect, the underlying task is solved by a method for the simple and flexible control of vehicle functions, including: Capture sensor data on a mobile device; Processing the captured sensor data on a computing unit; Determine, by the computing unit, a temporal and functional relationship between the processed sensor data and the vehicle, wherein the temporal and functional relationship also includes a spatial relationship and wherein the spatial relationship includes a position of a user of the mobile device in or on the vehicle; Determine, through the processing unit, an assignment of the processed sensor data to a predefined vehicle function; and Control or regulate, by a control unit of the vehicle, the predefinable vehicle function according to the determined assignment.

[0038] Preferably, the predefinable or predefined vehicle function includes: - Opening the vehicle's tailgate; and / or - Closing the vehicle's tailgate; and / or - Opening a vehicle door; and / or - Closing a vehicle door; and / or - Opening a vehicle's roller blind; and / or - Closing a vehicle's roller blind; and / or - Activating a vehicle lighting unit; and / or - Deactivating a vehicle lighting unit; and / or - Activating the vehicle's horn; and / or - Disabling the vehicle's horn; and / or - Opening a window of the vehicle; and / or - Closing a window of the vehicle; and / or - Rules of a function of a vehicle's infotainment system; and / or - Regulating the interior temperature of the vehicle; and / or - Controlling or regulating the vehicle's seat heating; and / or - Answering a phone call in the vehicle; and / or - Rejecting a phone call in the vehicle; and / or - Controlling and / or regulating one or more other vehicle functions.

[0039] Preferably, the mobile device includes the computing unit, wherein the mobile device transmits the determined assignment of the vehicle function to the vehicle.

[0040] Preferably, the mobile device transmits the captured sensor data to the vehicle, the vehicle comprising the computing unit.

[0041] These and other problems, features, and advantages of the present invention will become clear from studying the following detailed description of preferred embodiments and the accompanying figures. It is evident that—although embodiments are described separately—individual features can be combined to form additional embodiments. Fig. Figure 1 schematically shows a system for the simple and flexible control of vehicle functions of a vehicle; Fig. Figure 2 shows an exemplary method for the simple and flexible control of vehicle functions of a vehicle.

[0042] Fig. Figure 1 schematically shows a system 100 for the simple and flexible control of vehicle functions of a vehicle 110.

[0043] System 100 comprises a mobile device 120. The mobile device 120 includes a sensor unit 122, which is configured to collect sensor data. In particular, the sensor data can correspond to movement data of the user or carrier of the mobile device 120. The sensor unit 122 can collect sensor data from one or more of the following sensors (not shown): - an accelerometer that determines acceleration by measuring an inertial force acting on a mass or test mass, so that it can determine acceleration, an increase or decrease in velocity and / or a direction of motion; and / or - A position sensor or position determination unit for acquiring or determining the geographic position or current position data using a navigation satellite system. The navigation satellite system can be any current or future global navigation satellite system (GNSS) for position determination and navigation by receiving signals from navigation satellites and / or pseudolites. Examples include the Global Positioning System (GPS), GLONASS, Galileo, and / or BeiDou Navigation Satellite System. In the case of GPS, the position sensor or position determination unit can include a GPS module configured to determine current GPS position data from the mobile device; and / or - a gyroscope, which is an acceleration and / or position sensor configured to detect minute accelerations, rotational movements, and / or changes in position of a mass or test mass. Gyroscope data can be combined with position data from a navigation module, whereby the combination of gyroscope and position data allows, for example, changes in direction to be determined very accurately; and / or - a magnetic field sensor configured to detect the current orientation or direction of movement of the mobile device; and / or - a proximity sensor for activating or deactivating the display of the mobile device; and / or - at least one additional sensor that is set up to record movement data from the mobile device.

[0044] System 100 includes one vehicle 110.

[0045] System 100 includes at least one computing unit 114, 124. Computing unit 114, 124 is configured to process the acquired sensor data. Processing the sensor data may include preprocessing the raw sensor data.

[0046] The mobile device 120 can include the computing unit 124, whereby the mobile device 120 transmits the determined assignment of the vehicle function to the vehicle 110.

[0047] In this case, the raw data from the sensor(s) of sensor unit 122 can be preprocessed by the processing unit 124, for example, using a suitable application or app. Furthermore, the movement or sequence of movements of the user of the mobile device 120 is determined by processing the sensor data and assigning the processed sensor data to the predefined vehicle function on the mobile device 120. In this case, only the detected movement or sequence of movements of the user of the mobile device 120 and / or the determined, assigned vehicle function is transmitted to the vehicle 110. Mobile devices 120 can already determine movement data using appropriate machine learning functions. This framework can be used and / or extended to determine the user's movements or sequences of movements and transmit them to the vehicle 110.Advantageously, the functions already embedded in the operating system and / or ecosystem of the mobile device 120 can be used and, if necessary, extended. In another example, the aforementioned processing can be carried out using a suitable native application or app that is loaded and executed on the mobile device 120.

[0048] In addition, or alternatively, the mobile device 120 can transmit the recorded sensor data to the vehicle 110, the vehicle comprising the computing unit 114.

[0049] In this example, the raw data from the sensor(s) of sensor unit 122 of the mobile device 120 can either be preprocessed on the mobile device 120 (for example, by the processing unit 124 of the mobile device 120) and transmitted in this preprocessed form to the vehicle 110. Alternatively, the raw data can be transmitted directly from the mobile device 120 to the vehicle 110. Further processing of the sensor data then takes place on the vehicle's end by the processing unit 114.

[0050] The transmission of data from the mobile device 120 to the vehicle 110 can be achieved, for example, via Bluetooth or ultra-wideband (UWB) technology. UWB is a short-range radio communication technology that utilizes extremely large frequency ranges with a bandwidth of at least 500 MHz or at least 20% of the arithmetic mean of the lower and upper cutoff frequencies of the frequency band used. UWB can be used, in particular, for locating the mobile device on the vehicle. It can also be used for highly precise determination of the positions of the mobile device 120 relative to the vehicle 110. The data from the mobile device 120 to the vehicle 110 can be transmitted locally via a suitable radio interface, such as Bluetooth Low Energy (BLE). BLE is a radio technology that enables communication between two devices within a range of approximately 10 meters.BLE has very low power consumption compared to classic Bluetooth. A communication unit 116 can be provided and used on the vehicle side for this purpose. In another example – particularly if the mobile device 120 is not located within UWB range of the vehicle 110 – the movement or gesture can be detected by the mobile device 120, which can then transmit the captured sensor data to a backend (not shown). The backend can then transmit the captured sensor data to the vehicle 110. This data transmission can take place via the mobile network in a manner known from the prior art.

[0051] Furthermore, processing the sensor data can include determining a predefined movement or gesture of the user of the mobile device 120. This data is also referred to as motion data in this document. Examples of a predefined movement or gesture, or motion data of the user of the mobile device 120, could be a step to the side, a jump, a sequence of jumps, or any other predefined movement or gesture that can be detected by the sensors.

[0052] Determining the predefined or predefined conscious movement of the user of the mobile device 120 can be achieved using suitable machine learning algorithms, for example, models created using machine learning methods – such as supervised or unsupervised learning. The machine learning algorithms can be trained on predefined or predefined movements or gestures that are performed consciously. In other words, the movement or gesture must be performed consciously so that an action cannot be triggered or executed by a random movement or gesture. This can include the movement or gesture being completed within a predefined or predefined time window and / or being executed at a predefined or predefined speed.

[0053] The predefinable or predefined conscious movement or gesture thus determined can be assigned to a predefinable or predefined vehicle function.

[0054] The predefinable or predefined vehicle function can include: - Opening the tailgate of vehicle 110; and / or - Closing the tailgate of vehicle 110; and / or - Opening a door of vehicle 110; and / or - Closing a door of vehicle 110; and / or - Opening a roller blind of vehicle 110; and / or - Closing a roller blind of vehicle 110; and / or - Activating a vehicle lighting unit 110; and / or - Deactivating a vehicle lighting unit 110; and / or - Activating a vehicle horn 110; and / or - Deactivating the vehicle's horn (110); and / or - Opening a window of vehicle 110; and / or - Closing a window of vehicle 110; and / or - Rules of a function of a vehicle infotainment system 110; and / or - Regulating an interior temperature of the vehicle of 110; and / or - Controlling or regulating the seat heating of vehicle 110; and / or - Answering a telephone call in the vehicle (110); and / or - Rejecting a telephone call in the vehicle (110); and / or - Controlling and / or regulating one or more other vehicle functions of vehicle 110.

[0055] In general, any predefinable or predefined vehicle function can be included.

[0056] In particular, if the vehicle 110 supports the SAE Level 5 defined above as the highest level of automation, the predefinable or predefined vehicle function can also include starting and / or stopping the vehicle 110. For example, the aforementioned movement can be recognized as a 'raising and lowering of both heels' or a slight bending and straightening of the knees' by the user of the mobile device 120. Additionally or alternatively, the aforementioned movement can be a 'step backward from a standstill' by the user of the mobile device 120. Furthermore or alternatively, particularly if the mobile device 120 is a smartwatch, the aforementioned movement can be a 'raising of the hand' by the user of the mobile device 120. This can be...can be assigned to the vehicle function 'Hold vehicle 110', which could be, for example, an autonomous taxi.

[0057] For example, the aforementioned movement could be a "rapidly circling arm of the user of mobile device 120 above their head." This could be assigned to the vehicle function "activating the horn." Furthermore, additional conditions for executing the vehicle function could be stored in the aforementioned memory unit (not shown), which must be met for the vehicle function to be executed. In this example, it could be defined that—depending on the time of day and / or the geographical location of vehicle 110 (e.g., geographical locations where honking is prohibited)—the vehicle function "activating the horn" is not executed, even though the movement "rapidly circling arm of the user of mobile device 120 above their head" has been detected.

[0058] In another example, the aforementioned movement can be identified as a single arm swing by the user of mobile device 120. This can be assigned to the vehicle function "opening the tailgate of vehicle 110" and / or "opening a door of vehicle 110." In this example, the sensor data can also be used to determine the direction of the user's arm movement relative to vehicle 110 and the user's exact position at vehicle 110. Based on this, the vehicle function can be executed accordingly. In another example, the aforementioned movement can be identified as a "raising and lowering of the heels" or a slight bending and straightening of the knees by the user of mobile device 120. This can be assigned to the vehicle function "opening or closing the tailgate" and / or "opening or closing a door" and / or "opening or closing a roller blind" and / or "opening or closing a window."The movement can be assigned to the vehicle 110's automatic side door. This assignment can be made according to the relative position of the user of the mobile device 120 to the vehicle 110. This assignment is particularly advantageous if the user of the mobile device 120 is, for example, holding an object or subject in both hands, as this movement can still be performed very comfortably. In another example, the aforementioned movement can be recognized as the user of the mobile device 120 approaching the tailgate or respective vehicle door and taking a short step back. This can be assigned to the vehicle function of opening or closing the tailgate, and / or opening or closing the door, and / or opening or closing the roller blind, and / or opening or closing an automatic side door of the vehicle 110.In the event that the mobile device 120 is a smartwatch, the aforementioned movement can be recognized as a 'movement of the arm of the user of the mobile device 120, on which the smartwatch is worn, at a rapid speed in the direction of movement corresponding to the opening / closing direction of the door or tailgate of the vehicle 110'. This can be assigned to the vehicle function 'opening or closing the corresponding door or tailgate of the vehicle 110'.

[0059] In another example, the aforementioned movement can be identified as a 'single turn around the user's own body axis' or a 'turn of the upper body to the left and right' by the user of the mobile device 120. This can be assigned to the vehicle function 'activating or deactivating the parking lights' and / or 'activating or deactivating other lighting' of the vehicle 110.

[0060] The above examples are merely intended to underscore the complexity and maximum flexibility. It is understood that every assignment of a detected movement or sequence of movements by the user of the mobile device 120, with regard to its functional and temporal context, is unambiguously assigned to a vehicle function.

[0061] For each vehicle function, a feedback channel can be established to the user of the mobile device 120. This feedback channel signals to the user of the mobile device 120 whether a vehicle function was successfully executed or not. This can be done, for example, through visual and / or haptic feedback. Alternatively, or in addition, this can be done by outputting text and / or symbols to the user of the mobile device 120 via an output unit.

[0062] Furthermore, the computing unit 114, 124 is set up to determine a temporal and functional relationship between the processed sensor data and the vehicle 110.

[0063] The temporal and functional reference includes in particular: - Position of the user of the mobile device 120 in or on the vehicle 110; and optionally by one or more of the following conditions: - Condition of vehicle 110 or the respective vehicle function; - geographical position of the vehicle 110; - available vehicle functions; - detected movement or sequence of movements of the user of the mobile device 120; - Time; - etc.

[0064] The geographical position of vehicle 110 can be determined by a vehicle-mounted positioning unit (not shown).

[0065] Furthermore, the processing unit 114, 124 is configured – upon detection of a temporal and functional relationship – to determine the assignment of the processed sensor data to a predefined vehicle function. This can be done, for example, using a permanently updatable assignment stored in a suitable memory unit.

[0066] The vehicle 110 includes a control unit 112. The control unit 112 is configured to control or regulate the predefined vehicle function according to the determined assignment.

[0067] Advantageously, this allows for flexible control and / or regulation of a multitude of vehicle functions without requiring expensive sensors and / or control elements in the vehicle. This enables improved usability of functions in and around the vehicle by utilizing the latest technologies in the field of mobile devices, which already provide the necessary sensors. Furthermore, energy savings are achieved by eliminating vehicle-side sensors. New vehicle functions can be added, adapted, or modified as needed without requiring complex and expensive modifications or installations in the vehicle.

[0068] Fig. Figure 2 shows a method 200 for the simple and flexible control of vehicle functions of a vehicle, that is controlled by a system 100 as with reference to Fig. 1 can be described and executed.

[0069] Procedure 200 includes: Capture 210, or 120 on a mobile device, of sensor data; Processing 220, on a computing unit 114, 124, of the recorded sensor data; Determine, by means of the computing unit 114, 124, a temporal and functional reference of the processed sensor data to the vehicle 110, wherein the temporal and functional reference also includes a spatial reference and wherein the spatial reference includes a position of a user of the mobile device in or on the vehicle 110; Determine, through the computing unit 114, 124, an assignment of the processed sensor data to a predefinable vehicle function; and Control or regulate 250, by a control unit 112 of the vehicle 110, the predefinable vehicle function according to the determined assignment.

[0070] The predefinable vehicle function includes: - Opening the tailgate of vehicle 110; and / or - Closing the tailgate of vehicle 110; and / or - Opening a door of vehicle 110; and / or - Closing a door of vehicle 110; and / or - Opening a roller blind of vehicle 110; and / or - Closing a roller blind of vehicle 110; and / or - Activating a vehicle lighting unit 110; and / or - Deactivating a vehicle lighting unit 110; and / or - Activating a vehicle horn 110; and / or - Deactivating the vehicle's horn (110); and / or - Opening a window of vehicle 110; and / or - Closing a window of vehicle 110; and / or - Rules of a function of a vehicle infotainment system 110; and / or - Regulating an interior temperature of the vehicle of 110; and / or - Controlling or regulating the seat heating of vehicle 110; and / or - Answering a telephone call in the vehicle (110); and / or - Rejecting a telephone call in the vehicle (110); and / or - Control and / or regulate one or more other vehicle functions of vehicle 110.

[0071] The mobile device 120 can include the computing unit 124, whereby the mobile device 120 transmits the determined assignment of the vehicle function to the vehicle 110.

[0072] The mobile device 120 can transmit the captured sensor data to the vehicle 110, the vehicle 110 comprising the computing unit.

Claims

[1] System (100) for simple and flexible control of vehicle functions of a vehicle (110), comprising: a mobile device (120) that is set up to collect sensor data; a computing unit (114, 124) that is set up, - to process the captured sensor data; - to determine a temporal and functional relationship between the processed sensor data and the vehicle (110), wherein the temporal and functional relationship also includes a spatial relationship and wherein the spatial relationship includes a position of a user of the mobile device in or on the vehicle (110); and - to determine an assignment of the processed sensor data to a predefined vehicle function; wherein the vehicle (110) includes a control unit (112) which is configured to control or regulate the predefinable vehicle function according to the determined assignment. [2] System (100) according to claim 1, wherein the predefinable vehicle function comprises: - Opening a vehicle tailgate (110); and / or - Closing the vehicle's tailgate (110); and / or - Opening a vehicle door (110); and / or - Closing a vehicle door (110); and / or - Opening a vehicle roller blind (110); and / or - Closing a vehicle blind (110); and / or - Activating a vehicle lighting unit (110); and / or - Deactivating a vehicle lighting unit (110); and / or - Activating the vehicle's horn (110); and / or - Deactivating the vehicle's horn (110); and / or - Opening a window of the vehicle (110); and / or - Closing a window of the vehicle (110); and / or - Rules of a function of a vehicle infotainment system (110); and / or - Regulating the interior temperature of the vehicle (110); and / or - Controlling or regulating a vehicle's seat heating system (110); and / or - Answering a telephone call in the vehicle (110); and / or - Rejecting a telephone call in the vehicle (110); and / or - Control and / or regulate one or more other vehicle functions of the vehicle (110). [3] System (100) according to one of the preceding claims, wherein the mobile terminal (120) comprises the computing unit (124); and wherein the mobile terminal transmits the determined assignment of the vehicle function to the vehicle (110). [4] System (100) according to one of claims 1 or 2, wherein the mobile terminal (120) transmits the acquired sensor data to the vehicle (110); and wherein the vehicle (110) comprises the computing unit (114). [5] Method (200) for simple and flexible control of vehicle functions of a vehicle (110), comprising: Capture (210) sensor data on a mobile device (120); Processing (220) on a computing unit (114, 124) of the acquired sensor data; Determine (230), by the computing unit (114, 124), a temporal and functional reference of the processed sensor data to the vehicle (110), wherein the temporal and functional reference also includes a spatial reference and wherein the spatial reference includes a position of a user of the mobile device in or on the vehicle (110); Determine (240), by the processing unit (114, 124), an assignment of the processed sensor data to a predefinable vehicle function; and Control or regulate (250) by a control unit (112) of the vehicle (110) according to the predefinable vehicle function as determined. [6] Method (200) according to claim 5, the predefinable vehicle function includes: - Opening a vehicle tailgate (110); and / or - Closing the vehicle's tailgate (110); and / or - Opening a vehicle door (110); and / or - Closing a vehicle door (110); and / or - Opening a vehicle roller blind (110); and / or - Closing a vehicle blind (110); and / or - Activating a vehicle lighting unit (110); and / or - Deactivating a vehicle lighting unit (110); and / or - Activating the vehicle's horn (110); and / or - Deactivating the vehicle's horn (110); and / or - Opening a window of the vehicle (110); and / or - Closing a window of the vehicle (110); and / or - Rules of a function of a vehicle infotainment system (110); and / or - Regulating the interior temperature of the vehicle (110); and / or - Controlling or regulating a vehicle's seat heating system (110); and / or - Answering a telephone call in the vehicle (110); and / or - Rejecting a telephone call in the vehicle (110); and / or - Control and / or regulate one or more other vehicle functions of the vehicle (110). [7] Method (200) according to claim 5 or 6, wherein the mobile terminal (120) comprises the computing unit (124); and wherein the mobile terminal transmits the determined assignment of the vehicle function to the vehicle (110). [8] Method (200) according to one of claims 5 or 6, wherein the mobile terminal (120) transmits the acquired sensor data to the vehicle (110); and wherein the vehicle (110) comprises the computing unit (114).

Images