Method for operating a vehicle monitoring system, vehicle monitoring system and vehicle with a monitoring system

Abstract

The invention relates to a method for operating a monitoring system (10) of a vehicle (1). The invention provides that, for the detection of manipulations to the vehicle (1), the monitoring system (10) generates a manipulation index value that depends on the functional state of at least one component (6, 7) of the vehicle (1) and on environmental data of the vehicle (1), that the manipulation index value is formed from a first index value generated during the evaluation of the functional state of the at least one component (6, 7) of the vehicle (1) and from a second index value generated during the evaluation of the environmental data of the vehicle (1), that the manipulation index value is compared with an overall threshold value, and that manipulation of the vehicle (1) is considered to have occurred if the manipulation index value exceeds the overall threshold value.

Description

[0001] The invention relates to a method for operating a monitoring system of a vehicle, as well as a monitoring system of a vehicle and a vehicle with a monitoring system.

[0002] Vehicles are increasingly being equipped with anti-theft alarm systems as monitoring systems, which monitor the interior of the vehicle visually and / or audibly and thereby trigger an audible and / or visual alarm in the event of an attempted break-in into the interior of the vehicle or an attempt to steal items from the interior of the vehicle.

[0003] In this context, DE 10 2018 218 845 A1 discloses an autonomously operated motor vehicle that has first sensors for acquiring environmental data and second sensors for acquiring vehicle data. If a danger signal is generated by one of the sensors, a risk assessment is carried out to determine the extent to which damage to the motor vehicle is to be expected at its current parking position. Based on the result of the risk assessment, a driving instruction is issued for the motor vehicle to leave its current parking position, and an autonomous driving maneuver is executed.

[0004] Furthermore, DE 10 2017 114 122 A1 describes a method for detecting physical threats to a vehicle. External sensors mounted on the vehicle monitor the surrounding environment. Targets approaching the vehicle, detected by these sensors, are evaluated by a neural network to classify them as potential threats. If a potential threat to the vehicle is detected, countermeasures can be taken; in particular, in the case of an autonomous vehicle, the system can initiate a move away from an approaching threat.

[0005] Furthermore, DE 10 2018 221 186 A1 discloses a method for autonomous parking of a motor vehicle, in which autonomous parking, unparking or reparking of a motor vehicle is carried out using a mobile device in communication connection with the motor vehicle, for example using a smartphone.

[0006] In DE 10 2019 111 884 A1 a vehicle theft protection device is described in which a break-in sensor, a tilt sensor and a vibration sensor are arranged in the vehicle as fraud detection sensors for detecting vehicle thefts.

[0007] In connection with vehicle manipulations, a method for checking a distance measuring device of a motor vehicle that includes ultrasonic sensors is known from DE 10 2017 221 692 A1. To detect a manipulation-related misalignment of an ultrasonic sensor of the distance measuring device, measured values ​​from acceleration sensors of the motor vehicle are used, in particular to assess whether manipulation of the motor vehicle or a crash of the motor vehicle has occurred.

[0008] Furthermore, DE 10 2005 020 820 A1 describes a method for monitoring a vehicle in which various threshold values ​​are defined depending on the sensor signals detected by the vehicle. Based on these threshold values, a conclusion is then drawn about any possible staged interference with the vehicle, in particular with regard to the stages of vehicle manipulation, vehicle damage, and vehicle theft.

[0009] The invention is based on the objective of providing a method for operating a vehicle monitoring system in which the monitoring system is operated in a simple and advantageous manner to provide effective protection against impairments in the functioning of the vehicle.

[0010] This problem is solved according to the invention by a method for operating a monitoring system of a vehicle with the features listed in claim 1.

[0011] Advantageous further developments of the inventive method, a monitoring system of a vehicle and a vehicle with a monitoring system are part of the further patent claims.

[0012] In the inventive method for operating a vehicle monitoring system, a manipulation index value is generated by the vehicle's monitoring system to detect manipulations to the vehicle, in particular to detect manipulations to the vehicle parked at a parking location and / or optionally also to detect attempted manipulations to the vehicle, in particular to detect attempted manipulations to the vehicle parked at a parking location. This index value depends on the functional state of at least one component of the vehicle and on environmental data of the vehicle. In particular, the vehicle's monitoring system generates a manipulation index value that depends on the functional state of at least one component of the vehicle parked at a parking location and on environmental data of the vehicle parked at a parking location.

[0013] The terms "vehicle tampering" and "attempted vehicle tampering" refer to the deliberate and, in particular, negative interference by a third party with at least one component of the vehicle, which generally also has negative effects on the vehicle's driving characteristics. Unlike vandalism, tampering is not arbitrary and is often not noticeable or immediately apparent to a vehicle occupant. Tampering can occur on the exterior of the vehicle, specifically on at least one exterior component, or it can occur in the interior, specifically on at least one interior component. Furthermore, tampering can also be related to access to the vehicle.

[0014] Particularly in the case of vehicles capable of operating in autonomous driving mode, manipulations can be carried out by a person who has access to the vehicle during their booking period. Such targeted manipulations of at least one component of the vehicle capable of operating in autonomous driving mode, for example, targeted manipulations of at least one sensor, can significantly impair the vehicle's roadworthiness and thus its safety.For example, covering an optical sensor of a vehicle operating in autonomous mode, such as a camera, can cause the vehicle to miss objects and / or people during object detection due to the limited sensing of its surroundings. Such a manipulated vehicle operating in autonomous mode thus poses a significant safety risk.

[0015] A first aspect of the inventive method for determining the manipulation index value involves actively monitoring at least one component of the vehicle, and in particular, actively monitoring at least one component of the vehicle when it is parked at a parking location. This active monitoring serves, in particular, to detect internal manipulations carried out on at least one component of the vehicle, and especially to detect internal manipulations carried out on at least one sensor of the vehicle. From this, corresponding data on the functional state of the components are then generated or derived and evaluated.

[0016] A second aspect of the inventive method for determining the manipulation index value involves the passive monitoring of the vehicle, in particular the passive monitoring of a vehicle parked at a parking location. For this purpose, optical sensor units such as cameras are used. Such an optical sensor unit, like a camera, can be located on the outside of the vehicle and / or inside the vehicle and / or, for example, as a surveillance camera, at an external location away from the vehicle. From this, corresponding environmental data is then generated or derived and evaluated.

[0017] According to the invention, the manipulation index value is calculated from a first index value generated during the evaluation of the functional state of at least one vehicle component and a second index value generated during the evaluation of the vehicle's environmental data. Based on the result obtained during the evaluation of the functional state of the at least one vehicle component, a first index value is thus created as a first "risk score." Similarly, based on the result obtained during the evaluation of the vehicle's environmental data, a second index value is created as a further "risk score." The respective index values ​​can, for example, be on a scale between 0 and 10, where, for instance, an index value of 0 corresponds to the lowest risk level and an index value of 10 to the highest risk level. The higher the respective index value, the greater the probability that the vehicle has been manipulated.

[0018] The two index values ​​are combined in a suitable manner to form the manipulation index value, for example, by calculating them using a processing unit. In particular, a weighted sum of the two index values ​​can also be created to calculate the manipulation index value. Like the two index values ​​themselves, the manipulation index value can, for example, be on a scale between 0 and 10, where, for instance, an index value of 0 represents the lowest risk level and an index value of 10 the highest risk level. The higher the manipulation index value, the greater the probability that the vehicle has been tampered with.

[0019] According to the invention, the manipulation index value is compared with an overall threshold. Based on this comparison, manipulation of the vehicle, and in particular manipulation of a vehicle parked at a location, and / or possibly also an attempted manipulation of the vehicle, and in particular an attempted manipulation of a vehicle parked at a location, is deemed to have occurred if the manipulation index value exceeds the overall threshold. This rule-based approach, which compares the aforementioned index value with the corresponding threshold, thus determines whether or not manipulation of the vehicle has occurred.

[0020] In a preferred embodiment of the invention, the functional state of the at least one component of the vehicle is evaluated by comparing current functional data of the at least one component with functional data of the at least one component recorded at the beginning of the vehicle's journey and / or by comparing functional data of the at least one component with reference data of other vehicles for the at least one component, in particular with reference data for the at least one component of vehicles of the same type.

[0021] A control unit of the monitoring system is provided for evaluating the functional data of at least one vehicle component, and in particular for evaluating the functional data of at least one component of a parked vehicle. This control unit determines various sensor data from the vehicle's sensors, especially before the vehicle starts moving and / or at the beginning of a journey, and then processes this data appropriately. For example, sensor data can include camera data from at least one camera (the vehicle's optical sensor), lidar data from at least one lidar sensor, temperature data from various vehicle components, oil pressure data from the vehicle's internal combustion engine, and other sensor data. Alternatively or additionally, functional data from other, structurally identical vehicles operating normally and therefore not subject to manipulation can also be used.For this purpose, the vehicle is equipped with a communication system that enables, for example, Car2X communication with other vehicles or with an external central unit to retrieve the functional data of other vehicles. From this, the first index value is generated and sent to a control unit for evaluation and further processing.

[0022] To analyze the vehicle's environmental data, and especially the environmental data of a parked vehicle, internal sensor units assigned to the vehicle are used for object detection and / or for the pose detection of persons, and / or external sensor units located outside the vehicle are used as external monitoring devices for object detection. This allows for the detection of persons inside the vehicle, and especially persons in a parked vehicle, as well as persons on or near a parked vehicle, whereby their posture and / or position are then determined. The object detection sensor units can also detect objects used to tamper with the vehicle, such as knives, screwdrivers, or similar items.From this, the second index value is calculated and fed to a control unit for evaluation and further processing. For example, a high second index value, indicating a high risk level, is generated if, at night, a person wearing a hoodie approaches a vehicle parked in a parking space that is not immediately visible, using pliers.

[0023] Different control units and different calculation methods can be provided for processing the functional data of at least one component of the vehicle and the environmental data of the vehicle and for combining the two index values ​​generated from this, for example based on machine learning or such control units and calculation methods based on the use of neural networks.

[0024] In the event of a suspected manipulation of the vehicle, and in particular a suspected manipulation of a vehicle parked at a parking location, and / or possibly also a suspected manipulation attempt of the vehicle, and in particular a suspected manipulation attempt of a vehicle parked at a parking location, a warning signal is preferably generated and / or a message is sent to the driver of the vehicle and / or a message is sent to a central authority such as a control center or the police as the regulatory authority, and / or the vehicle is prevented from driving.

[0025] The inventive method for operating a monitoring system is used in particular in a vehicle that can be operated in an assisted driving mode, an automated driving mode, or an autonomous driving mode. In the latter case, vehicles capable of operating in an autonomous driving mode, an attempt to tamper with the vehicle while it is parked at a designated location can trigger an escape attempt in the form of autonomously repositioning the vehicle. That is to say, in the case of a vehicle operating in an autonomous driving mode, the vehicle will initiate an autonomous movement from its parking position if an attempt to tamper with the vehicle, as deemed to be the case, is made.

[0026] Preferably, the vehicle's monitoring system, comprising at least one sensor unit for generating environmental data, at least one control unit for evaluating and controlling the monitoring system, and at least one communication unit for communicating with the vehicle's driver and / or with other road users and / or with an external body such as a central office, is designed as a separate functional module of the vehicle or integrated into an existing functional module of the vehicle or integrated into an assistance system of the vehicle.

[0027] A control unit or control device / module of the monitoring system, intended for controlling the monitoring system, may include a data processing device or a processor configured to perform one of the described features of the invention. For this purpose, the processor may include at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). In particular, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or an NPU (Neural Processing Unit) may be used as the microprocessor. Furthermore, the processor may include program code configured to execute one of the described features of the invention when executed by the processor.The program code can be stored in a data memory of the processor device. The processor device can be integrated, for example, on at least one circuit board and / or on at least one SoC (System on Chip).

[0028] Furthermore, a vehicle comprising at least one such monitoring system is also claimed. The invention thus also includes a vehicle with a monitoring system according to the invention, wherein the vehicle with the monitoring system according to the invention can be designed in particular as a motor vehicle or motor car, especially as a passenger car, or as a truck or as a passenger bus.

[0029] The proposed method for operating a vehicle monitoring system advantageously enables the reliable detection and evaluation of tampering with the vehicle in a simple manner, and in particular, the reliable detection and evaluation of tampering with a parked vehicle. This also effectively prevents negative effects on the vehicle resulting from such tampering.

[0030] The invention also includes combinations of the features of the described embodiments.

[0031] An embodiment of the invention is described below. The following is shown: Fig. 1 a vehicle parked in a parking space in a parking garage.

[0032] The embodiment described below is a preferred embodiment of the invention. In this embodiment, the described components each represent individual features of the invention that can be considered independently of one another. Each of these features further develops the invention independently and can therefore be considered part of the invention individually or in a combination other than that shown. Furthermore, the described embodiment can also be supplemented by other features of the invention already described.

[0033] For example, the following actions can be detected by a vehicle's monitoring system as manipulations carried out on the vehicle or as attempted manipulations carried out on the vehicle: Physical manipulation of the vehicle's brakes, tires, and drivetrain components. This includes, for example, cutting the vehicle's brake lines or tampering with the vehicle's power steering.

[0034] Physical manipulation of vehicle sensors, such as cameras, lidar sensors, ultrasonic sensors, or radar sensors. This includes, for example, deliberately misaligning, covering, or damaging such sensors. This can cause the sensors to deliver faulty data and negatively impact the predictive accuracy of object recognition methods, such as those using neural networks.

[0035] Manipulation of a vehicle's GPS system, which is used, for example, in a navigation system or other vehicle assistance system to determine the vehicle's current location or position. This includes, for example, so-called GPS spoofing, which involves sending false or manipulated GPS signals or jamming signals, causing the vehicle to assume a false location and extract incorrect information from the location data, such as an incorrect speed limit for the vehicle's current route.

[0036] Manipulation of a vehicle's communication system, such as that used in Car2X communication. This could, for example, cause the vehicle to misinterpret a traffic light signal, assuming a green signal instead of an actual red one.

[0037] Manipulation of the vehicle's software by influencing or "reprogramming" the vehicle's driver assistance systems. This can cause incorrect or critical vehicle reactions while driving, or reactions that are unfamiliar to the driver, which in turn can lead to dangerous situations in traffic.

[0038] According to the Fig. Figure 1 shows an embodiment of a vehicle 1. The vehicle 1 is parked, for example, in a parking garage 4 in a parking space 9. The vehicle 1 can be operated in an autonomous driving mode. The vehicle 1 has several sensors for controlling the autonomous driving operation of the vehicle 1, of which in the Fig.The radar sensors 6 and ultrasonic sensors 7 are shown. Using a monitoring system 10 of the vehicle 1, actions performed on the vehicle 1 can be evaluated by recording and analyzing environmental data in the vicinity of the vehicle 1 parked in parking space 9 and by recording and analyzing data characterizing the functional state of at least one component of the vehicle 1. After evaluation, these actions are then, if necessary, attributed to manipulations of the vehicle 1.

[0039] For example, a person tampers with the radar sensors 6 of vehicle 1, which is parked in parking space 9 in parking garage 4. For example, these radar sensors 6, located at several points on the exterior 11 of the vehicle's body, are at least partially covered with a cover that is opaque to radar radiation. To detect these tamperings with the radar sensors 6 of vehicle 1, the monitoring system 10 of vehicle 1 acquires external environmental data from the surroundings 3 of vehicle 1 using a camera 8 located inside vehicle 1 as an optical sensor unit. Furthermore, the monitoring system 10 of vehicle 1 also acquires internal data by checking the functional status of the radar sensors 6 of vehicle 1.In addition, external data can also be determined as environmental data in the environment 3 of the vehicle 1 by a surveillance camera 5 installed in parking garage 4 and made available to the monitoring system 10 of the vehicle through suitable communication.

[0040] The camera 8 located inside the vehicle 1 and / or the surveillance camera 5 installed in the parking garage 4 record environmental data, such as a suspicious person in the immediate vicinity of the vehicle 1. This assigns a value of 7 to the second index value, corresponding to a high risk level, on a scale from 0 (lowest risk level) to 10 (highest risk level). Furthermore, anomalies are detected during a test of the functionality of the vehicle 1's radar sensors 6. This also assigns a value of 8 to the first index value, corresponding to a high risk level, on a scale from 0 (lowest risk level) to 10 (highest risk level).The overall manipulation index value, calculated from the first and second index values, is weighted to represent a very high risk level. This value, for example, is assigned a value of 8.5. This manipulation index value is then compared to a predefined threshold, such as 5. If the manipulation index value exceeds this threshold (e.g., 5), as is the case with a manipulation index value of 8.5, vehicle manipulation is detected. In this case, the driver of vehicle 1 is informed of the manipulation via a suitable communication channel. Simultaneously, an audible and visual warning message is issued in vehicle 1 the next time it is started.

[0041] If a manipulation has been carried out on the parked vehicle 1 that significantly impairs the driving safety of the vehicle 1, a subsequent journey of the vehicle 1 can also be prevented.

Claims

[1] Method for operating a monitoring system (10) of a vehicle (1), characterized by , that, in order to detect manipulations on the vehicle (1), the monitoring system (10) generates a manipulation index value that depends on the functional state of at least one component (6, 7) of the vehicle (1) and on environmental data of the vehicle (1), that the manipulation index value is formed from a first index value generated during the evaluation of the functional state of at least one component (6, 7) of the vehicle (1) and from a second index value generated during the evaluation of the environmental data of the vehicle (1), that the manipulation index value is compared with an overall threshold, and that manipulation of the vehicle (1) is deemed to have occurred if the manipulation index value exceeds the overall threshold. [2] Method according to claim 1, characterized by , that an evaluation of the functional state of the at least one component (6, 7) of the vehicle (1) is carried out by comparing functional data of the at least one component (6, 7) of the vehicle (1) with functional data of the at least one component (6, 7) of the vehicle (1) collected at the beginning of the journey of the vehicle (1) and / or by comparing functional data of the at least one component (6, 7) of the vehicle (1) with reference data of other vehicles, and that an evaluation of the environmental data in the environment (3) of the vehicle (1) is carried out by evaluating the sensor data generated by at least one sensor unit (8) of the vehicle (1) and / or by evaluating the monitoring data generated by at least one external monitoring device (5). [3] Method according to claim 1 or 2, characterized by, that in the event of a manipulation of the vehicle (1) deemed to be present, a warning signal is generated and / or a message is sent to the driver of the vehicle (1) and / or a message is sent to a central office (12) and / or a journey of the vehicle (1) is prevented. [4] Method according to any one of claims 1 to 3, characterized by , that the manipulation index value is used to detect manipulations of the vehicle (1) parked at a parking location (9). [5] Method according to any one of claims 1 to 4, characterized by , that in the case of a vehicle (1) capable of being operated in an autonomous driving mode, the vehicle (1) will, in the event of an attempt to manipulate the vehicle (1) as deemed to have occurred, undertake an automatic movement process from the parking location (9) and / or, in the event of a manipulation of the vehicle (1) as deemed to have occurred, a journey of the vehicle (1) will be prevented. [6] Monitoring system (10) of a vehicle (1) in which a method according to one of claims 1 to 5 is used. [7] Vehicle (1) with at least one monitoring system (10) operated according to claim 6.

Images