Methods for detecting a smoking event in a vehicle interior, as well as a tobacco smoking detection system

Abstract

Method for assessing the usage behavior of a user (4) in an interior (2) of a vehicle (1), in which the interior (2) is monitored with at least one detector with respect to a smoker indicator that characterizes tobacco smoking in the interior (2), characterized in that the interior (2) is monitored with respect to a tobacco ember (11) as a smoker indicator using at least one camera (6, 7), and a detected tobacco ember (11) is taken into account by an assessment system (16) when assessing whether tobacco smoking is taking place in the interior (2), wherein a local position of the image area in the thermal image and / or the size of the image area are taken into account for the assessment of whether a tobacco ember (11) is present.

Description

[0001] The invention relates to a method for assessing a user's usage behavior in the interior of a vehicle, in which the interior is monitored with at least one detector with respect to a smoke indicator that characterizes tobacco smoking in the interior.

[0002] German patent application DE 10 2018 130 589 A1 discloses a system and method for smoke detection and reporting in a vehicle used for car sharing and ride-sharing. The smoke detection system comprises a detection module and a reporting module. While the vehicle is being used as part of a car sharing or ride-sharing service, the detection module receives a sensor signal from a smoke detector, compares the data contained in the sensor signal with smoke detection data or smoke pattern data, and generates an alarm signal based on whether an occupant of the vehicle is smoking. The reporting module then warns the occupant, either visually or audibly, to stop smoking based on the alarm signal. The alarm signal is also transmitted to a mobile device belonging to the occupant to indicate that a smoke event has been detected, or it is transmitted to a multi-purpose device of a service provider to report the smoke event.It is also possible that the smoke detector may have at least one camera used to detect smoke. It may also be able to recognize patterns of typical smoking paraphernalia, such as a cigarette, a cigar, or a pipe.

[0003] The disadvantage of current technology is that smoke detection relies solely on smoke detection. This means that a smoke event cannot be reliably distinguished from another type of smoke event, such as a fire in the vehicle, which could lead to an unintended warning to the occupant. Similarly, at cold temperatures, a user's breath might freeze inside the vehicle, creating a mist in front of their mouth. This mist would be incorrectly identified as smoke from a smoking device under current technology. Furthermore, smoke can appear in a variety of forms, depending on airflow. For example, with open windows, the airflow might disperse the smoke to such an extent that it is no longer perceptible.Smoke as an indicator of smoking is therefore disadvantageous in many ways and inaccurate.

[0004] The invention is based on the objective of creating a method and a tobacco smoking detection system with which tobacco smoking in the interior of a vehicle can be detected more reliably.

[0005] The problem is solved by a method and a tobacco smoking detection system according to the independent claims. Advantageous embodiments of the invention are described by the dependent claims, the following description, and the figures.

[0006] One aspect of the invention relates to a method for assessing a user's behavior in the interior of a vehicle, in which the interior is monitored by at least one detector for a smoking indicator that characterizes tobacco smoking in the interior. The interior is monitored by at least one camera for a tobacco ember as a smoking indicator. A detected tobacco ember is taken into account by an assessment system when determining whether tobacco smoking is occurring in the interior. This improves the detection of tobacco smoking in the interior, as the tobacco ember is a significantly more definitive indicator of tobacco smoking than smoke itself. It can be easily detected by a thermal imaging camera, thus enabling reliable detection of the tobacco ember. The tobacco ember is very distinctive in its characteristic features, both in size and shape.The appearance of a tobacco ember is relatively independent of environmental influences such as airflow. It therefore serves as a smoking indicator, allowing for a more precise assessment of whether or not tobacco is being smoked inside the vehicle. Since a camera provides an easily evaluable image regardless of the time of day, the tobacco ember can be reliably detected even under a wide range of environmental conditions within the vehicle, including weather, light exposure, and / or interior lighting.

[0007] This is especially true for a thermal imaging camera. It can detect a real tobacco ember, which has a specific temperature that can be easily and reliably identified in a thermal image.

[0008] The method therefore searches specifically for a localized cluster of embers, particularly in a thermal image. This can be identified very clearly because its shape, even in comparison to other objects in the thermal image, makes it easy to recognize and distinguish.

[0009] In an electronic cigarette, the tobacco ember is optically symbolized by a light source. This creates the illusion of a cold tobacco ember. The process also seeks to replicate this in an advantageous form.

[0010] In particular, the procedure can also better comply with legal regulations regarding a smoking ban in vehicles in specific states.

[0011] Another advantage is that the assessment of whether tobacco smoking is present in the vehicle's interior is based on an optical measurement using a thermal imaging camera, allowing the tobacco embers to be detected. By directly detecting the source of the tobacco smoke as the primary indicator of smoking, rather than detecting the smoke itself as a secondary indicator, the cause can be identified more clearly, since smoke can have various causes that cannot be distinguished by simply detecting the smoke.

[0012] For example, detection can be achieved using a single thermal imaging camera positioned inside the vehicle, such as centrally on the headliner. This camera monitors the interior. Based on the temperature difference between the tobacco ember and the ambient temperature, the system can determine whether tobacco smoking is occurring inside the vehicle. The thermal imaging camera captures an image composed of multiple individual pixels, each containing color information that allows for inferences about the temperature. Monitoring the vehicle interior with the thermal imaging camera can be performed both when the vehicle is stationary and while it is in operation. Sensors can detect whether a user is present in the vehicle by measuring their weight and determining if they are seated.When detecting tobacco smoking, the thermal imaging camera can also capture the user's behavior, such as the lighting of a cigarette, which follows a specific pattern and can therefore be interpreted as the start of tobacco smoking by comparison with the smoking indicator. Furthermore, the user's movement patterns can also be used as a smoking indicator, as the thermal imaging camera detects the embers of a cigarette and the characteristic movement of bringing the tobacco product, such as a cigarette, to the mouth can be recognized by comparison with the smoking indicator.

[0013] Preferably, a reference temperature is specified for a tobacco ember, and the tobacco ember is detected when the thermal imaging camera detects an area of ​​the image corresponding to a temperature greater than or equal to the reference temperature. This allows for reliable detection of the tobacco ember. The temperatures of tobacco embers in cigarettes, cigars, pipes, etc., are known. By specifying such known temperatures as reference temperatures, a tobacco ember can be detected by simple comparison in the thermal image.

[0014] Since a thermal image uses colors to signal different temperature zones, the detection of a tobacco ember is possible with high precision when a specific reference temperature is given. For example, the color distribution in the thermal image can be analyzed for this purpose. A specific temperature range can also be defined as the reference temperature. Based on this color information, the temperature, or at least a reference temperature, can be inferred for each pixel. If the captured image contains several such pixels with color information or temperatures, image processing techniques can be used to analyze the image and determine, for example, a minimum and a maximum temperature. Furthermore, a temperature gradient between a pixel and its neighbor can be calculated, allowing for the determination of a maximum temperature gradient.This maximum temperature gradient can be compared with the smoker indicator. The reference temperature or the temperature gradient of the tobacco ember can be defined as a threshold value, so that as soon as one or more pixels exceed the temperature, or the temperature calculated from the color information, tobacco smoking is detected. The temperature determined by the thermal imaging camera can be equal to or greater than the reference temperature, allowing the assessment system to detect the tobacco ember.

[0015] Preferably, a smoke detector is used as an additional detector to monitor the interior space for smoke generated by a burning tobacco ember, acting as a smoking indicator. Any detected smoke is then taken into account by the assessment system when determining whether tobacco smoking is occurring in the interior. This provides a secondary smoking indicator—the smoke itself—in addition to the primary indicator, the burning tobacco ember, and considers it when assessing whether tobacco smoking is taking place. This allows for a more precise assessment of whether tobacco smoking is occurring.

[0016] This also allows for improved detection of whether, for example, only a lighter is activated, thus producing a flame, and no tobacco smoking is taking place. It also allows for improved detection of whether only vapor is present and no tobacco smoke is emitted.

[0017] The smoke detector can be mounted in a central position on the roof lining or on a window of the vehicle. It can detect tobacco smoke even with an open window.

[0018] If both a tobacco ember and smoke are present as indicators of smoking, an advantageous embodiment allows for the evaluation of the relative locations of these smoke indicators. This can be done by the assessment system. This spatial correlation allows for a more accurate assessment of whether tobacco smoking is occurring. In particular, if the source of the smoke is identified as being adjacent to or directly adjacent to the detected tobacco ember, the event can be classified as tobacco smoking with a higher probability.

[0019] Preferably, recorded smoking indicators can be weighted by the assessment system.

[0020] Preferably, a camera sensitive in the visible spectrum is used as an additional detector to capture images of the interior space. These images are preferably evaluated with regard to smoking paraphernalia. The captured smoking paraphernalia is preferably taken into account by the assessment system when determining whether tobacco smoking is occurring in the interior space. This further refines the assessment of tobacco smoking. A smoking paraphernalia can be a physical component, such as a cigarette, cigar, or pipe. It can also be an electronic cigarette, in which a tobacco ember is symbolized by a light source. This, too, can be detected.

[0021] In an advantageous embodiment, the type of smoking utensil is evaluated by the assessment system. Based on this, the system then knows whether the tobacco ember in the identified smoking utensil is hot or cold. It can then specifically search for a hot tobacco ember, for example, in a thermal image. Alternatively, it can specifically search for a local "cold" light-emitting light source. This can be achieved, for example, by image analysis in at least one image from a camera that is sensitive in the visible spectral range.

[0022] Preferably, the absolute and / or relative positions of the thermal imaging camera and / or the camera sensitive in the visible spectral range, and / or the smoke detector in the interior are known. These positions are known to the assessment system. This also allows the assessment system to correlate the information from these specific sensors. In particular, this enables the determination of spatial relationships between the detected information. This allows for a more precise assessment of tobacco smoking based on the spatial positions of a tobacco ember and / or smoke and / or a smoking paraphernalia, both absolutely and / or relative to the other indicators.

[0023] The advantage is that the camera, as an additional detector, provides further information for the assessment system to detect a smoke event, and thus, in the case of, for example, contradictory information from both the smoke detector and the thermal imaging camera, an additional source of information is available to the assessment system for recording a smoke event.

[0024] The use of a camera sensitive in the visible spectrum enables the evaluation and monitoring of the vehicle interior using images. The camera's captured images can be analyzed using image processing algorithms to identify geometric objects, particularly elongated objects such as the shape of a cigarette or cigar. The analysis of the captured images can also include an assessment of whether the detected geometric object moves within the vehicle interior over time. If movement of a geometrically elongated object is detected, it can be assumed that tobacco smoking is taking place, as the movement of a smoker with their smoking paraphernalia exhibits a typical behavioral pattern.The camera, which is sensitive in the visible spectral range, can be used in combination with the thermal imaging camera and / or the smoke detector. The sensor data can then be sent to the assessment system and evaluated based on smoke indicators, for example, by weighting these indicators, to determine whether a smoke event has occurred.

[0025] Preferably, a detector is used to monitor the interior for a person. In particular, tampering with the assessment system is detected if the image from the vehicle's thermal imaging camera does not contain an area corresponding to human body temperature. It can be provided that, if tampering is detected, the vehicle's movement is automatically stopped. Specifically, the drive unit can be switched off. Depending on the current traffic situation and / or the vehicle's current state of motion, this shutdown can be delayed, in particular until the vehicle can be safely braked and moved to a safe parking location.

[0026] This means that the thermal imaging camera installed in the vehicle's interior is used to ensure the effective functioning of the assessment system. The images captured by the thermal imaging camera are evaluated by the assessment system to determine whether a temperature range corresponding to human body temperature can be located within the images. The size of this area within the image is also preferably evaluated. If a smoke detector is detected, but no person is found inside the vehicle, it can be concluded that a detector has been manipulated to prevent it from detecting smoking. In this context, at least one image from at least one camera can be evaluated. If the camera is manipulated, for example, if its lens is covered or taped over, it will only capture a very uniform, dark image.This too can be detected through image processing. It can then also be used to conclude that manipulation has occurred.

[0027] It may be preferable to store information from at least one detector and / or the information from the assessment system in a data unit located externally to the vehicle, in particular in a data cloud. This allows the information to be made available for analysis elsewhere as well.

[0028] It may be provided that the information obtained by at least one detector and / or the information of the assessment system, which includes an assessment, is stored on a storage unit located external to the vehicle, in particular in a cloud.

[0029] This offers the advantage that the evaluation of the information recorded by the sensors or detectors can also be carried out by an assessment system external to the vehicle. Furthermore, direct transmission to the external data unit prevents subsequent manipulation of the detector data and / or the information from the assessment system.

[0030] The aforementioned transfer of information to the external data unit, in particular a cloud, can be provided by using a suitable communication module, which can be installed in the vehicle. The information can be transmitted, for example, via the mobile network.

[0031] Preferably, it is proposed that, depending on the detection of tobacco smoking in the interior, information on the health risks of smoking and / or information on legal regulations concerning tobacco smoking is generated and displayed in the vehicle interior.

[0032] This has the advantage that the driver or passenger can be warned about behavior that is harmful to health and / or illegal.

[0033] If tobacco smoking is detected inside the vehicle, informational messages can be displayed both audibly and visually. For example, a separate display or an existing display in the vehicle can be used for visualization. An audible alert can be a beep or a voice announcement. A combination of audible and visual alerts is also possible.

[0034] It may be provided that the misconduct information is retrieved, in particular automatically, by an electronic penalty system, and in particular that an electronic penalty notice is automatically generated by the penalty system and transmitted to the vehicle owner.

[0035] In other words, the data stored by the assessment system can be used on the external storage unit, especially the cloud, so that the fine system can retrieve the data and automatically generate the fine notice based on the stored assessments and arrange for its dispatch to the vehicle owner.

[0036] This offers the advantage that, if the legal situation prohibits smoking, or tobacco smoking, in the interior of the vehicle, it is automatically possible to initiate the penalty notice with minimal administrative effort or even without any administrative effort.

[0037] The provision of behavioral information can be achieved by the assessment system saving assessments on the external storage unit, preferably in the cloud of the fines office, so that the fines office automatically has access to the collected data and can thus initiate the electronic fine notice.

[0038] Another aspect concerns a tobacco smoking detection system for a vehicle, with which tobacco smoking in the interior of a vehicle can be assessed, wherein the tobacco smoking detection system has at least one camera designed to monitor the interior for a tobacco ember as a smoking indicator, and an electronic assessment system designed to take a detected tobacco ember into account when assessing whether tobacco smoking is taking place in the interior.

[0039] The invention also includes combinations of the features of the described embodiments.

[0040] Another aspect also concerns a vehicle that can perform at least partial steps of the procedure and / or has at least partial components of the tobacco smoking detection system.

[0041] The following describes exemplary embodiments of the invention. This is illustrated by: Fig. 1 a schematic representation of a top view of an embodiment of a tobacco smoking detection system; and Fig. 2 a schematic representation of a side view of an embodiment of a vehicle, wherein a method for assessing a user's usage behavior in the interior of a vehicle is explained using the vehicle.

[0042] The embodiment described below is a preferred embodiment of the invention. In this embodiment, the described components each represent individual features of the invention that can be considered independently of one another. Each of these features further develops the invention independently and can therefore be considered part of the invention individually or in a combination other than that shown. Furthermore, the described embodiment can also be supplemented by other features of the invention already described.

[0043] In the figures, identical reference symbols denote functionally equivalent elements.

[0044] In Fig. Figure 1 is a vehicle in a schematic top view. 1 shown. The vehicle 1 It could be, for example, a passenger car. It can be designed to transport passengers. The vehicle 1features an interior 2 open. The interior 2 It can also be referred to as the passenger compartment. Inside the vehicle 2 The vehicle is specifically designed with seating for passengers. This could be, for example, a driver's seat and a passenger seat. 1 However, in an advantageous design, it can also, for example, have a rear compartment. Seats can be installed in this compartment. For example, a rear bench seat can be located here. 13 These rear seats, or rather the back bench, are intended to be used. 13 Can an Isofix mount 3 This is intended for use with, for example, a child seat on the back seat. 13 They can be secured. This allows even small children to be transported. Older children can travel without an additional seat, for example on the back seat. 13 Take a seat. Is there an Isofix mount? 3If activated, the system can also detect if a child is in a child seat. This is relevant, for example, if smoking is prohibited in a vehicle in certain countries. Depending on such a detection, measures such as alerting an adult in the vehicle and / or notifying a traffic violation authority can then be initiated.

[0045] For example, in Fig. 1. A passenger is shown. This passenger, who is also a user 4 In the exemplary embodiment, it can be described as being positioned on the driver's seat.

[0046] The vehicle 1 In an advantageous embodiment, it features at least one camera as a detector. This camera is used to capture the interior. 2 trained. The camera is preferably part of a vehicle camera system. 1In an advantageous embodiment, this camera system comprises at least one first camera, which is a thermal imaging camera. 6 This thermal imaging camera 6 In an advantageous embodiment, this can be done on a roof liner. 14 ( Fig. 2) of the vehicle 1 be arranged. In particular, the thermal imaging camera 6 centrally located on the headliner 14 They can be arranged. Multiple thermal imaging cameras can also be installed indoors. 2 be arranged.

[0047] In an advantageous embodiment, it is provided that the vehicle 1 at least one more camera 7 features this additional camera 7 is a thermal imaging camera 6 Different camera. The camera 7 It is sensitive in the spectral range visible to humans. The camera 7 is preferably part of the camera system. At least one additional camera. 7can be installed in an advantageous design on the headliner 14 It can be arranged in a specific way. It is also possible to have several separate cameras. 7 inside 2 are arranged. The camera 7 It can also be advantageously positioned centrally on the headliner. 14 be arranged. The camera 7 It can be designed specifically as a wide-angle camera. It can be a fisheye camera.

[0048] In particular, a specific living being, such as a child in the vehicle 1 , also through the thermal imaging camera 6 and / or the camera 7 This can be determined, for example, by the size of the creature and / or the position of its limbs, such as a leg and / or a foot. In particular, this allows for better identification of babies and / or toddlers.

[0049] In an advantageous embodiment, the vehicle features 1 a smoke detector 5 as an additional detector. The smoke detector 5 is a thermal imaging camera 6 and to the camera 7 separate detector.

[0050] Especially the thermal imaging camera 6 and / or the camera 7 and / or the smoke detector 5 are part of an electronic tobacco smoking reporting system 15 A tobacco smoking reporting system 15 is trained to prevent tobacco smoking in the interior 2 of the vehicle 1 to recognize.

[0051] The tobacco smoking reporting system 15 can be fully integrated into the vehicle with its components 1 be arranged. In another embodiment, however, it may also be provided that subcomponents of the tobacco smoking detection system 15 external to the vehicle 1 are arranged.

[0052] Preferably, the tobacco smoking detection system features 15 an assessment system 16 on. This assessment system 16 can an evaluation unit 17 exhibit. The evaluation unit 17 is specifically intended to provide information from the thermal imaging camera 6 and / or the camera 7 and / or the smoke detector 5 to evaluate and, depending on that, allow tobacco smoking indoors 2 to recognize the evaluation unit 17 can in the vehicle 1 It can be arranged externally to the vehicle. 1 It can be arranged, for example, as part of a cloud. 8 , as they are in Fig. 1 is symbolically indicated. Such a design allows for evaluation to be performed externally to the vehicle. 1 This will take place. For communication with the cloud. 8 can the vehicle 1 a telematics unit that is not shown.

[0053] It may also be provided that the vehicle 1 a display unit 9 features the display unit 9 It could be, for example, an electronic display.

[0054] With the tobacco smoking reporting system 15 Is it possible to develop a procedure for assessing a user's usage behavior? 4 in the interior 2 of the vehicle 1 to be carried out. In this process, the interior 2 with at least one detector regarding a smoke indicator that detects tobacco smoking indoors 2 characterized, monitored. At least one detector can be used with the thermal imaging camera. 6 and / or the smoke detector 5 and / or the camera 7 be.

[0055] It may be provided that at least one smoke detector is installed. 5 on the headliner 14It is arranged. It can be positioned centrally. It is also possible to have several smoke detectors. 5 inside 2 are arranged.

[0056] It may also be provided that a smoke detector is installed. 5 in the area of ​​the driver's seat and / or a smoke detector 5 in the area of ​​the passenger seat and / or at least a smoke detector 5 It is located in the front area where the rear seats are situated. At least one smoke detector is required. 5 It can also be located, for example, next to a side window of the vehicle. 1 It should be arranged in such a way that such a window can be opened and closed.

[0057] In Fig. Figure 2 is a schematic representation of the vehicle. 1 shown in a side view. It can be seen here that the user 4carries a smoking paraphernalia. This smoking paraphernalia is also activated. This means that the smoking paraphernalia is being used to smoke tobacco. The smoking paraphernalia 12 This could be, for example, a cigarette, an electronic cigarette, a cigar, a pipe, or the like. Such smoking paraphernalia usually have... 12 Smoking exhibits specific characteristics. This is particularly evident in the tobacco embers. 11 The tobacco ember 11 In a cigarette, pipe, or cigar, the actual smoldering tobacco is used. In an electronic cigarette, a light source, such as a light-emitting diode (LED), is typically used to visually simulate this kind of tobacco glow.

[0058] An interior 2 of the vehicle 1 In particular, the camera system will be used at least with regard to the tobacco embers. 11 It is monitored as a smoke indicator. If such a tobacco ember is detected, it is monitored. 11This information is recorded and used in the assessment of whether the interior 2 tobacco smoking occurs, according to the assessment system. 16 taken into account.

[0059] It is intended that a real tobacco ember will be used. 11 of smoldering tobacco, especially with at least one thermal imaging camera 6 is detected. Such a thermal imaging camera 6 It generates a thermal image which, with regard to heat distribution in the interior, 2 This can be evaluated. This is done in particular through the assessment system. 16 It may be provided that the assessment system 16 It not only performs a corresponding heat analysis of the thermal image. In an advantageous embodiment, the local position of this heat area within the thermal image, which corresponds to such a tobacco ember, can also be taken into account. 11characterized. Additionally or instead, in an advantageous embodiment, the size of this specifically temperature-controlled area in the thermal image can also be taken into account for the assessment, in order to make an even more precise statement as to whether the detected heat zone actually represents a tobacco ember. 11 This can be achieved, for example, by advantageously incorporating reference values ​​into the assessment system. 16 It should be stored. Therefore, a better assessment can be made by comparing the size and / or position of the supposed tobacco ember in the thermal image with these reference sizes.

[0060] In an advantageous embodiment, it is provided that a real tobacco ember is used. 11 As occurs with a cigarette, cigar, or pipe, a reference temperature is specified. This can be included in the assessment system. 16be stored. Such a reference temperature is characteristic and common for temperatures such as those found in real tobacco gluten. 11 This means that the assessment can also take into account the temperature of the supposed tobacco ember as characterized in the thermal image. 11 is compared with this reference temperature and, depending on this, the assessment of whether such a real tobacco ember exists 11 was recorded, will take place.

[0061] In an advantageous embodiment, the camera in particular 7 The evaluation was carried out to determine whether a symbolic tobacco ember, as is common with electronic cigarettes, was present. Since such a symbolic tobacco ember does not exhibit the same heat as a real tobacco ember, this was not considered. 11 If present, it can be detected with a thermal imaging camera 6 They are practically undetectable. This also applies to such smoking paraphernalia. 12To enable the detection of smoking based on the tobacco embers, this is possible with the camera. 7 This allows for a corresponding image analysis of this symbolized tobacco ember.

[0062] In all exemplary embodiments, a further advantageous procedure may provide that, in particular depending on at least one image from the camera, 7 including the smoking utensil 12 It is recognized automatically. This can be determined based on specific geometries and positions. Since the shape of a cigarette, a pipe, a cigar, and an electronic cigarette is known, these geometries can, in turn, serve as reference geometries in the assessment system. 16 The images must be stored. This allows for appropriate image analysis of at least one image from the camera. 7 including the specific physical smoking utensil 12can be identified and analyzed. This information can be used to advantageously supplement the specific tobacco ember. 11 the unambiguous statement regarding tobacco smoking indoors 2 increased. In particular, the assessment system can be used in this context. 16 also a local attribution between the supposed tobacco ember 11 and the smoking utensil 12 These measurements must be taken. If these parameters are directly adjacent, this indicates the presence of an actual tobacco ember. 11 there.

[0063] In an advantageous embodiment, in addition to assessing the tobacco embers, 11 a smoke 10 be detected. This smoke detection is also carried out. 10 can also be used to assess whether tobacco smoking is permitted indoors 2 take place, be used. The smoke 10 is especially used with the smoke detector 5detected. Additionally or instead, it may also be provided that at least one image from the camera is evaluated. 7 such smoke 10 is detected. In particular, a comparison with stored smoke patterns can also be made in this context. Additionally or instead of this, it can also be provided that the local position of the smoke is determined. 10 , especially regarding the supposed tobacco ember 11 , is analyzed. Is there an immediate proximity here between the beginning of the smoke and the tobacco ember? 11 If detected, there is an even higher probability of a smoke incident indoors. 2 close.

[0064] In a further advantageous embodiment, it is provided that the assessment system 16 It is also equipped for tamper detection of the camera system. Likewise, it can be used additionally or instead for tamper detection of the smoke detector. 5 planned.

[0065] In particular, it can be determined in this context whether the smoke detector 5 for example, it is taped over and / or the camera 7 for example, it is taped over and / or the thermal imaging camera 6 For example, it might be covered with tape. This can be achieved, for instance, by creating a thermal image that shows a nearly homogeneous temperature distribution across the entire surface. Such a scenario occurs during vehicle operation. 1 just as unlikely as a completely dark, especially black, image from the camera. 7 These are indications that the respective detector has been manipulated with regard to its detection behavior.

[0066] In an advantageous embodiment, the assessment system is provided for 16 has a manipulation detection function such that the thermal imaging camera 6The analysis focuses on the presence of a human body. Since a human body exhibits a typical heat distribution, this distribution can be searched for in a thermal image. If no such distribution is present, this information can at least be used to infer manipulation.

[0067] Preferably, it is provided that if tobacco smoking is permitted indoors 2 was identified as requiring information on the health risks of smoking and / or information regarding legal regulations on tobacco smoking indoors. 2 is generated and in the interior 2 This can be output, for example, by a voice signal and / or by a display on the display unit. 9 take place.

[0068] It may also be stipulated that the assessment system 16It is designed for the time-based cascaded monitoring of user behavior. For example, if a smoke incident occurs in the interior... 2 detected and, within a specified time interval, following this detection and the issuance of at least one piece of information, a further smoking incident concerning tobacco smoking indoors 2 If smoking is detected, a second stage of action can be taken. This could involve, for example, issuing further, possibly more explicit, information. Additionally or instead, information, particularly regarding the smoking incident, can then be automatically forwarded to an external agency. This could, for example, be a fine collection agency. 18 be. The fines office 18In a more convenient version, it can then automatically generate a penalty notice. This penalty notice can be sent electronically to the vehicle owner. 1 will be sent. In particular, if the smoking is still present after a defined period of time, the information will include characteristic details such as the vehicle registration number, vehicle identification number, date, time, and GPS position of the vehicle. 1 a message to the cloud 8 and then to the fines office 18 transmitted. In particular, this is done via the vehicle's telematics unit. 1 .

[0069] Especially when information about a detected smoke incident in the vehicle 1 externally, for example in a cloud 8 It may be provided that the fines office 18 individually tailored to this cloud data 8The fines office may access this information. In particular, the fines office may 18 have an electronic fine system. Reference symbol list 1 vehicle 2 Interior 3 Isofix brackets 4 users 5 smoke detectors 6 Thermal imaging camera 7 Camera 8 Cloud 9 Display unit 10 Smoke 11 Tobacco embers 12 smoking accessories 13 Rear seat 14 Headliner 15 Tobacco Smoking Reporting System 16 Assessment system 17 evaluation units 18 Bus fine office QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] DE 102018130589 A1

[0002]

Claims

[1] Method for assessing a user’s behavior (4) in an interior (2) of a vehicle (1) in which the interior (2) is monitored with at least one detector with respect to a smoker indicator that characterizes tobacco smoking in the interior (2), characterized by , that the interior (2) is monitored with at least one camera (6, 7) with regard to a tobacco ember (11) as a smoking indicator, and a detected tobacco ember (11) is taken into account by an assessment system (16) when assessing whether tobacco smoking is taking place in the interior (2). [2] Method according to claim 1, characterized by , that a reference temperature is specified for a real tobacco ember (11), and when an image area is detected in the image of a camera designed as a thermal imaging camera (6) which corresponds to a temperature greater than or equal to the reference temperature, the tobacco ember (11) is detected. [3] Method according to claim 1 or 2, characterized by, that with a smoke detector (5) as a further detector the interior (2) is monitored with regard to smoke (10) produced by the tobacco ember (11) as a smoking indicator, and any detected smoke (10) is taken into account by the assessment system (16) when assessing whether tobacco smoking is taking place in the interior (2). [4] Method according to any one of the preceding claims, characterized by , that with a camera (7) which is sensitive in the visible spectral range, the interior (2) is recorded at least in images as a further detector, wherein the images are evaluated with regard to a smoking utensil (12), wherein the recorded smoking utensil (12) is taken into account by the evaluation system (16) when assessing whether tobacco smoking takes place in the interior (2) and / or the images are evaluated with regard to a cold and optically symbolized tobacco ember (11). [5] Method according to any one of the preceding claims, characterized by, that the interior (2) is monitored for a person by means of a detector and manipulation of the assessment system (16) is then detected if the image of a camera designed as a thermal imaging camera (6) does not contain an area corresponding to a human body temperature. [6] Method according to any one of the preceding claims, characterized by , that information from at least one detector and / or the information from the assessment system (16) is stored in a data unit arranged externally to the vehicle (1), in particular in a cloud (8). [7] Method according to any one of the preceding claims, characterized by , that depending on the detection of tobacco smoking in the interior (2) information on the health of smoking and / or information on legislation relating to tobacco smoking is generated and displayed in the vehicle interior. [8] Method according to claim 7, characterized by, that the user’s behavior (4) is monitored after the transmission of at least one informational notice and, in the event of continued tobacco smoking, misconduct information is transmitted by the assessment system (16) to an external entity, in particular a cloud (8). [9] Method according to claim 8, characterized by , that the misconduct information is retrieved, in particular automatically, from an electronic fine system (18), in particular that an electronic fine notice is automatically generated by the fine system (18) and transmitted to the owner of the vehicle (1). [10] Tobacco smoking detection system (15) for a vehicle (1) with which tobacco smoking in an interior (2) of the vehicle (1) can be assessed, wherein the tobacco smoking detection system (15) has at least one camera (6, 7) which is designed to monitor the interior (2) with respect to a tobacco ember (11) as a smoking indicator, and has an electronic assessment system (16) which is designed to take into account a detected tobacco ember (11) when assessing whether tobacco smoking is taking place in the interior (2).

Images