Device and method for determining the admissibility of sunglasses worn by a driver of a vehicle

Abstract

In a device and method for determining the permissibility of sunglasses worn by a driver of a vehicle, at least one image depicting an area of ​​the interior is captured using an interior camera arranged in the vehicle, and image data corresponding to the image is generated. Based on the image data from the camera, sunglasses worn by the driver are detected. Furthermore, at least one optical property of the sunglasses is determined. The determined optical property is compared with a preset limit value. If the limit value is exceeded, a dangerous condition is identified.

Description

The invention relates to a device and a method for determining the permissibility of a pair of sunglasses worn by a vehicle driver of a vehicle. An interior camera arranged in the interior of a vehicle captures at least one image with an image of a region of the interior and generates image data corresponding to the image. A processing unit processes the image data and detects a pair of sunglasses worn by the vehicle operator based on the image data of the camera.Document DE 10 2019 209 950 A1 discloses a method for adjusting a display device in the interior of a vehicle. In the method, a vehicle occupant is detected: Furthermore, it is detected whether the detected vehicle occupant is wearing sunglasses.Document DE 10 2021 100 632 A1 discloses a system for outputting content to a user. The system has a display device for visually outputting the content and a detection device which is designed to detect whether the user is wearing spectacles. Further, the system includes an adjustment device for adjusting the output of the content.Document KR 2020-0145301 A discloses a method in which the luminance and color temperature of a displayed image are varied according to transmission characteristics of sun glasses. A user is allowed to easily acquire the transmission characteristics of the sunglasses by photographing the sunglasses with a smartphone camera, so that the display characteristics of the image can be varied according to the transmission characteristics of the recognized sunglasses.In road traffic, sun glasses should have a maximum tint of category 3 with a light transmittance of 8 to 18 percent, i.e. a tint of 82% to 92%. Darker tinted sunglasses do not transmit sufficient light and limit the vision of the vehicle driver too much. At night, the tint of a pair of sunglasses worn by the vehicle operator should not exceed 25%. In order to determine the transmittance of a pair of sunglasses directly, a spectrophotometer is requiredBased on the known prior art, it is an object of the invention to specify a device and a method for determining the permissibility of a pair of sunglasses worn by a vehicle driver of a vehicle.This object is achieved in each case by a device having the features of claim 1 and by a method having the features of the independent method claim. Advantageous further developments are specified in the dependent claims.The device according to claim 1 ensures that the driver's sunglasses are detected and a hazardous condition is detected if the driver is wearing sunglasses that are unsuitable for road traffic. The tint of the sunglasses can serve as the optical property, wherein the limit value then indicates the maximum permitted tint. If the maximum permissible tint is exceeded, the hazardous condition is then established.The light transmission of the sunglasses can be detected in particular with the aid of the images recorded by the interior camera. For this purpose, the processing unit can use, in particular, a neural network programmed by machine learning or, in general, a method using artificial intelligence (AI). In this case, the model of the sunglasses can be recognized and the optical property of the sunglasses relevant to the permissibility of the sunglasses can be determined by the neural network. In addition to the image data, the neural network or the AI can be supplied with information about the brightness in the vehicle as an input variable when the image is recorded with the aid of the interior camera.It is advantageous if the processing unit is designed to output an indication to the vehicle driver via an output unit of the vehicle when the limit value is exceeded. This allows the vehicle driver to be warned of the impermissibleness and / or unsuitableness of the sunglasses. The vehicle driver can then do without wearing these sunglasses and optionally set up suitable sunglasses.The processing unit can also be designed to output information to at least one assistance system of the vehicle and / or to increase at least one safety setting preset in the assistance system if the limit value is exceeded.In particular, the safety setting can be a distance set in a distance control system of the vehicle to vehicles traveling ahead and / or a level of autonomous driving of the vehicle. This can increase safety during operation of the vehicle. Alternatively or additionally, the safety setting can be a sensitivity of a lane keeping assistant of the vehicle and / or a sensitivity of a brake assistant of the vehicle. This also allows safety during operation of the vehicle to be increased. Furthermore, the safety setting can alternatively or additionally be a sensitivity of a blind spot assistant of the vehicle and / or a sensitivity of a distance warning assistant of the vehicle. This also allows safety during operation of the vehicle to be increased. In addition, the safety setting of a warning threshold or the warning distance of the Parking Distance Control (PDC) assistance system can be increased, so that a warning message is output even when the distance of the vehicle from obstacles is greater.In one development, at least two different limit values can be preset, wherein the processing unit is designed to select one of these limit values for the limit value comparison depending on the brightness in the environment and / or in the interior of the vehicle. As a result, a first limit value can be preset on the day and a second limit value can be preset during the night. As a result, the requirements for the optical property of the sunglasses relevant for the permissibility of the sunglasses can be easily adapted to the lighting conditions during the day and at night or in the dark or artificially illuminated environment of the vehicle and sunlight. Driving in a tunnel is therefore to be equalized with lighting conditions at night. In this way, different lighting conditions can be taken into account when determining the permissibility of a pair of sunglasses.It is particularly advantageous if the optical property is the tint of the sunglasses, wherein a limit value in the range of 70% to 92%, in particular in the range of 82% to 92%, tint is preset in particular in daylight in the environment of the vehicle and / or wherein a limit value in the range of 20% to 30%, for example 25%, tint is preset in particular in darkness in the environment of the vehicle. This makes it possible to determine whether the vehicle driver is wearing unsuitable or impermissible sunglasses.The processing unit can also be designed to determine the optical property of the sunglasses on the basis of the image data, in particular to determine the model of the sunglasses with the aid of a database and to determine the optical property on the basis of the model of the sunglasses and / or in particular to determine the tint on the basis of the facial regions visible through the lenses of the sunglasses, in particular on the basis of the brightness in the interior of the vehicle. Alternatively or additionally, the optical property can be determined with the aid of a neural network trained with different sun glasses and sun glasses models. This makes it possible to easily determine the permissibility of sunglasses worn by a vehicle driver of a vehicle. The database can be stored in the vehicle or provided outside the vehicle, wherein the image data are then preferably transmitted to the database via a wireless communication network and the database and / or a processing unit connected to the database determines the optical property of the sunglasses and transmits it to the processing unit of the vehicle via the wireless communication networkThe device can also comprise a sensor unit which is designed to determine the tint of the sunglasses. As a result, the optical property can be determined reliably and easily. The sensor unit can be a smartphone with a camera, wherein the vehicle driver or another occupant of the vehicle records an image of the sunglasses, as disclosed for example in the document KR 2020-0145301 A.It is furthermore advantageous if the processing unit is designed to prompt the vehicle driver, after detecting sunglasses via an output unit of the vehicle, to input the optical property of the sunglasses, in particular the tint of the sunglasses, via an input unit of the vehicle and / or to determine it with the aid of the sensor unit. As a result, the optical property of the sunglasses can be determined without great effort and very securely and correctly.The camera may be a camera integrated into the interior rearview mirror of the vehicle or integrated into the housing of the interior rearview mirror, a camera arranged above the driver and / or the passenger in the roof region and / or into the B pillar on the driver side and / or the passenger side. This allows objects to be detected which are contacted by an occupant, in particular sunglasses worn by the vehicle driver. Furthermore, it is advantageous if the field of view of the camera has a capture angle in the range from 100° to 150°, wherein the camera is preferably a monocular camera and / or an RGB-IR camera. In this way, in particular, image processing by the processing unit can take place on the basis of the recorded IR images. The use of IR images is advantageous because these images are independent of ambient light. Alternatively, the camera can also be a pure IR camera and / or a stereo camera (3D camera).The processing of the image data of the camera can take place in a computer vision system provided by the processing unit.The method having the features of the subordinate method claim has the same advantages as the claimed device. In particular, the method can be further developed with the features of the dependent claims directed to the device. The method is carried out in particular whenever the vehicle driver starts the vehicle and / or whenever the interior camera determines that a pair of sunglasses is being placed on and / or worn. This ensures that the permissibility of a pair of sunglasses is determined at least when it is worn by the vehicle driver.Exemplary embodiments of the invention are explained in more detail below with reference to the figures. Shown therein are: FIG. 1 shows a perspective schematic illustration of a cockpit of a vehicle; FIG. 2 shows a schematic illustration of an image of the interior of the vehicle recorded by an interior camera of the vehicle; and FIG. 3 is a flowchart for determining permissibility of sunglasses worn by a vehicle operator of the vehicle.FIG. 1 shows a perspective schematic illustration of a cockpit 100 of a vehicle 102. A vehicle operator 104 sits on a driver seat 106 of the vehicle 102. The cockpit 100 also includes a central information display (CID) 108, a head-up display 110 and a graphical instrument cluster 112 which are arranged in an instrument panel 114 of the vehicle 102. The aforementioned display elements 108, 110, 112 each form a functional unit of an output unit of the vehicle 102, which is designed to output information to the vehicle driver 104 and / or to a further occupant 206 (cf. FIG. 2 ). At least one loudspeaker 116 of an entertainment system of the vehicle 102 is likewise arranged in the cockpit 100. The loudspeaker 116 also forms a functional unit of the output unit. The functional units of the output unit also serve as a reproduction unit for audio and / or video reproduction.The cockpit 100 further comprises a steering wheel 118 with operating elements 120, a gear selector 122, a pedal mechanism 124, and an input unit 126 with a turning wheel and a pushbutton function and / or a touch input panel. This input unit 126 is also referred to as an Ergo Commander.In the upper region of a front window 128 of the vehicle 102, an interior rearview mirror 132 and an interior camera 134 integrated into this interior rearview mirror 132 are arranged. The camera 134 is configured and integrated into the rearview mirror 132 such that it captures images with an image of at least one region of the interior of the vehicle 102. Specifically, the field of view of the camera 134 is directed toward the driver seat 106 and a passenger seat 202 of the vehicle 102.An exemplary image 200 captured using the camera 134 is shown in FIG. 2. The camera 134 is in particular configured to capture a plurality of images following one another in time, in particular in the form of a video stream, to generate image data corresponding to the images 200 and to transmit said image data to a control unit 138 serving as a processing unit.The control unit 138 has data outputs 140 and data inputs 142 which are used for connection to further units of the vehicle 102, for example to further cameras, sensors, input and output units and control units of assistance systems.The control unit 138 further comprises a communication module 144 which is designed to establish a connection to a telecommunication network, in particular a mobile radio network.Further cameras are disposed in the interior of the vehicle 102 in the B-pillars and above the vehicle driver 104 and the passenger. With the aid of the camera 134 and the further interior cameras, a plurality of images can be recorded one after the other, preferably as an image sequence or video sequence, and corresponding image data can be generated for each image, which image data are transmitted to the control unit 138 and processed by the latter.FIG. 2 shows a schematic illustration of an image 200 of the interior of the vehicle 102 recorded by the interior camera 134. The camera 134 has a field of view of 120 degrees, purely by way of example. It is particularly advantageous if the camera 134 is an RGB-IR interior camera. In other embodiments, camera 134 may also have a field of view in the range of 100 degrees to 150 degrees or more. The camera 134 is oriented toward the driver seat 106, a passenger seat 202, and a rear seat bank 204 of the vehicle 102. In other embodiments, the camera may also be a pure IR camera and / or a stereo camera (3D camera).In the situation shown in FIG. 2, the vehicle driver 104 sits on the driver seat 106 and the further occupant 206 sits on the passenger seat 202. Thus, in the present embodiment, the further occupant is passenger 206. The passenger 206 has a tablet computer in his hands. The vehicle driver 104 wears sunglasses 210 and fitness bracelet 212 and earphones 214.FIG. 3 shows a flow chart for determining the permissibility of a pair of sunglasses 210 worn by a vehicle operator 104 of the vehicle 102. In step S 100, the process starts. Subsequently, in step S 102, it is determined, based on the image data of the camera 134, whether the vehicle driver 104 is wearing a pair of sunglasses 210. If this is not the case, then the method branches to step S 112 in step S 104 and the process ends.Otherwise, the process continues in step S 106, in which an optical property of the detected sunglasses 210 is determined. Subsequently, in step S 108, it is checked whether the determined optical property of the sunglasses 210 exceeds a preset limit value GW. If this is not the case, the system branches to step S 112 and the process ends.Otherwise, a danger condition is then determined in step S 110 and the process is ended in step S 112. When the hazardous state is ascertained in step S 110, a corresponding warning message can be output to vehicle driver 104, for example. Alternatively or additionally, a safety setting of an assistance system of the vehicle 102 may be increased.The limit value GW may be changed depending on the brightness in the vicinity of the vehicle 102 and / or in the interior of the vehicle. In particular, a first limit value GW can be used in the case of a bright environment and a second limit value GW in the case of a dark environment.In the exemplary embodiments described with reference to FIGS. 1 to 3, at least the camera 134 and the control unit 138 form a device for determining the permissibility of a pair of sunglasses 210 worn by a vehicle driver 104 of a vehicle 102. The control unit 138 is also referred to as a processing unit. Further elements and features shown in FIGS. 1 to 3 and mentioned in the preceding description can be part of the device for determining the permissibility of a pair of sunglasses 210 worn by a vehicle driver 104 of a vehicle 102. Method steps described with reference to the device can likewise be part of the claimed method.List of reference characters100 Cockpit 102 Vehicle 104 Vehicle driver 106 Driver seat 108 Central information display 110 Head-up display 112 Graphical instrument cluster 114 Dashboard 116 Loudspeaker 118 Steering wheel 120 Operating element 122 Gear selector 124 Pedal console 126 Input unit 128 Front window 130 Microphone 132 Interior rearview mirror 134 Interior camera 136 Emergency call bracelet 138 Control unit 140 Data output 142 Data input 144 Communication interface 200 Image 202 Passenger seat 204 Rear seat bank 206 Passenger 208 Tablet computer 210 Sunglasses 212 Fitness bracelet 214 Earphones S100-S110 Method stepsReferences included in the specificationThis list of documents cited by the applicant has been produced in an automated manner and is only included for the better information of the reader. The list is not part of the German patent application or utility model application. The DPMA does not take any adhesion for any faults or omissions.Patent Literature citedDE 10 2019 950 A1

[0002] DE 10 2021 100 632 A1

[0003] KR 2020-0145301 A [0004, 0016]

Claims

Device for determining the permissibility of a pair of sunglasses worn by a vehicle driver of a vehicle, having an interior camera (134) arranged in the interior of a vehicle (102), which is designed to capture at least one image (200) with an image of a region of the interior and to generate image data corresponding to the image (200), having a processing unit (138) which is designed to process the image data, wherein the processing unit (138) is designed to detect pair of sunglasses (210) worn by the vehicle driver (104) on the basis of the image data of the camera (134), wherein the processing unit (138) is designed to determine at least one optical property of the pair of sunglasses (210), wherein the processing unit (138) is designed to compare the determined optical property with a preset limit value, and wherein the processing unit (138) is designed to determine the optical property determined, if the limit value is exceeded, a danger condition is determined.Device according to Claim 1, characterized in that the processing unit (138) is designed to output an indication to the vehicle driver (104) via an output unit (108-120, 116) of the vehicle (102) if the limit value is exceeded.Device according to one of the preceding claims, characterized in that the processing unit (138) is designed to output information to at least one assistance system of the vehicle (102) if the limit value is exceeded, to increase at least one safety setting preset in the assistance system.Device according to Claim 3, characterized in that the safety setting is a distance set in a distance control system of the vehicle (102) to vehicles traveling ahead.The device according to claim 3 or 4, characterized in that the safety setting is a stage of autonomous driving of the vehicle (102).Device according to one of the preceding Claims 3 to 5, characterized in that the safety setting is a sensitivity of a lane keeping assistant of the vehicle (102).Device according to one of the preceding claims 3 to 6, characterized in that the safety setting is a sensitivity of a brake assistant of the vehicle (102).Device according to one of the preceding claims 3 to 7, characterized in that the safety setting is a sensitivity of a blind spot assistant of the vehicle (102).Device according to one of the preceding claims 3 to 8, characterized in that the safety setting is a sensitivity of a distance warning assistant of the vehicle (102).Device according to one of the preceding claims, characterized in that at least two different limit values are preset, wherein the processing unit (138) is designed to select one of these limit values for the limit value comparison as a function of the brightness in the environment and / or in the interior of the vehicle (102).Device according to one of the preceding claims, characterized in that the optical property is the tint of the sunglasses (210), wherein in particular in daylight in the environment of the vehicle (102) a limit value in the range of 70% to 80% tint is preset and / or wherein in particular in darkness in the environment of the vehicle (102) a limit value in the range of 20% to 25% tint is preset.Device according to one of the preceding claims, characterized in that the processing unit is designed to determine the optical property of the sunglasses (210) on the basis of the image data, in particular to determine the model of the sunglasses (210) with the aid of a database and to determine the optical property on the basis of the model of the sunglasses (210) and / or in particular to determine the tint on the basis of the facial regions visible through the lenses of the sunglasses (210).Device according to one of the preceding claims, characterized in that the device comprises a sensor unit which is designed to determine the tint of the sunglasses (210).Device according to one of the preceding claims, characterized in that the processing unit is designed to prompt the vehicle driver (104), after detection of sunglasses (210) via an output unit (108-112, 116) of the vehicle (102), to input the optical property of the sunglasses (210), in particular the tint of the sunglasses (210), via an input unit (126, 130) of the vehicle (102) and / or to determine it with the aid of the sensor unit.Method for determining the permissibility of a pair of sunglasses worn by a vehicle driver of a vehicle, in which at least one image (200) with an image of a region of the interior is captured with the aid of an interior camera (134) arranged in the interior of a vehicle (102), and image data corresponding to the image (200) is generated, in which a pair of sunglasses (210) worn by the vehicle driver (104) is detected on the basis of the image data of the camera (134), in which at least one optical property of the pair of sunglasses (210) is determined, in which the determined optical property is compared with a preset limit value, and in which a danger state is determined if the limit value is exceeded.

Images