Method for operating an interior camera of a vehicle

Abstract

The invention relates to a method for operating an interior camera of a vehicle, wherein at least image data of an occupant located in the detection range of the interior camera of the vehicle are captured. According to the invention, it is provided that - image data of a physiological state of the occupant are recorded and evaluated by the interior camera at each time window (Z), - a probability for a significant change in the physiological state of the occupant in a next time window (Z) is determined by means of a priority algorithm (P) based on the known parameters of the physiological state of humans, and - if it is determined by means of the priority algorithm (P), taking into account known parameters relating to the physiological state of a person and known driving dynamics parameters of the vehicle present in a current driving operation of the vehicle, that no significant change in the physiological state of the occupant is to be expected in the next time window (Z), the next time window (Z) is available for carrying out another function (F2 to F4) of the interior camera.

Description

[0001] The invention relates to a method for operating an interior camera of a vehicle, wherein at least image data of an occupant located in the detection range of the interior camera of the vehicle are recorded.

[0002] DE 101 58 415 A1 discloses a method for optically monitoring the interior of a vehicle. The interior is observed using at least one surround-view camera. The surround-view camera provides images in curvilinear coordinates. The method provides for transforming the images obtained by the surround-view camera to cylindrical or planar coordinates, and subjecting the transformed images to electronic image analysis.

[0003] The invention is based on the object of specifying a method for operating an interior camera of a vehicle.

[0004] The object is achieved according to the invention by a method which has the features specified in claim 1.

[0005] Advantageous embodiments of the invention are the subject of the subclaims.

[0006] A method for operating an interior camera of a vehicle provides for capturing at least image data of an occupant located within the detection range of the vehicle's interior camera. According to the invention, image data of a physiological state of the occupant are captured and evaluated by the interior camera at each time window.By means of a priority algorithm, a probability for a significant change in the physiological state of the occupant in a next time window is determined based on the known parameters of the physiological state of humans. If by means of the priority algorithm, taking into account known parameters relating to the physiological state of a human and known driving dynamics parameters of the vehicle present in a current driving operation of the vehicle, it is determined that no significant change in the physiological state of the occupant is to be expected in the next time window, the next time window is made available to execute another function of the interior camera.

[0007] By applying the method, it is possible to use a single interior camera for a variety of functions, for example, for occupant observation, in particular for driver observation, for recording videos and photos, for vital parameter recording, etc. Thus, multiple functions can be performed using a single interior camera, even if the interior camera's hardware does not allow multiplexing or simultaneous execution of functions.

[0008] The method therefore allocates a time window for the execution of certain functions of the interior camera, taking into account predetermined conditions, so that the method represents a cost-effective solution in comparison.

[0009] The method enables efficient use of available resources at comparatively low hardware costs.

[0010] Active functions of the interior camera can be prioritized based on physiological parameters, for example, a time period since the occupant's last eyelid closure, on vehicle dynamics parameters, for example, steering, wheel angle, etc., and on context data, for example, driver profile settings.

[0011] Embodiments of the invention are explained in more detail below with reference to drawings.

[0012] Showing: Fig. 1 schematically shows a standard multiple use of an interior camera of a vehicle according to the state of the art and Fig. 2 schematically shows a method for the adapted operation of an interior camera

[0013] Corresponding parts are provided with the same reference numerals in all figures.

[0014] Fig. 1 shows a standard multiple use of an interior camera of a vehicle according to the state of the art.

[0015] In Fig. Figure 2 shows an adapted function selection of the interior camera of a vehicle.

[0016] It is generally known that an interior camera for monitoring occupants, in particular for monitoring a driver and / or front passenger, is arranged in the vehicle, for example integrated into a rear-view mirror.

[0017] Known functions of such an interior camera include monitoring the driver of the vehicle, recording videos and photos, recording the driver's vital parameters and others.

[0018] In particular, driver monitoring is used to determine eyelid closure frequency, to record gaze direction, head position and rotation, body posture, and to record facial expressions. Driver monitoring is used in particular for safety purposes, for example, to determine driver attention, and / or comfort purposes.

[0019] The recording of videos and / or photos is intended primarily for the entertainment, comfort and safety of the driver and other passengers of the vehicle.

[0020] The driver's heart rate and blood pressure are recorded as vital parameters, which are determined based on image data captured by the interior camera, for example for comfort and safety purposes.

[0021] The interior camera is used to perform a monitoring function F1, a recording function F2, a vital parameter function F3 and at least one further function F4.

[0022] In the embodiment according to the prior art in Fig. Figure 1 shows that the functions F1 to F4 of the interior camera are executed in a predetermined sequence within a predetermined time period t. The functions F1 to F4 are repeated in this predetermined sequence depending on the duration of the vehicle's driving operation.

[0023] The following describes a method for operating the interior camera of the vehicle, wherein the method provides for an adaptive dynamic selection of the functions F1 to F4.

[0024] During each time window Z during operation of the interior camera, the monitoring function F1 is executed to determine the driver's physiological state. A person's physiological parameters, such as blinking between 8 and 15 times per minute, are known and stored in relation to an analysis of captured image data. For example, the driver's average eyelid closure frequency, the time since the last blink, the direction of gaze, etc., are recorded.

[0025] Using a priority algorithm P, a probability of a significant change in the occupant's physiological state is determined based on the known parameters of the physiological state of humans in a next time window Z. In other words, the priority algorithm P determines the probability that a significant driver monitoring event will occur during the next time window Z. Such a change can be an eye blink or a change in gaze.

[0026] The priority algorithm P additionally takes into account driving dynamics parameters during vehicle operation, for which, for example, a current driving speed, a steering angle, acceleration, and / or braking behavior are determined. The driving dynamics parameters are therefore also known.

[0027] A result of the priority algorithm P is a priority of the functions F1 to F4 for subsequent time windows Z. If the priority algorithm P determines a comparatively low probability that a significant driver monitoring event will occur, then the vital parameter function F3 or the further function F4 is executed within the next time window Z. Otherwise, i.e. if the probability is comparatively high that a significant driver monitoring event will occur, then the monitoring function F1 is executed in the next time window Z using the interior camera.

[0028] For example, it is rather unlikely that the driver of the vehicle will blink in the next time window Z, so that the interior camera can perform one of the other functions F2 to F4, for example the vital parameter function F3.

[0029] In the same way, the priority algorithm P determines a priority with respect to the execution of the vital parameter function F3 and the further function F4. This means that the priority is determined as to which of the two functions F3 and F4 is executed.

[0030] In particular, the priority algorithm P also takes into account the driving dynamics parameters during vehicle operation and so-called context data.

[0031] According to the present embodiment, the recording function F2 is always executed because a time window Z is assigned to the recording function F2.

[0032] That, as in the example in Fig. 2, the monitoring function F1, the vital parameter function F3 and the further function F4 are executed separately in a common time window Z with the recording function F2, is exemplary and can be changed.

[0033] By means of the method, it is possible for the functions F1 to F4 of the interior camera to be executed dynamically in accordance with a current situation, whereby in particular the function F1 to F4 which is currently relevant is executed.

[0034] If the interior camera's capture is limited to an area of ​​interest, the time windows Z can follow at a higher frequency, which ensures a more precise adaptation of the functions F1 to F4 and the time windows Z can in turn be adapted more dynamically.

[0035] The vehicle occupant, specifically the driver or front passenger, is exposed within the time window Z assigned to the respective functions F1 to F4. The interior camera records the exposed scene. The recorded image data is analyzed using software, for example, using a Fourier transformation based on image brightness and a subsequent evaluation of the Fourier transformation results. The analysis allows the vital parameter function F3 to be executed, and vital parameters of the occupant, such as respiratory rate, heart rate, heart rate variability, etc., to be determined. List of reference symbols F1 monitoring function F2 recording function F3 Vital sign function F4 additional function P Priority algorithm Z time window t duration QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] DE 101 58 415 A1

[0002]

Claims

[1] Method for operating an interior camera of a vehicle, wherein at least image data of an occupant located in the detection range of the interior camera of the vehicle are recorded, characterized by , that - at each time window (Z), image data of a physiological state of the occupant are recorded and evaluated by means of the interior camera, - a probability for a significant change in the physiological state of the occupant in a next time window (Z) is determined by means of a priority algorithm (P) based on the known parameters of the physiological state of humans, and - if it is determined by means of the priority algorithm (P), taking into account known parameters relating to the physiological state of a person and known driving dynamics parameters of the vehicle present in a current driving operation of the vehicle, that no significant change in the physiological state of the occupant is to be expected in the next time window (Z), the next time window (Z) is available for carrying out another function (F2 to F4) of the interior camera. [2] Method according to claim 1, characterized by that within a time window (Z) for recording the physiological state of the occupant, the occupant is exposed to light and an exposed scene is recorded by means of the interior camera and the recorded image data are evaluated. [3] Method according to claim 1 or 2, characterized bythat at least a current driving speed and / or a steering angle and / or an acceleration and / or a braking behavior are or are known as driving dynamics parameters of the vehicle.

Images