Control device and method for controlling the operation of a motor vehicle

Abstract

A control device (1) for controlling the operation of a motor vehicle (10) is provided. The control device (1) is designed to detect (S1) whether a windshield (2) of the motor vehicle (10) is at least partially iced over based on first sensor data from a first sensor device (4) of the motor vehicle (10), to detect (S2) whether a driver of the motor vehicle (10) is looking through the windshield (2) based on second sensor data from the first sensor device (4) and / or a second sensor device of the motor vehicle (10), and to deactivate and / or block (S4) at least one display device (3) of the motor vehicle (10) if it has been detected that the windshield (2) is at least partially iced over and the driver is not looking through the windshield (2).

Description

[0001] The present disclosure relates to a control device for controlling the operation of a motor vehicle, a motor vehicle having the control device, and / or a method for controlling the operation of a motor vehicle. Additionally or alternatively, a computer program is provided, which comprises instructions that, when executed by a computer, cause the computer to at least partially execute the method. Additionally or alternatively, a computer-readable medium is provided, which comprises instructions that, when executed by a computer, cause the computer to at least partially execute the method.

[0002] In motor vehicles, especially in winter, windshields can freeze, making it impossible to see outside. Drivers typically turn on the air conditioning and wait until the windshield has defrosted, and / or scrape the windshield. However, new technologies in motor vehicles allow a view outside even when the windshield is frozen, namely via functions that provide access to an exterior camera system (e.g., front and / or rear cameras) of the respective vehicle, for example, with an augmented reality view.

[0003] Such functions can be abused by the driver to drive the vehicle even when visibility outside is not adequate, for example, because the windshield is still frozen. Safe driving would not be possible due to the poor visibility.

[0004] US 9,848,173 B1 describes a device comprising a camera sensor configured to generate a video signal based on a target view in a vehicle, and a processor configured to receive one or more status signals from one or more sensors located on the vehicle, receive the video signal from the camera sensor, and detect a type of obstruction of a window of the vehicle visible in the video signal based on (i) a classification of information in the video signal and (ii) one or more of the status signals.

[0005] DE 10 2021 128 590 A1 describes a method for adjusting a screen, wherein the screen is provided for a main viewer and is designed to display a display content. An environment of the screen is monitored by sensors, wherein a private mode is automatically set for the screen if it is determined by sensors that at least one secondary viewer is looking at the screen with at least one eye, wherein in the private mode the display content is only displayed to the main viewer and is made unrecognizable for the at least one secondary viewer.

[0006] Against the background of this prior art, the object of the present disclosure is to provide a device and / or a method which are each suitable for enriching the prior art.

[0007] The problem is solved by the features of the independent claims. The subordinate claims and the dependent claims each contain optional developments of the disclosure.

[0008] According to this, the object is achieved by a control device for controlling the operation of a motor vehicle (and / or at least one display device of a motor vehicle), e.g. before driving (or outside of driving) the motor vehicle.

[0009] The control device is designed to detect, based on first sensor data from a first sensor device of the motor vehicle, whether a windshield of the motor vehicle is at least partially iced over.

[0010] The control device is designed to detect, based on second sensor data of the first sensor device and / or a second sensor device of the motor vehicle, whether a driver of the motor vehicle is looking through the windshield.

[0011] The control device is designed to deactivate and / or block at least one display device of the motor vehicle if it has been detected that the windshield is at least partially iced over and the driver is not looking through the windshield.

[0012] Thus, the operation of the motor vehicle that can be controlled by the control device does not necessarily relate to a driving operation of the motor vehicle or is not limited to this, but can also relate to controlling components of the motor vehicle, in particular the at least one output device.

[0013] The control device or control unit can be part of the driver assistance system or represent it. The control device can be, for example, an electronic control unit (ECU). The electronic control unit can be an intelligent processor-controlled unit that can communicate with other modules, for example, via a central gateway (CGW) and, if necessary, can form the vehicle's on-board network via fieldbuses such as the CAN bus, LIN bus, MOST bus, FlexRay, and / or via the automotive Ethernet, e.g., together with telematics control units and / or environmental sensors.

[0014] It is conceivable that the control device controls functions relevant to the vehicle's driving behavior, such as the steering, engine control, power transmission, and / or the braking system. Furthermore, driver assistance systems such as a parking assistant, adaptive cruise control (ACC), lane keeping assistant, lane change assistant, traffic sign recognition, traffic light recognition, start-off assistant, night vision assistant, and / or intersection assistant can be controlled by the control device.

[0015] The control device described above offers several advantages. Among other things, it provides a technique for preventing the potentially dangerous misuse of display devices and surround-view camera devices that provide external views, such as front-view camera perspectives, of motor vehicles to the display devices.

[0016] Thus, use of the at least one display device can be advantageously prevented by deactivating or blocking it if an actual view outside is not sufficiently possible due to a frozen windshield. This can prevent the driver, for example, from driving off based solely on an external view provided by a surrounding camera system of the motor vehicle. This ensures the safest possible driving off, thereby increasing, among other things, the operational reliability and road safety of the motor vehicle.

[0017] Possible further developments of the control device described above are explained in detail below.

[0018] The control device can be configured to determine whether the at least one display device represents a front camera perspective captured by an environmental camera device of the motor vehicle in the forward direction of travel of the motor vehicle. The control device can be configured to deactivate and / or block the at least one display device if it has been determined that the at least one display device represents the front camera perspective.

[0019] The front camera perspective can, for example, be image data and / or (real-time) recordings captured by at least one camera of the surround-view camera system directed in the forward direction of travel of the motor vehicle. The image data can be in the form of electronically storable data containing the image information captured by the surround-view camera system. The image data can be provided in the form of individual images and / or in the form of a video stream or (real-time) recordings. The image content of image data represents information that can be extracted by the driver if this information is displayed to the driver and the driver acknowledges it.

[0020] The control device can be configured to determine whether the at least one display device displays a front camera perspective, for example, by receiving a signal from the at least one display device that the front camera perspective is being displayed. Alternatively, or additionally, it is conceivable that the control device can be configured to receive and evaluate image data (and / or the front camera perspective) that is (and / or will be) displayed by the at least one display device from the surrounding camera device.

[0021] The control device can be designed to deactivate and / or block the at least one display device of the motor vehicle only when the motor vehicle is moving and / or a signal for the movement of the motor vehicle has been output.

[0022] The control device can be designed to detect whether the driver is looking through the windshield in order to determine, based on the second sensor data, whether a view or a direction of view of the driver is directed towards the windshield.

[0023] The control device can be designed to detect whether the driver is looking through the windshield, to determine on the basis of the second sensor data whether the driver of the motor vehicle is looking at the at least one display device (e.g. a look or a direction of look of the driver points in the direction of the at least one display device), and to detect that the driver is not looking through the windshield if it has been determined that the driver is looking at the at least one display device.

[0024] The control device can be designed to reactivate the at least one display device and / or to remove the blocking only when it has been detected on the basis of the first sensor data that the windshield is no longer iced over.

[0025] The above description can be summarized in other words and in a possible more concrete embodiment of the disclosure as described below, whereby the following description is not to be interpreted as limiting the disclosure.

[0026] According to the present disclosure, sensors and / or cameras can detect whether the windshield is icy and whether the driver is looking at the road. When the driver is not looking at the road, displays can be deactivated until they look forward again to reduce potential distractions and misuse of, for example, an augmented reality view.

[0027] To prevent misuse, the system can first detect whether the windshield is icy. This can be done using temperature and precipitation sensors, for example, in combination, or by a camera mounted in the vehicle (pointed in the forward direction of travel). In a subsequent step, it can be detected whether the driver has selected the front camera perspective or not. Initially, this front camera perspective cannot be removed; instead, the system waits to see how the driver behaves. It is also possible that the driver activates navigation and receives the front camera perspective immediately upon startup, for example, with an augmented reality view.

[0028] If the driver sets off despite partially poor visibility outside, this is not a problem that can be solved by adjusting the displays. However, if this is the case, i.e., the driver looks at the displays instead of outside (where they have only a limited field of vision), these displays can be blocked (switched off or made unavailable) until the view ahead is clear. The driver's gaze can be recorded by an interior camera, and it can be detected whether they are looking at an area of ​​interest (AOI) that displays a function with a front-camera perspective.

[0029] This can prevent potentially dangerous misuse of the camera system (which provides the front camera perspective) or the displays (e.g. with augmented reality) by the driver.

[0030] Furthermore, a motor vehicle is provided which comprises the control device described above and the at least one display device.

[0031] The at least one display device can be designed to display a front camera perspective of the motor vehicle with an augmented reality view.

[0032] The motor vehicle may include a surround-view camera device for capturing a front camera perspective (and / or a view in the forward direction of travel of the motor vehicle). The at least one display device may be configured to display the front camera perspective.

[0033] The motor vehicle may comprise a first sensor device. The first sensor device may be configured to generate (and / or capture) first sensor data, based on which it can be detected whether a windshield of the motor vehicle is at least partially iced over. The first sensor device may have at least one temperature and / or precipitation sensor, which may be arranged, for example, on the windshield. Alternatively, or additionally, the first sensor device may have an interior camera device and / or at least one interior camera. The at least one interior camera may be directed, for example, at the windshield.

[0034] The first sensor device can further be configured to generate (and / or capture) second sensor data, which can be used to detect whether a driver of the motor vehicle is looking through the windshield. Alternatively, or additionally, the motor vehicle can comprise a second sensor device, which can be configured to generate (and / or capture) the second sensor data. The first sensor device and / or the second sensor device can have the interior camera device and / or at least one interior camera. The first sensor device and / or the second sensor device can serve, for example, to detect a gaze or a gaze direction of the driver.

[0035] The control device can be signal-connected to the at least one display device (e.g., for deactivation and / or blocking). The control device can be signal-connected to the first sensor device (e.g., for receiving the first sensor data and optionally the second sensor data) and optionally to the second sensor device (e.g., for receiving the second sensor data).

[0036] The motor vehicle may be a passenger car, in particular an automobile, or a commercial vehicle, such as a truck.

[0037] What has been described above with reference to the control device also applies analogously to the motor vehicle and vice versa.

[0038] Furthermore, a method for controlling an operation of a motor vehicle (and / or at least one display device of a motor vehicle), e.g. before a driving operation (or outside of a driving operation) of the motor vehicle, is provided.

[0039] The method comprises detecting, based on first sensor data from a first sensor device of the motor vehicle, whether a windshield of the motor vehicle is at least partially iced over.

[0040] The method comprises detecting, based on second sensor data of the first sensor device and / or a second sensor device of the motor vehicle, whether a driver of the motor vehicle is looking through the windshield.

[0041] The method comprises deactivating and / or blocking at least one display device of the motor vehicle if it has been detected that the windshield is at least partially iced over and the driver is not looking through the windshield.

[0042] The (control) method may be a computer-implemented method, i.e. one, several or all steps of the method may be carried out at least partially by a computer or a data processing device, optionally the control device.

[0043] What has been described above with reference to the control device and the motor vehicle also applies analogously to the method and vice versa.

[0044] Furthermore, a computer program is provided, comprising instructions which, when the program is executed by a computer, cause the computer to at least partially carry out or carry out the method described above.

[0045] A program code of the computer program may be in any code, in particular in a code suitable for motor vehicle controls.

[0046] What has been described above with reference to the control device, the motor vehicle and the method also applies analogously to the computer program and vice versa.

[0047] Furthermore, a computer-readable medium, in particular a computer-readable storage medium, is provided. The computer-readable medium comprises instructions which, when executed by a computer, cause the computer to at least partially execute or carry out the method described above.

[0048] This means that a computer-readable medium can be provided that contains a computer program as defined above. The computer-readable medium can be any digital data storage device, such as a USB flash drive, a hard disk, a CD-ROM, an SD card, or an SSD card (or SSD drive / SSD hard disk).

[0049] The computer program does not necessarily have to be stored on such a computer-readable storage medium in order to be made available to the motor vehicle, but can also be obtained via the Internet or otherwise externally.

[0050] What has been described above with reference to the method, the control device, the computer program and the motor vehicle also applies analogously to the computer-readable medium and vice versa.

[0051] Below is an optional embodiment with reference to Fig. 1 and Fig. 2 described. Fig. 1 schematically shows a motor vehicle according to the disclosure with a control device for controlling an operation of the motor vehicle, Fig. 2 schematically shows a flow diagram of a method according to the disclosure for controlling an operation of the motor vehicle.

[0052] The Fig. 1, the motor vehicle 10, which is shown only schematically, comprises the control device 1 and at least one display device 3. The control device 1 and the at least one display device 3 can be connected to one another by signaling.

[0053] The motor vehicle 10 can comprise a surround-view camera device 5 for capturing a front camera perspective (i.e., a view 10 in the forward direction of travel of the motor vehicle 10), wherein the at least one display device 3 can be configured to display the front camera perspective. The front camera perspective can, for example, be (real-time) images captured by at least one camera of the surround-view camera device 5 directed in the forward direction of travel of the motor vehicle 10.

[0054] For example, the at least one display device 3 for displaying the front camera perspective of the motor vehicle 10 can be designed with an augmented reality view.

[0055] The motor vehicle 10 can comprise a first sensor device 4, which can be configured to generate first sensor data, based on which it can be detected whether a windshield 2 of the motor vehicle 10 is at least partially iced over. For this purpose, the first sensor device 4 can have at least one temperature and / or precipitation sensor, which is arranged, for example, on the windshield 2. Alternatively, or additionally, the first sensor device 4 can have an interior camera device and / or at least one interior camera. The at least one interior camera can be directed, for example, at the windshield 2.

[0056] Furthermore, the first sensor device 4 can be configured to generate second sensor data, based on which it can be detected whether a driver of the motor vehicle 10 is looking through the windshield 2. Alternatively, or additionally, the motor vehicle 10 can comprise a second sensor device, which can be configured to generate the second sensor data. For this purpose, the first sensor device 4 and / or the second sensor device can have the interior camera device or at least one interior camera and can serve, for example, to detect a gaze or a direction of gaze of the driver. Accordingly, based on the detected gaze or the detected direction of gaze, it can be determined whether the driver is looking through the windshield 2 or, for example, looking at the at least one display device 3.

[0057] To control the operation of the motor vehicle 10, the control device 1 is designed to control the following with reference to Fig.2 to carry out the procedures 100 described in detail.

[0058] In a first method step S1, the first sensor data of the first sensor device 4 of the motor vehicle 10 are used to detect whether the windshield 2 of the motor vehicle 10 is at least partially iced over.

[0059] In a second method step S2, the second sensor data of the first sensor device 4 and / or the second sensor device of the motor vehicle 10 are used to detect whether a driver of the motor vehicle 10 is looking through the windshield 2.

[0060] In this case, it can be determined on the basis of the second sensor data whether the driver of the motor vehicle 10 is looking at the at least one display device 3, and it can be recognized that the driver is not looking through the windshield 2, provided that it has been determined that the driver is looking at the at least one display device 3.

[0061] In a third method step S3, it can be determined whether the at least one display device 3 represents a front camera perspective that is captured by an environmental camera device 5 of the motor vehicle 10 in the forward direction of travel of the motor vehicle 10.

[0062] In a fourth method step S4, the at least one display device 3 of the motor vehicle 10 is deactivated and / or blocked if it has been detected that the windshield 2 is at least partially iced over and the driver is not looking through the windshield 2. If the third method step S3 was previously performed, the at least one display device 3 of the motor vehicle 10 can be deactivated and / or blocked if it has additionally been determined that the at least one display device 3 represents the front camera perspective.

[0063] In addition, the at least one display device 3 of the motor vehicle can only be deactivated and / or blocked when the motor vehicle 10 is moving and / or a signal for the movement of the motor vehicle 10 has been issued.

[0064] If the at least one display device 3 has been deactivated and / or blocked, the at least one display device 3 can, for example, only be reactivated and / or the blocking can be removed when it has been detected on the basis of the first sensor data that the windshield 2 is no longer iced over. List of reference symbols 1 control device 2 Windshield 3 Display device 4 Sensor device 5 Surround camera setup 10 motor vehicle 100 procedures S1-S4 process steps QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] US 9,848,173 B1

[0004] DE 10 2021 128 590 A1

[0005]

Claims

[1] Control device (1) for controlling an operation of a motor vehicle (10), characterized by that the control device (1) is designed to: - to detect (S1) on the basis of first sensor data from a first sensor device (4) of the motor vehicle (10) whether a windscreen (2) of the motor vehicle (10) is at least partially iced over; - to detect (S2) on the basis of second sensor data from the first sensor device (4) and / or a second sensor device of the motor vehicle (10) whether a driver of the motor vehicle (10) is looking through the windscreen (2); and - to deactivate and / or block (S4) at least one display device (3) of the motor vehicle (10) if it has been detected that the windscreen (2) is at least partially iced over and the driver is not looking through the windscreen (2). [2] Control device (1) according to claim 1, characterized bythat the control device (1) is designed to: - to determine (S3) whether the at least one display device (3) represents a front camera perspective which is captured by means of an environmental camera device (5) of the motor vehicle (10) in the forward direction of travel of the motor vehicle (10); and - to deactivate and / or block (S4) the at least one display device (3) if it has been determined that the at least one display device (3) represents the front camera perspective. [3] Control device (1) according to claim 1 or 2, characterized by that the control device (1) is designed to: - to deactivate and / or block the at least one display device (3) of the motor vehicle only when the motor vehicle (10) is moving and / or a signal for the movement of the motor vehicle (10) has been issued. [4] Control device (1) according to one of claims 1 to 3, characterized bythat the control device (1) for detecting (S2) whether the driver is looking through the windscreen (2) is designed to: - to determine, based on the second sensor data, whether the driver of the motor vehicle (10) is looking at the at least one display device (3); and - to detect that the driver is not looking through the windscreen (2) if it has been determined that the driver is looking at the at least one display device (3). [5] Control device (1) according to one of claims 1 to 4, characterized by that the control device (1) is designed to: - to reactivate the at least one display device (3) and / or to release the blocking only when it has been detected on the basis of the first sensor data that the windscreen (2) is no longer iced over. [6] Motor vehicle (10), characterized by that the motor vehicle (10) comprises: - the control device (1) according to one of claims 1 to 5; and - the at least one display device (3). [7] Motor vehicle (10) according to claim 6, characterized by that the at least one display device (3) is designed to display a front camera perspective of the motor vehicle (10) with an augmented reality view. [8] Method (100) for controlling operation of a motor vehicle, characterized by that the method (100) comprises: - Detecting (S1) on the basis of first sensor data from a first sensor device (4) of the motor vehicle (10) whether a windshield (2) of the motor vehicle (10) is at least partially iced over; - Detecting (S2) on the basis of second sensor data from the first sensor device (4) and / or a second sensor device of the motor vehicle (10) whether a driver of the motor vehicle (10) is looking through the windscreen (2); and - Deactivating and / or blocking (S3) at least one display device (3) of the motor vehicle (10) if it has been detected that the windscreen (2) is at least partially iced over and the driver is not looking through the windscreen (2). [9] Computer program, characterized by that the computer program comprises instructions which, when the program is executed by a computer, cause the computer to carry out the method (100) according to claim 8. [10] Computer-readable medium, characterized by that the computer-readable medium comprises instructions which, when executed by a computer, cause the computer to carry out the method (100) according to claim 8.

Images