Environment-sensing device and motor vehicle with such an environment-sensing device
The environment-sensing device addresses self-heating issues in vehicle cameras by temperature management and strategic component deactivation, ensuring continuous operation of driver assistance and autonomous systems.
Patent Information
- Application Number
- DE102017208663
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2016-06-09
- Filing Date
- 2017-05-22
- Publication Date
- 2024-12-05
- Estimated Expiration
- 2037-05-22
AI Technical Summary
Environment-sensing systems in vehicles, particularly vehicle front cameras, face critical self-heating issues due to sunlight exposure, leading to deactivation and loss of autonomous driving or driver assistance functions when temperature limits are exceeded.
An environment-sensing device with a temperature measuring unit and control device that monitors and manages sensor unit temperature, implementing measures such as switching off components, reducing image resolution, and deactivating driver assistance systems to prevent overheating.
Ensures continuous availability of safety-critical sensor data by preventing abrupt deactivation, maintaining driver assistance and autonomous driving functions, and reducing power consumption and heat generation.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to an environment-sensing device having the features of the preamble of claim 1. Furthermore, the invention relates to a motor vehicle having the environment-sensing device and a corresponding method.
[0002] Environment-sensing systems, such as cameras with image processing, are used, among other things, in vehicles equipped with at least one driver assistance system, such as lane departure warning, traffic light recognition, traffic sign recognition, collision warning, or pedestrian detection. Environment-sensing systems are also essential for autonomous vehicle guidance. The functionality of such environment-sensing systems is therefore crucial to ensuring the safety and comfort gains for the driver achieved through driver assistance systems and autonomous vehicle guidance.
[0003] In particular, the data processing effort of such environment-sensing systems can lead to critical self-heating, especially during long-term or continuous operation. Furthermore, front-facing vehicle cameras, which are typically located inside the vehicle behind the windshield, are particularly exposed to significant sunlight-induced heat. To prevent temperature damage to the environment-sensing system, the system is typically shut down when a defined temperature limit is exceeded. This inevitably results in the deactivation of autonomous driving or the driver assistance system.
[0004] Document DE 11 2013 002 203 T5 discloses a vehicle-mounted camera control device for an on-board camera that includes an imaging element for capturing an image around the vehicle. The device controls a power supply state of the imaging element. The device prevents the power supply of the imaging element from starting when the temperature in the vicinity of the imaging element is high.
[0005] The invention is based on the object of providing an environment-sensing device which reliably ensures sensor data for driver assistance devices based thereon.
[0006] This object is achieved by an environment-sensing device having the features of claim 1, by a motor vehicle having the features of claim 7, and by a method having the features of claim 8. Advantageous or preferred embodiments of the invention are set forth in the subclaims, the following description, and the figures.
[0007] A surroundings-detecting device for a motor vehicle, such as a passenger car, is proposed. The surroundings-detecting device comprises a sensor unit for determining environmental information of an area surrounding the vehicle, in particular an area surrounding the vehicle ahead. The term "the vehicle" refers, in particular, to a motor vehicle with the integrated surroundings-detecting device. The surroundings-detecting device is preferably arranged in the interior and in the direction of travel of the vehicle.
[0008] For example, the sensor unit comprises or is designed as a radar or lidar unit. Alternatively or optionally additionally, the sensor unit comprises or is designed as an image recording unit with at least one optical unit for projecting light and at least one image sensor, such as a CMOS sensor, for detecting the light projected by the optical unit.
[0009] In particular, the sensor unit comprises an evaluation device which is designed to evaluate environmental information such as road markings from the sensor data transmitted by the lidar, radar and / or image recording unit in order to execute at least one driver assistance device and / or for autonomous vehicle guidance.
[0010] Furthermore, the sensor unit comprises, in particular, at least one driver assistance device for supporting the driver of the vehicle using the environmental information evaluated by the evaluation device. The at least one driver assistance device includes, for example, lane departure warning, traffic light recognition, traffic sign recognition, collision warning, pedestrian detection, braking assistance, or autonomous vehicle guidance.
[0011] The environment-sensing device has a temperature measuring unit configured to measure at least or precisely a state temperature of the sensor unit. In this context, the state temperature is understood to mean, in particular, a component temperature of at least one component comprising the sensor unit, preferably the actual temperature of the image sensor, and / or an ambient temperature of the sensor unit, specifically the ambient temperature of the image sensor. The ambient temperature can be, for example, an actual temperature measured in a housing of the sensor unit.
[0012] The environment-sensing device comprises a control device. Particularly preferably, the control device is configured to shut down the sensor unit, specifically the image sensor and / or the evaluation device, if a predetermined temperature shutdown threshold is exceeded by the at least one state temperature measured by the temperature measuring unit. This is intended to protect the sensor unit from overheating.
[0013] The control device is configured to initiate at least one measure to reduce the state temperature when a predefined temperature warning value is exceeded. In other words, when the temperature warning value is reached, a preventative measure is taken by the control device to prevent or at least mitigate an increasing temperature development and thus prevent the temperature shutdown limit from being exceeded. In this way, a shutdown process of the sensor unit caused by self-heating is avoided or at least delayed, and consequently the sensor data required for the driver assistance functions is ensured for as long as possible. This is intended to achieve greater availability of safety-relevant driver assistance systems.
[0014] The control device is designed to reduce the operating power of the sensor unit or at least of electronic subcomponents of the sensor unit, such as the evaluation device, in order to reduce the state temperature.
[0015] In particular, the control device is designed to switch off at least one initiated measure, in particular the reduction of the work output, if the temperature warning value is undershot by the measured state temperature.
[0016] The evaluation of the environmental information by the evaluation device takes place, for example, within a processing cycle with a fixed time interval. The processing cycle is understood in particular to be the sum of a data processing time and an idle time. During the data processing time, for example, the environmental information is evaluated by the evaluation device, whereas the evaluation device is idle during the idle time. A disadvantage is that the evaluation device requires approximately the same amount of power during data processing and when idle, and thus the heat output associated with idle is also present. Against this background, the control device is preferably designed to switch off the evaluation device during the idle time of at least one processing cycle in order to reduce the state temperature.Particularly preferably, the evaluation device is switched off during idle time if the time required for switching the evaluation device off, saving, and on is less than the idle time. To determine the current idle time, for example, the idle time of at least one of the most recently completed processing cycles is evaluated. In this way, power consumption and the associated temperature development are reduced without compromising the evaluation of the environmental information.
[0017] As a further particularly preferred measure to be initiated, the control device is particularly designed to reduce, for example, halve, an image resolution, a field of view to be evaluated and / or an image acquisition rate of the at least one image to be acquired in order to reduce the state temperature. If the sensor unit comprises the radar unit, the resolution of the radar unit is preferably reduced. In this way, a reduction in the computing effort and consequently in the self-heating of the image sensor or the radar unit is achieved. Furthermore, this particularly reduces the data processing time of the evaluation device, so that additional heat energy is saved by switching off the evaluation device during the extended idle time.Despite the associated reduced ability to evaluate environmental information, particularly at great distances, a large amount of environmental information can still be evaluated, and consequently, driver assistance systems based on this information or autonomous driving can be implemented, at least to a limited extent. In particular, an abrupt total failure of all available driver assistance systems can be advantageously prevented.
[0018] In one measure according to the invention, the control device is configured to deactivate the at least one or more driver assistance devices to reduce the state temperature if the temperature warning value is exceeded by the measured state temperature. According to the invention, the evaluation of the environmental information required for the at least one deactivated driver assistance device is deactivated. The additional idle time thus gained saves additional heat energy when the evaluation device is deactivated.
[0019] In the case of at least two driver assistance devices, the control device is preferably designed to deactivate the at least one driver assistance device in stages according to a defined safety relevance. In particular, a first temperature warning value is provided; if this value is exceeded, a driver assistance device with the lowest safety level or driver assistance devices with an equivalent safety level are deactivated. If a second temperature warning value is exceeded, at least one driver assistance device with the next higher safety level is deactivated. In other words, the driver assistance devices are deactivated in stages, depending on their contribution to road safety.For example, with pedestrian and traffic sign recognition, it is preferable to switch off traffic sign recognition first, as pedestrian recognition makes a significant contribution to active vehicle safety.
[0020] In a further preferably implemented measure, the control device is particularly designed to switch the evaluation device into a simplified evaluation mode for evaluating the environmental information in order to reduce the state temperature. For example, in the simplified evaluation mode, the evaluation device is designed to evaluate a limited image area of the field of view of the at least one recorded image. Purely as an example, the evaluation of traffic signs for traffic sign recognition can be mentioned here, in which the evaluation device in the simplified evaluation mode, for example, evaluates the patterns in the limited image area compared to a normal evaluation mode. Alternatively or optionally additionally, the evaluation device in the simplified evaluation mode is designed to simplify the search criteria for evaluating the environmental information, for exampleto evaluate a smaller number of samples.
[0021] In a preferred development, the control device is configured to initiate a permissible maximum vehicle speed, in other words, a speed limit for the vehicle's own motor vehicle, when at least one of the measures initiated to reduce the state temperature is initiated. Restricting the vehicle speed makes it possible to evaluate a multitude of environmental information despite the at least one initiated measure, such as the simplified evaluation mode or the reduced image resolution.
[0022] From a structural perspective, it is preferred that the environment-detecting device comprises a system-on-chip, wherein the image sensor of the image recording unit, the evaluation device, the at least one driver assistance device and / or the control device are arranged on the system-on-chip, in particular as electronic subcomponents.
[0023] A further subject matter of the invention relates to a motor vehicle with the environment-sensing device according to the above description. Preferably, the control device is designed to inform the driver of the vehicle, when a predetermined temperature warning level is exceeded, of a possible imminent shutdown of the environment-sensing device, of a possible imminent deactivation of at least one driver assistance device or of the autonomous driving mode, and / or of a possible imminent speed restriction. For example, the driver is informed via a visual and / or acoustic warning message. The temperature warning level is, for example, the temperature warning value. In this way, the driver is informed early, e.g.informed of a potentially impending driving request, thus avoiding any surprise effect. This is particularly advantageous if the temperature cut-off limit is exceeded due to at least one initiated measure and thus the deactivation of autonomous driving or the operation of at least one driver assistance system is unavoidable.
[0024] The invention further relates to a method with an environment-sensing device, in particular for temperature-dependent control of the sensor unit according to the preceding description. In a first step, environmental information about an area surrounding the vehicle's own motor vehicle is determined. The environmental information preferably comprises the objects to be detected for the execution of the at least one driver assistance system, such as lane markings for a lane departure warning system. Furthermore, at least one state temperature of the sensor unit is measured by the temperature measuring unit. To determine the current state temperature, for example, a regular temperature measurement is carried out at a time interval of two seconds.If the specified temperature warning value is exceeded by at least one state temperature measured by the temperature measuring unit, at least one measure to reduce the state temperature is initiated by the control device.
[0025] With at least one measure to be initiated, the performance of the sensor unit or of electronic subcomponents of the sensor unit, such as the evaluation device or the image sensor, is reduced. Alternatively, or optionally in addition, the evaluation device is switched off during idle time, in particular if the time required for switching the evaluation device off, saving, and on is less than, for example, the idle time of the last processing cycle completed. As a further alternative or optional addition, the image resolution, the field of view, and / or the image acquisition rate are reduced. As a further preferred measure to be initiated, the at least one driver assistance device is deactivated to extend the idle time. In the case of at least two driver assistance devices, the driver assistance devices are preferably deactivated according to a graded, defined safety relevance.In a further preferred measure, the evaluation device is switched to a simplified evaluation mode to reduce the state temperature.
[0026] Further features, advantages, and effects of the invention will become apparent from the following description of preferred embodiments of the invention. These show: Fig. 1 shows a block diagram of an environment-sensing device comprising a sensor unit; Fig. 2 a bar chart showing the temperature status of the sensor unit and two temperature limit values specified for the sensor unit to prevent the risk of overheating of the sensor unit; Fig. 3 the processing cycle of an evaluation device of the sensor unit with a higher and lower data processing effort for the evaluation of environmental information in the diagram comparison; Fig. 4 the processing cycle with a compared to Fig. 3 extended idle time due to the deactivation of a driver assistance device of the sensor unit; Fig. 5 the time required for switching off, storing and switching on the evaluation device; Fig. 6 a diagram with a sequence of measures to be initiated depending on the state temperature of the sensor unit.
[0027] Corresponding parts are provided with the same reference numerals in all figures.
[0028] Fig. 1 shows a schematic block diagram of an environment-sensing device 1 which is integrated in a motor vehicle 2 such as a car, truck or an agricultural work machine.
[0029] The environment-detecting device 1 comprises a sensor unit 3 for determining environmental information of an area surrounding the driver's own motor vehicle 2. The sensor unit 3 has, for example, an image recording unit 4 such as a mono or stereo camera, which is designed to record at least one image of the area surrounding the driver's own motor vehicle 2 to determine the environmental information. Furthermore, the sensor unit 3 comprises, for example, an evaluation device 5, which is designed in particular to evaluate the environmental information from the at least one image recorded by the image recording unit 4.
[0030] For example, the environment-sensing device 1 comprises at least one driver assistance device 6a, 6b, 6c, such as pedestrian protection or a lane departure warning system, which executes the driver assistance function, such as braking, warning and / or steering assistance, in particular on the basis of the environmental information evaluated by the evaluation device 5.
[0031] The environment-sensing device 1 comprises a temperature measuring unit 7, which is designed to measure at least one state temperature T1 of the sensor unit 3. The temperature measuring unit 7 is, for example, a temperature sensor integrated in a housing of the sensor unit 3 and / or in an image sensor of the image recording unit 4. The temperature of the sensor unit 3 is monitored, in particular, by means of the at least one measured state temperature T1.
[0032] The environment-sensing device 1 has a control device 8. The control device 8 is preferably designed to shut down the sensor unit 3, in particular the image recording unit 4, if a temperature shutdown limit T3, which is specified in particular by the control device 8, is exceeded by the measured state temperature T1. The shutdown process is intended to prevent heat damage to the sensor unit 3, in particular to the image recording unit 4.
[0033] The deactivation process of the sensor unit 3 also deactivates the at least one driver assistance device 6a, 6b, 6c and, consequently, the associated driver support. This deactivation process requires an abrupt takeover action by the driver, particularly in partially or highly autonomous driving modes.
[0034] The control device 8 is configured to initiate at least one measure to reduce the state temperature T1 if a temperature warning value T2, in particular specified by the control device 8, is exceeded by the measured state temperature T1. Particularly preferably, a temperature-dependent control of the operating performance of the sensor unit 3 is carried out to reduce the state temperature T1. This is intended to prevent a shutdown of the sensor unit 3 associated with exceeding the temperature shutdown limit value T3, and consequently to ensure the execution of the at least one driver assistance device 6a, 6b, 6c or the autonomous driving operation.
[0035] In Fig. Figure 2 shows a bar chart with the currently measured state temperature T1, the predefined temperature warning value T2, and the predefined temperature shutdown limit T3. In this example, the state temperature T1 is below the predefined temperature warning value T2. The control device 8 is particularly configured to initiate at least one measure to reduce the state temperature T1 if the temperature warning value T2 is exceeded, and to shut down the sensor unit 3 if the temperature shutdown limit T3 is exceeded.
[0036] As in Fig. As shown in Figure 3, the evaluation of the environmental information by the evaluation device 5 takes place, for example, within a processing cycle VZ with a fixed time interval of, for example, 50 ms. Purely as an example, the evaluation of the environmental information for three driver assistance devices 6a, 6b, 6c is shown, for example, the evaluation of lanes for a lane departure warning system, the evaluation of traffic signs for traffic sign recognition, and the evaluation of pedestrians for pedestrian protection.
[0037] Within the processing cycle VZ, on the one hand, the data processing DV for evaluating the environmental information takes place. Following the data processing DV, the evaluation device 5 is in an idle state L until the time-defined processing cycle VZ is completed. The duration of the data processing DZ depends in particular on the amount of environmental information to be evaluated from the sensor data, in particular from the at least one recorded image. When comparing the two in the Fig. 3, the upper diagram shows a lower utilization of the evaluation device 5 during data processing than the lower diagram, so that the idle time LZ is shortened accordingly in the lower diagram.
[0038] The disadvantage is that the evaluation device 5 requires approximately the same amount of work during data processing DV and during idle L. Against this background, the control device 8 is designed, for example, to switch off the evaluation device 5 during the idle time LZ of the processing cycle VZ in order to reduce the state temperature T1. However, this is particularly presumed that the time required for the switching off, saving and switching on process ASE and optionally additionally the switching on process Z of a deactivated driver assistance device 6a, 6b, 6c of the evaluation device 5, which is exemplary in Fig. 5 is less than the idle time LZ.
[0039] To extend the idle time LZ and thus to save the heat energy associated with the shutdown process during the idle time LZ, a further preferred measure provides for the deactivation of at least one of the driver assistance devices 6a, 6b, 6c. Fig. 4, purely by way of example, the driver assistance system 6b is deactivated, thus disabling the associated evaluation of the environmental information for the driver assistance system 6b. This advantageously results in a longer idle time LZ, thus eliminating the associated heat and energy loss.
[0040] A calculation example is intended to illustrate the potential savings in self-heating by switching off at least one driver assistance device 6b and the evaluation device 5 during the idle time LZ.
[0041] By switching off the driver assistance device 6b, which requires, for example, a data processing time DZ of 10 ms, the idle time LZ increases from 10 ms to 25 ms. The effective time ratio for switching off the evaluation device 5 during the idle time LZ is [(Idle time LZ (25 ms) - switching off, saving, switching on, and switching on process ASEZ (1.5 ms) / processing cycle VZ (50 ms)] = 0.45. The efficiency of switching off the evaluation device 5 is 50 percent (0.5). Since the power consumption of the evaluation device 5 corresponds to one watt, an energy saving of 0.225 watts is based on 1 watt * 0.45 * 0.5. Thus, the power consumption of the evaluation device 5 was reduced by more than 20 percent, and consequently, the self-heating of the sensor unit 3 was significantly reduced.
[0042] Fig.Figure 6 shows an overview diagram of a sequence of measures to be initiated depending on the state temperature T1 of the sensor unit 3. The self-heating reducing measures to counteract the self-heating of the sensor unit 3 are shown on the γ-axis, and the associated temperature limit values T2, T3 are shown on the x-axis. A linear characteristic curve is shown purely as an example. If the temperature warning value T2 is exceeded by the state temperature T1, for example, as self-heating reducing measures y1, the evaluation device 5 is switched off during the idle time LZ, at least one driver assistance device 6a, 6b, 6c is deactivated, the evaluation device 5 is switched to a simplified evaluation mode with a simplified data processing algorithm, and an image resolution and / or an image recording rate of the image sensor is reduced. At y2, for example,the warning to the driver that driver assistance systems 6a, 6b, 6c or partially or highly autonomous driving may be terminated. At y3, the temperature shutdown limit T3 is exceeded, and the sensor unit 3 or its subcomponents are shut down by the control device 8 to prevent further heat generation.
Claims
[1] Environment-sensing device (1) for a motor vehicle (2), with a sensor unit (3) for determining environmental information of an area surrounding the own motor vehicle (2), with a temperature measuring unit (7) which is designed to measure at least one state temperature (T1) of the sensor unit (3), with a control device (8) which is designed to initiate at least one measure for reducing the state temperature (T1) when a predetermined temperature warning value (T2) is exceeded, characterized by , that the control device (8) is designed to reduce a working output of the sensor unit (3) or of electronic subcomponents (5, 6a, 6b, 6c) of the sensor unit (3) in order to reduce the state temperature (T1), and wherein the sensor unit (3) comprises at least one driver assistance device (6a, 6b, 6c) for assisting the vehicle driver, wherein the control device (8) is designed to deactivate the at least one driver assistance device (6a, 6b, 6c) in order to reduce the state temperature (T1), wherein the evaluation of the environmental information required for the at least one deactivated driver assistance device is switched off. [2] Environment sensing device (1) according to claim 1, characterized byin that the sensor unit (3) comprises an evaluation device (5) for evaluating environmental information from the sensor data transmitted by the sensor unit (3), wherein the control device (8) is designed to switch off the evaluation device (5) during an idle time (LZ) of a processing cycle (VZ) in order to reduce the state temperature (T1), if the time required for a switch-off, storage and switch-on process (ASE) of the evaluation device (5) is less than the idle time (LZ). [3] Environment-detecting device (1) according to one of the preceding claims, characterized by in that the sensor unit (3) comprises an image recording unit (4), wherein the control device (8) is designed to reduce an image resolution, a field of view and / or an image recording rate of at least one image to be recorded by the image recording unit (4) in order to reduce the state temperature (T1). [4] Environment sensing device (1) according to one of the preceding claims, characterized by that the sensor unit (3) comprises at least two driver assistance devices (6a, 6b, 6c), wherein the control device (8) is designed to deactivate the driver assistance devices (6a, 6b, 6c) in stages according to safety relevance. [5] Environment-detecting device (1) according to one of the preceding claims, characterized by that the control device (8) is designed to switch the evaluation device (5) into a simplified evaluation mode for evaluating the environmental information in order to reduce the state temperature (T1). [6] Environment-sensing device (1) according to one of the preceding claims, characterized by that the control device (8) is designed to initiate a speed restriction of the own motor vehicle (2) in the event of at least one measure initiated by the control device (8). [7] Motor vehicle (2) with an environment-detecting device (1) according to one of the preceding claims, characterized by that the control device (8) is designed, when a predetermined temperature warning level is exceeded, to inform the driver of a possible imminent switch-off process of the environment-sensing device (1), of a possible imminent deactivation of at least one driver assistance device (6a, 6b, 6c), of a possible imminent deactivation of an autonomous driving operation and / or of a possible imminent initiated speed limitation. [8] Method with an environment-detecting device (1) according to one of the preceding claims 1 to 6, comprising the steps: - Determination of environmental information of an area surrounding the own motor vehicle (2); - measuring at least one state temperature (T1) of the sensor unit (3); - initiating at least one measure to reduce the state temperature (T1) when the specified temperature warning value (T2) is exceeded, wherein the at least one measure to be initiated reduces the performance of the sensor unit or of electronic subcomponents of the sensor unit.
Citation Information
Patent Citations
Vehicle on-board camera control device
DE112013002203T5
Method for detecting a blocked state of an ultrasonic sensor; ultrasonic sensor device and motor vehicle
DE102013015410A1
Driver assistance system
DE102014208666A1
Power control method of a device controllable by user gestures
DE112010004671T5
Electronic camera with internal temperature increase controlled
US20030071913A1
