Driver assistance system, means of transport and method for displaying an image of an area surrounding a means of transport

Abstract

Method for displaying an image of an environmental area of ​​a means of transport (10) comprising the steps: • Detecting (100) the surrounding area of ​​the means of transport (10) by means of a first environmental sensor (1), • Displaying (500) a first partial area (4) of an image of the detected surrounding area on a display unit (6), • Determining (600) that a second sub-area (5) of the image of the detected surrounding area has an increased relevance compared to the first sub-area (4) and in response thereto, • Displaying (700) the second partial area (5) instead of the first partial area (4) of the image of the detected surrounding area on the display unit (6), • wherein the determination that a second sub-area (5) of the image of the detected surrounding area has an increased relevance compared to the first sub-area (4) is carried out as a function of map material and a location of the means of transport (10).

Description

[0001] The present invention relates to a driver assistance system, a means of transportation, and a method for displaying an image of an area surrounding a means of transportation. In particular, the present invention relates to improved driver assistance through dynamic adaptation of a displayed section of environmental data.

[0002] Modern means of transport are increasingly using environmental sensors that can provide the driver with an image of the surroundings. In particular, optical environmental data is increasingly being used in artificial rearview mirrors, comprising camera sensors and display devices. Unlike a conventional, static rearview mirror, which is adjusted to the needs of an individual driver before the start of the journey and remains unchanged afterward, environmental data captured by sensors offers the possibility of being displayed in the vehicle in an adapted manner depending on given circumstances.

[0003] DE 10 2006 037 600 A1 discloses a method for the resolution-dependent representation of the surroundings of a motor vehicle, in which the image data is masked in those image areas where the resolution is below a specified threshold. This makes a resolution-dependent representation of the surroundings of a motor vehicle, which allows the driver to perceive the surroundings in a particularly reliable manner, possible. In particular, the representation is advantageously adapted to cornering or shunting operations, whereby, when used in conjunction with articulated vehicles, the articulation angle between the towing vehicle and the trailer or semi-trailer is taken into account when deciding which image areas are displayed and which are masked.

[0004] DE 10 2010 033 786 A1 discloses a method for capturing and displaying areas located to the side of and behind the vehicle, wherein the output of the captured images is dynamically adjusted depending on the current driving situation and / or user specifications. If the proposed image capture units are intended to replace conventional exterior mirrors, the image capture units can be controlled accordingly depending on the travel speed and steering angle information.

[0005] WO 2009 / 132617 A1 discloses a device for detecting and displaying the rear and / or lateral surroundings of a motor vehicle. The core idea of ​​this disclosure is that image sections are selected depending on the signals from a turn signal and / or the signals from a sensor representing the steering angle.

[0006] DE 103 36 329 A1 discloses a method for improving visibility in a motor vehicle, wherein the road ahead of the vehicle is analyzed to select an image section. A corresponding disclosure can also be found in DE 10 2007 044 536 A1.

[0007] It is an object of the present invention to make even better use of further possibilities in the optical presentation of information acquired by environmental sensors and thus to better support vehicle drivers.

[0008] The above-mentioned object is achieved according to the invention by a method for displaying an image of an environmental area of ​​a means of transport. The means of transport can be, for example, a car, a van, a truck, an aircraft and / or a watercraft. The environmental area can be an optically detectable area around the means of transport or a part thereof. In a first step, the environmental area of ​​the means of transport is detected by a first environmental sensor. This does not preclude the possibility that a second or further sensor can also be involved in detecting the environmental area. The environmental sensor can in particular be an optical sensor, which enables a photorealistic representation of the environmental area detected by it. Furthermore, a first partial area of ​​an image of the detected environmental area is shown on a display unit.The partial area can in particular represent a smaller image section than the entirety of the surrounding area information recorded. The representation can take place on a display unit of the means of transport. In other words, the display unit can comprise an integral component of the means of transport (e.g. a central information display, an instrument cluster, or similar). In particular, the display unit can be arranged at the position or in the direction in which a rear-view mirror (interior mirror) is usually arranged. An alternative location for the display unit is in the area of ​​the A-pillars. In addition, according to the invention it is automatically determined that a second partial area of ​​the image of the recorded surrounding area has increased relevance compared to the first partial area. In other words, the second partial area which has a region that is not congruent (oridentical) part of the recorded environmental information is more important for the information of the user (e.g., driver of the vehicle) due to current circumstances. The increased relevance can arise due to various circumstances. In particular, the relevance can be determined automatically based on a driving situation, which can be done with the aid of sensors. The determination that the second sub-area of ​​the image of the recorded environmental area has increased relevance compared to the first sub-area is carried out depending on map material and the location of the vehicle.

[0009] In response to the determination of the increased relevance, the second sub-area is then automatically displayed on the display unit instead of the first sub-area of ​​the image of the captured surrounding area. In other words, the second sub-area is displayed on the display unit, while the first sub-area is no longer displayed on the display unit. This does not preclude the first sub-area and the second sub-area from relating to one another in such a way that the second sub-area contains information that is also present in the first sub-area. Therefore, the second sub-area is characterized from the first sub-area in particular by the fact that different boundaries mark the imaged surrounding areas.For example, a section of the surrounding information that was displayed as the first sub-area can be shifted in response to the occurrence of increased relevance, so that information disappears at a first edge of the image, while new information is added to the display at an opposite edge of the image. In principle, it is also possible for the second sub-area to have a different zoom level than the first sub-area. In particular, however, the information displayed by the second sub-area is of greater relevance to the driver of the means of transport than the information in the first sub-area that is not contained in the second sub-area. In this way, information that is more relevant to the guidance of the means of transport is automatically provided, which can increase road safety and / or user comfort.

[0010] The subclaims show preferred developments of the invention.

[0011] As indicated above, the surrounding area of ​​the means of transport can also be detected by means of a second environmental sensor. The second environmental sensor can detect a different area of ​​the surrounding area, which overlaps or is disjoint (does not overlap) with an area detected by the first sensor. The data detected by the second environmental sensor can be used to display the first partial area on the display unit. In other words, the display of the first partial area can be a fused image which includes information from the first environmental sensor and the second environmental sensor. The second environmental sensor can in particular also be an optical sensor and very preferably have an identical resolution to the first environmental sensor. In this way, a particularly harmonious fused display can be achieved.a computationally intensive adaptation of the data from the two environmental sensors is omitted. In particular, the first environmental sensor and the second environmental sensor can be arranged at different positions in the means of transport. Preferably, the first environmental sensor can be assigned to one side of the vehicle, while the second environmental sensor can have a position in the means of transport that lies essentially on a central longitudinal axis of the means of transport. In particular, it can be a front camera and / or a rear-facing camera (rear-view camera). In this way, the first environmental sensor and the second environmental sensor can be used to create a representation of the surrounding areas of the means of transport that covers a horizontal angle of almost 270 degrees.

[0012] If a first and a second environmental sensor are used to display the first sub-area, the display of the second sub-area can comprise a reduced (reduced) image based on data from the first environmental sensor compared to the first sub-area and an expanded image based on data from the second environmental sensor. In other words, depending on the increased relevance, environmental data determined by the first environmental sensor is removed from the display in favor of environmental data determined by the second sensor. In particular, the horizontal angle included in the display can be shifted and / or enlarged and / or reduced.

[0013] The determination that the second sub-area of ​​the image of the captured surrounding area has increased relevance compared to the first sub-area can be made based on digital map material and a current and / or future location of the means of transport. For example, based on the map material and a current position of the means of transport, it can be determined that the means of transport is in a curve or is approaching a curve. Since cornering can cause a shift in a rearward area with the highest relevance, the representation of the rearward area can be automatically adjusted according to the invention by displaying the second sub-area instead of the first sub-area.

[0014] Similarly, a shift in the relevant surrounding area can be automatically determined depending on a steering angle. For example, a steering angle to the left can be used as an opportunity to include surrounding areas further to the left as part of the second sub-area in favor of surrounding information to the right in the representation of the image of the detected surrounding area. This improves the information available to the driver.

[0015] Since cornering, for example, is also documented or announced by the operating state of a direction indicator, the operating state of the direction indicator of the means of transport can also be used as a reason to determine the increased relevance of the second sub-area and to initiate its display. After it is determined that a predefined period of time has elapsed and / or a predefined distance has been traveled since the second sub-area was displayed, the first sub-area can be displayed again on the display unit instead of the second sub-area in response to this finding. In this way, the previous state is restored depending on the time / distance traveled. In particular, a factory setting can be restored in this way, independently of sensory inputs, which can be used to permanently or permanently restore the original factory settings.On average, the best possible perception of the vehicle's surroundings can be achieved by the user. Furthermore, the display can be visually calmed, since the sensory state that led to the display of the second sub-area instead of the first sub-area may only last a few seconds, whereas such a brief shift of the displayed image section could potentially lead to a loss of comfort when using the display by the user.

[0016] The predefined time period or the predefined path length can be set by the user in a configuration menu. In other words, the user can predefine the time / distance to adapt the behavior of a system according to their preferences.

[0017] According to a second aspect of the present invention, a driver assistance system for displaying an image of the surrounding area of ​​a means of transport is proposed. The driver assistance system comprises a data input, which may, for example, comprise a bus participant. At least the data input can receive the data from an environmental sensor and forward it to an evaluation unit also provided in the driver assistance system (e.g., an electronic control unit, a programmable processor, a microcontroller, or the like). The evaluation unit is linked for information technology purposes to a data output, which may, for example, also comprise a bus participant and / or a monitor cable, or the like. The data input is configured to detect an environmental area of ​​the means of transport using a first environmental sensor.This does not preclude the possibility that data from a second, third, or further environmental sensor may also be received via the data input. The data output is configured to display a first sub-area of ​​an image of the detected environmental area on a display unit of the means of transport. In other words, the data output can cause the instrument cluster and / or a central information display and / or a head-up display or similar to display a first sub-area / partial image of the sensor data. The evaluation unit is configured to determine that a second sub-area of ​​the image of the detected environmental area has increased relevance compared to the first sub-area. The determination that the second sub-area of ​​the image of the detected environmental area has increased relevance compared to the first sub-area is carried out depending on map material and a location of the means of transport.In response to the recognition that the second sub-area of ​​the image of the detected surrounding area has increased relevance compared to the first sub-area, the data output is configured to display the second sub-area instead of the first sub-area of ​​the image of the detected surrounding area on the display unit. In this way, the driver assistance system according to the invention is configured, when used in a means of transport, to implement the features, feature combinations, and the resulting advantages of the method according to the invention in a manner that is clearly evident, so that reference is made to the above explanations to avoid repetition.

[0018] According to a third aspect of the present invention, a means of transport (e.g. a car, a van, a truck, an aircraft and / or a watercraft) is proposed which has a driver assistance system according to the second aspect of the invention and therefore also implements the features, combinations of features and advantages of the above aspects of the invention in a corresponding manner.

[0019] Further details, features, and advantages of the invention will become apparent from the following description and the figures. They show: Fig. 1 a schematic representation of a first embodiment of a means of transport according to the invention; Fig. 2 a schematic plan view of an embodiment of a means of transport designed according to the invention; Fig. 3 a representation of environmental areas recorded by different environmental sensors; Fig. 4 which in Fig. 3 shows a representation according to the invention of the second partial area compared to the first partial area; Fig. 5 shows an inventive, fused view of available data material and a dynamically movable window for selecting information to be displayed; and Fig. 6 a flowchart illustrating steps of an embodiment of a method according to the invention for displaying an image of an environmental area of ​​a means of transport.

[0020] Fig. 1 shows a passenger car 10 as an exemplary embodiment of a means of transport according to the invention, which has an electronic control unit 8 as an evaluation unit with a data input 8a and a data output 8b. The electronic control unit 8 is informationally connected to a digital data memory 7, in which computer program code for executing a method according to the invention is stored. The data input 8a is informationally connected to an optical camera 1 in the mirror triangle as the first environmental sensor and to an optical camera 2 in the form of a rear-view camera as the second environmental sensor and receives digital data representing the detection areas I and II of the cameras 1, 2. By means of the data output 8b, the electronic control unit 8 can generate representations according to the invention on the central information display 6 as the display unit.

[0021] Fig. Figure 2 shows a plan view of an embodiment of a passenger car according to the invention as a means of transport, which has two cameras 1, 3 arranged in the exterior mirrors as the first and third environmental sensors and a rearview camera 2 as the second environmental sensor. The cameras 1, 2, 3 are linked via information technology to an electronic control unit 8, which in turn is connected via information technology to a digital data storage device 7 and a central information display 6. To generate a view of a digital rearview mirror for the driver of the passenger car 10, the environmental areas I, II, III are imaged from the detection areas of the cameras 1, 2, 3 and combined. The merged representation 14 represents the maximum amount of displayable information.Depending on the respective driving situation, a sub-area 4 can be selected from this data set as the first sub-area or a sub-area 5 as the second sub-area and displayed on the central information display 6. If the first sub-area 4 has a higher relevance for the current vehicle condition than the second sub-area 5, the boundaries of the area to be displayed are both shifted to the right, with data material that can generally be displayed on the left being ignored. If the driving situation shows that the data set not contained in the first sub-area 4 has a higher relevance than a sub-image displayed on the right-hand edge of the image, the second sub-area 5 is displayed in order to increase the relevance of the image material displayed. In this way, the user acceptance and / or user comfort and / or road safety of a means of transport designed according to the invention is increased.

[0022] Fig. 3 shows a representation 4' of three camera images 1a, 2a, 3a, which are captured by the cameras 1, 2, 3 of the Fig. 1 and Fig. 2. Image component 11 shows, in particular, the ego vehicle. This component is usually included in a classic rearview mirror image to simplify the viewer's orientation. Image component 12 indicates the legally prescribed field of vision, which is of permanent relevance for safe vehicle driving. Image component 13 goes beyond the legally prescribed image component 12 and is no longer necessary or helpful for a left turn. The present invention therefore proposes not continuously displaying this in favor of another image component, which does not rule out the possibility that the image material will continue to be recorded and evaluated, for example, for video object recognition.

[0023] Fig. 4 shows a representation 5' in which the image component 13 (see Fig. 3) has been largely removed from the representation 5' in order to be able to display the image component 17 on the display device and thus to represent a second partial area in the representation 5', which, compared to the one in Fig. 3 has an increased relevance for vehicle control.

[0024] The image section can be shifted to the left, for example, by a turn signal request or a larger steering angle, to hide the unnecessary area on the right and gain more information in the critical area on the left. Additionally, map data from the telematics unit (head unit) can be used to interpret the situation. The section automatically returns to its original state after a predefined period of at least ten seconds, after the curve has been completely negotiated, or after a predefined distance has been covered.

[0025] Fig. 5 shows fused image material 14 and a dynamically selectable section 15 according to the invention, which is displayed to the driver of the means of transport. This step could also be referred to as "situational windowing" in order to reduce or even eliminate the blind spot. The section 15 to be displayed can, for example, be adapted to the current driving situation / vehicle situation in the direction of the arrows P1 and / or P2. In particular, the method according to the invention can be applied such that, for certain situations, a shift of the displayed section 15, consisting of a superimposed horizontal and vertical shift, is carried out in order to display an optimized image section. The speed, or the duration, for bringing the image section into the desired position and the duration for returning to the starting situation can be predefined by the manufacturer of the means of transport.Within certain limits, the driver can influence the preset values ​​for adjustment. In particular, these settings can be assigned to the current driver via an ID transmitter (e.g., vehicle key, pedestrian recognition, or similar) and automatically recalled.

[0026] Fig.6 shows steps of an exemplary embodiment of a method according to the invention for displaying an image of an environmental area of ​​a means of transport. In step 100, the environmental area of ​​the means of transport is detected by means of a first environmental sensor. In step 200, the environmental area of ​​the means of transport is detected by means of a second environmental sensor. The second environmental sensor can, in particular, have a different orientation than the first environmental sensor. In step 300, a screen view can therefore be combined from the data of the first and second environmental sensors and, in step 400, displayed on a display unit of the means of transport. In step 500, a first partial area of ​​an image of the detected environmental area is then displayed on a display unit of the means of transport. The first partial area is, in particular, a section selected from the entire data material.In step 600, it is determined that a second sub-area of ​​the image of the detected surrounding area has increased relevance compared to the first sub-area. This can be done in particular with sensor support and preferably automatically. In response, in step 700, the second sub-area is displayed on the display unit instead of the first sub-area of ​​the image of the detected surrounding area. Due to the increased relevance, the components of the image of the surrounding area now displayed are of greater assistance to the driver in safely and / or comfortably guiding the means of transport. In step 800, a user input for configuring the system according to the invention is determined. In other words, the user specifies the conditions under which a selection of a section (second sub-area) changed according to the invention is to be reversed.In step 900, a changed time period and also a changed distance are predefined by the user input. In step 1000, it is then determined that a predefined time period has elapsed and / or a predefined distance has been traveled. In response, in step 1100, the first sub-area is displayed on the display unit instead of the second sub-area of ​​the image of the detected environmental area. In other words, after a predefined time period has elapsed, the method according to the invention returns from the display of the second sub-area to the display of the first sub-area. The definition of a minimum time period after which the first sub-area is displayed again calms the display and increases user acceptance when using dynamically selected sections from the data material determined using environmental sensors. List of reference symbols: 1 camera 1a camera image 2 rear view cameras 2a Rear view camera image 3 Camera 3a Camera image 4 first section 4' display 5 second sub-area 5' display 6 central information display 7 Data storage 8 electronic control unit 8a Data input 8b Data output 10 cars 11 Image section with ego vehicle 12 Image detail required by law 13 Image section, which is only relevant depending on the driving situation 14 merged representation 15 section to be displayed 17 image component relevant when turning left 100-1100 Process steps I, II, III surrounding areas to be merged P1, P2 arrows

Claims

[1] Method for displaying an image of an environmental area of ​​a means of transport (10) comprising the steps: • Detecting (100) the surrounding area of ​​the means of transport (10) by means of a first environmental sensor (1), • Displaying (500) a first partial area (4) of an image of the detected surrounding area on a display unit (6), • Determining (600) that a second sub-area (5) of the image of the detected surrounding area has an increased relevance compared to the first sub-area (4) and in response thereto, • Displaying (700) the second partial area (5) instead of the first partial area (4) of the image of the detected surrounding area on the display unit (6), • wherein the determination that a second sub-area (5) of the image of the detected surrounding area has an increased relevance compared to the first sub-area (4) is carried out as a function of map material and a location of the means of transport (10). [2] The method of claim 1 further comprising • Detecting (200) the surrounding area of ​​the means of transport (10) by means of a second environmental sensor (2, 3) and • Displaying the first partial area (4) of the image of the detected environmental area on the display unit (6) using data from the second environmental sensor (2). [3] Method according to claim 2, wherein the • Representation of the second sub-area (5) comprises a reduced image compared to the first sub-area (4) based on data from the first environmental sensor (1) and an expanded image based on data from the second environmental sensor (2). [4] The method according to claim 2 or 3 further comprising • Combining (300) and displaying (400) a common screen view from data of the first environmental sensor (1) and the second environmental sensor (2). [5] Method according to one of the preceding claims, wherein • determining that a second sub-area (5) of the image of the detected surrounding area has increased relevance compared to the first sub-area (4) is carried out as a function of a steering angle of the means of transport (10). [6] Method according to one of the preceding claims, wherein • determining that a second sub-area (5) of the image of the detected surrounding area has an increased relevance compared to the first sub-area (4) is carried out as a function of a signal representing an operating state of a direction indicator of the means of transport (10). [7] Method according to one of the preceding claims further comprising • Determining (1000) that a predefined period of time has elapsed and / or a predefined distance has been traveled, and in response • Displaying (1100) the first partial area (4) instead of the second partial area (5) of the image of the detected surrounding area on the display unit (6). [8] The method of claim 7 further comprising • Determining (800) a user input representing a changed time period and / or distance and in response thereto • Predefine (900) the changed time duration and / or path length. [9] Driver assistance system for displaying an image of an area surrounding a means of transport (10), comprising • a data input (8a), • an evaluation unit (8) and • a data output (8b), where • the data input (8a) is configured to detect an environmental area of ​​the means of transport (10) by means of a first environmental sensor (1), • the data output (8b) is configured to display a first partial area (4) of an image of the detected surrounding area on a display unit (6), • the evaluation unit (8) is set up to determine that a second sub-area (5) of the image of the detected surrounding area has an increased relevance compared to the first sub-area (4) and • the data output (8b) is configured to display the second sub-area (5) instead of the first sub-area (4) of the image of the detected surrounding area on the display unit (6) in response to the recognition that the second sub-area (5) of the image of the detected surrounding area has increased relevance compared to the first sub-area (4), • wherein the determination that a second sub-area (5) of the image of the detected surrounding area has an increased relevance compared to the first sub-area (4) is carried out as a function of map material and a location of the means of transport (10). [10] Means of transport (10) comprising a driver assistance system according to claim 9.

Images