Activation and optimization of a night mode in camera monitor applications

The method improves vehicle camera monitor system image quality by adjusting image processing settings based on day or night conditions, enhancing safety by reducing the risk of accidents and improving driver situational awareness.

DE102023127318B4Active Publication Date: 2025-04-30MAN TRUCK & BUS SE +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
DE102023127318
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-10-06
Publication Date
2025-04-30
Estimated Expiration
2043-10-06

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The invention relates to a method for operating an image data processing unit (16) of a vision system (10) of a vehicle (20). The method comprises receiving image data acquired by at least one image acquisition unit (12), receiving a status signal indicating a day or night state, and processing the received image data depending on the received status signal. The invention further relates to a vision system (10) comprising an image data processing unit (16) configured to carry out the method, and a vehicle (20) comprising the vision system (10).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method for operating an image data processing device of a vision system of a vehicle, a vision system with a corresponding image data processing device and a vehicle with a corresponding vision system.

[0002] For the general state of the art, reference is made to DE 10 2018 207 388 A1 and DE 10 2011 083 786 A1.

[0003] DE 10 2018 207 388 A1 discloses a method for generating a display image in a motor vehicle by means of a system having at least one camera, a processing unit and a display screen arranged in a motor vehicle with a brightness sensor that measures the ambient brightness on the display screen, wherein in the method, tonal value transfer parameters of the system are determined and applied by the processing unit and / or a control unit of the camera and / or a control unit of the display screen depending on the ambient brightness detected by the brightness sensor.

[0004] DE 10 2011 083 786 A1 discloses a method for automatic color matching in a vehicle with a camera system. The method comprises the following steps: providing illumination information about at least one vehicle-specific illumination source; and performing a color match based on the provided illumination information on image information provided by the camera system, as well as providing the color-corrected image information.

[0005] It is known in the art to equip vehicles with camera monitor systems (CMS) to facilitate vehicle operation. Such camera monitor systems typically comprise a monitor device connected to at least one camera device. The at least one camera device is usually designed to capture image data of the vehicle's surroundings, which is then displayed on the monitor device arranged in the vehicle.

[0006] The image quality settings, i.e., the image signal processor (ISP) settings, of camera-monitor systems are typically optimized for daylight scenarios. Using the same ISP settings for night driving often results in mediocre image quality (e.g., severe color noise, low dynamic range, over- or underexposure), which increases the risk of accidents due to fatigue, distraction, or misjudgment of the situation.

[0007] A common approach to addressing this problem is to change the operating settings of the monitor device, e.g., by reducing the brightness of the monitor device at night (dimming). Reducing the power of an LED backlight behind the display can prevent driver fatigue or distraction from a bright screen at night. However, the image content itself is usually not improved or adjusted. Consequently, image quality factors (key performance indicators), such as color noise, dynamic range, exposure, and / or white balance, remain inadequate.

[0008] The aim of the invention is to provide an improved method for providing image data, e.g., for a driver of a vehicle, preferably avoiding the disadvantages of conventional methods. Preferably, one aim of the invention is to provide image data of better image quality, in particular adapted to nighttime conditions and / or the current situation.

[0009] These objects are achieved by the subject matter of the independent claims. Preferred embodiments and applications of the invention are covered by the dependent claims.

[0010] According to a first independent aspect, a method for operating an image data processing device is provided. Preferably, the image data processing device is an image data processing device of a vision system (e.g., a mirror replacement system) of a vehicle.

[0011] The method comprises receiving image data captured by at least one image capture device. The at least one image capture device can be part of the vehicle and / or the vehicle's vision system. For example, the at least one image capture device can comprise one or more cameras, e.g., mounted on the vehicle. Preferably, the image data comprises rear view image data captured (e.g., from the side) next to and / or behind the vehicle. For example, the at least one image capture device can be configured to capture a Class II field of view, a Class IV field of view, and / or a Class V field of view in accordance with Directives 2003 / 97 / EC and 2007 / 38 / EC.

[0012] The method further comprises receiving a status signal that preferably indicates a daytime status or a nighttime status. The status signal can be generated by a status device of the vehicle and / or the vehicle's vision system. For example, the status device can be a brightness and / or light sensor. The brightness and / or light sensor can be configured to output a first status signal value that indicates a daytime status when the brightness of the vehicle's surroundings is above a predefined value, and to output a second status signal value that indicates a nighttime status when the brightness of the vehicle's surroundings is below this predefined value.

[0013] The method further comprises (e.g., automatically) processing (e.g., post-processing) of the received image data (e.g., by the image data processing device) depending on the received state signal. Consequently, the manner of processing the received image data may differ depending on the received state signal, in particular depending on whether the state signal indicates the day state or the night state. In this context, the processing step may comprise changing and / or changing image processing settings based on the received state signal. For example, the processing step may comprise adjusting a contrast and / or a brightness of the received image data. Preferably, the method further comprises outputting the processed image data, e.g., to a display device.

[0014] In contrast to known concepts in which only the display properties (e.g., the intensity of an LED backlight) of a monitor device are adapted (e.g., dimmed) to nighttime conditions, the current solution advantageously adapts the image content itself by appropriately processing the acquired image data. This advantageously enables significantly greater flexibility in actively modifying the image data by the image data processing device compared to simply adjusting the display appearance via the monitor device. This allows the image quality to be optimized (e.g., automatically) to a greater extent for the respective situation, enabling better adaptation of the provided image data to the driver's current needs.

[0015] According to a first aspect, the processing step may differ depending on whether the received state signal indicates the day state or the night state. For example, the processing step may comprise a day mode and a night mode. Preferably, the image processing settings used to process the received image data differ depending on whether the day state (e.g., day mode) or the night state (e.g., night mode) is met or present. For example, a contrast, a digital gain, and / or a white balance of the received image data may be changed depending on the received state signal and / or the present mode (e.g., day or night). This advantageously allows the image data to be adapted to the current lighting conditions.

[0016] According to a further aspect, the processing step may include adjusting (e.g., increasing and / or reducing) a contrast of the received image data. The term "contrast" may refer, for example, to the difference between light and dark areas of the image data. The contrast adjustment may be global (e.g., by influencing the entire tonal range of the image data) and / or local (e.g., by independently influencing areas of the image data).

[0017] Additionally or alternatively, the processing step may include adjusting (e.g., increasing and / or decreasing) a digital gain of the received image data. The term "digital gain" may, for example, refer to a factor by which the image data is amplified after the digitization process of the at least one image capture device. In contrast, the term "analog gain" may refer to the magnitude of the amplification of an output voltage of the photodetectors of the at least one image capture device prior to sampling by an analog-to-digital converter.

[0018] Additionally or alternatively, the processing step may comprise adjusting (e.g., increasing and / or decreasing) a noise filtering of the received image data. This may be done, for example, by using a denoising algorithm known per se, such as a spatial domain filter and / or a Wiener filter. In this context, the term noise filtering may, for example, refer to the removal of noise from the image data, in particular to the restoration of the "true" image. Preferably, adjusting the noise filtering (e.g., depending on the received state signal) comprises changing the degree to which the noise filtering is used and / or whether it is used at all.

[0019] According to a further aspect, the method may further comprise outputting (e.g., by the image data processing device) a control signal for the at least one image capture device depending on the received state signal. The control signal may cause the at least one image capture device to adjust at least one image capture setting (e.g., a frame rate, an (analog) gain, an exposure time, and / or an exposure threshold) of the at least one image capture device. For example, if the received state signal indicates the post-state, the output control signal may cause the at least one image capture device to reduce the frame rate (e.g., from 50 fps to 25 fps) and / or increase the exposure time.In addition to the already mentioned adjustment of the image processing settings, this aspect advantageously allows for an active change in the way in which the (e.g. raw) image data is acquired, thereby further increasing the flexibility to adapt / optimize the image quality to the current conditions.

[0020] According to the invention, the method further comprises receiving a situation signal. The situation signal can be generated by a situation recognition device of the vehicle and / or the vision system of the vehicle. The situation signal can indicate a current speed of the vehicle, a gear selection of the vehicle (e.g., forward or reverse), and / or an operating state of the vehicle (e.g., maneuvering, cornering, and / or driving on a highway). The processing step is further dependent on the received situation signal. Preferably, the processing of the received image data can therefore depend on the received state signal and the received situation signal. For example, processing in night mode can depend on whether the vehicle is reversing into a parking space or traveling on a highway. While in the first case, for example, the contrast and brightness of the image data (e.g.,In one case, the contrast and brightness of the image data (in the night mode / night settings) can be increased by the image data processing device (e.g., so that the driver can perceive as many details as possible). In the second case, the contrast and brightness of the image data (in the night mode / night settings) can be reduced (e.g., so that the driver is less distracted). This advantageously allows the image quality to be optimally adapted to the respective driving situation, so that the driver's situational awareness can be improved for various scenarios.

[0021] According to a further aspect, the step of processing (e.g., the received image data) may include reducing a contrast, a digital gain, and / or a brightness of the received image data if the received situation signal indicates a long-distance journey of the vehicle. The corresponding situation signal may be generated, for example, if the vehicle is traveling at a speed exceeding 60 km / h. This has the advantage that the driver is not fatigued and / or distracted by the displayed image data.

[0022] Additionally or alternatively, the step of processing (e.g., the received image data) may also include increasing the contrast, digital gain, and / or brightness of the received image data if the received situation signal indicates maneuvering (e.g., parking) of the vehicle. The corresponding situation signal can be generated, for example, when the vehicle is reversing and / or traveling at a speed below 25 km / h. This has the advantage that the driver can clearly identify objects and / or obstacles in the displayed image data.

[0023] According to a further aspect, the method further comprises selecting an image data processing mode from predefined possible image data processing modes depending on the received situation signal. For example, the predefined possible image data processing modes can comprise at least three, preferably at least four, (e.g., different) predefined possible image data processing modes. The predefined possible image data processing modes can comprise, for example, a reversing mode, a highway mode, a maneuvering mode, and / or an urban mode. Each of the predefined possible image data processing modes can preferably be associated with a specific type of processing of the received image data and / or specific image processing settings. The processing step can be performed according to the selected image data processing mode.This advantageously allows for optimal adaptation of the image quality to the respective driving situation.

[0024] According to a further aspect, the predefined possible image data processing modes may include a reversing mode. The reversing mode may, for example, include generating a wide-angle view of the received image data. Preferably, in the reversing mode, only rearward image data is processed during the processing step. This can be achieved by selecting (e.g., only) the rearward image data from the received image data and / or by controlling the at least one image capture device such that (e.g., only) rearward image data is received from the image data processing device. This has the advantage that the driver can obtain a wide overview of the rear area, allowing them to easily identify possible objects or obstacles.

[0025] Additionally or alternatively, the predefined possible image data processing modes may include a highway driving mode. The highway driving mode may, for example, include generating a zoom view of the received image data. Preferably, the zoom view focuses on a specific area of ​​the acquired image data, e.g., a distant area of ​​the vehicle's surroundings. By way of example only, the step of processing according to the highway driving mode may include processing the received image data such that the Class II field of view is enlarged and / or the Class V field of view is reduced. This has the advantage that the relevant area of ​​interest can be displayed to the driver without additional distracting information about the immediate surroundings.

[0026] Additionally or alternatively, the predefined possible image data processing modes may include a maneuvering mode. The maneuvering mode may, for example, include generating a wide-angle view of the received image data. Preferably, the step of processing according to the maneuvering mode may include processing the received image data such that the information about the lateral area next to the vehicle is enlarged and / or highlighted. By way of example only, the step of processing according to the maneuvering mode may include processing the received image data such that the Class II field of view is enlarged while the Class IV field of view is reduced. This has the advantage of providing the driver with a wide overview of the lateral area, allowing them to easily identify possible objects or obstacles, e.g., during a turning maneuver.

[0027] According to a further aspect, the predefined possible image data processing modes may also include a default mode (e.g., an urban driving mode). The default mode may, for example, be activated by default unless the received situation signal indicates a specific operating state of the vehicle, e.g., reversing, highway driving, and / or maneuvering. In this context, the aforementioned reversing mode may preferably have a higher contrast, a higher brightness, and / or a higher digital gain compared to the default mode. Additionally or alternatively, the aforementioned highway driving mode may preferably have a lower contrast, a lower brightness, and / or a lower digital gain compared to the standard mode.Additionally or alternatively, the aforementioned maneuvering mode may feature higher contrast, higher brightness, and / or higher digital gain compared to the standard mode. This advantageously allows for avoiding distraction or fatigue in driving situations where little additional image information is required, while still providing clearly recognizable image information in parking and / or turning situations.

[0028] According to another aspect, the received image data may comprise data relating to different fields of view. For example, the received image data may comprise a Class II field of view, a Class II field of view, a Class IV field of view, a Class V field of view, and / or a Class VI field of view (e.g., according to Directive 2003 / 97 / EC and 2007 / 38 / EC). The different fields of view preferably correspond to different viewing directions and / or views of the vehicle surroundings of a driver sitting in the driver's seat of the vehicle in a normal driving position. Additionally or alternatively, the different fields of view preferably correspond to views of the driver that would actually be displayed in (e.g., legally required) mirror devices of the vehicle. In this context, the step of processing (e.g.,The processing of the received image data preferably comprises merging the various fields of view into a combined view. For example, the various fields of view can be combined and / or joined together. The combined view preferably provides a (possibly distorted) visualization of the various fields of view in a single image, preferably continuous. This has the advantage that the driver can be provided with a single representation of the vehicle's surroundings that contains the relevant information for safe vehicle control.

[0029] According to a further aspect, the relative areas of the various fields of view in the combined view are varied depending on the selected image processing mode. Preferably, the merging step comprises varying the relative areas of the various fields of view in the combined view depending on the selected image processing mode. The term "relative area" can, for example, correspond to the relative areas that the various views are intended to occupy when displayed (e.g., on the display device).

[0030] For example, in Highway Mode, the Class V field of view or a portion of the Class V field of view may be reduced (e.g., reduced) compared to Standard Mode. In other words, the various fields of view may be merged in Highway Mode such that the Class V field of view occupies a smaller area of ​​the combined view than in Standard Mode. Additionally or alternatively, in Highway Mode, the Class IV field of view and / or the Class II field of view may be enlarged (e.g., enlarged and / or displayed larger) compared to Standard Mode.

[0031] Additionally or alternatively, in maneuvering mode, the Class V field of view or a section of the Class V field of view can be enlarged (e.g., enlarged and / or displayed larger) compared to standard mode. In other words, the different fields of view can be merged in maneuvering mode so that the Class V field of view occupies a larger area of ​​the combined view than is the case in standard mode. Additionally or alternatively, in maneuvering mode, the Class IV field of view and / or the Class II field of view can be reduced (e.g., reduced) compared to standard mode. This advantageously enables the driver to have relevant information about the vehicle's surroundings available to them in a situation-appropriate manner, so that the areas that are particularly relevant to the current situation can be displayed larger.

[0032] According to a further aspect, the method may further comprise receiving a display brightness signal from a display device. The display brightness signal may, for example, indicate the brightness of a display (e.g., an LCD display) of the display device, in particular the brightness of a backlight of a display of the display device. Preferably, the display brightness signal indicates a (e.g., manually adjusted or adjustable) brightness value of the display. In this context, the processing step may be performed depending on the received display brightness signal.Preferably, the processing step is performed as a function of the received display brightness signal, such that a contrast of the received image data is increased when the display brightness signal indicates an increase in the brightness of the display and / or a contrast of the received image data is decreased when the display brightness signal indicates a decrease in the brightness of the display. Thus, the processing and / or image processing settings can be coupled with a (e.g., manual) brightness adjustment of the display of the display device. This has the advantage of enabling a synergistic interaction between the brightness of the backlight and the image processing settings.

[0033] According to a further aspect, the method may further comprise receiving a user request signal. The user request signal may be generated by a control unit of the vehicle and / or the vision system of the vehicle. For example, the control device may be arranged on the display device and / or integrated into the display device. For example, the control device may be designed as a touch-sensitive surface of the display device. The user request signal may preferably indicate a command and / or a request from a user. In this context, the method may further comprise adapting the image processing settings (e.g., of the image data processing device), which are used, for example, to process the received image data, depending on the received user request signal. This may, for example, involve selecting a different (e.g.,currently not selected) image data processing mode and / or adapting the (e.g., currently) selected image data processing mode depending on the received user request signal. Advantageously, the image data processing mode can thereby be actively selected and / or changed by a user. Additionally or alternatively, the method and / or the step of adapting the image processing settings can comprise adapting a contrast, a digital gain, and / or a noise filtering of the received image data depending on the received user request signal. Advantageously, the user can thereby actively adapt the processing of the received image data.Additionally or alternatively, the method and / or the step of adjusting the image processing settings may comprise adjusting a portion of the received image data to be displayed depending on the received user request signal. For example, the user may switch from a zoom view to a wide-angle view and vice versa.

[0034] According to a further aspect, the method can further comprise outputting the processed image data (e.g., by the image data processing device). For example, the image data processing device can have a corresponding output at which the processed image data can be provided. Preferably, the processed image data is output for display on a display device. For example, the processed image data can be output in a data format readable by the display device. The display device can be part of the vehicle and / or the vision system (e.g., the mirror replacement system) of the vehicle. The processed image data can comprise image data of the Class II field of view, the Class IV field of view, and / or the Class V field of view. The display device can be configured to simultaneously display the Class II field of view, the Class IV field of view, and / or the Class V field of view, e.g.,on the same monitor and / or display device.

[0035] According to the invention, the method further comprises generating a zoom view and / or a wide-angle view of the received image data depending on the received situation signal. The zoom view preferably focuses on a specific area of ​​the recorded image data, while the wide-angle view preferably represents the entire capture area of ​​the at least one image capture device. This advantageously enables a situation-specific viewing of the received image data.

[0036] According to a further independent aspect, a vision system is provided. Preferably, the vision system is a vision system for a vehicle (e.g., a car or truck).

[0037] The vision system has at least one image capture device (e.g., a camera) configured to capture image data. The image data preferably comprises rear view image data recorded (e.g., laterally) next to and / or behind the vehicle. The at least one image capture device may be part of the vehicle and / or arranged on the vehicle. For example, the at least one image capture device may be mounted in or on a camera arm extending laterally outward from the vehicle body. Particularly preferably, the at least one image capture device is configured to capture one or more legally prescribed fields of view, e.g., a Class II field of view, a Class IV field of view, and / or a Class V field of view in accordance with Directives 2003 / 97 / EC and 2007 / 38 / EC.

[0038] The vision system further comprises a status device (e.g., a brightness and / or light sensor). The status device is configured to generate a status signal that preferably indicates a daytime status or a nighttime status. The status device can be part of the vehicle and / or arranged on the vehicle.

[0039] The image processing system further comprises an image data processing device (e.g., a processor). The image data processing device is configured to receive the captured image data and the generated status signal. For this purpose, the image data processing device can be connected to the at least one image capture device and the status device, e.g., via corresponding wired or wireless signal connections. The image data processing device is further configured to process the received image data depending on the received status signal. For example, the image data processing device can be configured to perform a method as described in this document. Consequently, the aspects described herein in connection with the method are also intended to be disclosed and claimable in connection with the vision system just described; the same applies vice versa.

[0040] According to one aspect, the vision system may further comprise a display device. The display device may be configured to display the processed image data. For example, the display device may comprise a display (e.g., an LCD display) that is preferably configured to display the processed image data. The display device may be part of the vehicle and / or arranged on the vehicle. For example, the display device may be arranged in a driver's cab of the vehicle and / or in a cockpit of the vehicle, preferably in the driver's field of vision. The display device may be connected to the image data processing device, e.g., via a wired or wireless signal connection. As previously described, the display device may be configured to display different fields of vision, e.g., the Class II field of vision, the Class IV field of vision, and / or the Class V field of vision, simultaneously, e.g.,on one and the same display of the display device.

[0041] According to a further independent aspect, a vehicle (e.g., motor vehicle) is provided. Preferably, the vehicle may be a commercial vehicle, such as a truck or a bus. For example, due to its construction and equipment, the vehicle may be specifically designed for transporting goods, transporting persons, and / or towing one or more (e.g., agricultural) trailers. The vehicle comprises a vision system as described herein. Consequently, the aspects described herein in connection with the vision system and the method are also intended to be disclosed and claimable in connection with the vehicle, and the same applies vice versa.

[0042] According to one aspect, the at least one image capture device can be configured to capture different fields of view, preferably a Class II field of view, a Class IV field of view, and / or a Class V field of view (e.g., according to Directive 2003 / 97 / EC and 2007 / 38 / EC). The at least one image capture device can, for example, comprise a plurality of cameras, which are, for example, mounted in or on a common camera arm. The plurality of cameras can be differently aligned and / or each have different viewing angles. In this context, the image data processing device can be configured to select image data from a subset of the plurality of cameras and / or to merge / combine the image data from the plurality of cameras.

[0043] Additionally or alternatively, the image processing system can be part of a mirror replacement system of the vehicle, in particular an exterior mirror replacement system. The term mirror replacement system can, for example, refer to a (e.g., generally known) driver assistance system in which (e.g., legally required) mirror devices (e.g., an exterior rearview mirror) of the vehicle are replaced by one or more image capture devices, wherein the captured images of these image capture devices are displayed on a display device in the vehicle. In this case, the image capture devices capture, in particular, a section of the vehicle's surroundings that would actually be displayed in the respective (e.g., legally required) mirror device. For example, the at least one image capture device can be designed to capture image data that is assigned to a main exterior rearview mirror (e.g., field of view II), a wide-angle exterior rearview mirror (e.g.,Field of view IV) and / or a near-field or ramp mirror (e.g., field of view V). Consequently, the at least one image capture device can comprise and / or be at least one mirror-replacement image capture device.

[0044] Additionally or alternatively, the image processing system may be capable of displaying a panoramic view of the vehicle's surroundings on the display device. The term panoramic view, which may also be referred to as a bird's-eye view, may refer, for example, to a (e.g., generally known) driver assistance system in which the driver is provided with a (e.g., artificial) image of the vehicle's surroundings and / or the vehicle from a bird's-eye view. The at least one image capture device may comprise a plurality of surroundings cameras (e.g., including a front camera, a rearview camera, and / or at least one side camera), wherein the surroundings cameras may preferably be oriented in different directions.Additionally or alternatively, the at least one image capture device can be part of a combination of two or more image capture devices, whose image data is merged / combined to create a bird's-eye view of the vehicle. In this context, the at least one image capture device can preferably comprise at least four image capture devices (e.g., surround-view cameras).

[0045] The above-described aspects and features of the disclosure can be combined in any desired manner. Further details and advantages are described below with reference to the accompanying figures. The figures show: Fig. 1 is a schematic representation of a vehicle according to an embodiment; Fig. 2 shows two schematic representations of processed image data in standard mode according to an embodiment, using different image processing settings; Fig. 3 two schematic representations of processed image data in highway driving mode, using different image processing settings; and Fig. 4 schematic representations of the processed image data in standard mode, shunting mode and highway mode.

[0046] The Fig. 1, Fig. 2, Fig. 3 and Fig. 4 correspond at least partially, so that similar or identical parts are provided with the same reference numerals and for their explanation reference is also made to the description of the other embodiments or figures in order to avoid repetition.

[0047] Fig. 1 shows a vehicle 20 according to an embodiment of the disclosure. For example only, the vehicle 20 is shown in Fig. 1 is depicted as a truck. However, the vehicle 20 can be any type of vehicle, such as a car, a bus, a construction machine, an agricultural machine, or the like.

[0048] The vehicle 20 has at least one image capture device 12, a status device 14 and an image data processing device 16.

[0049] The aforementioned components can be connected to one another. For example, the image data processing device 16 can be connected to the at least one image capture device 12 and the status device 14, e.g., via corresponding signal connections (dashed lines). Each of the signal connections can be a cable connection and / or a wireless connection.

[0050] Furthermore, the at least one image capture device 12, the state device 14, and the image data processing device 16 can form a vision system 10 and / or be part of a vision system 10 (e.g., a mirror replacement system) of the vehicle 20. Thus, the vehicle 20 can have a vision system 10 that includes the at least one image capture device 12, the state device 14, and the image data processing device 16.

[0051] The at least one image capture device 12 can be configured to capture image data (e.g., in real time). The at least one image capture device 12 can, for example, comprise one or more cameras. The one or more cameras can be mounted in or on a camera arm that preferably extends laterally and externally from the vehicle body (e.g., laterally and externally from a driver's cab of the vehicle). The at least one image capture device 12 can comprise at least one image sensor (e.g., a CMOS image sensor and / or a CCD image sensor). The at least one image capture device 12 can comprise one or more optical elements (e.g., a lens, a mechanical shutter, an electrical shutter, and / or an aperture).

[0052] The at least one image capture device 12 can be designed to capture optical information about the surroundings of the vehicle. In particular, the at least one image capture device 12 can be designed to capture forward-facing image data (of the vehicle surroundings) in front of the vehicle 20, to capture lateral image data (of the vehicle surroundings) next to (e.g., to the left and / or right of) the vehicle 20, and / or to capture rearward-facing image data (of the vehicle surroundings) behind the vehicle 20. Preferably, the at least one image capture device 12 can be designed to capture a rearward-facing side view of the surroundings of the vehicle (along the vehicle 20). This rearward-facing side view can (e.g.,Due to the arrangement of the at least one image capture device 12 in front of the windshield of the vehicle 20, the image capture device 12 can at least partially also include areas of the vehicle's surroundings that are (directly) in front of and / or to the side of the vehicle. The at least one image capture device 12 can be designed to capture fields of vision of the vehicle's surroundings, e.g., those legally prescribed under Directives 2003 / 97 / EC and 2007 / 38 / EC.

[0053] For example, the at least one image capture device 12 may be configured to capture a Class II field of view, which may include a distant rear view laterally along the vehicle 20. The Class II field of view may correspond to a field of view typically captured by a main exterior mirror of the vehicle 20.

[0054] Additionally or alternatively, the at least one image capture device 12 can be configured to capture a Class IV field of view, which can include a (rearward-facing) wide-angle view of the lateral surroundings of the vehicle 20. Compared to the Class II field of view, the Class IV field of view can cover a shorter but wider lateral portion of the vehicle's surroundings. The Class IV field of view can correspond to a field of view typically captured by a wide-angle exterior mirror of the vehicle 20.

[0055] Additionally or alternatively, the at least one image capture device 12 may be configured to capture a Class V field of view, which may include a close-up view of a lateral area adjacent to (and possibly partially in front of) a cab of the vehicle 20, in particular a lateral area adjacent to the passenger side of the vehicle 20 and / or the cab of the vehicle 20. The lateral area may begin at the front edge of the vehicle 20. The Class IV field of view may correspond to a field of view typically captured by a ramp mirror and / or a side-area safety mirror of the vehicle 20.

[0056] Consequently, the (received) image data may comprise Class II field of view image data, Class IV field of view image data, and / or Class V field of view image data. Additionally or alternatively, the (received) image data may also comprise Class I field of view image data and / or Class III field of view image data.

[0057] Furthermore, the at least one image capture device 12 can comprise a plurality (e.g., four) image capture devices 12. The plurality of image capture devices 12 can be distributed across the vehicle 20. The various image capture devices 12 can be oriented differently and / or each have different fields of observation. For example, the at least one image capture device 12 can comprise a rearview camera, a front camera, and / or a side-view camera. The at least one image capture device 12 or the plurality of image capture devices 12 can be part of a mirror replacement system of the vehicle 20 (e.g., replacement of an exterior rearview mirror) and / or a bird's-eye view system of the vehicle 20.

[0058] The status device 14 can be configured to generate and / or output a status signal. Preferably, the status signal can indicate a daytime status or a nighttime status. Additionally or alternatively, the status signal can also indicate a light status of the vehicle's surroundings. For example, the status signal can have a first status signal value when the brightness of the vehicle's surroundings is above a predefined value and a second when the brightness of the vehicle's surroundings is below this predefined value. In this context, the status device 14 can comprise a brightness and / or light sensor. Additionally or alternatively, the status device 14 can also comprise a clock, a timer, and / or an interface configured to receive an external input indicating a daytime status and / or a nighttime status.

[0059] The image data processing device 16 may be configured to receive inputs from the at least one image capture device 12 and the status device 14. In particular, the image data processing device 16 may be configured to receive the captured image data from the at least one image capture device 12 and the generated status signal from the status device 14. The image data processing device 16 may include a memory and / or at least one processor (e.g., an image signal processor - ISP) for processing images and / or image data. The memory may be configured to store instructions that can be executed by the at least one processor.

[0060] The image data processing device 16 can be configured to process the received image data. For example, the image data processing device 16 can be configured to modify the received image data (e.g., a quality and / or performance indicator of the received image data) through image processing. Preferably, the image data processing device 16 can be configured to adjust or modify a contrast, digital gain, noise filtering, white balance, luminance, brightness, and / or sharpness of the received image data.

[0061] The image data processing device 16 can be designed to process the received image data depending on the received status signal. Thus, the image data processing device 16 can be designed to process the received image data differently depending on the received status signal, which can be achieved in connection with the Fig. 2, Fig. 3 and Fig. 4 will be described in more detail. In particular, the processing may differ depending on whether the received status signal indicates the daytime status or the nighttime status. For example, the received status signal may trigger a day or night mode of the image data processing device 16 for processing the received image data. Depending on the status signal and / or the respective mode (day or night mode), the image processing settings for processing the received image data may vary. For example, the image data processing device 16 may be configured to adjust the contrast, digital gain, noise filtering, white balance, luminance, brightness, and / or sharpness of the received image data depending on the received status signal and / or the mode.In particular, the image data processing device 16 can be configured to optimize the image quality for the daytime state and / or the nighttime state. For example, the image data processing device 16 can be configured to increase the contrast and / or decrease the brightness of the received image data if the received state signal indicates the nighttime state.

[0062] Furthermore, the image data processing device 16 can be configured to output a control signal to the at least one image capture device 12. The control signal can cause the at least one image capture device 12 to change and / or adapt at least one image acquisition setting of the at least one image capture device 12. In this context, the term image acquisition setting can refer, for example, to (hardware or software) settings of the at least one image capture device 12 that determine the manner in which the (e.g., raw) image data is captured by the at least one image capture device 12. For example, the at least one image acquisition setting can include a frame rate, an (analog) gain, a black level, an exposure time, and / or an exposure threshold of the at least one image capture device 12.The frame rate can specify a number of images per second that the at least one image capture device 12 attempts to deliver. The black level can define a brightness level corresponding to the darkest value of the at least one image capture device 12. By adjusting the black level, a possible dark current can be compensated. The exposure time can specify a period of time in which the at least one image capture device 12 collects photons for each image. The exposure threshold can define a level at which saturation of the at least one image capture device 12 is reached. Additionally or alternatively, the at least one image capture setting can also include a focus and / or an aperture of the at least one image capture device 12.

[0063] In particular, the image data processing device 16 can be designed to output the control signal to the at least one image capture device 12 as a function of the received signal. Thus, the image data processing device 16 can be designed to output the control signal differently as a function of the received status signal, which in connection with the Fig. 2, Fig. 3 and Fig. 4 will be described in more detail. For example, the output can be different depending on whether the received status signal indicates the daytime or nighttime status.

[0064] Furthermore, the vehicle 20 can have a situation recognition device 15. The situation recognition device 15 can be connected to the image data processing device 16, e.g., via a corresponding signal connection (dashed line). The situation recognition device 15 can be part of a vision system 10 of the vehicle 20. Thus, the vision system 10 can further have the situation recognition device 15.

[0065] The situation detection device 15 can be configured to generate and / or output a situation signal. The situation signal can indicate a (e.g., current) speed, a gear selection, and / or an operating state of the vehicle 20. For this purpose, the situation detection device 15 can be connected to corresponding control units and / or sensor units of the vehicle 20, e.g., a speed sensor, a gear position sensor, and / or a steering angle sensor. Furthermore, the situation detection device 15 can be configured to receive position data from a (e.g., GPS) positioning system of the vehicle. The situation detection device 15 can be configured to generate and / or output the situation signal based on the information received from the control units, sensor units, and / or the positioning system.

[0066] The situation signal generated by the situation detection device 15 can, for example, have a first situation signal value indicating that the vehicle 20 is traveling backward, e.g., when a reverse gear of the vehicle 20 is engaged. The situation signal can have a second situation signal value indicating that the vehicle 20 is traveling on a highway, e.g., when the speed of the vehicle 20 exceeds 60 km / h or 100 km / h. The situation signal can have a third situation signal value indicating that the vehicle 20 is maneuvering, e.g., when the speed of the vehicle 20 is below 25 km / h and / or (strong) steering movements are present.

[0067] The image data processing device 16 can further be configured to process the received image data depending on the received situation signal. Thus, the image data processing device 16 can be configured to process the received image data differently depending on the received situation signal. For example, the received situation signal can trigger different image data processing modes of the image data processing device 16 for processing the received image data. For example, the night mode can adapt (automatically) to different situations and / or operating states of the vehicle 20 (at night) depending on the situation signal. The image processing settings can change (automatically) for different driving speeds and directions of travel (forward / backward).

[0068] For example, various predefined image data processing modes can be stored and / or defined in the image data processing device 16. The predefined image data processing modes can, for example, have at least three, preferably at least four, predefined image data processing modes. The various predefined image data processing modes can define different image processing settings that are used for processing the received image data. The image data processing device 16 can be designed to select an image data processing mode from the predefined possible image data processing modes depending on the received situation signal. This can be done via predefined rules or assignment tables that assign different values ​​of the situation signal to a corresponding image data processing mode. Additionally or alternatively, an optimization method (e.g.a gradient-based Newton method and / or genetic optimization). Furthermore, the image data processing device 16 can be configured to process the received image data according to the selected image data processing mode. For example, the manner in which the received image data is processed and / or the image processing settings used can vary depending on the selected image data processing mode.

[0069] The predefined image processing modes may include, for example, a standard mode, a reversing mode, a highway mode, and / or a maneuvering mode.

[0070] The standard mode used in Fig. 2, may, for example, be an urban driving mode. The standard mode may be activated by default unless the situation signal indicates a different operating state of the vehicle, e.g., reversing, highway driving, and / or maneuvering. Additionally or alternatively, the standard mode may be selected by the image data processing device 16 if the received situation signal indicates urban driving of the vehicle. For example, the situation signal may have a fourth situation signal value indicating urban driving of the vehicle, e.g., if the speed of the vehicle 20 is between 25 km / h and 60 km / h.

[0071] In standard mode, the image data processing device 16 can be configured to generate a combined view of the received image data (in a single image). For this purpose, different fields of view contained in the received image data can be combined. In particular, as in Fig. As shown in Figure 4, the image data from the Class II fields of view, the Class IV fields of view, and the Class V fields of view are combined and / or concatenated into a single image. In this context, the image data or the processed image data may contain distortions and / or deformations (e.g., perspective).

[0072] The reverse mode can be selected by the image data processing device 16 when the received situation signal indicates that the vehicle 20 is traveling in reverse. In the reverse mode, the image data processing device 16 can be configured to generate a wide-angle view of the received image data. Preferably, the received image data can comprise rearward image data (e.g., recorded by a rearview camera). Particularly preferably, only rearward image data is processed during the step of processing in the reverse mode. In the reverse mode, the image data processing device 16 can further be configured to increase a contrast, a brightness, and / or a digital gain of the received image data compared to a contrast, a brightness, and / or a digital gain in the standard mode.

[0073] The motorway driving mode, which is Fig. 3 and Fig. 4, can be selected by the image data processing device 16 when the received situation signal indicates motorway travel of the vehicle 20. In motorway travel mode, the image data processing device 16 can be configured to generate a zoom view of the received image data. The term zoom view can refer, for example, to a view that focuses on a specific area of ​​the acquired image data, e.g., a specific area of ​​the external environment of the vehicle 20. The zoom view can include an enlarged and / or expanded representation of portions of the acquired image data. As shown in Fig. As shown in Figure 4, in highway mode, the Class V field of view can be reduced (e.g., reduced) compared to standard mode and / or maneuvering mode. The received image data can be processed to minimize information about the surroundings of the vehicle to the front and the side and maximize information about the surroundings of the vehicle to the rear. In highway mode, the image data processing device 16 can further be configured to reduce the contrast, brightness, and / or digital gain of the received image data compared to the contrast, brightness, and / or digital gain in standard mode.

[0074] The maneuvering mode can be selected by the image data processing device 16 when the received situation signal indicates maneuvering of the vehicle 20. In the maneuvering mode, the image data processing device 16 can be configured to generate a wide-angle view of the received image data. As shown in Fig. 4, the Class V field of view can be enlarged compared to the standard mode and / or the highway driving mode. Furthermore, the Class IV field of view and / or the Class II field of view can be reduced (e.g., reduced) compared to the standard mode and / or highway driving mode. Furthermore, the image data processing device 16 can be configured in the maneuvering mode to increase the contrast, brightness, and / or digital gain of the received image data compared to the contrast, brightness, and / or digital gain in the standard mode. The coupling can be asymmetrical, i.e., the contrast can be increased much more (during maneuvering) than it can be decreased (during highway and / or long-distance driving).

[0075] Furthermore, the vehicle 20 can have a display device 18. The display device 18 can be connected to the image data processing device 16, e.g., via a corresponding signal connection (dashed line). The display device 18 can be part of the vision system 10 of the vehicle 20. Thus, the vision system 10 can also have the display device 18.

[0076] The display device 18 can be configured to display the processed image data (e.g., in real time, i.e., the situation displayed on the display device 18 preferably corresponds to the actual situation outside the vehicle 20). The display device 18 can be configured to receive the processed image data from the image data processing device 16. The display device 18 can have a display (e.g., an LCD display) and / or a monitor. The display and / or monitor can be touch-sensitive (e.g., configured as a touchscreen). The processed image data can be displayable on a monitor and / or display of the display device 18.

[0077] The display device 18 can be arranged on a dashboard of the vehicle 20. Alternatively, the display device 18 can also be arranged on an A-pillar of the vehicle 20. The display device 18 and / or the entire vision system 10 can be part of a mirror replacement system of the vehicle 20. Thus, the display device 18 can be designed to display an area of ​​the vehicle's surroundings that is normally visible via a (non-existent) mirror of the vehicle 20. The display device 18 can be permanently active during operation of the vehicle 20. Additionally or alternatively, the display device 18 and / or the entire vision system 10 can be operable to display a panoramic view (or bird's-eye view) of the vehicle's surroundings.

[0078] The display device 18 can have a dimmer to adjust the brightness of the display and / or the monitor of the display device 18. The dimmer can be designed, for example, as a rotary knob and / or button on the display device 18. However, the dimmer can also be designed as a (virtual) button that is displayed on the (touch-sensitive) display and / or monitor. The display device 18 can be designed to generate and / or output a display brightness signal. The display brightness signal can indicate a (current) brightness of the display and / or the monitor of the display device 18. For example, the display brightness signal can be proportional to an adjustment or setting of the dimmer. The display brightness signal can, in particular, indicate a brightness of a backlight of a display and / or a monitor of the display device 18.In particular, the image data processing device 16 can be configured to process the received image data depending on the received display brightness signal. Thus, the image data processing device 16 can be configured to process the received image data differently depending on the received display brightness signal. For example, the image processing settings can be coupled to the dimmer, i.e., the manual brightness adjustment of the display. In particular, the image data processing device 16 can be configured to increase the contrast of the received image data if the display brightness signal indicates an increase in the brightness of the display, and / or to decrease the contrast of the received image data if the display brightness signal indicates a decrease in the brightness of the display.Additionally or alternatively, the display brightness signal can be asymmetrically coupled to the image processing settings.

[0079] Furthermore, the display device 18 and / or the vehicle 20 can have a control device 17. The control device 17 can, for example, have one or more touchscreens, a button, or a switch. The control device 17 can be arranged on the display device 18 and / or integrated into it. Thus, the control device 17 can be part of the vision system 10 of the vehicle 20.

[0080] The control device 17 can be configured to generate and / or output a user request signal, e.g., based on inputs and / or actuations of the control device 17. The user request signal can indicate a command and / or a request from a user, e.g., in connection with the (post-)processing of the received image data. For example, the user request signal can indicate a selection and / or adjustment of an image data processing mode, a change in image processing settings, and / or a change and / or selection of a view (e.g., a zoom or wide-angle view).

[0081] The image data processing device 16 can be configured to process the received image data depending on the received user request signal. Thus, the processing of the image data processing device 16 can be actively changed and / or adjusted by a user. The image data processing device 16 can be configured to adjust the image processing settings depending on the received user request signal. In addition to or as an alternative to automatic adjustment, the driver can thus preferably also manually control the scope of the image processing settings. For example, the image processing settings of the night mode can be manually adjusted by the driver.

[0082] For example, the image data processing device 16 can be configured to adapt the selected image data processing mode depending on the received user request signal and / or to select a different image data processing mode depending on the received user request signal. For example only, the user can request a change from the reversing mode to the maneuvering mode (manually), e.g., by performing a corresponding control action on the control device 17 (e.g., by pressing a maneuvering mode button on the control device 17). The control device 17 can then generate and output a corresponding user request signal indicating the aforementioned change in the image data processing mode, and the image data processing device 16 can be configured to change the respective image data processing mode based on the received user request signal.

[0083] Additionally or alternatively, the image data processing device 16 can be configured to adjust the contrast, digital gain, noise filtering, white balance, luminance, brightness, and / or sharpness of the received image data depending on the received user request signal. For example, the user can (manually) request a change in the contrast of the (displayed) image data, e.g., by performing a corresponding control action on the control device 17 (e.g., by pressing a contrast key on the control device 17). The control device 17 can then generate and output a corresponding user request signal indicating the aforementioned change in contrast, and the image data processing device 16 can be configured to change the contrast of the received image data based on the received user request signal.

[0084] Additionally or alternatively, the image data processing device 16 can also be configured to adapt a region of the received image data to be displayed depending on the received user request signal. For example, the image data processing device 16 can be configured to adapt an image region generated from the received image data and / or a view generated from the received image data for display depending on the received user request signal. In particular, the image data processing device 16 can be configured to generate a zoom view or wide-angle view of the received image data depending on the received user request signal. For example, the user can (manually) request a change of the view from a currently (displayed) zoom view to a wide-angle view, e.g., by executing a corresponding control action on the control device 17 (e.g.,by pressing a wide-angle view button of the control device 17). The control device 17 can then generate a corresponding user request signal indicating the aforementioned change in view, and the image data processing device 16 can be configured to generate a wide-angle view of the received image data based on the received user request signal.

[0085] Fig. 2 shows an example of processed image data (e.g., displayed on the display device 18) in standard mode. The left and right images show the same recording situation or the same received image data (raw data), but with different image processing settings when processing the received image data. For reasons of clarity, the differences primarily concern the image brightness, but this should not be construed as a limitation. As can be seen, both processed image data show, by way of example, a view of a city center street at night, with the received image data in this exemplary case comprising rear image data. By way of example, parts of the side surface of the vehicle 20 can be seen on the left parts of the left and right images, respectively.Comparing the respective images, it can be seen that in the left image, essentially only the road 22 can be seen, which is illuminated by another vehicle 21 behind the vehicle 20, while the surroundings of the road 22 are relatively dark. In the right image, the image processing settings are changed so that the overall brightness of the image is increased and more details in the surroundings of the road 22 (e.g., parked cars) can be better recognized. By default, only one standard setting of the image processing settings can be used (e.g., the settings that result in the left or right image). However, it may be possible for the driver to manually adjust the image processing settings, e.g., via the vehicle's control unit and / or the vehicle's vision system, which in this exemplary case results in the respective other image (right or left).Furthermore, it should be mentioned again that other image processing settings, such as contrast, digital gain and / or sharpness of the received image data, can also be changed, but these are difficult to represent in a line drawing.

[0086] Fig. Figure 3 shows an example of processed image data (e.g., displayed on the display device 18) in highway driving mode. Here, too, the left and right images show the same recorded situation or received image data (raw data), but with different image processing settings used in processing the received image data. As in the case of Fig. 2, the different image processing settings primarily relate to image brightness for reasons of representability, although this should not limit the subject matter in any way. As can be seen, both processed image data exemplify a zoom view of a nighttime motorway situation, with the received image data in this exemplary case comprising rearward image data. Comparing the respective images, it can be seen that in the left-hand image, another vehicle 21 can be seen driving behind the vehicle 20, but the driver is not excessively dazzled by the light of the other vehicle 21 because the overall brightness is reduced. In contrast, in the right-hand image, the image processing settings are changed such that the overall brightness of the image is increased, which results in a very bright image being displayed on the display device 18.By default, a standard image processing setting may be used (e.g., the settings that result in the darker left image). However, it may be possible for the driver to manually adjust the image processing settings, e.g., via the vehicle's control unit and / or the vehicle's vision system, resulting in the image on the right in this example. Furthermore, it should be noted again that other image processing settings, such as contrast, digital gain, and / or sharpness of the received image data, can also be changed, but these are difficult to represent in a line drawing.

[0087] Fig.Figure 4 shows schematic representations of processed image data in standard, maneuvering, and highway mode, where the processed image data has different fields of view. In this example, the processed image data (and the received image data) comprises image data relating to a Class II field of view, a Class IV field of view, and a Class V field of view of the vehicle's surroundings in accordance with Directives 2003 / 97 / EC and 2007 / 38 / EC. In the processing step, the different fields of view may be combined into a combined view, whereby the relative areas of the different fields of view in the combined view may vary depending on the respective image processing mode. For example, in maneuvering mode, the area of ​​the Class V field of view may be enlarged compared to the standard mode.Consequently, the (identical) image data of the Class V field of view or the Class V field of view can be displayed larger on the display device 18 than in standard mode. Furthermore, the area of ​​the Class IV field of view and the Class II field of view can be reduced compared to standard mode. Thus, the Class II and Class IV fields of view can be displayed smaller on the display device 18 than in standard mode. Additionally or alternatively, in highway driving mode, the area of ​​the Class V field of view can be reduced (e.g., reduced) compared to standard mode. Consequently, the image data of the Class V field of view or the Class V field of view can be displayed smaller on the display device 18 than in standard mode.

[0088] Although the invention has been described with reference to specific embodiments, it will be apparent to those skilled in the art that various modifications may be made and equivalents may be substituted without departing from the scope of the invention. Accordingly, the invention is not intended to be limited to the disclosed embodiments, but to include all embodiments falling within the scope of the appended claims. In particular, the invention also claims protection for the subject matter and features of the dependent claims, independent of the referenced claims. List of reference symbols 10 Vision System 12 Image capture device 14 Status device 15 Situation recognition device 16 Image data processing device 17 Control device 18 Display device 20 vehicles 21 Other vehicle 22 Street

Claims

[1] Method for operating an image data processing device (16) of a vision system (10) of a vehicle (20), comprising: Receiving image data acquired by at least one image acquisition device (12), wherein the image data preferably comprises rear view image data acquired from the side and / or rear of the vehicle (20); Receiving a status signal indicating a day status or a night status, preferably generated by a status device (14), e.g. a brightness sensor; and Processing the received image data, preferably comprising adjusting a contrast and / or a brightness of the received image data depending on the received status signal, characterized by : Receiving, preferably from a situation recognition device (15), a situation signal indicating a current speed, a gear selection and / or an operating state of the vehicle (20); and wherein the step of processing further depends on the received situation signal, comprising: Generating a zoom view and / or a wide-angle view of the received image data depending on the received situation signal. [2] The method of claim 1, wherein the processing step differs depending on whether the received state signal indicates the day state or the night state. [3] The method of claim 1 or 2, wherein the step of processing comprises: Adjusting a contrast of the received image data; and / or adjusting a digital gain of the received image data; and / or adjusting a noise filtering of the received image data. [4] Method according to one of the preceding claims, further comprising: Outputting a control signal for the at least one image capture device (12) as a function of the received status signal, wherein the control signal causes the at least one image capture device (12) to adapt at least one image capture setting, preferably a frame rate, a gain, an exposure time and / or an exposure threshold value, of the at least one image capture device (12). [5] A method according to any one of the preceding claims, wherein the step of processing comprises: Reducing a contrast, a digital gain and / or a brightness of the received image data if the received situation signal indicates a long-distance journey of the vehicle (20); and / or Increasing a contrast, a digital gain and / or a brightness of the received image data if the received situation signal indicates a maneuvering, preferably a parking maneuver, of the vehicle (20). [6] Method according to one of the preceding claims, further comprising: Selecting an image data processing mode from, preferably at least three, particularly preferably at least four, predefined possible image data processing modes depending on the received situation signal; and wherein the step of processing is performed according to the selected image data processing mode. [7] A method according to claim 6, wherein the predefined possible image data processing modes comprise: a reverse mode, preferably comprising generating a wide-angle view of the received image data; and / or a highway driving mode, which preferably comprises generating a zoom view of the received image data; and / or a shunting mode, preferably comprising generating a wide-angle view of the received image data. [8] The method of claim 7, wherein: the predefined possible image data processing modes further comprise a standard mode, preferably an urban driving mode; wherein: the reversing mode has a higher contrast, brightness and / or digital gain than the standard mode; and / or the motorway mode has lower contrast, lower brightness and / or lower digital gain than the standard mode; and / or the shunting mode has higher contrast, higher brightness and / or higher digital gain than the standard mode. [9] Method according to one of the preceding claims, wherein: the received image data comprises data relating to different fields of view, preferably a Class II field of view, a Class IV field of view and / or a Class V field of view; and the processing step comprises merging the different fields of view into a combined view. [10] A method according to claim 9, depending on any one of claims 6 to 8, wherein: relative areas of the different fields of view in the combined view are varied depending on the selected image processing mode, preferably where: in highway driving mode, the Class V field of view is reduced compared to standard mode; and / or In shunting mode, the Class V field of view is enlarged compared to standard mode. [11] A method according to any one of the preceding claims, further comprising: Receiving a display brightness signal from a display device (18), wherein the display brightness signal indicates a brightness of a display of the display device (18), preferably a brightness of a backlight of a display of the display device (18); wherein the processing step is performed in dependence on the received display brightness signal, preferably such that: that a contrast of the received image data is increased if the display brightness signal indicates an increase in the brightness of the display and / or that a contrast of the received image data is reduced when the display brightness signal indicates a reduction in the brightness of the display. [12] Method according to one of the preceding claims, further comprising: Receiving a user request signal; and Adjusting the image processing settings depending on the received user request signal, preferably: a) selecting a different image processing mode and / or adapting the selected image processing mode depending on the received user request signal; and / or b) adjusting a contrast, a digital gain and / or a noise filtering of the received image data depending on the received user request signal; and / or c) adapting a section of the received image data to be displayed depending on the received user request signal. [13] Vision system (10) for a vehicle (20), comprising: at least one image capture device (12) configured to capture image data, preferably comprising rear view image data captured to the side and / or behind the vehicle (20); a state device (14), preferably a brightness sensor, wherein the state device (14) is designed to generate a state signal indicating a day state or a night state; a situation recognition device (15) designed to generate a situation signal indicating a current speed, a gear selection and / or an operating state of the vehicle (20); and an image data processing device (16), wherein the image data processing device (16) is designed to receive the acquired image data, the generated status signal and the situation signal, and is further designed to process the received image data as a function of the received status signal and the received situation signal, wherein the image data processing device (16) is designed to carry out a method according to one of the preceding claims. [14] Vision system (10) according to claim 13, further comprising: a display device (18) configured to display the processed image data, wherein the display device (18) preferably comprises a display configured to simultaneously display a Class II field of view, a Class IV field of view, and a Class V field of view. [15] Vehicle (20), preferably commercial vehicle, comprising: a vision system (10) according to claim 13 or 14. [16] Vehicle (20) according to claim 15, wherein: the at least one image capture device (12) is designed to capture different fields of view, preferably a Class II field of view, a Class IV field of view and / or a Class V field of view; and / or the vision system (10) is part of a mirror replacement system of the vehicle; and / or the vision system (10) is operable to display a panoramic view of the vehicle surroundings on the display device (18).

Citation Information

Patent Citations

  • Method for implementing automatic color balancing in towing vehicle with camera system, has performing color balancing on picture information based on available lighting information, and providing color-corrected picture information

    DE102011083786A1

  • Method and device for generating a display image in a motor vehicle

    DE102018207388A1