Activation and optimization of a night mode in camera monitor applications
The image data processing method dynamically adjusts image quality and capture settings based on environmental brightness and driving conditions, addressing the issue of insufficient night-time image quality in vehicle systems, thereby reducing driver fatigue and improving safety.
Patent Information
- Application Number
- DE102023005537
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-10-06
- Publication Date
- 2025-11-06
- Estimated Expiration
- 2043-10-06
AI Technical Summary
Existing camera monitor systems in vehicles provide insufficient image quality during night driving, leading to increased risk of accidents due to fatigue, distraction, or misassessment of the situation, as they are optimized for daylight scenarios and do not adequately adjust image content for night conditions.
An image data processing method that adjusts image processing settings based on environmental brightness and driving conditions, including contrast, digital amplification, and noise filtering, to optimize image quality for day and night scenarios, and adapts capture settings like frame rate and exposure time to enhance flexibility and relevance for the driver.
The method significantly improves image quality and adaptability, reducing driver fatigue and distraction by optimizing image content and capture settings for varying lighting conditions and driving situations, thereby enhancing safety and situational awareness.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[0001] The invention relates to a method for operating an image data processing device of a vision system of a vehicle, a vision system with a corresponding image data processing device and a vehicle with a corresponding vision system.
[0002] For the general state of the art, reference is made to DE 10 2018 207 388 A1 and DE 102011 083 786 A1.
[0003] DE 10 2018 207 388 A1 discloses a method for generating a display image in a motor vehicle by means of a system with at least one camera, a processing unit and a display screen arranged in a motor vehicle with a brightness sensor that measures the ambient brightness at the display screen, wherein in the method, tone value transfer parameters of the system are determined and applied by the processing unit and / or a control unit of the camera and / or a control unit of the display screen depending on the ambient brightness detected by the brightness sensor.
[0004] German patent DE 10 2011 083 786 A1 discloses a method for automatic color matching in a vehicle with a camera system. The method comprises the following steps: providing lighting information for at least one vehicle-integrated lighting source; and performing a color match, based on the provided lighting information, on image information provided by the camera system, and providing the color-corrected image information.
[0005] It is known in the art to equip vehicles with camera-monitor systems (CMS) to facilitate vehicle operation. Such camera-monitor systems typically have a monitor unit connected to at least one camera unit. The at least one camera unit is usually configured to capture image data of the vehicle's surroundings, which is then displayed on the monitor unit located in the vehicle.
[0006] The image quality settings, i.e., the settings of the image signal processor (ISP), of camera-monitor systems are generally optimized for daylight scenarios. Using the same ISP settings for night driving often results in mediocre image quality (e.g., strong color noise, low dynamic range, over- or underexposure), which increases the risk of accidents due to fatigue, distraction, or misjudgment of the situation.
[0007] A common approach to addressing this problem is to modify the monitor's operating settings, for example, by reducing its brightness at night (dimming). Reducing the power of an LED backlight behind the display can prevent driver fatigue or distraction from a bright screen at night. However, the image content itself is typically not improved or adjusted. Consequently, key performance indicators (KPIs) such as color noise, dynamic range, exposure, and / or white balance remain inadequate.
[0008] The object of the invention is to provide an improved method for supplying image data, e.g., to a vehicle driver, preferably avoiding the disadvantages of conventional methods. A preferred objective of the invention is to provide image data of better image quality, particularly adapted to nighttime conditions and / or the current situation.
[0009] These problems are solved by the subject matter of the independent claims. Preferred embodiments and applications of the invention are covered by the dependent claims.
[0010] According to a first independent aspect, a method for operating an image data processing device is provided. Preferably, the image data processing device is an image data processing device of a vision system (e.g., a mirror replacement system) of a vehicle.
[0011] The method involves receiving image data acquired by at least one image acquisition device. The at least one image acquisition device may be part of the vehicle and / or the vehicle's vision system. For example, the at least one image acquisition device may comprise one or more cameras, mounted, for instance, on the vehicle. Preferably, the image data includes rear-view images captured (e.g., laterally) beside and / or behind the vehicle. For example, the at least one image acquisition device may be configured to capture a Class II, Class IV, and / or Class V field of view in accordance with Directives 2003 / 97 / EC and 2007 / 38 / EC.
[0012] The method further comprises receiving a status signal, preferably indicating a daytime or nighttime state. The status signal can be generated by a state device of the vehicle and / or the vehicle's vision system. For example, the state device can be a brightness and / or light sensor. The brightness and / or light sensor can be configured to output a first status signal value indicating a daytime state when the brightness of the vehicle's surroundings is above a predefined value, and a second status signal value indicating a nighttime state when the brightness of the vehicle's surroundings is below this predefined value.
[0013] The method further includes (e.g., automatic) processing (e.g., post-processing) of the received image data (e.g., by the image data processing device) depending on the received status signal. Consequently, the manner in which the received image data is processed can vary depending on the received status signal, particularly depending on whether the status signal indicates the day or night state. In this context, the processing step can involve modifying and / or changing image processing settings based on the received status signal. For example, the processing step can involve adjusting the contrast and / or brightness of the received image data. Preferably, the method further includes outputting the processed image data, e.g., to a display device.
[0014] Unlike existing concepts that merely adjust the display characteristics (e.g., the intensity of an LED backlight) of a monitor to nighttime conditions (e.g., by dimming), the current solution advantageously adapts the image content itself by processing the captured image data. This allows for significantly greater flexibility in actively modifying the image data via the image processing unit, compared to simply adjusting the display appearance via the monitor. As a result, the image quality can be optimized more extensively (e.g., automatically) for each specific situation, enabling a better adaptation of the provided image data to the driver's current needs.
[0015] From a first perspective, the processing step can differ depending on whether the received state signal indicates daytime or nighttime conditions. For example, the processing step can include a day mode and a night mode. Preferably, the image processing settings used to process the received image data differ depending on whether daytime (e.g., day mode) or nighttime conditions (e.g., night mode) are present. For example, the contrast, digital gain, and / or white balance of the received image data can be adjusted depending on the received state signal and / or the current mode (e.g., day or night). Advantageously, this allows the image data to be adapted to the prevailing lighting conditions.
[0016] Another aspect of the processing step can involve adjusting (e.g., increasing and / or decreasing) the contrast of the received image data. The term contrast can refer, for example, to the difference between light and dark areas of the image data. Contrast adjustment can be global (e.g., by affecting the entire tonal range of the image data) and / or local (e.g., by independently affecting specific areas of the image data).
[0017] Additionally or alternatively, the processing step may involve adjusting (e.g., increasing and / or decreasing) the digital amplification of the received image data. The term digital amplification can, for example, refer to a factor by which the image data is amplified after the digitization process of the at least one image acquisition device. In contrast, the term analog amplification or gain can refer to the magnitude of the amplification of an output voltage from the photodetectors of the at least one image acquisition device before sampling by an analog-to-digital converter.
[0018] Additionally or alternatively, the processing step may include adjusting (e.g., increasing and / or decreasing) noise filtering of the received image data. This can be achieved, for example, by using a known denoising algorithm, such as a spatial domain filter and / or a Wiener filter. In this context, the term noise filtering may refer, for example, to the removal of noise from the image data, particularly to the restoration of the "true" image. Preferably, adjusting the noise filtering (e.g., depending on the received state signal) involves changing the degree to which noise filtering is applied and / or whether it is applied at all.
[0019] According to another aspect, the method can further include the output (e.g., by the image data processing unit) of a control signal for the at least one image acquisition unit, depending on the received status signal. This control signal can cause the at least one image acquisition unit to adjust at least one image acquisition setting (e.g., a frame rate, an (analog) gain, an exposure time, and / or an exposure threshold). For example, if the received status signal indicates the post-state, the output control signal can cause the at least one image acquisition unit to decrease the frame rate (e.g., from 50 fps to 25 fps) and / or increase the exposure time.In addition to the previously mentioned adjustment of image processing settings, this aspect advantageously allows for an active change in the way in which the (e.g. raw) image data is acquired, thereby further increasing the flexibility to adapt / optimize the image quality to the current conditions.
[0020] According to another aspect, the method can further include receiving a situation signal. The situation signal can be generated by a situation recognition device of the vehicle and / or the vehicle's vision system. The situation signal can indicate the current speed of the vehicle, the vehicle's gear selection (e.g., forward or reverse), and / or an operating state of the vehicle (e.g., maneuvering, cornering, and / or highway driving). The processing step is further dependent on the received situation signal. Preferably, the processing of the received image data can depend on the received status signal and the received situation signal. For example, processing in night mode can depend on whether the vehicle is reversing into a parking space or traveling on a highway. While in the first case, for example, the contrast and brightness of the image data (e.g.,In the second case, the contrast and brightness of the image data can be increased (e.g., in night mode / night settings) by the image data processing unit (e.g., so that the driver can recognize as many details as possible). Conversely, in the second case, the contrast and brightness of the image data (in night mode / night settings) can be reduced (e.g., to reduce driver distraction). This advantageously allows the image quality to be optimally adapted to the respective driving situation, thus improving the driver's situational awareness in various scenarios.
[0021] Another aspect is that the processing step (e.g., of the received image data) can involve reducing the contrast, digital gain, and / or brightness of the received image data if the received situation signal indicates that the vehicle is traveling on a long journey. This situation signal can be generated, for example, when the vehicle is traveling at a speed exceeding 60 km / h. This has the advantage of preventing the driver from becoming fatigued and / or distracted by the displayed image data.
[0022] Additionally or alternatively, the processing step (e.g., of the received image data) can also include increasing the contrast, digital amplification, and / or brightness of the received image data if the received situation signal indicates that the vehicle is maneuvering (e.g., parking). The corresponding situation signal can be generated, for example, when the vehicle is reversing and / or traveling at a speed below 25 km / h. This has the advantage that the driver can clearly see objects and / or obstacles in the displayed image data.
[0023] According to another aspect, the method further includes selecting an image data processing mode from predefined possible image data processing modes depending on the received situation signal. For example, the predefined possible image data processing modes can include at least three, preferably at least four, (e.g., different) predefined possible image data processing modes. The predefined possible image data processing modes can include, for example, a reversing mode, a highway driving mode, a shunting mode, and / or an urban driving mode. Each of the predefined possible image data processing modes can preferably be associated with a specific type of processing of the received image data and / or specific image processing settings. The processing step can then be carried out according to the selected image data processing mode.This advantageously allows for optimal adaptation of the image quality to the respective driving situation.
[0024] Another aspect is that the predefined possible image data processing modes can include a reverse view mode. This reverse view mode can, for example, generate a wide-angle view of the received image data. Preferably, only rearward image data is processed during the processing step in reverse view mode. This can be achieved by selecting (e.g., only) the rearward image data from the received image data and / or by controlling the at least one image acquisition device so that (e.g., only) rearward image data is received by the image data processing device. This has the advantage that the driver can obtain a wide overview of the area behind the vehicle, making it easy to identify potential objects or obstacles.
[0025] Additionally or alternatively, the predefined possible image data processing modes can include a highway driving mode. The highway driving mode can, for example, generate a zoomed-in view of the received image data. Preferably, the zoomed-in view focuses on a specific area of the captured image data, such as a distant area of the vehicle's surroundings. By way of example only, the processing step according to the highway driving mode can include processing the received image data so that the Class II field of view is enlarged and / or the Class V field of view is reduced. This has the advantage that the driver can be shown the relevant area of interest without additional distracting information about the immediate surroundings.
[0026] Additionally or alternatively, the predefined possible image data processing modes can include a maneuvering mode. The maneuvering mode can, for example, involve generating a wide-angle view of the received image data. Preferably, the processing step according to the maneuvering mode can include processing the received image data so that information about the area to the side of the vehicle is enlarged and / or highlighted. By way of example only, the processing step according to the maneuvering mode can include processing the received image data in such a way that the Class II field of view is enlarged while the Class IV field of view is reduced. This has the advantage that the driver gains a broad overview of the area to the side, making it easy to recognize potential objects or obstacles, for example, during a turning maneuver.
[0027] According to another aspect, the predefined possible image data processing modes can also include a default mode (e.g., an urban driving mode). The default mode can, for example, be activated by default unless the received situation signal indicates a specific operating state of the vehicle, such as reversing, highway driving, and / or maneuvering. In this context, the aforementioned reversing mode can preferably have higher contrast, higher brightness, and / or higher digital gain compared to the default mode. Additionally or alternatively, the aforementioned highway driving mode can preferably have lower contrast, lower brightness, and / or lower digital gain compared to the default mode.Additionally or alternatively, the aforementioned maneuvering mode can feature higher contrast, higher brightness, and / or higher digital gain compared to the standard mode. This advantageously allows for the avoidance of distraction or fatigue in driving situations where little additional visual information is required, while still providing clearly recognizable visual information in parking and / or turning situations.
[0028] According to the invention, the received image data includes data relating to different fields of view. For example, the received image data can include a Class II field of view, a Class IV field of view, a Class V field of view, and / or a Class VI field of view (e.g., in accordance with Directives 2003 / 97 / EC and 2007 / 38 / EC). The different fields of view preferably correspond to different viewing directions and / or views of the vehicle's surroundings from the perspective of a driver sitting in the driver's seat of the vehicle in a normal driving position. Additionally or alternatively, the different fields of view preferably correspond to views of the driver that would actually be displayed in the vehicle's mirror devices (e.g., those required by law). In this context, the processing step (e.g., of the received image data) involves combining the different fields of view into a single, combined view.For example, the different fields of view can be combined and / or superimposed. The combined view preferably provides a (possibly distorted) visualization of the different fields of view in a single image, preferably a continuous one. This has the advantage that the driver can be provided with a single representation of the vehicle's surroundings, containing the relevant information for safe driving.
[0029] According to the invention, the relative areas of the different fields of view in the combined view are varied depending on the selected image data processing mode. Preferably, the merging step thus includes varying the relative areas of the different fields of view in the combined view depending on the selected image data processing mode. The term "relative area" can, for example, correspond to the relative areas that the different views are intended to occupy when displayed (e.g., on the display device).
[0030] For example, in highway driving mode, the Class V field of view, or a portion thereof, can be reduced compared to standard mode. In other words, the various fields of view can be combined in highway driving mode so that the Class V field of view occupies a smaller area of the combined view than in standard mode. Additionally or alternatively, in highway driving mode, the Class IV and / or Class II fields of view can be enlarged compared to standard mode (e.g., enlarged and / or displayed larger).
[0031] Additionally or alternatively, in shunting mode, the Class V field of view, or a portion thereof, can be enlarged (e.g., enlarged and / or displayed larger) compared to standard mode. In other words, the various fields of view can be combined in shunting mode so that the Class V field of view occupies a larger portion of the combined view than in standard mode. Additionally or alternatively, in maneuvering mode, the Class IV and / or Class II fields of view can be reduced (e.g., decreased) compared to standard mode. This advantageously allows the driver to be provided with relevant information about the vehicle's surroundings in a situation-appropriate manner, so that the areas most relevant to the current situation can be displayed more prominently.
[0032] According to another aspect, the method can further include receiving a display brightness signal from a display device. The display brightness signal can, for example, indicate the brightness of a display (e.g., an LCD display) of the display device, in particular the brightness of a backlight of the display. Preferably, the display brightness signal indicates a brightness value of the display (e.g., manually adjusted or configurable). In this context, the processing step can be performed depending on the received display brightness signal.Preferably, the processing step is performed depending on the received display brightness signal, so that the contrast of the received image data is increased when the display brightness signal indicates an increase in display brightness, and / or the contrast of the received image data is decreased when the display brightness signal indicates a decrease in display brightness. This allows the processing and / or image processing settings to be linked to (e.g., manual) brightness adjustment of the display. This has the advantage of enabling a synergistic interaction between the backlight brightness and the image processing settings.
[0033] According to another aspect, the method can further include receiving a user request signal. The user request signal can be generated by a control unit of the vehicle and / or the vehicle's vision system. For example, the control unit can be located on and / or integrated into the display unit. For example, the control unit can be designed as a touch-sensitive surface of the display unit. The user request signal can preferably specify a command and / or a request from a user. In this context, the method can further include adjusting the image processing settings (e.g., of the image data processing unit), which are used, for example, to process the received image data, depending on the received user request signal. This can, for example, involve selecting a different (e.g.,The method includes adjusting the image data processing mode (currently not selected) and / or adapting the (e.g., currently) selected image data processing mode depending on the received user request signal. Advantageously, this allows the user to actively select and / or change the image data processing mode. Additionally or alternatively, the method and / or step of adjusting the image processing settings may include adjusting the contrast, digital gain, and / or noise filtering of the received image data depending on the received user request signal. Advantageously, this allows the user to actively adjust the processing of the received image data.Additionally or alternatively, the procedure and / or step of adjusting the image processing settings may include adjusting a portion of the received image data to be displayed, depending on the received user request signal. For example, the user can switch from a zoomed-in view to a wide-angle view and vice versa.
[0034] According to another aspect, the method can also include output of the processed image data (e.g., via the image data processing unit). For example, the image data processing unit can have a corresponding output at which the processed image data can be made available. Preferably, the processed image data is output for display on a display device. For example, the processed image data can be output in a data format readable by the display device. The display device can be part of the vehicle and / or the vehicle's vision system (e.g., the mirror replacement system). The processed image data can include image data of the Class II, Class IV, and / or Class V fields of view. The display device can be configured to simultaneously display the Class II, Class IV, and / or Class V fields of view, e.g.,on the same monitor and / or the same display of the display device.
[0035] According to a further aspect, the method can also include generating a zoomed-in view and / or a wide-angle view of the received image data depending on the received situation signal. Preferably, the zoomed-in view focuses on a specific area of the recorded image data, while the wide-angle view preferably represents the entire detection range of the at least one image acquisition device. This advantageously allows for a situation-specific viewing of the received image data.
[0036] According to another independent aspect, a vision system is provided. Preferably, the vision system is a vision system for a vehicle (e.g., a car or truck).
[0037] The vision system comprises at least one image acquisition device (e.g., a camera) configured to capture image data. Preferably, the image data consists of rear-view images captured (e.g., laterally) beside and / or behind the vehicle. The at least one image acquisition device may be part of the vehicle and / or mounted on the vehicle. For example, the at least one image acquisition device may be mounted in or on a camera arm extending laterally outward from the vehicle body. Particularly preferably, the at least one image acquisition device is configured to capture one or more legally required fields of view, e.g., a Class II field of view, a Class IV field of view, and / or a Class V field of view in accordance with Directives 2003 / 97 / EC and 2007 / 38 / EC.
[0038] The vision system also includes a status device (e.g., a brightness and / or light sensor). The status device is configured to generate a status signal that preferably indicates a day or night state. The status device can be part of the vehicle and / or mounted on the vehicle.
[0039] The image processing system further comprises an image data processing unit (e.g., a processor). The image data processing unit is configured to receive the acquired image data and the generated status signal. For this purpose, the image data processing unit can be connected to the at least one image acquisition unit and the status unit, e.g., via appropriate wired or wireless signal connections. The image data processing unit is further configured to process the received image data depending on the received status signal. For example, the image data processing unit can be configured to perform a procedure as described in this document. Consequently, the aspects described herein in connection with the procedure are also disclosed and claimable in connection with the vision system just described, and vice versa.
[0040] According to one aspect, the vision system may further include a display device. The display device may be configured to show the processed image data. For example, the display device may include a display (e.g., an LCD display) preferably configured to show the processed image data. The display device may be part of the vehicle and / or located on the vehicle. For example, the display device may be located in the vehicle's driver's cabin and / or cockpit, preferably within the driver's field of vision. The display device may be connected to the image data processing device, e.g., via a wired or wireless signal connection. As previously described, the display device may be configured to display different fields of view simultaneously, e.g., the Class II field of view, the Class IV field of view, and / or the Class V field of view.on one and the same display of the display device.
[0041] According to another independent aspect, a vehicle (e.g., a motor vehicle) is provided. Preferably, the vehicle may be a commercial vehicle, such as a truck or a bus. For example, the vehicle may be specifically designed and equipped for transporting goods, transporting people, and / or towing one or more (e.g., agricultural) trailers. The vehicle has a vision system as described herein. Consequently, the aspects described herein in connection with the vision system and the method shall also be disclosed and claimable in connection with the vehicle, and vice versa.
[0042] According to one aspect, the at least one image acquisition device can be configured to capture different fields of view, preferably a Class II field of view, a Class IV field of view, and / or a Class V field of view (e.g., in accordance with Directives 2003 / 97 / EC and 2007 / 38 / EC). The at least one image acquisition device can, for example, comprise several cameras mounted, for instance, in or on a common camera arm. The several cameras can be oriented differently and / or each have different viewing angles. In this context, the image data processing device can be configured to select image data from a subset of the several cameras and / or to merge / combine the image data from the several cameras.
[0043] Additionally or alternatively, the image processing system can be part of a vehicle's mirror replacement system, in particular an exterior mirror replacement system. The term "mirror replacement system" can refer, for example, to a (generally known) driver assistance system in which (e.g., legally required) mirror devices (e.g., an exterior rearview mirror) of the vehicle are replaced by one or more image acquisition devices, with the images captured by these image acquisition devices being displayed on a display unit in the vehicle. In particular, the image acquisition devices capture a section of the vehicle's surroundings that would actually be displayed in the respective (e.g., legally required) mirror device. For example, the at least one image acquisition device can be configured to capture image data that would be displayed in a main exterior rearview mirror (e.g., field of view II), a wide-angle exterior rearview mirror (e.g.,Field of view IV) and / or a near-field or ramp mirror (e.g., field of view V). Consequently, the at least one image acquisition device can include and / or be at least one mirror replacement image acquisition device.
[0044] Additionally or alternatively, the image processing system can be capable of displaying a 360° view of the vehicle's surroundings on the display device. The term 360° view, which can also be referred to as a bird's-eye view, can, for example, refer to a (e.g., generally known) driver assistance system in which the driver is provided with a (e.g., artificial) image of the vehicle's surroundings and / or the vehicle itself from a bird's-eye perspective. The at least one image acquisition device can have several surround-view cameras (e.g., including a front camera, a rear-view camera, and / or at least one side camera), whereby the surround-view cameras can preferably be oriented in different directions.Additionally or alternatively, the at least one image acquisition device can be part of a combination of two or more image acquisition devices whose image data are merged / combined to create a bird's-eye view of the vehicle. In this context, the at least one image acquisition device can preferably comprise at least four image acquisition devices (e.g., surround-view cameras).
[0045] The aspects and features of revelation described above can be combined in any way. Further details and benefits are described below with reference to the accompanying figures. The figures show: Fig. 1 a schematic representation of a vehicle according to one embodiment; Fig. 2 Two schematic representations of processed image data in standard mode according to one embodiment, using different image processing settings; Fig. 3 Two schematic representations of processed image data in highway driving mode, using different image processing settings; and Fig. 4 schematic representations of the processed image data in standard mode, shunting mode and motorway driving mode.
[0046] The in the Fig. 1, Fig. 2, Fig. 3 and Fig. The four embodiments shown correspond at least partially, so that similar or identical parts are provided with the same reference numerals and, to avoid repetition, reference is also made to the description of the other embodiments or figures for their explanation.
[0047] Fig. Figure 1 shows a vehicle 20 according to one embodiment of the disclosure. The vehicle 20 shown is for illustrative purposes only. Fig. Vehicle 1 is depicted as a truck. However, vehicle 20 can be any type of vehicle, such as a car, a bus, construction equipment, agricultural machinery, or similar.
[0048] The vehicle 20 has at least one image acquisition device 12, one condition device 14 and one image data processing device 16.
[0049] The aforementioned components can be interconnected. For example, the image data processing unit 16 can be connected to the at least one image acquisition unit 12 and the status unit 14, e.g., via appropriate signal connections (dashed lines). Each of the signal connections can be a wired connection and / or a wireless connection.
[0050] Furthermore, the at least one image acquisition device 12, the condition monitoring device 14, and the image data processing device 16 can form a vision system 10 and / or be part of a vision system 10 (e.g., a mirror replacement system) of the vehicle 20. Thus, the vehicle 20 can have a vision system 10 comprising the at least one image acquisition device 12, the condition monitoring device 14, and the image data processing device 16.
[0051] The at least one image acquisition device 12 can be configured to acquire image data (e.g., in real time). The at least one image acquisition device 12 can, for example, comprise one or more cameras. The one or more cameras can be mounted in or on a camera arm, which preferably extends laterally and externally from the vehicle body (e.g., laterally and externally from the vehicle's cab). The at least one image acquisition device 12 can comprise at least one image sensor (e.g., a CMOS image sensor and / or a CCD image sensor). The at least one image acquisition device 12 can comprise one or more optical elements (e.g., a lens, a mechanical shutter, an electric shutter, and / or an aperture).
[0052] The at least one image acquisition device 12 can be configured to acquire optical information about the vehicle's surroundings. In particular, the at least one image acquisition device 12 can be configured to acquire forward-facing image data (of the vehicle's surroundings) in front of the vehicle 20, to acquire lateral image data (of the vehicle's surroundings) beside (e.g., to the left and / or right of) the vehicle 20, and / or to acquire rearward-facing image data (of the vehicle's surroundings) behind the vehicle 20. Preferably, the at least one image acquisition device 12 can be configured to acquire a rearward-facing side view of the vehicle's surroundings (along the vehicle 20). This rearward-facing side view can (e.g.,Due to the arrangement of at least one image capture device 12 in front of the windshield of the vehicle 20), the image capture device may at least partially capture areas of the vehicle's surroundings that are located (directly) in front of and / or to the side of the vehicle. The at least one image capture device 12 may be designed to capture fields of vision of the vehicle's surroundings that are legally required, for example, according to Directives 2003 / 97 / EC and 2007 / 38 / EC.
[0053] For example, the at least one image acquisition device 12 can be configured to capture a Class II field of view, which may include a distant rear view laterally along the vehicle 20. The Class II field of view may correspond to a field of view typically captured by a main exterior mirror of the vehicle 20.
[0054] Additionally or alternatively, the at least one image acquisition device 12 can be configured to capture a Class IV field of view, which may include a (rearward-facing) wide-angle view of the vehicle's lateral surroundings 20. Compared to the Class II field of view, the Class IV field of view may cover a shorter but wider lateral portion of the vehicle's surroundings. The Class IV field of view may correspond to a field of view typically captured by a wide-angle exterior mirror of the vehicle 20.
[0055] Additionally or alternatively, the at least one image acquisition device 12 can be configured to capture a Class V field of view, which may show a close-up view of a lateral area next to (and possibly partially in front of) the cab of the vehicle 20, in particular a lateral area next to the passenger side of the vehicle 20 and / or the cab of the vehicle 20. The lateral area may begin at the front edge of the vehicle 20. The Class IV field of view may correspond to a field of view that is normally captured by a ramp mirror and / or a side safety mirror of the vehicle 20.
[0056] Consequently, the (received) image data can be Class II field-of-view image data, Class IV field-of-view image data, and / or Class V field-of-view image data. Additionally or alternatively, the (received) image data can also be Class I field-of-view image data and / or Class III field-of-view image data.
[0057] Furthermore, the at least one image acquisition device 12 can comprise several (e.g., four) image acquisition devices 12. The multiple image acquisition devices 12 can be distributed across the vehicle 20. The various image acquisition devices 12 can be oriented differently and / or each have different fields of view. For example, the at least one image acquisition device 12 can comprise a reversing camera, a front camera, and / or a side-view camera. The at least one image acquisition device 12 or the multiple image acquisition devices 12 can be part of a mirror replacement system of the vehicle 20 (e.g., replacement of an external rearview mirror) and / or a bird's-eye view system of the vehicle 20.
[0058] The state device 14 can be configured to generate and / or output a state signal. Preferably, the state signal can indicate a day state or a night state. Additionally or alternatively, the state signal can also indicate a light state of the vehicle's surroundings. For example, the state signal can have a first state signal value when the brightness of the vehicle's surroundings exceeds a predefined value, and a second value when the brightness of the vehicle's surroundings falls below this predefined value. In this context, the state device 14 can include a brightness and / or light sensor. Additionally or alternatively, the state device 14 can also include a clock, a timer, and / or an interface configured to receive an external input indicating a day state and / or a night state.
[0059] The image data processing unit 16 can be configured to receive inputs from the at least one image acquisition unit 12 and the state unit 14. In particular, the image data processing unit 16 can be configured to receive the acquired image data from the at least one image acquisition unit 12 and the generated state signal from the state unit 14. The image data processing unit 16 can include a memory and / or at least one processor (e.g., an image signal processor - ISP) for processing images and / or image data. The memory can be configured to store instructions that can be executed by the at least one processor.
[0060] The image data processing device 16 can be configured to process the received image data. For example, the image data processing device 16 can be configured to modify the received image data (e.g., a quality and / or performance parameter of the received image data) by means of image processing. Preferably, the image data processing device 16 can be configured to adjust or modify the contrast, digital gain, noise filtering, white balance, luminance, brightness, and / or sharpness of the received image data.
[0061] The image data processing device 16 can be configured to process the received image data depending on the received status signal. Thus, the image data processing device 16 can be configured to process the received image data differently depending on the received status signal, which is relevant in connection with the Fig. 2, Fig. 3 and Fig. 4 is described in more detail below. In particular, the processing can differ depending on whether the received status signal indicates the day or night state. For example, the received status signal can trigger a day or night mode of the image data processing unit 16 for processing the received image data. Depending on the status signal and / or the respective mode (day or night mode), the image processing settings for processing the received image data can vary. For example, the image data processing unit 16 can be configured to adjust the contrast, digital gain, noise filtering, white balance, luminance, brightness, and / or sharpness of the received image data depending on the received status signal and / or the mode.In particular, the image data processing device 16 can be configured to optimize the image quality for daytime and / or nighttime conditions. For example, the image data processing device 16 can be configured to increase the contrast and / or decrease the brightness of the received image data when the received status signal indicates nighttime conditions.
[0062] Furthermore, the image data processing device 16 can be configured to output a control signal to the at least one image acquisition device 12. This control signal can cause the at least one image acquisition device 12 to change and / or adjust at least one image acquisition setting. In this context, the term "image acquisition setting" can refer, for example, to (hardware or software) settings of the at least one image acquisition device 12 that determine how the (e.g., raw) image data is acquired by the at least one image acquisition device 12. For example, the at least one image acquisition setting can include a frame rate, an (analog) gain, a black level, an exposure time, and / or an exposure threshold of the at least one image acquisition device 12.The frame rate can define the number of frames per second that the at least one image acquisition device 12 attempts to deliver. The black level can define a brightness level corresponding to the darkest value of the at least one image acquisition device 12. Adjusting the black level can compensate for any dark current. The exposure time can define a period of time during which the at least one image acquisition device 12 collects photons for each frame. The exposure threshold can define a level at which saturation of the at least one image acquisition device 12 is reached. Additionally or alternatively, the at least one image acquisition setting can also include a focus and / or an aperture for the at least one image acquisition device 12.
[0063] In particular, the image data processing device 16 can be configured to output the control signal to the at least one image acquisition device 12 depending on the received signal. Thus, the image data processing device 16 can be configured to output the control signal differently depending on the received status signal, which in connection with the Fig. 2, Fig. 3 and Fig. Section 4 will be described in more detail. For example, the output can differ depending on whether the received status signal indicates the day state or the night state.
[0064] Furthermore, the vehicle 20 can have a situation recognition device 15. The situation recognition device 15 can be connected to the image data processing device 16, e.g., by a corresponding signal connection (dashed line). The situation recognition device 15 can be part of a vision system 10 of the vehicle 20. The vision system 10 can also include the situation recognition device 15.
[0065] The situation detection device 15 can be configured to generate and / or output a situation signal. This situation signal can indicate a (e.g., current) speed, a gear selection, and / or an operating state of the vehicle 20. For this purpose, the situation detection device 15 can be connected to corresponding control units and / or sensor devices of the vehicle 20, such as a speed sensor, a gear position sensor, and / or a steering angle sensor. Furthermore, the situation detection device 15 can be configured to receive position data from a (e.g., GPS) positioning system of the vehicle. The situation detection device 15 can be configured to generate and / or output the situation signal based on the information received from the control units, sensor devices, and / or the positioning system.
[0066] The situation signal generated by the situation detection device 15 can, for example, have a first situation signal value indicating that the vehicle 20 is reversing, e.g., when the vehicle 20 is in reverse gear. The situation signal can have a second situation signal value indicating that the vehicle 20 is traveling on a highway, e.g., when the vehicle 20's speed exceeds 60 km / h or 100 km / h. The situation signal can have a third situation signal value indicating that the vehicle 20 is maneuvering, e.g., when the vehicle 20's speed is below 25 km / h and / or (strong) steering movements are occurring.
[0067] The image data processing unit 16 can further be configured to process the received image data depending on the received situation signal. Specifically, the image data processing unit 16 can be configured to process the received image data differently depending on the received situation signal. For example, the received situation signal can trigger different image data processing modes of the image data processing unit 16 for processing the received image data. For instance, the night mode can automatically adapt to different situations and / or operating states of the vehicle 20 (at night) depending on the situation signal. The image processing settings can also change automatically for different driving speeds and directions (forward / reverse).
[0068] For example, the image data processing unit 16 can store and / or define 16 different predefined image data processing modes. These predefined modes can, for example, include at least three, preferably at least four, predefined image data processing modes. The different predefined image data processing modes can define different image processing settings that are used to process the received image data. The image data processing unit 16 can be configured to select an image data processing mode from the predefined possible image data processing modes, depending on the received situation signal. This can be done using predefined rules or mapping tables that assign different values of the situation signal to a corresponding image data processing mode. Additionally or alternatively, an optimization procedure (e.g.,A gradient-based Newton method and / or genetic optimization may be used. Furthermore, the image data processing unit 16 may be configured to process the received image data according to the selected image data processing mode. For example, the way in which the received image data is processed and / or the image processing settings used may differ depending on the selected image data processing mode.
[0069] The predefined image data processing modes can include, for example, a standard mode, a reverse driving mode, a highway driving mode and / or a shunting mode.
[0070] The default mode, which is in Fig. The situation signal shown in Figure 2 can, for example, represent an urban driving mode. The standard mode can be activated by default unless the situation signal indicates a different operating state of the vehicle, such as reversing, highway driving, and / or maneuvering. Additionally or alternatively, the standard mode can be selected by the image data processing unit 16 if the received situation signal indicates that the vehicle is driving in an urban environment. For example, the situation signal may have a fourth value indicating that the vehicle is driving in an urban environment, such as when the vehicle's speed 20 is between 25 km / h and 60 km / h.
[0071] In standard mode, the image data processing unit 16 can be configured to generate a combined view of the received image data (in a single image). For this purpose, different fields of view contained in the received image data can be merged. In particular, as for example in Fig. Figure 4 shows how image data from Class II, Class IV, and Class V fields of view can be combined and / or juxtaposed in a single image. In this context, the image data or the processed image data may exhibit distortions and / or deformations (e.g., perspective distortions).
[0072] The reverse driving mode can be selected by the image data processing unit 16 when the received situation signal indicates that the vehicle 20 is reversing. In reverse driving mode, the image data processing unit 16 can be configured to generate a wide-angle view of the received image data. Preferably, the received image data can include rear-view image data (e.g., captured by a reversing camera). Particularly preferably, only rear-view image data is processed during the processing step in reverse driving mode. In reverse driving mode, the image data processing unit 16 can further be configured to increase the contrast, brightness, and / or digital gain of the received image data compared to the contrast, brightness, and / or digital gain in standard mode.
[0073] The highway driving mode, which is in the Fig. 3 and Fig. As shown in Figure 4, the image data processing unit 16 can be selected when the received situation signal indicates that the vehicle 20 is traveling on a highway. In highway driving mode, the image data processing unit 16 can be configured to generate a zoomed-in view of the received image data. The term "zoomed-in view" can refer, for example, to a view that focuses on a specific area of the captured image data, such as a particular area of the vehicle 20's external surroundings. The zoomed-in view can show an enlarged and / or expanded representation of parts of the captured image data. As shown in Figure 4, the image data processing unit 16 can be configured to generate a zoomed-in view of the captured image data. Fig. As shown in Figure 4, in highway driving mode the Class V field of view can be reduced compared to standard mode and / or maneuvering mode. The received image data can be processed to minimize information about the surroundings of the vehicle in front and to the side, and to maximize information about the surroundings of the vehicle behind. In highway driving mode, the image data processing unit 16 can further be configured to reduce the contrast, brightness, and / or digital gain of the received image data compared to the contrast, brightness, and / or digital gain in standard mode.
[0074] The shunting mode can be selected by the image data processing unit 16 when the received situation signal indicates that the vehicle 20 is being shunted. In shunting mode, the image data processing unit 16 can be configured to generate a wide-angle view of the received image data. As described in Fig. As shown in Figure 4, the Class V field of view can be increased compared to the standard mode and / or the highway driving mode. Furthermore, the Class IV and / or Class II field of view can be decreased (e.g., reduced) compared to the standard mode and / or the highway driving mode. Additionally, the image data processing unit 16 can be configured in shunting mode to increase the contrast, brightness, and / or digital gain of the received image data compared to the contrast, brightness, and / or digital gain in standard mode. The coupling can be asymmetrical, meaning that the contrast can be increased much more (during shunting) than it can be decreased (during highway and / or long-distance driving).
[0075] Furthermore, the vehicle 20 can have a display device 18. The display device 18 can be connected to the image data processing device 16, e.g., by a corresponding signal connection (dashed line). The display device 18 can be part of the vision system 10 of the vehicle 20. Thus, the vision system 10 can also include the display device 18.
[0076] The display device 18 can be configured to display the processed image data (e.g., in real time, meaning the situation displayed on the display device 18 preferably corresponds to the actual situation outside the vehicle 20). The display device 18 can be configured to receive the processed image data from the image data processing device 16. The display device 18 can include a display (e.g., an LCD display) and / or a monitor. The display and / or monitor can be touch-sensitive (e.g., configured as a touchscreen). The processed image data can be displayed on a monitor and / or display of the display device 18.
[0077] The display device 18 can be located on the dashboard of the vehicle 20. Alternatively, the display device 18 can also be located on an A-pillar of the vehicle 20. The display device 18 and / or the entire vision system 10 can be part of a mirror replacement system of the vehicle 20. The display device 18 can be configured to display an area of the vehicle's surroundings that is normally visible via a (non-existent) mirror of the vehicle 20. The display device 18 can be permanently active during the operation of the vehicle 20. Additionally or alternatively, the display device 18 and / or the entire vision system 10 can be operated in such a way that it displays a 360° view (or bird's-eye view) of the vehicle's surroundings.
[0078] The display device 18 may include a dimmer to adjust the brightness of the display and / or monitor of the display device 18. The dimmer may, for example, be configured as a rotary knob and / or button on the display device 18. Alternatively, the dimmer may be configured as a (virtual) button displayed on the (touch-sensitive) display and / or monitor. The display device 18 may be configured to generate and / or output a display brightness signal. This display brightness signal may indicate the (current) brightness of the display and / or monitor of the display device 18. For example, the display brightness signal may be proportional to an adjustment or setting of the dimmer. In particular, the display brightness signal may indicate the brightness of a backlight of a display and / or monitor of the display device 18.In particular, the image data processing device 16 can be configured to process the received image data depending on the received display brightness signal. Specifically, the image data processing device 16 can be configured to process the received image data differently depending on the received display brightness signal. For example, the image processing settings can be linked to the dimmer, i.e., the manual brightness adjustment of the display. Specifically, the image data processing device 16 can be configured to increase the contrast of the received image data when the display brightness signal indicates an increase in the display brightness, and / or to decrease the contrast of the received image data when the display brightness signal indicates a decrease in the display brightness.Additionally or alternatively, the display brightness signal can be coupled asymmetrically with the image processing settings.
[0079] Furthermore, the display device 18 and / or the vehicle 20 may include a control device 17. The control device 17 may, for example, include one or more touchscreens, a button, or a switch. The control device 17 may be located on and / or integrated into the display device 18. Thus, the control device 17 may be part of the vision system 10 of the vehicle 20.
[0080] The control unit 17 can be configured to generate and / or output a user request signal, e.g., based on inputs and / or actions of the control unit 17. The user request signal can indicate a command and / or a request from a user, e.g., related to the (post-)processing of the received image data. For example, the user request signal can indicate a selection and / or adjustment of an image data processing mode, a change in image processing settings, and / or a change and / or selection of a view (e.g., a zoomed-in or wide-angle view).
[0081] The image data processing unit 16 can be configured to process the received image data depending on the received user request signal. Thus, the processing by the image data processing unit 16 can be actively modified and / or adjusted by a user. The image data processing unit 16 can be configured to adjust the image processing settings depending on the received user request signal. In addition to or as an alternative to automatic adjustment, the driver can therefore preferably also manually control the scope of the image processing settings. For example, the image processing settings for night mode can be manually adjusted by the driver.
[0082] For example, the image data processing unit 16 can be configured to adjust the selected image data processing mode depending on the received user request signal and / or to select a different image data processing mode depending on the received user request signal. By way of example only, the user can request a change from reverse mode to shunting mode (manual), e.g., by performing a corresponding control action at the control unit 17 (e.g., by pressing a shunting mode button on the control unit 17). The control unit 17 can then generate and output a corresponding user request signal indicating the aforementioned change of image data processing mode, and the image data processing unit 16 can be configured to change the respective image data processing mode based on the received user request signal.
[0083] Additionally or alternatively, the image data processing device 16 can be configured to adjust the contrast, digital gain, noise filtering, white balance, luminance, brightness, and / or sharpness of the received image data depending on the received user request signal. For example, the user can (manually) request a change in the contrast of the (displayed) image data, e.g., by performing a corresponding control action on the control device 17 (e.g., by pressing a contrast button on the control device 17). The control device 17 can then generate and output a corresponding user request signal indicating the aforementioned change in contrast, and the image data processing device 16 can be configured to change the contrast of the received image data based on the received user request signal.
[0084] Additionally or alternatively, the image data processing device 16 can also be configured to adapt a portion of the received image data to be displayed, depending on the received user request signal. For example, the image data processing device 16 can be configured to adapt an image area and / or a view generated from the received image data for display, depending on the received user request signal. In particular, the image data processing device 16 can be configured to generate a zoomed-in or wide-angle view of the received image data, depending on the received user request signal. For example, the user can (manually) request a change from a currently displayed zoomed-in view to a wide-angle view, e.g., by performing a corresponding control action on the control device 17 (e.g., by...).by pressing a wide-angle view button on the control unit 17). The control unit 17 can then generate a corresponding user request signal indicating the aforementioned change in view, and the image data processing unit 16 can be configured to generate a wide-angle view of the received image data based on the received user request signal.
[0085] Fig. Figure 2 shows an example of processed image data (e.g., displayed on the display unit 18) in standard mode. The left and right images show the same shooting situation and the same received image data (raw data), but with different image processing settings. For clarity, the differences primarily concern image brightness, but this is not intended to be a limitation. As can be seen, both processed image sets show an example of a city street at night, with the received image data in this example being rear-view data. For example, parts of the side of vehicle 20 can be seen on the left side of both the left and right images.Comparing the two images, it can be seen that the left image essentially only shows road 22, illuminated by another vehicle 21 behind vehicle 20, while the area surrounding road 22 is relatively dark. In the right image, the image processing settings are changed to increase the overall brightness of the image, allowing more details in the area surrounding road 22 (e.g., parked cars) to be more easily discernible. By default, only one standard image processing setting can be used (e.g., the settings that result in either the left or right image). However, it may be possible for the driver to manually adjust the image processing settings, for example, via the vehicle's control unit and / or vision system, which in this example results in the opposite image (right or left).Furthermore, it should be mentioned again that other image processing settings, such as contrast, digital amplification and / or sharpness of the received image data, can also be changed, but these are difficult to represent in a line drawing.
[0086] Fig. Figure 3 shows an example of processed image data (e.g., displayed on display unit 18) in highway driving mode. Again, the left and right images show the same captured situation or received image data (raw data), but with different image processing settings used when processing the received image data. As in the case of Fig. 2. For reasons of displayability, the different image processing settings mainly concern image brightness, which, however, should not restrict the subject in any way. As can be seen, both processed image data show an exemplary zoomed view of a nighttime highway situation, whereby in this exemplary case the received image data consists of rear-view images. Comparing the respective images, it can be seen that in the left image another vehicle 21 is visible driving behind vehicle 20, but the driver is not excessively dazzled by the light of the other vehicle 21 because the overall brightness is reduced. In contrast, in the right image the image processing settings are changed so that the overall brightness of the image is increased, resulting in a very bright image being displayed on the display device 18.By default, a standard image processing setting can be used (e.g., the settings that result in the darker left image). However, it is possible for the driver to manually adjust the image processing settings, for example, via the vehicle's control unit and / or vision system, which in this example results in the right image. Furthermore, it should be noted again that other image processing settings, such as contrast, digital gain, and / or sharpness of the received image data, can also be changed, but these are difficult to illustrate in a line drawing.
[0087] Fig.Figure 4 shows schematic representations of processed image data in standard, shunting, and highway driving modes, where the processed image data has different fields of view. In this example, the processed image data (and the received image data) includes image data relating to a Class II, a Class IV, and a Class V field of view of the vehicle's surroundings, as defined in Directives 2003 / 97 / EC and 2007 / 38 / EC. During the processing step, the different fields of view can be combined into a single view, whereby the relative areas of the different fields of view in the combined view can vary depending on the specific image processing mode. For example, in shunting mode, the area of the Class V field of view can be enlarged compared to standard mode.Consequently, the (identical) image data of the Class V field of view can be displayed larger on the display unit 18 than in standard mode. Furthermore, the area of the Class IV and Class II fields of view can be reduced compared to standard mode. Thus, the Class II and Class IV fields of view can be displayed smaller on the display unit 18 compared to standard mode. Additionally or alternatively, in highway driving mode, the area of the Class V field of view can be reduced compared to standard mode. Consequently, the image data of the Class V field of view can be displayed smaller on the display unit 18 in this mode than in standard mode.
[0088] Although the invention has been described with reference to specific embodiments, it is obvious to the person skilled in the art that various modifications can be made and equivalents can be used as replacements without deviating from the scope of the invention. Consequently, the invention is not intended to be limited to the disclosed embodiments, but rather to encompass all embodiments that fall within the scope of the appended claims. In particular, the invention also claims protection for the subject matter and features of the dependent claims independently of the referenced claims. Reference symbol list 10 Vision System 12 Image capture device 14 Condition setting 15 Situation Recognition Device 16 Image data processing equipment 17 Control unit 18 Display device 20 vehicles 21 Other vehicle 22nd Street
Claims
[1] Method for operating an image data processing device (16) of a vision system (10) of a vehicle (20), comprising: Receiving image data acquired by at least one image acquisition device (12), wherein the image data preferably include rear view image data acquired laterally and / or behind the vehicle (20); Receiving a status signal indicating a day state or a night state, preferably generated by a status device (14), e.g. a brightness sensor; and Processing the received image data, preferably comprising adjusting the contrast and / or brightness of the received image data depending on the received status signal; wherein the received image data includes data relating to different fields of view, preferably a Class II field of view, a Class IV field of view and / or a Class V field of view; and The processing step involves merging the different fields of view into a combined view, whereby the relative areas of the different fields of view in the combined view are varied depending on a selected image data processing mode. [2] Method according to claim 1, wherein the processing step differs depending on whether the received state signal indicates the day state or the night state. [3] Method according to claim 1 or 2, wherein the processing step comprises: Adjusting the contrast of the received image data; and / or adjusting the digital gain of the received image data; and / or adjusting the noise filtering of the received image data. [4] Method according to any of the preceding claims, further comprising: Output of a control signal for the at least one image acquisition device (12) depending on the received status signal, wherein the control signal causes the at least one image acquisition device (12) to adjust at least one image acquisition setting, preferably a frame rate, a gain, an exposure time and / or an exposure threshold, which is the at least one image acquisition device (12). [5] Method according to any of the preceding claims, further comprising: Receiving, preferably from a situation detection device (15), a situation signal indicating a current speed, gear selection and / or operating state of the vehicle (20); and the processing step also depends on the received situation signal. [6] Method according to claim 5, wherein the processing step comprises: Reducing the contrast, digital gain and / or brightness of the received image data when the received situation signal indicates a long-distance journey of the vehicle (20); and / or Increasing the contrast, digital amplification and / or brightness of the received image data when the received situation signal indicates maneuvering, preferably a parking operation, of the vehicle (20). [7] Method according to claim 5 or 6, further comprising: Selecting the image data processing mode, preferably at least three, particularly preferably at least four, predefined possible image data processing modes depending on the received situation signal; and the processing step is performed according to the selected image data processing mode. [8] Method according to claim 7, wherein the predefined possible image data processing modes include: a reverse driving mode, preferably featuring the generation of a wide-angle view of the received image data; and / or a motorway driving mode which preferably includes the generation of a zoomed view of the received image data; and / or a shunting mode which preferably includes the generation of a wide-angle view of the received image data. [9] Method according to claim 8, wherein: the predefined possible image data processing modes further include a standard mode, preferably an urban driving mode; wherein: The reverse driving mode has higher contrast, higher brightness and / or higher digital gain than the standard mode; and / or The motorway driving mode has lower contrast, lower brightness and / or lower digital gain than the standard mode; and / or The shunting mode has a higher contrast, higher brightness and / or higher digital gain than the standard mode. [10] Method according to claim 9, wherein: In motorway driving mode, the Class V field of vision is reduced compared to standard mode; and / or In shunting mode, the Class V field of vision is increased compared to standard mode. [11] A method according to any of the preceding claims, further comprising: Receiving a display brightness signal from a display device (18), wherein the display brightness signal indicates a brightness of a display of the display device (18), preferably a brightness of a backlight of a display of the display device (18); wherein the processing step is carried out depending on the received display brightness signal, preferably as follows: that the contrast of the received image data is increased when the display brightness signal indicates an increase in the brightness of the display and / or that the contrast of the received image data is reduced when the display brightness signal indicates a decrease in the brightness of the display. [12] Method according to any of the preceding claims, further comprising: Receiving a user request signal; and Adjusting the image processing settings depending on the received user request signal, preferably: a) Selecting a different image data processing mode and / or adjusting the selected image data processing mode depending on the received user request signal; and / or b) Adjusting the contrast, digital gain, and / or noise filtering of the received image data depending on the received user request signal; and / or c) Adjusting the displayed portion of the received image data depending on the received user request signal. [13] Vision system (10) for a vehicle (20), comprising: at least one image capture device (12) designed to capture image data, preferably rear view image data, which are captured from the side and / or behind the vehicle (20); a state device (14), preferably a brightness sensor, wherein the state device (14) is configured to generate a state signal indicating a day state or a night state; an image data processing device (16), wherein the image data processing device (16) is configured to receive the captured image data and the generated status signal, and is further configured to process the received image data depending on the received status signal, wherein the image data processing device (16) is configured to carry out a method according to one of the preceding claims. [14] Vision system (10) according to claim 13, further comprising: a display device (18) configured to display the processed image data, wherein the display device (18) preferably has a display configured to simultaneously display a Class II field of view, a Class IV field of view and a Class V field of view. [15] vehicle (20), preferably a commercial vehicle, comprising: a vision system (10) according to claim 13 or 14. [16] Vehicle (20) according to claim 15, wherein: the at least one image acquisition device (12) is configured to capture different fields of view, preferably a Class II field of view, a Class IV field of view and / or a Class V field of view; and / or the vision system (10) is part of a mirror replacement system of the vehicle; and / or The vision system (10) is capable of displaying a 360° view of the vehicle's surroundings on the display device (18).
Citation Information
Patent Citations
Method for implementing automatic color balancing in towing vehicle with camera system, has performing color balancing on picture information based on available lighting information, and providing color-corrected picture information
DE102011083786A1
Method and device for generating a display image in a motor vehicle
DE102018207388A1