Optical sensor, environment detection system and vehicle

A two-dimensional pixel matrix with predefined spectral sensitivities in a CCD or CMOS sensor enables simultaneous capture of multiple spectral ranges, enhancing vehicle detection systems for reliable environmental sensing and autonomous driving.

DE102023206089B4Active Publication Date: 2025-01-23VOLKSWAGEN AG
View PDF 20 Cites 0 Cited by

Patent Information

Application Number
DE102023206089
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-06-28
Publication Date
2025-01-23
Estimated Expiration
2043-06-28

AI Technical Summary

Technical Problem

Existing optical sensors struggle to simultaneously capture multiple spectral ranges, including visible and non-visible light, for applications such as vehicle detection systems, lacking efficient methods for multi-spectral imaging.

Method used

A two-dimensional pixel matrix with a predefined sequence of spectral sensitivities, combined with a selection and evaluation unit, allows for simultaneous capture of at least four different wavelength ranges, including three in the visible spectrum and one in the non-visible spectrum, using a CCD or CMOS sensor.

Benefits of technology

Enables reliable and comprehensive environmental detection, including ice, water, fog, people, animals, and various materials, supporting partial or full autonomous driving and driver assistance systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

The invention relates to an optical sensor (5), an environment detection system, and a vehicle, wherein the optical sensor (5) comprises a pixel matrix (10), a readout unit (20), and an evaluation unit (30). A spectral sensitivity of pixels (12) of the pixel matrix (10) is defined according to a predefined sequence (40), which specifies spectral sensitivities for every five consecutive pixels (12) in a row (14) of the pixel matrix (10), wherein, based on the predefined sequence (40), three pixels (12) of the five consecutive pixels (12) in a row (14) are configured to detect only light in the visible spectral range, one pixel (12) of the five consecutive pixels (12) is configured to detect only light outside the visible spectral range, and the predefined sequence (40) is repeatedly assigned to each row (14) of the pixel matrix (10).the predefined sequence (40) is assigned between two consecutive rows (12) offset by two pixels (12), the readout unit (20) is set up to read out generated charge quantities from the pixel matrix (10) and to generate a brightness image corresponding to the pixel matrix (10) on the basis of these, the evaluation unit (30) is set up to evaluate the brightness image pixel by pixel on the basis of a predefined evaluation pattern (60) by evaluating four further pixels (12') adjacent to each pixel (12) and assigning the respective brightness information of the pixels (12, 12') to be evaluated together to their respective spectral sensitivities and providing these as group information for each pixel (12) to be evaluated.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to an optical sensor, an environment recognition system with such an optical sensor and a vehicle with such an optical sensor and / or with such an environment recognition system.

[0002] Optical sensors are known from the prior art, for example, for use in cameras that enable the detection of three different colors, usually red, green, and blue (hereinafter also abbreviated as RGB). For this purpose, individual light-sensitive cells (i.e., pixels) of the optical sensors are usually preceded by color filters corresponding to the respective colors to be detected, which are distributed across a receiving surface of the optical sensors according to a predefined pattern (e.g., a Bayer pattern, or similar).

[0003] Sensor surfaces with a silicon-based photosensitive layer are often used as the basis for such optical sensors, by means of which a spectral range of approximately 400 nm to 1000 nm can be detected.

[0004] However, novel approaches for photosensitive layers enable the detection of a wider spectral range from approximately 400 nm to 1700 nm or, in some cases, even beyond 2000 nm, on the basis of which multispectral images with more than three or more than four different detectable spectral ranges are possible.

[0005] Multispectral images capturing more than four different spectral ranges have traditionally been achieved using a color wheel placed in front of the optical sensor. This color wheel is divided into numerous sectors, each with a different spectral band filter, and positioned in front of the optical sensor in such a way that an image generated by the optical sensor is completely captured by a single spectral band filter. Thus, several images are captured sequentially, each representing an exposure for a predefined spectral range.

[0006] US 20070024931 A1 discloses an image sensor with a two-dimensional array of first and second groups of pixels, wherein the pixels of the first group have a narrower spectral sensitivity than pixels of the second group, and wherein the first group has individual pixels corresponding to a set of at least two colors. The placement of the pixels of the first and second groups forms a pattern having a minimum repeat unit of at least 12 pixels.

[0007] US 6803955 B1 discloses an image capture device having a pixel array formed as a two-dimensional periodic array of 6-pixel arrays as a unit array, wherein of the six pixels of each unit array, the first to third pixels have different color properties and the fourth to sixth pixels each have different sensitivities and identical color properties with respect to the first to third pixels.

[0008] US 2007296841 A1 discloses, inter alia, a method for producing a color image capture unit comprising a pixel group in which a plurality of pixels each have a photoelectric conversion element and a color filter, the method comprising, inter alia, a step for generating a random arrangement pattern in which color filters of at least one color component are randomly arranged.

[0009] DE 11 2019 003 967 T5 shows an image recording device comprising a first pixel with a first color filter that transmits a wavelength band corresponding to light of a first color, which is visible light, and a cutoff filter for infrared light that limits a transmittance of a wavelength band for infrared light, a second pixel with a second color filter that transmits a wavelength band corresponding to light of a second color, which is visible light, and the cutoff filter for infrared light, a third pixel with a third color filter that transmits a wavelength band corresponding to light of a third color, which is visible light, and the cutoff filter for infrared light, a fourth pixel with transmittance characteristics to transmit the wavelength band for infrared light, and a fifth pixel with wavelength transmittance characteristics that are different from all of the first pixel, the second pixel,of the third pixel and the fourth pixel are different.,

[0010] It is an object of the present invention to provide an optical sensor that enables simultaneous multispectral recording of visible light and light outside the visible spectral range. It is also an object of the present invention to provide an environment detection system and a vehicle based on the optical sensor.

[0011] The above-identified problem is solved by the features of the independent claim. The subclaims contain preferred developments of the invention.

[0012] According to a first aspect of the present invention, an optical sensor is proposed which comprises a (two-dimensional) pixel matrix, a readout unit, and an evaluation unit. The optical sensor is designed, for example, as a CCD sensor and / or a CMOS sensor. The number of pixels per row and / or column and / or the size of the pixels are not limited to specific values. Based on the optical sensor, it is possible, for example, to design a camera for a vehicle and / or a camera for optical quality monitoring of products and / or a component other than these.

[0013] The pixel matrix is ​​formed from a plurality of light-sensitive cells (also called pixels), wherein a spectral sensitivity of pixels of the pixel matrix is ​​determined according to a predefined sequence of spectral sensitivities, which specifies spectral sensitivities for five consecutive pixels in a row of the pixel matrix. Based on the predefined sequence of spectral sensitivities, at least three pixels of the five consecutive pixels in a row are configured to detect essentially only light in the visible spectral range, wherein the at least three pixels each have differing spectral sensitivities.

[0014] It should be noted that the term "row" refers to the pixel matrix in which the predefined sequence of spectral sensitivities is applied, and does not necessarily correspond to a row definition resulting from a readout direction (by line-by-line readout) and / or an orientation of the pixel matrix in space and / or with respect to a housing, etc. Accordingly, it is also possible to apply the predefined sequence of spectral sensitivities in a direction perpendicular to a direction of a row defined by line-by-line readout.

[0015] It should also be noted that the term “light” here explicitly includes electromagnetic radiation whose wavelength lies outside the visible range, for example in the infrared range.

[0016] Furthermore, at least one of the five consecutive pixels is configured to detect essentially only light outside the visible spectral range. Accordingly, this does not preclude one or more of these three pixels from having a certain (residual) sensitivity in the range of non-visible wavelengths, as long as a primary sensitivity of each of these three pixels lies within the visible wavelength range.

[0017] The predefined sequence of spectral sensitivities is repeatedly assigned depending on the number of pixels per row, so that all pixels in a row are assigned one of the predefined spectral sensitivities according to the predefined sequence of spectral sensitivities. Specifically, the predefined sequence of spectral sensitivities is applied to the pixels of the first row, for example, in such a way that the predefined sequence is applied to the first five pixels starting from the leftmost edge of the row and then repeated for pixels 6 to 10, 11 to 15, 16 to 20, and so on. It is not mandatory for the number of pixels per row to be an integer multiple of the number of sensitivities in the predefined sequence (i.e., five).Instead, the predefined sequence can also be applied incompletely if five full pixels can no longer be assigned at the end of a particular row. It should also be noted that the direction of assignment of the predefined sequence of spectral sensitivities within a row can also be from right to left.

[0018] Furthermore, the predefined sequence of spectral sensitivities is assigned between two consecutive rows of the pixel matrix, offset by two pixels in a predefined direction (from left to right or from right to left). This shift of the predefined sequence occurs with each row change and always in the predefined direction, so that, for example, the sixth row of the pixel matrix again has an identical assignment of spectral sensitivities as the first row. Even in this viewing direction (i.e., perpendicular to the direction of extension of the respective rows), it is not necessary for the total number of rows of the pixel matrix to correspond to an integer multiple of the repetition period (i.e., 5 rows).Specifically, the offset of two pixels in the predefined direction means that the predefined sequence, which, for example, has the spectral sensitivity values ​​E1, E2, E3, E4, and E5 in the first row of the pixel matrix, begins with the sensitivity value E3 in the immediately following row, so that the sequence in this subsequent row corresponds to the values ​​E3, E4, E5, E1, and E2, which may be repeated several times depending on the number of pixels per row. In another subsequent row, the sequence of sensitivity values ​​according to the present example would correspond to the values ​​E5, E1, E2, E3, and E4.Instead of performing the shift by two pixels at a time, it is also possible to predefine line-specific sequences of spectral sensitivities corresponding to the different lines for each of five consecutive lines, which in their entirety form the predefined sequence of spectral sensitivities.

[0019] The readout unit is configured to read photoelectrically generated charge quantities from the pixels in the pixel matrix and, based on these, generate a brightness image corresponding to the pixel matrix. For this purpose, mechanisms known from the prior art for reading the pixels of the pixel matrix are preferably used (e.g., line-by-line readout with a corresponding shutter function, etc.), which is why reference is made to the prior art in this regard.

[0020] The evaluation unit, which is designed, for example, as an ASIC, FPGA, processor, digital signal processor, microcontroller, or similar, is configured to evaluate the brightness image pixel by pixel based on a predefined evaluation pattern. For each pixel to be evaluated, four additional pixels adjacent to the pixel to be evaluated are evaluated. These pixels are arranged symmetrically with respect to the pixel to be evaluated, so that the total of five pixels to be evaluated together have the spectral sensitivities of the predefined sequence of spectral sensitivities. Here and below, "adjacent" pixels are generally understood to mean pixels that are closest to one another in a given viewing direction. This therefore also applies if there is a gap between the nearest pixels and these pixels do not directly abut one another with their respective edges.

[0021] Since the additional pixels to be evaluated are arranged symmetrically around the pixel currently being evaluated or viewed, the outermost pixels of the pixel matrix, which represent the edge pixels of the pixel matrix, sometimes have no adjacent pixels. This problem can be avoided, for example, by not using the outermost pixels as the central pixel to be evaluated during pixel-by-pixel evaluation of the pixel matrix, but instead by only considering the pixels within the outermost pixel row during pixel-by-pixel evaluation. In this way, the outermost pixels always ensure that all additional pixels to be evaluated are available when evaluating the respective central pixel to be evaluated.Alternatively, it is also conceivable to evaluate all pixels of the pixel matrix pixel by pixel and fill the partially missing surrounding pixels with virtual pixels, for which, for example, a black value or a suitable predefined brightness value deviating from this value is assumed. Furthermore, it is also conceivable to extrapolate the virtual pixels based on a calculation of surrounding pixel values.

[0022] Finally, the evaluation unit is configured to assign the respective brightness information of the five pixels to be evaluated together to their respective spectral sensitivities and to provide this as group information for each pixel to be evaluated.

[0023] The optical sensor according to the invention offers, among other things, the advantage that at least four different wavelength ranges (at least three in the visible light range and at least one in the non-visible light range) of a light incident on the optical sensor can be detected simultaneously, which results in numerous advantageous uses of the proposed optical sensor, for example in an environment detection system of a vehicle.

[0024] In an advantageous embodiment of the present invention, the evaluation unit is configured to use the evaluation pattern to evaluate, in addition to the pixel currently being evaluated, those four pixels of the pixel matrix that each border with an edge on one of the edges of the pixel to be evaluated to generate the corresponding group information during pixel-by-pixel evaluation of the pixel matrix. In other words, in this case, the evaluation pattern forms a cross shape, in which the pixel currently being evaluated represents the center of the cross, while the two pixels to the left and right of the pixel to be evaluated and the two pixels above and below the pixel to be evaluated represent the additional pixels to be evaluated.Alternatively or additionally, the evaluation unit is configured to use the evaluation pattern to evaluate, in addition to the pixel currently being evaluated, those four pixels of the pixel matrix that are diagonally adjacent to the pixel to be evaluated to generate the corresponding group information during pixel-by-pixel evaluation of the pixel matrix. In other words, the evaluation pattern in this case forms an x-shape. It may be advantageous to apply both the cross-shaped evaluation pattern and the x-shaped evaluation pattern to each pixel to be evaluated in order to generate two pieces of group information for each pixel to be evaluated, which can be used alternatively or jointly in subsequent processing as required.

[0025] In a further advantageous embodiment of the present invention, the at least three pixels, which are configured based on the predefined sequence of spectral sensitivities to detect essentially only light in the visible spectral range with respectively differing spectral sensitivities, are configured to detect red, green, and blue (i.e., RGB) light. In other words, a first of these three pixels is configured to detect light in the red wavelength range, while a second of these three pixels is configured to detect light in the green wavelength range, and while a third of these three pixels is configured to detect light in the blue wavelength range.

[0026] Preferably, the at least one pixel of the five consecutive pixels (from each of which a piece of group information is generated) which is intended to detect light outside the visible range is configured to detect light in the near infrared range and / or in the short-wave infrared range and / or in a wavelength range from 700 nm to 1000 nm and / or in a wavelength range from 1000 nm to 2000 nm and / or in a wavelength range from 1150 nm to 1250 nm and / or in a wavelength range from 1350 nm to 1450 nm. In particular, the wavelength range from 1150 nm to 1250 nm is suitable for detecting light reflections from color pigments of skin and / or clothing, so that persons can be identified particularly reliably on the basis of this wavelength range.The wavelength range between 1350 nm and 1450 nm is particularly suitable for identifying wet and / or frozen patches on a road surface, as these patches exhibit significantly higher absorption in this wavelength range than dry areas of the road surface. The high contrast between these patches and the dry areas enables appropriate identification when the optical sensor is used in a vehicle, for example. Particularly advantageously, one of the five consecutive pixels in a row is configured to detect wavelengths from 1150 nm to 1250 nm, while another of the five consecutive pixels is configured to detect wavelengths in the range from 1350 nm to 1450 nm.Accordingly, by detecting these two wavelength ranges in the non-visible range in addition to the wavelength ranges of the remaining three pixels in the visible range, an optical sensor can be achieved on the basis of which particularly reliable and comprehensive environmental detection is possible, e.g. for a vehicle.

[0027] Alternatively or additionally, one pixel of the predefined sequence of pixels is configured to receive light across the entire visible spectral range. This allows for the realization of an optical sensor that can capture differing color information (e.g., RGB) in the visible wavelength range across three pixels, information across the entire visible wavelength range across one pixel, and light in the near-infrared and / or short-wave infrared ranges across one pixel.

[0028] Furthermore, it is possible for the respective spectral sensitivities of the pixels of the pixel matrix to be realized based on a plurality of spectral filters arranged upstream of the respective pixels in order to appropriately filter light incident on the optical sensor before it strikes the pixel matrix. Alternatively or additionally, it is possible to realize the respective spectral sensitivities of the pixels of the pixel matrix based on differently designed light-sensitive cells. In other words, in this case, the technical properties of the respective pixels are designed according to the predefined sequence of spectral sensitivities.

[0029] According to a second aspect of the present invention, an environment detection system, in particular for a vehicle, is proposed, which has an optical sensor according to the first aspect of the invention. The environment detection system is configured to verify the plausibility of and / or supplement the environment information detected by the optical sensor in the visible spectral range using environment information detected by the optical sensor in the near infrared range and / or in the short-wave infrared range. The features, combinations of features, and the advantages resulting from them correspond to those explained in connection with the first aspect of the invention, so that reference is made to the above statements to avoid repetition.

[0030] In an advantageous embodiment of the environment detection system according to the invention, the environment detection system is configured to identify ice and / or water and / or fog and / or people and / or animals and / or plants and / or generally different materials based on measurement signals from the optical sensor. By appropriately verifying the plausibility and / or supplementing the color information captured by the optical sensor with this additional information from the non-visible spectral range, a particularly high level of detection accuracy of the environment can be achieved with such an environment detection system.

[0031] According to a third aspect of the present invention, a vehicle is proposed which has an optical sensor according to the first aspect of the invention and / or an environment detection system according to the second aspect of the invention. The vehicle is, for example, a road vehicle (e.g., motorcycle, car, van, truck), a rail vehicle, an aircraft, and / or a watercraft. The features, feature combinations, and the advantages resulting from them correspond to those explained in connection with the first and second aspects of the invention, so that reference is made to the above explanations to avoid repetition.

[0032] In an advantageous embodiment of the vehicle according to the invention, the vehicle is configured to use environmental information detected by means of the optical sensor and / or the environmental detection system for a partially autonomous and / or fully autonomous driving operation and / or for a driver assistance system of the vehicle.

[0033] Further details, features, and advantages of the invention will become apparent from the following description and the figures. They show: Fig. 1 is a schematic view of an embodiment of an optical sensor according to the invention; Fig. 2 a schematic view of an embodiment of an evaluation pattern according to the invention; and Fig. 3 a schematic view of a vehicle according to the invention in conjunction with an environment recognition system according to the invention.

[0034] Fig. Figure 1 shows a schematic view of an embodiment of an optical sensor 5 according to the invention, which comprises a pixel matrix 10 with a plurality of light-sensitive pixels 12, a readout unit 20, and an evaluation unit 30 configured as a CPU. The optical sensor 5 is configured here as a CCD sensor.

[0035] The pixels 12 are arranged two-dimensionally in a plurality of rows 14 and a plurality of columns 16 of the pixel matrix 10. A spectral sensitivity of the pixels 12 of the pixel matrix 10 is defined according to a predefined sequence of 40 spectral sensitivities, which defines spectral sensitivities for five consecutive pixels 12 in a row 14 of the pixel matrix 10. The predefined sequence 40 here corresponds to a sequence of 40 spectral sensitivities for a red spectral range R, a blue spectral range B, a green spectral range G, a near-infrared spectral range N, and a short-wave infrared range K.

[0036] The predefined sequence of 40 spectral sensitivities is assigned repeatedly depending on the number of pixels 12 per row 14, so that all pixels 12 of a row 14 are assigned one of the predefined spectral sensitivities according to the predefined sequence of 40 spectral sensitivities. Fig. 1 it is made clear that only a section of a larger pixel matrix 10 is shown, so that the predefined sequence 40 is repeated more frequently than shown here.

[0037] The predefined sequence 40 of spectral sensitivities is assigned between two consecutive rows 12 of the pixel matrix 10 in a predefined direction 50 offset by two pixels 12 each, so that the Fig. 1 shown arrangement of 40 spectral sensitivities is achieved.

[0038] It should be noted that both the sequence 40 of the spectral sensitivities used here and the composition of the spectral sensitivities in the sequence 40 may be different from this.

[0039] The readout unit 20 is configured to read out photoelectrically generated charge quantities in the pixels 12 from the pixel matrix 10 and, on the basis thereof, to generate a brightness image corresponding to the pixel matrix 10.

[0040] The evaluation unit 30 is configured to evaluate the brightness image pixel by pixel based on a predefined evaluation pattern 60. For each pixel 12 to be evaluated, four additional pixels 12' adjacent to the pixel 12 to be evaluated (here, for reasons of clarity, only one of the four additional pixels 12' is provided with a reference symbol) are evaluated. These pixels are arranged symmetrically with respect to the pixel 12 to be evaluated, so that the total of five pixels 12, 12' to be evaluated together have the spectral sensitivities of the predefined sequence 40 of spectral sensitivities. By means of the evaluation pattern 60, those pixels 12 of the pixel matrix 10 which each border with an edge on one of the edges of the pixel 12 to be evaluated are defined as additional pixels 12' to be evaluated.

[0041] The evaluation unit 30 is further configured to assign the respective brightness information of the pixels 12, 12' to be evaluated together to their respective spectral sensitivities and to provide this as group information for each pixel 12 to be evaluated.

[0042] Fig. 2 shows a schematic view of an embodiment of an evaluation pattern 60 according to the invention, wherein on the basis of this evaluation pattern 60 those pixels 12 of the pixel matrix 10 are selected as additional pixels 12' to be evaluated which each border diagonally on the pixel 12 of the pixel matrix 10 currently to be evaluated.

[0043] The Fig. The embodiment of the evaluation pattern 60 shown in Figure 2 can be used alternatively or in addition to the Fig. Apply the different embodiment shown in 1.

[0044] Fig.3 shows a schematic view of a vehicle 80 according to the invention in conjunction with an environment recognition system 70 according to the invention, wherein the vehicle 80 is designed here as a passenger car and the environment recognition system 70 is connected in terms of information technology to an optical sensor 5 according to the invention, which is integrated here into a front camera of the vehicle 80.

[0045] Based on this configuration, the vehicle 80 is configured by means of the environment detection system 70 to particularly reliably detect and evaluate the environment of the vehicle 80 and to transmit output signals of the environment detection system 70 to a driver assistance system 90, which is designed, for example, as a lane keeping system and / or as a pedestrian detection system and / or in a manner deviating therefrom. List of reference symbols 5 optical sensor 10 pixel matrix 12 pixels 12' additional pixels 14 lines 16 columns 20 reading unit 30 evaluation unit 40 predefined sequences of spectral sensitivities 50 Displacement direction 60 evaluation samples 70 Environment detection system 80 vehicles 90 Driver assistance system

Claims

[1] Optical sensor (5) comprising: • a pixel matrix (10), • a reading unit (20), and • an evaluation unit (30), where • the pixel matrix (10) is formed from a plurality of light-sensitive cells, • a spectral sensitivity of pixels (12) of the pixel matrix (10) is determined according to a predefined sequence (40) of spectral sensitivities, which spectral sensitivities define for five consecutive pixels (12) in a row (14) of the pixel matrix (10), • based on the predefined sequence (40) of spectral sensitivities ◯ at least three pixels (12) of the five consecutive pixels (12) in a row (14) are arranged to detect substantially only light in the visible spectral range, wherein the at least three pixels (12) each have spectral sensitivities that differ from one another, ◯ at least one pixel (12) of the five consecutive pixels (12) is arranged to detect substantially only light outside the visible spectral range, • the predefined sequence (40) of spectral sensitivities is repeatedly assigned as a function of a number of pixels (12) per row (14), so that all pixels (12) of a row (14) are assigned one of the predefined spectral sensitivities according to the predefined sequence (40) of spectral sensitivities, • the predefined sequence (40) of spectral sensitivities is assigned between two consecutive lines (12) of the pixel matrix (10) in a predefined direction (50) offset by two pixels (12) each, • the readout unit (20) is configured to read out photoelectrically generated charge quantities in the pixels (12) from the pixel matrix (10) and, on the basis of these, to generate a brightness image corresponding to the pixel matrix (10), • the evaluation unit (30) is set up, ◯ to evaluate the brightness image pixel by pixel on the basis of a predefined evaluation pattern (60) by evaluating, for each pixel (12) to be evaluated, four further pixels (12') adjacent to the pixel (12) to be evaluated, which are arranged symmetrically with respect to the pixel (12) to be evaluated, so that the total of five pixels (12, 12') to be evaluated together have the spectral sensitivities of the predefined sequence (40) of spectral sensitivities, and ◯ to assign the respective brightness information of the pixels (12, 12') to be evaluated together to their respective spectral sensitivities and to provide this as group information for each pixel (12) to be evaluated. [2] Optical sensor (5) according to claim 1, wherein the evaluation unit (30) is configured to evaluate, by means of the evaluation pattern (60), in addition to the pixel (12) currently to be evaluated, those four pixels (12') of the pixel matrix (10) for generating the group information, • which each border with an edge on one of the edges of the pixel (12) to be evaluated, and / or • which each border diagonally on the pixel (12) to be evaluated. [3] Optical sensor (5) according to one of the preceding claims, wherein the at least three pixels (12) which are configured on the basis of the predefined sequence (40) of spectral sensitivities to detect substantially only light in the visible spectral range with respectively differing spectral sensitivities are configured to detect red, green and blue light. [4] Optical sensor (5) according to one of the preceding claims, wherein the at least one pixel (12) of the five consecutive pixels (12) which is intended to detect light outside the visible range is arranged to detect light • in the near infrared range and / or in the short-wave infrared range, and / or • in a wavelength range of 700 nm to 1000 nm, and / or • in a wavelength range of 1000 nm to 2000 nm, and / or • in a wavelength range of 1150 nm to 1250 nm, and / or • to detect in a wavelength range from 1350 nm to 1450 nm. [5] Optical sensor (5) according to one of the preceding claims, wherein a pixel (12) of the predefined sequence (40) of pixels (12) is arranged to receive light in the entire visible spectral range. [6] Optical sensor (5) according to one of the preceding claims, wherein the respective spectral sensitivities of the pixels (12) of the pixel matrix (10) are based on • a plurality of spectral filters are implemented, which are arranged upstream of the respective pixels (12) in order to filter light incident on the optical sensor (5) before it strikes the pixel matrix (10), and / or • differently formed light-sensitive cells are realized. [7] Environment detection system (70) comprising an optical sensor (5) according to one of the preceding claims, wherein the environment detection system (70) is configured to check the plausibility of and / or supplement environment information in the visible spectral range detected by the optical sensor (5) by means of environment information in the near infrared range and / or in the short-wave infrared range detected by the optical sensor (5). [8] Environment detection system (70) according to claim 7, wherein the environment detection system (70) is set up on the basis of measurement signals from the optical sensor (5), • Ice and / or water and / or fog, and / or • Persons and / or animals and / or plants, and / or • different materials to identify. [9] Vehicle (80) comprising an optical sensor (5) according to one of claims 1 to 6 and / or an environment detection system (70) according to claim 7 or 8. [10] Vehicle (80) according to claim 9, wherein the vehicle (80) is configured to use environmental information detected by means of the optical sensor (5) and / or the environmental detection system (70) for a partially autonomous and / or fully autonomous driving operation and / or for a driver assistance system of the vehicle (80).

Citation Information

Patent Citations

  • Combined pixel with phase-sensitive and color-selective subpixel

    DE102011053219B4

  • sensor module, method for determining a brightness and / or a color of an electromagnetic radiation and method for producing a sensor module

    DE102016208409A1

  • IMAGE SYSTEM AND IMAGE PIXELS AND ASSOCIATED METHODS

    DE102022134400A1

  • sensor arrangement with a plurality of types of optical sensors

    DE10335190A1

  • IMAGE ACCEPTATION DEVICE AND IMAGE ACCEPTATION SYSTEM

    DE112019003967T5