Object recognition system for a flat carrier medium arranged on a device

By using a surface carrier medium and holographic elements in the vehicle, the problem of inappropriate image acquisition position and low resolution in object recognition in vehicle is solved, high-quality object recognition and hidden installation are achieved, and recognition is improved Effect.

CN113767396BActive Publication Date: 2024-12-03AUDI AG
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202080032973.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-05-03
Filing Date
2020-04-30
Publication Date
2024-12-03
Estimated Expiration
2040-04-30

AI Technical Summary

Technical Problem

The prior art has problems in the object recognition in vehicles that inappropriate image acquisition position, distortion of image resolution, low resolution and opaque instrument design, which leads to inability to install in multiple locations, limiting the object recognition effect.

Method used

Design an object recognition system, using a planar carrier medium as a light conductor, transmits light from the surrounding environment to the image acquisition device through internal reflection, and uses the coupling in and out regions of holographic elements to realize the deflection and beam splitting of light, improving The quality and range of image acquisition.

Benefits of technology

It realizes high-quality image acquisition and object recognition in large areas, and can be installed concealedly in multiple locations in the motor vehicle, improving the accuracy and reliability of object recognition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113767396B_ABST
    Figure CN113767396B_ABST
Patent Text Reader

Abstract

The invention relates to an object recognition system (30) having an evaluation device (32) and at least one detection device (10) having at least one image acquisition device (11) and a planar carrier medium (12) for arrangement on a device in a vehicle interior (42). The planar carrier medium (12) is designed as an optical waveguide and has an incoupling region (16) and an outcoupling region (18) arranged thereon. Light (100) from the surroundings is fed into the carrier medium (12) via the incoupling region (16), is transmitted to the outcoupling region (18) by means of internal reflection, and is coupled out of the carrier medium there. The at least one image acquisition device (11) is designed to detect the outcoupling light (100) and to provide it in the form of image data relating to the detected light (100). The evaluation device (32) is designed to detect an object (36) in the surroundings taking into account the image data, to identify the detected object (36) taking into account an object recognition criterion, and to provide object data describing the identified object (36).
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to an object recognition system having an evaluation device and at least one detection device, wherein the at least one detection device has at least one image acquisition device and a planar carrier medium for being arranged on the device. The invention also relates to a motor vehicle having a vehicle interior and such an object recognition system. Background Art

[0002] Various measuring methods can be used to determine the type of object in the surroundings of the instrument. Measuring methods based on near field communication or with the aid of optical sensors, radar devices or proximity-based sensors can be used, for example. For example, inductive measuring devices or pressure sensors are understood here as proximity-based sensors. However, especially in optical sensors, the shooting position for taking an image of the object to be identified is often set inappropriately. For example, this is usually the case: due to the viewing angle of the measuring instrument, the image of the object is distorted, the recognition distance or focal plane of the measuring instrument is limited, the resolution of the image is too low, the structural space used for detecting and identifying objects, for example in a vehicle, is designed to be too small for the application of the selected measuring method; or the instrument is designed to be opaque, resulting in the inability to select various positions in the motor vehicle, such as on the windshield.

[0003] US 2015 / 0023602 A1 discloses a system and method for quickly identifying and distinguishing different objects. Objects can be identified using vehicle sensors that work according to the holographic principle.

[0004] DE 10 2009 010 904 A1 describes the detection of one or more objects by recording a time-coherent object wave field reflected or emitted by the respective object. In this case, the amplitude and phase of the object wave field are recorded at a plurality of points in the recording space portion.

[0005] WO 00 / 50267 describes the recognition of persons or objects in the interior of a vehicle by means of a sensor. The sensor can be designed as a camera and record an image of the interior and then perform pattern recognition. Alternatively, the sensor can scan the active area in the interior of the vehicle, for example by means of light radiation.

[0006] Optical diffraction gratings are also known from the prior art, which are produced in a holographic manner and are therefore called holographic gratings. In this regard, it is known from the scientific publication "Volume-phase holographic gratings and their potential for astronomical applications" (SC Barden, JA Arns und WS Colburn, Proceedings SPIE 3355, Optical Astronomical Instrumentation, 1998) that light incident on such a holographic grating at an angle that is clearly outside the angular range that satisfies the Bragg condition passes through the holographic grating without being diffracted. However, if the light is incident on the holographic grating at an angle that at least approximately satisfies the Bragg condition, the light is diffracted at an angle. Similar characteristics are manifested in the wavelength dependence of the influence of the holographic grating on the light. Since light with a wavelength that significantly exceeds the wavelength range predetermined by the Bragg condition as the so-called Bragg wavelength also passes through the holographic grating without being diffracted, only light with a wavelength that at least approximately satisfies the Bragg condition is diffracted at the holographic grating. Thus, for example, light with two different wavelength ranges can be diffracted at the same angle by means of a complex holographic grating structure. In addition, for example, light of different wavelengths can be split into different optical paths by means of a holographic grating, so that a dispersive beam splitter can be realized by means of a holographic grating. Summary of the invention

[0007] The object of the present invention is to provide a solution by means of which objects in the surroundings can be detected and identified over a large recording area.

[0008] Advantageous improvements of the invention are disclosed by the following description and the accompanying drawings. The object recognition system according to the invention comprises an evaluation device and at least one detection device: at least one detection device comprises at least one image acquisition device and a planar carrier medium. The planar carrier medium is designed to be arranged on an instrument. The carrier medium is implemented, for example, as a plate or a film (for example, made of plastic or glass), wherein the carrier medium conducts light from the surroundings to the at least one image acquisition device by means of internal reflection. For this purpose, the carrier medium is designed as an optical conductor, on which an incoupling region and an outcoupling region are provided. That is, the carrier medium is a light-conducting medium. It is a carrier of the incoupling region and the outcoupling region.

[0009] The coupling-in region is designed as a holographic element with a first deflection structure. The first deflection structure is designed to couple light incident on the first deflection structure from the surroundings into a planar carrier medium. In this case, a carrier medium whose surface length and width are selected to be particularly large compared to its vertical thickness is referred to as a planar carrier medium. The coupling-in region includes at least a partial region of the surface of the planar carrier medium. The first deflection structure of the coupling-in region can be implemented as a diffraction grating, for example.

[0010] The planar carrier medium is designed to transmit the coupled light from the coupling-in region to the coupling-out region by means of internal reflection, preferably total reflection. The coupling-out region is in turn designed as a holographic element with a second deflection structure, which is designed to couple the transmitted light impinging on the second deflection structure out of the planar carrier medium. The second deflection structure of the coupling-out region can also be implemented as a diffraction grating, for example.

[0011] At least one image acquisition device is arranged on the decoupling region and is designed to detect the decoupled light and provide it in the form of image data related to the detected light. That is, the image acquisition device is designed to produce or generate image data from the light coupled into the detection device. In order to detect the light coupled out from the carrier medium, the image acquisition device is placed against the decoupling region. In order to fix the image acquisition device on the carrier medium, for example, the image acquisition device can be glued to the carrier medium. Alternatively, the carrier medium can be clamped in a holding device for the image acquisition device. The image acquisition device can preferably be implemented as an image sensor or a camera, respectively with or without an imaging optical system, such as a lens or a lens system. The image acquisition device can be designed, for example, as a CCD sensor (Charged Coupled Device-ladungsgekoppelteVorrichtung) or a CMOS sensor (Complementary Metal Oxide Semiconductor- Metalloxidhalbleiter complementary metal oxide semiconductor). In this design of the image acquisition device as an image sensor, the carrier medium provided with the coupling-in region and the coupling-out region can additionally perform the task of the objective lens, i.e. the imaging optical system. Alternatively, the image acquisition device can also be implemented as a camera or a photographic device with its own imaging optical system, in particular a miniature camera, as designed in a mobile terminal device (smartphone). Therefore, the image acquisition device is designed to generate an image of the surroundings of the object recognition system based on photography and / or video.

[0012] That is, the object recognition system is designed to record a static or moving picture showing an image of the surroundings of the object recognition system. In this case, light incident on the first deflection structure from the surroundings is coupled into the carrier medium and guided in the carrier medium in a sawtooth-like motion along a plane parallel to the surface of the carrier medium. A prerequisite for this is of course that the detection device of the object recognition system is positioned in a preferred installation position, that is, arranged on the surface of the instrument, wherein the side with the coupling-in area points in the direction of the surroundings, while the coupling-out area is arranged, for example, on the opposite side and, for example, arranged in the direction of the instrument. Alternatively, the coupling-in area and the coupling-out area can be arranged on the same side of the carrier medium.

[0013] That is, the entire coupling region of the detection device serves as a detection region for light, which is ultimately conducted to the image acquisition device and provided there as light-related image data. The coupling region thus forms a camera sensor for the image acquisition device. The coupling region preferably includes the entire surface side of the planar carrier medium. This has the advantage that the detection region of the object recognition system can include at least one entire side of the planar carrier medium.

[0014] The evaluation device of the object recognition system is designed to detect objects in the surroundings while taking into account the image data. It is thus possible to detect with the aid of the evaluation device whether a relevant object, such as a person, an object or a symbol displayed on a display device in the surroundings, can be recognized in the image data associated with the detected light. In addition, the evaluation device is designed to recognize the detected object while taking into account object recognition criteria. The object recognition criteria include, for example, features of various objects stored in a database, such as typical size, color and shape, typical reflection properties of light on the object and typical position-related and / or time-related arrangement of the object, for example in the interior of a motor vehicle. The object data describing the recognized object are ultimately provided by the evaluation device. Object recognition can be carried out based on machine learning methods, for example with the aid of artificial neural networks.

[0015] If the detection device with the flat carrier medium is arranged, for example, on the dashboard of a motor vehicle, the object recognition system can first detect the face of the motor vehicle driver in the form of image data, then the detected object, i.e. the detected driver's face, can be recognized taking into account object recognition criteria and, for example, assigned to a stored driver's profile, so that the driver can be authenticated. The object data can then include, for example, the name and other data about the recognized driver stored in the profile.

[0016] For this purpose, the evaluation device has, for example, a processor device which is configured to carry out the described object recognition. For this purpose, the processor device can have at least one microprocessor or at least one microcontroller. In addition, the processor device can have a program code which is configured to carry out the described object recognition when it is executed by the processor device. The program code for this purpose can be stored in a data memory of the processor device.

[0017] That is, an imaging device is finally realized by the object recognition system, which includes a planar carrier medium and at least one image acquisition device arranged on the decoupling area as a camera sensor, and can be positioned at any position, for example, in the interior of a motor vehicle, with which image acquisition is realized on the one hand and object recognition of objects is realized with the detected image data. For example, objects in the interior of a motor vehicle can be detected and recognized thereby. In this case, compared with the above-mentioned alternative object recognition possibilities, an improvement in the recording quality of the image data required for this is achieved by first coupling light into the carrier medium over a large area and transferring it from the carrier medium to the image acquisition device. This is because light is coupled into the object recognition system from a large recording area (for example, the entire surface of the planar carrier medium), so that the image is not only captured point by point but also over a large area. Such a planar and preferably also transparent carrier medium can also be integrated inconspicuously in various positions, including in the windshield of a motor vehicle. The object recognition system described can therefore be used in a universal manner in the surrounding environment, for example in a motor vehicle.

[0018] The present invention also includes configurations that produce additional advantages.

[0019] One embodiment provides that the coupling-in region and the coupling-out region have at least one grating as a deflection structure, in particular a surface holographic grating or a volume holographic grating. In this case, the detection device can also be called HoloCam (short for holographic camera).

[0020] As already mentioned, gratings (also called diffraction gratings) as well as their function and production methods are well known, as can be seen, for example, from the scientific publications cited above. In principle, a grating can be based on an at least partially periodic structure in a substrate, a so-called grating structure. With the help of such a grating structure, the grating can produce a light deflection by the physical effect of diffraction, as is known, for example, from mirrors, lenses or prisms. If light, i.e. a light beam, is incident on the grating, wherein the incident light beam in particular satisfies the Bragg equation, the light beam is diffracted or deflected by the grating. The light deflection can therefore be carried out by the interference phenomenon of the light beam diffracted by the grating. The deflection structure of the coupling-in region or the coupling-out region can therefore also be referred to as a diffraction structure.

[0021] The grating can preferably be designed to be directionally selective or angle selective with respect to the incident light. Thus, only light, in particular a portion of the light, incident on the grating from a predetermined direction of incidence, for example at a predetermined angle, can be deflected. Light, in particular a portion of the light, incident on the grating from another direction is preferably not deflected, or the greater the difference from the predetermined direction of incidence, the smaller the deflection. Thus, light components deviating from the predetermined direction of incidence or the optimal direction of incidence can preferably propagate unhindered through the substrate with the grating.

[0022] Additionally or alternatively, the grating can also be designed to be wavelength selective or frequency selective. Thus, only light with a predetermined wavelength, in particular the first part of the light, can be deflected or diffracted by the grating at a specific diffraction angle. Light with a wavelength different from the predetermined wavelength, in particular the second part of the light, is preferably not deflected, or the greater the difference from the predetermined wavelength, the smaller the deflection. Thus, the second light component deviating from the predetermined wavelength or the optimal wavelength can preferably propagate unhindered through the substrate with the grating. For example, at least one monochromatic light component can be separated from the polychromatic light incident on the grating in this way. The deflection effect is advantageously maximum for the optimal wavelength and decreases towards longer and shorter wavelengths, or becomes weaker, for example according to a Gaussian clock. The deflection effect acts in particular only on a small part of the visible spectrum and / or within an angular range of less than 90 degrees.

[0023] The grating can be produced in particular by exposure of the substrate, i.e. for example by photolithography or holography. In this case, the grating can also be referred to as a holographic grating or a holographic grating. Two types of holographic gratings are known: surface holographic gratings (SHG for short) and volume holographic gratings (VHG for short). In surface holographic gratings, the grating structure can be produced by optically deforming the surface structure of the substrate. By means of the changed surface structure, the incident light can be deflected, for example reflected. Examples of surface holographic gratings are so-called sawtooth- or blazed gratings. In contrast, in the case of volume holographic gratings, the grating structure can be machined into the entire volume of the substrate or into partial regions of the volume. Surface holographic gratings and volume holographic gratings are usually frequency selective. However, gratings are also known which can diffract polychromatic light. These are called multiplexed volume holografic gratings (MVHG for short) and can be produced, for example, by varying the periodicity of the grating structure of the grating or by arranging a plurality of volume holographic gratings one after another.

[0024] Polymers, in particular photopolymers, or films, in particular photosensitive films, for example made of plastic or organic materials, are particularly suitable as materials for the substrate for processing the grating into the substrate. A substrate with a deflection structure for diffracting light, for example in the form of a grating, can also be referred to as a holographic optical element (HOE).

[0025] The described design of the coupling-in region and the coupling-out region therefore makes it possible to diffract light incident on the coupling-in region towards an image acquisition device, which is arranged, for example, laterally on a transparent carrier medium, so that the object recognition system can be designed in such a way that the image acquisition device is at least partially covered in a preferred mounting position of the detection device on the instrument and is therefore arranged inconspicuously.

[0026] In a preferred design of the present invention, it is provided that the planar carrier medium between the coupling-in region and the coupling-out region is designed as a transparent plate, film or paint. That is, the planar carrier medium can be designed to have a small thickness, so that the width and length of the planar carrier medium are larger than the small thickness of the carrier medium, which is perpendicular to the flat surface of the planar carrier medium. For example, the thickness of the planar carrier medium can be between half a millimeter and five millimeters. If the planar carrier medium is designed as a transparent film, it is also designed to be flexible, that is, it can be deformed without loss, wherein the deformation without loss is understood as the film being bent without loss with a bending radius of less than two centimeters. If the planar carrier medium is designed as a transparent paint, it can have a thickness in the micrometer range, and therefore less than one millimeter. It is achieved that the planar carrier medium with the coupling-in region and the coupling-out region can be arranged inconspicuously at multiple locations, such as inside a motor vehicle or on a wall, while, for example, not covering the object arranged behind it there, so that, for example, it can be arranged on the window glass of a motor vehicle. The distance measuring device can thus be integrated into any surrounding environment.

[0027] In a particularly advantageous embodiment of the invention, it is provided that the evaluation device is designed to determine, in particular by means of photogrammetry, the spatial position of the detected object relative to the reference point of the object recognition system and / or the three-dimensional shape of the detected object as provided object data. For example, if the corresponding detection device with, for example, a corresponding image acquisition device is arranged at different positions in the vehicle interior, the driver of the motor vehicle can be detected from different perspectives, for example. With the help of image data provided by, for example, a plurality of image acquisition devices, the evaluation device can finally determine the position of the driver relative to the reference point of the object recognition system, for example relative to the surface of the carrier medium of one of the detection devices. For example, the coordinates of the detected object can be determined. Alternatively or in addition, a three-dimensional reconstruction of the surface of the object, i.e. its shape, can also be determined. The evaluation by the evaluation device is carried out by photogrammetry, i.e. by means of a measuring method and an associated remote sensing evaluation method, which aims to determine the spatial position or the three-dimensional shape of the object from a picture of the object, i.e. the image data. For this purpose, the object surrounded by natural light is usually photographed from a plurality of station positions, i.e. the detection device with the corresponding image acquisition device is positioned at different positions of the surroundings of the object, the image acquisition device respectively creating images of the object from its different perspective angles.

[0028] The evaluation device is designed to provide details about the arrangement of the detected object in the surroundings from the image data from the images of different perspective angles after the corresponding object data have been determined. This also enables the movement of objects in the interior to be tracked, since the spatial position of the detected object as well as its orientation, i.e. its shape, can be determined at different points in time and compared with corresponding data from other points in time. For example, gestures of the driver can be detected, recognized and interpreted reliably and quickly in this way.

[0029] In another embodiment, it is provided that the object recognition system comprises a light source which is designed to emit a light signal into the surroundings. The light signal can be emitted in particular as infrared light, i.e. as an infrared light signal, and / or as a predetermined light pattern. The evaluation device is designed to perform an improvement of the image data and / or the object recognition based on the light signal detected and / or reflected in the surroundings, wherein the light signal emitted by the light source is coupled into the planar carrier medium via a light signal coupling-in region provided on the planar carrier medium, guided through the planar carrier medium by means of internal reflection and emitted into the surroundings at a light signal coupling-out region arranged on the planar carrier medium. For this purpose, the light signal coupling-in region is designed as a holographic element having a third deflection structure, which is designed to couple the light signal incident on the third deflection structure into the planar carrier medium. The light signal coupling-out region is correspondingly also designed as a holographic element having a fourth deflection structure, which is designed to couple the transmitted light signal incident on the fourth deflection structure out of the planar carrier medium into the surroundings.

[0030] Here, the light source emits, for example, infrared light through the HOE. In addition, the infrared light can also be emitted in the form of a predetermined light pattern, i.e. as so-called structured light. As an alternative to infrared light, light of another wavelength range, for example visible light, can also be emitted as a predetermined light pattern. Such a light pattern is usually used for an autofocus function, that is to say for focusing an image of an object, wherein the image is provided in the form of image data. This is a common autofocus method, for example by digital camera devices. The light signal coupling-in area can correspond to the coupling-out area and the light signal coupling-out area can correspond to the coupling-in area. However, this is only the case if the light source is correspondingly arranged, for example, below or to the side of the carrier medium, more precisely in the vicinity of the image acquisition device. As an alternative, the light source can be surrounded by an instrument on which the detection device is arranged.

[0031] On the one hand, the image data can be improved with the aid of the light signal. This is because, for example, the described autofocus function can be provided for the image acquisition device by means of such a light signal. However, objects can also be detected better with the aid of the light signal, because, for example, if the light signal is selected accordingly, more light in the visible wavelength range can be used to illuminate the surroundings, which is particularly useful in dark surroundings and helps to improve the image quality. In addition, a reduction in image quality in the case of strong scattered light can be prevented, because the evaluation device can perform corresponding correction calculations by detecting a given reflected light signal. The described light signal can therefore ultimately contribute to improved object recognition, because the object data is based on the image data. When performing object recognition, the evaluation device can also take into account, for example, how the object reflects the light signal on its surface, so that, for example, information about the material properties of the object can be determined, whereby the object recognition can be improved.

[0032] In a particularly advantageous design of the present invention, it is provided that the coupling-in region and the coupling-out region are formed integrally with the carrier medium, or the carrier medium is designed as an element separated from the coupling-in region and the coupling-in region. In the first case, the coupling-in region and the coupling-out region can therefore be processed directly on the surface of the carrier medium, for example. This means that, for example, the deflection structure can be etched or laser engraved into the surface of the carrier medium. Therefore, the carrier medium itself can be designed as an HOE. In the second case, the coupling-in region, the coupling-out region and the carrier medium can be formed separately. In this case, the coupling-in region and the coupling-out region can, for example, form at least one first element, and the carrier medium can form a second element abutting against the first element. Therefore, the coupling-in region and the coupling-out region can be formed in at least one HOE. For example, the coupling-in region and the coupling-out region can be formed in different sections of a holographic film or plate. In order to fix the film or plate to the carrier medium, the film of the plate can be bonded to the carrier medium. Alternatively, the holographic film can also be designed as an adhesive film and directly attached to the surface of the carrier medium by molecular forces (that is, without adhesive). The detection device having the carrier medium and the coupling-in region and the coupling-out region arranged thereon can thus be produced in many ways and in particular in a cost-effective manner.

[0033] According to the present invention, a motor vehicle having a vehicle interior and an object recognition system as described above is also provided. At least one detection device of the object recognition system is arranged in the vehicle interior and is oriented toward the illuminated volume of the vehicle interior and / or toward the surroundings of the motor vehicle. The at least one detection device is therefore arranged, for example, in the vehicle interior so that light from the vehicle interior is incident on the first deflection structure of the coupling-in region and is coupled into the carrier medium. The preferred design scheme and its advantages proposed in conjunction with the object recognition system according to the present invention are accordingly applicable and, if applicable, can also be applied to the motor vehicle according to the present invention. For this reason, the corresponding design scheme of the motor vehicle according to the present invention will not be repeated here. Finally, the detection device is preferably arranged in the vehicle interior in such a way that it is, for example, arranged on an instrument in the vehicle interior, wherein the coupling-in region is arranged on a side that is opposite to a side on the surface of the instrument in the vehicle interior to which the detection device is fixed.

[0034] According to an advantageous embodiment of the motor vehicle according to the invention, the carrier medium of at least one detection device with the coupling-in region and the coupling-out region is arranged in one of the following locations: in the screen of a display device in the vehicle interior, in a rearview mirror, in a center console, in a dashboard (so-called instrument panel), in an instrument cluster, in a windshield, in a side window, in a sunroof and / or between the A-pillars of the motor vehicle. In this case, the detection device can be integrated into a corresponding component of the motor vehicle or fastened to or to a corresponding component of the motor vehicle. In particular, when the carrier medium is designed as a flat, transparent plate, film or paint, various positioning options in the motor vehicle are possible, for example on the windshield or on the side window. Due to the different positions described, different perspectives of objects in the surroundings in the vehicle interior are ultimately provided, from which image data of the objects are determined and then used to determine the object data. This also has the advantage that the light can have a direct beam path to the coupling-in region, which can reduce shadows or distortions. As an alternative or in addition to the positions described, the carrier medium can be arranged on a trim of the motor vehicle, for example on a strip or cover which is painted from behind or on a protective glass.

[0035] According to a particularly advantageous embodiment of the motor vehicle of the invention, the object recognition system comprises at least two detection devices, which are arranged at different positions in the interior of the motor vehicle. Thus, at least two detection devices are provided, which can be positioned at two of the above-mentioned positions, whereby the already described viewing angles can be achieved, so that objects in the vehicle interior can ultimately be recognized and object information in the form of object data describing the recognized object can be provided, for example, to further evaluation devices, such as driver assistance systems or gesture control devices.

[0036] The motor vehicle according to the invention is preferably designed as an automobile, in particular a car or a truck, or as a bus or a motorcycle.

[0037] The present invention also includes combinations of the features of the configurations described. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] The following describes an embodiment of the present invention. It is shown here:

[0039] Figure 1 A schematic diagram showing a detection device of an object recognition system; and

[0040] Figure 2 A schematic diagram of the vehicle interior of a motor vehicle with an object recognition system is shown.

[0041] The exemplary embodiments explained below are preferred embodiments of the present invention. In the embodiments, the described components of the embodiments are respectively single, can be regarded as independent features of the present invention, and these features are also further improved independently of each other. Therefore, the disclosure should also include the feature combination except the feature combination of the illustrated embodiment. In addition, the described embodiments can also be supplemented by other features of the present invention that have been described.

[0042] In the figures, the same reference numerals respectively denote elements with the same function. DETAILED DESCRIPTION

[0043] exist Figure 1 A system for object recognition 30 (in Figure 2 The detection device 10 (indicated by reference numeral 30 in the figure) is shown. The detection device 10 includes a carrier medium 12 and an image acquisition device 11. The carrier medium 12 is designed as a planar carrier medium 12, specifically a transparent plate, a film or a paint. The planar carrier medium 12 is designed to be arranged on an instrument, for example in a vehicle interior space 42 (in the vehicle interior space 42). Figure 2 In addition, the carrier medium 2 is designed as a light guide, on which the coupling-in region 16 and the coupling-out region 18 are arranged.

[0044] The coupling-in region 16 is designed as a holographic element 14 with a first deflection structure 20, which is designed to couple light 100 incident on the first deflection structure 20 from the surroundings into the carrier medium 12. The carrier medium 12 is designed to transmit the coupled-in light 100 from the coupling-in region 16 to the decoupling region 18 by internal reflection. The decoupling region 18 is also designed as a holographic element 14 and has a second deflection structure 22, which is designed to couple the transmitted light 100 incident on the second deflection structure 22 out of the planar carrier medium 12. The image acquisition device 11 is designed to detect the decoupled light 100 and provide it in the form of image data related to the detected light 100.

[0045] The coupling-in region 16 and the coupling-out region 18 have at least one grating as respective deflection structures 20, 22, which grating is in particular designed as a volume holographic grating or a surface holographic grating. The coupling-in region 16 and the coupling-out region 18 are also formed integrally with the carrier medium 12. Alternatively, the carrier medium 12 can be designed as an element separate from the coupling-in region 16 and the coupling-out region 18.

[0046] The vehicle interior 42 of the motor vehicle 40 is Figure 2. An object recognition system 30 is located in the interior of the vehicle, in this example the object recognition system comprises three detection devices 10. These detection devices 10 are arranged in a central console 44, a rearview mirror 46 and an instrument panel 48 of a motor vehicle 40. In addition to the corresponding detection devices 10 and the corresponding at least one image acquisition device 11, the object recognition system 30 also comprises a central evaluation device 32. To this end, the evaluation device 32 is designed to detect objects 36 in the surroundings taking into account image data provided by the corresponding image acquisition device 11, to identify the detected object 36 taking into account object recognition criteria, and to provide object data describing the identified object 36. For example, the spatial position of the detected object 36 relative to a reference point of the object recognition system 30 and / or the three-dimensional shape of the detected object 36 can be determined as the provided object data. This can be done in particular by photogrammetry. For example, the driver of the motor vehicle 40 can be detected as an object 36 by the object recognition system 30. Therefore, the object 36 in Figure 2 Depicted as the driver.

[0047] The corresponding image acquisition device 11 can be arranged, for example, on a lateral area of ​​the corresponding detection device 10. However, as depicted in the example of the detection device 10 in the rearview mirror 46, it can be arranged in the side frame of the device on which the flat support medium 12 is arranged, so that it is not visible to the driver.

[0048] The object recognition system 30 further comprises a light source 34, which is designed to emit a light signal into the surroundings, i.e. into the vehicle interior 42. The light signal can be emitted, for example, as infrared light, i.e. as an infrared light signal, and / or as a predetermined light pattern. The evaluation device 32 is designed here to improve the image data and / or object recognition based on the detected light signal reflected in the surroundings. The light source 34 is preferably arranged relative to the detection device 10 in such a way that the light signal emitted by the light source 34 is coupled into the carrier medium 12 via a light signal coupling-in region, passes through the carrier medium 12 by means of internal reflection and is emitted into the surroundings in a light signal coupling-out region. In this case, the light signal coupling-in region is, for example, equal to the coupling-out region 18, and the light signal coupling-out region is equal to the coupling-in region 16. The light signal coupling-out region is Figure 1 The number 35 is marked with a cross.

[0049] At least one detection device 10 may be alternatively arranged in the vehicle interior 42 : in a screen of a display device in the vehicle interior 42 , in an instrument cluster, in a windshield, in a side window, or between two A-pillars of the motor vehicle 40 .

[0050] The object recognition system 30 preferably comprises at least two detection devices 10 , that is to say, for example, as in the described example, three detection devices 10 , which are each arranged at a different position in the vehicle interior 42 .

[0051] In summary, these examples show how the invention can provide for the identification of an object 36 in a vehicle interior 42. For this purpose, a holographic optical element (HOE) is used to identify an object 36 in the vehicle interior 42. An object recognition system 30 designed for this purpose can be arranged inconspicuously in a trim strip, that is, for example, in a center console 44, an instrument panel 48 or an instrument cluster, or on a screen of a display device in the vehicle interior 42, in a windshield, in a side window and / or on a rearview mirror 46. The object recognition system 30 is used to identify the object 36. In addition to the installability, it is also advantageous that the beam paths, that is, the beam paths of the light 100, can remain parallel and thus prevent shading or distortion. In addition, the light signal can be guided from the light source 34 into the carrier medium 12 and coupled out of the carrier medium in the direction of the surroundings in order to utilize the improvement in the recording quality that can be achieved in the determination of image data and / or in the object recognition. Another advantage comes from the use of various types of illumination in order to be able to determine which material an object is made of and / or which temperature or surface properties it has. For example, a light signal consisting of infrared light is suitable for this.

[0052] All of this is achieved by positioning holographic optical elements in the center console, the dashboard, the screen of the display device, the instrument cluster and / or the rearview mirror 46, so that objects 36 carried by the driver and the driver himself as object 36 can ultimately be detected and evaluated. Multiple views from different perspectives are advantageous here, because they can be used for reconstruction, for example, by photogrammetry. Therefore, various systems can also be combined with each other, so that objects 36 in the vehicle interior 42 can be detected simultaneously, or, for example, the movement of objects 36 in the vehicle interior 42 can be tracked. In order to improve the detection, additional light sources 34 or detection methods can be used, which are performed, for example, by light patterns or infrared light. This makes it possible to collect high-quality image data and object data when the vehicle interior 42 is dark or strong scattered light is observed in the vehicle interior 42.

Claims

1. A motor vehicle (40) having a vehicle interior (42) and an object recognition system (30), the object recognition system having an evaluation device (32) and at least two detection devices (10), each of the at least two detection devices having at least one image acquisition device (11) and a planar carrier medium (12) for arrangement on the device, wherein the carrier medium (12) is designed as an optical waveguide, on which an incoupling region (16) and an outcoupling region (18) are provided, wherein the coupling-in region (16) is designed as a holographic element (14) having a first deflection structure (20), the first deflection structure being designed to couple light (100) incident on the first deflection structure (20) from the surroundings into the planar carrier medium (12); The planar carrier medium (12) is designed to transmit the coupled light (100) from the coupling-in region (16) to the coupling-out region (18) by means of internal reflection; the decoupling region (18) is designed as a holographic element (14) having a second deflection structure (22) which is designed to decouple the transmitted light (100) incident on the second deflection structure (22) from the planar carrier medium (12); at least one image acquisition device (11) is designed to detect the outcoupled light (100) and to provide it in the form of image data related to the detected light (100); and the evaluation device (32) is designed to detect objects (36) in the surroundings taking into account the image data, to identify the detected objects (36) taking into account object recognition criteria and to provide object data describing the identified objects (36), At least two detection devices (10) of an object recognition system (30) are arranged in a vehicle interior (42) and are oriented toward a volume of the vehicle interior (42) illuminated by light (100) and / or toward the surroundings of the motor vehicle, the at least two detection devices (10) being arranged at different positions in the vehicle interior (42) so that an object (36) is photographed from multiple stations and from different perspective angles. An evaluation device is designed to provide details about the arrangement of the detected object in the surroundings from image data of images from different perspective angles after determining the corresponding object data.

2. The motor vehicle (40) according to claim 1, in, The coupling-in region (16) and the coupling-out region (18) have at least one grating as a respective deflection structure (20, 22), the at least one grating being a volume holographic grating or a surface holographic grating.

3. The motor vehicle (40) according to claim 1 or 2, in, The planar carrier medium (12) having the coupling-in region (16) and the coupling-out region (18) is designed as a transparent plate, film or lacquer.

4. The motor vehicle (40) according to claim 1 or 2, in, The evaluation device (32) is designed to determine the spatial position of the detected object (36) relative to a reference point of the object recognition system (30) and / or the three-dimensional shape of the detected object (36) as provided object data.

5. The motor vehicle (40) according to claim 1 or 2, in, The object recognition system (30) comprises a light source (34) which is designed to emit a light signal into the surroundings, the light signal being infrared light and / or a predetermined light pattern, and an evaluation device (32) which is designed to perform an improvement of the image data and / or the object recognition based on the detected light signal reflected in the surroundings, wherein the light signal emitted by the light source is coupled into a carrier medium (12) via a light signal coupling-in region, guided through the carrier medium (12) by means of internal reflection and emitted into the surroundings at a light signal coupling-out region.

6. The motor vehicle (40) according to claim 1 or 2, in, The coupling-in region (16) and the coupling-out region (18) are formed integrally with the carrier medium (12), or the carrier medium (12) is designed as a separate element from the coupling-in region (16) and the coupling-out region (18).

7. A motor vehicle (40) according to claim 1 or 2, in, The carrier medium (12) of the at least one detection device (10) having an incoupling region (16) and an outcoupling region (18) is arranged in each case in one of the following positions: - in a screen of a display device in the vehicle interior (42); - in the rearview mirror (46); - in the center console (44); - in the instrument panel (48); - in the instrument cluster; - in the windshield; - in the side windows; - in the skylight; - between two A-pillars of a motor vehicle (40).