Haptic hologram

EP4466580A1Pending Publication Date: 2024-11-27CARL ZEISS JENA GMBH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
EP2023701667
Authority / Receiving Office
EP · EP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-01-20
Filing Date
2023-01-20
Publication Date
2024-11-27

AI Technical Summary

Technical Problem

Current systems for providing haptic feedback with holographic images are complex, costly, and limit simultaneous haptic sensation and holographic representation, especially in vehicle systems, due to the integration of components and shadowing effects during interaction gestures.

Method used

A system comprising a light source, a base body with a substrate and holographic-optical elements, and sound transducers that emit sound waves through sound channels in the substrate, allowing for compact and efficient generation of holographic images and haptic perception, with sound waves propagating undistorted to create pressure fluctuations in the interaction area.

Benefits of technology

Enables a compact, cost-effective, and efficient haptic perception system that allows for a variety of interaction options without shadowing effects, providing precise pressure maxima and minima, enhancing user interaction safety and efficiency, particularly in human-machine interaction contexts.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 1.1
    Figure 1.1
Patent Text Reader

Abstract

The invention relates to a system for generating a haptic perception and a holographic display. The system comprises a light source for emitting light and a main body comprising a substrate and at least one holographic-optical element. The light source and the main body comprising the holographic-optical element are designed to generate a holographic display in an interaction region. Simultaneously, the system comprises one or more sound transducers for emitting sound waves in the direction of the interaction region, such that pressure fluctuations within the interaction region can be haptically perceived. The system is characterised in that the substrate is located between the one or more sound transducers and the interaction region and has sound channels in the form of openings through which the sound can propagate. The invention also relates to the use of the system according to the invention to generate a holographic display and a haptic perception.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] HAPTIC HOLOGRAM

[0002] DESCRIPTION

[0003] In a first aspect, the invention relates to a system for generating haptic perception and a holographic image. The system comprises a light source for emitting light and a base body comprising a substrate and at least one holographic optical element. The light source and the base body comprising the holographic optical element are designed to generate a holographic image in an interaction area. At the same time, the system comprises one or more sound transducers for emitting sound waves toward the interaction area, so that pressure fluctuations within the interaction area can be perceived haptically.

[0004] The system is characterized in that the substrate is located between the one or more sound transducers and the interaction area and has sound channels which are designed as openings through which the sound can propagate.

[0005] In a further aspect, the invention relates to the use of the system according to the invention for generating a holographic image and a haptic perception.

[0006] Background and state of the art

[0007] Holography is a branch of optics that deals with the production and construction of three-dimensional, real images and can be seen as an extension of photography. While a photographic image is merely a two-dimensional representation of an object, holography results in three-dimensional images. Here, a different type of recording of the object is used. In photography, for example, a film shows the intensity of the light reaching it at every point. In holography, on the other hand, additional optical information about an object is taken into account based on the wavefronts emanating from the object, in particular the amplitude and phase. Further information that can be captured in a holographic image concerns the color spectrum and polarization, which increases the variety of creative possibilities.The recorded image is usually referred to as a hologram, while an image created on the basis of the hologram with appropriate reconstruction is referred to as a holographic image.

[0008] A technological extension of holography envisages the creation and display of holographic images freely in space. This usually involves using holographically generated microstructures to deflect light of a specific wavelength spectrum or angle of incidence. For a viewer, real objects or animations can appear freely in space. These are referred to as real images, which are visible in a holographic eyebox. Compared to a two-dimensional image on a display, such a representation is advantageously visible from different sides – the viewer can therefore view the holographic image from different perspectives, creating a true-to-life image. It would be advantageous if such holographic images could also be touched, i.e. "felt," in space.Particularly in the context of human-machine interfaces (HMI), this would have the advantage of enabling tactile feedback alongside visual perception. For example, holographic control elements (keys, buttons, etc.) could be conceivable, which could not only be visually displayed but also be simultaneously perceived by the user.

[0009] It is known in the art to use ultrasonic emitters to provide haptic feedback. These emitters can provide tangible feedback to the user using ultrasound. For example, the ultrasonic signals can be amplitude-modulated at a low frequency and applied to the user's skin. The ultrasonic signals act as pressure fluctuations on the skin and are haptically perceptible.

[0010] For example, US Pat. No. 9,612,658 B2 discloses a device for generating a sound field for tactile sensations. For this purpose, a user's hand can be placed over a screen, which is intended to sense a tactile signal. An array of ultrasonic transducers is positioned beneath the screen, which is intended to generate the sound field above the screen. A hand tracker can be used to track the hand's movement to enable a corresponding pressure sensation in different areas.

[0011] WO 2014 / 181084 A1 also discloses a device for generating a sound field using an array of ultrasonic transducers. A method is proposed for generating points in a sound field that have a fixed spatial relationship to each other or to the array.

[0012] DE 102017116012 A1 discloses a display device that, in addition to outputting an optical image by generating a sound field, can also provide tactile feedback. The display device has an optical display with a plurality of pixels that generate an optical image on the front side of the display device.

[0013] To generate a tactile sound field in a space in front of the display, a plurality of sound transducers are provided, which are preferably arranged on a rear side of the display. In preferred embodiments, control signals for the sound transducers are pre-distorted based on the acoustic properties of the display in order to compensate or mitigate the acoustic distortion caused by the display. In an alternative embodiment, a display is provided whose pixels have an acoustically transparent region alongside three subpixels for the RGB colors. The sound transducers are preferably aligned with the acoustically transparent regions such that each sound transducer at least partially covers an acoustically transparent region.In this embodiment, the size and arrangement of the acoustically transparent areas are therefore determined by the pixel array of the display, which, however, has a detrimental effect on the flexible generation of a sound field in the space in front of the display.

[0014] To date, there have only been isolated approaches in the prior art for combining holographic images with haptic feedback, particularly in connection with the provision of control elements in vehicles. For example, DE 10 2016 214 478 A1 discloses a holographic display mounted on a vehicle steering wheel. Haptic feedback when the holographic display is operated can be provided by means of an ultrasonic pulse. If the ultrasonic pulse is focused on the position operated by the user within the holographic display, this can provide haptic feedback to the user, which can simulate the presence of a real button. The ultrasonic array for generating the ultrasonic pulse can be arranged, for example, in the steering column and / or in the area of ​​the dashboard.

[0015] DE 2016210213 A1 describes a method for the interaction between a passenger and control elements of a vehicle. For this purpose, haptically perceptible ultrasonic pulses are generated using a plurality of ultrasonic transducers, which can be arranged in an array. The modulated individual signals are superimposed on the surface of a virtual object. The virtual object can, for example, represent a control device. In this way, in highly automated ferry operations, operating gestures are to be freely executed in space for the user and combined with haptic perception.

[0016] DE 102017211378 A1 discloses a user interface for a vehicle comprising a display device having a holographic device. The holographic device generates a representation freely in space, referred to as a hologram. The user interface can have an ultrasonic speaker arrangement to generate haptically perceptible ultrasonic pulses on the user's skin. This allows a user to perceive a tangible stimulation from the ultrasound, resulting in haptic feedback upon touching the hologram. The user should experience less distraction because they receive immediate feedback through interaction with the hologram.

[0017] However, the known devices and methods of the current state of the art for the haptic perception of a holographic image are associated with some disadvantages.

[0018] In particular, the integration of the necessary components to provide a tactile sensation such as a holographic image into the respective vehicle systems is complex, which has a negative impact on both the manufacturing effort and the control system.

[0019] Furthermore, the known systems have limitations in their usability, which result from the fact that certain interaction gestures prevent simultaneous haptic sensation and holographic representation.

[0020] Object of the invention

[0021] The object of the invention is to provide a system for the haptic perception of a holographic image which eliminates the disadvantages of the prior art.

[0022] In particular, it is an object of the invention to provide a system for the haptic perception of holographic images, which is characterized by a compact design, efficient generation of holographic images and haptic perception with diverse interaction options using preferably simple and cost-effective means. Summary of the invention

[0023] The object is achieved by the features of the independent claims. Preferred embodiments of the invention are described in the dependent claims.

[0024] In a first aspect, the invention relates to a system for generating haptic perception and a holographic image in an interaction area, comprising a. a light source for emitting light b. a base body comprising a substrate and at least one holographic-optical element, wherein the light source and the base body are designed to generate a holographic image in the interaction area and c. one or more sound transducers for emitting sound waves in the direction of the interaction area, so that pressure fluctuations within the interaction area can be felt haptically, characterized in that the substrate is located between the one or more sound transducers and the interaction area and the substrate has one or more sound channels, wherein the sound waves propagate at least partially through the one or more sound channels in the direction of the holographic image.

[0025] The arrangement of the components, particularly the placement of the substrate between the sound transducers and the interaction area, enables a particularly compact system design. For example, the sound transducers can be arranged directly behind the base body comprising the holographic optical element. Separate integration of the components into different areas of an application system, such as in a vehicle, is not necessary.

[0026] By positioning the components for generating the holographic image and haptic perception on an optical and acoustic axis, adverse shadowing effects can be avoided, which, for example, could impair the generation of the holographic image or haptic perception during the execution of an operating gesture in the interaction area. Instead, both the light propagation for generating a holographic image and the sound propagation for generating a haptic perception in the interaction area originate from the substrate or base body.

[0027] Access to the interaction area is advantageously possible from any direction in front of the base body or substrate without any impairment of the quality of the holographic image or haptic perception.

[0028] The placement of the sound transducers behind the base body or substrate, from the perspective of the interaction area, does not diminish the haptic experience. Rather, the sound channels according to the invention ensure that the sound waves emitted by one or more sound transducers propagate toward the holographic image largely without distortion or attenuation, thus enabling optimal haptic capture. In particular, the sound waves are used particularly efficiently, as the sound channels prevent any obstruction to the propagation of the sound waves.

[0029] With regard to the substrate, the provision of the sound waves also allows for a high degree of design freedom. In particular, materials such as optical glass or plastic can be used, which are optimized for light transmission to generate holographic images but can prevent sound propagation. Furthermore, the substrate can be constructed as robustly as desired without causing significant pressure and / or intensity losses of the sound waves and thus a reduction in haptic perception. Instead, it may be preferable to incorporate appropriate sound channels into substrates with optimized geometry and / or dimensions according to optical requirements, without having to accept any loss of quality in terms of a simultaneous haptic experience.

[0030] Furthermore, it is advantageous that the system according to the invention allows pressure maxima and pressure minima to be generated in the interaction zone in a particularly targeted and precise manner. Thus, preferably by appropriately positioning the sound channels, a desired pressure can be ensured in specific areas of the interaction zone through interference. The arrangement of the sound channels themselves can thus be used to create the desired constructive and destructive interference to generate pressure fluctuations for the haptic perception of a holographic image.

[0031] The system according to the invention has proven particularly advantageous in the field of human-machine interaction (HMI). Sound waves, which propagate preferentially in the direction of the holographic image, transmit information in the form of haptic feedback particularly effectively. The combination with a holographic image allows a multitude of information to be provided. Haptic feedback can advantageously make operation safer and more efficient. For example, operation can be carried out at least partially without eye contact, since the user receives feedback about the operation and / or the control element through the sense of touch. This particularly increases safety, for example when using a means of transport such as a car.

[0032] Advantageously, the system according to the invention is also particularly simple, compact and cost-effective to provide.

[0033] For the purposes of the invention, a holographic image preferably refers to an optical image which is generated with the aid of a holographic-optical element. This can be any content, for example information, animations or a projection of an object or control element. In preferred embodiments, the holographic image can be a three-dimensional projection of an object which is located freely in space, in particular in the interaction area. The holographic image can represent an object statically or dynamically. For the embodiment, it is preferred that the object appears to the observer to be free in space, i.e. preferably at a distance in front of the base body. This can preferably be a real image which is visible in a so-called holographic eyebox.Compared to a two-dimensional image generated on a display, such a representation is advantageously visible from different sides. The viewer can therefore preferably view the holographic image from different perspectives, creating a true-to-life image. In preferred forms, the holographic image can appear at a distance of more than 1 mm, 2 mm, 5 mm, 10 mm, 2 cm, 5 cm, or more from the base body comprising the substrate and the at least one holographic optical element.

[0034] In further embodiments, the holographic image can be generated on a projection surface, wherein the projection surface can be a transparent, semi-transparent, or non-transparent surface. The holographic image can represent, for example, a control panel, a joystick, a keyboard, and / or a trackball, without being limited to these examples.

[0035] In general, haptic perception preferably refers to the active detection of the size, contour, texture, temperature, and / or mass of an object using the surface sensitivity of the skin, whereas tactile perception refers to the passive perception of mechanical stimuli. The surface sensitivity of the skin preferably refers to the sensitivity of the skin to external stimuli mediated by receptors. It particularly includes the sensation of touch, which is provided, among other things, by mechanoreceptors. In preferred embodiments, haptic perception can comprise feeling a real holographic image, for example, its contours. However, it can also be preferred that local pressure fluctuations for haptic / tactile perception are generated only in spatial proximity to the perceivable holographic image.For example, it may be preferable to project a holographic image onto a screen and to generate haptic perceptions above the screen that correspond to the optical content projected onto the screen (e.g., control panels).

[0036] The terms “haptic perception”, “tactile perception”, “haptic feedback”, “haptic sensation”, “haptic signal” and / or “haptics” can be used synonymously in the context of the invention and refer in particular to the perceptions that can be conveyed by (ultrasonic) pressure fluctuations in the air.

[0037] The interaction area preferably refers to a spatial area in which a holographic image is visually perceived by a user and simultaneously enables haptic / tactile perception. The interaction area can preferably be expanded or reduced by respective arrangements of system components and / or settings. For example, it is known that the intensity of sound decreases with the square of the distance. For example, increasing the intensity of the sound transducers can enlarge the interaction area. Certain arrangements of the sound channels can also expand the interaction area. Accordingly, the interaction area can be reduced by reversing the arrangement. The interaction area can also be enlarged or reduced by positioning the light source and / or the holographic-optical elements.In further preferred embodiments, the interaction area can comprise an eyebox. The eyebox preferably refers to a plane or spatial region in which the holographic image is perceivable by a viewer or user as a virtual image. The virtual image plane, i.e., the plane on which the virtual image is generated, can be arranged on or behind a projection surface.

[0038] A light source encompasses all types of illuminants used to convert electrical energy into light. The light source is preferably configured to emit light toward the base body. The base body and the light source are particularly designed to generate the holographic image. The holographic image is preferably provided by at least one holographic optical element.

[0039] This allows the light from the light source to enter a light entry area. The light entry area preferably refers to an area on the substrate where the light enters the substrate. To generate the holographic image, the light exits again through a light exit area. Analogous to the light entry area, the light exit area refers to an area of ​​the substrate from which the light exits to generate a holographic image.

[0040] For the purposes of the invention, a holographic optical element (abbreviated to HOE) preferably refers to a component that was provided by holographic methods and fulfills an optical function. In preferred embodiments, the at least one holographic optical element is a hologram that realizes a specific optical function. The at least one holographic optical element thus influences the beam path of the light incident on the base body. An optical function can be, for example, transmission, reflection, diffraction, scattering, and / or deflection of light. Holographic optical elements are advantageously cost-effective to produce. In addition, holographic optical elements are robust, have a low susceptibility to interference, and are long-term stable.Furthermore, the at least one holographic-optical element is characterized by the fact that it can be designed to be particularly flat and thus takes up very little space.

[0041] The at least one holographic-optical element is preferably designed to fulfill an optical function for a plurality of wavelengths. For this purpose, for example, several holograms, each diffracting light of one wavelength, and / or multiplex holograms diffracting light of multiple wavelengths, can be arranged as hologram stacks.

[0042] The holographic image is preferably generated in front of the base body. The term “in front of” preferably means an area comprising the interaction area. The sound transducers are preferably located behind the substrate. The term “behind” preferably means positioning in an area in which the sound transducers are located. These areas can also be described by the terms “front area” and “rear area” in the context of the invention. In particular, the interaction area is located in front of the substrate. The front and rear areas are preferably separated from one another by the base body. In preferred embodiments, the light source can be located in front of the substrate, so that the light from the front area reaches or into the base body.If the light source is located in front of the substrate, it may be preferred for the at least one holographic-optical element to comprise a reflection hologram that reflects light rays incident from the front into a front region to generate a holographic image. It may also be preferred for the at least one holographic-optical element to comprise a transmission hologram, wherein light rays from a spatial direction initially transmit undiffracted through the transmission hologram from the front. The light rays can preferably be reflected in the substrate or at another reflection hologram and then strike the transmission hologram from behind. Various combinations of reflection and / or transmission holograms are conceivable and can be used in the structure according to the invention.

[0043] In preferred embodiments, the light source can be located behind the substrate, so that the light from the rear region reaches or into the base body. If the light source is positioned behind the base substrate, it can be preferred that the at least one holographic-optical element comprises a transmission hologram which transmits light rays incident from behind into a front region to generate a holographic image. It can also be preferred that the at least one holographic-optical element comprises a reflection hologram, wherein light rays from a spatial direction from behind are preferably initially transmitted undiffracted through the reflection hologram. The light can be reflected back in the substrate or by another reflection hologram and then guided from a direction from the front onto the reflection hologram.Various combinations of reflection and / or transmission holograms are conceivable and can be used in the structure according to the invention.

[0044] Furthermore, it may be preferred that the light source be arranged such that light rays are emitted onto an edge of the base substrate, which corresponds to an edgelit configuration. Even in the case of an edgelit configuration, it may be preferred that transmission holograms, reflection holograms, or a combination of transmission and reflection holograms be used.

[0045] Furthermore, the at least one holographic-optical element can be connected to a surface of the substrate. The connection can be made possible, for example, by adhesive bonding and / or lamination. Furthermore, it is preferred for the at least one holographic-optical element to be connected to the substrate as a film. The film can also be connected to the substrate, for example, only in the region of a light entry area and / or light exit area. In alternative embodiments, a substantially full-surface connection can be present between the at least one holographic-optical element in the form of at least one film and the substrate.

[0046] In particular, at least one holographic-optical element is configured to change the beam path of the light, for example, through diffraction, reflection, transmission, and / or refraction. In preferred embodiments, the at least one holographic-optical element comprises a hologram. Instead of changing the light in the beam path through the geometric shape of a transmitting or reflecting object, such as lenses or mirrors, the at least one holographic-optical element changes the light in the beam path, preferably through the information stored in the hologram, for example, as a change in the refractive index. The holograms used for the at least one holographic-optical element are preferably not produced as images of real objects, but rather as a superposition of various planar or spherical light waves, whose interference pattern produces a desired optical effect.

[0047] Preferably, the at least one holographic-optical element comprises one or a plurality of holograms. Each hologram is preferably recorded with at least one specified wavelength. A holographic-optical element can, for example, comprise a plurality of holograms, which can be arranged one on top of the other as a stack. For example, a holographic-optical element can have a number, preferably a plurality, of monochromatic holograms. Alternatively, a holographic-optical element can comprise at least one hologram recorded with at least two specified wavelengths. Such a hologram is preferably recorded with three different wavelengths of a specified color space, for example, as an RGB hologram or CMY hologram, or as a hologram formed from a number of individual wavelengths of another color space.In the examples mentioned, R stands for red, G for yellow, B for blue, C for cyan, M for magenta and Y for yellow.

[0048] Preferably, the at least one holographic optical element comprises a material selected from a group comprising photosensitive glasses, dichromate gelatins, photopolymers, polycarbonate, and / or triacetate. In particular, these materials can be applied to a film and / or formed or provided by the film itself.

[0049] The base body preferably comprises the substrate and the at least one holographic-optical element. The substrate can, for example, be a circular or square disk which can have a thickness in the centimeter, millimeter or submillimeter range. The at least one holographic-optical element is preferably connected to a surface of the substrate, i.e. on a front and / or back side, or embedded within the substrate. The front and back sides of the base body can be designed as flat surfaces. For example, the base body can be designed as a plane-parallel plate or disk. However, it is also possible for the front and / or the back to be curved. The base body can comprise glass and / or plastic. Furthermore, the base body can be in one piece or have a multi-layer structure. The base body can also be transparent or partially transparent.In particular, the substrate can also be transparent or semi-transparent. Preferably, the transparent or semi-transparent base body and / or substrate can be permeable to light from the light source.

[0050] For the purposes of the invention, a sound transducer preferably refers to a device that, in particular, converts an electrical signal into acoustic signals. An acoustic signal refers, in particular, to the controlled emission of sound waves. Thus, in the context of the invention, the sound transducer serves as a sound source. For the purposes of the invention, a sound channel refers, in particular, to an opening in the substrate so that sound can propagate in the direction of the holographic image in the interaction region. The sound channel or opening preferably extends completely from a rear side to a front side or preferably at least over a length of more than 50%, 60%, 70%, 80%, 90% or more of the thickness of the substrate. The opening is characterized by the absence of substrate material. The opening can be substantially air-filled.It may also be preferable to place another - preferably sound-conducting - medium into the opening to form the sound channel.

[0051] Advantageously, sound pressure, especially fluctuations in sound pressure, can be sensed in the interaction area, making the holographic image haptic. The arrangement, number, shape, and / or size of the openings can be adjusted to suit the specific application.

[0052] Advantageously, the sound propagation for generating the haptic perception and the light propagation for generating the holographic image can occur along an optical or acoustic axis.

[0053] Such an arrangement is unknown in the prior art because optical components exhibit unfavorable permeability to sound, especially ultrasound. For example, glass and / or plastic as substrate materials are essentially opaque to sound waves, making a compact arrangement of the sound transducers behind a substrate on the optical axis impossible to implement without adversely affecting haptic perception.

[0054] On the other hand, the inventors recognized that by providing sound channels in the substrate, the sound, preferably ultrasound, can be advantageously guided undistorted through the same (optical) substrate to generate a holographic image.

[0055] In a further preferred embodiment, the system is characterized in that the system is designed to generate the holographic image by a transmission hologram and / or a reflection hologram.

[0056] For this purpose, the at least one holographic-optical element preferably comprises a reflection and / or transmission hologram. The at least one holographic-optical element preferably fulfills an optical function, for example transmission and / or reflection. Advantageously, a multitude of geometric arrangements of the components light source, base body, and sound transducer can thus be enabled in order to generate the holographic image and, in particular, also the haptic perception in the interaction area. Advantageously, the interaction area can also be regulated and optimized depending on the application and built-up space. Advantageously, a user can thus be located in a plurality of positions and simultaneously perceive the holographic image optically and haptically.The designation of the hologram type comprising the at least one holographic-optical element preferably indicates the optical function that is fulfilled and the arrangement of the system components for reconstructing the holograms.

[0057] Reflection holograms are reflective holograms that reflect the incoming light from the light source and thus act like a mirror. In the case of a reflection hologram, the light source can be located in front of or behind the substrate. For example, it may be preferable for the light source to be located in front of the substrate and to emit light from this spatial direction from the front onto the reflection hologram. When using a reflection hologram, the light entry area and the light exit area can therefore be identical, i.e. the light rays hit the reflection hologram through the light entry area, are reflected by it and exit through the same area to display the holographic image. It may also be preferable for the light source to be located behind the substrate and to initially transmit undiffracted through the reflection hologram from this spatial direction.The light can preferably be reflected in the substrate or on another reflection hologram and then impinge on the reflection hologram from a direction from the front.

[0058] The reflection hologram advantageously accepts a wider angular spectrum for a defined wavelength with high efficiency and higher wavelength selectivity. This allows the colors to be separated from each other despite a broad spectrum of angles of incidence. In particular, a large field of view for holographic imaging can be realized with simultaneous high incidence efficiency.

[0059] In some embodiments, it may be preferable to arrange two reflection holograms one behind the other in the beam path, with the light source preferably located behind the substrate. The first reflection hologram transmits the light waves from the light source essentially undiffracted to a second reflection hologram located behind it. The second reflection hologram reflects or diffracts the light rays back to the first reflection hologram. The first reflection hologram reflects or diffracts to generate a holographic image in front of the substrate. Reflection holograms arranged in this way thus allow a structure analogous to a transmission hologram, but the advantages of reflection holograms described above can still be utilized.

[0060] In the case of a transmission hologram, the light from the light source is transmitted. When using a transmission hologram, it is preferable for the light source to be located in front of or behind the substrate. For example, it may be preferable for the light source to be located behind the substrate and to emit light from behind onto the transmission hologram, which diffracts the light rays. In this case, the light entry area and the light exit area are located on different sides of the substrate. It may also be preferable for the light source to be located in front of the substrate and to initially transmit light from behind through the transmission hologram without being diffracted. The light can preferably be reflected in the substrate and then strike the transmission hologram from behind and be diffracted by it, such that a holographic image is generated in a front area.Transmission holograms may be preferred to avoid color distortions. Furthermore, the holographic image created using a transmission hologram advantageously exhibits a high depth of field, i.e., a particularly expanded area that can be clearly seen by an observer.

[0061] In further preferred embodiments, the system is designed to generate the holographic image using an edgelit configuration. An edgelit configuration preferably refers to the irradiation of light onto an edge or marginal region of the substrate and an emission of the light to generate a holographic image in a front region. For this purpose, the at least one holographic-optical element can, in the case of an edgelit configuration, preferably be embedded on the substrate or within the substrate. Furthermore, even in the case of an edgelit configuration, the at least one holographic-optical element can be a reflection hologram and / or transmission hologram. When using an edgelit configuration, the substrate is preferably designed as a light guide.This allows the light to propagate through reflections, preferably total reflections, within or through the substrate by illuminating the light source and the holographic image to be displayed in the interaction area.

[0062] A particularly advantageous feature is that when using an edgelit configuration, the light source can be integrated into the base body and / or the substrate itself, ensuring a particularly compact and carefully aligned representation of the holographic image. In particular, the holographic image can appear particularly clear, providing a viewer with a particularly realistic image of an object. For this purpose, it may be preferable to use reflection holograms, which can optimize brightness and contour sharpness to a particularly high degree for a realistic representation.

[0063] An edge of the substrate preferably refers to a lateral region of the substrate that has a thickness that is significantly less than the length and / or width of the substrate. Thus, the thickness of the edge can be approximately 0.2 mm, approximately 0.5 mm, approximately 1 mm, 5 mm, 10 mm, or 50 mm. It is preferred that the ratio of the thickness of the edge to the length and / or width of the substrate be greater than 1:10, greater than 1:50, or greater than 1:100. In the context of the invention, the terms "edge" and "edge of the substrate" can be used synonymously.

[0064] In a further preferred embodiment, the system is characterized in that the substrate has a coupling-in region and a coupling-out region, which are located at different positions on the substrate and the light is propagated within the substrate between the coupling-in region and the coupling-out region by reflections, preferably total reflections.

[0065] The substrate can thus advantageously also function as a light guide, within which the light can propagate to provide the holographic image in the interaction region. The terms "coupling region" and "coupling region" are intended to describe an entry section and an exit section of the substrate if the substrate itself is designed as a light guide. The coupling region preferably refers to a region of the substrate that allows the light to penetrate the substrate, so that the light is coupled into the substrate. The coupling region can preferably comprise a holographic optical element with which the light is coupled into the substrate.

[0066] In some embodiments, the coupling region can also be transparent or partially transparent. If transparency is desired, the radiation coupling, e.g., by a diffractive structure, can be just efficient enough to ensure sufficient radiation power reaches the coupling-out region. The partially transparent coupling region can be designed such that the coupling efficiency is, e.g., 2%, 5%, 10%, 15%, 20%, 25%, 30%, 35%, 40%, 45%, or 50% or more. The coupling efficiency refers to the proportion of light that can be transmitted and thus admitted into the substrate.

[0067] The coupling of light into the substrate refers specifically to the entry and propagation of light within it. The propagation of light within the substrate preferably occurs through reflections, particularly preferably through total internal reflection. Total internal reflection ensures that the light is not emitted uncontrollably from the region, but rather is specifically directed toward the output region in order to display the holographic image in or from the output region.

[0068] The principle of total internal reflection can be illustrated by the incidence of light at an interface during the transition between two media. If a light beam passes from one medium into a second medium with a different optical density, two phenomena can occur at the interface: part of the light is refracted and enters the second medium, or part of the light is reflected and remains in the first medium. If the first medium is optically denser than the second medium, from a certain angle of incidence the refracted beam runs parallel to the interface. If the angle of incidence is increased further, no more light penetrates the second medium and the light beam is completely reflected. The latter is referred to as total internal reflection. In the context of the invention, the term "internal total internal reflection" means that the total reflections occur within the substrate, with the substrate preferably acting as a light guide.

[0069] Total internal reflections can occur on the front, back, and within the substrate. Reflective layers or coatings, or partially reflective layers or coatings, can also be used to propagate light within the substrate through reflections, preferably total internal reflections.

[0070] The propagation of the light along or within the substrate can preferably also be achieved using an edgelit configuration. Preferably, the light is admitted at an edge of the substrate and propagates within the substrate, preferably to the at least one holographic optical element, which can be, for example, a reflection hologram. Due to the effect of the HOE, the light preferably exits at the output region to preferably display the holographic image within the interaction region.

[0071] The coupling-out region preferably refers to the region of the substrate as a light guide from which the light is coupled out to form the holographic image in the interaction region. The coupling-out region can preferably comprise a holographic optical element with which the light is coupled out of the substrate.

[0072] In some embodiments, the coupling-out region can be transparent or semi-transparent, similar to the coupling-in region. In particular, the coupling-out efficiency of the coupling-out region can be, for example, 2%, 5%, 10%, 15%, 20%, 25%, 30%, 35%, 40%, 45%, or 50%. The coupling-out efficiency refers to the percentage of light that can be transmitted and thus emitted from the substrate.

[0073] In a further preferred embodiment, the system is characterized in that the coupling region is located at an edge of the substrate and / or the coupling region has a first holographic-optical element, wherein the light can be coupled into the substrate by the first holographic-optical element and can be deflected in a targeted manner within the substrate.

[0074] Advantageously, the light beam path within the substrate can be precisely adjusted by the first holographic optical element with a corresponding optical function to allow the light to propagate within the substrate. The first holographic optical element can be located on a front side, back side, edge, and / or embedded within the substrate.

[0075] The first holographic-optical element is preferably designed as a reflection or transmission hologram. It is also preferred that the first holographic-optical element be a reflection or transmission hologram if the light is coupled in via an edgelit configuration.

[0076] In further embodiments, the coupling region can have a diffractive structure formed on a front and / or back side of the substrate. The diffractive structure of the coupling region can be formed, for example, as a buried diffractive structure or as a diffractive structure on the front or back side of the substrate. It is also possible for the diffractive structure of the coupling region to comprise a transmissive or reflective relief grating.

[0077] In a further preferred embodiment, the system is characterized in that the coupling-out region has a second holographic-optical element and light exits via the coupling-out region to generate the holographic image in the interaction region.

[0078] Advantageously, the second holographic-optical element selectively couples out the light so that the holographic image can be generated at desired positions within the interaction area. In further embodiments, the second holographic-optical element can be designed as a reflection or transmission hologram. Advantageously, the light is reflected or transmitted into the interaction area in such a way that the holographic image appears within the interaction area.

[0079] In further embodiments, the coupling-out region has a diffractive structure. The diffractive structure of the coupling-out region can be formed as a buried diffractive structure or as a diffractive structure on the front or back of the substrate. In particular, a reflection or transmission hologram can be provided as the diffractive structure. Furthermore, it is possible for the diffractive structure of the coupling-out region to be a transmissive or reflective relief grating. The coupling-out region can also have a mirror surface, a prism, and / or a reflective or transmissive Fresnel structure. These variants can be provided as an alternative to the diffractive structure or in addition to the diffractive structure of the coupling-out region.

[0080] A diffractive structure preferably refers to an optical element for shaping the light beam emitted by the light source. The diffractive structure preferably comprises microstructures, applied, for example, by photolithography. In the microstructures, phase modulations occur due to different optical path lengths of the partial beams, creating interference patterns. In addition, the amplitude is modulated by constructive and destructive interference. Thus, with clever design, the intensity patterns and / or the beam path can be manipulated to generate the holographic image.

[0081] In a further preferred embodiment, the system is characterized in that the system comprises 2, 3, 5, 10, 20, 50, 100 or more sound transducers, wherein the sound transducers are preferably arranged as an array.

[0082] The sound transducers are preferably configured to emit sound waves in the direction of the holographic image. In particular, the sound transducers are located “behind the substrate,” i.e., the substrate is arranged between the interaction region and the sound transducers. Advantageously, an acoustic field can be generated within the interaction region by a plurality of sound transducers, in particular by an array. The acoustic field is characterized by a pressure and / or intensity distribution in order to be able to provide a different haptic perception on the human skin, preferably for different regions of the holographic image. In particular, a different force acts on the skin, which haptically reproduces the shape and / or structure of an object that is visualized by the holographic image.For example, a car's joystick and / or keypad can be represented as a holographic image. The area of ​​the joystick that is touched and / or the keys on the keypad may exhibit a different pressure and / or force sensation than other sections of these objects.

[0083] Preferably, a sound transducer or a plurality of sound transducers is connected to one or more phase control components. Advantageously, the phase of the sound waves emitted by the sound transducers can be controlled and / or regulated by the phase control component. It is particularly advantageous that the phase can be adjusted such that the pressure in specific areas of the holographic image and / or the interaction area is maximized and / or minimized, thus creating a particularly realistic haptic perception of the holographic image.

[0084] In further embodiments of the invention, the sound transducers generate a predetermined distribution of pressure patterns so that a first haptic sensation of the holographic image is provided in one section of the interaction area and a second haptic perception of the holographic image is provided in another section of the interaction area.

[0085] By providing various haptic sensations, the system according to the invention enables the user, for example, to position their hand precisely to recognize and / or perform shapes, structures, and / or inputs. Furthermore, the system can be configured to provide haptic feedback to the user when, for example, the user's hands are in the correct position to interact with the holographic image. For example, if the user's finger is in the area of ​​a play and / or pause control or volume control of a keyboard as a holographic image, a vibration can be transmitted. Alternatively, the perceived strength or intensity of the feedback can also be increased. Haptic feedback can also be provided when, for example, control gestures are completed.In particular, the system can be configured such that gestures and / or controls of a user can be registered on, in and / or along the holographic image.

[0086] The sound transducers are preferably arranged as an array. For the purposes of the invention, an array refers to a geometric configuration with regard to the arrangement, i.e., the positioning of the sound transducers. For example, the sound transducers can be arranged one-dimensionally, two-dimensionally, or three-dimensionally. The sound transducers are preferably arranged as a grid and / or have a fixed spacing from one another. For example, the sound transducers can have a spacing from one another of up to approximately 250 mm, approximately 200 mm, approximately 150 mm, approximately 100 mm, approximately 50 mm, approximately 20 mm, approximately 10 mm, approximately 5 mm, approximately 2 mm, approximately 1 mm.

[0087] In further embodiments, it may be preferable to use beamforming technology for sound propagation. This allows sound waves to be emitted in a directed manner by controlling the phase control component via interference, for example, to achieve a specific pressure increase in certain areas.

[0088] The system according to the invention preferably comprises a control unit configured to regulate the phase, intensity, intensity distribution, pressure, and / or frequency of the sound transducers. Advantageously, the sound transducers can emit over an angular range along a plane of up to 180°, preferably up to 120°, particularly preferably up to 80°, very particularly preferably up to 50°, even more preferably up to 30°, and very preferably up to 10°, so that the sound waves can be emitted in a particularly focused manner.

[0089] Advantageously, the sound waves can penetrate the substrate through the sound channels with minimal distortion, allowing the user to experience a particularly realistic haptic perception of the holographic image. For example, a desired pressure of 10–50 Pa (Pascal) can be achieved at a distance of approximately 10–40 cm and an angular range of approximately 40–70°. The sound parameters can preferably be adjusted and / or regulated via the control unit.

[0090] The system preferably also comprises a control unit for controlling the components of the system, for example the ultrasonic transducers or the light source. For the purposes of the invention, a control unit preferably refers to a computing unit, such as a processor, a processor chip, a microprocessor and / or a microcontroller for automatically controlling the components of the system, e.g. the ultrasonic transducers, by specifying parameters of the sound waves (e.g. phase, intensity, pressure, frequency, etc.). In further preferred embodiments, the control unit can be a computing machine such as a computer, a computing device or a computer system. The components of the control unit can be conventional or individually configured for the respective implementation. The control unit preferably comprises a processor, a memory and computer code (software / firmware) for controlling the components of the device.

[0091] The control unit can preferably also be a programmable circuit board, a microcontroller, or other component for receiving and processing data signals from the components of the system, in particular the sound transducer or the light source. The control unit preferably further comprises a computer-usable or computer-readable medium, such as a hard disk, random access memory (RAM), read-only memory (ROM), flash memory, etc., on which computer software or code is preferably installed. The computer code or software for controlling the components of the system according to the invention can be written in any programming language or model-based development environment, such as BC / C++, C#, Objective-C, Java, Basic / VisualBasic, MATLAB, Simulink, StateFlow, Lab View, or Assembler.

[0092] The formulation that the control unit is configured to perform a specific operation, such as regulating the phase, intensity distribution, pressure and / or frequency of the transducers, may include customized or standard software installed on the control unit that initiates and controls these operation steps.

[0093] In a further preferred embodiment, the system is characterized in that the sound transducers are ultrasonic transducers which are configured for sound emission in a frequency range of 20 kHz to 100 kHz, preferably 30 kHz to 60 kHz.

[0094] The use of ultrasonic transducers can advantageously result in particularly efficient haptic perception. Furthermore, ultrasonic transducers have proven their worth in the technical field of haptic or tactile sensation projection, enabling optimal and simple haptic feedback. An ultrasonic transducer is a sound transducer that emits ultrasound, particularly in the corresponding frequency ranges.

[0095] In a further preferred embodiment, the system is characterized in that the pressure fluctuations are generated by acoustic sound waves with a carrier frequency and a modulation frequency, wherein the carrier frequency is preferably between 20 kHz (kilohertz) and 100 kHz and / or the modulation frequency is in a range between 0.1 Hz (Hertz) and 500 Hz, particularly preferably a range between 150 Hz and 250 Hz. This can preferably be regulated by a control unit. The modulation of the acoustic waves with a frequency between 0.1 Hz and 500 Hz advantageously results in a user being able to perceive the holographic image particularly well haptically. This is due in particular to the fact that the mechanoreceptors of the human skin are particularly sensitive to these frequencies. The holographic image can thus advantageously be combined with a particularly realistic haptic perception.

[0096] In further embodiments, the sound transducers can emit sound in such a way that control points are defined within the interaction area. A control point preferably denotes a marker at a specific location in the interaction area. Control points can be characterized by areas assigned a specific amplitude and / or a specific phase. For example, a control point can also be modeled such that a sound transducer is located directly below the control point. The control points are preferably spaced apart at a distance that essentially corresponds to a wavelength of the sound. A control unit is preferably configured to define such control points within the interaction area. Shapes and / or sections of the holographic image can advantageously be defined by control points.For example, a volume comprising a plurality of edges and / or vertices can be modeled using control points, such that the control points are located at the edges and / or vertices, thereby allowing a specific pressure to be sensed. The control points can also define a shape that can be felt by a user as part of a haptic feedback system. Preferably, the user can interact within the tactile area.

[0097] In a further preferred embodiment, the system is characterized in that the light source is located inside or outside the substrate, wherein the light source is preferably a laser and / or an LED.

[0098] In particular, the installation of a light source within the substrate advantageously results in the system according to the invention being designed to be particularly compact. A compact design allows the system according to the invention to be integrated into a wide variety of applications. Installing the light source outside the substrate is advantageous in that it achieves greater variability and flexibility with regard to the type of light source and the illumination and / or irradiation of the base body and / or substrate. This reduces the requirement for compact dimensioning of the light source, and it can also be installed in different positions if an adapted angle of incidence toward the base body and / or substrate is desired.

[0099] It is also preferred that the at least one holographic-optical element is introduced as a volume hologram on a front side, back side and / or within the substrate. A volume hologram preferably refers to a hologram that has been inscribed in a light-sensitive, relatively thick layer. This can preferably be done using a transmission or reflection technique. Interference of the object and reference beams within the hologram volume preferably creates a sequence of Bragg planes. A volume hologram can therefore also be understood as a holographic grating, i.e. as an optical grating produced using holographic methods. A volume hologram therefore preferably has a non-negligible extension in the propagation direction of the light rays, wherein the Bragg condition applies to the reconstruction of a volume hologram.

[0100] For this reason, volume holograms exhibit wavelength and / or angle selectivity. The ability of volume holograms to store multiple images simultaneously enables, among other things, the production of colored holograms. Light sources that emit the three primary colors blue, green, and red can be used to record the holograms. After exposure, three holograms are stored simultaneously in the volume hologram. To reproduce the color hologram, it can be exploited that each partial hologram can be reconstructed using only the color with which it was recorded. Thus, the three reconstructed color separations overlap to form a colored, true-to-original image, provided the color components are correctly weighted.

[0101] In addition, by means of volume holograms, particularly diverse light beams can advantageously be deflected particularly precisely in the direction of an exit or coupling-out region within the interaction region and / or, in embodiments in which the substrate acts as a light guide, also within the substrate.

[0102] In preferred embodiments, the light source is coherent, particularly preferably partially coherent. A coherent light source is characterized by the emission of coherent light rays. Coherence preferably refers to the property of optical waves according to which there is a fixed phase relationship between two wave trains. As a result of the fixed phase relationship between the two wave trains, spatially stable interference patterns can arise. With regard to coherence, a distinction can be made between temporal and spatial coherence. Spatial coherence preferably represents a measure of a fixed phase relationship between wave trains perpendicular to the direction of propagation and is given, for example, for parallel light rays. Temporal coherence preferably represents a fixed phase relationship between wave trains along the direction of propagation and is given in particular for narrowband, preferably monochromatic light rays.

[0103] The coherence length preferably refers to the maximum path length or travel time difference between two light beams from a starting point, so that a (spatially and temporally) stable interference pattern is still created when they superpose. The coherence time preferably refers to the time it takes for the light to travel a coherence length.

[0104] In preferred embodiments, the light source is a laser. Particularly preferably, it is a narrowband, preferably monochromatic laser with a preferred wavelength in the visible range (preferably 400 nm to 780 nm). Non-exhaustive examples include solid-state lasers, preferably semiconductor lasers or laser diodes, gas lasers, or dye lasers.

[0105] Other light sources, preferably coherent light sources, may also be used. Narrowband light sources, preferably monochromatic light sources, such as light-emitting diodes (LEDs), optionally in combination with monochromators, are preferred.

[0106] In particular, the use of LEDs is advantageous in that they are particularly compact and cost-effective and particularly easy to integrate into the system according to the invention.

[0107] In a further preferred embodiment, the system is characterized in that one or more sound channels are formed as openings within the substrate.

[0108] Advantageously, the light can be transported into or through the substrate in a targeted manner to create the holographic image in the interaction area and also to transmit sound through the substrate via the openings. In particular, the holographic image can be designed to be haptically perceptible particularly efficiently. Thus, perforated substrates can be used to create holographic images and combined with sound transducers to obtain haptic feedback.

[0109] With regard to the distance between the sound transducers and the holographic image, it must be taken into account that the sound intensity decreases with the square of the distance. Therefore, the sound transducers are preferably arranged such that pressure fluctuations perceptible to human skin pass through the openings to the interaction area. It may be preferable for the sound channels to be arranged directly next to and / or around the second holographic-optical element.

[0110] By adjusting the positioning of the sound channels, particularly in the form of openings on the substrate, sound pressure patterns can advantageously be generated to be perceived as a haptic signal. The sound pressure pattern can be characterized by sections within the interaction area with pressure maxima and / or pressure minima, which are located particularly along the holographic image. In particular, constructive and / or destructive interference can make the pressure fluctuations effective at desired locations, and the continuing wavefronts of the sound waves can cancel each other out. Thus, it may be preferable for the outgoing wavefronts to interfere destructively in a far-end range and constructively in a near-end range, particularly within the interaction area.

[0111] Advantageously, depending on the performance of the sound transducers, defined pressure field increases can be achieved for the pressure pattern in the interaction area. This allows different sound pressures to be generated in a highly localized manner, making them suitable for perception as a haptic signal.

[0112] In a further preferred embodiment, the system is characterized in that the one or more sound channels have an elliptical and / or a quadrangular cross-section.

[0113] The geometric design of the sound channels can advantageously influence the propagation of the sound waves and / or light.

[0114] An elliptical cross-section of the sound channels is advantageous in that it has only a minimal influence on the sound modes. In particular, the mode spectrum of the sound is not altered or is altered only very slightly. Sound channels with an elliptical cross-section can be used to particularly well and easily control the passage of sound. It has been recognized that the rounder the cross-section of a sound channel, the larger the resulting mode spectrum. In particular, an elliptical cross-section also encompasses a circular sound channel. Thus, elliptical cross-sections of the sound channels are particularly advantageous for the propagation of sound through the substrate.

[0115] However, an elliptical cross-section of the sound channels can cause the light rays passing through them to be refracted. In particular, the light rays may be scattered outward, with outward preferably referring to a ray path away from the center of the light beam. Thus, an elliptical cross-section of the sound channels can act like a diverging lens with respect to light passing through the sound channel in the substrate.

[0116] To compensate for the effect of the sound channel, it may be preferable to incorporate a lens and / or a holographic-optical element with a corresponding optical function, e.g., a lens function, which can advantageously refocus the outwardly scattered light so that the light is specifically aligned to generate the holographic image. In preferred embodiments, a holographic-optical element with the function of a converging lens is used to compensate for sound channels with an elliptical cross-section. The lens or the holographic-optical element with the function of a converging lens can have an inverse optical function to the curved sound channels. Advantageously, the light can be transmitted over a variety of angles of incidence and / or colors can be correctly combined.

[0117] A quadrangular cross-section for the sound channels, on the other hand, has proven particularly advantageous for the path of the light rays in the substrate, since the light is not refracted or only slightly refracted at the surfaces of the quadrilateral - with appropriate alignment. A slit is particularly preferably used as the sound channel. A slit preferably means a rectangular cross-section with a significantly smaller width in the direction of light propagation than in an orthogonal direction (length). A slit can, for example, be narrower than it is long by a factor of 3, 5, 10 or more. A quadrangular cross-section includes, in particular, a rectangle, a square, a trapezoid, a parallelogram, and / or a rhombus. In further embodiments, the cross-section can also have a dihedral, pentagon, hexagon, heptagon, octagon, or other polygonal shape.There are no restrictions on the geometric shape of the sound channels, especially as openings on the substrate. A square cross-section is advantageous in that it is easier to provide a substantially orthogonal interface onto which the light can impinge essentially perpendicularly, thus advantageously minimizing imaging errors.

[0118] In a further preferred embodiment, the system is characterized in that the one or more sound channels in the substrate have an angle of inclination, thus enabling the sound waves to be focused on the holographic image. A sound channel preferably has an angle of inclination if a straight line drawn at a point on an edge of the sound channel has a different course than that of the longitudinal and / or transverse axis of the substrate. In the context of the invention, this can also be referred to as tilting. Tilting the sound channels advantageously results in increased sound pressure being able to be achieved within the interaction area. In particular, the holographic image can be perceived haptically with increased intensity. It is particularly preferred if the sound transducers are also tilted.In this case, the sound pressure and thus the intensity can be intensified to a particularly high degree, and the haptic perception can be created with particularly high fidelity. It is particularly advantageous if the sound transducers have essentially the same angle of inclination as the tilted sound channels.

[0119] In a further preferred embodiment, the system is characterized in that the one or more sound channels partially or completely surround a light exit region or a coupling-out region within the substrate. Surrounding preferably means that the one or more sound channels are arranged on a contour that encloses the light exit region or a coupling-out region, wherein one or more sound channels are not arranged in the light exit region or coupling-out region itself.

[0120] Advantageously, positioning the sound channels along an outer contour of the light exit area or output area can result in a particularly efficient delivery of pressure fluctuations within the interaction area to generate a haptic signal. In particular, sound waves can be emitted in a particularly focused manner in the direction of the holographic image, creating particularly subtle pressure fluctuations and thus a realistic haptic perception.

[0121] Advantageously, the holographic image can also be related to pressure fluctuations in a particularly realistic manner with regard to shape, contours, sizes, etc.

[0122] In a further preferred embodiment, the system is characterized in that one or more sound channels are filled as openings within the substrate with a material, preferably a fluid, particularly preferably water, glycerol, an oil, preferably a silicone oil, wherein the material preferably has an optical refractive index that substantially corresponds to a refractive index of the substrate.

[0123] Terms such as substantially, approximately, about, approx., etc., preferably describe a tolerance range of less than ± 20%, preferably less than ± 10%, particularly preferably less than ± 5%, and especially less than ± 1%, and always include the exact value. Similarly, preferably describes quantities that are approximately equal. Partially, preferably, describes at least 5%, particularly preferably at least 10%, and especially at least 20% or at least 40%.

[0124] Advantageously, a material filled in the sound channels that has a similar refractive index to the substrate material results in the light rays experiencing less refraction. This either eliminates the need for subsequent compensation or collimation, or simplifies the process. The smaller the difference between the refractive indices of the material filled in the sound channels and the substrate material, the smaller the angular changes experienced by the light beam, so that any collimation can be performed without errors. Advantageously, the light can be directed aberration-free toward the light exit or light output area to create the holographic image.

[0125] Oil, preferably optical oil, has proven to be a particularly preferred material for filling the sound channels. In preferred embodiments, the substrate comprises glass, in particular an optical glass or optical plastic with a refractive index between 1.4 and 1.6, preferably approximately 1.5. Oils, in particular optical oils, with a similar refractive index between approximately 1.4 and approximately 1.6, preferably approximately 1.5, can advantageously be selected, so that undesirable refraction effects can be minimized. Oils are preferably also characterized by good sound conduction, so that even through a sound channel filled with oil the sound waves propagate in the direction of the holographic image largely without distortion or attenuation.

[0126] In preferred embodiments, the material for filling the one or more sound channels is a fluid with an increased surface tension, preferably with a surface tension at room temperature (20°C) of at least 20 mN / m (milliNewtons per meter), preferably at least 30 mN / m, 40 mN / m, 50 mN / m, 60 mN / m or more. The increased surface tension of the fluid material minimizes the risk of the material flowing out of one or more sound channels. The person skilled in the art can select materials with preferred surface tensions for filling the one or more sound channels depending on the geometric design of the sound channels (in particular a cross-section of the sound channels) based on known physical principles in order to ensure that the fluid remains securely in the sound channels.

[0127] In a further preferred embodiment, the system is characterized in that one or more sound channels are filled with a material, preferably a fluid, as openings within the substrate, wherein a membrane or a film is applied to the substrate at least over the region of the one or more filled sound channels. The fluid can preferably be one of the preferred fluids mentioned above, which have an optical refractive index that essentially corresponds to a refractive index of the substrate. However, the fluid can also be air, in which case the membrane or the film essentially has a protective function against contamination.

[0128] Preferably, the film or membrane is attached to the surfaces of the substrate on both sides to seal the one or more filled sound channels on both sides. This preferably enables a particularly reliable seal of a fluid material, regardless of the surface tension or geometric configuration of the sound channels.

[0129] The film or membrane is preferably transparent to the light from the light source. Furthermore, it is preferred that the film or membrane has a similar refractive index to the material of the substrate and / or the material used to fill the sound channel. The membrane or film is preferably impermeable to the enclosed fluid material. In preferred embodiments, the layer thickness of the film or membrane is less than 1 mm, preferably less than 500 μm, 400 μm, 300 μm, 200 μm, or less. The membrane or film is preferably capable of oscillation.

[0130] The membrane can be a silicone membrane, for example, and the film can be a transparent plastic film, e.g. a PMMA film (polymethyl methacrylate film). The membrane or film can preferably be attached to the substrate surface at least in the region of the sound channels with an optical adhesive or an additional OCA film (OCA is the abbreviation for optical clear adhesive). An optical adhesive or an OCA film preferably has a similar refractive index to the membrane, the film or the material of the substrate in order to ensure a smooth optical bond. The membrane or film preferably encloses the fluid in the one or more sound channels with as little bubbles as possible. This means that there are preferably no air pockets in the sound channel in order to advantageously ensure an essentially aberration-free passage of the light through the filled sound channel.

[0131] In preferred embodiments, a film cover is applied to the membrane or film. The film cover is preferably characterized by greater mechanical stability than the film or membrane. For example, it may be preferred for the film cover to have a layer thickness that is 2, 3, 4, 5, 10 or more higher than that of the film or membrane. The film cover preferably serves to cover and protect the membrane or film. In the region of the sound channels, the film cover preferably has openings or holes whose number, shape and size preferably correspond to the number, shape and size of the sound channels. The film cover can preferably comprise the same material as the substrate, e.g. an optical plastic (e.g. PMMA) or optical glass.

[0132] In preferred embodiments, a number or a plurality of sound channels comprise the material having a similar refractive index to the substrate material. In further preferred embodiments, all sound channels are filled with the material. In particularly preferred embodiments, the sound channels arranged along or around a light exit or coupling-out region are filled with the material. It may also be preferred to fill only the sound channels located in the beam path of the light with a material, preferably a fluid, particularly preferably water, glycerin, an oil, preferably a silicone oil. In a preferred embodiment, the system is characterized in that one or more sound channels are closed by a membrane or film.Air can preferably be present within the sound channel, or, as explained above, a fluid whose refractive index is matched to the refractive index of the substrate. By providing a membrane or film, the ingress of dirt into the sound channels can be reliably prevented without impairing sound propagation. Cleaning the sound channels is not necessary.

[0133] If no membrane or film is provided to close the sound channels, it may also be preferable to clean the sound channels regularly. To simplify cleaning of the sound channel, the shape, in particular the dimensions, of the sound channel can be optimized. It may also be preferable for cleaning to be carried out using the sound transducers themselves. For example, one or more sound transducers can be designed to emit sound waves which serve to remove dirt within a sound channel. In particular, sound waves can be emitted which have a sound pressure level which is higher than an average value for generating a haptic perception, for example by a factor of 1, 5, 2, 3, 5, 10 or more.

[0134] It may also be preferred that a pulsed application of sound waves, in the sense of "blowing clean," of the sound channels be used to remove any contaminants. Thus, one or more sound transducers, particularly through a corresponding configuration of a control unit, can be designed to emit amplified sound waves or ultrasonic pulses within specific time periods in order to remove any contaminants from the sound channels. Such cleaning can preferably be performed at regular intervals or depending on the degree of contamination; it may also be preferable to specifically select and clean any contaminated sound channels.

[0135] In a further preferred embodiment, the system is characterized in that the substrate has one or more holographic-optical elements in front of and / or behind one or more sound channels, which are configured for compensation, redirection, and / or expansion of the light that the light undergoes due to propagation through the one or more sound channels. In this context, "in front of" or "behind" preferably means upstream or downstream of the beam with respect to the direction of light propagation in the substrate.

[0136] Advantageously, light beams can thus be directed in a targeted manner toward the light exit region or output region to generate the holographic image in the interaction region, and / or the beam path can be designed particularly simply. In preferred embodiments, the second holographic-optical element is located at the light exit region or output region. Therefore, it may be preferable for the light to be directed toward the second holographic-optical element before the light is emitted into the interaction region to generate the holographic image.

[0137] A holographic optical element for compensating light beams can preferably compensate for undesired refraction effects of the sound channels on the light beams. For example, a compensation HOE can be configured to compensate for a diverging effect of a sound channel by re-collimating the light beams. Chromatic effects can also be corrected by correctly combining colors using holographic optical elements for compensation. Holographic optical elements for compensating light, also called compensation HOEs, can be embedded in front of a sound channel, behind a sound channel, in particular on a front and / or back side, and / or within the substrate.A compensation HOE preferably has an optically inverse function to the sound channels, which influence the propagation of the light rays in the substrate and are preferably used to reduce imaging errors. In the case of an elliptical sound channel, the compensation function can, for example, take the form of collimation, so that the effect of the sound channel is compensated, i.e., balanced.

[0138] In a preferred embodiment, the system can also comprise one or more holographic-optical elements configured to redirect the light such that the light beams are essentially deflected around the sound channels. These HOEs are referred to as redirection HOEs in the context of the invention. Advantageously, such redirection prevents light beams and the sound channels from coming into contact with each other. In particular, no scattering and / or refraction occurs through the sound channel, thus advantageously producing a particularly unadulterated and true-to-original holographic image.

[0139] In further preferred embodiments, the light can also be deflected in such a way that it is fanned out and collimated and directed towards the light exit region or output region. For the purposes of the invention, an expansion of light preferably means an enlargement of the optical beam diameter, i.e. the size of a light beam. In particular, the beam diameter refers to the diameter of each line that runs perpendicular to the beam axis and intersects it. Advantageously, an enlarged holographic image can be generated by expanding the light beams. The expansion of the light beams can be achieved, for example, by a holographic-optical element that has the effect of a diverging lens, i.e. emits light over a wide area and deflects it in particular towards the light exit or output region.

[0140] In further embodiments, multiple holographic optical elements can be used to expand the light. In the context of the invention, this can be described as pupil dilation. The term is based on pupil dilation in humans, for example, when an increased amount of light is to enter the iris of the eye in the dark in order to recognize objects. In the context of the invention, pupil dilation refers to an increase in the extent to which light is directed into the light exit area or output area.

[0141] In a further preferred embodiment, the system is characterized in that the substrate has a coupling-in region and a coupling-out region, wherein the one or more sound channels at least partially surround the coupling-out region and the light is directed to the coupling-out region of the substrate by one or more holographic-optical elements past the sound channels and / or the light is directed to the coupling-out region of the substrate through a light channel past sound channels, wherein preferably one or more holographic-optical elements are present after the sound channels, which expand the light and direct it in a collimated manner to the coupling-out region.

[0142] The aforementioned possibilities for attaching holographic-optical elements for compensating, redirecting, and / or expanding light can also be used, in particular, when the substrate functions as a light guide. In the context of the invention, the holographic-optical elements that serve the described optical functions can be referred to as compensation HOEs, redirecting HOEs, or expanding HOEs. In particular, it may be preferable to arrange several such holographic-optical elements on and / or in the substrate. In preferred embodiments, the compensation HOEs, redirecting HOEs, or expanding HOEs are selected from a group comprising one or more reflection and / or transmission holograms.

[0143] Furthermore, it is preferred that the substrate is connected to a light channel, the light source irradiates the light channel, and the light is admitted into the substrate via the light channel. In particular, the light can then be specifically deflected so that it does not have to propagate through the sound channels, but rather around them. Light is preferably coupled into the light channel in such a way that it is always totally reflected at the interface between an optically denser material (higher refractive index) of the light channel and an optically thinner material (lower refractive index) surrounding the light channel.

[0144] Advantageously, the system according to the invention provides a variety of options for directing the light, in particular past the sound channels, and propagating it into the exit or output region to display the holographic image. In particular, without additional effort (or compensation HOEs), the holographic image can be reliably prevented from experiencing aberrations due to the geometric design of the sound channels.

[0145] In a further preferred embodiment, the system is characterized in that the substrate comprises a material which is an optical plastic, preferably selected from a group comprising polymethyl methacrylate (PMMA), polycarbonate (PC), cycloolefin polymers (COP), cycloolefin copolymers (COC) and / or an optical glass, preferably selected from the group comprising borosilicate glass, B270, N-BK7, N-SF2, P-SF68, P-SK57Q1, P-SK58A and / or P-BK7.

[0146] These materials are characterized by good optical properties for holography and are also well-suited for industrial-scale production. They offer the advantage of cost-effective series production while maintaining consistently high optical quality. Furthermore, a wide variety of geometric and complex geometries can be achieved, for example, through further processing.

[0147] In a further aspect, the invention relates to a use of the system according to the invention for generating a haptic perception and a holographic image in an interaction area. This advantageously allows the holographic image to be perceived particularly efficiently and optimally. In particular, pressure differences can correspond to the geometric configuration of the object that the holographic image is intended to represent, creating a particularly realistic impression for the user.

[0148] The average person skilled in the art will recognize that technical features, definitions, and advantages of preferred embodiments described for the system according to the invention for generating a haptic perception and a holographic image equally apply to the use of the system for generating a haptic perception and a holographic image, and vice versa. In particular, the system according to the invention can be used in a variety of application areas, especially in many modern technological applications.

[0149] The system according to the invention can advantageously be used, for example, in conjunction with control surfaces, such as holographic buttons. A holographic button, within the meaning of the invention, refers to a holographic image that is generated and can interact with a user. The user's interaction can, in particular, relate to a touch. For example, a touch can lead to a specific function being performed. It is thus conceivable for the system according to the invention to display a keyboard and / or a joystick as a holographic image. A user can, for example, operate the keyboard and / or joystick via the holographic image without having to touch the actual keyboard and / or joystick. This applies to any objects that can be visualized using a holographic image.This has a particularly beneficial effect on hygiene, as the objects themselves do not require touching. This is particularly relevant for devices that are commonly used by many users, such as a car gearshift lever and / or an elevator keypad.

[0150] In a preferred embodiment, the system comprises a detector, wherein the detector is preferably configured to detect an operating gesture in relation to the holographic image. The detector is preferably a photodetector for detecting electromagnetic radiation, preferably visible light or infrared radiation. Non-limiting examples include digital image sensors, such as a CCD sensor or a CMOS sensor, or also photodiodes, photocells, and phototransistors, which can preferably be arranged as an array.

[0151] While a holographic image and haptic perception can be generated in the interaction area in front of the base body, the arrangement of a detector preferably enables the detection of operating gestures in the interaction space. An operating gesture preferably refers to a contactless interaction of a user with respect to the holographic image. If, for example, a holographic button or keyboard is generated in the interaction area, the operating gesture can be a tap, swipe, or swipe input. For a holographic image in the form of a joystick, the operating gesture can also correspond, for example, to a movement of the joystick.

[0152] The measurement data acquired by the detector are preferably transmitted to a control or processing unit configured to recognize operating gestures. For this purpose, a corresponding computer code (software / firmware) can preferably be stored on the control or processing unit.

[0153] In preferred embodiments, the system is configured to adapt the display of a holographic image and / or tactile feedback depending on a recognized operating gesture. For example, it may be preferable to indicate the detected actuation of a holographic button either by changing the color and / or shape of the holographic button and / or haptically by a pressure fluctuation. Likewise, with respect to a joystick, it may be preferable to track the haptic perception and / or holographic image of the joystick based on a recognized operating gesture.

[0154] This makes it possible to provide a particularly user-friendly operating system that enables extremely realistic interaction with holographic objects for contactless operation.

[0155] With regard to positioning, various arrangements of the detector are conceivable, with the detector preferably detecting electromagnetic radiation from the interaction area. For this purpose, optical components for steering, collimation, and / or focusing, such as lenses, mirrors, diffractive structures, or holographic-optical elements, can be provided.

[0156] In a preferred embodiment, the detector is arranged behind the base body, thus on the opposite side of the interaction region. In this embodiment, the detector is therefore preferably located on the same side of the base body as the sound transducers. By appropriately providing optical components, e.g. lenses, one or more planes from the interaction region are preferably imaged onto the detector, e.g. a CCD sensor or CMOS sensor, so that an operating gesture can be determined based on the measurement data. In this embodiment, it is preferred that the detector is located on an optical axis with the holographic image or a holographic-optical element for generating the holographic image.

[0157] To enable any desired positioning of the detector, it may be preferable to provide a second optical fiber or waveguide, which serves to transmit light toward the detector. The second waveguide can preferably be a functionalized waveguide, as known from WO 2020 / 157306 A1, the contents of which are hereby incorporated in their entirety by reference.

[0158] The second waveguide can, for example, have a second base body with a front side and a back side, wherein the base body has a partially transparent second coupling region and a second coupling region spaced therefrom in a first direction. The second coupling region can preferably lie on an optical axis with the holographic image and comprise a diffractive structure that deflects at least a portion of the radiation coming from an operating gesture to be detected in the interaction space, such that the deflected portion propagates as coupled-in radiation in the second base body through reflections to the second coupling-out region. From the second coupling-out region, the deflected portion of the coupled-in radiation is preferably directed onto the detector.

[0159] In this embodiment, the terms second coupling region or second coupling-out region refer to regions for coupling in or out radiation of an operating gesture to be detected from the interaction region. For this embodiment, the second coupling and coupling-out regions can therefore also be referred to as detection coupling and detection coupling regions, respectively. These regions are generally not identical to the (first) coupling and coupling-out regions described above for generating a holographic image. Likewise, it may be preferable to refer to the second waveguide as a detection waveguide. Embodiments described for the (first) base body, in particular with a substrate that functions as a light guide, preferably also apply to the second base body, which serves as a waveguide for radiation to be detected.

[0160] The transparent base body can be designed, for example, as a plane-parallel plate. The semi-transparent base body can be made of glass and / or plastic. It can be a single piece or have a multi-layer structure. In particular, the transparent base body can be transparent to radiation or light in the visible wavelength range (preferably 400 nm to 780 nm). Furthermore, it can be transparent to the near infrared (780 nm to 3000 nm, preferably 780 nm to 1400 nm) and / or the entire infrared range (3000 nm to 1 mm, preferably 3000 nm to 50 pm).

[0161] The second coupling region can also be transparent or semi-transparent. If transparency is desired, the radiation coupling can be achieved, for example, by means of a diffractive structure, with just enough efficiency to ensure sufficient radiation power reaches the coupling-out region. The semi-transparent second coupling region can be designed such that the coupling efficiency is, for example, 2%, 5%, 10%, 15%, 20%, 25%, 30%, 35%, 40%, 45%, or 50% or more. The coupling efficiency refers to the proportion of detected radiation from the interaction region that can be transmitted and thus admitted into the substrate of the second base body.

[0162] The transparent or semi-transparent second coupling region is preferably designed such that the deflection is free from an imaging optical function (e.g., free from a focusing effect). The reflections can, in particular, be total internal reflections on the front and / or back of the transparent base body. However, it is also possible for reflective layers or coatings, or partially reflective layers or coatings, to be provided for this purpose.

[0163] The output coupling region of the transparent second base body can deflect at least a portion of the coupled radiation impinging on it such that the deflected portion exits the second base body. This preferably occurs via the front or back of the transparent second base body toward the detector.

[0164] The second output region can also be partially transparent. In particular, the output efficiency of the second output region can be, for example, 2%, 5%, 10%, 15%, 20%, 25%, 30%, 35%, 40%, 45%, or 50%. In particular, the output efficiency of the second output region can be in the range of 2% - 50%, so that the transparency of the second output region is in the range of 50% - 98%.

[0165] The partially transparent design is advantageous, for example, if the second coupling-in region and the second coupling-out region are formed as diffractive structures (e.g., as volume holograms). In this case, the second coupling-in region and the second coupling-out region can be formed, for example, in a film, which is advantageous from a manufacturing perspective. However, it is also possible for the second coupling-out region to have maximum coupling-out efficiency. This can be achieved, for example, by a mirror coating (preferably a full mirror coating).

[0166] The second coupling region and the second coupling region can be configured such that, in addition to deflection, they do not perform any optical imaging function. However, it is also possible for the second coupling region and / or the second coupling region to provide an optical imaging function in addition to deflection and thus perform optical imaging. For example, the optical imaging function can implement the function of a converging lens or diverging lens, a concave or convex mirror, whereby the curved surfaces (centered or decentered) can be spherically curved or aspherically curved.

[0167] In preferred embodiments, the second coupling-out region also has a diffractive structure. The diffractive structure of the second coupling-in region or the second coupling-out region can be implemented as a buried diffractive structure, as a diffractive structure between two substrates, or as a diffractive structure formed on the front or back side.

[0168] In particular, a reflection or transmission hologram can be provided as the diffractive structure for the second coupling or decoupling region. Furthermore, the diffractive structure of the second coupling or decoupling region can be a transmissive or reflective relief grating. The second decoupling region can also have a mirror surface, a prism, and / or a reflective or transmissive Fresnel structure. These variants can be provided as an alternative to the diffractive structure or in addition to the diffractive structure.

[0169] Particularly preferably, the second coupling region is designed as a reflective volume hologram which has an angle-of-incidence-dependent wavelength selectivity, so that it has a high transparency for a large angle and wavelength range.

[0170] This makes it possible to provide a detector system that advantageously enables optical detection of operating gestures in the interaction area without affecting the quality of the generated holographic image. Although the second coupling area for the radiation to be detected is preferably located on an optical axis with the holographic image or a holographic element provided for this purpose in the (first) base body, it does not interfere with the holographic imaging.

[0171] For this purpose, it may be preferable for the wavelength of the radiation to be detected from an operating gesture from the interaction area and the wavelength of the radiation from the light source used to generate a hologram to be different. For example, detection can occur in the non-visible wavelength range (e.g., the infrared range), while the holographic image is generated in the visible range.

[0172] The diffractive structures or holographic elements in the (first) base body (for generating the holographic image) or in the second base body (for detecting an operating gesture) can preferably be designed for different wavelengths. For example, a reflective volume hologram in the second base body can be designed to reflect infrared radiation for radiation to be detected from the interaction area, while being transmissive for light to generate a holographic image in the visible range.

[0173] In a preferred embodiment, the system, in combination with the detector, comprises an IR radiation source (infrared radiation source), which is preferably designed to provide IR radiation in the interaction region. IR radiation refers in particular to infrared radiation in the range from 780 nm to 1 mm, preferably 780 nm to 50 pm. The infrared radiation emitted by the IR radiation source is particularly preferably radiation in the near infrared range (780 nm to 3 pm, preferably 780 nm to 1400 nm).

[0174] Preferably, in addition to the second waveguide for guiding radiation to be detected from the interaction region to the detector, the (first) base body for generating a holographic image or its substrate also functions as a light guide, preferably as a guide for light in a visible wavelength range.

[0175] The second base body for detecting an operating gesture can preferably be a separate structural component from the (first) base body for generating a holographic image. For example, the second base body for detection can be arranged in front of or behind the (first) base body for beam guidance for the holographic image. It may be preferable for the first and second base bodies to be arranged at a distance from one another. Likewise, the first and second base bodies can be connected to one another to create a multi-layer structure.

[0176] Preferably, the radiation from the light source is guided in a (first) base body to generate a holographic image (for example in the visible range), while the radiation which is guided from the interaction area to the detector to detect an operating gesture (for example also in the visible range or in the infrared range) is guided in the second base body.

[0177] In these embodiments, both the detector (for detecting an operating gesture) and the light source (for generating a holographic image) can advantageously be positioned flexibly depending on the available installation space. Corresponding first and second coupling and decoupling regions can be easily provided for this purpose in the first or second base body.

[0178] The two base bodies themselves can form a compact unit, behind which the sound transducers are arranged as described. These designs are characterized by a particularly compact design. In particular, the system can have an extremely shallow installation depth, so that hardly any installation space is required in this dimension. This simplifies the installation of the system and opens up a wide range of application possibilities.

[0179] To further ensure reliable haptic perception within the interaction area, it is preferred that the second base body also has sound channels for detecting an operating gesture, wherein these are preferably arranged congruently with the sound channels located in the substrate of the first base body for generating a holographic image. Those skilled in the art will recognize that preferred embodiments described with regard to the design of sound channels in the substrate of the (first) base body also apply to the provision of sound channels in the second base body (or its substrate), which serves as a beam guide for detecting an operating gesture.

[0180] In further embodiments, it may be preferred that the first and second base bodies form a unit, i.e. are preferably designed as a (single) base body which serves both as a waveguide for radiation to generate the holographic image and as a waveguide for radiation to detect the operating gesture. In other words, it may be preferred that only a (first) base body with a (preferably monolithic) substrate is provided, wherein both the radiation to generate the holographic image and the radiation to detect the operating gesture are guided in the substrate as described. Such a base body will therefore preferably have both first coupling and decoupling regions for radiation to generate a holographic image, as well as second coupling and decoupling regions for radiation to detect an operating gesture from the interaction region.Advantageously, the first and second coupling and decoupling regions can be positioned independently of one another in the base body, depending on the requirements for the positioning of the light source (for generating the hologram) or the detector (for detecting an operating gesture). Instead of providing two base bodies or waveguides, the base body for generating the hologram advantageously functions simultaneously as a detection waveguide. This enables a particularly compact design, which advantageously enables integration of the system with an extremely shallow installation depth. Furthermore, in this embodiment, interfaces between two base bodies are avoided, whereby particularly high quality with regard to the holographic imaging and the detection of an operating gesture can still be achieved.

[0181] In preferred embodiments of the system, a plurality of coupling sections can be provided in the second base body for detecting an operating gesture, which direct the radiation to be detected from an operating gesture from the interaction area to a plurality of associated coupling sections. Accordingly, the second coupling area and the second coupling area preferably comprise an identical number of coupling sections and coupling sections, respectively, which can be arranged, for example, in a line or matrix format. A sensor section of the detector can preferably be assigned to each coupling section.

[0182] The detector is preferably designed to continuously measure the intensity of the radiation impinging on the respective coupling section and to feed it to a control device. The control device is preferably configured to determine the distance of an input device for an operating gesture (e.g. a hand) from a respective coupling section as a function of the measured intensity. Ambient light can be used for detection. A reduction in the measured intensity for a coupling section preferably indicates shading of the coupling section by a closer input device (e.g. a finger of a hand). Likewise, an active illumination of an input device in the interaction area can occur, for example by a separate light source (e.g. by an LED frame).Such embodiments of a preferred functionalized waveguide are disclosed, for example, in WO 2022 / 022904 A1, the content of which is hereby incorporated in its entirety by reference.

[0183] In WO 2022 / 022904 A1, a contactless area sensor is provided by means of the functionalized waveguide, wherein, in particular, contactless input in a selection area in front of an optoelectronic display, such as an LCD element or an OLED element, is to be enabled. According to the invention, it was recognized that the described detection principle for the contactless determination of a distance of an object in front of an optoelectronic display can also be used to detect operating gestures in an interaction area. For this purpose, a plurality of coupling sections in array form can preferably be provided, for example, in the second base body, which cover the dimensions of the interaction area. By determining the intensity using a corresponding detector array, the distance of an input device (for example, a hand) from the first or second base body can be detected.Advantageously, by providing an array of coupling sections, for example, a matrix, the distance of the input device at various positions in front of the first or second base body can be simultaneously detected. A preferably determined two-dimensional distance area allows conclusions to be drawn about an operating gesture.

[0184] In preferred embodiments, the coupling sections can be matched to the holographic image to be generated. In the case of generating a holographic keyboard, for example, it may be preferable for the coupling sections to correspond to the individual holographic keys. Pressing a holographic key can preferably be detected by a reduction in the intensity of the corresponding coupling section. The embodiment thus enables simple, reliable detection of a user's interaction with control elements represented by the holographic image.

[0185] The system according to the invention will be explained in more detail below using examples, without being limited to these examples.

[0186] FIGURES

[0187] Short description of the characters

[0188] Fig. 1 ab representation of a coupling of light through Edgelit and via a first holographic-optical element

[0189] Fig. 2 Schematic representation of the sound field

[0190] Fig. 3 ab Representation of sound channels around a second holographic-optical element in top and side view

[0191] Fig. 4 Representation of circulating sound channels around a second holographic-optical element in plan view

[0192] Fig. 5 Representation of the system according to the invention in plan view Fig. 6 ab Representation of an effect of different cross sections of the sound channels on the beam path of light

[0193] Fig. 7a-b Illustration of the effect of a compensation HOE

[0194] Fig. 8 ab Representation of an arrangement of compensation HOEs

[0195] Fig. 9 ab Representation of a sound channel as a gap in top and side view

[0196] Fig. 10 ab Representation of an arrangement of tilted sound channels and tilted sound transducers

[0197] Fig. 11 Representation of a beam path through tilted sound channels

[0198] Fig. 12 Representation of the system according to the invention with a light channel and a

[0199] Expansion HOE

[0200] Fig. 13 Illustration of the system according to the invention in combination with a dilation HOE via pupil expansion

[0201] Fig. 14 Illustration of a possible arrangement of deflection HOEs

[0202] Fig. 15 ab Representation of sound channels filled with a material

[0203] Fig. 16 Representation of several compensation HOEs

[0204] Detailed description of the characters

[0205] Fig. 1 shows a schematic representation of different possibilities for radiating and / or coupling light into a substrate 5.

[0206] Fig. 1a shows an embodiment in which the light is admitted into the substrate through an edgelit. In this case, light is emitted from a light source 7 in the direction of a substrate 5. The light source 7 can be an LED, for example. In particular, the light can hit the substrate 5 from the side and be coupled in via one side, i.e. admitted into the substrate via an edge. The light can propagate within the substrate in the direction of a second holographic-optical element 15, by means of which a holographic image 3 is generated in an interaction area, i.e. a user can perceive a holographic image 3 optically (by sight) and haptically or tactilely. In particular, the second holographic-optical element 15 can be designed as an output hologram, so that the holographic image 3 appears to be freely floating in the interaction area.

[0207] Fig. 1b illustrates an embodiment in which the light is introduced into the substrate 5 through a first holographic-optical element 13. The light can be coupled into the substrate 5 by the first holographic-optical element 13 at a specific wavelength (and thus a specific color) and a specific angle of incidence and deflected in a directed manner according to the resulting function. In particular, the light can be directed in a targeted manner toward the second holographic-optical element 15 to generate the holographic image 3 in the interaction area. Fig. 2 shows a schematic representation of the sound field that can be generated by emitting sound waves through sound transducers (not shown). Depending on the arrangement of sound channels (not shown), sound pressures and / or a sound pressure pattern can arise through interference phenomena in order to obtain a haptic perception.Particularly in the near field, a particularly intense haptic signal can be perceived through constructive interference, while in the far field, the outgoing sound waves interfere destructively, causing the haptic signal to weaken and become unnoticeable to the user upon leaving the interaction area. Preferably, defined pressure field increases can be generated, which depends on the performance of the sound transducers, the arrangement of the sound channels, and / or their geometric design. For example, pressure field increases of up to a factor of approximately 3 can be achieved between different spatial sections within the interaction area.

[0208] By designing various pressure fluctuations within the interaction area, a particularly realistic haptic perception of the holographic image 3 can be created. For example, it is possible for the holographic image 3 to represent an object, such as a joystick. The area of ​​the joystick that would be touched can have a higher pressure than an area that depicts the contours, thanks to the system 1 according to the invention. The haptic perception can give the user the impression that they are holding the object, e.g. the joystick, in their own hands. The sound transducers can preferably use beamforming of the sound waves in order to emit sound waves in a particularly directed and focused manner, and thus also intensively, in certain areas of the interaction area.

[0209] Fig. 3 shows an arrangement of sound channels surrounding a coupling-out region comprising a second holographic-optical element 15 in top and side views.

[0210] Fig. 3a shows a plan view of an embodiment of the system 1 according to the invention. Here, the sound channels 11 partially surround a coupling-out region comprising a second holographic-optical element 15. In a region from which the light rays or light bundles propagate from the light source 7 in the direction of the second holographic-optical element 15 (represented by the arrow in the figure), no sound channels 11 are arranged. As a result, the light does not experience any undesired deflection, for example due to a lens effect that could result from the sound channels 11. Instead, the light can advantageously propagate undisturbed in the direction of the holographic-optical element 15 in order to generate the holographic image 3 in the interaction region. The sound channels 11 are formed as openings within the substrate 5.

[0211] Fig. 3b shows a side view of this embodiment. As can be seen from the side view, the substrate 5 is located between the sound transducers 9 and the interaction area. The sound waves propagate through the sound channels 11 toward the holographic image 3, generating an additional haptic signal for a user within the interaction area through pressure fluctuations.

[0212] Fig. 4 shows a top view of sound channels 11, which completely surround a coupling-out region comprising the second holographic-optical element 15. In this embodiment of the system 1 according to the invention, the sound channels 11 are arranged as openings continuously circumferentially along the second holographic-optical element 15, so that the sound waves can pass through them and generate a particularly focused and / or broad-area haptic signal.

[0213] Fig. 5 shows a top view of another embodiment of the system 1 according to the invention. The light source 7 emits the light toward the substrate 5. The figure shows that the light undergoes deflection during propagation through the sound channel 11. This is due to the fact that the substrate material and a medium located within the sound channel 11 can have different refractive indices. The sound transducers 9 are located behind the substrate 5, with the emitted sound waves (indicated by a circle around the sound transducer 9) passing through the sound channels 11.

[0214] In particular, the sound transducers can emit ultrasonic waves. When ultrasound is used, the tactile or haptic sensation for a user is triggered by sound pressure fluctuations in the interaction area. Ultrasound has proven particularly advantageous for generating a particularly realistic haptic perception for the user.

[0215] The light propagates toward the second holographic-optical element 15, so that the holographic image 3 can appear in front of an exit or coupling-out region of the substrate 5. Thus, the system 1 according to the invention makes it possible to generate both a holographic image 3 and a haptic perception without the substrate 5 blocking or inhibiting the sound.

[0216] Fig. 6 illustrates the effect of differently geometrically shaped cross-sections of the sound channels on the propagation of light in the substrate 5.

[0217] Fig. 6a illustrates the effect of angular cross-sections on light propagation. It can be seen that a sound channel with a angular cross-section, in particular a rectangular cross-section, makes it possible for light rays to experience no or only slight deflection. For this purpose, the boundary surfaces of the sound channel 11 are preferably oriented orthogonally to the direction of propagation of the light rays. This is advantageous for the design of the optics of the system 1 according to the invention, since the path of the light can be controlled particularly easily, for example by attaching optical components and / or holographic-optical elements. Thus, angular cross-sections, in particular rectangular cross-sections of the sound channels 11, are particularly well suited to obtaining an effective and simple beam path.

[0218] Fig. 6b illustrates the effect of sound channels 11 with an elliptical cross-section on light propagation. An elliptical cross-section of the sound channels 11 is advantageous for the propagation of sound waves, since the mode spectrum is little or not altered in an elliptical shape.

[0219] However, when passing through a sound channel 11 with an elliptical cross-section (a circular one is shown), a light beam can lose its collimation and be refracted outward. Thus, an elliptical cross-section can have a similar effect to a diverging lens. As explained in more detail below, various compensation options can be provided to re-collimate the light beams.

[0220] Fig. 7 illustrates the effect of a compensation HOE 17 in preferred embodiments.

[0221] In Fig. 7a, a compensation HOE 17 is arranged such that the light passes through it after passing through a sound channel 11. This allows the light to be collimated, provided the sound channel, for example, has the effect of a diverging lens.

[0222] Fig. 7b shows another possibility for compensating for any undesirable effects of the sound channel 11 on the light propagation. In the embodiment shown, the compensation HOE 17 is arranged such that the light passes through it first before traversing the sound channel 11. The compensation HOE 17 can be configured to pre-compensate for the refractive effect of the sound channel, for example, by the compensation HOE 17 having the optical function. The compensation HOE 17 is preferably designed to accept different angles of incidence and correctly combine different wavelengths, thus avoiding chromatic aberrations in the light propagation in the substrate.

[0223] Fig. 8 illustrates further possible arrangements of compensation HOEs 17. In Fig. 8a, the compensation HOE 17 is embedded in the substrate 5, while in Fig. 8b the substrate lies on a surface of the substrate 5. The compensation HOE 17 can be connected to the substrate 5, for example, by lamination and / or gluing, for example in the form of a film.

[0224] The illustrated connection options with the substrate 5 also apply analogously to all holographic optical elements shown. Preferably, the holographic optical elements can be mounted on and / or in the substrate 5.

[0225] Fig. 9 shows a top and side view of a sound channel 11 as a slit. In particular, an angular, especially a square, cross-section of the sound channels 11 has proven advantageous for the beam path, as it reduces the complexity of the beam path.

[0226] Fig. 9a shows a top view in which several sound channels 11 are arranged such that they surround a coupling-out region comprising the second holographic optical element 15, with one sound channel 11 being designed as a gap. The sound channel 11, designed as a gap, is arranged such that the light first passes through the gap before propagating to the second holographic element 15 to generate the holographic image 3.

[0227] Fig. 9b shows the same arrangement as Fig. 9a in side view.

[0228] Fig. 10 illustrates an embodiment of the system 1 according to the invention in which the sound channels 11 and / or the sound transducers 9 are inclined.

[0229] Fig. 10a shows that the sound channels 11 are tilted. As a result, the sound waves propagating through the sound channels 11 experience a different diffraction behavior than if the sound channels 11 were not tilted. A tilted sound channel 11 is characterized by an angle of inclination. This advantageously allows the sound pressure to be increased at certain positions in the interaction area, thus generating a more pronounced haptic signal.

[0230] Fig. 10b shows an embodiment of the system 1 according to the invention, in which the sound channels 11 and the sound transducers 9 are tilted. This advantageously demonstrated that the sound pressure and the haptically perceptible pressure fluctuations could be increased to a significant degree.

[0231] Fig. 11 shows the beam path and a further embodiment of the system 1 according to the invention, in which the sound channels 11 are tilted.

[0232] Fig. 11a shows the path of a light beam propagating through a tilted sound channel. It can be seen that the light is refracted at the sound channel 11 because the substrate material and the material located within the sound channel 11 have different refractive indices. Therefore, the system 1 according to the invention is preferably designed to compensate for the refractive effect of the sound channel or to guide the light past the sound channels.

[0233] Fig. 11b shows an embodiment in which not all, but some sound channels 11 are tilted, so that an increased sound pressure can still be achieved in the interaction area.

[0234] Advantageously, this leads to an intensive haptic perception of the holographic image 3.

[0235] Fig. 12 illustrates an embodiment of the system 1 according to the invention, in which an expansion HOE 21 is arranged. The system 1 according to the invention also has a light channel 23. The light source emits light in the direction of the light channel 23. Advantageously, the light channel 23 is connected to the substrate 5 in such a way that the light is specifically directed past the sound channels 11. As a result, the light is advantageously not refractured, so that no compensation for the refraction is necessary. Instead, the light channel 23 directs the light to an expansion HOE 21. The expansion HOE 21 expands the light, in particular with respect to the propagation area. As a result, the light is directed over a large area, preferably in a collimated manner, toward the second holographic optical element 15 in order to display the holographic image 3.

[0236] Fig. 13 illustrates an embodiment of the system 1 according to the invention, which has an expansion HOE 21. Several holographic optical elements are arranged side by side to achieve pupil expansion. The light from the light source 7 is coupled very narrowly into the substrate 5 and deflected such that it propagates around the sound channels 11 and experiences pupil expansion through the expansion HOE 21 in the form of several holographic optical elements. In this case, the light is also expanded, with the light from several holographic optical elements preferably being expanded and collimated and directed to the second holographic optical element.

[0237] Fig. 14 shows a further possibility for directing the light specifically past the sound channels 11. This is particularly advantageous for embodiments in which the sound channels have an elliptical cross-section, since light could refract outwards. Additional deflection HOEs 19 are used to specifically direct the light past the sound channels 11, in particular by total reflection. The light then reaches the second holographic-optical element 15 to generate the holographic image 3. The deflection HOEs 19 can be designed as transmission and / or reflection holograms. In particular, it is also possible to use multiple light sources 7, in particular two light sources 7.

[0238] Fig. 15a shows an embodiment in which some sound channels 11 are filled with a material. Preferably, the material has a similar refractive index to the substrate material. The smaller the difference in refractive indices between the substrate material and the material that is filled into the sound channels 11, the smaller the refractive effect or angular changes that the light experiences on its way to the second holographic-optical element 15 to ultimately generate the holographic image 3. Oil has proven particularly advantageous as a filling material for the sound channels 11, since oil, preferably optical oil, can be selected with a refractive index that can be adapted particularly closely to preferred optical glasses or plastics and at the same time provides good sound transmission. Materials such as glycerin, water and / or silicone oil can also be advantageously used for filling the sound channels 11.

[0239] Fig. 15b schematically illustrates a cross-sectional view of a section (represented by the dashed line) of the substrate 5, which has a sound channel 11 that is filled with a material, preferably a fluid. To enclose the material (represented by the black filling), a film or membrane 25 is applied along the sound channel 11. Preferably, the film or membrane 25 is attached to both sides of the surfaces of the substrate 5 in order to close the filled sound channels 11. Preferably, the film or membrane 25 is transparent to the light of the light source and impermeable to the enclosed material, preferably the fluid. The membrane can be, for example, a silicone membrane and the film can be, for example, a transparent plastic film, e.g.a PMMA film (polymethyl methacrylate film) and, in the area of ​​the sound channels, can be applied to the substrate surface with an optical adhesive or an OCA film (not shown). To cover and protect the film or membrane 25, it may be preferable to apply a film cover 27 to the film or membrane 25. The film cover 27 has an opening 29 in the area of ​​the sound channel 11, which corresponds in shape and size to the shape and size of the (cross-section of the) sound channel 11. The film cover 27 can preferably be made of the same material as the substrate 5.

[0240] Fig. 16 shows an embodiment of the system according to the invention in which several compensation HOEs 17 are arranged. Here, one compensation HOE 17 is located in front of and one behind a circular sound channel 11. This advantageously simplifies the compensation of the light by focusing the light with a compensation HOE 17 in front of the sound channel 11 such that the light rays impinge orthogonally on the interfaces upon entering and exiting the sound channel. Undesired refraction effects and aberrations can be avoided particularly efficiently in this way. LIST OF REFERENCE SYMBOLS

[0241] 1 system

[0242] 2 Coupling area

[0243] 3 Holographic image

[0244] 4 Decoupling area

[0245] 5 Substrat

[0246] 7 Light source

[0247] 9 transducers

[0248] 11 Sound channel

[0249] 13 First holographic-optical element

[0250] 15 Second holographic-optical element

[0251] 17 Compensation HOE

[0252] 19 Deflection HOE

[0253] 21 Widening HOE

[0254] 23 light channel

[0255] 25 film or membrane

[0256] 27 foil lids

[0257] 29 Opening in the foil lid

Claims

PATENT CLAIMS 1. System (1) for generating a haptic perception and a holographic image (3) in an interaction area comprising a. a light source (7) for emitting light, b. a base body comprising a substrate (5) and at least one holographic-optical element (13, 15, 17, 19, 21, 23), wherein the light source (7) and the base body are designed to generate a holographic image (3) in the interaction area, and c.one or more sound transducers (9) for the emission of sound waves in the direction of the interaction area, such that pressure fluctuations within the interaction area (3) are haptically perceptible, characterized in that the substrate (5) is located between the one or more sound transducers (9) and the interaction area and the substrate (5) has one or more sound channels (11), wherein the sound waves propagate at least partially through the one or more sound channels (9) in the direction of the holographic image (3).

2. System (1) according to the preceding claim characterized in that the system (1) is designed to generate the holographic image (3) by means of a transmission hologram and / or a reflection hologram.

3. System (1) according to one or more of the preceding claims characterized in that the substrate has an input coupling area (2) and an output coupling area (4) which are located at different positions on the substrate and propagates the light within the substrate (5) between the input coupling area (2) and the output coupling area (4) by reflections, preferably total internal reflections.

4. System (1) according to the previous claim characterized in that the coupling area (2) is located at an edge of the substrate (5) and / or the coupling area (2) has a first holographic-optical element (13), wherein the light can be coupled into the substrate (5) and deflected within the substrate (5) by means of the first holographic-optical element (13).

5. System (1) according to one or more of the preceding claims 3 and / or 4 characterized in that the output coupling area (4) has a second holographic-optical element (15) and light exits via the output coupling area (4) to generate the holographic image (3) in the interaction area. System (1) according to one or more of the preceding claims, characterized in that the system comprises 2, 3, 5, 10, 20, 50, 100 or more transducers (9), wherein the transducers (9) are preferably arranged as an array. System (1) according to one or more of the preceding claims, characterized in that the transducers (9) are ultrasonic transducers configured for sound emission in a frequency range of 20 kHz to 100 kHz, preferably 30 kHz to 60 kHz. System (1) according to one or more of the preceding claims, characterized in that the pressure fluctuations are generated by acoustic sound waves with a carrier frequency and a modulation frequency, wherein the carrier frequency is preferably between 20 and 100 kHz and / or the modulation frequency is in a range between 0.1 Hz and 500 Hz, particularly preferably in a range between 150 Hz and 250 Hz.System (1) according to one or more of the preceding claims, characterized in that the light source (7) is located inside or outside the substrate (5), wherein the light source (7) is preferably a laser and / or an LED. System (1) according to one or more of the preceding claims, characterized in that the one or more sound channels (11) are designed as openings within the substrate (5). System (1) according to one or more of the preceding claims, characterized in that the one or more sound channels (11) have an elliptical and / or a quadrilateral cross-section. System (1) according to one or more of the preceding claims, characterized in that the one or more sound channels (11) in the substrate have an angle of inclination such that the sound waves are focused onto the holographic image (3).System (1) according to one or more of the preceding claims characterized in that the one or more sound channels (11) partially or completely surround an exit area or coupling area (4) within the substrate (5). System (1) according to one or more of the preceding claims, characterized in that one or more sound channels (11) are filled as openings within the substrate (5) with a material, preferably a fluid, particularly preferably water, glycerin, an oil, preferably a silicone oil, wherein the material has a refractive index that substantially corresponds to a refractive index of the substrate. System (1) according to one or more of the preceding claims, characterized in that one or more sound channels (11) are filled as openings within the substrate (5) with a material, preferably a fluid, wherein a membrane or a film (25) is applied to the substrate (5) at least over the area of ​​the one or more filled sound channels (11).System (1) according to one or more of the preceding claims characterized in that the substrate (5) has one or more holographic-optical elements in front of and / or behind one or more sound channels (11) which are arranged for a compensation (17), a deflection (19) and / or a widening (21) of the light which the light experiences as a result of propagation through the one or more sound channels (11).System (1) according to one or more of the preceding claims characterized in that the substrate (5) has an input coupling area (2) and an output coupling area (4) wherein the one or more sound channels (11) at least partially surround the output coupling area (4) and the light to the output coupling area (4) of the substrate (5) is directed past the sound channels by one or more holographic-optical elements (19) and / or the light to the output coupling area (4) of the substrate (5) is guided past sound channels (11) by a light channel (23), wherein preferably one or more holographic-optical elements (21) are provided after the sound channels, which widen the light and direct it collimated onto the output coupling area.System (1) according to one or more of the preceding claims, characterized in that the substrate (5) comprises a material which is an optical plastic, preferably selected from the group comprising polymethyl methacrylate (PMMA), polycarbonate (PC), cycloolefin polymers (COP), cycloolefin copolymers (COC) and / or an optical glass, preferably selected from the group comprising borosilicate glass, B270, N-BK7, N-SF2, P-SF68, P-SK57Q1, P-SK58A and / or P-BK7. System (1) according to one or more of the preceding claims, characterized in that. The system (1) comprises a detector, which is preferably designed to recognize an operating gesture in relation to the holographic image (3). Use of the system (1) according to one or more of the preceding claims for generating a haptic perception and a holographic image (3) in an interaction area.