Haptly expressive interaction element, display screen, human-machine interface with operating procedures and vehicle

Abstract

Interaction element for a display screen, comprising a flexible light-emitting layer defining a display area and a viewing direction extending perpendicular to the display area for displaying a display content, display screen, human-machine interface (HMI), and vehicle, as well as a method for operating a human-machine interface.

Description

[0001] The invention relates to an interaction element for a display screen, comprising a flexible light-emitting layer defining a display area and a viewing direction extending perpendicular to the display area for displaying a display content. The invention further relates to a display screen, a human-machine interface (HMI), a vehicle, and a method for operating a human-machine interface.

[0002] Interaction elements of the type mentioned above, in various forms, are part of the state of the art and serve to allow the display screen, originally intended as an output device, to also be used as an input device.

[0003] If the display screen is touch-sensitive, i.e., designed as a so-called touchscreen, and if the content displayed on the screen includes an actuation symbol, for example, a virtual push button, the display screen can detect a touch of the displayed actuation symbol. A control unit functionally connected to the display screen can then activate a function associated with the displayed actuation symbol as a result of the detected touch. In this case, at least the area of ​​the display screen showing the actuation symbol is to be considered an interaction element within the meaning of the invention.

[0004] However, the interaction element, i.e., the area of ​​the display screen showing the activation symbol, is only perceptible visually, which is why touching the displayed activation symbol requires looking at the display screen.

[0005] Apart from that, the appearance of the displayed activation symbol can be modified by the control unit following a touch, in order to signal the success of the touch. However, such feedback is also only perceptible visually.

[0006] In many situations, it is at least desirable that the interaction element also allows for a haptic, i.e., tactile, perception of the activation symbol and / or a haptically perceptible feedback of activation of the activation symbol.

[0007] DE 10 2019 200 090 A1 discloses an interaction element with a plurality of electric motors that change the shape of an interaction surface of the interaction element when the penetration of a finger into a predetermined area in front of the interaction surface is detected by a sensor. The shape is changed, for example, in such a way that the haptic perception of the deformed interaction surface is similar to the haptic perception of a push button. The shape of the interaction surface can also be changed in response to pressure applied by a finger to the interaction surface, which is perceived as haptically perceptible feedback from the interaction element to the finger pressure.

[0008] Alternatively, US 2012 / 0105333 A1 discloses an interaction element comprising a plurality of elastic layers and a plurality of piezoelectric elements arranged in a matrix between the elastic layers. The piezoelectric elements can be individually controlled to deform an elastic layer, which serves as the interaction surface of the interaction element, in a complex manner. Conversely, the piezoelectric elements can provide an electrical signal when, for example, a finger exerts pressure on the interaction surface.

[0009] One object of the invention is to provide an alternative interaction element for a display screen that makes a variable actuation symbol displayed by the interaction element flexibly and dynamically perceptible through touch. Further objects of the invention are to provide a display screen, a human-machine interface, and a vehicle, as well as to propose a method for operating a human-machine interface.

[0010] An object of the invention is an interaction element for a display screen, comprising a flexible light-emitting layer defining a display area and a viewing direction extending perpendicular to the display area for displaying content. The invention is based on a flexible, i.e., bendable and in particular elastic, layer configured to emit light at least opposite to the viewing direction of a user of the interaction element in such a way that the user can visually perceive content displayed by the interaction element. It is understood that the interaction element can display and dynamically change variable content as usual.

[0011] The viewing direction here is to be understood as a direction originating from the user's eyes and extending perpendicularly to the display surface. Accordingly, a spatial area located between the light-emitting layer and the user's eyes is, with respect to the viewing direction, i.e., as seen by the user, positioned in front of the light-emitting layer.

[0012] According to the invention, the interaction element comprises a flexible photothermal layer arranged behind the light-emitting layer with respect to the viewing direction, a bulk layer arranged behind the photothermal layer with respect to the viewing direction for bending the layers arranged in front of the bulk layer with respect to the viewing direction, and an infrared (IR) sensor layer for detecting an area-related heat distribution within the photothermal layer. The interaction element comprises a plurality of different layers and has a laminar structure.

[0013] The photothermal layer is designed to convert the energy of light into heat locally when illuminated. Locality in this context means that the photothermal layer heats up precisely where it is illuminated. Conversely, the photothermal layer does not heat up anywhere it is not illuminated.

[0014] The light-emitting layer defines a plurality of pixels, i.e., picture elements, arranged in a matrix and immediately adjacent to one another. The light-emitting layer is designed to emit identical light simultaneously against the viewing direction (i.e., towards the user) and in the viewing direction (i.e., towards the photothermal layer). Consequently, the photothermal layer can always provide a thermal image of the display content shown by the light-emitting layer.

[0015] The photothermal layer inevitably emits infrared (IR) radiation that spatially corresponds to the thermal image it produces. The infrared sensor layer is designed to detect the infrared radiation emitted by the photothermal layer, in particular the spatial distribution of the emitted infrared radiation, and to provide a sensor signal corresponding to the detected spatial distribution.

[0016] The provided sensor signal can be used to control the volume layer. The volume layer is configured to bend each layer of the interaction element located in front of the volume layer, relative to the viewing direction, in accordance with the provided sensor signal. The volume layer can have a plurality of chambers arranged in a matrix and immediately adjacent to one another. The volume of each chamber can be changed individually, i.e., independently of other chambers in the volume layer, by introducing or removing a gas, for example, air, or a liquid, for example, water. Accordingly, the volume layer can be referred to as a pneumatic volume layer or a hydraulic volume layer, depending on the phase state of the volume medium used. Each chamber is advantageously spatially assigned to a group of adjacent pixels of the light-emitting layer.

[0017] In this way, a three-dimensional profile corresponding to the displayed content can be provided for the surface of the interaction element facing away from the user's viewing direction, i.e., towards the user. The user can perceive the three-dimensional profile solely through touch, without looking at the interaction element.

[0018] Thanks to the described chain of effects, the interaction element according to the invention can transform a variable display content into a haptically perceptible three-dimensional surface profile in an extremely flexible and dynamic way.

[0019] In one embodiment, the light-emitting layer comprises a recombination layer, a first charge-transport layer arranged in front of the recombination layer (relative to the viewing direction), a first electrode layer arranged in front of the first charge-transport layer (relative to the viewing direction), a second charge-transport layer arranged behind the recombination layer (relative to the viewing direction), and a second electrode layer arranged behind the second charge-transport layer (relative to the viewing direction). The first electrode layer and the second electrode layer are each configured to provide an area distribution of freely moving opposite electric charges, i.e., electrons or negative charges or electron vacancies (also referred to as holes), or positive charges, corresponding to a display content.

[0020] The first and second charge transport layers are designed to allow mutually attracting electric charges to leave their respective electrode layers and approach each other. The recombination layer is designed to allow the recombination of pairs of opposite charges. During each recombination, an electron fills an electron vacancy, emitting a photon, i.e., light. This photon emission can be directed either towards the user's eyes or towards the photothermal layer.

[0021] Naturally, the charge transport layers and the electrode layers each have a transparency so that light emitted from the recombination layer can pass through the charge transport layers and the electrode layers essentially undamped.

[0022] Advantageously, the interaction element includes a capacitive sensor layer positioned in front of the light-emitting layer, relative to the user's viewing direction. This capacitive sensor layer is designed to detect when a user's finger touches a surface of the interaction element and to provide a corresponding sensor signal. The capacitive sensor layer serves as an input element for the interaction element, enabling bidirectional interaction with the user in conjunction with the light-emitting layer as an output element.

[0023] Another aspect of the invention is a display screen for a human-machine interface. The display screen is designed to show content that can be visually perceived by the user.

[0024] According to the invention, the display screen comprises an interaction element according to one embodiment of the invention. Thanks to the interaction element according to the invention, variable display content can be flexibly and dynamically displayed in a haptically perceptible manner.

[0025] The interaction element can extend over a section of the display screen or over the entire display screen. In the first case, another section of the display screen is designed as a conventional display screen. In the second case, the entire display screen is designed as the interaction element according to the invention; that is, a three-dimensional profile of the surface of the interaction element can extend over the entire surface.

[0026] A third aspect of the invention is a human-machine interface comprising a display screen and a control unit functionally connected to the display screen. The control unit is configured to control the display screen, i.e., at least to cause the display screen to show content.

[0027] According to the invention, the human-machine interface comprises a display screen according to one embodiment of the invention and a control unit functionally connected to the light-emitting layer, the volume layer, the IR sensor layer, and optionally the capacitive sensor layer. By means of the display screen according to the invention, the human-machine interface can flexibly and dynamically display variable content in a haptically perceptible manner.

[0028] A fourth item is a vehicle with a human-machine interface (HMI). The vehicle is preferably a road vehicle, in particular a passenger car. The human-machine interface can then be located, for example, and not as a limitation, in a center console of the vehicle or centrally in a cockpit panel of the vehicle, i.e., be designed as a central information display (CID) of the vehicle.

[0029] Alternatively, the vehicle can be designed as a rail vehicle, for example a train car, as a watercraft, for example a ship, or as an aircraft, for example an airplane.

[0030] According to the invention, the human-machine interface is designed according to one embodiment of the invention. The human-machine interface according to the invention enables the user, in particular the driver of the vehicle, to interact with the interface while the vehicle is in motion without taking their eyes off the traffic situation. Thanks to the human-machine interface according to the invention, the vehicle's driving safety is significantly increased.

[0031] It is noted that the human-machine interface can, for example, even display a digital navigation map in a haptically perceptible way if the interaction element extends across the entire display screen.

[0032] A fifth object of the invention is a method for operating a human-machine interface. The method can be referred to briefly as the operating method of the human-machine interface and comprises a plurality of process steps that specify how a display screen of the human-machine interface and a control unit of the human-machine interface functionally connected to the display screen interact, i.e., cooperate.

[0033] According to the invention, a control unit of a human-machine interface, according to one embodiment of the invention, controls a light-emitting layer of an interaction element of a display screen of the human-machine interface such that the interaction element displays an actuation symbol as the display content, heats the light emitted to display the actuation symbol, heats an area of ​​a photothermal layer of the interaction element arranged according to a surface position and surface contour of the displayed actuation symbol, an IR sensor layer of the interaction element detects the surface position and surface contour of the heated area, an IR sensor layer of the interaction element provides a sensor signal indicating the detected surface position and the detected surface contour, and the control unit controls a volume layer of the interaction element depending on the provided sensor signal such thatthat the volume layer bends each layer of the interaction element positioned in front of the volume layer, forming a convex bulge that projects from the display surface at the surface position of the displayed actuation symbol and along the detected surface contour. The surface position specifies the position of the displayed actuation symbol, for example, a virtual push button, on the display screen. The surface contour specifies the area and contour of the displayed actuation symbol. The resulting bulge enables haptic perception of the displayed actuation symbol.

[0034] It is understood that in normal operation of the human-machine interface, the position and / or shape of the protrusion changes flexibly and dynamically depending on the position and / or shape of the variable actuating element.

[0035] Preferably, a capacitive sensor layer of the interaction element detects a touch on the convex protrusion and provides a sensor signal corresponding to the detected touch. Depending on this sensor signal, the control unit then controls the volume layer such that the volume layer reduces the height of the convex protrusion and / or bends any layer of the interaction element located in front of the volume layer (relative to the viewing direction), forming a concave depression with a surface contour corresponding to the detected touch. This depression is positioned at the touch point and recedes into the display area. In this way, the human-machine interface provides haptically perceptible feedback of the touch. This haptically perceptible feedback can be similar to that of a corresponding physical actuator.

[0036] Advantageously, the photothermal layer heats up depending on the color and intensity of the emitted light, the IR sensor layer provides a sensor signal with a strength dependent on the detected heat, and the control unit regulates the bending force independently of the strength of the sensor signal. Energy input into the photothermal layer depends, firstly, on the energy of the photons, which is determined by a photon frequency corresponding to the color, and secondly, on the number of photons, which corresponds to a specific intensity of the emitted light. For example, the photoelectric layer heats up more with strong blue light than with weak red light. The control unit is aware of the color and intensity distribution of the light emitted by the light-emitting layer. Ideally, the control unit compensates for color- and intensity-related differences in the color distribution.This ensures that the haptic perception of the operating symbols is not impaired by the color or intensity of the light emitted by the light-emitting layer.

[0037] For example, the display screen can be dimmed during the night in a night mode without any changes to the bulges that have formed.

[0038] A key advantage of the interaction element according to the invention is that variable display content can be flexibly and dynamically transformed into a haptically perceptible three-dimensional surface profile. In this way, a user can operate the interaction element according to the invention without looking at it. Because of this advantage, the interaction element according to the invention is particularly suitable for use in vehicles.

[0039] The invention is schematically illustrated in the drawing with reference to one embodiment and is further described with reference to the drawing. It shows: Fig. 1 in a cross-sectional view an interaction element according to an embodiment of the invention for a display screen; Fig. 2 in a partial perspective interior view of a vehicle according to an embodiment of the invention.

[0040] Fig. Figure 1 shows a cross-sectional view of an interaction element 1 according to an embodiment of the invention for a display screen 2. The interaction element 1 comprises a flexible light-emitting layer 10 for displaying a display content, which defines a display area and a viewing direction 100 extending perpendicular to the display area.

[0041] Ideally, the light-emitting layer 10 comprises a recombination layer 101, a first charge transport layer 102 arranged in front of the recombination layer 101 with respect to the viewing direction 100, a first electrode layer 103 arranged in front of the first charge transport layer 102 with respect to the viewing direction 100, a second charge transport layer 104 arranged behind the recombination layer 101 with respect to the viewing direction 100, and a second electrode layer 105 arranged behind the second charge transport layer 104 with respect to the viewing direction 100.

[0042] Furthermore, the interaction element 1 comprises a flexible photothermal layer 11, which is arranged behind the light-emitting layer 10 with respect to the viewing direction 100, a volume layer 13, which is arranged behind the photothermal layer 11 with respect to the viewing direction 100, for bending each layer 10, 11 arranged in front of the volume layer 13 with respect to the viewing direction 100, and an infrared, IR, sensor layer 12 for detecting an area-related heat distribution within the photothermal layer 11.

[0043] In addition, the interaction element 1 advantageously comprises a capacitive sensor layer 14 arranged in front of the light-emitting layer 10 with respect to the viewing direction 100.

[0044] Fig.Figure 2 shows a partial perspective interior view of a vehicle 4 according to an embodiment of the invention. The vehicle 4 comprises a human-machine interface (HMI) 3 according to an embodiment of the invention. The human-machine interface 3 comprises a display screen 2 according to an embodiment of the invention and a control unit 30 functionally connected to the light-emitting layer 10, the volume layer 13, the IR sensor layer 14, and the capacitive sensor layer 14.

[0045] The display screen 2 comprises an interaction element 1 according to one embodiment of the invention. In the display screen 2, the interaction element 1 can extend over a section of the display screen 2 or over the entire display screen 2.

[0046] The human-machine interface 3 is operated in a method according to an embodiment of the invention as follows.

[0047] The control unit 30 of the human-machine interface 3 controls the light-emitting layer 10 of the interaction element of the display screen 2 of the human-machine interface 3 such that the interaction element 1 displays an actuation symbol, for example a virtual push button, as the display content.

[0048] The light emitted to display the actuation symbol heats up an area of ​​the photothermal layer 11 of the interaction element 1 corresponding to a surface position and a surface contour of the displayed actuation symbol.

[0049] The IR sensor layer 12 of the interaction element 1 detects the surface position and surface contour of the heated area and provides a sensor signal indicating the detected surface position and surface contour.

[0050] The control unit 30 controls the volume layer 13 of the interaction element 1 depending on the provided sensor signal such that the volume layer 13 bends each layer 10, 11 of the interaction element 1 arranged in front of the volume layer 13 with respect to the viewing direction 100, forming a convex bulge arranged at the surface position of the displayed actuation symbol and projecting from the display surface with the detected surface contour.

[0051] Ideally, the capacitive sensor layer 14 of the interaction element 1 detects a touch of the convex protrusion and provides a sensor signal corresponding to the detected touch.

[0052] Depending on the sensor signal provided, the control unit 30 can control the volume layer 13 such that the volume layer 13 reduces the height of the convex protrusion and / or bends each layer 10, 11 of the interaction element 1 arranged in front of the volume layer 13 with respect to the viewing direction 100, forming a concave depression with a surface contour of the detected touch, arranged at a surface position of the touch and receding into the display surface.

[0053] If the photothermal layer 11 heats up depending on a color and intensity of the emitted light and the IR sensor layer 12 provides a sensor signal with a strength dependent on the detected heat, the control unit 30 controls a degree of bending preferably independently of the strength of the provided sensor signal. REFERENCE MARK LIST: 1 Interaction element 10 Light-emitting layer 100 View direction 101 Recombination layer 102 first cargo transport layer 103 first electrode layer 104 second cargo transport layer 105 second electrode layer 11 photothermal layer 12 IR sensor layers 13 volume layer 14 capacitive sensor layers 2 Display screen 3 Human-Machine Interface 30 Control unit 4 vehicles QUOTES INCLUDED IN THE DESCRIPTION

[0000] This list of documents cited by the applicant was automatically generated and is included solely for the reader's convenience. The list is not part of the German patent or utility model application. The DPMA accepts no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2019 200 090 A1

[0007] US 2012 / 0105333 A1

[0008]

Claims

Interaction element (1) for a display screen (2), comprising a flexible light-emitting layer (10) defining a display area and a viewing direction (100) extending perpendicular to the display area for displaying a display content, a flexible photothermal layer (11) arranged behind the light-emitting layer with respect to the viewing direction (100), a volume layer (13) arranged behind the photothermal layer (11) with respect to the viewing direction (100) for bending each layer (10, 11) arranged in front of the volume layer (13) with respect to the viewing direction (100), and an infrared, IR, sensor layer (12) for detecting an area-related heat distribution within the photothermal layer (11). Interaction element according to claim 1, wherein the light-emitting layer (10) comprises a recombination layer (101), a first charge transport layer (102) arranged in front of the recombination layer (101) with respect to the viewing direction (100), a first electrode layer (103) arranged in front of the first charge transport layer (102) with respect to the viewing direction (100), a second charge transport layer (104) arranged behind the recombination layer (101) with respect to the viewing direction (100), and a second electrode layer (105) arranged behind the second charge transport layer (104) with respect to the viewing direction (100). Interaction element according to claim 1 or 2, comprising a capacitive sensor layer (14) arranged in front of the light-emitting layer (10) with respect to the viewing direction (100). Display screen (2) for a human-machine interface (3), comprising an interaction element (1) according to one of claims 1 to 3 . Display screen according to claim 4, wherein the interaction element (1) extends over a section of the display screen (2) or over the entire display screen (2). Human-machine interface (3) comprising a display screen (2) according to claim 4 or 5 and a control unit (30) functionally connected with the light-emitting layer (10), the volume layer (13), the IR sensor layer (14) and the capacitive sensor layer (14). Vehicle (4) comprising a human-machine interface, HMI, (3) according to claim 6 . Method for operating a human-machine interface (3), wherein: - a control unit (30) of a human-machine interface (3) according to claim 6 controls a light-emitting layer (10) of an interaction element (1) of a display screen (2) of the human-machine interface (1) such that the interaction element (1) displays an actuation symbol as the display content; - the light emitted to display the actuation symbol heats an area of ​​a photothermal layer (11) of the interaction element (1) corresponding to a surface position and a surface contour of the displayed actuation symbol; - an IR sensor layer (12) of the interaction element (1) detects the surface position and the surface contour of the heated area and provides a sensor signal indicating the detected surface position and the detected surface contour;- the control unit (30) controls a volume layer (13) of the interaction element (1) depending on the provided sensor signal such that the volume layer (13) bends each layer (10, 11) of the interaction element (1) arranged in front of the volume layer (13) with respect to the viewing direction (100) by forming a convex bulge arranged at the surface position of the displayed actuation symbol and projecting from the display surface with the detected surface contour. Method according to claim 8, wherein: - a capacitive sensor layer (14) of the interaction element (1) detects a touch of the convex protrusion and provides a sensor signal corresponding to the detected touch; - the control unit (30) controls the volume layer (13) depending on the provided sensor signal such that the volume layer (13) reduces the height of the convex protrusion and / or bends each layer (10, 11) of the interaction element (1) arranged in front of the volume layer (13) with respect to the viewing direction (100), forming a concave depression with a surface contour of the detected touch, arranged at a surface position of the touch and receding into the display surface. Method according to claim 8 or 9, wherein: - the photothermal layer (11) heats up depending on a color and intensity of the emitted light; - the IR sensor layer (12) provides a sensor signal with a strength dependent on the detected heat; - the control unit (30) controls a degree of bending independently of the strength of the provided sensor signal.

Images