User interface, door control module, roof control module and means of transport for displaying user-facing control element labels

Abstract

User interface (10) comprising - a control element (20), - a display unit (30) and - an actuation sensor (40), wherein - the operating element (20) comprises a translucent material, - the display unit (30) is arranged on a first side of the operating element (20) and is configured to position an image (34) by means of aerial imaging technology on a second side of the operating element (20) opposite the first side as a floating image (35) in space, and - the actuation sensor (40) is arranged to generate a control signal in response to an actuation of the operating element (20), - wherein the operating element (20) is movably arranged and configured to be moved from a first position to a second position by a user interaction in order to trigger the actuation sensor (40) in response thereto.

Description

[0001] The invention relates to a user interface, a door control module, a roof control module and a means of transport for displaying user-facing control element labels or symbols (hereinafter referred to as "control element labeling").

[0002] Labels for control elements are typically placed on or next to their user interfaces. Depending on the positioning of the user interfaces, the legibility of the control element labels can be significantly reduced if the user's viewing angle is too flat relative to the control element surface. This problem can occur, for example, in a vehicle, where the user interfaces may be located above or to the side of a user and thus outside their optimal viewing angle. Limited legibility of control element symbols usually results in user interfaces being placed only in certain areas of the user's environment.

[0003] Furthermore, devices are known that allow the image content of a display to be placed in space, for example, by additionally arranging a retroreflector and a half-mirror. In other words, the representation plane of the image generated by the display is no longer the surface of the display itself; rather, depending on the structural arrangement of the retroreflector and the half-mirror, the image appears tilted to a greater or lesser extent in the space above the display and the half-mirror. This technology is called floating imaging, mid-air imaging, or aerial imaging technology (Asukanet) (hereinafter referred to as "aerial imaging technology").

[0004] Another known technical embodiment of aerial imaging technology is based on an optical plate (also called an "aerial imaging plate") arranged above the display, which, due to its special properties, is also capable of projecting the display image in three dimensions. In the following, the aerial imaging plate configuration will be used to further explain the invention, as it is easier to illustrate. However, other embodiments of aerial imaging technology are also applicable here, according to the invention.

[0005] US 2011 / 0 037 682 A1 relates to an image display device comprising a floating image display unit and a floating image detection unit. The floating image display unit comprises a display unit having a screen for displaying a two-dimensional image and an image transmission panel located far from the screen, wherein the floating image display unit focuses light emanating from the screen onto an image plane in a space to thereby display a floating image, the space being located on one side of the image transmission panel opposite the other side opposite the display unit. The floating image detection unit is formed from a light-transmitting plate. The light-transmitting plate has a size that allows all the light to the left of the screen and focused onto the image plane to pass through.The translucent plate is arranged so that it crosses the image plane at an angle.

[0006] JP 2008-243693 A relates to a non-contact switch that suppresses erroneous detection of an operation. The non-contact switch includes a display panel for displaying a three-dimensional hologram of an operation switch at a predetermined viewing angle; a proximity object sensor that detects a distance and speed of a detected object to the hologram of the operation switch; and a control unit for determining that the operation switch is operated by an operator at the predetermined viewing angle based on the transition of the distance and speed of the detected object.

[0007] Aerial imaging technology is used in the current state of the art to position control elements such as ATM buttons, etc., in a floating position in space. The operability of the floating buttons is achieved in the current state of the art through the use of 3D sensors, which can, for example, detect a user's finger position and trigger an operation when the finger "touches" the floating button in space or is in the same position. This type of operation requires the use of the aforementioned 3D sensors and a corresponding evaluation unit, which is associated with higher costs and, on the other hand, requires more space for the arrangement of the sensors.

[0008] It is therefore an object of this invention to optimize the method used in the prior art for labeling operating elements such as buttons or switches with a view to improving the readability of the operating element symbols.

[0009] To achieve the aforementioned object, the invention proposes a user interface. This provides an operating element, a display unit based on aerial imaging technology, and an actuation sensor. According to the invention, the operating element comprises a translucent material, the optical and haptic design of which can advantageously be adapted to existing user interfaces in order to achieve a uniform operating experience for the user. On a first side of the operating element, there is a display unit configured to generate an image according to the principle of aerial imaging technology or floating image technology. This image is displayed in three dimensions on a second side of the operating element, which is opposite the first side of the operating element.The image of the display unit can be generated, for example, by an LCD display in conjunction with an aerial imaging plate, which, due to its optical properties, allows the image to be shifted beyond the plane of the control element surface. The actuation sensor is configured to generate a control signal in response to an actuation of the control element. The actuation sensor can be, for example, an electrical contact, a reed switch, or a capacitive sensor. The control element is movably arranged and configured to be moved from a first position to a second position by user interaction in order to trigger the actuation sensor in response.

[0010] The subclaims show preferred developments of the invention.

[0011] In particular, the control element of the user interface can be arranged to be movable, so that it can be moved from a first predefined position to a second predefined position during user interaction. Depending on the design of the user interface, the second predefined position can be reached, for example, by turning, moving, pressing, or pulling. Reaching the second predefined position triggers the actuation sensor. A signal generated by the actuation sensor can be processed by an evaluation unit, which can be connected to the actuation sensor. The evaluation unit can be located either inside or outside the user interface.

[0012] In a further advantageous embodiment, the operating element can alternatively or additionally comprise a capacitive sensor, so that touching the operating element surface is sufficient to trigger and signal an actuation process.

[0013] In a further embodiment of the invention, the display unit can comprise an LED as a light source instead of a display, combined with a mask arranged above the LED. The mask comprises an opaque material that has translucent cutouts or areas at predefined positions that display symbols or text. In this way, control element labels can be implemented in a technically simplified and more cost-effective variant compared to the display-based solution, in the event that the display unit is intended to display only fixed text or symbols.

[0014] The user interface further preferably comprises a proximity sensor and an evaluation unit configured to process the output signals of the proximity sensor via a data input. An infrared LED in combination with a photodiode, for example, can be used as a proximity sensor to detect the intensity of the infrared light reflected by the user. The evaluation unit, which can be a control unit used for other functions in a means of transport, for example, receives the signals generated by the proximity sensor and calculates the current distance of the user from the user interface. If a proximity threshold stored in the evaluation unit is undershot, a visual change in the displayed image can be brought about, for example. This visual change can be, for example, fading out or switching off the image output.A flashing image as a visual confirmation of successful operation of the user interface, and / or a brightening and / or color change of the image upon approach are also conceivable application scenarios.

[0015] In a further embodiment, information about the user's viewing angle on the control element of the user interface can be provided to the user interface via a data input. This can be achieved, for example, by an optical sensor in the form of a camera that detects the user's eyes. The camera image can then be processed by an evaluation unit that is configured to detect the viewing direction of the eyes using image recognition and is further configured to calculate the user's viewing angle on the control element from the viewing direction in relation to the surface of the control element. By passing the information about the user's viewing angle to the user interface, the inventive advantages described below can be achieved: Firstly, this enables a demand-oriented display of the user interface image. This means that the image generated by aerial imaging technology can be deactivated by default and only displayed when the user is looking at the user interface. This has the advantage that the user is not disturbed by permanently displayed images of user interfaces that are not currently in use, which can be particularly useful for the driver of a vehicle at night.

[0016] The calculation of the viewing angle and the resulting control of the display unit can also be performed by an evaluation unit located outside the user interface, provided the required data interfaces are provided at the user interface. An external evaluation unit can have a beneficial effect on the manufacturing costs and the required installation space for the user interface. Furthermore, the external evaluation unit can be used to control multiple user interfaces simultaneously. It can also be part of a control unit used for other functions in a means of transport, which, due to free computing capacity, can control one or more user interfaces in parallel with the other functions.

[0017] Secondly, information about the user's viewing angle on the user interface control element also allows for further optimized alignment of the displayed label. This can be relevant, for example, for different drivers of a vehicle whose body height and therefore eye height vary to a greater or lesser extent. The images displayed using aerial imaging technology are, by design, placed at a fixed angle of inclination in space, depending on the predefined position of the optical components within the display unit. As described above, the aim of this inclination is to ensure optimal legibility of the label for the user. Different eye heights of users also mean different viewing angles on the user interface. An ideal viewing angle of 90° on the user interface cannot therefore be guaranteed for every user.If the display unit comprises an LCD display, for example, it is possible to appropriately distort the display content using known image processing algorithms so that the image appears tilted toward the user's viewing angle in addition to the tilt created by aerial imaging technology. The additional image distortion can be performed, for example, by means of trapezoidal distortion by an internal or external evaluation unit configured to transform the display image.

[0018] In a further advantageous embodiment, different images can be made available to a first user and a second user simultaneously via one and the same user interface. To achieve this, a second display unit can be provided. Alternatively or additionally, the display unit can be expanded, for example, to include a second display, which is also arranged below the first side of the control element and positioned next to the first display. The second display has a different beam angle within the user interface relative to the control element surface. Due to the relatively strong viewing angle dependence of aerial imaging technology, it is thus possible to provide two users who are at different viewing positions with independent images simultaneously via the same user interface.The orientation of the second display depends on the viewing angle of the second user.

[0019] An advantageous further development provides for the above-described optical sensor in the form of a camera for detecting the user's line of sight and, in addition, for detecting the user's hand positions. The image data from the optical sensor can be processed in the evaluation unit using image recognition algorithms as described above, enabling the recognition of hand positions and hand movements. Provided appropriate wide-angle optics are available, this also enables the detection of multiple users, for example a driver and a passenger in a means of transport. The image processing algorithms of the evaluation unit can be designed such that they can distinguish between operation of the user interface by the driver and operation by the passenger as soon as a signal is registered by the user interface's actuation sensor.In combination with the independent display of images for the driver and passenger described above, the user interface can be configured with different images associated with different functions. By recognizing the user of the user interface, the different displayed functions can be clearly assigned and executed at the moment of operation. This allows for dual assignment of user interfaces for different users, thus reducing the number of required user interfaces.

[0020] An advantageous development provides for the integration of the user interface according to the invention into a roof control module for a means of transportation. Typically, a roof control module can include user interfaces for controlling the interior lighting, the automatic sunroof, the SOS emergency call, and other functions. The arrangement of the roof control module above the user is generally associated with a flat viewing angle of the roof control module, which can make conventional control element labels on the user interfaces located there difficult to read. In contrast, the user interface according to the invention allows for an optimal alignment of the image in the room, adapted to the user's viewing angle.

[0021] Furthermore, the user interface according to the invention in a roof control module can advantageously be expanded by one or more control elements, so that several control elements arranged next to one another can be supplied with images positioned in the room by a single display unit. In other words, this means that, for example, when using an LCD display in the display unit, several control elements can be arranged above a single LCD display and, due to their design, each only makes a specific section of the overall display available to the user. Because each control element does not have to be provided with its own display, the manufacturing costs for the user interfaces can be reduced. In addition, this design allows the cabling effort to be kept to a minimum, since numerous displays do not have to be controlled individually.A further advantage is the simplified alignment of the control element labels, since multiple display units do not have to be aligned separately within the roof control module during manufacture or installation, but only the surface of one display unit is aligned.

[0022] In a further embodiment, the features, feature combinations, and advantages described above can also be implemented in a door control module for a means of transportation. Typically, a door control module comprises user interfaces for seat adjustment, side mirror adjustment, window lift control, and other functions. Since the door control module in a means of transportation is generally located to the side of the user, similar problems arise with regard to the legibility of the control element labels as with the previously described roof control module. For this reason, the user interface according to the invention is intended for use in the door control module, analogous to the configurations of the roof control module.

[0023] An advantageous development of the present invention relates to a means of transport comprising the user interface according to the invention, alternatively or additionally comprising the door control module for a means of transport, alternatively or additionally comprising the roof control module for a means of transport and alternatively or additionally comprising an optical sensor which is configured to detect the viewing angle of the user and / or the actuation of the control element by the user.

[0024] Further details, features, and advantages of the invention will become apparent from the following description and the figures. They show: Fig. 1 a cross-section of a user interface designed as a push button, which is configured to display an image based on aerial imaging technology using a display in the room; Fig. 2 a schematic overview of a user interface, which can display different operating displays or functions from different viewing angles; and Fig. 3 a schematic overview of the components of a means of transport according to the invention.

[0025] Fig. 1 shows a cross-section of a user interface 10 according to the invention, which is configured to display a spatial image 35 based on aerial imaging technology using a display 31. The illustrated user interface 10 comprises an operating element 20, a capacitive sensor 22 arranged below the operating element 20, a display unit 30 arranged below the capacitive sensor 22, an actuation sensor 40, and an evaluation unit 50. The display unit 30 in turn comprises an LCD display 31 and an aerial imaging plate 32. By arranging the display 31 at an angle relative to the user interface 20, the image 35 of the display 31 can be displayed in space such that the user's line of sight 12 is aligned as perpendicular as possible to the spatial image 35. This enables optimal readability of symbols and text displayed by the image 35.

[0026] Furthermore, the operating element 20, the capacitive sensor 22, and the display unit 30 are firmly connected to one another and, as a whole, are arranged so as to be movable within the user interface 10. The movable arrangement of the above-described components of the user interface 10 allows, when operated by the user, a displacement of the components from a first position to a second position. Upon reaching the second position, the actuation sensor 40 arranged below the display unit 30 triggers an electrical contact. The contact closure can thus be detected by the evaluation unit connected to the actuation sensor. By means of a mechanical reset 41, the displacement of the above-described components from a first to a second position is reversed after actuation of the operating element, so that the components are returned from the second position to the first position.

[0027] Alternatively or in addition to mechanical operation, the operating element 20 can be actuated by touch or proximity using the capacitive sensor 22. This operating process can in turn be processed by the evaluation unit 50 connected to the capacitive sensor 22.

[0028] Fig. Figure 2 shows a schematic overview of the user interface 10, which is arranged, for example, in a roof area of ​​a vehicle that is clearly visible to a driver and a passenger. The user interface is configured to generate different spatial images 35, 36 for the driver and the passenger depending on their respective viewing position. For this purpose, the user interface 10 comprises, for example, two independent display units that are arranged at a predefined angle to each other. The predefined angle is based on the respective viewing position of the driver and the passenger and their viewing angle of the user interface 10. The optical surfaces used in aerial imaging technology to generate spatial images 35, 36 generally havea strong angle dependence, which enables a targeted separation of the images 35, 36 of the two display units for the driver and the front passenger.

[0029] Fig.3 shows a schematic overview of the components of a means of transport 90 according to the invention, which comprises a roof control module 70 and a door control module 80. Furthermore, the means of transport 90 comprises an optical sensor 100, which is configured to detect the user's viewing angle 12 of the roof control module 70 and / or the door control module 80. By determining the viewing angle 12 from the signals of the optical sensor 100, the brightness of the images of the user interfaces 10 of the roof control module 70 and / or the door control module 80 can be adjusted according to the user's needs. For example, the display units can be operated at a brightness level of 50% in standard operation (the user's gaze is not directed at one of the control modules 70, 80) and at a brightness level of 100% during use (the user's gaze is directed directly at one of the control modules 70, 80).Furthermore, the means of transport 90 comprises a proximity sensor 45, which is arranged in the immediate vicinity of the roof control module 70. In a preferred embodiment, the proximity sensor 45 is integrated into the roof control module. The signals from the proximity sensor 45 can be used to determine whether the user is approaching the roof control module 70. If, for example, a user's hand is in the vicinity of the roof control module 70, the floating or stationary image displayed by the display unit can be switched off to ensure the user an optimal view of the user interface of the user interface 10 for an operating process. List of reference symbols: 10 User interface 12 perspectives 20 Control element 22 Capacitive sensor 30 display unit 31 Display 32 Aerial Imaging Plate 34 images 35 picture standing in the room 36 picture standing in the room 40 Actuation sensor 41 Mechanical reset 45 Proximity sensor 50 evaluation unit 70 roof control module 80 door control module 90 means of transport 100 Optical Sensor

Claims

[1] User interface (10) comprising - a control element (20), - a display unit (30) and - an actuation sensor (40), wherein - the operating element (20) comprises a translucent material, - the display unit (30) is arranged on a first side of the operating element (20) and is configured to position an image (34) by means of aerial imaging technology on a second side of the operating element (20) opposite the first side as a floating image (35) in space, and - the actuation sensor (40) is arranged to generate a control signal in response to an actuation of the operating element (20), - wherein the operating element (20) is movably arranged and configured to be moved from a first position to a second position by a user interaction in order to trigger the actuation sensor (40) in response thereto. [2] User interface (10) according to claim 1, wherein the user interface (10) comprises a mechanical reset (41) which is configured to automatically move the operating element (20) from the second position to the first position after an actuation. [3] User interface (10) according to claim 2, wherein the operating element (20) is fixedly connected to the display unit (30) and, in the event of an actuation, is moved together with the display unit (30) from the first position to the second position, or wherein the operating element (20) is arranged to be movable relative to the display unit (30). [4] User interface (10) according to one of the preceding claims, further comprising a capacitive sensor (22) which is configured to detect an actuation of the operating element (20) by a user. [5] User interface (10) according to one of the preceding claims, wherein the display unit (30) is configured to generate an image (34) by means of a display (31) and to place this image in a floating manner in space. [6] User interface (10) according to one of the preceding claims, wherein the display unit (30) is configured to generate a predefined image (34) by means of a light source and a mask and to place this as a floating image (35) in space. [7] User interface (10) according to one of the preceding claims further comprising - a proximity sensor (45) and - an evaluation unit (50), wherein - the proximity sensor (45) is configured to detect and signal a movement of the user in the environment of the user interface (10), and - the evaluation unit (50) is configured to process the signals of the proximity sensor (45) and to effect an optical change in the image (35) in the room in response to a predefined proximity threshold being undershot. [8] User interface (10) according to one of the preceding claims, which is arranged to adapt the image (35) in the room based on information about the viewing angle (12) of the user. [9] User interface (10) according to one of the preceding claims, which is arranged to provide users at different viewing positions with independent spatial images (35, 36). [10] User interface (10) according to claim 9, which is arranged to perform different actions in response to operation by different users. [11] Roof control module (70) or door control module (80) for a means of transport, comprising a user interface (10) according to one of the preceding claims, which in particular comprises a second control element. [12] Means of transport (90), comprising - a user interface (10) according to one of claims 1-10, and / or - a roof control module (70) and / or door control module (80) according to claim 11. [13] Means of transport (90) according to claim 12, further comprising an optical sensor (100) which is configured to detect the viewing angle (12) of the user and / or the actuation of the operating element (20) by the user.

Images