Display device and display method

Abstract

The invention relates to a display device comprising a display unit that is at least designed to display one or more buttons, a transparent and touch-sensitive layer arranged on the display unit and designed to detect actuations of the display device and their positions, at least one detection unit designed to detect the buttons of the display unit and actuations of the display device and their positions, and a computer unit which is designed to check whether the buttons of the display unit detected by the at least one detection unit correspond to the buttons to be displayed by the display unit and / or whether the actuations and / or positions detected by the layer and the at least one detection unit correspond with one another and with the displayed buttons. The invention also relates to a display method and a computer program product.

Description

[0001] DISPLAY DEVICE AND METHOD FOR DISPLAYING

[0002] The invention relates to a display device and a display method therefor.

[0003] In the state of the art, display devices are already often implemented by touch screens, in which a touch-sensitive layer detects the touch of a screen by a finger, another body part, or even by a separate input device.

[0004] When operating machines and equipment, safety is desired or even required in various applications in order to avert danger to people, i.e. to rule out injury. To ensure the safe operation of machines and equipment, unintentional contact must be prevented from triggering unwanted actions or processes. For safety reasons, it is also essential that the actual intention of an operator is implemented correctly. To do this, it must be ensured that the person knows which function is associated with pressing a button. If displayed control elements have different functions depending on the situation, or if the displayed control elements and the functions performed by them do not match due to a defective display, this can pose a danger.

[0005] Touch user interfaces are particularly well-suited to variable displays, meaning that different control elements with different functions can be displayed at the same location in the input area depending on the operating state. Therefore, for safety reasons, it is necessary to detect malfunctions in the hardware and software components required for the display and to verify their functionality. An error that occurs must either be technically detectable or recognizable to the operator before a hazard occurs. In some applications, it is also desirable that certain actions can only be initiated by authorized persons.

[0006] A safe method for operating an industrial robot is shown in EP 2 834 050. Using a graphical user interface with a touch display, a virtual control element representing a function or operating mode of the industrial robot is displayed on the touch display. After selecting the control element, another control element is displayed on the touch display at a constantly changing position, and the function or operating mode is only activated after this additional control element is actuated. A function is therefore only executed after the additional actuation of a separately displayed control element at a specific, but constantly changing, position.

[0007] The disadvantage here is that a two-stage process is used, i.e. first actuating the desired functional elements and then confirming by actuating a second, specially displayed and constantly changing button. With conventional touch-screen systems, a lack of security is unacceptable in the context of industrial machine operation if, for example, an accidental touch cannot be distinguished from an intentional touch and an operator cannot correctly recognize what an intended operating procedure will cause. This is particularly a problem with functional elements that change over time or depending on the operating state. In addition, it must be verifiable that the information displayed for the functions is also displayed correctly.For example, a defective display controller could cause the display to freeze and signal a specific previously assigned function for an actuating element, even though the evaluation of the input sensor for the display position superimposed on the display leads to the triggering of an already newly assigned control command.

[0008] The object of the present invention is to overcome the disadvantages of the prior art and, among other things, to improve the safety of operating machines and devices using touch screens.

[0009] A display device, a method for displaying, a use of the display device and a computer program product are provided.

[0010] The object of the invention is achieved by the subject matter of the independent claims. Advantageous further developments are found in the dependent claims.

[0011] In the following, the embodiments of the invention are set out, whereby it is pointed out that the embodiments can generally relate to both the device and the alternative forms of implementation (method, use, computer program product, etc.).

[0012] In a first aspect, according to a first embodiment, a display device is provided, comprising a display device, a transparent and touch-sensitive layer, at least one sensing device and a computing device.

[0013] The display device is configured to display at least one or more buttons. The transparent and touch-sensitive layer arranged on the display device is configured to detect actuations of the display device and their positions. The at least one detection device is configured to detect the buttons of the display device and actuations of the display device and their positions. The computing device is configured to check whether the buttons of the display device detected by the at least one detection device correspond to the buttons to be displayed by the display device, and / or whether the actuations and / or positions detected by the layer and the at least one detection device correspond to one another and to the displayed buttons.

[0014] According to a further aspect of the invention, a method for displaying is provided. The method for displaying on a display device comprises a

[0015] Displaying one or more buttons by a display device. Then, actuations on the display device and their positions are detected by a transparent, touch-sensitive layer arranged on the display device, and both the buttons of the display device and the actuations of the display device and their positions are detected by at least one detection device. Finally, a computing device checks whether the buttons of the display device detected by the at least one detection device correspond to the buttons to be displayed by the display device, and / or whether the actuations detected by the touch-sensitive layer and the at least one detection device correspond to one another and to the buttons.

[0016] The advantage here is that a two-fold plausibility check, i.e., verification, can take place. Firstly, it is checked whether the detected buttons actually match the buttons to be displayed, thus ensuring that an operator is correctly informed about the function currently associated with an actuation. Secondly, it is checked whether the actuations and positions detected by two channels (the touch-sensitive layer and the detection device) match, thus preventing unwanted triggering due to static discharge, contamination, or condensation on the surface, particularly since the layer and the detection device use different technologies to detect an actuation, which is also referred to as diversity, and thus a single error influence does not affect both systems simultaneously and in the same way.

[0017] This enables the display device or its computing device to determine whether the display is correct and, in the event of an error being detected, to prevent the triggering of an incorrect function and to avoid false triggering.

[0018] The following embodiments may relate to any of the aforementioned aspects of the invention.

[0019] In a further embodiment, the computing device can send information or control signals depending on the result of the check.

[0020] This allows for a safe operation of the machine or device being operated. In particular, a potentially hazardous function can only be triggered if the button display actually corresponds to the control-related function. An operator can be notified of a device error in the display device and the faulty display device can be deactivated. The control signals can also be control commands.

[0021] In further embodiments, the display device can be configured as a film, such as a liquid crystal display or light-emitting diode film. The transparent and touch-sensitive layer can also be configured as a film, such as a touchscreen film. The detection devices can be, for example, a camera or a light field film. The advantages of these individual embodiments are described in more detail below.

[0022] In a further embodiment, one of the at least one detection device is a fingerprint sensor, which is arranged either directly below the display device, between the touch-sensitive layer and the display device, or above the touch-sensitive layer. It is configured to detect fingerprints.

[0023] By capturing fingerprints, for example, it is possible to ensure that the device is operated by hands, thus preventing it from being triggered by elbows or other body parts.

[0024] In a further embodiment, the computing device is further configured to check whether the fingerprints detected by the fingerprint sensor match fingerprints stored in a data memory, whereby the authorization of an operating person can be checked.

[0025] By comparing fingerprints with stored data, biometrics can be used to restrict access to the control system or display. The access restriction can affect the control system as a whole, i.e., activating the control console, or the individual actuation of a functional element. The verification is advantageously performed for each individual operating action, so that, for example, two people can very well perform alternating operations on the display device in a timely manner, although only one of them can trigger potentially dangerous functions, and these functions are prevented for the other person.

[0026] In a further embodiment, the at least one detection device and the touch-sensitive layer are further configured to detect gestures upon actuation, and the computing device is further configured to check whether the gestures detected by the touch-sensitive layer and the at least one detection device match each other and match gestures stored in a data memory. This advantageously expands the operating options, and the buttons can be actuated in more than one way to trigger different functions or actions.

[0027] In a further embodiment, the display device comprises two or more display parts, each display part being configured to display a part of each button. In a first implementation, the display parts are arranged one above the other, and at least one display part is semi-transparent. The buttons are created by superimposing the partial displays. The partial displays can be offset spatially or temporally. In a second implementation, the display parts are arranged side by side, and each button extends to each display part.

[0028] By displaying two or more partial displays, an operator can clearly see, because the representations of the partial displays do not correspond, that one of the partial displays has failed, i.e. that at least one of the display components is defective and use of the terminal is therefore no longer permitted due to a potential hazard. The safety of a system, for example, can only be guaranteed if it is certain that the display is correct. This is the only way the user can be sure what the operation of pressing a button will do. By dividing a button into two or more superimposed display components, and with the appropriate selection of the representation, the user can see that at least one of the displays is defective if the representations do not correspond and therefore use of the system is no longer permitted due to a potential hazard.Technically, this is a two-circuit signaling system that reaches the user’s eye.

[0029] In a further embodiment, the buttons or their surrounding areas are displayed with one or more of the following properties:

[0030] Changing the display location after a predetermined time, exhibiting a continuous movement across the display device, visible flashing, flashing such that the flashing is not visible but can be detected by the detection device, exhibiting a dynamic change in brightness and / or color, and / or

[0031] Exhibiting patterns of dynamic brightness and / or color change. These display properties allow an operator to detect that the display is operating outside of normal operating parameters and that a fault may be present, making operation unsafe and therefore prohibited. However, these properties can also provide additional information and enable or facilitate additional functions.

[0032] In a further embodiment, the computing device is configured to perform the checks as described above for two or more buttons simultaneously.

[0033] This allows the display device to provide multiple buttons for different potentially hazardous functions simultaneously and without pre-selection for a user, for example, for two directions of movement of a machine axis or even for multiple machine axes. Simultaneous verification of multiple buttons is also advantageous for two-handed operation, where operation by both hands of a person is required to increase safety.

[0034] In a further embodiment, the computing device is further configured to only take into account an actuation of a button detected by the at least one detecting device when a predefined period of time has elapsed between the start of the display of the button and its actuation.

[0035] This can prevent accidental activation such that the display changes shortly before the display is touched, and then a button is pressed that has just appeared. This applies both to the dynamic options for changing the display as described above, but also to the options for displaying new buttons in previously empty areas.

[0036] In a further embodiment, the display device displays the buttons differently during the predefined time period than after the expiration of the predefined time period.

[0037] It is advantageous that an operator can see when a button can be used, thus preventing invalid actuations or unexpectedly delayed function executions. A second aspect of the invention relates to the use of a previously described display device as a fail-safe display means in control systems of potentially hazardous technical systems, such as industrial plants, machines, or motor vehicles.

[0038] According to a further aspect of the invention, a computer program product is described which can be loaded directly into a memory of a programmable control device of a display device, with program code means for carrying out all steps of a method described herein when the program product is executed on the control device.

[0039] The embodiments show possible variants. The invention is not limited to the specifically illustrated variants; rather, combinations of the individual variants are also possible. In particular, the features of the device can also be implemented in a method, and vice versa.

[0040] For a better understanding of the invention, it is explained in more detail with reference to the following figures. They show, in highly simplified, schematic representations:

[0041] Fig. 1 shows a display device according to exemplary embodiments,

[0042] Fig. 2 an embodiment with partial displays, and

[0043] Fig. 3 is a schematic flow diagram according to exemplary embodiments.

[0044] By way of introduction, it should be noted that in the variously described embodiments, identical parts are provided with identical reference numerals or identical component designations, whereby the disclosures contained in the entire description can be transferred mutatis mutandis to identical parts with identical reference numerals or identical component designations. The position information chosen in the description, such as top, bottom, side, etc., also relates to the directly described and illustrated figure, and these position information are to be transferred mutatis mutandis to the new position in the event of a position change. Fig. 1 shows an exemplary structure of a display device 1 in a schematic representation. This comprises a display device 2, a transparent and touch-sensitive layer 4, a detection device 5 and a computing device 6. The display device 2 shows in Fig.1 shows three buttons 3 as an example, however, more or fewer buttons 3 can also be displayed. The buttons 3 are also drawn on the transparent and touch-sensitive layer 4 and the detection device 5, as they shine through upwards.

[0045] It should be noted that Fig. 1 only schematically shows an embodiment.

[0046] The display device 2 displays at least one or more buttons 3.

[0047] The transparent and touch-sensitive layer 4, which is arranged on the display device 2, detects operations of the display device 1 and their positions.

[0048] The at least one detection device 5 optically detects the buttons 3 of the display device 1 as well as actuations of the display device 1 and their positions. The detection device 5 detects at least characteristic features of the display of the buttons 3. The detection device 5 can also cover only a part of the display device 1, for example, in the case of an optical fingerprint sensor 7 or in the case of a detection device that detects only one button 3. Position detection can be achieved by knowing the position of the detection device 5 and using it accordingly.

[0049] The computing device 6 checks whether the buttons 3 of the display device 2 detected by the at least one detection device 5 correspond to the buttons 3 to be displayed by the display device 2.

[0050] Alternatively or additionally, the computing device 6 checks whether the actuations and / or positions detected by the touch-sensitive layer 4 and the at least one detection device 5 correspond to one another and to the displayed buttons 3. The display device 2 can, for example, be in the form of a film. This can be a liquid crystal display or light-emitting diode film. However, it is also conceivable for the display device 2 to be another type of display, such as a monitor, an OLED or LCD display, or the like. The display device 2 displays buttons 3. As a button 3, the respective display is linked in terms of control technology to an action or function, so that, for example, when a device is controlled by the display device 1, pressing a button 3 is intended to start an action for the device.As described later, several functions or actions can be alternately assigned to a button 3, which can be context-dependent on the one hand, i.e. depending on the operating and control situation, different actions can be triggered by a button 3, and on the other hand, several linked actions can be assigned at the same time and then triggered simultaneously with one actuation.

[0051] The display device 2 is at least configured to display buttons 3, i.e., in addition to buttons 3, i.e., the interactive elements of the display, further elements can also be displayed. These can comprise a photo or video signal which, for example, depicts processes inside the device to be controlled. Measured values ​​which, for example, depict the device to be controlled or environmental conditions such as temperature and humidity can also be displayed. Further, non-safe buttons can also be provided which are used for non-critical functions such as switching the display, changing parameters or the like. Information relating to communication can also be displayed, such as an incoming call, or a text message addressed to the operator, such as an email or other text message.

[0052] The transparent and touch-sensitive layer 4 can also be designed in the form of a film. It is arranged on the display device 2 and must therefore be translucent. It can be designed, for example, as a capacitive or resistive touchscreen film.

[0053] The transparent and touch-sensitive layer 4, which is arranged on the display device 2, detects actuations of the display device 1 and their positions. This means that the layer 4 can detect that the display device 1 is being actuated and also at which position on the display device 1 this actuation occurs.

[0054] An alternative embodiment may provide for the display device 2 and the layer 4 to be implemented as an integrated component. This would then be, for example, a film that can display a button and simultaneously detect actuations and positions, which is commonly known and widely used as a touchscreen.

[0055] The sensing devices 5 can be implemented in various ways. One example is a light field film, which can be arranged on or below the transparent and touch-sensitive layer 4. In Fig. 1, it is arranged on the transparent and touch-sensitive layer 4 and must therefore also be transparent or translucent. Even if it is arranged below the transparent and touch-sensitive layer 4, but on the display device 2, it must be transparent or translucent. A sensing device 5 in the form of a film or fingerprint camera could also be arranged below the display device 2; in this case, the need for the sensing device 5 to be transparent or translucent could be eliminated.

[0056] The detection devices 5 can also be implemented as other optical systems, e.g., a camera, and record the display device 2 and the layer 4. The camera or cameras can record the display device 2 and the layer 4 from different positions, for example, from below, or from above, where the user can also be additionally recorded.

[0057] A detection device 5 detects the buttons 3 of the display device 1 and detects actuations of the display device 1 and their positions. This means that, just like layer 4, a detection device 5 can determine that the display device 1 is actuated and also at which position of the display device 1 this actuation occurs. Furthermore, a detection device 5 can also detect the buttons 3 displayed by the display device 2 and their positions.

[0058] In the display device 1, one or more of the detection devices 5 can be configured as a fingerprint sensor 7. Depending on the design, these can be arranged directly below the display device 2, between the layer 4 and the display device 2, or above the layer 4. A fingerprint sensor 7 is configured to detect fingerprints.

[0059] Fig. 1 shows an exemplary fingerprint sensor 7, wherein the position shown in Fig. 1 represents an arrangement on the detection device.

[0060] For example, two fingerprint sensors 7 that are positioned sufficiently far apart can be used to require security-relevant two-handed operation. For example, the function requiring two-handed operation can be stored as an action behind one of the two fingerprint sensors 7, but can only be triggered if the second fingerprint sensor 7 also successfully reads a fingerprint.

[0061] A fingerprint read by a fingerprint sensor 7 can also be compared with fingerprints stored in a data storage device 8 to implement a restriction for certain functions. This would allow, for example, only an authorized person to shut down or turn off a machine or restart it after a fault. For safety-critical operating actions, it can thus be ensured that only a restricted group of people can perform a specific action, for example, particularly reliable, specially trained, or specially tested individuals whose fingerprints have been technically registered beforehand. Such operating actions are prevented for other persons, even if they are in the vicinity of an operating terminal at the same time as authorized persons.

[0062] In the display device 1, several detection devices 5 can also be used, which can also include different types, e.g. a field of view film, three cameras and two fingerprint sensors 7.

[0063] Such fingerprint sensors 7 can, for example, be implemented as low-resolution cameras integrated into the display. Similar sensors are also used in mobile phones. One or more of the detection devices 5 and / or the layer 4 can also be capable of detecting gestures during operation.

[0064] Computing device 6 can then, on the one hand, check whether the detected gestures match each other, which increases security, and, on the other hand, check whether the detected gestures match gestures stored in a data memory 8. In the latter case, a function linked to the gesture, which may differ from the regular function of button 3, can then be triggered. For example, a button 3 may not normally trigger any function in order to be particularly protected against unintentional actuation; however, actuation with a circular or pulling gesture triggers button 3 and leads, for example, to unlocking the other buttons 3. Alternatively, other functions can also be assigned to the simple actuation and the gesture actuations; for example, a movement of a machine axis can be caused in one or the opposite direction depending on the direction of movement of the finger.The advantage here is that a single detection device 5, for example a fingerprint sensor 7, can make several functions available at a single location, for example by swiping movements, using a button 3.

[0065] The computing device 6 can be responsible for transmitting the buttons 3 to be displayed and other information to the display device 2. However, this can also be handled by another computing device. The computing device 6 can send information or control signals depending on the result of the check. This can directly or indirectly affect the display on the display device 2. The sent information or control signals can, for example, inform the device to be controlled by the display device 1 of the activated functions and actions, thereby controlling the device. The control signals can also be control commands.

[0066] Fig. 2 shows that the display device 2 can consist of two or more display parts 2a, 2b. Fig. 2 shows an embodiment in which the display device 2 consists of two display parts 2a, 2b. Each of the display parts 2a, 2b displays a part of a button 3. The display parts 2a, 2b are shown arranged one above the other in Fig. 2. At least one display part 2a, or more precisely at least all but one, namely the bottom one, is semi-transparent, translucent or transparent, which is indicated in Fig. 2 by hatching the plane shown above. The buttons 3 are created by superimposing the partial displays on the display parts 2a, 2b. Should one of the display parts 2a, 2b fail, an operator can recognize this without a doubt and potentially dangerous use can be avoided.

[0067] The display variant described above describes the spatially offset display of the partial displays.

[0068] The partial displays can also be staggered, so that the display sections alternate. If one of the display sections fails, the display will be interrupted, indicating a potentially dangerous situation, allowing the operator to avoid activating the display.

[0069] As an alternative to the previously described variant in which the display parts are arranged one below the other, a variant is also possible in which the display parts 2a, 2b are arranged side by side, and each button 3 extends to each display part 2a, 2b. This can be achieved, for example, by implementing a pixel grid with various control units.

[0070] The display of buttons 3 can be further improved in several ways.

[0071] Here, the surrounding areas are the areas displayed in the immediate vicinity of a button. These can display content that can be assigned to button 3 or its function or action, or they can provide information about alternative functions or actions that can be performed, for example, using gestures or alternative actuation methods via button 3, such as double or multiple presses, press and hold, press harder, press with an input device such as a stylus or glove, etc.

[0072] One or more buttons 3 can change their display location after a predetermined time. This can prevent damage to the display device 2, e.g., excessive wear at that location. It can also counteract a trained behavior pattern of an operator, since the buttons 3 can be located in new positions, requiring the user to actively search for and consciously press the currently desired button 3.

[0073] One or more buttons 3 can exhibit continuous movement across the display device 2. This requires an operator to pay full attention to the display device, ensuring that they cannot miss current information or warnings. Above all, however, an operator can detect a frozen and thus invalid screen display due to a technical defect.

[0074] One or more buttons 3 or surrounding areas can flash visibly, whereby the flashing indicates that the display is functioning correctly. If the display does not flash at all, this would mean that there is a fault in the display unit. Alternatively, additional information can be output via the flashing. This can happen via the fact that a button flashes, but also via a predetermined rhythm or pattern, a predetermined frequency or speed, whereby the pattern and speed can also change. A pattern can, for example, indicate a status such as "Ready", "Busy", "Error", and a speed can, for example, indicate the time that is still available for a function, i.e. the faster a button 3 flashes, the shorter the time it is still available.

[0075] The flashing can also be configured so that it is not visible but can be detected by the detection device 5. An example of this is a very high-frequency flashing, or a long display phase combined with a short fade-out phase. This type of flashing could be configured so that an operator would not notice it, but an appropriately configured camera would be able to detect the flashing. The actively controlled flashing can signal the detection device 5 that the display control is still active and there is no system error, i.e., a failure of the display control.

[0076] The buttons 3 or the surrounding areas can also exhibit dynamic brightness and / or color changes, each with or without a pattern. These can be displayed to the operator, or, as previously described, in such a way that only a correspondingly configured detection device 5, but not the operator, can detect them.

[0077] By changing the brightness or colors, error-free functioning or additional information, as described above, can also be displayed.

[0078] The computing device 6 can also perform the previously described checks for two or more buttons 3 simultaneously. This is particularly helpful if the display device is used for multiple control panels that are to be operated by multiple people. Simultaneous checking for multiple buttons 3 is also advantageous for two-handed operation, where operation by both hands of one person is required to increase safety.

[0079] In order to check whether the actuations detected by layer 4 and the detection devices 5 correspond to one another, the computing device 6 can only take into account a detected actuation of a button 3 if a predefined period of time has elapsed between the start of the display of the button 3 and its actuation.

[0080] This prevents accidental activation such that the display changes shortly before touching the display device 1, and then a button 3 that has just appeared is pressed. This applies both to the dynamic options for changing the display as described above, but also to the options for displaying new buttons 3 in previously empty areas.

[0081] The display device 2 can display the buttons 3 differently during this time period, i.e., as long as the button 3 is not yet considered active, than after the time period has elapsed, i.e., when the button 3 is active. This can be achieved using the previously mentioned options, such as flashing, color, brightness, etc.

[0082] It is advantageous that an operator can see from when a button 3 can be used, while at the same time its assigned function is already recognizable in advance, thus preventing invalid actuations. Fig. 3 shows a schematic flowchart based on which the method 100 will now be described. Optional features are shown in dashed lines. It should be pointed out again that the features of the device already described are generally also applicable to the method, which is why a repeated description of all details related to the method is omitted.

[0083] First, in step 110, at least one or more buttons 3 are displayed by a display device 2. Then, in step 120, operations of the display device 1 and their positions are recorded by a transparent and touch-sensitive layer 4 arranged on the display device 2.

[0084] At the same time, but also before or after step 120, in step 130 at least one detection device 5 detects the buttons 3 of the display device 2 and actuations of the display device 1, as well as their positions.

[0085] When capturing the buttons in step 130, the representation of the buttons 3 or also certain characteristics, such as a frequency, of the representation can be captured.

[0086] In step 140, a computing device 6 checks whether the buttons 3 of the display device 2 detected by the at least one detection device 5 correspond to the buttons 3 to be displayed by the display device 2.

[0087] This determines whether the display device 2 is functioning correctly. Furthermore, in step 140, the computing device 6 checks whether the actuations detected by layer 4 and the at least one detection device 5 match each other and with the buttons 3. This allows an actuation to be verified via two channels, namely layer 4 and the detection devices 5. If the actuation data from layer 4 and the detection devices 5 match spatially and temporally, the actuation of button 3 is detected more reliably than via only one channel.

[0088] Optionally, in step 150, the computing device 6 can send information or control signals depending on the result of the check 140. These can, for example, be used to control a device, but can also contain the result of the check 140 and thus trigger an error message.

[0089] One of the detection devices can be, in particular, an optical fingerprint sensor 7, or comprise such a sensor. In this case, step 130 can comprise a sub-step 131 in which fingerprints are detected. Alternatively, for example, if there are multiple detection devices 5, one of the detection devices 5, which is a fingerprint sensor 7, can have fingerprint detection as the sole content of step

[0090] 130 carry out.

[0091] If fingerprints were captured in step 130, step 140 of the computing device 6 can include a check 141 to determine whether the captured fingerprints match fingerprints stored in a data storage device 8. For security-critical operating actions, it can thus be ensured that only a restricted group of persons can perform a specific action, for example, particularly reliable, specially trained, or specially tested persons whose fingerprints have previously been technically registered. For other persons, such operating actions are prevented, even if they are in the vicinity of an operating terminal at the same time as authorized persons and cannot perform non-security-critical operating actions on the operating terminal.

[0092] Biometrics can therefore be used to restrict access in general or to restrict access to individual operations.

[0093] In addition, as an optional feature, both the layer 4 and the detection devices 5 in step 120 or 130 can detect gestures during actuation in a sub-step 121 or

[0094] 131. The computing device 6 can then again check, as part of step 140 as sub-step 141, whether the detected gestures match each other and match gestures stored in a data memory 8.

[0095] The display of the buttons in step 110 can be carried out by two or more display parts 2a, 2b of the display device 2 such that each display part 2a, 2b displays a part of each button 3 such that the buttons 3 are formed by the superimposition of the partial displays, wherein the partial displays can be offset spatially or temporally. Alternatively, the display parts 2a, 2b can display a part of each button 3 such that each button 3 extends to each display part.

[0096] The display 110 of the buttons 3 can be further improved by the following features when displaying the buttons 3 or the surrounding areas:

[0097] Changing the display location after a predetermined time, having a continuous movement across the display device, visible flashing, flashing such that the flashing is not visible but can be detected by the detection device 5, having a dynamic brightness and / or color change, and / or having patterns in a dynamic brightness and / or color change.

[0098] Furthermore, in step 140, the computing device can check two or more buttons 3 simultaneously, whereby this can occur in parallel processes truly simultaneously or directly one after the other.

[0099] The check in step 140 can also be designed such that a press of a button 3 is only considered if a predefined time period has elapsed between the start of the display of button 3 and its press. Button 3 can be displayed differently during the predefined time period than after the expiration of the predefined time period.

[0100] Another aspect is a computer program product comprising instructions which, when executed by a computer, cause the computer to perform one of the methods set out above.

[0101] Another aspect is a computer-readable medium on which the computer program product is stored.

[0102] A further aspect is the use of the described display device 1 as a fail-safe display device in control systems of potentially hazardous technical systems, such as industrial plants, machines, or motor vehicles. The exemplary embodiments show possible embodiments; it should be noted at this point that the invention is not limited to the specifically illustrated embodiments; rather, various combinations of the individual embodiments are also possible.

[0103] The scope of protection is determined by the claims. However, the description and drawings must be used to interpret the claims. Individual features or combinations of features from the various embodiments shown and described may represent independent inventive solutions. The problem underlying these independent inventive solutions can be derived from the description.

[0104] All information on value ranges in this description is to be understood as including any and all sub-ranges thereof, e.g. the information 1 to 10 is to be understood as including all sub-ranges starting from the lower limit of 1 and the upper limit of 10, ie all sub-ranges begin with a lower limit of 1 or greater and end with an upper limit of 10 or less, e.g. 1 to 1.7, or 3.2 to 8.1, or 5.5 to 10.

[0105] For the sake of clarity, it should finally be pointed out that, in order to better understand the structure, some elements have been shown out of scale and / or enlarged and / or reduced in size.

[0106] Reference symbol list

[0107] Display device

[0108] Display device a, 2b Display parts

[0109] Buttons transparent and touch-sensitive layer

[0110] Recording device

[0111] computing device

[0112] Fingerprint sensor

[0113] Data storage 00 Display methods 10 Displaying buttons 20 Detecting operations and positions 21 Detecting gestures 30 Detecting buttons and positions 31 Detecting gestures 32 Detecting fingerprints 40 Checking correctness and consistency of positions 41 Checking gestures 50 Sending information or control signals

Claims

Patent claims 1. Display device (1), comprising a display device (2) which is at least configured to display one or more buttons (3), a transparent and touch-sensitive layer (4) which is arranged on the display device (2) and which is configured to detect actuations of the display device (1) and their positions, at least one detection device (5) which is configured to detect the buttons (3) of the display device (1) and actuations of the display device (1) and their positions, and a computing device (6) which is designed to check whether the buttons detected by the at least one detection device (5) (3) of the display device (2) correspond to the buttons (3) to be displayed by the display device (2), and / or whether the operations and / or positions detected by the layer (4) and the at least one detection device (5) correspond to one another and to the displayed buttons (3).

2. Display device (1) according to claim 1, wherein the computing device (6) is further configured to send information or control signals depending on the result of the check.

3. Display device (1) according to claim 1 or 2, wherein the display device (2) is designed in the form of a film, in particular as a liquid crystal display or light-emitting diode film.

4. Display device (1) according to one of claims 1 to 3, wherein the transparent and touch-sensitive layer (4) is designed in the form of a film, in particular as a touch-screen film.

5. Display device (1) according to one of claims 1 to 4, wherein one of the at least one detection device (5) is a camera.

6. Display device (1) according to one of claims 1 to 5, wherein one of the at least one detection device (5) is a light field film.

7. Display device (1) according to one of claims 1 to 6, wherein one of the at least one detection device (5) is a fingerprint sensor (7) which is arranged directly below the display device (2), between the layer (4) and the display device (2) or above the layer (4) and is configured to detect fingerprints.

8. Display device (1) according to claim 7, wherein the computing device (6) is further configured to check whether the fingerprints detected by the fingerprint sensor (7) match fingerprints stored in a data memory (8).

9. Display device (1) according to one of claims 1 to 8, wherein the at least one detection device (5) and the layer (4) are further configured to detect gestures during actuation, and wherein the computing device (6) is further configured to check whether the gestures detected by the layer (4) and the at least one detection device (5) match one another and match gestures stored in a data memory (8).

10. Display device (1) according to one of claims 1 to 9, wherein the display device (2) comprises two or more display parts (2a, 2b), wherein each display part (2a, 2b) is designed to display a part of each button (3), wherein the display parts (2a, 2b) are arranged one above the other, at least one display part (2a) is semi-transparent and the buttons (3) result from the superposition of the partial displays, and wherein the partial displays can be offset spatially or temporally.

11. Display device (1) according to one of claims 1 to 9, wherein the display device (2) comprises two or more display parts (2a, 2b), wherein each display part (2a, 2b) is adapted to display a part of each button (3), wherein the display parts (2a, 2b) are arranged next to one another, and each button (3) extends onto each display part (2a, 2b).

12. Display device (1) according to one of claims 1 to 11, wherein the display device (2) is configured to display buttons (3) such that the buttons (3) or their surrounding surfaces have one or more of the following features: Changing the display location after a predetermined time, Exhibiting a continuous movement across the display device (2), Visible flashing, Flashing in such a way that the flashing is not visible but can be detected by the detection device (5), Having a dynamic brightness and / or color change, and / or having patterns in a dynamic brightness and / or color change.

13. Display device (1) according to one of claims 1 to 12, wherein the computing unit (6) is further configured to perform the checking for two or more buttons (3) simultaneously.

14. Display device (1) according to one of claims 1 to 13, wherein the computing unit (6) is configured to take into account an actuation of a button (3) detected by the at least one detection device (5) only when a predefined time period has elapsed between the start of the display of the button (3) and its actuation.

15. Display device (1) according to claim 14, wherein the display device (2) displays the buttons (3) differently during the predefined time period than after the expiration of the predefined time period.

16. Use of the display device (1) according to one of claims 1 to 15 as a fail-safe display means in control systems of potentially dangerous technical systems, such as industrial plants, machines or motor vehicles.

17. Method (100) for displaying on a display device (1), with Displaying (110) at least one or more buttons (3) by a display device (2), detecting (120) operations of the display device (1) and their positions by means of a transparent and touch-sensitive layer (4) arranged on the display device (2), detecting (130) the buttons (3) of the display device (2) and actuations of the display device (1) and their positions by at least one detecting device (5), and Checking (140), by a computing device (6), whether the buttons detected by the at least one detection device (5) (3) of the display device (2) correspond to the buttons (3) to be displayed by the display device (2), and / or whether the operations detected by the layer (4) and the at least one detection device (5) correspond to one another and to the buttons (3).

18. A method (100) for displaying according to claim 17, further comprising sending (150), by the computing device (6), information or control signals depending on the result of the checking (140).

19. A method (100) for displaying according to claim 17 or 18, wherein detecting (130) the buttons comprises detecting (132) fingerprints by a detecting device (5) which is a fingerprint sensor (7).

20. The method (100) for displaying according to claim 19, wherein the checking (140) comprises checking (141) whether the captured fingerprints match fingerprints stored in a data store (8).

21. Method (100) for display according to one of claims 17 to 20, wherein the detection (120) of actuations and the detection (130) of the buttons comprises a detection (121, 131) of gestures during the actuation, and wherein the checking (140) comprises a check (141) whether the gestures detected by the layer (4) and the at least one detection device (5) match each other and match gestures stored in a data memory (8).

22. Method (100) for displaying according to one of claims 17 to 21, wherein the display (110) is effected by two or more display parts (2a, 2b) of the display device (2), wherein each display part (2a, 2b) displays a part of each button (3) in such a way that the buttons (3) result from the superposition of the partial displays, wherein the partial displays can be offset spatially or temporally.

23. A method (100) for displaying according to any one of claims 17 to 21, wherein the displaying (110) is effected by two or more display parts (2a, 2b) of the display device (2), each display part (2a, 2b) displaying a part of each button (3) such that each button (3) extends to each display part.

24. Method (100) for displaying according to one of claims 17 to 23, wherein the display (110) of the buttons (3) is carried out in such a way that the buttons (3) or their surrounding areas have one or more of the following features: Changing the display location after a predetermined time, Exhibiting a continuous movement across the display device (2), Visible flashing, Flashing in such a way that the flashing is not visible but can be detected by the detection device (5), Having a dynamic brightness and / or color change, and / or having patterns in a dynamic brightness and / or color change.

25. A method (100) for displaying according to any one of claims 17 to 24, wherein a check (140) checks two or more buttons (3) simultaneously.

26. Method (100) for displaying according to one of claims 17 to 25, wherein the checking (140) only takes into account an actuation of a button (3) if a predefined period of time has elapsed between the start of the display of the button (3) and its actuation.

27. The method (100) for displaying according to claim 26, wherein the display (110) displays the buttons (3) differently during the predefined period of time than after the expiration of the predefined period of time.

28. A computer program product which can be loaded directly into a memory of a programmable control device of a display device (1), comprising program code means for executing all steps of a method according to one of claims 17 to 27 when the program product is executed on the control device.

Images