Touch screen input system and method
Patent Information
- Application Number
- PCT/AT2024/060259
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-07-03
- Filing Date
- 2024-07-02
- Publication Date
- 2025-04-10
Smart Images

Figure AT2024060259_10042025_PF_FP_ABST
Abstract
Description
[0001] TOUCH-SCREEN INPUT SYSTEM AND INPUT METHOD
[0002] The invention relates to a touch-screen input system and an input method therefor.
[0003] Touch screen input systems, also called touchscreens, are screens that respond to touch, for example, from fingers or input devices. They are used, for example, in the operation of machines and devices. In various applications, safety is desired or even required to avert danger to people, i.e., to prevent injury. To ensure the safe operation of machines and devices, it is necessary to prevent unintentional touches from triggering unwanted actions or processes.
[0004] The forerunners of modern touchscreens were systems based on pens, which, when placed on a cathode-ray tube, amplified and enhanced the existing signal. This allowed drawings to be displayed on screens. Further developments made it possible to separate teletype pens from their mechanical connections, allowing the user to transfer what they drew on a screen to a computer and save it.
[0005] Later, touchscreens were developed that functioned independently of the screen's light, using a matrix of collimated, i.e., parallel, light beams radiated orthogonally across the touchscreen's surface. If a beam was interrupted by a stylus, photodetectors, which no longer received a signal, could determine the location of the interruption and thus the position of the stylus.
[0006] The next developments were finger-controlled touch screens, which could detect the touch of the touch screen with one finger, and later also so-called multi-touch screens, which could detect several fingers simultaneously.
[0007] With the introduction of multi-touch systems, input pens such as touch pens became increasingly less important. However, the advantages of pen-like operation later led to a resurgence of pens for handwriting, drawing, and even for operating buttons, for example. Many modern high-end devices such as smartphones, tablets, and laptops can also capture inputs made with pens and implement various additional functions.
[0008] In addition, touch screens are used to operate machines, display information, for example in department stores or train stations, carry out transactions, for example at ATMs or ticket machines, or for combined purposes, such as in vehicles for communication, information and control.
[0009] In recent years, an increasing number of hybrid touch systems have been introduced. These systems enable both inputs through a user's fingertip, for example, for pressing buttons or inputs via keyboards graphically displayed on an underlying display, as well as precise, fine inputs using a stylus. These hybrid touch systems feature resistive or capacitive touch sensors for detecting finger touches, as well as conductive loop layers for detecting the position of inductive styluses. With a suitable design, these styluses can be detected both via the conductive loop layer and via the touch sensor. Such hybrid touch systems are used, for example, in high-priced tablet computers.
[0010] When using such hybrid touch systems, the main problem that has arisen so far is that both sensors are activated at the same time and the user does not have to manually preset one of the two input methods, which is the result of unwanted contact of the touch surface with the hand during the actual input using the stylus.
[0011] US 11,221,688 describes an input device with a pen display position detector that detects a pen position indicated by an electronic pen held by a user on an input surface, a touch position detector that detects a touch position touched by the user on the input surface.
[0012] EP 2 631 749 describes a hybrid touchscreen device that is applied to an electrical device and detects an input event through a direct touch. The pen touch panel detects a touch pen input and an input event based on an input to a predetermined detection position before a touch. A touch pen input event and a touch panel input event are detected independently of each other.
[0013] EP 2 674 849 describes a method for controlling a touch input of a terminal. The method includes determining a touch position when a touch input is detected and defining a portion of a touch pad, including the determined touch position, as the effective touch area of the touch pad. The method may further determine whether the touch input is a pen touch input.
[0014] In the field of industrial machine control, conventional touchscreens with capacitive or resistive touch sensors, which do not yet offer the hybrid features described above, have been used for many years. They are used for flexible and intuitive operating concepts in conjunction with graphic diagrams and process displays. Depending on the type of machine or process, certain operating actions or settings can sometimes pose significant potential risks, particularly to human life and health, but also to property. Appropriate measures must therefore be taken to ensure that such operating actions are only carried out consciously, without error, and only by trained and authorized personnel.In addition, it must be ensured that individual technical defects or malfunctions in the control system and the associated operating devices cannot lead to the unintentional activation of such functions and thus endanger persons.
[0015] While certain non-time-critical inputs, such as parameter changes, can be protected against unconscious and unauthorized changes by means of security queries and additional confirmations, this is not practical for functions with a direct temporal connection between activation and execution. This applies, for example, to the movement of machine axes or robots only as long as and to the extent that an authorized user activates an assigned control element (so-called hold-to-run function). This particularly applies to special operating states of machines in which other protective measures such as safety doors or fences are temporarily opened and thus deactivated, e.g. during adjustment, setup, repair, or maintenance work on machines (e.g. on injection molding machines or machine tools).
[0016] To date, only specially safe switching elements and control components, particularly those with two circuits, have been used in industrial environments for the immediate triggering of potentially dangerous functions and movements, whereby the associated machine function is only triggered when both circuits (e.g. two contacts) signal an actuation in unison.
[0017] The authority of operators is checked, for example, by using password queries or key switches.
[0018] The disadvantage of state-of-the-art solutions is the considerable additional space required for such secure operating elements, the associated costs, and the simultaneous lack of flexibility in terms of number, positioning, or function assignment. Furthermore, an operator's authorization can only be verified via additional queries or key switches or similar, but not directly during an operating action. This means that after a positive verification of an operator's access authorization and the activation of certain functionalities, it is entirely possible that another, unauthorized person subsequently performs operating actions while, for example, the previously authorized person temporarily leaves the operating terminal and inspects parts of the system or machine or performs work on it.
[0019] The object of the present invention is to overcome the disadvantages of the prior art and to improve the safety of touch screens, and to create a flexible touch input system for the execution of dangerous or safety-critical machine functions with improved security against external interference, technical defects and unauthorized and unwanted operating actions.
[0020] A touchscreen input system, an input method for a touchscreen input system, and a computer program product are provided. The object of the invention is achieved by the subject matter of the independent claims. Advantageous further developments can be found in the dependent claims.
[0021] This object is achieved in particular by using an input system with at least two independently acting sensor systems, i.e. with hybrid touch features, for essentially simultaneous and independent detection of the position of a touch pen on an input surface, checking the respectively detected position for agreement with the surface of an operating element defined on the input surface by a computing unit and triggering a machine function assigned to the operating element in terms of control technology by the computing unit.
[0022] By using two technologically diverse sensor systems for detecting the actuation and the input position, it is ensured that incorrect actuation or position detection, for example due to a single technical defect, contamination, moisture or electromagnetic interference or even simply unintentional contact with the hand, does not occur through both sensor systems and not in the same way, and by checking the plausibility of the results of both sensors, unintentional triggering of the function is reliably avoided.
[0023] In addition, the triggering of potentially critical machine functions requires the use of a touch pen, whereas non-critical settings or status queries can be made on the same operating terminal, for example, without a touch pen and using only the conventional touch sensor, so that the touch pen and its assignment to an authorized operator already have a certain function as a key in this simple form.
[0024] A further advantage of the mandatory use of the touch pen for safety-critical machine commands is that it is clear to the user which of several displayed buttons they are selecting and thus activating with the tip of the pen. Simply touching such a button with a finger or the ball of the hand can either be ignored or, in some cases, can be used to alert the user to the mandatory use of a touch pen. In this case, the actuation of buttons would be registered, and non-critical functions behind the corresponding buttons would also be executed. Safety-critical functions, however, would not be executed, and the operator would be informed that such a critical function is only permitted with a touch pen, possibly with special authorization.
[0025] Furthermore, when using an unauthorized or authorizing touch pen, a corresponding notice is conceivable, informing the operator that the operator cannot perform the intended function with the input device used.
[0026] An advantageous further development provides that the inductive touch pen modulates a coding that identifies the respective pen and can be detected by the conductor loop layer onto the magnetic field it generates or influences, which makes the touch pen technically distinguishable from other, otherwise identical pens and thus significantly expands the functionality as a key for verifying the authorization of an operator or, in an industrial environment, enables a more selective allocation of authorizations to individual users.
[0027] For some applications, special security during input is desired or required. The present invention can reduce additional switching elements and / or implement additional application possibilities and functions through secure touch input.
[0028] In the following, the embodiments of the invention are set out, whereby it is pointed out that the embodiments can generally relate to both the system and the alternative implementation forms (method, computer program product, etc.).
[0029] In a first aspect, according to a first embodiment, a touch screen input system is provided which has at least one visually perceivable button at at least one position.The touch screen input system comprises an active, inductive input device configured to generate an alternating electromagnetic field, a touch-sensitive layer configured to detect actuations of the touch screen input system by the input device and first position information of the input device, a conductor loop layer configured to detect the alternating electromagnetic field and to determine second position information of the input device by comparing induction signal strengths, and a computing device configured to check whether the first position information, the second position information, and the button position match and, if so, to trigger the button upon an actuation detected by the touch-sensitive layer.
[0030] A match within the meaning of this document does not have to be an exact match, but can be subject to tolerance. This means, for example, that a predeterminable edge area of a button will result in its activation. Positional match is therefore determined even if the compared coordinates or areas differ to a technically determined extent. These include, in particular, deviations that are on the order of magnitude of the detection accuracy, for example, a few millimeters or that are smaller than the gaps between two adjacent buttons.
[0031] The advantage here is that the button is only triggered if the position of the input device has been determined consistently by two systems. This prevents the button from being triggered accidentally, for example, by resting the palm of the hand on the screen or by a body part hitting the touchscreen input device. Furthermore, this allows for triple confirmation, since the two determined positions must match the known position of the button.
[0032] In a further embodiment, each of the at least one button has a fixed position on the touch screen input system.
[0033] The fixed positioning of buttons makes it possible to place safety-relevant functions in places that are less frequently touched, e.g., in the upper touchscreen area.
[0034] In a further embodiment, the input device is further configured to modulate additional input device information onto the alternating electromagnetic field. The computing device is then further configured to determine the additional input device information from the detected alternating electromagnetic field and to trigger the actuation of the button only if the additional input device information meets criteria stored for the button.
[0035] This has the advantage that, for example, input devices can be assigned an authorization, meaning that certain functions can only be performed by authorized input devices.
[0036] In a further embodiment, the input device comprises a pressure detection device configured to detect the pressure with which the input device is pressed against the touchscreen input system, and the additional input device information comprises the detected pressure. Alternatively or additionally, the input device may also comprise a fingerprint reader, and the additional input device information may comprise a read fingerprint. Alternatively or additionally, the input device may have stored identification information, and the additional input device information may comprise the identification information.
[0037] In a further embodiment, the touch-sensitive layer is further configured to detect direct actuations of the touch-screen input system by an operator and third position information of the direct actuation, and the computing device is further configured to output a notification indicating the need for an input device for a first group of buttons that can only be triggered by an input device; and to check whether the third position information and the button position match for a second group of buttons that can also be triggered without an input device, and if so, to trigger the button upon a direct actuation detected by the touch-sensitive layer.
[0038] This advantageously makes it possible to implement a mixed input mode (so-called mixed mode), in which, for example, buttons in a first group, which can then trigger safety-critical operations, can only be activated using an input device. This can create additional safety because the risk of unintentional activation by the operator can be reduced. The buttons in a second group, which can then trigger non-critical actions, such as menu control buttons or buttons that influence the display, can, in contrast, be activated without an input device. The term "direct activation" here means activation by the operator without an input device and can refer to touches with one or more fingers, the ball of the hand, the forearm, the elbow, or other body parts.
[0039] In a further embodiment, one of the criteria stored for the button comprises identification information of a predetermined input device from a set of several similar input devices, wherein the identification information of the predetermined input device is registered in the stored criteria by a user using the specific input device.
[0040] Because an input device can only be used after it has been activated with an additional registration, a lost input device can be easily replaced, and swapping input devices cannot have adverse consequences. Furthermore, a lost or stolen input device does not allow unauthorized third parties to operate the system.
[0041] These are advantageous further developments that will be explained later in the description.
[0042] According to a further aspect of the invention, an input method for a touchscreen input system is described, wherein the method comprises detecting an actuation of the touchscreen input system with the input device by the touch-sensitive layer, detecting the first position information of the input device by the touch-sensitive layer, detecting the electromagnetic alternating field by the conductor loop layer, and determining the second position information of the input device by the conductor loop layer by comparing induction signal strengths, checking by the computing device whether the first position information, the second position information and the button position match, and if they match, triggering the button when actuation of the touchscreen input system is detected.Another advantage here is that the button is only triggered if the position of the input device has been determined consistently by two systems. This prevents the button from being triggered accidentally, for example, by resting the palm of your hand on the screen or by a body part hitting the touchscreen input device. Furthermore, this allows for triple confirmation, since the two determined positions must match the known position of the button.
[0043] In a further embodiment, the input method further comprises modulating, by the input device, additional input device information onto the electromagnetic alternating field, and determining, by the computing device, the additional input device information from the detected electromagnetic alternating field, wherein the triggering of the button only occurs if the additional input device information fulfills criteria stored for the button.
[0044] This also has the advantage that input devices can be assigned an authorization, for example, and thus certain functions can only be carried out by authorized input devices.
[0045] In a further embodiment, the additional input device information includes the pressure with which the input device is pressed onto the touch screen input system, a fingerprint and / or identification information of the input device.
[0046] In a further embodiment, the method further comprises detecting a direct actuation of the touch-screen input system by an operator through the touch-sensitive layer, and detecting third position information of the direct actuation through the touch-sensitive layer. For a first group of buttons that can only be triggered by an input device, a notification is then output indicating the need for an input device for actuation. For a second group of buttons that can also be triggered without an input device, the method comprises checking, by the computing device, whether the third position information matches the button position, and, if there is a match, triggering the button upon detected direct actuation of the touch-screen input system.
[0047] This advantageously makes it possible to implement a mixed input mode (so-called mixed mode), in which, for example, buttons in a first group, which can then trigger safety-critical operations, can only be activated using an input device. This can create additional safety because the risk of unintentional activation by the operator can be reduced. The buttons in a second group, which can then trigger non-critical actions, such as menu control buttons or buttons that influence the display, can, in contrast, be activated without an input device. The term "direct activation" here means activation by the operator without an input device and can refer to touches with one or more fingers, the ball of the hand, the forearm, the elbow, or other body parts.
[0048] These advantageous further training courses will be explained in the further course of the description.
[0049] According to a further aspect of the invention, a computer program product is described which can be loaded directly into a memory of a programmable control device of a touch screen input system, with program code means for executing all steps of a previously described input method when the program product is executed on the control device.
[0050] The embodiments show possible variants. The invention is not limited to the specifically illustrated variants. Rather, combinations of the individual variants are also possible. In particular, the features of the system can also be implemented in a method, and vice versa.
[0051] For a better understanding of the invention, it is explained in more detail with reference to the following figures. They show, in highly simplified, schematic representations:
[0052] Fig. 1 shows a touch-screen input system according to exemplary embodiments, Fig. 2 shows an exemplary input device of the touch-screen input system, and
[0053] Fig. 3 is a schematic flow diagram according to exemplary embodiments.
[0054] By way of introduction, it should be noted that in the variously described embodiments, identical parts are provided with identical reference symbols or component designations. The disclosures contained throughout the description can be applied analogously to identical parts with identical reference symbols or component designations. Furthermore, the positional information chosen in the description, such as top, bottom, side, etc., refers to the directly described and illustrated figure, and these positional information must be applied analogously to the new position in the event of a change in position.
[0055] Compared to known systems, higher security can be achieved, for example, through a two-channel architecture.
[0056] Control architectures were classified into categories by the DIN EN 954-1 standard, which describes the classification of the safety-related parts of a control system with regard to their resistance to faults and their subsequent behavior in the event of a fault. Five control categories were defined (B, 1, 2, 3, 4), with categories 3 and 4 relating to two-channel architectures.
[0057] Since 2009, the categories have been replaced by performance levels defined in DIN EN ISO 13849-1. The performance levels, PL, are designated by the letters a to e and define the probability of a dangerous failure per hour, for example, PL d: 1 / 1,000,000 to 1 / 10,000,000. The solution proposed here can achieve a PL d or e.
[0058] Fig. 1 shows a schematic representation of an exemplary structure of a touchscreen input system 1. It comprises a touch-sensitive layer 5, a conductive loop layer 6, and visually perceptible buttons 2, three of which are depicted on each layer.
[0059] The touch-sensitive layer 5 can comprise a resistive system, a surface capacitive system, a projected capacitive system, an inductive system, a wave- or sound-wave-controlled system (Surface Acoustic Wave, SAW), an optical system, e.g. with an infrared light grating, or a dispersive signal technology system.
[0060] The actual display of the buttons can be realized by a conventional display, which can be configured as an integrated layer with the touch-sensitive layer 5. Alternatively, the touch-sensitive layer 5 can be merely a transparent layer, and a display layer can be arranged between the touch-sensitive layer 5 and the conductive loop layer 6.
[0061] The number of buttons 2 can be chosen as required and depends on the intended use and the design options. It is conceivable that only one button 2 (e.g. machine start or buttons for opening or closing an injection mold) is protected by the second layer; it is also conceivable that a complete keyboard with up to 100 or more buttons is implemented. An example with two buttons 2 would be buttons 2 for moving machine axes or the like, where both circuits, i.e. those connected with an AND operation, have to be actuated. Not all buttons on the touch screen have to be protected by the second layer. It is conceivable that some buttons can only be triggered via the touch-sensitive layer 5 or only via the conductor loop layer 6.
[0062] The system 1 further comprises an inductive input device 3, which is illustrated in Fig. 1 as a pen. The inductive input device 3 can generate an alternating electromagnetic field 4 that can be detected by the conductor loop layer 6. The alternating field 4 is indicated in Fig. 1 by dashed circle segments, which are intended to symbolize a wave-like propagation.
[0063] Fig. 2 shows the input device 3 again, with the optional components pressure detection device 8 and fingerprint reader 9. The position of these optional components is also only schematic. For example, the fingerprint reader 9 can be mounted in such a way that when the input device 3 is used as a pen, the user's fingerprint can be read by the fingerprint reader 9. Alternatively, the fingerprint reader 9 can also be mounted in a location that is not touched during use, so that, for example, the input device 3 must be unlocked with a fingerprint before use. The same applies to the pressure detection device 8. This can be located near the tip, i.e. the part used to touch the touch screen, and detect the pressure with which the tip is pressed onto the touch screen.Alternatively, the pressure detection device 8 can also be mounted at a different location on the input device 3, depending on the design of the input device 3. A differently designed pressure detection device can also be used to detect pressure exerted by the user on the input device 3 and thus confirm the intentional actuation of a button 2.
[0064] The input device 3 can, for example, be a glove with which the touch screen is operated.
[0065] The induction function of input device 3 requires energy. The input device can obtain this energy via a cable or have a built-in or replaceable energy storage device (e.g., a rechargeable battery or battery). The energy storage device can be rechargeable and charged, for example, by an induction charging device. This induction charging device can, for example, be installed in or on a storage facility in which or on which input device 3 is kept when not in use. Input device 3 can also be supplied with energy directly by induction, which it receives, for example, from an induction coil installed in touchscreen input system 1.
[0066] Regardless of the type of power supply, the input device 3 can include a securing device, such as a wire or cable, with which it is or can be secured to a specific location. This can ensure that the input device 3 is not lost.
[0067] The system 1 also comprises a computing device 7. The computing device 7 can be installed in the screen part of the system 1, but the computing device 7 can also be a standalone computer to which the signals from the system components that display the screen are fed. The computing device 7 can also designate the part of a machine to be operated that performs a control function, i.e. the controller, for the machine. The touch-sensitive layer 5 and the conductor loop layer 6 are shown offset from one another in Fig. 1 for the sake of clarity, but they are usually located one above the other. The touch-sensitive layer 5 is located above the conductor loop layer 6, i.e. closer to the person operating the device.
[0068] However, it is also conceivable that the conductor loop layer 6 covers only a part of the touch-sensitive layer 5 in order to secure only the part of the touch-sensitive layer 5 corresponding to the conductor loop layer 6 by a second positioning of the input device 3.
[0069] Fig. 3 shows a schematic flowchart, which will now be used to describe the touchscreen input system 1 and the input method 100 therefor. Optional features are shown in dashed lines.
[0070] First, in step 110, an actuation of the touchscreen input system 1 with the input device 3 is detected by the touch-sensitive layer 5. As already described, the touch-sensitive layer 5 can be constructed according to a known functional principle. In step 120, the touch-sensitive layer 5 further detects initial position information of the input device 3, i.e., the location at which the input device 3 touches the touch-sensitive layer 5.
[0071] In step 130, the conductor loop layer 6 detects the alternating electromagnetic field 4 of the input device 3 and determines second position information of the input device 3 by comparing induction signal strengths. In this process, the conductor loop layer 6 measures the induction signal strengths at the individual conductor loops of the conductor loop layer 6, and the position of the input device 3 is determined by the comparison.
[0072] It should be noted that steps 110, 120 and 130 can occur in any order and even simultaneously.
[0073] In the next step 140, the computing device 7 checks whether the first position information, the second position information, and the button position match. The first position information is obtained from the touch-sensitive layer 5, the second position information from the conductive loop layer 6, and the button position from the unit that controls the display of the buttons 2 on the display layer or the touch-sensitive layer 5 with a display function.
[0074] It should be noted that the positional alignment can be adjusted with a certain tolerance to compensate for measurement inaccuracies. The tolerance can be adjusted depending on the components used, the input device 3, the size of the buttons 2, and / or empirical values.
[0075] If the three positions match, the button is triggered in step 150 upon detecting the actuation of touchscreen input system 1. When button 2 is triggered, the function or command associated with button 2 is transmitted to the corresponding remote station. Therefore, if touchscreen input system 1 is actuated, i.e., touched by input device 3, and the touch position indicated by the first position information can be verified twice, i.e., by the second position information and the known button position, the function or command associated with the touched button 2 is also triggered.
[0076] Optionally, one or more of the buttons can each have a fixed position on the touchscreen input system. These buttons can then be printed, for example, or marked with stickers, so that in the event of a display device or function failure, button 2 can still be found and pressed. This can also prevent burn-in, because while normal buttons can be displayed at different positions at certain intervals to prevent burn-in, this may not be possible or permitted for safety-relevant functions.
[0077] The input device can optionally modulate additional input device information onto the alternating electromagnetic field in a step 105, which can be performed before step 110. This enables the alternating field 4 to transmit additional information that can be determined and evaluated by the computing device 7. The computing device 7 can then make the triggering of button 2, if the position information matches, dependent on whether the transmitted additional input device information meets predetermined criteria. The criteria can be defined for each button 2 or for the entire operation of the touchscreen input system 1.
[0078] The modulation can be incorporated into the alternating field 4 as angle modulation, as amplitude modulation, as modulation methods derived therefrom or as pulse modulation.
[0079] The additional input device information can, for example, be a device ID of the input device 3. This allows different input devices 3 to be assigned different authorizations. For example, a specific input device 3 may be required to perform a specific function, e.g., starting a maintenance mode. It is also conceivable that different input devices 3 are required for multiple machines at the same location, for example, a first input device 3 for a first machine and a second input device 4 for a second machine.
[0080] The additional input device information can also relate to the user if input device 3 is assigned to a specific user. This can be used, for example, to store which user performed which function at what time. Multiple users or input devices 3 can also be grouped together, and the authorization to execute various buttons can depend on the respective group.
[0081] The authorization of an input device, for example to activate a special operating mode or to press a specific function button, can also depend on a login process that the user must first complete. This means that while there are a number of input devices that are essentially authorized, once a user has logged in to a machine, only the input device used for the login is authorized, and this authorization can only be revoked using the authorized input device or through another authorized user action. Each input device can have a unique identifier that would be temporarily registered as the user's input device during the login process for the duration of the login.This eliminates the need for separate rights management for input devices, allowing access to the individual user rights. The advantage of this is that a lost input device can be easily replaced, and mixing up input devices has no adverse consequences. Furthermore, a lost or stolen input device does not allow unauthorized third parties to operate the system.
[0082] To further increase security, additional identification or authentication may be required in addition to the input device, for example through a key, a magnetic or RFID card, a smart device such as a wearable or a mobile phone, TAN tokens, biometric procedures or similar.
[0083] The exclusive authorization of the input device of the currently logged-in user increases safety, particularly in connection with so-called special operating modes of a machine. Special operating modes can include, for example, maintenance during which otherwise effective protective measures are deactivated, such as light barriers, safety doors, protective plates or screens. Testing, setup, or adjustment operations could also be a special operating mode. As long as a user is logged in to the machine, has activated such a special operating mode, and is carrying their input device, no other person can trigger safety-critical machine functions (e.g., activation of drives, tools, or energy sources, or deactivation of brakes or holding devices) or authorize any other input device.This protects the logged-in user while performing repairs, inspections, adjustments, or similar actions on parts of a large machine or system that may not be visible to others. However, the logged-in user performing maintenance work can trigger such safety-critical functions with their input device at any time and without any hassle—that is, without having to lock and unlock the machine every time they leave the control panel. This significantly simplifies the temporary, exclusive assignment of operating authorization to a single user, thereby increasing user acceptance and improving safety.
[0084] The additional input device information may also indicate the actuation of a button on the input device 3, or the input of information via other means on the input device 3. For example, an input device 3 could have a scroll wheel for scrolling through menu structures, so that various buttons 2 are displayed in response to an actuation of the scroll wheel.
[0085] In addition or alternatively to the methods just described, the input device 3 can also transmit the additional input device information to the touchscreen input system 1 via another communication channel. Examples include Bluetooth, network communication (LAN, WLAN), infrared, shortwave radio, and NFC.
[0086] It may also be a criterion that additional input device information that identifies a user or an input device 3 is transmitted at all.
[0087] Furthermore, the position information confirmed three times by system 1 can be additionally confirmed by a fourth device. This can be, for example, a visual detection device, such as a camera, an infrared camera, or the like, or an acoustic detection device, such as a microphone, through which a voice input from the user corresponding to the button 2 to be triggered is detected. This fourth device can also determine the user's identity, if necessary, and the buttons can be activated, deactivated, or adapted accordingly.
[0088] The system 1 can also, as soon as an input device 3 is detected (by the conductive loop layer 6 or, in the case of further communication paths, by the corresponding components of the touch screen input system 1), process or forward this additional input device information so that the buttons not available for the current user or the current input device 3 are hidden or otherwise marked as unavailable.
[0089] The input device 3 can also include additional functions. For example, the input device 3 can include a pressure detection device 8 configured to detect the pressure with which the input device 3 is pressed onto the touchscreen input system 1. The additional input device information can then include the detected pressure. On the one hand, this can create an additional level of functions, since a button can be assigned a different command or function for light pressure than for strong pressure.
[0090] In addition, a further security level can be introduced and constant pressure over a long predetermined period can be interpreted as a failure of the input device or the input device is considered to be discarded.
[0091] In addition, the touch-sensitive layer 5 can also be equipped with a pressure sensor, and the two determined values can be checked for agreement as an additional safety function.
[0092] The input device 3 can also alternatively or additionally comprise a fingerprint reader 9, and the additional input device information can comprise a read fingerprint. The fingerprint reader 9 can be mounted at a location where a user's finger would rest during conventional operation. However, the fingerprint reader 9 can also be mounted at a location that does not allow the fingerprint to be read during use. In this case, the input device 3 must be activated before use. It may also be necessary to use the fingerprint reader 9 before a particularly critical operation in order to obtain authorization to perform the operation.
[0093] Alternatively or additionally, the input device 3 may have stored identification information, and the additional input device information may comprise the identification information, as already described above.
[0094] A further embodiment is a computer program product comprising instructions which, when executed by a computer, cause the computer to perform one of the methods set out above.
[0095] Another embodiment is a computer-readable medium on which the computer program product is stored.
[0096] The embodiments show possible embodiments, whereby it should be noted at this point that the invention is not limited to the specifically illustrated embodiments thereof, but rather various combinations of the individual embodiments with one another are also possible.
[0097] The scope of protection is determined by the claims. However, the description and drawings must be used to interpret the claims. Individual features or combinations of features from the various embodiments shown and described may represent independent inventive solutions. The problem underlying these independent inventive solutions can be derived from the description.
[0098] All information on value ranges in this description is to be understood as including any and all sub-ranges thereof, e.g. the information 1 to 10 is to be understood as including all sub-ranges starting from the lower limit of 1 and the upper limit of 10, ie all sub-ranges begin with a lower limit of 1 or greater and end with an upper limit of 10 or less, e.g. 1 to 1.7, or 3.2 to 8.1, or 5.5 to 10.
[0099] For the sake of clarity, it should finally be pointed out that, in order to better understand the structure, some elements have been shown out of scale and / or enlarged and / or reduced in size.
[0100] Reference symbol list
[0101] Touch-screen input system
[0102] buttons inductive input device electromagnetic alternating field touch-sensitive layer
[0103] Conductor loop layer
[0104] computing device
[0105] Pressure detection device
[0106] Fingerprint reader
[0107] Input procedure
[0108] Modulating additional input device information
[0109] Recording an operation
[0110] Collecting initial position information
[0111] Capturing second position information
[0112] Checking the consistency of the position information
[0113] Determine the additional input device information
[0114] Triggering the button
Claims
P a t e n t a n s p r ü c h e 1. A touchscreen input system (1) having at least one visually perceptible button (2) at at least one position, comprising: an active, inductive input device (3) configured to generate an alternating electromagnetic field (4); a touch-sensitive layer (5) configured to detect actuations of the touchscreen input system (1) by the input device (3) and first position information of the input device (3); a conductor loop layer (6) configured to detect the alternating electromagnetic field (4) and to determine second position information of the input device (3) by comparing induction signal strengths;and a computing device (7) configured to check whether the first position information, the second position information and the button position match, and if so, to trigger the button (2) upon actuation detected by the touch-sensitive layer; 2. Touch screen input system (1) according to claim 1, wherein each of the at least one button (2) has a fixed position on the touch screen input system (1).
3. Touch-screen input system (1) according to claim 1 or 2, wherein the input device (3) is further configured to modulate additional input device information onto the alternating electromagnetic field (4); and the computing device (7) is further configured to determine the additional input device information from the detected alternating electromagnetic field (4) and to trigger the button (2) only if the additional input device information meets criteria stored for the button (2).
4. Touch screen input system (1) according to claim 3, wherein the input device (3) comprises a pressure detection device (8) which is configured to detect the pressure with which the input device (3) is pressed onto the touchscreen input system (1), and the additional input device information comprises the detected pressure; the input device (3) comprises a fingerprint reader (9), and the additional input device information comprises a read fingerprint; and / or the input device (3) has stored identification information, and the additional input device information comprises the identification information.
5. Touch screen input system (1) according to one of claims 3 or 4, wherein one of the criteria stored for the button (2) comprises identification information of a predetermined input device (3) from a set of several similar input devices (3), wherein the identification information of the predetermined input device (3) is registered in the stored criteria by a user using the specific input device (3).
6. Touch screen input system (1) according to one of claims 1 to 5, wherein the touch-sensitive layer (5) is further configured to detect direct actuations of the touch screen input system (1) by an operator and third position information of the direct actuation; and the computing device (7) is further configured to, for a first group of buttons (2) which can only be actuated by an input device (3) are to be triggered, to issue a message indicating the need for an input device (3) for actuation; and for a second group of buttons (2), which are to be triggered even without an input device (3), to check whether the third position information and the button position match, and if so, to trigger the button (2) upon direct actuation detected by the touch-sensitive layer.
7. Input method (100) for a touch screen input system (1) according to one of claims 1 to 6, comprising: Detecting (110) an actuation of the touch screen input system (1) with the input device (3) by the touch-sensitive layer (5); detecting (120) the first position information of the input device (3) by the touch-sensitive layer (5); Detecting (130) the alternating electromagnetic field (4) through the conductor loop layer (6) and determining (135) the second position information of the input device (3) through the conductor loop layer (6) by comparing induction signal strengths; Checking (140), by the computing device (7), whether the first position information, the second position information and the button position match; and if they match, triggering (150) the button (2) upon detected actuation of the touch screen input system (1).
8. Input method (100) according to claim 7 for a touch screen input system (1) according to one of claims 1 to 6, further comprising: Modulating (105), by the input device (3), additional input device information onto the alternating electromagnetic field (4); and Determining (145), by the computing device (7), the additional input device information from the detected alternating electromagnetic field (4); wherein the triggering (150) of the button (2) only occurs if the additional input device information fulfills criteria stored for the button (2).
9. Input method (100) according to claim 8 for a touch screen input system (1) according to one of claims 1 to 6, wherein: the additional input device information comprises the pressure with which the input device (3) is pressed onto the touch screen input system (1); the additional input device information comprises a fingerprint; and / or the additional input device information comprises identification information of the input device (3).
10. Input method (100) according to claim 7 or 8 for a touch screen input system (1) according to one of claims 1 to 6, wherein: one of the criteria stored for the button (2) comprises identification information of a predetermined input device (3) from a set of several similar input devices (3), wherein the identification information of the predetermined input device (3) was registered in the stored criteria by a user using the specific input device (3).
11. Input method (100) according to one of claims 7 to 10 for a touch screen input system (1) according to one of claims 1 to 6, further comprising: Detecting a direct actuation of the touch screen input system (1) by an operator through the touch-sensitive layer (5); detecting (120) third position information of the direct actuation by the touch-sensitive layer (5); and for a first group of buttons (2) that can only be triggered by an input device (3), Outputting a message indicating the need for an input device (3) for actuation; and for a second group of buttons (2) that can also be triggered without an input device (3), Checking (140), by the computing device (7), whether the third position information matches the button position; and if there is a match, triggering (150) of the button (2) when direct actuation of the touch screen input system (1) is detected.
12. A computer program product which can be loaded directly into a memory of a programmable control device of a touch-screen input system (1), comprising program code means for executing all steps of an input method according to one of claims 6 to 10 when the program product is executed on the control device.
Citation Information
Patent Citations
Position indicator, position detecting device, and input control method of position detecting device
US20170097724A1
Information processing device and information processing method
US20180373392A1
Touch display apparatus, stylus and sensing method of stylus
US20220075501A1
Electronic device including capacitive sensor driven by stylus excited by magnetic field, touch system including the same, and operating method thereof
US20220197443A1