Systems and methods associated with enhancing touch detection on a display using a force sensor

Abstract

An example display device includes: a display; a touch sensor configured to provide a position signal indicating a position of a human touch relative to the display; a force sensor configured to provide force information indicating a magnitude of a force applied by the human touch; and a processor. The processor is configured to track a baseline position signal generated by the touch sensor due to presence of one or more non-human objects; detect at a point in time, based on the force information provided by the force sensor, that a magnitude of the force exceeds a threshold force; and responsively, remove the baseline position signal from a respective position signal provided by the touch sensor at the point in time, thereby generating a clean position signal indicating a location of the human touch relative to the display.

Description

Systems and Methods Associated with Enhancing Touch Detection on a Display Using a Force SensorCROSS REFERENCE TO RELATED APPLICATION

[0001] The present application claims priority to U.S. Provisional Patent Application No. 63 / 664,231, filed on June 26, 2024, the entire contents of which are herein incorporated by reference as if fully set forth in this description.BACKGROUND

[0002] Many modem outdoor instrumentation and information displays include touchscreens. A touchscreen is a type of display that can detect touch input from a user. As such, the touchscreen operates both an input device and an output device. A touchscreen typically includes a touch panel layered on top of the electronic visual display of a device.

[0003] Further, a touchscreen typically includes some form of sensor that can detect where a user is touching the screen. In outdoor applications, the touchscreen may be subjected to environmental factors that affect the accuracy with which such sensor detects the location of the touch. Such environmental factors include water (fresh and salt, pooling and running), debris, temperature variations, as examples.

[0004] These environmental factors, especially water, can generate erroneous touch signals that are difficult to discern from the signals created by a human finger. As a result, a display may behave unexpectedly by registering a false touch, failing to register a touch, or registering a touch in the wrong location. These malfunctions can result in a poor user experience. Also, due to thenature of these malfunctions, touch sensors are frowned upon in many industries and / or excluded from many safety-critical applications.

[0005] It may thus be desirable to enhance touch detection in such environments. It is with respect to these and other considerations that the disclosure made herein is presented.SUMMARY

[0006] The present disclosure describes implementations that relate to systems and methods associated with enhancing touch detection on a display using a force sensor.

[0007] In examples, this disclosure describes systems, display devices, vehicles, and methods associated with enhancing touch detection using a combination of a force sensor and a touch sensor. A processor of a display device can keep track of a baseline signal generated by a touch sensor due to the presence of non-human touch factors. Once the force sensor indicates that a force threshold has been exceeded due to a human touch, the processor subtracts the baseline signal from the signal generated after the force threshold is exceeded. This way, the processor filters out the baseline (noise) signal and generates a clean signal that more accurately represents a location of the a human touch.

[0008] The foregoing summary is illustrative only and is not intended to be in any way limiting. In addition to the illustrative aspects, implementations, and features described above, further aspects, implementations, and features will become apparent by reference to the figures and the following detailed description.BRIEF DESCRIPTION OF THE FIGURES

[0009] The novel features believed characteristic of the illustrative examples are set forth in the appended claims. The illustrative examples, however, as well as a preferred mode of use, further objectives and descriptions thereof, will best be understood by reference to the following detailed description of an illustrative example of the present disclosure when read in conjunction with the accompanying Figures.

[0010] Figure 1 illustrates a partial view of a motorcycle having a display device, according to an example implementation.

[0011] Figure 2 illustrates a partial view of a boat having a display device, according to an example implementation.

[0012] Figure 3 illustrates a partial view of a tub controllable by a display device, according to an example implementation.

[0013] Figure 4 illustrates a cross-sectional side view of a display device, according to an example implementation.

[0014] Figure 5 is a block diagram of a display device, according to an example implementation.

[0015] Figure 6 is a flowchart of a method for detecting finger touch on a touchscreen or display, according to an example implementation.DETAILED DESCRIPTION

[0016] A display device with a touchscreen may use different types of sensors to detect presence or touch of a human finger at a particular location on a display. Such sensors may include a resistive touch sensor, a capacitive touch sensor, an infrared touch sensor, a surface acoustic wave sensor, etc.

[0017] For example, a display device may employ a Projective Capacitive touchscreen (P-CAP, Pro-Cap or PCAP touchscreen) sensor that operates by maintaining a standing electrical charge across the sensor. Such standing electric charge extends through a contact surface, where changes in the electrical charge caused by the proximity of other capacitive bodies (such as touch stylus, fingers, etc.) can be detected by a touch controller or processor of the display device. However, the accuracy of determining a location of a touch by a user of the display device using a PCAP sensor may be affected by the presence of environmental factors such as debris, temperature variations, or water.

[0018] Figure 1 illustrate a partial view of a motorcycle 10 having a display device 12, according to an example implementation. The display device 12 is configured to have a touchscreen operable by the driver of the motorcycle 10.

[0019] Due to the operating environments of the motorcycle 10, the display device 12 may be exposed to debris, water (e.g., rain), temperature variations, etc. For example, if water (pooled water or water droplets) are present on the touchscreen, and the display device 10 has a capacitive touchscreen, the effect of water and finger touches might be the same. Particularly, both water and a finger touch increase the capacitance, and thus the location having water (e.g., water droplets) thereon is equivalent to finger touch in terms of causing a capacitance change.

[0020] Thus, the presence of water may trigger false touch detections, and the accuracy of determining a position of a finger of the rider on the touchscreen may be affected. This causes a deterioration in user experience.

[0021] Figure 2 illustrate a partial view of a boat 20 having a display device 22, according to an example implementation. The display device 22 has a touchscreen 24 operable by a driver 26 of the boat 20. Particularly, the driver 26 may use a finger 28 to touch various locations of a touchscreen 24 to select various graphical user-interface items (e.g., menus, windows, buttons, etc.) displayed on the display device 22 to operate various aspects of the boat 20.

[0022] Due to the operating environment of the boat 20, the display device 22 is typically exposed to water. Water can affect the accuracy of determining a position of the finger 28 of the driver 26 on the touchscreen 24, causing a deterioration in user experience as described above.

[0023] The motorcycle 10 and the boat 20 are examples of vehicles that could operate in an environment where non-human objects such as water can distort output of a display device. Other example vehicles can similarly have displays that suffer from the same problems.

[0024] Figure 3 illustrate a partial view of a tub 30 controllable by a display device 32, according to an example implementation. Similar to the display devices 12, 22, the display device 32 has a touchscreen operable by a user of the tub 30. Particularly, the user may use a finger to touch various locations of a touch screen of the display device 32 to select various graphical user-interface items (e.g., menus, windows, buttons, etc.) displayed on the display device 32 to operate various aspects of the tub 30.

[0025] Due to the operating environment of the tub 30 being full of water that may splash under various operating conditions, the display device 32 is typically exposed to water. This isexacerbated by the display device 32 having a flat orientation in this application, causing water to form one or more pools on the display device 32. As explained above, water can affect the accuracy of determining a position of the finger of the user on the touchscreen of the display device 32, causing a deterioration in user experience.

[0026] As such, there are various applications in which operating a display device having a touchscreen is affected by the presence of environmental factors such as water. It may be desirable to enhance the accuracy of detection of user fingers in such conditions.

[0027] Disclosed herein are systems, display devices, and methods that enhance detection of a human touch location on a touchscreen of a display device. The methods involve leveraging a force touch sensor to detect the physical presence of a human pushing on the screen. This allows the display to discern human intention from other non-human inputs.

[0028] Particularly, a processor of the display device keeps track of a baseline (noise) signal generated by a touch sensor due to presence of environmental factors or non-human objects. Once the touch force exceeds a threshold force as indicated by a force sensor, the processor can subtract the baseline signal from a signal generated by the touch sensor at or after the point of time when the threshold force is exceeded. This way, the processor removes erroneous (baseline or noise) signals produced by the presence of water and other artifacts from the signal measured when a human touch has actually occurred. Removing such erroneous signal leaves only the signal associated with the presence of the human finger, thus preventing false or missed touch detections and increasing the accuracy of the touch position identification.

[0029] Further, in some examples, the force sensor may have the ability to provide touch location or position in addition to force information. While position information generated by a force sensor might not be as accurate as position information generated by a touch sensor, the forcesensor might not be sensitive to the presence of non-human objects (e.g., water or other artifacts), which affect performance of the touch sensor.

[0030] Thus, in this example, the position data from a force sensor could be used to inform or enhance the position information from the touch sensor. Particularly, the processor of the display device can take into consideration touch sensor signals only in a certain area of the display near a force touch event as indicated by the force sensor, while ignoring or negating the touch sensor (noise) data from areas that are not near the force touch event. This may enable the processor to detect the position / location of a human touch more reliably in the presence of non-human objects such as water.

[0031] Figure 4 illustrates a cross-sectional side view of a display device 100, according to an example implementation. The display device 100 represents any of the display devices 12, 22, 32 described above, for example. As depicted, the display device 100 is multi-layered, and includes a protective lens 102, a touch sensor 104 (e.g., a capacitive touch sensor layer), a force sensor 106, and a screen or display 108.

[0032] The protective lens 102 can also be referred to as a cover lens. The protective lens 102 can be made of glass, for example, and is configured to protect the other layers from damage and ensure the data on the display 108 is clearly visible. In examples, the protective lens 102 can also be customized to meet specific performance characteristics such as impact protection and heat resistance. The protective lens 102 can also have surface coatings to reduce glare, fingerprints, or reflections.

[0033] Thickness of the protective lens 102 may vary based on the desirable impact protection and mechanical characteristics. As examples, thicknesses may include 0.55 millimeter (mm), 0.7 mm, 1.1 mm, 1.8 mm, 3 mm, or 4 mm.

[0034] The touch sensor 104 is configured to generate sensor information that indicates a location at which a finger of the user (or some other instrument such as a stylus) has touched the display device 100 (e.g., within a specific area of the protective lens 102). As an example for illustration, the touch sensor 104 may operate using a Projected Capacitive Touch technology having an insulator such as glass or polyethylene terephthalate (PET) plastic, which is coated with a transparent conductor, such as a lager array of indium tin oxide (ITO). The user’s finger conducts electricity, so touching the surface of the display device 100 results in a distortion of the electrostatic field, and the distortion is measurable as a change in capacitance. Such change in capacitance facilitates determining a particular location of the finger touch.

[0035] As such, in this example, the touch sensor 104 can be a capacitance-based sensor having a circuit configured to sense touch via changes in the electrical fields. A finger touch causes the capacitance of the circuit to change, indicating the position of the touch.

[0036] As described above, the presence of environmental factors such as water may affect performance of the touch sensor 104 and the accuracy with which the finger touch location is determined. To enhance determination of the finger touch location, the display device 100 further includes the force sensor 106.

[0037] The force sensor 106 can be a configured as a transducer that transforms a mechanical input force like weight, tension, compression, torque, strain, stress, or pressure into an electrical output signal, the value of which is used to indicate the force’s magnitude. The signal can be provided to a processor (e g., the processor(s) 202 described below) of the display device 100 to determine the magnitude of the force, for example.

[0038] In an example, the force sensor 106 may operate based on a haptic pressure-sensing technology that allows the processor of the display device 100 to determine the amount of forceapplied to the display device 100 (e.g., to the protective lens 102). The force sensor 106 can distinguish between various levels of force being applied to the display device 100. Using the force sensor 106 to enhance detection of a touch location is described in detail below.

[0039] In an example, the display 108 can be a thin-film-transistor (TFT) liquid-crystal display (LCD). A TFT LCD uses thin-film-transistor technology to improve image qualities such as addressability and contrast of an LCD. A TFT LCD may include an active matrix LCD, in contrast to passive matrix LCDs or simple, direct-driven LCDs, for example.

[0040] In the example implementation of Figure 4, the touch sensor 104 is interposed between the protective lens 102 and the force sensor 106. Also, the force sensor 106 is interposed between the touch sensor 104 and the display 108. However, other arrangements are contemplated. For example, the force sensor 106 may be interposed between the protective lens 102 and the touch sensor 104

[0041] The display 108 is configured to display a user interface that can be manipulated by the user via finger or stylus touches. The touch sensor 104 is configured to provide an indication of a location of the touch of the finger touch such that the processor of the display device 100 determines the appropriate action based on the finger touch location.

[0042] The processor further leverages the information provided by the force sensor 106 to detect the physical presence of a human pushing on the display device 100 (e.g., on the protective lens 102). This allows the processor to discern human intention from other non-human inputs (e.g., false triggers due to water presence).

[0043] Particularly, the processor uses the registered touch force as indicated by the force sensor 106 and the calculated location of the touch based on the touch sensor 104 to enhance theperformance of the touch sensor 104. The term “registered touch force” is used herein to indicate that the touch force exceeds a threshold force.

[0044] In one example, the processor can subtract sensor data recorded by the touch sensor 104 prior to the force touch being registered (e.g., exceeding a threshold force) from the sensor data recorded by the touch sensor 104 at the moment the force touch has registered. This allows the erroneous signals produced by the presence of water and other artifacts to be removed from the signal measured when a human touch has actually occurred.

[0045] As an example for illustration, the processor of the display device 100 may implement the following equation:where:“t” is the moment or point in time at which registering of a force touch event occurs (e.g., a finger pushes on the protective lens 102 with a force that exceeds a particular threshold force) as indicated by the force sensor 106;• “x” is a point in time or period of time (e.g., window of time) prior to the registering of the force touch event (e.g., prior to time “f ’);• SignalNoise(t) is the touch signal generated by the touch sensor 104 due to any non-human environmental conditions that influence the touch sensor 104, e.g., manufacturing and assembly variances, temperature, water (fresh and salt, pooling and running), debris, installation variances and influences (bezels, etc.). This signal is measured at the moment in time “f ’ at which a force touch event is registered;• SignalNoise Prior(t — x) is the representative touch signal generated by the touch sensor 104 due to any non-human environmental conditions listed above that influence the touch sensor 104. This signal is measured at a point in time or over a period of time prior to the registering of a force touch event (e.g., prior to time “t”).

[0046] In examples,may be substantially equal to Sigiroilj^Q^Q^0*Thus, by subtracting SignalNoiseprior(t ~ ) from SignalNoise(t), the processor removes or cancels erroneous noise signals and determines a clean signal Signalclean(t at the time the force sensor 106 indicates that a touch force has exceeded the threshold force. The clean signal may accurately indicate a touch position or location.

[0047] Thus, removal of such erroneous signals leaves only the signals associated with the presence of the human finger, preventing false or missed touches. Removal of the erroneous signals also increases the accuracy of the touch position determination compared to using a force touch sensor alone or a touch sensor (e.g., PCAP) alone. A touch sensor alone may operate accurately in a clean and dry environment, but not in the environments described above with respect to Figures 1-3, for example.

[0048] Thus, by using the method described above, the processor of the display device 100 can filter out or remove signal noise generated by environmental factors, which could lead to false triggers of finger touches. Particularly, the force sensor 106 indicates when a finger touch applies a force that exceeds a threshold force, triggering the processor to process the signal generated by the touch sensor 104 while subtracting the signal noise or background noise generated prior to the force exceeding the threshold force. This way, the processor can eliminate or at least reduce false detections of finger touches, thus reducing instances when environmental factors are confused with actual finger touches.

[0049] In examples, detection of actual finger touches can be further enhanced by taking into consideration finger touch position information indicated by the force sensor 106 to determine a preliminary location or position of a touch that can be enhanced or confirmed via information from the touch sensor 104. Particularly, while the force sensor 106 may provide low resolution finger position information compared to high resolution information provided by the touch sensor 104, the low resolution position information of the force sensor 106 might be insensitive to presence of non-human objects, and may thus be used to eliminate portions of the display from consideration.

[0050] For example, the processor may be configured to divide the display 108 into quadrants or regions. The low resolution touch position information provided by the force sensor 106 may be used to ignore or negate some quadrants or regions where a finger touch has not occurred but where non-human objects may be present. This narrows the regions of the display 108 where a touch may have occurred. A more exact or high resolution finger touch position can then be confirmed or identified with the method described above combining the force sensor 106 indicating a threshold force being exceeded with touch sensor 104 generating a clean finger location touch signal that does not include the baseline background noise signal.

[0051] Figure 5 is a block diagram of the display device 100, according to an example implementation. The display device 100 may have processor(s) 202, a communication interface 204, and data storage 206, each connected to a communication bus 212. The display device 100, and particularly the communication interface 204, may include hardware to enable communication within the display device 100 and between the display device 100 and an external communication bus of the motorcycle 10, the boat 20, or the tub 30, for example. Such hardware may include transmitters, receivers, and antennas, for example.

[0052] The communication interface 204 may be a wireless interface and / or one or more wireline interfaces that allow for both short-range communication and long-range communication to one or more networks or to one or more remote devices (e.g., to allow communication with the communication bus of the motorcycle 10, the boat 20, or the tub 30). Wireless interfaces may provide for communication under one or more wireless communication protocols, Bluetooth, WiFi (e.g., an institute of electrical and electronic engineers (IEEE) 802.11 protocol), Long-Term Evolution (LTE), cellular communications, near-field communication (NFC), and / or other wireless communication protocols. Wireline interfaces may include an Ethernet interface, a CAN network interface, a USB interface, or similar interface to communicate via a wire, a twisted pair of wires, a coaxial cable, an optical link, a fiber-optic link, or other physical connection to a wireline network. Thus, the communication interface 204 may be configured to receive input data from the communication bus of the motorcycle 10, the boat 20, or the tub 30, and may be configured to send output data to the communication bus of the motorcycle 10, the boat 20, or the tub 30.

[0053] The data storage 206 may include or take the form of one or more computer-readable storage media that can be read or accessed by the processor(s) 202. The computer-readable storage media can include volatile and / or non-volatile storage components, such as optical, magnetic, organic or other memory or disc storage, which can be integrated in whole or in part with the processor(s) 202. The data storage 206 is considered as a non-transitory computer readable media. In some examples, the data storage 206 can be implemented using a single physical device (e.g., one optical, magnetic, organic or other memory or disc storage unit), while in other examples, the data storage 206 can be implemented using two or more physical devices.

[0054] The data storage 206 can thus be a non-transitory computer readable storage medium, with executable instructions 214 stored thereon. The executable instructions 214 include computerexecutable code. When the executable instructions 214 are executed by the processor(s) 202, the processor(s) 202 perform the various operations of the display device 100 (e.g., operations described above related to detection of finger touch).

[0055] The processor(s) 202 may be a general-purpose processor or a special purpose processor (e.g., digital signal processors, application-specific integrated circuits (ASIC), etc.). The processor(s) 202 may receive inputs from the communication interface 204, the touch sensor 104, and the force sensor 106, and process the inputs to generate outputs that are stored in the data storage 206.

[0056] The display device 100 can further include an output interface 208 for outputting information to the display 108. The output interface 208 can be a wireless interface (e.g., transmitter) or a wired interface as well. The processor(s) 202 may receive inputs from the communication interface 204, and process the inputs to generate outputs to the display 108.

[0057] Particularly, the processor(s) 202 may generate a graphical user-interface on the display 108. A user interacts with the graphical user-interface via finger touch or a stylus, for example. The processor(s) 202 detect location of a human touch (finger or stylus) via the methods described above combining output from the force sensor 106 and the touch sensor 104. Responsively, the processor(s) 202 take action corresponding to the location of the human touch (e.g., generate another menu, take an action corresponding to pressing a menu item, icon, or button on the display 108, etc.).

[0058] Figure 6 is a flowchart of a method 300 for detecting finger touch on a touchscreen or display, according to an example implementation. The method 300 can be implemented by one or more components of the display device 100, for example.

[0059] The method 300 may include one or more operations, or actions as illustrated by one or more of blocks 302-310. Although the blocks are illustrated in a sequential order, these blocks may in some instances be performed in parallel, and / or in a different order than those described herein. Also, the various blocks may be combined into fewer blocks, divided into additional blocks, and / or removed based upon the desired implementation.

[0060] In addition, for the method 300 and other processes and operations disclosed herein, the flowchart shows operation of one possible implementation of present examples. In this regard, each block may represent a module, a segment, or a portion of program code, which includes one or more instructions executable by a processor (e.g., the processor(s) 202 of the display device 100) for implementing specific logical operations or steps in the process. The program code may be stored on any type of computer readable medium or memory, for example, such as a storage device (e.g., the data storage 206) including a disk or hard drive. The computer readable medium may include a non-transitory computer readable medium or memory, for example, such as computer-readable media that stores data for short periods of time like register memory, processor cache and Random Access Memory (RAM). The computer readable medium may also include non-transitory media or memory, such as secondary or persistent long term storage, like read only memory (ROM), optical or magnetic disks, compact-disc read only memory (CD-ROM), for example. The computer readable media may also be any other volatile or non-volatile storage systems. The computer readable medium may be considered a computer readable storage medium, a tangible storage device, or other article of manufacture, for example. In addition, for the method 300 and other processes and operations disclosed herein, one or more blocks in Figure 6 may represent circuitry or digital logic that is arranged to perform the specific logical operations in the process.

[0061] At block 302, the method 300 includes generating, by the processor(s) 202, a graphical user-interface on the display 108 of the display device 100, wherein the display device 100 comprises: (i) the touch sensor 104 configured to provide a position signal indicating a position of a human touch relative to the graphical user-interface, and (ii) the force sensor 106 configured to provide force information indicating a magnitude of a force applied by the human touch.

[0062] At block 304, the method 300 includes tracking, by the processor(s) 202, a baseline position signal generated by the touch sensor 104 due to presence of one or more non-human objects (e.g., water).

[0063] At block 306, the method 300 includes detecting at a point in time, based on the force information provided by the force sensor 106, that a magnitude of the force exceeds a threshold force.

[0064] At block 308, the method 300 includes, responsively, removing the baseline position signal from a respective position signal provided by the touch sensor 104 at the point in time at which the magnitude of the force exceeds the threshold force, thereby generating a clean position signal indicating a location of the human touch relative to the graphical user-interface.

[0065] At block 310, the method 300 includes taking an action on the graphical user-interface based on the location of the human touch.

[0066] The method 300 can further include any of the steps performed by the display device 100 or the devices thereof as described throughout herein.

[0067] The detailed description above describes various features and operations of the disclosed systems with reference to the accompanying figures. The illustrative implementations describedherein are not meant to be limiting. Certain aspects of the disclosed systems can be arranged and combined in a wide variety of different configurations, all of which are contemplated herein.

[0068] Further, unless context suggests otherwise, the features illustrated in each of the figures may be used in combination with one another. Thus, the figures should be generally viewed as component aspects of one or more overall implementations, with the understanding that not all illustrated features are necessary for each implementation.

[0069] Additionally, any enumeration of elements, blocks, or steps in this specification or the claims is for purposes of clarity. Thus, such enumeration should not be interpreted to require or imply that these elements, blocks, or steps adhere to a particular arrangement or are carried out in a particular order.

[0070] Further, devices or systems may be used or configured to perform functions presented in the figures. In some instances, components of the devices and / or systems may be configured to perform the functions such that the components are actually configured and structured (with hardware and / or software) to enable such performance. In other examples, components of the devices and / or systems may be arranged to be adapted to, capable of, or suited for performing the functions, such as when operated in a specific manner.

[0071] By the term “substantially” or “about” it is meant that the recited characteristic, parameter, or value need not be achieved exactly, but that deviations or variations, including for example, tolerances, measurement error, measurement accuracy limitations and other factors known to those with skill in the art, may occur in amounts that do not preclude the effect the characteristic was intended to provide.

[0072] The arrangements described herein are for purposes of example only. As such, those skilled in the art will appreciate that other arrangements and other elements (e.g., machines, interfaces, operations, orders, and groupings of operations, etc.) can be used instead, and some elements may be omitted altogether according to the desired results. Further, many of the elements that are described are functional entities that may be implemented as discrete or distributed components or in conjunction with other components, in any suitable combination and location.

[0073] While various aspects and implementations have been disclosed herein, other aspects and implementations will be apparent to those skilled in the art. The various aspects and implementations disclosed herein are for purposes of illustration and are not intended to be limiting, with the true scope being indicated by the following claims, along with the full scope of equivalents to which such claims are entitled. Also, the terminology used herein is for the purpose of describing particular implementations only, and is not intended to be limiting.

[0074] Embodiments of the present disclosure can thus relate to one of the enumerated example embodiments (EEEs) listed below.

[0075] EEE 1 is a display device comprising: a display; a touch sensor configured to provide a position signal indicating a position of a human touch relative to the display; a force sensor configured to provide force information indicating a magnitude of a force applied by the human touch; and a processor performing operations comprising: tracking a baseline position signal generated by the touch sensor due to presence of one or more non-human objects, detecting at a point in time, based on the force information provided by the force sensor, that a magnitude of the force exceeds a threshold force, and responsively, removing the baseline position signal from a respective position signal provided by the touch sensor at the point in time at which the magnitudeof the force exceeds the threshold force, thereby generating a clean position signal indicating a location of the human touch relative to the display.

[0076] EEE 2 is the display device of EEE 1 , wherein the operations further comprise: dividing the display into a plurality of regions; determining, based on the force information provided by the force sensor, a preliminary location of the human touch; and confirming the location of the human touch based on the clean position signal.

[0077] EEE 3 is the display device of EEE 2, wherein the operations further comprise: ignoring, based on the preliminary location, a given position signal provided by the touch sensor for a region of the plurality of regions of the display; and taking into consideration one or more regions, other than the region ignored based on the preliminary location indicated by the force sensor, to determine the location of the human touch.

[0078] EEE 4 is the display device of any of EEEs 2-3, wherein dividing the display into the plurality of regions comprises: dividing the display into quadrants.

[0079] EEE 5 is the display device of any of EEEs 1-4, wherein the operations further comprise: generating a graphical user-interface on the display; and taking an action on the graphical userinterface based on the location of the human touch relative to the display.

[0080] EEE 6 is the display device of any of EEEs 1-5, further comprising: a protective lens, wherein the touch sensor is interposed between the protective lens and the touch sensor.

[0081] EEE 7 is the display device of EEE 6, wherein the force sensor is interposed between the touch sensor and the display.

[0082] EEE 8 is a method of operating the display device of any of EEEs 1-7. For example, the method comprises: generating, by a processor, a graphical user-interface on a display of a displaydevice, wherein the display device comprises: (i) a touch sensor configured to provide a position signal indicating a position of a human touch relative to the graphical user-interface, and (ii) a force sensor configured to provide force information indicating a magnitude of a force applied by the human touch; tracking, by the processor, a baseline position signal generated by the touch sensor due to presence of one or more non-human objects; detecting at a point in time, based on the force information provided by the force sensor, that a magnitude of the force exceeds a threshold force; responsively, removing the baseline position signal from a respective position signal provided by the touch sensor at the point in time at which the magnitude of the force exceeds the threshold force, thereby generating a clean position signal indicating a location of the human touch relative to the graphical user-interface; and taking an action on the graphical user-interface based on the location of the human touch.

[0083] EEE 9 is the method of EEE 8, further comprising: dividing the display into a plurality of regions; determining, based on the force information provided by the force sensor, a preliminary location of the human touch; and confirming the location of the human touch based on the clean position signal.

[0084] EEE 10 is the method of EEE 9, further comprising: ignoring, based on the preliminary location, a given position signal provided by the touch sensor for a region of the plurality of regions of the display; and taking into consideration one or more regions, other than the region ignored based on the preliminary location indicated by the force sensor, to determine the location of the human touch.

[0085] EEE 11 is the method of any of EEEs 9-10, wherein dividing the display into the plurality of regions comprises: dividing the display into quadrants.

[0086] EEE 12 is the method of any of EEEs 8-1 1, wherein the display device further comprises a protective lens, wherein the touch sensor is interposed between the protective lens and the touch sensor.

[0087] EEE 13 is the method of EEE 12, wherein the force sensor is interposed between the touch sensor and the display.

[0088] EEE 14 is a vehicle that includes the display device of any of EEEs 1-7, and / or a processor that performs the operations of the method of any of EEEs 8-13. For example, the vehicle comprises: a display device comprising a display, a touch sensor configured to provide a position signal indicating a position of a human touch relative to the display, and a force sensor configured to provide force information indicating a magnitude of a force applied by the human touch; and a processor performing operations comprising: tracking a baseline position signal generated by the touch sensor due to presence of one or more non-human objects, detecting at a point in time, based on the force information provided by the force sensor, that a magnitude of the force exceeds a threshold force, and responsively, removing the baseline position signal from a respective position signal provided by the touch sensor at the point in time at which the magnitude of the force exceeds the threshold force, thereby generating a clean position signal indicating a location of the human touch relative to the display.

[0089] EEE 15 is the vehicle of EEE 14, wherein the operations further comprise: dividing the display into a plurality of regions; determining, based on the force information provided by the force sensor, a preliminary location of the human touch; and confirming the location of the human touch based on the clean position signal.

[0090] EEE 16 is the vehicle of EEE 15, wherein the operations further comprise: ignoring, based on the preliminary location, a given position signal provided by the touch sensor for a region ofthe plurality of regions of the display; and taking into consideration one or more regions, other than the region ignored based on the preliminary location indicated by the force sensor, to determine the location of the human touch.

[0091] EEE 17 is the vehicle of any of EEEs 15-16, wherein dividing the display into the plurality of regions comprises: dividing the display into quadrants.

[0092] EEE 18 is the vehicle of any of EEEs 14-17, wherein the operations further comprise: generating a graphical user-interface on the display; and taking an action regarding operation of the vehicle based on the location of the human touch relative to the display.

[0093] EEE 19 is the vehicle of any of EEEs 14-18, wherein the display device further comprises: a protective lens, wherein the touch sensor is interposed between the protective lens and the touch sensor.

[0094] EEE 20 is the vehicle of EEE 19, wherein the force sensor is interposed between the touch sensor and the display.

Claims

CLAIMSWhat is claimed is:1 . A display device comprising: a display; a touch sensor configured to provide a position signal indicating a position of a human touch relative to the display; a force sensor configured to provide force information indicating a magnitude of a force applied by the human touch; and a processor performing operations comprising: tracking a baseline position signal generated by the touch sensor due to presence of one or more non -human objects, detecting at a point in time, based on the force information provided by the force sensor, that a magnitude of the force exceeds a threshold force, and responsively, removing the baseline position signal from a respective position signal provided by the touch sensor at the point in time at which the magnitude of the force exceeds the threshold force, thereby generating a clean position signal indicating a location of the human touch relative to the display.

2. The display device of claim 1, wherein the operations further comprise: dividing the display into a plurality of regions; determining, based on the force information provided by the force sensor, a preliminary location of the human touch; and confirming the location of the human touch based on the clean position signal.

3. The display device of claim 2, wherein the operations further comprise: ignoring, based on the preliminary location, a given position signal provided by the touch sensor for a region of the plurality of regions of the display; and taking into consideration one or more regions, other than the region ignored based on the preliminary location indicated by the force sensor, to determine the location of the human touch.

4. The display device of claim 2, wherein dividing the display into the plurality of regions comprises: dividing the display into quadrants.

5. The display device of claim 1, wherein the operations further comprise: generating a graphical user-interface on the display; and taking an action on the graphical user-interface based on the location of the human touch relative to the display.

6. The display device of claim 1, further comprising: a protective lens, wherein the touch sensor is interposed between the protective lens and the touch sensor.

7. The display device of claim 6, wherein the force sensor is interposed between the touch sensor and the display.

8. A method comprising: generating, by a processor, a graphical user-interface on a display of a display device, wherein the display device comprises: (i) a touch sensor configured to provide a position signal indicating a position of a human touch relative to the graphical user-interface, and (ii) a force sensor configured to provide force information indicating a magnitude of a force applied by the human touch; tracking, by the processor, a baseline position signal generated by the touch sensor due to presence of one or more non-human objects; detecting at a point in time, based on the force information provided by the force sensor, that a magnitude of the force exceeds a threshold force; responsively, removing the baseline position signal from a respective position signal provided by the touch sensor at the point in time at which the magnitude of the force exceeds the threshold force, thereby generating a clean position signal indicating a location of the human touch relative to the graphical user-interface; and taking an action on the graphical user-interface based on the location of the human touch.

9. The method of claim 8, further comprising: dividing the display into a plurality of regions; determining, based on the force information provided by the force sensor, a preliminary location of the human touch; and confirming the location of the human touch based on the clean position signal.

10. The method of claim 9, further comprising: ignoring, based on the preliminary location, a given position signal provided by the touch sensor for a region of the plurality of regions of the display; and taking into consideration one or more regions, other than the region ignored based on the preliminary location indicated by the force sensor, to determine the location of the human touch.

11. The method of claim 9, wherein dividing the display into the plurality of regions comprises: dividing the display into quadrants.

12. The method of claim 8, wherein the display device further comprises a protective lens, wherein the touch sensor is interposed between the protective lens and the touch sensor.

13. The method of claim 12, wherein the force sensor is interposed between the touch sensor and the display.

14. A vehicle comprising: a display device comprising: a display, a touch sensor configured to provide a position signal indicating a position of a human touch relative to the display, and a force sensor configured to provide force information indicating a magnitude of a force applied by the human touch; and a processor performing operations comprising: tracking a baseline position signal generated by the touch sensor due to presence of one or more non-human objects,detecting at a point in time, based on the force information provided by the force sensor, that a magnitude of the force exceeds a threshold force, and responsively, removing the baseline position signal from a respective position signal provided by the touch sensor at the point in time at which the magnitude of the force exceeds the threshold force, thereby generating a clean position signal indicating a location of the human touch relative to the display.

15. The vehicle of claim 14, wherein the operations further comprise: dividing the display into a plurality of regions; determining, based on the force information provided by the force sensor, a preliminary location of the human touch; and confirming the location of the human touch based on the clean position signal.

16. The vehicle of claim 15, wherein the operations further comprise: ignoring, based on the preliminary location, a given position signal provided by the touch sensor for a region of the plurality of regions of the display; and taking into consideration one or more regions, other than the region ignored based on the preliminary location indicated by the force sensor, to determine the location of the human touch.

17. The vehicle of claim 15, wherein dividing the display into the plurality of regions comprises: dividing the display into quadrants.

18. The vehicle of claim 14, wherein the operations further comprise: generating a graphical user-interface on the display; and taking an action regarding operation of the vehicle based on the location of the human touch relative to the display.

19. The vehicle of claim 14, wherein the display device further comprises: a protective lens, wherein the touch sensor is interposed between the protective lens and the touch sensor.

20. The vehicle of claim 19, wherein the force sensor is interposed between the touch sensor and the display.

Images