Screen keyboard user interface with contextually aware haptic feedback

Abstract

An electronic device displays a keyboard user interface on a touch screen display panel. An electronic device detects a key press interaction with a keyboard user interface. The electronic device triggers one or more haptic actuators to generate a vibration waveform associated with a haptic pattern based at least in part on a context associated with the key press interaction. A corresponding method and a non-transitory computer readable medium are also described.

Description

[0001] Cross - Reference to Related Applications

[0002] This patent application claims priority to U.S. Patent Application No. 18 / 148,006, filed on December 29, 2022, entitled "ON - SCREEN KEYBOARD USER INTERFACE WITH CONTEXT - AWARE HAPTIC FEEDBACK", which has been assigned to the assignee of the present application. The disclosure of the prior application is considered to be a part of the present patent application and is incorporated herein by reference. Technical Field

[0003] Aspects of the present disclosure generally relate to on - screen keyboard user interfaces, and for example, to providing context - aware haptic feedback to a user interacting with an on - screen keyboard user interface. Background Art

[0004] Haptic technology, sometimes referred to as kinesthetic technology or three - dimensional (3D) touch technology, refers to technologies that can create a touch experience (e.g., a tactile experience) by applying force, vibration, motion, or other feedback that generates a user - perceivable tactile sensation (e.g., physical or mechanical output). For example, haptic technology can be used (e.g., in extended reality applications) to simulate the feeling of touching an object in a virtual environment, can be used to provide haptic feedback or tactile indication in a control system, and / or can be used to provide physical or tactile elements to music, among many other use cases. In some cases, haptic technology can include tactile sensors that can measure the force applied by a user on an interface and / or can include tactile actuators that can generate the force perceived by a user on an interface. Summary of the Invention

[0005] Some aspects described herein relate to a method performed by an electronic device. The method can include displaying a keyboard user interface on a touch - screen display panel. The method can include detecting a key - press interaction with the keyboard user interface. The method can include triggering one or more tactile actuators to generate a vibration waveform associated with a haptic pattern that is at least partially based on the context associated with the key - press interaction.

[0006] Some aspects described herein relate to an electronic device. The electronic device may include a memory and one or more processors coupled to the memory. The one or more processors may be configured to display a keyboard user interface on a touchscreen display panel. The one or more processors may be configured to detect key press interactions with the keyboard user interface. The one or more processors may be configured to trigger one or more haptic actuators to generate a vibration waveform associated with a haptic pattern that is at least partially based on a context associated with the key press interaction.

[0007] Some aspects described herein relate to a non-transitory computer-readable medium storing an instruction set. When executed by one or more processors of an electronic device, the instruction set may cause the electronic device to display a keyboard user interface on a touchscreen display panel. When executed by one or more processors of an electronic device, the instruction set may cause the electronic device to detect key press interactions with the keyboard user interface. When executed by one or more processors of an electronic device, the instruction set may cause the electronic device to trigger one or more haptic actuators to generate a vibration waveform associated with a haptic pattern that is at least partially based on a context associated with the key press interaction.

[0008] Some aspects described herein relate to an apparatus. The apparatus may include means for displaying a keyboard user interface on a touchscreen display panel. The apparatus may include means for detecting key press interactions with the keyboard user interface. The apparatus may include means for triggering one or more haptic actuators to generate a vibration waveform associated with a haptic pattern that is at least partially based on a context associated with the key press interaction.

[0009] Aspects generally include methods, apparatuses, systems, computer program products, non-transitory computer-readable media, electronic devices, user devices, wireless communication devices, and / or processing systems substantially as described and illustrated in connection with the figures and the specification.

[0010] The features and technical advantages of examples in accordance with the present disclosure have been outlined rather broadly above so that the detailed description that follows may be better understood. Additional features and advantages will be described hereinafter. The disclosed concepts and specific examples may be readily utilized as a basis for modifying or designing other structures for carrying out the same purposes of the present disclosure. Such equivalent constructions do not depart from the scope of the appended claims. When considered in conjunction with the accompanying figures, the characteristics (both structural and operational methods) of the concepts disclosed herein, as well as the associated advantages, will be better understood. Each of the figures is provided for the purpose of illustration and description and is not intended as a limitation on the claims. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] To understand the above features of the present disclosure in detail, a more specific description of what was briefly outlined above can be obtained by referring to various aspects, some of which are illustrated in the accompanying drawings. It should be noted, however, that the drawings only illustrate certain typical aspects of the present disclosure and should not be considered as limiting the scope of the present disclosure, since the description may allow other equally effective aspects. The same reference numerals in different drawings may identify the same or similar elements.

[0012] Figure 1 FIG. is an example showing haptic feedback that can be provided by a physical keyboard device according to the present disclosure.

[0013] Figure 2 FIG. is an example environment showing a screen keyboard user interface associated with context-aware haptic feedback that can be implemented according to the present disclosure.

[0014] Figure 3 FIG. shows according to the present disclosure Figure 2 FIG. is a diagram showing example components of one or more devices (such as an electronic device that can present a screen keyboard user interface associated with context-aware haptic feedback) shown in

[0015] Figures 4A - 4F FIG. is an example showing a screen keyboard user interface associated with context-aware haptic feedback according to the present disclosure.

[0016] Figure 5 FIG. is a diagram showing an example process associated with configuring a screen keyboard user interface associated with context-aware haptic feedback according to the present disclosure.

[0017] Figure 6 FIG. is a diagram showing an example process associated with applying context-aware haptic feedback to a screen keyboard user interface according to the present disclosure.

[0018] Figure 7 FIG. is a flowchart of an example process associated with a screen keyboard user interface associated with context-aware haptic feedback according to the present disclosure. DETAILED DESCRIPTION

[0019] Aspects of the present disclosure are described more fully hereinafter with reference to the accompanying drawings. However, the present disclosure may be embodied in many different forms and should not be construed as limited to any specific structure or function presented throughout this disclosure. Rather, these aspects are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the present disclosure to those skilled in the art. Those skilled in the art should understand that the scope of the present disclosure is intended to cover any aspect of the present disclosure disclosed herein, whether implemented independently of any other aspect of the present disclosure or in combination with any other aspect of the present disclosure. For example, any number of the aspects set forth herein may be used to implement an apparatus or practice a method. Additionally, the scope of the present disclosure is intended to cover apparatuses or methods practiced using other structures, functions, or combinations of structures and functions in addition to or different from the aspects of the present disclosure set forth herein. It should be understood that any aspect of the present disclosure disclosed herein may be embodied by one or more elements of a claim.

[0020] Figure 1 FIG. 100 is a diagram illustrating an example 100 of haptic feedback that may be provided by a physical keyboard device in accordance with the present disclosure.

[0021] Mobile electronic devices typically display a screen keyboard user interface to allow a user to support data input or data entry by typing. For example, the screen keyboard user interface may be displayed on a touchscreen display panel equipped with capacitive sensors or other suitable mechanical means to map keyboard interactions to keys associated with the screen keyboard user interface. Although the specific layout in the screen keyboard user interface may vary (e.g., an alphabet layout may be used for text entry, buttons may be provided to switch between the alphabet layout and a number and punctuation layout, an email layout may include an "@" or ".com" key for entering an email address, etc.), the screen keyboard user interface generally mimics or emulates the QWERTY layout commonly used in physical keyboard devices. However, mobile electronic devices typically have small screens that display the screen keyboard user interface in limited space, which can still pose challenges to users attempting to type using the screen keyboard user interface, despite advances such as support for swipe typing.

[0022] For example, physical keyboard devices are typically designed to provide distinct mechanical or haptic feedback to improve typing accuracy and / or reduce the visual attention required for typing or retyping. For example, reference Figure 1, reference numeral 110 depicts an example of haptic feedback that can be provided when a user presses the center of a key, where each key on the keyboard can have a profile that allows the user to know when the center of the target key is pressed (e.g., the key can have a profile that intuitively guides the user to press the center of the key). In a similar aspect, reference numeral 120 depicts an example of haptic feedback that can be provided when a user presses the edge of a key or the gap between adjacent keys, which can have a different haptic feel from pressing the center of the key (e.g., there is typically a distance of about 5 millimeters (mm) between the switch holes of adjacent keys on a physical keyboard device). In this way, the physical keyboard device provides haptic or mechanical feedback that allows the user to know whether a key has been pressed correctly (e.g., at the center of the key rather than the edge of the key or the boundary between adjacent keys). Additionally, a user of the physical keyboard device can sense whether a key has been pressed correctly or incorrectly (e.g., based on the resistance when the key is pressed incorrectly or stuck). On the other hand, for a typical on-screen keyboard user interface, the user needs to visually check what has been typed and re-type to correct mis-typed letters or characters. In some cases, the user needs to visually pay attention to the on-screen keyboard user interface, which can pose a safety hazard as the user may not be aware of events occurring in their surrounding environment or be distracted by events occurring in their surrounding environment.

[0023] In another example, as shown by reference numerals 130 and 135, a physical keyboard device typically includes various keys with standard keycap sizes and various keys with non-standard (e.g., larger) keycap sizes. For example, the standard keycap size on a typical physical keyboard device is approximately 18 mm wide, which is defined as one (1) unit, which can be abbreviated as 1u, and the standard 1u keycap size is typically used for alphanumeric characters (e.g., A-Z and 0-9) and various punctuation keys (e.g., comma, period, parentheses, dash, etc.). Additionally, larger keycap sizes can be used for special keys or modifier keys, such as 1.25u for control keys and / or alternate (alt) keys, 1.5u for the tab key, 2u for the backspace key, 6.25u for the spacebar key, etc., which can refer to a multiplicative scaling factor applied to the width of the standard keycap size (e.g., a spacebar with a keycap size of 6.25u can have a width of approximately 112.5 mm on a keyboard where the standard 1u keycap size is 18 mm). In this way, the variability of the keycap sizes used on a physical keyboard device allows a user to distinguish between keys with standard keycap sizes and special keys with larger keycap sizes without expending visual attention. In contrast, in a typical on-screen keyboard user interface, there is no mechanical or physical feedback for distinguishing between keys with different keycap sizes or keys with special functions. Instead, insofar as the electronic device currently provides any tactile or mechanical feedback to the user, the feedback is limited to a simple tactile vibration to confirm key presses, rather than providing any feedback indicating the context associated with the key presses. Additionally, in some cases, special keys with non-standard (e.g., larger) keycap sizes on a typical physical keyboard device can have a standard keycap size in the on-screen keyboard user interface.

[0024] Some aspects described herein relate to techniques for providing context - aware haptic feedback to a user based on contexts associated with keyboard interactions with a screen - keyboard user interface. For example, in some aspects, an electronic device can be configured to present vibration waveforms associated with different haptic patterns during a keyboard interaction with a screen - keyboard user interface, which can reduce the visual attention required by the user when typing or re - typing and / or provide more immediate feedback regarding typing accuracy during a screen - keyboard interaction. For example, in some aspects, contexts associated with a keyboard interaction with a screen - keyboard user interface can be detected by a touch - screen controller, a force sensor, previously typed characters, and / or an active application, and different context - aware haptic waveforms can be used to provide haptic feedback regarding the keyboard interaction. For example, in some aspects, context - aware vibration waveforms or haptic waveforms can be used to indicate or confirm a key press at the center of a key, a key press at the edge of a key or at a boundary between adjacent keys, a selection of a special key (e.g., shift, tab, caps lock, spacebar, etc.), a space to be added after the last character in a word to be typed, a press - and - hold on a particular key, and / or an automatic switch between uppercase and lowercase. Additionally or alternatively, in some aspects, an electronic device can be configured to present force - aware haptic feedback to assist in guiding and training a user regarding the correct amount of force and finger contact to apply when interacting with a screen - keyboard user interface, which can reduce user typing fatigue, reduce incorrect key presses or mis - presses, and / or otherwise improve the user experience during an interaction with a screen - keyboard user interface.

[0025] As described above, Figure 1 is provided as an example. Other examples may be different from those described with respect to Figure 1 what is described.

[0026] Figure 2 is a diagram showing an example environment 200 in which a screen - keyboard user interface associated with context - aware haptic feedback can be implemented according to the present disclosure. As Figure 2 shown, the environment 200 can include an electronic device 210, a network node 220, and a network 230. The devices of the environment 200 can be interconnected via a wired connection, a wireless connection, or a combination of a wired connection and a wireless connection.

[0027] The electronic device 210 includes one or more devices capable of presenting context - aware haptic feedback based on an interaction with a screen - keyboard user interface displayed on the electronic device 210. For example, as shown, the electronic device 210 can include a touch - screen display panel or other suitable interface that can display a screen - keyboard user interface. Additionally, although not shown in Figure 2Although not explicitly shown in the figure, the electronic device 210 may include one or more sensors that can detect interactions with the on-screen keyboard user interface and one or more actuators that can generate vibration waveforms associated with a haptic pattern that is at least partially based on the context associated with the key press interaction. For example, in some aspects, the electronic device 210 may include a wired and / or wireless communication and / or computing device equipped with appropriate display, sensor, and actuator components, such as a user equipment (UE), a mobile phone (e.g., a smartphone, a wireless phone, etc.), a laptop computer, a tablet computer, a handheld computer, a desktop computer, a gaming device, a wearable communication device (e.g., a smartwatch or smart glasses), etc.

[0028] The network node 220 includes one or more devices capable of receiving, generating, storing, processing, and / or providing information related to interactions with the on-screen keyboard user interface displayed on the electronic device 210. For example, the network node 220 may include a base station (Node B, gNB, and / or 5G Node B (NB), etc.), a UE, a relay device, a network controller, an access point, a transmit receive point (TRP), a device, an apparatus, a computing system, one or more components of any of these, and / or additional processing entities configured to perform one or more aspects of the techniques described herein. For example, the network node 220 may be one or more components of an aggregated base station and / or a disaggregated base station, which may receive data entered by a user into the electronic device 210 using a keyboard user interface that supports context-aware haptic feedback, send data to configure the context-aware haptic feedback presented on the electronic device 210, etc.

[0029] The network 230 includes one or more wired and / or wireless networks. For example, the network 230 may include a cellular network (e.g., a Long Term Evolution (LTE) network, a Code Division Multiple Access (CDMA) network, a 3G network, a 4G network, a 5G network, another type of next-generation network, etc.), a Public Land Mobile Network (PLMN), a Local Area Network (LAN), a Wide Area Network (WAN), a Metropolitan Area Network (MAN), a telephone network (e.g., a Public Switched Telephone Network (PSTN)), a private network, an ad hoc network, an intranet, the Internet, a fiber-based network, a cloud computing network, etc. and / or a combination of these or other types of networks.

[0030] Figure 2 The number and arrangement of the devices and networks shown in the figure are provided as examples. In practice, there may be additional devices and / or networks, fewer devices and / or networks, different devices and / or networks, or differently arranged devices and / or networks compared to the Figure 2 devices and / or networks shown in the figure. Additionally, Figure 2 two or more of the devices shown in the figure may be implemented within a single device, orFigure 2 The single device shown in Figure 2 can be implemented as multiple distributed devices. Additionally or alternatively, a set of devices (e.g., one or more devices) of environment 200 can perform one or more functions described as being performed by another set of devices of environment 200.

[0031] Figure 3 FIG. [FIG. number] is a diagram illustrating example components of device 300 in accordance with the present disclosure. In some aspects, device 300 can correspond to Figure 2 the electronic device 210 and / or network node 220 shown in Figure 2 . In some aspects, the electronic device 210 and / or network node 220 can include one or more devices 300 and / or one or more components of device 300. As Figure 3 shown, device 300 can include a bus 305, a processor 310, a memory 315, a storage component 320, an input component 325, an output component 330, a communication interface 335, a sensor 340, an actuator 345, and / or a haptic feedback component 350.

[0032] The bus 305 includes components that permit communication between the components of device 300. The processor 310 is implemented in hardware, firmware, or a combination of hardware and software. The processor 310 is a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), a microprocessor, a microcontroller, a digital signal processor (DSP), a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), or another type of processing component. In some aspects, the processor 310 includes one or more processors that can be programmed to perform functions. The memory 315 includes random access memory (RAM), read only memory (ROM), and / or another type of dynamic or static storage device that stores information and / or instructions for use by the memory 310 (e.g., flash memory, magnetic memory, and / or optical memory).

[0033] The storage component 320 stores information and / or software related to the operation and use of device 300. For example, the storage component 320 can include a hard disk (e.g., a magnetic disk, an optical disk, a magneto-optical disk, and / or a solid state disk), a compact disk (CD), a digital versatile disk (DVD), a floppy disk, a cassette tape, a magnetic tape, and / or another type of non-transitory computer-readable medium, as well as a corresponding drive.

[0034] The input component 325 includes components that allow the device 300 to receive information, such as via user input (e.g., a touch screen display, a keyboard, a keypad, a mouse, buttons, switches, and / or a microphone). Additionally or alternatively, the input component 325 may include components for determining the location or position of the device 300 (e.g., a Global Positioning System (GPS) component or a Global Navigation Satellite System (GNSS) component) and / or sensors for sensing information (e.g., an accelerometer, a gyroscope, or another type of position or environmental sensor). The output component 330 includes components that provide output information from the device 300 (e.g., a display, a speaker, and / or an audio or visual indicator).

[0035] The communication interface 335 includes transceiver-like components (e.g., a transceiver and / or separate receiver and transmitter) that enable the device 300 to communicate with other devices, such as via a wired connection, a wireless connection, or a combination of wired and wireless connections. The communication interface 335 may allow the device 300 to receive information from another device and / or provide information to another device. For example, the communication interface 335 may include an Ethernet interface, an optical interface, a coaxial interface, an infrared interface, a radio frequency interface, a Universal Serial Bus (USB) interface, a wireless local area interface (e.g., a Wi-Fi interface), and / or a cellular network interface.

[0036] The sensor 340 includes one or more wired or wireless devices that are capable of receiving, generating, storing, transmitting, processing, detecting, and / or providing information associated with the state of the device 300 and / or the environment surrounding the device 300, as described elsewhere herein. For example, the sensor 340 may include a touch screen controller, a force sensor, a motion sensor, an accelerometer, a gyroscope, a proximity sensor, a light sensor, a noise sensor, a pressure sensor, an ultrasonic sensor, a positioning sensor, a capacitance sensor, a timing device, an infrared sensor, an active sensor (e.g., one that requires an external power signal), a passive sensor (e.g., one that does not require an external power signal), a biological or biometric sensor, a smoke sensor, a gas sensor, a chemical sensor, an alcohol sensor, a temperature sensor, a water vapor sensor, a humidity sensor, a radioactive sensor, a magnetic sensor, an electromagnetic sensor, an analog sensor, and / or a digital sensor, etc. The sensor 340 may sense or detect conditions or information related to the state of the device 300 and / or the environment surrounding the device 300, and send an indication of the detected conditions or information to other components of the device 300 and / or other devices using a wired or wireless communication interface.

[0037] Actuator 345 includes one or more devices capable of receiving, generating, storing, transmitting, processing, detecting, and / or providing information associated with the state of device 300 and / or the environment surrounding device 300, as described elsewhere herein. For example, actuator 345 may include a haptic actuator such as a linear resonant actuator (LRA), an eccentric rotating mass (ERM) vibration motor, a piezoelectric actuator, an ultrasonic or electrostatic friction modulation surface actuator, and / or other suitable devices or combinations of devices configured to generate vibration waveforms or have different mechanical haptic patterns (e.g., based on a context associated with an interaction with a screen keyboard user interface).

[0038] Haptic feedback component 350 includes one or more devices capable of receiving, generating, storing, transmitting, processing, detecting, and / or providing context-aware haptic feedback based on an interaction with a screen keyboard user interface, as described elsewhere herein. In some aspects, haptic feedback component 350 may include a haptic actuator driver or other suitable device that can drive actuator 345. For example, in some aspects, haptic feedback component 350 may display a keyboard user interface on a touchscreen display panel associated with output component 330, may detect a key press interaction with the keyboard user interface based on information sensed by one or more sensors 340, and may trigger one or more actuators 345 to generate a vibration waveform associated with a haptic pattern that is at least partially based on the context associated with the key press interaction.

[0039] Device 300 may perform one or more of the processes described herein. Device 300 may perform these processes based on software instructions stored by a non-transitory computer-readable medium (such as memory 315 and / or storage component 320) and executed by processor 310. A computer-readable medium is defined herein as a non-transitory memory device. A memory device includes memory space within a single physical storage device or memory space distributed across multiple physical storage devices.

[0040] Software instructions may be read into memory 315 and / or storage component 320 from another computer-readable medium or from another device via communication interface 335. When executed, the software instructions stored in memory 315 and / or storage component 320 may cause processor 310 to perform one or more of the processes described herein. Additionally or alternatively, hardwired circuitry may be used in place of or in combination with software instructions to perform one or more of the processes described herein. Accordingly, aspects described herein are not limited to any particular combination of hardware circuitry and software.

[0041] In some aspects, device 300 includes components for performing one or more of the processes described herein and / or for performing one or more operations of the processes described herein. For example, device 300 can include components for displaying a keyboard user interface, components for detecting key press interactions with the keyboard user interface, and / or components for triggering one or more tactile actuators to generate a vibration waveform associated with a tactile pattern that is at least partially based on the context associated with the key press interaction. In some aspects, these components can include one or more components of device 300 described in conjunction with Figure 3 such as bus 305, processor 310, memory 315, storage component 320, input component 325, output component 330, communication interface 335, sensor 340, actuator 345, and / or tactile feedback component 350.

[0042] Figure 3 The number and arrangement of the components shown in Figure 3 are provided as an example. In practice, device 300 can include additional components, fewer components, different components, or differently arranged components compared to the components shown in

[0043] Figures 4A - 4F is a diagram showing an example 400 associated with a screen keyboard user interface according to the present disclosure and associated with context-aware tactile feedback. As Figure 4A shown, example 400 can be performed by any suitable electronic device including a touchscreen display panel and a screen keyboard area in which a screen keyboard user interface is displayed or otherwise presented. For example, in Figure 4A , the screen keyboard user interface is displayed in portrait mode in the screen keyboard area of the touchscreen display panel, but it should be understood that example 400 can also apply when the screen keyboard user interface is displayed in landscape mode. Additionally, although Figure 4A shows an alphabetical layout of the screen keyboard user interface, it should be understood that example 400 can also apply to other keyboard layouts (e.g., numeric keypad layout, number and punctuation layout, email address layout, etc.). As Figure 4AAs further shown herein, the electronic device includes a force sensor and / or other suitable sensors (e.g., a touchscreen controller) that can detect a location and force (or pressure) associated with an interaction with one or more keyboards, and one or more haptic actuators that can generate or otherwise present a vibration waveform. For example, in some aspects, the one or more haptic actuators can include an LRA, an ERM vibration motor, a piezoelectric actuator, an ultrasonic or electrostatic friction modulation surface actuator, and / or any other suitable device or combination of devices configured to generate a vibration waveform or have different mechanical haptic patterns.

[0044] As shown by reference numeral 410 and described in more detail herein, the electronic device can be configured to trigger haptic feedback using one or more haptic actuators based on the context of one or more keyboard interactions. For example, as described herein, the electronic device can display a keyboard user interface on a touchscreen display panel (e.g., in a screen keyboard region that can vary depending on whether the electronic device is in portrait or landscape mode), and the electronic device can detect a key press interaction with the keyboard user interface. For example, in some aspects, the context associated with a key press interaction can include the location pressed within the screen keyboard user interface that can be detected using a touchscreen controller, the amount of force or pressure used to press the location within the screen keyboard user interface that can be detected using a force sensor, and / or the typing context (e.g., previously typed characters and / or the application associated with the keyboard input) that can be detected by one or more processors of the electronic device. Thus, in the case where the context associated with the current keyboard interaction involves a particular event, the one or more haptic actuators can be triggered to generate a vibration waveform associated with a haptic pattern corresponding to the event, which minimizes the visual attention required by the user when typing or retyping and / or otherwise improves the user experience when interacting with the screen keyboard user interface.

[0045] For example, in some aspects, various keyboard interactions can each be associated with a particular haptic pattern, whereby the vibration waveform generated by the one or more haptic actuators for the current keyboard interaction can provide a user-perceivable tactile indication or confirmation of the context of the current keyboard interaction. For example, as described herein with reference to Figures 4B - 4FMore specifically, different haptic patterns can be configured to indicate or confirm key presses in the key center region, key presses in the key edge region or the boundary region between adjacent keys, the force used in a key press, key presses for selecting special keys (e.g., shift, control, tab, space, etc.), key presses using additional force indicating the last character in the typed word, key presses where the key is pressed and held for a long period of time, and / or automatic switching or toggling between uppercase and lowercase (e.g., when typing the first letter in a new sentence and / or when switching from the first letter to the second letter of a word). Additionally, it should be understood that although some aspects described herein relate to certain typing scenarios that can be associated with specific haptic patterns, the techniques described herein can be applied to any suitable typing scenario (e.g., different haptic patterns can be presented when suggested autocomplete words are available and / or when the user selects a key to switch between different keyboard layouts such as from an alphabet layout to a number and punctuation layout or an emoji layout, etc.). Further, in some aspects, the haptic patterns associated with a specific typing scenario can be configured in various ways (e.g., the user can enable or disable haptic feedback for one or more typing scenarios and / or all typing scenarios, can enable a default haptic pattern or define a custom haptic pattern for one or more typing scenarios, and / or can define one or more keyboard interactions or sequences of keyboard interactions as typing scenarios that will be associated with the default or configurable haptic patterns).

[0046] Accordingly, as described herein, an electronic device can trigger one or more haptic actuators to generate a vibration waveform associated with a specific haptic pattern that is configured for a context associated with a current keyboard interaction, which can provide a user with a tactile feedback that differentiates various keyboard interactions with a screen keyboard user interface that can be performed with or without additional force or pressure. In this way, using configurable haptic patterns to provide haptic feedback can improve the user experience when interacting with a screen keyboard user interface, can reduce the visual attention that a user may need when typing (e.g., by allowing the user to observe and focus on events in the surrounding environment, such as when walking in a busy area, potentially increasing safety) and / or can increase the screen space available for displaying the screen keyboard user interface by removing keys that may be associated with a force perception and / or haptic perception context. Additionally, in some cases, different haptic actuators and / or different combinations of haptic actuators can be used to differentiate one typing context from another. For example, in some aspects, haptic actuators that can be equipped in an electronic device can include LRAs, ERM vibration motors, piezoelectric actuators, ultrasonic or electrostatic friction modulation surface actuators, and / or any other suitable haptic actuators, and one or more of the haptic actuators can be triggered based on a specific typing context and a desired vibration waveform. Further, in the case of simultaneously triggering multiple haptic actuators to generate a composite vibration waveform for a current keyboard interaction, the composite vibration waveform can be divided into different components presented using different haptic actuators (e.g., a low-frequency component can be provided by an LRA and a high-frequency component can be provided by a piezoelectric actuator, etc.).

[0047] In some aspects, in addition to providing haptic feedback to indicate or confirm and typing scenarios associated with keyboard interaction with the on-screen keyboard user interface, the electronic device can trigger one or more haptic actuators to apply force-aware haptic feedback to guide and train the user regarding the correct amount of force and finger contact to apply when interacting with the on-screen keyboard user interface. For example, some users may press too hard on the keyboard display area, which may flatten the fingertip area and potentially cause the user to press multiple keys and / or false detection of the intended key press. On the other hand, some users may press too lightly on the keyboard, which may result in the failure to detect the intended keyboard interaction. Thus, in some aspects, the electronic device can (e.g., via one or more haptic actuators) apply haptic feedback to indicate the appropriate amount of force the user should apply in a key press, which can reduce false detection or non-detection of key presses, reduce user typing fatigue and / or otherwise improve the user experience when interacting with the on-screen keyboard user interface. For example, in some aspects, the force applied when the user performs a key press can be used to vary or otherwise adjust the intensity of the vibration waveform generated as haptic feedback. For example, a user key press with a force of approximately twenty (20) Newtons (e.g., corresponding to approximately 4.5 pounds or 2 kilograms) can be associated with 1G of vibrotactile feedback (e.g., a haptic vibration that gives the electronic device a mechanical acceleration of 9.8 meters per second squared, which is the acceleration due to gravity).

[0048] Figures 4B - 4F Shows various examples of specific haptic patterns that can be generated by one or more haptic actuators to provide a tactile feedback to the user indicating or confirming the typing scenario associated with the current keyboard interaction. As Figures 4B - 4F shown, each haptic pattern can be presented as a vibration waveform, where the vertical axis represents the acceleration of the haptic vibration (e.g., in Gs) and the horizontal axis represents time (e.g., in arbitrary units).

[0049] For example, referring to Figure 4B, reference numeral 420 depicts a haptic pattern that can be generated to indicate or confirm a keyboard interaction including a key press in the key center region, and reference numeral 422 depicts a haptic pattern that can be generated to indicate a keyboard interaction including a key press in the key edge region or the boundary region between adjacent keys. For example, in the case where the key press is an accurate press in the center region of a key displayed in a screen keyboard user interface, the vibration waveform can be a square or trapezoidal pulse associated with a sharp rise to a pulse maximum (e.g., the maximum amount of vibration acceleration), a steady state at the pulse maximum, and a sharp drop to zero (e.g., no vibration acceleration). Alternatively, in the case where the key press is in the key edge region or the boundary region between adjacent keys, a different haptic pattern can be generated to indicate a potentially inaccurate or mis-press. For example, in such a case, the vibration waveform can include an initial rise to a pulse maximum and a subsequent decay to a lower sustained amplitude. Thus, when the key press is in the key edge or boundary region, a triangular accentuation can be provided at the start of the vibration waveform, followed by a flatter portion at the end of the vibration waveform, to simulate the tactile response that can be provided by a physical keyboard device when the user presses on the key edge or the gap between adjacent keys.

[0050] In another example, referring to Figure 4C , reference numerals 430, 432, and 434 depict different haptic patterns that can be generated to indicate or confirm the force used in a current keyboard interaction. For example, when a user presses a key on a screen keyboard user interface, the electronic device can (e.g., using a force sensor) measure the force level applied by the user when pressing the key, and the amplitude of the vibration waveform presented by the haptic actuator can depend on the measured force level. For example, as shown by reference numeral 430, when the user applies a normal level of force (e.g., the force level is within a defined range associated with a normal level of force), the vibration waveform can have a baseline amplitude. Alternatively, reference numeral 432 depicts that when the user applies a high level of force (e.g., the force level is above the defined range associated with a normal level of force), the vibration waveform can have an amplitude higher than the baseline amplitude, and reference numeral 434 depicts that when the user applies a low level of force (e.g., the force level is below the defined range associated with a normal level of force), the vibration waveform can have an amplitude lower than the baseline amplitude. Additionally, it should be understood that under various use cases, vibration waveforms associated with different keying scenarios can be combined. For example, if the user presses on the key edge or boundary region with a high level of force, the haptic pattern can include an initial accentuation with a relatively high amplitude (e.g., as shown by reference numeral 422 in Figure 4B ).

[0051] In another example, referring to Figure 4D, reference numerals 440 and 442 depict different haptic patterns that can be generated to indicate or confirm the selection of special keys such as the shift key, caps lock key, tab key, spacebar key, return key, backspace key, etc. For example, as described herein, special keys can generally include any key on a screen keyboard user interface or a physical keyboard device emulated or mimicked by a screen keyboard user interface that has a non-standard keycap size. However, it should be understood that the special keys associated with the haptic pattern depicted by reference numeral 442 can be defined or configured in other ways. As Figure 4D shown, reference numeral 440 depicts a baseline square or trapezoidal pulse that can be generated when a user presses a key other than a special key (e.g., an alphanumeric character or punctuation key) when the special key is not activated (e.g., shift and caps lock are off), which provides a tactile response with a continuous steady state (e.g., potentially varying depending on whether the key press is in the key center region and / or the force applied when pressing a non-special key). Alternatively, reference numeral 442 depicts a vibration waveform that can be generated when a user presses a special key or a non-special key when the special key is activated (e.g., shift and / or caps lock are on). In this case, as shown by reference numeral 442, the vibration waveform can include a precursor pulse before the baseline square or trapezoidal pulse, where the precursor pulse has a maximum amplitude and short duration that are lower than the continuous steady state of the baseline square or trapezoidal pulse (e.g., including a rise time longer than the fall time). In this way, the precursor pulse can provide a different tactile sensation to the user when the special key is pressed or a key press occurs when the special key is activated, to indicate the current state of the keyboard user interface (e.g., guiding the user to prevent accidental activation of caps lock or shift, which can be particularly important when typing password-related hidden fields or other case-sensitive information).

[0052] In another example, referring to Figure 4E, reference numerals 450 and 452 depict haptic patterns that can be used to distinguish key presses that include an added force to indicate the last character in a word. For example, reference numeral 450 depicts a baseline square or trapezoidal pulse that can be generated when a user presses a key with a normal force (e.g., when typing a character other than the last character in a word), and reference numeral 452 depicts a vibration waveform that can be generated when a user presses a key with an additional force to indicate the last character in a word. For example, in some cases, a screen keyboard user interface can be associated with an autocomplete function that suggests one or more words based on the character sequence that has been typed so far. However, in some cases, a word can be a subset of one or more words, which can potentially lead to ambiguity or misleading autocomplete (e.g., the character set "play" by itself is a word in addition to being a subset of "playground" and "player", etc.). Thus, in some aspects, the keyboard user interface can provide the user with the option to apply an additional force to indicate the last character in a word and automatically add a space at the end of the word, and reference numeral 452 depicts a haptic pattern that can be used to indicate or confirm a force press that indicates the last character in a word. For example, as shown by reference numeral 452, the haptic pattern can include an initial portion (where the square or trapezoidal pulse has a sustained steady state at a pulse maximum that is above the baseline amplitude for normal force) and subsequent post-cursor pulses with an amplitude equal to the baseline value (e.g., the post-cursor pulses provide additional tactile feedback to confirm the last letter in the word and the space added after the word).

[0053] In another example, referring to Figure 4F , reference numerals 460 and 462 depict haptic patterns that can be used to indicate a key long press event, where the user presses a key and holds the key pressed, which can potentially lead to accidentally typing multiple repeated letters (e.g., "eeeeeeeee..."). For example, reference numeral 460 depicts a baseline square or trapezoidal pulse that can be generated when a user presses a key with a normal force and immediately lifts their finger, and reference numeral 462 depicts a vibration waveform that can be generated when a user presses a key and holds the key pressed for a period of time. In this case, in addition to the baseline square or trapezoidal pulse, the vibration waveform indicating the long press event can include one or more subsequent square or trapezoidal pulses with an amplitude lower than the initial pulse amplitude, which can repeat periodically until a finger lift event occurs. For example, as shown by reference numeral 462, the subsequent square or trapezoidal pulses can be scaled-down replicas of the initial baseline square or trapezoidal pulse, which are used to indicate to the user that the key is being held down to help avoid accidental repetition of the pressed character.

[0054] As described above, Figures 4A - 4F is provided as an example. Other examples can relate toFigures 4A - 4F described differently

[0055] Figure 5 FIG. 500 is a diagram illustrating an example process associated with a screen keyboard user interface configured to be associated with context-aware haptic feedback in accordance with the present disclosure.

[0056] For example, as shown in block 505, a user may select an option to launch or otherwise open a keyboard settings menu of the screen keyboard user interface (e.g., via a settings application associated with the electronic device, an application-specific keyboard settings menu, etc.). In some aspects, as shown in block 510, the keyboard settings menu may include an option to configure one or more force thresholds associated with context-aware haptic feedback. For example, in block 510, the user may configure a force range associated with a normal level of force and / or may configure an upper or lower limit of the range to define a low-level or high-level force press. Additionally or alternatively, the user may configure other force-related settings, such as the force required for the last character in an indication.

[0057] As further shown, in block 515, the keyboard settings menu may include an option to configure one or more haptic modes. For example, in some aspects, the screen keyboard user interface may be associated with various default haptic modes that may be associated with different typing contexts, such as Figures 4B - 4F the haptic modes shown in and described in further detail above. Additionally or alternatively, in block 515, the user may download additional haptic modes and / or create one or more custom haptic modes (e.g., by tapping on a touch screen display in a specific pattern, with or without a variable level of force). As further shown, in block 520, the keyboard settings menu may provide the user with an option to open a global behavior menu that allows the user to configure global behavior for one or more typing contexts.

[0058] For example, as shown in block 525, a global behavior menu may indicate configurable typing contexts, which may be associated with various configurable settings. For example, as shown in block 530, a configurable typing context may be associated with corresponding keyboard behaviors (such as toggling between lowercase and uppercase for the first letter in a word, adding a space if the current character is not the first letter in a new word, providing a track point word traversal for a slide keyboard that supports suggested words to automate the slide performed on a QWERTY keyboard and / or defining a specific input key sequence for a local key mapping to customize the meaning of a specific key). Additionally, as shown in block 535, the global behavior menu may provide an option to associate each typing context with a corresponding haptic pattern generated or presented when that typing context is detected. Additionally, as shown in block 540, the global behavior menu may include a button or option to toggle haptic feedback for a typing context between enabled and disabled states. Thus, as shown in block 545, a user may traverse the various typing contexts provided in the global behavior menu to configure haptic patterns to be associated with the various typing contexts and / or enable or disable haptic feedback for the various typing contexts.

[0059] Although Figure 5 example blocks of process 500 are shown, in some aspects, process 500 includes additional blocks, fewer blocks, different blocks, or blocks arranged differently compared to Figure 5 those depicted therein. Additionally or alternatively, two or more of the blocks of process 500 may be executed in parallel.

[0060] Figure 6 is a diagram illustrating an example process 600 associated with applying context-aware haptic feedback to a screen keyboard user interface in accordance with the present disclosure.

[0061] For example, as shown in block 605, an electronic device may detect keyboard interactions with a screen keyboard user interface displayed on the electronic device (e.g., in a messaging application, a note application, a web browser application, or any other suitable application that accepts keyboard input). As further shown in block 610, the electronic device may determine a two-dimensional (e.g., x-y) position of the current keyboard interaction and may map the two-dimensional position of the current keyboard interaction to a corresponding key. As further shown in block 615, the electronic device may calculate a force value at the key position to determine whether the user is pressing with a force level within a normal range, a low force level below the normal range, or a high force level above the normal range. Thus, as shown in block 620, the electronic device may determine whether the force level meets one or more thresholds (e.g., equal to or exceeding an upper limit of the normal range, indicating a high level of force, or failing to equal or exceed a lower limit of the normal range, indicating a low level of force). In some aspects, as shown in block 625, the electronic device may apply a force-enabled behavior when the force level meets one or more thresholds (e.g., associated with a low or high level of force), examples of which are described above with reference to Figures 4A - 4F are described.

[0062] As further shown in block 630, the electronic device may identify a typing context associated with the current keyboard interaction and may process the keyboard interaction in block 635. For example, processing the keyboard interaction may include performing any keyboard behavior that may be associated with the typing context, such as switching between lowercase and uppercase for the first letter in a new word, adding a space after a character that is not the first letter in a new word, and / or using tracking point information to calculate a fixed-point tracking point force and rotate between left and right for a suggested word when there is a suggested word available for a keyboard user interface that supports swipe typing. Additionally, as shown in block 640, the electronic device may trigger one or more haptic actuators to generate a vibration waveform associated with a haptic pattern or a combination of haptic patterns corresponding to the current typing context. For example, the electronic device may trigger the haptic actuator to generate haptic feedback to indicate or confirm that the current typing context includes a key press in a boundary region between adjacent keys or a key edge region, a key press in a key center region, a key press for selecting a special key or other key when a special key is activated, a key press for the first letter in a new word, a key press for a key other than the first letter in a new word, a key press or swipe when a suggested word is available, a key long press interaction, and / or a key press with additional pressure for the last character in an indication word, etc.

[0063] Although Figure 6 example blocks of process 600 are shown, in some aspects, process 600 includes additional blocks, fewer blocks, different blocks, or differently arranged blocks compared to those depicted in Figure 6 Additionally or alternatively, two or more of the blocks of process 600 may be executed in parallel.

[0064] Figure 7 is a flowchart of an example process 700 associated with a screen keyboard user interface associated with context-aware haptic feedback. In some aspects, Figure 7 one or more of the process blocks are performed by an electronic device (e.g., electronic device 210). In some aspects, Figure 7 one or more of the process blocks are performed by another device or group of devices separate from or including the electronic device. Additionally or alternatively, Figure 7 one or more of the process blocks may be performed by one or more components of device 300, such as processor 310, memory 315, storage component 320, input component 325, output component 330, communication interface 335, sensor 340, actuator 345, and / or haptic feedback component 350).

[0065] As Figure 7 shown, process 700 may include displaying a keyboard user interface on a touchscreen display panel (block 710). For example, as described above, the electronic device may display a keyboard user interface on the touchscreen display panel.

[0066] As Figure 7 further shown, process 700 may include detecting a key press interaction with the keyboard user interface (block 720). For example, as described above, the electronic device may detect a key press interaction with the keyboard user interface.

[0067] As Figure 7 further shown, process 700 may include triggering one or more haptic actuators to generate a vibration waveform associated with a haptic pattern that is at least partially based on the context associated with the key press interaction (block 730). For example, as described above, the electronic device may trigger one or more haptic actuators to generate a vibration waveform associated with a haptic pattern that is at least partially based on the context associated with the key press interaction.

[0068] Process 700 may include additional aspects, such as any single aspect or any combination of aspects described below and / or in combination with one or more other process descriptions elsewhere in this document.

[0069] In a first aspect, the context associated with the key press interaction includes a key press in the key center region.

[0070] Individually or in combination with the first aspect, in a second aspect, at least partially based on the context associated with the key press interaction including a key press in the key center region, the haptic pattern includes a square or trapezoidal pulse having a sustained steady state at the pulse maximum.

[0071] Alone or in combination with one or more of the first and second aspects, in a third aspect, the tactile pattern includes a precursor pulse having an amplitude less than a pulse maximum value, based at least in part on a key center area corresponding to a key having a non-standard keycap size on one or more of the physical keyboards simulated by the keyboard user interface or the keyboard user interface.

[0072] Alone or in combination with one or more of the first to third aspects, in a fourth aspect, the context associated with the key press interaction includes key presses in a key edge region or a boundary region between adjacent keys.

[0073] Alone or in combination with one or more of the first to fourth aspects, in the fifth aspect, based at least in part on a context associated with the key press interaction including a key press in a key edge area or a boundary area between adjacent keys, the tactile pattern includes an initial rise to a pulse maximum and a subsequent decay to a lower sustained amplitude.

[0074] In a sixth aspect, either alone or in combination with one or more of the first to fifth aspects, process 700 includes measuring a force level associated with a key press interaction, wherein the vibration waveform has an amplitude based at least in part on the force level associated with the key press interaction.

[0075] Alone or in combination with one or more of aspects 1 to 6, in aspect 7, the amplitude of the vibration waveform has a baseline value based on a force level within a range, has a value lower than the baseline value based on a force level below the range, or has a value higher than the baseline value based on a force level above the range.

[0076] Alone or in combination with one or more of the first to seventh aspects, in an eighth aspect, the context associated with the key press interaction comprises the key press associated with a force level indicating a last character in a word.

[0077] In a ninth aspect, either alone or in combination with one or more of the first to eighth aspects, the tactile pattern comprises a square or trapezoidal pulse that continues in a plateau at a pulse maximum value exceeding a baseline value and a subsequent post-somatic pulse with an amplitude equal to the baseline value.

[0078] Alone or in combination with one or more of the first to ninth aspects, in a tenth aspect, the context associated with the key press interaction includes a long press of a duration.

[0079] Alone or in combination with one or more of aspects 1 to 10, in aspect 11, the tactile pattern includes an initial square or trapezoidal pulse having a continuous steady state at a pulse maximum value, and one or more subsequent square or trapezoidal pulses having a continuous steady state below the pulse maximum value until a finger lift event occurs.

[0080]

[0081]

[0081]

[0082]

[0082]

[0083]

[0083]

[0084]

[0084]

[0085]

[0085]

[0086] Although Figure 7 Figure 7 Figure 7 Figure 7

[0087] The following provides an overview of some aspects of the present disclosure:

[0088]

[0088]

[0089]

[0089]

[0090] Aspect 3: The method according to aspect 2, wherein the context associated with the key press interaction includes a key press in the key center region, and the haptic pattern includes a square or trapezoidal pulse that remains in a steady state at the pulse maximum.

[0091] Aspect 4: The method according to aspect 3, wherein the context associated with the key press interaction includes a key press in the key center region corresponding to one or more keys with non-standard keycap sizes on a keyboard user interface or a physical keyboard simulated by the keyboard user interface, and the haptic pattern includes a precursor pulse with an amplitude lower than the pulse maximum.

[0092] Aspect 5: The method according to any one of aspects 1-4, wherein the context associated with the key press interaction includes a key press in the key edge region or in the boundary region between adjacent keys.

[0093] Aspect 6: The method according to aspect 5, wherein the context associated with the key press interaction includes a key press in the key edge region or in the boundary region between adjacent keys, and the haptic pattern includes an initial rise to the pulse maximum and a subsequent decay to a lower sustained amplitude.

[0094] Aspect 7: The method according to any one of aspects 1-6, further comprising: measuring a force level associated with the key press interaction, wherein the vibration waveform has an amplitude at least partially based on the force level associated with the key press interaction.

[0095] Aspect 8: The method according to aspect 7, wherein the amplitude of the vibration waveform has a baseline value based on the force level being within a range, a value lower than the baseline value based on the force level being below the range, or a value higher than the baseline value based on the force level being above the range.

[0096] Aspect 9: The method according to any one of aspects 1-8, wherein the context associated with the key press interaction includes a key press associated with the force level of the last character in an indication word.

[0097] Aspect 10: The method according to aspect 9, wherein the haptic pattern includes a square or trapezoidal pulse that remains in a steady state at a pulse maximum exceeding the baseline value and a subsequent postcursor pulse with an amplitude equal to the baseline value.

[0098] Aspect 11: The method according to any one of aspects 1-10, wherein the context associated with the key press interaction includes a long press for a period of time.

[0099] Aspect 12: The method according to aspect 11, wherein the haptic pattern includes an initial square or trapezoidal pulse that remains in a steady state at the pulse maximum and one or more subsequent square or trapezoidal pulses that remain in a steady state with an amplitude lower than the pulse maximum until a finger lift event occurs.

[0100] Aspect 13: The method according to any one of Aspects 1-12 further comprises: receiving, via a set user interface, one or more user inputs for configuring a haptic pattern for a context associated with a key press interaction.

[0101] Aspect 14: The method according to any one of Aspects 1-13, wherein the one or more haptic actuators comprise a plurality of actuators, each actuator being configured to generate a different component of a vibration waveform.

[0102] Aspect 15: The method according to any one of Aspects 1-14, wherein the context associated with the key press interaction comprises a key press for an initial letter in a word.

[0103] Aspect 16: The method according to any one of Aspects 1-15, wherein the context associated with the key press interaction comprises a key press for a letter other than the first letter in a word.

[0104] Aspect 17: The method according to any one of Aspects 1-16, wherein the context associated with the key press interaction comprises the availability of one or more suggested words.

[0105] Aspect 18: The method according to any one of Aspects 1-17, wherein the haptic pattern comprises a combination of a plurality of haptic patterns associated with the context associated with the key press interaction.

[0106] Aspect 19: An electronic device, comprising: a memory; and one or more processors coupled to the memory, the one or more processors being configured to: display a keyboard user interface on a touch screen display panel; detect a key press interaction with the keyboard user interface; and trigger one or more haptic actuators to generate a vibration waveform associated with a haptic pattern, the haptic pattern being at least partially based on a context associated with the key press interaction.

[0107] Aspect 20: The electronic device according to Aspect 19, wherein the context associated with the key press interaction comprises a key press in a key center region.

[0108] Aspect 21: The electronic device according to any one of Aspects 19-20, wherein the context associated with the key press interaction comprises a key press in a key edge region or a boundary region between adjacent keys.

[0109] Aspect 22: The electronic device according to any one of Aspects 19-21, wherein the one or more processors are further configured to: measure a force level associated with the key press interaction, wherein the vibration waveform has an amplitude that is at least partially based on the force level associated with the key press interaction.

[0110] Aspect 23: The electronic device according to any one of aspects 19-22, wherein the context associated with the key press interaction includes a key press associated with the force level of the last character in the indicator word.

[0111] Aspect 24: The electronic device according to any one of aspects 19-23, wherein the context associated with the key press interaction includes a long press for a period of time.

[0112] Aspect 25: The electronic device according to any one of aspects 19-24, wherein the context associated with the key press interaction includes a key press for the initial letter in a word.

[0113] Aspect 26: The electronic device according to any one of aspects 19-25, wherein the context associated with the key press interaction includes a key press for a letter other than the first letter in a word.

[0114] Aspect 27: The electronic device according to any one of aspects 19-26, wherein the context associated with the key press interaction includes the availability of one or more suggested words.

[0115] Aspect 28: The electronic device according to any one of aspects 19-27, wherein the tactile pattern includes a combination of multiple tactile patterns associated with the context associated with the key press interaction.

[0116] Aspect 29: A non-transitory computer-readable medium storing a set of instructions, the set of instructions including: one or more instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: display a keyboard user interface on a touch screen display panel; detect a key press interaction with the keyboard user interface; and trigger one or more tactile actuators to generate a vibration waveform associated with a tactile pattern that is at least partially based on the context associated with the key press interaction.

[0117] Aspect 30: A device, comprising: means for displaying a keyboard user interface on a touch screen display panel; means for detecting a key press interaction with the keyboard user interface; and means for triggering one or more tactile actuators to generate a vibration waveform associated with a tactile pattern that is at least partially based on the context associated with the key press interaction.

[0118] Aspect 31: A system configured to perform one or more operations described in one or more of aspects 1-30.

[0119] Aspect 32: A device, comprising means for performing one or more operations described in one or more of aspects 1-30.

[0120] Aspect 33: A non-transitory computer-readable medium storing an instruction set, the instruction set including one or more instructions that, when executed by a device, cause the device to perform one or more operations described in one or more of Aspects 1 to 30.

[0121] Aspect 34: A computer program product including instructions or code for performing one or more operations described in one or more of Aspects 1 - 30.

[0122] The foregoing disclosure provides illustration and description, but is not intended to be exhaustive or to limit the aspects to the precise forms disclosed. Modifications and variations can be made in light of the above disclosure, or can be obtained from practice of the aspects.

[0123] As used herein, the term "component" is intended to be broadly construed as a combination of hardware and / or hardware and software. Whether referred to as software, firmware, middleware, microcode, hardware description language, or other terms, "software" should be broadly construed to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executables, execution threads, processes, and / or functions, etc. As used herein, a "processor" is implemented as a combination of hardware and / or hardware and software. Clearly, the systems and / or methods described herein can be implemented in different forms of combinations of hardware and / or hardware and software. The actual specific control hardware or software code used to implement these systems and / or methods does not limit the aspects. Thus, the operations and behaviors of the systems and / or methods are described herein without reference to specific software code, as those skilled in the art will understand that the software and hardware can be designed to implement the systems and / or methods at least in part based on the description herein.

[0124] As used herein, depending on the context, "meeting a threshold" can mean a value greater than the threshold, a value greater than or equal to the threshold, a value less than the threshold, a value less than or equal to the threshold, a value equal to the threshold, a value not equal to the threshold, etc.

[0125] Even if specific combinations of features are recited in the claims and / or disclosed in the specification, these combinations are not intended to limit the disclosure of the various aspects. Multiple features among these features can be combined in ways not specifically recited in the claims and / or not disclosed in the specification. The disclosure of the various aspects includes the combination of each dependent claim with every other claim in the claim set. As used herein, the phrase "at least one" in reference to a list of items means any combination of those items, including a single member. As an example, "at least one of a, b, or c" is intended to cover a, b, c, a + b, a + c, b + c, and a + b + c, as well as any combination with multiple identical elements (e.g., a + a, a + a + a, a + a + b, a + a + c, a + b + b, a + c + c, b + b, b + b + b, b + b + c, c + c, and c + c + c or any other permutation of a, b, and c).

[0126] Unless explicitly described as such, elements, acts, or instructions used herein should not be construed as critical or essential. Additionally, as used herein, the articles "a" and "an" are intended to include one or more items and can be interchanged with "one or more". Additionally, as used herein, the article "the" is intended to include one or more items referred to in conjunction with the article "the" and can be interchanged with "one or more". Additionally, as used herein, the terms "set" and "group" are intended to include one or more items and can be interchanged with "one or more". In the case of only meaning Figure 1 a single item, the phrase "only one" or similar language is used. Additionally, as used herein, the term "having" is intended to be an open-ended term that does not limit the element it modifies (e.g., an element "having" A can also have B). Additionally, unless otherwise explicitly stated, the phrase "based on" is intended to mean "at least partially based on". Additionally, as used herein, the term "or" when used in series is intended to be inclusive and can be interchanged with "and / or" unless otherwise explicitly stated (e.g., if used in conjunction with "either" or "only one of").

Claims

1. A method performed by an electronic device, comprising: displaying a keyboard user interface on a touchscreen display panel; detecting a key press interaction with the keyboard user interface; and triggering one or more haptic actuators to generate a vibration waveform associated with a haptic pattern, the haptic pattern being at least partially based on a context associated with the key press interaction.

2. The method according to claim 1, wherein, The context associated with the key press interaction includes a key press in a key center region.

3. The method according to claim 2, wherein, At least partially based on the context associated with the key press interaction including a key press in the key center region, the haptic pattern includes a square or trapezoidal pulse having a sustained steady state at a pulse maximum.

4. The method according to claim 3, wherein, At least partially based on the key center region corresponding to a key having a non-standard keycap size on one or more of the keyboard user interface or a physical keyboard simulated by the keyboard user interface, the haptic pattern includes a precursor pulse having an amplitude lower than the pulse maximum.

5. The method according to claim 1, wherein The context associated with the key press interaction includes a key press in a key edge region or a boundary region between adjacent keys.

6. The method according to claim 5, wherein, At least partially based on the context associated with the key press interaction including a key press in a key edge region or a boundary region between adjacent keys, the haptic pattern includes an initial rise to the pulse maximum and a subsequent decay to a lower sustained amplitude.

7. The method according to claim 1, further comprising: measuring a force level associated with the key press interaction, wherein the vibration waveform has an amplitude at least partially based on the force level associated with the key press interaction.

8. The method according to claim 7, wherein The amplitude of the vibration waveform has a baseline value based on the force level being within a range, a value lower than the baseline value based on the force level being below the range, or a value higher than the baseline value based on the force level being above the range.

9. The method according to claim 1, wherein, The context associated with the key press interaction includes a key press associated with a force level of the last character in an indication word.

10. The method according to claim 9, wherein, The haptic pattern includes a square or trapezoidal pulse having a sustained steady state at a pulse maximum exceeding the baseline value and a subsequent afterbody pulse having an amplitude equal to the baseline value.

11. The method according to claim 1, wherein The context associated with the key press interaction includes a long press for a duration.

12. The method according to claim 11, wherein, The haptic pattern includes an initial square or trapezoidal pulse having a sustained steady state at the pulse maximum and one or more subsequent square or trapezoidal pulses having a sustained steady state lower than the pulse maximum until a finger lift event occurs.

13. The method according to claim 1, further comprising: receiving, via a settings user interface, one or more user inputs configuring a haptic pattern for a context associated with the key press interaction.

14. The method according to claim 1, wherein, The one or more haptic actuators include a plurality of actuators, each actuator being configured to generate a different component of the vibration waveform.

15. The method according to claim 1, wherein The context associated with the key press interaction includes a key press for an initial letter in a word.

16. The method according to claim 1, wherein, The context associated with the key press interaction includes a key press for a letter other than the first letter in a word.

17. The method according to claim 1, wherein, The context associated with the key press interaction includes the availability of one or more suggested words.

18. The method according to claim 1, wherein, The haptic pattern includes a combination of multiple haptic patterns associated with the context associated with the key press interaction.

19. An electronic device, comprising: a memory; and one or more processors coupled to the memory, the one or more processors being configured to: display a keyboard user interface on a touchscreen display panel; detect key press interactions with the keyboard user interface; and trigger one or more haptic actuators to generate a vibration waveform associated with a haptic pattern, the haptic pattern being at least partially based on a context associated with the key press interaction.

20. The electronic device according to claim 19, wherein, The context associated with the key press interaction includes a key press in a key center region.

21. The electronic device according to claim 19, wherein, The context associated with the key press interaction includes a key press in a key edge region or a boundary region between adjacent keys.

22. The electronic device according to claim 19, wherein, The one or more processors are further configured to: measure a force level associated with the key press interaction, wherein the vibration waveform has an amplitude that is at least partially based on the force level associated with the key press interaction.

23. The electronic device according to claim 19, wherein, The context associated with the key press interaction includes a key press associated with a force level of the last character in an indication word.

24. The electronic device according to claim 19, wherein, The context associated with the key press interaction includes a long press for a period of time.

25. The electronic device according to claim 19, wherein, The context associated with the key press interaction includes a key press for an initial letter in a word.

26. The electronic device according to claim 19, wherein, The context associated with the key press interaction includes a key press for a letter other than the first letter in a word.

27. The electronic device according to claim 19, wherein, The context associated with the key press interaction includes the availability of one or more suggested words.

28. The electronic device according to claim 19, wherein The haptic pattern includes a combination of multiple haptic patterns associated with a context associated with the key press interaction.

29. A non-transitory computer-readable medium storing an instruction set, the instruction set comprising: one or more instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: display a keyboard user interface on a touchscreen display panel; detect key press interactions with the keyboard user interface; and trigger one or more haptic actuators to generate a vibration waveform associated with a haptic pattern, the haptic pattern being at least partially based on a context associated with the key press interaction.

30. A device, comprising: means for displaying a keyboard user interface on a touchscreen display panel; means for detecting key press interactions with the keyboard user interface; and means for triggering one or more haptic actuators to generate a vibration waveform associated with a haptic pattern, the haptic pattern being at least partially based on a context associated with the key press interaction.

Images