Touch screen input with haptic feedback

Abstract

Techniques are provided for a visually impaired person to securely interact with a user device. A user may slide a finger on a touch screen and receive iterative haptic feedback signals indicative of different selectable numbers as the finger moves. Additionally, a digital grid may be presented such that the user's initial contact is a center of the digital grid. In addition, swipes in different directions may be associated with a particular number.

Description

[0001] Cross-references to related applications

[0002] This application claims priority to U.S. Provisional Application No. 63 / 519,809, filed August 15, 2023; U.S. Provisional Application No. 63 / 520,064, filed August 16, 2023; and U.S. Provisional Application No. 63 / 520,058, filed August 16, 2023, the entire contents of which are incorporated herein by reference. Background Technology

[0003] Typical digital touchscreen devices are primarily configured to interact with users through visually displayed information. Therefore, such devices are difficult for visually impaired individuals to operate. Users may not be able to see the various information displayed on the screen, and they may not be able to determine which area of ​​the screen to touch to input commands or otherwise operate the device. For example, visually impaired users may not be able to utilize an interactive numeric keypad or numeric keypad displayed on a touchscreen that lacks other physical buttons, Braille, or other raised markings.

[0004] Some devices may offer voice-based accessibility modes where the content displayed on the screen is described audibly using words or other tones. This can help visually impaired users understand what information is being displayed and help them determine which area of ​​the screen to touch for input. However, such processes can be difficult and tedious. Additionally, any sensitive information is subsequently played back audibly for bystanders to hear. This can compromise the security of certain sensitive processes, such as unlocking the device or entering login information that should be kept confidential.

[0005] The embodiments of the present invention address these and other problems respectively. Summary of the Invention

[0006] The implementation provides technology for safe interaction between visually impaired individuals and user devices. Users can swipe their fingers on a touchscreen and receive iterative haptic feedback signals indicating different selectable inputs (e.g., numbers) as their fingers move across the screen. Additionally, a digital layout (e.g., a grid, a turntable) can be presented, with the user's initial contact centered on the layout. Furthermore, swipes in different directions can be associated with specific numbers.

[0007] Some implementations provide a method performed by a user equipment. The method includes: a) detecting contact with one or more objects on the touchscreen by the user equipment including a touchscreen; b) detecting movement of the contact on the touchscreen by the user equipment; c) generating one or more haptic feedback signals by the user equipment in response to the movement of the contact, each of the one or more haptic feedback signals being associated with a selectable digit; d) detecting at least one of an end of contact and a selection indication by the user equipment; e) determining a selected digit by the user equipment based on at least one of the end of contact and the selection indication; and f) storing or transmitting the selected digit by the user equipment.

[0008] Various embodiments provide a user equipment comprising: a touchscreen; an actuator configured to generate haptic feedback signals; a processor and a memory storing instructions that, when executed by the processor, cause the processor to perform steps including: a) detecting contact with one or more objects on the touchscreen; b) detecting movement of the contact on the touchscreen; c) generating one or more haptic feedback signals in response to the movement of the contact, each of the one or more haptic feedback signals being associated with a selectable digit; d) detecting at least one of an end of contact and a selection indication; e) determining a selected digit based on at least one of the end of contact and the selection indication; and f) storing or transmitting the selected digit.

[0009] These and other implementation schemes are described in further detail below. Attached Figure Description

[0010] Figure 1 An example is given of a method for digital input via continuous contact according to the implementation plan.

[0011] Figures 2A to 2C A first example of digital input via continuous contact is shown according to the implementation scheme.

[0012] Figures 3A to 3B A second example of digital input via continuous contact is shown according to the implementation scheme.

[0013] Figures 4A to 4F A third example of digital input via continuous contact is shown according to the implementation scheme.

[0014] Figure 5 A fourth example of digital input via contact is shown according to the implementation scheme.

[0015] Figure 6 An example timeline of character input via continuous contact is shown according to the implementation scheme.

[0016] Figure 7An example is provided of a method for providing haptic feedback support for digital input in a digital layout, according to an implementation scheme.

[0017] Figure 8 An example of a digital layout on a user device according to the implementation scheme is shown.

[0018] Figure 9 An example is given of a method for digital input in a dynamically positioned digital layout according to the implementation scheme.

[0019] Figure 10 An example of a dynamic digital layout on a user device according to the implementation scheme is shown.

[0020] Figure 11 A method for digital input via directional swiping, according to an implementation scheme, is shown.

[0021] Figure 12 An example trajectory diagram based on the implementation scheme is shown.

[0022] Figures 13A to 13H An example of a contact detected at the user equipment according to the implementation scheme is shown.

[0023] Figure 14 A method for digital input via haptic feedback according to an implementation scheme is shown.

[0024] Figures 15A to 15D An example of amount modification and input based on the implementation scheme is shown.

[0025] Figure 16 A block diagram of a user equipment according to an implementation scheme is shown. Detailed Implementation

[0026] Before discussing the details of some embodiments of the present invention, a description of some terms can be used to understand the various embodiments.

[0027] "Haptic feedback" can include interactions involving touch perception. For example, haptic feedback can stimulate tactile sensations through a user's touch perception. Haptic feedback can include vibration, temperature fluctuations, electrical current, friction, and any other suitable type of force or motion that can be detected by touch. In some embodiments, haptic feedback can be used to convey information (e.g., one-way or two-way communication). Pulses can be different instances, moments, or energy transfers of haptic feedback. A haptic feedback signal can include one or more pulses of haptic feedback. For example, a single haptic feedback signal can include a single pulse, two consecutive and / or rapid pulses, three consecutive and / or rapid pulses, etc. Pulses can vary in intensity, duration, type (e.g., vibration or electrical current), and / or any other suitable quality.

[0028] "User" can include a personal or computing device. In some implementations, a user may be associated with one or more personal accounts and / or mobile devices. In some implementations, a user may be a cardholder, account holder, or consumer.

[0029] A “user equipment” can be any suitable device with which a user can interact (e.g., a payment card or mobile phone). A user equipment can take any suitable form. Some examples of user equipment include cards with magnetic stripes or contactless elements (e.g., payment cards such as debit cards, credit cards, and prepaid cards), cellular phones, PDAs, personal computers (PCs), tablet computers, etc. In some embodiments where the user equipment is a mobile device, the mobile device may include a display, memory, processor, computer-readable medium, and any other suitable components. In some embodiments, the user equipment may include an access device with which a user interacts.

[0030] A “mobile device” (sometimes referred to as a mobile communication device) can include any suitable electronic device that a user can transport or operate, and which may also provide the ability to communicate remotely with a network. A mobile communication device can communicate using a mobile phone (wireless) network, a wireless data network (e.g., 3G, 4G, or similar networks), Wi-Fi, Bluetooth, Bluetooth Low Energy (BLE), Wi-Max, or any other communication medium that provides access to networks such as the Internet or a private network. Examples of mobile devices include mobile phones (e.g., cellular phones), PDAs, tablet computers, netbooks, laptops, wearable devices (e.g., watches), vehicles such as cars and motorcycles, personal music players, handheld dedicated readers, etc. A mobile device can include any suitable hardware and software for performing such functions, and may also include multiple devices or components (e.g., two devices used together can be considered a single mobile device when the device remotely accesses a network by sharing the network with another device (i.e., using said other device as a modem)).

[0031] "Access device" can be any suitable device used to provide access to an external computer system. Access devices can take any suitable form. Some examples of access devices include point-of-sale (POS) devices, cellular phones, PDAs, personal computers (PCs), tablet PCs, handheld dedicated readers, set-top boxes, electronic cash registers (ECRs), automated teller machines (ATMs), virtual cash registers (VCRs), kiosks, security systems, access systems, websites, and so on. Access devices can use any suitable contact or contactless operating mode to send or receive data to or from mobile devices, or associate with mobile devices. In some implementations where the access device may include a POS terminal, any suitable POS terminal can be used, and it may include a reader, a processor, and a computer-readable medium. The reader may include any suitable contact or contactless operating mode. For example, an exemplary card reader may include a radio frequency (RF) antenna, an optical scanner, a barcode reader, or a magnetic stripe reader to interact with a mobile device.

[0032] An "application" can be a computer program used for a specific purpose. Examples of applications may include transportation applications, secure data access applications, banking applications, digital wallet applications, event ticketing applications, loyalty reward applications, and so on. In some implementations, an application may be associated with a user account (e.g., a bank account, a public transportation prepaid account, a building access account, etc.) maintained by a resource or service provider.

[0033] "Access data" can include any suitable data that can be used to access resources or create data that allows access to resources. In some embodiments, access data can be account information for a payment account. Account information can include a PAN, payment token, expiration date, and verification value (e.g., CVV, CVV2, dCVV, dCVV2), etc. In other embodiments, access data can be data that can be used to activate account data. For example, in some cases, account information can be stored on a mobile device but may not be activated until the mobile device receives specific information. In other embodiments, access data can include data that can be used to access a location. Such access data can be event ticket information, data for accessing a building, transportation ticket information, etc. In other embodiments, access data can include data used to obtain access to sensitive data. Examples of access data can include code or other data required by a server computer to grant access to sensitive data.

[0034] "Authentication data" can include any data suitable for authenticating a user or mobile device. Authentication data can be obtained from the user or the device operated by the user. Examples of authentication data obtained from the user can include confidential information such as a personal identification number (PIN), biometric data, passwords, etc. Examples of authentication data that can be obtained from the device can include the device serial number, hardware secure element identifier, device fingerprint, phone number, IMEI number, etc.

[0035] "Confidential" can be information that others do not know or cannot see. Confidentiality may be known only to the user. For example, a PIN, password, biometric sample, biometric template, or other data specific to the user and / or known only to the user can be confidential. Derivatives of confidentiality can be information derived from it. For example, encrypted confidentiality or confidentiality linked to other information can be derivatives of confidentiality.

[0036] A "Personal Identification Number" or "PIN" may include one or more characters used to identify an individual or other entity. A PIN may include one or more numbers, letters, special characters, and / or any other suitable symbols. A PIN may be confidential information known only to the user. Users can provide a PIN to verify their identity and / or gain access to information, resources, devices, physical spaces, conduct transactions, etc.

[0037] A "key" or "cryptographic key" can include a piece of information used in a cryptographic algorithm to transform data into another representation. A cryptographic algorithm can be an encryption algorithm that transforms the original data into an alternative representation, or a decryption algorithm that transforms encrypted information back into the original data. Examples of cryptographic algorithms may include Triple Data Encryption Standard (TDES), Data Encryption Standard (DES), Advanced Encryption Standard (AES), etc.

[0038] A “number layout” can be a set of one or more numbers arranged in a layout. For example, a numeric keypad (also known as a numeric keypad or numeric grid) can include a set of cells, each with an associated number. For example, each number can occupy a rectangular cell. These cells can be arranged as a grid or table of cells with any suitable number of columns and / or rows. Additional cells may be included for non-numeric keys or functions such as input keys, delete keys, etc. Another example of a number layout is a turntable. A turntable can include a circular pattern with numbers arranged along the circumference of a circle. It is possible to select a number by pressing the position on the circle corresponding to the desired number. Alternatively, a number can be selected by rotating or otherwise moving a selection indicator along the circumference of the circle to the position on the circle corresponding to the desired number. A physical number layout can be a physical object, such as a set of physical keys on a physical keyboard. A digital number layout can be displayed digitally or otherwise provided, such as a digital number layout on a touchscreen.

[0039] The term "resource" generally refers to any asset that can be used or consumed. For example, a resource can be a computer resource (e.g., stored data or networked computer accounts), a physical resource (e.g., a tangible object or physical location), or other electronic resources or communications between computers (e.g., communication signals corresponding to accounts used to execute transactions). Some non-limiting examples of resources can be goods or services, physical buildings, computer accounts or documents, or payment accounts. In some implementations, a resource can refer to a financial product, such as a loan or line of credit.

[0040] "Interaction" can include mutual interaction or influence. "Interaction" can include communication, contact, or exchange between parties, devices, and / or entities. Example interactions include communication between a user and a user's device, transactions between the two parties, and data exchange between two devices. In some implementations, an interaction can include a user requesting access to secure data, secure web pages, secure locations, etc. In some implementations, an interaction can include a user providing confidential information or other information to a device. In other implementations, an interaction can include a payment transaction, where two devices (e.g., a mobile device and an access device) can interact to facilitate a payment.

[0041] "Interaction data" can include data related to the interaction and / or data recorded during the interaction. In some implementations, interaction data can be transaction data of network data. Transaction data can contain multiple data elements with data values.

[0042] "Computing device" can include any suitable device capable of processing data electronically. Examples of computing devices include desktop computers, mobile devices or mobile computing devices, televisions, etc.

[0043] A "server computer" can include a powerful computer or cluster of computers. For example, a server computer can be a mainframe, a small cluster of computers, or a group of servers operating as a single unit. In one example, a server computer can be a database server coupled to a web server. A server computer can be coupled to a database and can include any hardware, software, other logic, or a combination of the foregoing for servicing requests from one or more client computers.

[0044] "Processor" can include any suitable one or more data computing devices. A processor can include one or more microprocessors working together to achieve a desired function. A processor can include a CPU, which includes at least one high-speed data processor sufficient to execute program components for performing user and / or system-generated requests. A CPU can be a microprocessor, such as AMD's Athlon, Duron, and / or Opteron; IBM and / or Motorola's PowerPC; IBM and Sony's Cell processors; Intel's Celeron, Itanium, Pentium, Xeon, and / or XScale; and / or similar processors.

[0045] "Memory" can be any suitable one or more devices capable of storing electronic data. Suitable memory may include non-transitory computer-readable media whose storage can be executed by a processor to implement a desired method. Examples of memory may include one or more memory chips, disk drives, etc. Such memory can be operated using any suitable electrical, optical, and / or magnetic modes of operation.

[0046] The implementation provides a technology for safe interaction between visually impaired individuals and user devices. For example, a user can slide their finger across a touchscreen and receive iterative haptic feedback signals indicating different selectable numbers as the finger moves across the screen. When the user feels the haptic feedback signal corresponding to the desired number, the user can select the number by removing their finger and / or by providing a selection instruction (e.g., double-clicking or a voice command).

[0047] As another example, users can navigate digital layouts (e.g., grids or turntables) based on haptic feedback. The digital layout can have a dynamic positioning presented based on the random location of the user's initial contact point. This random positioning allows people born with visual impairments (e.g., those who have never seen a numeric keypad or keypad) to input numbers on a touchscreen. A digital grid can be presented such that the user's initial contact is at the center of the grid. Therefore, the user knows that contact always begins at the center and can make informed movements from that location towards nearby numbers.

[0048] As another example, users can provide a directional swipe associated with a desired number. Different swipe directions can be associated with different numbers.

[0049] In each of these examples, the user can safely input numbers (or other characters) on the user device without requiring visual communication.

[0050] Continuous contact with haptic feedback

[0051] The implementation scheme allows the user device to communicate with the user via haptic feedback signals. Haptic feedback signal communication enables the user device to receive PIN input (e.g., a series of numeric inputs) from the user. For example, the user device can provide a series of haptic feedback signals, each corresponding to a different selectable digit. When the user perceives (e.g., feels) the haptic feedback signal associated with the desired input digit, the user can select that digit through one or more actions. As long as the user maintains contact and / or continuous movement (e.g., finger swipe) with an interactive element of the user device (e.g., a touchscreen), the user device can continue cycling through different selectable digits.

[0052] Figure 1 A flowchart illustrating a method 100 for digital input via continuous contact is provided.

[0053] Users may expect or be prompted to enter a PIN on their device. For example, a user may want to unlock their mobile device. As another example, a user may activate payment mode on their mobile device, and the mobile device may prompt the user to enter a PIN. As yet another example, a user may conduct a transaction at an access device, and the access device may prompt the user to enter a PIN. The user device may display visual cues and / or generate audio prompts, such as "Please enter your PIN."

[0054] In step 101, the user equipment may detect contact with one or more objects on the touchscreen of the user equipment. For example, the user may touch the touchscreen with one or more fingers, a stylus, or any other suitable object. The detection of contact may initiate a process for inputting information (e.g., numbers).

[0055] An example of initial contact detection on a user device is shown in Figure 2A As illustrated, user equipment 200 can detect a touch at a starting position 210 on the touchscreen. In this example, the touch occurs in the lower left area of ​​the touchscreen. However, in some implementations, there may not be a predefined location on the touchscreen that requires a user to touch to initiate the PIN input process. Instead, initial touch detection can occur in any area of ​​the touchscreen. This can advantageously improve access security because a bystander may not be able to obtain any useful PIN information based on the location of the initial touch.

[0056] In some implementations, initial haptic feedback may be generated in response to detected contact. For example, a combination of short pulses, long pulses, haptic feedback pulses, or any other suitable haptic feedback with a different quality, pattern, or other configuration than the haptic feedback signal discussed below may be generated to communicate to the user that contact has been detected and the user equipment is ready to receive PIN input. In other implementations, no haptic feedback may be generated until the first haptic feedback described below with respect to step 103.

[0057] Return to reference Figure 1 In method 100, in step 102, the user equipment may detect movement of the contact. For example, the one or more objects in contact with the touchscreen may slide on the touchscreen in any suitable orientation or otherwise move while remaining in contact with the touchscreen. In some embodiments, the movement may be continuous.

[0058] In step 103, the user equipment may generate a first tactile feedback signal in response to continuous contact and / or movement of the contact. For example, the user equipment may generate the first tactile feedback signal after a predetermined amount of time (e.g., ½ second, 1 second, 2 seconds, 3 seconds, 4 seconds, 5 seconds, 10 seconds, etc.) of continuous contact and / or movement of the contact. Additionally or alternatively, the user equipment may generate the first tactile feedback signal after a predetermined distance of movement of the contact (e.g., ½ cm, 1 cm, 2 cm, 3 cm, 4 cm, 5 cm, 10 cm, 10 pixels, 20 pixels, 30 pixels, 50 pixels, 100 pixels, 1000 pixels, etc.). The tactile feedback signal may include one or more vibration pulses, electrical pulses, thermal signals, or cold signals, or any other suitable type of tactile sensation.

[0059] The first haptic feedback signal can be associated with a first selectable digit (e.g., 1). Additionally, the first haptic feedback signal can be configured to indicate the first digit. For example, the first haptic feedback signal can provide a pulse to convey the digit 1 to the user.

[0060] exist Figure 2BAn example of a first haptic feedback signal generated in response to the detection of a moving contact on a user device is illustrated. As shown, after an initial contact is detected at a starting position 210 on the touchscreen, the user device 200 can detect movement of the contact on the screen to a first position 211. When the contact occurs at the first position 211, the user device 200 can generate a first haptic feedback signal (e.g., in response to the contact movement lasting for a certain amount of time or crossing a certain distance).

[0061] Figure 2B An example of diagonal movement to the right and upward is illustrated. However, according to the implementation, the user can move the contact in any suitable direction, with any suitable curvature or motion pattern (e.g., a random pattern), and at any suitable and / or varying speed. The user may not be required to move the contact according to any predefined pattern.

[0062] In some implementations, the user can move the contact in a circular motion to outline one or more circles or portions of circles. Any suitable amount of haptic feedback signal can be provided during movement along the circular pattern, and this amount can vary for each circle or portion of a circle.

[0063] According to the implementation, the touchscreen may not display any visual feedback or other visual information related to the selectable number or the selected number. The user can slide their finger across a blank screen or a blank area of ​​the screen. Start position 210 and first position 211 are shown as circles to indicate the position of the user's finger when a haptic feedback signal is generated. However, the user device may not actually display any circles or other information in these areas. Therefore, the implementation can advantageously reduce or eliminate visual cues and instead utilize touch-based communication between the user device 200 and the user, thereby providing a safe mechanism for inputting information into the user device for visually impaired individuals.

[0064] Return to reference Figure 1In method 100, at any desired time, the user can select a currently selectable number. In some embodiments, the user can select the current number by ending contact with the touchscreen (e.g., by removing one or more objects). In some embodiments, the user can select the current number by providing a selection instruction. For example, the selection instruction can be a predefined user input, such as double-clicking, long-pressing, simultaneously touching two or more fingers, shaking the user device, a voice command (e.g., “Select” or “Enter”), touching a selectable area (e.g., a “Select,” “Enter,” or “Done” button displayed on the touchscreen or otherwise provided on the user device), or any other suitable input. Thus, if the user expects to select the number 1, the user can end contact with the touchscreen and / or provide a selection instruction shortly after the first haptic feedback signal in step 103. If the user expects to select a different number, the user can continue to maintain contact with the touchscreen and / or move the contact (e.g., swiping a finger on the screen).

[0065] In step 104, the user equipment may determine whether the contact has ended and / or detect a selection indication (e.g., double-click). If the user equipment determines that the contact has not ended and / or no selection indication has been detected, this may indicate that the user does not wish to select the number 1, and the method may continue to step 105. If the user equipment determines that the contact has ended and / or a selection indication has been detected, this may indicate that the user wishes to select the number 1, and the method may jump to step 106 to process the number 1 entered by the user.

[0066] In step 105, the user equipment may generate another tactile feedback signal in response to continued contact and / or movement of the contact. For example, the user equipment may generate a second tactile feedback signal in response to further continued contact and / or further movement of the contact. For example, the user equipment may generate a second tactile feedback signal after an additional predetermined amount of time (e.g., ½ second, 1 second, 2 seconds, 3 seconds, 4 seconds, 5 seconds, 10 seconds, etc.) and / or an additional predetermined distance (e.g., ½ cm, 1 cm, 2 cm, 3 cm, 4 cm, 5 cm, 10 cm, etc.) of the moving contact.

[0067] The second haptic feedback signal can be associated with the selection of a second digit (e.g., the digit 2). For example, while the user device generates the second haptic feedback signal, the user device can increment the currently selectable digit by 1 (e.g., from digit 1 to digit 2). The selectable digit can remain static until the next haptic feedback signal.

[0068] The second haptic feedback signal can be configured to indicate a new selectable digit. For example, the second haptic feedback signal can provide two pulses (e.g., fast and continuous) to convey to the user that the currently selectable digit is 2.

[0069] In other embodiments, each successive tactile feedback signal can be identical (e.g., a single pulse). In this case, the second tactile feedback signal can provide a single pulse, and the user can count and / or remember that this is the second pulse after the first pulse in step 103 (thus indicating the number 2).

[0070] Figure 2C An example of a second haptic feedback signal generated in response to the detection of continuous moving contact on a user device is illustrated. As shown, after generating a first haptic signal in response to detecting contact movement from a starting position 210 to a first position 211, the user device 200 can detect continuous movement of the contact on the screen to a second position 212. When the contact has reached the second position 212, the user device 200 can generate a second haptic feedback signal (e.g., in response to the continuous contact movement lasting for a certain amount of time or crossing a certain distance). Figure 2B The illustration shows a slight change in direction with continuous upward and rightward movement. However, according to the implementation, the user can change the direction and / or speed of the movement as needed. This can advantageously improve access security because bystanders may not be able to obtain any useful PIN information based on the direction and / or speed of movement.

[0071] According to the implementation scheme, instead of fixed and / or predetermined intervals between haptic feedback signals, variable intervals (e.g., time intervals and / or distance intervals) can exist between the haptic feedback signals. For example, a first haptic feedback signal may be generated after a first portion of movement, which may be a 2-second movement contact or a 2-centimeter contact movement, and a second haptic feedback signal may be generated after a second portion of movement, which may be a 1-second movement contact or a 1-centimeter contact movement. According to the implementation scheme, the intervals can vary between haptic feedback signals, between digital inputs, and / or between PIN inputs. The user equipment can be configured to generate random intervals within a specific range (e.g., between 0.3 seconds and 5 seconds, or between 0.5 centimeters and 8 centimeters). This can advantageously improve access security because bystanders may not be able to obtain any useful information about the currently selectable digit based on the amount of time the user maintains contact and / or based on the distance of contact movement. Instead, the user may be the only one who knows the currently selectable digit conveyed through the haptic feedback signals.

[0072] Additionally, in some implementations, the user equipment may not provide audio information regarding the currently selectable digits, the selected digits, the PIN, and / or other sensitive information. This can advantageously improve access security because an observer may not be able to obtain the PIN information by eavesdropping.

[0073] Return to reference Figure 1 Method 100 may repeat step 104 to determine whether the user has selected the number 2. For example, as described above with respect to step 104, the user equipment may determine whether the contact has ended and / or detect a selection indication. If the user equipment determines that the contact has ended and / or detects a selection indication, this may indicate that the user wishes to select the number 2, and the method may proceed to step 106 to process the number 2 entered by the user. If the user equipment determines that the contact has not ended and / or no selection indication has been detected, this may indicate that the user does not wish to select the number 2, and the method may continue to step 105.

[0074] According to the implementation, steps 104 to 105 can be repeated until the user ends contact with the touchscreen and / or provides a selection indication, at which point the method can proceed to step 106. At each instance of step 105, the user device can continue to detect contact and / or movement and can then provide additional haptic feedback signals. Furthermore, at each instance of step 105, the selectable digit can be iteratively incremented by 1. In some implementations, the haptic feedback signal can be modified to convey the selectable digit to the user. For example, the digit 3 can be associated with a third haptic feedback signal of three pulses (e.g., rapid succession), the digit 4 can be associated with a fourth haptic feedback signal of four pulses, and so on. Alternatively, as discussed above, each haptic feedback signal can comprise a single pulse, and the user can track the currently selectable digit based on the number of single-pulse haptic feedback signals that have been generated. Steps 104 to 105 can be repeated until any suitable digit, such as the digit 9, the digit 10, the digit 20, etc.

[0075] In some implementations, the selectable number may not be iteratively incremented at each instance of step 105. Instead, a random number (e.g., between 0 and 9) can be provided as the selectable number. The selectable number can be conveyed through a haptic feedback signal with a corresponding number of pulses (e.g., five pulses represent the number 5). The random display of numbers can improve security by making it more difficult for an observer to know which number the user is selecting.

[0076] In step 106, the user equipment can determine the number selected by the user based on the end of the contact. For example, when the contact ends, the currently selectable number can be selected as the chosen number. The currently selectable number can be stored in a record or determined based on the most recent haptic feedback signal. For example, if the most recent haptic feedback signal is associated with the number 2 (e.g., as...), the user equipment can determine the number selected based on the end of the contact. Figure 2CAs shown), the user equipment can then determine that the user has selected the number 2. As discussed above, the user can know the number associated with the haptic feedback signal based on the number of pulses in the haptic feedback signal (e.g., 2 pulses), based on the sequence order of the haptic feedback signal (e.g., the second iteration haptic feedback signal), or through any other suitable communication.

[0077] In some implementations, the user equipment may provide additional haptic feedback signals when a number is selected. For example, in response to an end of contact, a selection indication, and / or identification of the selected number, the user equipment may generate a haptic feedback signal to inform the user that a number has been selected and entered and / or to inform the user that the user equipment is ready for subsequent number input. In some implementations, this final haptic feedback signal may differ from the previous haptic feedback signal used to count the selectable numbers. For example, the final haptic feedback signal may include extended pulses, a series of short pulses (e.g., 2, 3, 4, or 5), a combination of long and short pulses (e.g., Morse code), a user-defined pulse pattern, etc.

[0078] In step 107, the user equipment may store and / or transmit the selected numbers. For example, the user equipment may mark the first PIN digit as the selected number and wait for the remaining PIN digits to be entered. Additionally or alternatively, the user equipment may transmit the selected numbers to a PIN processing secret or server computer.

[0079] In step 108, the user equipment can determine whether the PIN input is complete. For example, the user equipment can determine whether a complete set of PIN digits has been entered based on a predefined PIN length (e.g., 4, 5, 6, 7, 8, 9, 10, 11, 12, or 15 digits).

[0080] In some implementations, the user equipment can determine PIN input completion in response to receiving an indication of PIN input completion from the user. For example, the user equipment can input a complete command. The user equipment can provide a selectable area for inputting the complete command. For example, the lower right corner (or any other suitable area) of a touchscreen or user equipment (e.g., a side button) can be used to select complete. The selectable area can include visual markings, such as rectangles with the words "done," "complete," or "input." In some implementations, the area for selecting complete can be associated with a haptic feedback signal. The completion haptic feedback signal can be different from other haptic feedback signals. For example, when a user touches a screen area to select complete, the user equipment can provide continuous haptic feedback (e.g., continuous vibration), a specific predefined series of short, medium, and / or long pulses, and / or any other suitable different haptic feedback signal. The user can select complete by tapping the selectable area, double-tapping the selectable area, long-pressing the selectable area, swiping to the selectable area and then ending the contact, and / or by any other suitable user input. In some implementations, the complete command can be provided in any suitable area of ​​the screen, not just on a button or other designated area. In some implementations, users can enter a completion command by selecting a completion button or area and then providing a second gesture or instruction (e.g., double-click).

[0081] If the PIN input is not complete, the method can return to step 101 to begin the process for providing subsequent digit input (e.g., for the second PIN digit). Steps 101 through 108 can be repeated in this manner for each digit of the PIN. Once the PIN input is complete, the method can proceed to step 109.

[0082] For example, in the case of a 4-digit PIN, steps 101 to 108 can be performed three more times to receive the remaining three digits. Three examples of such digit inputs are provided below. Figures 3A to 3B , Figures 4A to 4F and Figure 5 As shown in the image.

[0083] Figures 3A to 3BAn example of a user equipment receiving contact input for a second PIN digit, where the second PIN digit is the number 1, is illustrated. As shown, user equipment 200 can detect an initial contact at a start position 310 (e.g., step 101), and then detect subsequent contacts and contact movement to a first position 311 (e.g., step 102). In this example, the movement is in a downward and rightward direction, but other movements are also possible. When contact is made at the first position 311, user equipment 200 can provide a first haptic feedback signal (e.g., step 103). User equipment 200 can then detect disengagement from the touchscreen and / or detect a selection indication (e.g., step 104). In response, user equipment 200 can determine (e.g., step 106) that the user has selected a currently selectable digit (e.g., the number 1). In some embodiments, during the selection of the second PIN digit, user equipment 200 can display a dot or other indication that the first PIN digit has been entered.

[0084] Figures 4A to 4F An example of a user equipment receiving touch input for a third PIN digit, where the third PIN digit is the number 5, is illustrated. As shown, user equipment 200 can detect an initial contact at a start position 410, followed by subsequent contacts and contact movement to first positions 411, second positions 412, third positions 413, fourth positions 414, and fifth positions 415. In this example, the movement includes a clockwise curve, but other movements are possible. When contact is made at the first position 411, user equipment 200 can provide a first haptic feedback signal; when contact is made at the second position 412, a second haptic feedback signal; when contact is made at the third position 413, a third haptic feedback signal; when contact is made at the fourth position 414, a fourth haptic feedback signal; and when contact is made at the fifth position 415, a fifth haptic feedback signal. User equipment 200 can increment a selectable digit at each instance of the haptic feedback signal. User equipment 200 can then detect disengagement from the touchscreen and / or detect a selection indication. In response, user equipment 200 can determine that the user has selected the currently selectable number (e.g., the number 5). In some implementations, during the selection of the third PIN digit, user equipment 200 can display two dots or another indication that two PIN digits have been entered.

[0085] According to the implementation scheme, the user equipment can initially set the selectable number to 0. In order to select 0, the user can touch the touchscreen for a short duration (e.g., tap) and / or touch the touchscreen without moving the contact (e.g., without swiping or dragging).

[0086] Figure 5An example of a user equipment receiving contact input for a fourth PIN digit is illustrated, where the third PIN digit is the number 0. As shown, user equipment 200 can detect an initial contact at start position 510. User equipment 200 can then detect disengagement from the contact with the touchscreen and / or detect a selection indication. In this example, the detected contact may remain mostly or completely still without any swipe motion. In response, user equipment 200 can determine that the user has selected the currently selectable digit (e.g., the number 0). In some embodiments, during the selection of the fourth PIN digit, user equipment 200 may display three dots or another indication that three PIN digits have been entered.

[0087] According to the implementation scheme, the touchscreen may not display any visual feedback or other visual information related to the selectable number or the selected number. Users can slide their fingers across a blank screen or a blank area of ​​the screen. Positions illustrated in Figure 3 (e.g., start position 310 and first position 311), and positions illustrated in Figure 4 (e.g., start position 410, first position 411, second position 412, third position 413, fourth position 414, fifth position 415), and... Figure 5 The illustrated locations (e.g., starting location 510) are shown as circles to indicate the position of the user's finger when a tactile feedback signal is generated. However, the user device may not actually display any circles or other information in one or more of these areas. Therefore, the implementation can advantageously reduce or eliminate visual cues and instead utilize touch-based communication between the user device 200 and the user, thereby providing a safe mechanism for inputting information into the user device for visually impaired individuals.

[0088] Return to reference Figure 1 In method 100, in step 109, the user equipment can determine the PIN based on the selected combination of numbers. For example, the user equipment may have received four numbers, and the user equipment can compile these four numbers into a four-digit PIN.

[0089] In step 110, the user equipment may process and / or transmit the PIN. For example, the user equipment may determine whether the PIN is valid (e.g., by comparing it with stored PIN information) via a confidentiality processing module. Additionally or alternatively, the user equipment may transmit the completed PIN to another device or server computer for processing (e.g., by comparing it with a stored PIN value to determine whether the PIN is valid).

[0090] In some implementations, in addition to haptic feedback, the user device may also provide audio information. For example, the user device may play audio tones, chimes, messages, and / or other sounds to notify the user that a selection has been received after each entered digit. In some implementations, the user device may use audio messages to notify the user how many digits have been entered after each digit input. For example, the user device may play audio messages such as "One digit entered," "Two digits entered," etc.

[0091] As mentioned above, users can touch the user device with one or more objects. For example, a user can touch the touchscreen with one or more fingers.

[0092] In some implementations, additional areas of the touchscreen can provide additional haptic or audio feedback. For example, a "clear" or "delete" button for erasing numeric input can be associated with an audio prompt of "clear" or "delete" when touched. As another example, a "complete" button can be associated with an audio prompt of "input," "complete," or "submit" when touched.

[0093] In some implementations, users can delete the entered numbers by selecting a delete button.

[0094] In some implementations, the user device can be configured to delete the most recent numeric input in response to a delete instruction. The delete instruction can include any suitable form of user contact. For example, a circular or near-circular swipe contact can serve as a delete instruction. This functionality can be included instead of and / or in addition to a delete button (e.g., a selectable area of ​​the screen). In other implementations, the circular gesture may not be associated with delete, allowing the user to drag their finger in any direction during the numeric selection process. Instead, delete can be associated with another gesture, such as shaking the user device.

[0095] The implementation scheme can advantageously prevent side-channel attacks that use other device sensors to decipher PIN input. For example, a side-channel attack could use the user device's gyroscope to attempt to identify the location of a touchscreen tap, or it could use the user device's camera to attempt to identify hand and finger movements on the screen. As mentioned above, the implementation scheme allows the user to touch the touchscreen in any desired area and swipe the contact object (e.g., a finger) in any suitable direction and / or pattern. Therefore, even if the gyroscope or camera reveals the contact location and / or movement, this information is useless for deciphering the PIN.

[0096] The implementation scheme can further mask the haptic feedback signal to prevent side-channel attacks that attempt to use a gyroscope to measure the haptic feedback signal corresponding to a specific number. Natural movements of the user's hand holding the phone and / or movements of the user's fingers on the touchscreen can introduce additional vibrations that may not be distinguishable from the haptic feedback signal, thus introducing noise into the gyroscope measurement. A gyroscope (and / or sensors on other devices) can detect numerous vibrations and movements, some of which may be caused by the haptic feedback signal, while others may be caused by random user movements. Therefore, gyroscope measurements may not be usable for counting haptic feedback signals or otherwise determining PIN-related information from them.

[0097] The above description and discussion pertain to the process of entering a digit-based PIN. However, the implementation is not limited to numeric or PIN input. For example, the implementation is also suitable for entering any other appropriate characters, alphanumeric codes, and other types of confidential information. The implementation can be further applied to entering amounts (e.g., payment amounts or tip amounts), phone numbers, addresses, Morse code, written messages, "yes" or "no" binary answers, selections from multiple options, and any other suitable information that can be entered into the device.

[0098] Figure 6 Example timeline 600 for character input via haptic feedback is shown.

[0099] In step 601, it can be with Figure 1 The steps are the same as or similar to step 101, where the user can initiate contact with the user device.

[0100] In step 602, it can be with Figure 1 The steps are the same as or similar to step 102, where the user can swipe, drag, or otherwise move the contact on the touchscreen. The user can maintain the contact for the duration of step 602. In some embodiments, the user can maintain continuous movement for the duration of step 602. In other embodiments, the user can stop and / or restart movement during step 602.

[0101] In step 603, it can be with Figure 1 The user equipment can generate a first tactile signal in the same or similar way as step 103.

[0102] In step 605A, it can be with Figure 1 The user equipment can generate a second tactile signal, which is the same as or similar to step 104 in the previous step.

[0103] In step 605B, it can be with Figure 1The user equipment can generate a third tactile signal, which is the same as or similar to step 104 in the previous step.

[0104] In step 604, it can be with Figure 1 Step 103 is the same as or similar to step 604, whereby the user can terminate contact with the user device. As discussed above, step 604 can vary along the timeline based on when the user chooses to end contact.

[0105] In step 607, it can be with Figure 1 The process is the same as or similar to step 107 in the example, whereby, in response to the user ending contact with the user device, the user device may register, store, and / or otherwise receive input of a number selected by the user. In this example, the selected number is 3.

[0106] Fixed digital grid with haptic feedback

[0107] In other embodiments of the invention, different numbers (or other characters) can be associated with different locations on the touchscreen. For example, a digital grid simulating a physical numeric keypad (e.g., a PIN pad) can be provided on the screen. This grid can include multiple cells, each corresponding to a different number. When a user touches the cell corresponding to a specific number, a corresponding haptic feedback signal can be generated. Embodiments allow each number to correspond to a unique haptic feedback signal, or allow several numbers to be associated with the same haptic feedback signal. The central cell of the digital grid can have a different haptic feedback signal to provide spatial guidance to the user.

[0108] Figure 7 A flowchart illustrating a method 700 for providing haptic feedback support for digital input at a digital grid is provided.

[0109] Users may expect or be prompted to enter a PIN on their device.

[0110] In step 701, the user equipment may provide a digital grid. For example, the user equipment may activate a digital grid on a touchscreen, where a set of numbers each corresponds to a specific cell at a specific location on the touchscreen. In some embodiments, the digital grid is displayed visually. In other embodiments, the digital grid is not displayed visually. The digital grid may be conveyed to the user solely through haptic feedback signals.

[0111] In step 702, the user equipment can detect contact with one or more objects on the touchscreen of the user equipment. For example, the user can touch the touchscreen with one or more fingers, a stylus, or any other suitable object.

[0112] In step 703, the user equipment can determine the location of the contact. For example, the user equipment can determine the cell of the digital grid being contacted, and which number is associated with that cell.

[0113] In step 704, the user equipment can determine whether the cell is the center cell. If the grid cell is the center cell, the method can proceed to step 705A. If the cell is not the center cell, the method can proceed to step 705B.

[0114] In step 705A, if the detected contact is located at the center cell of the digital grid, the user equipment may generate a first tactile feedback signal. The first tactile feedback signal may be uniquely associated with the center cell. Any suitable tactile feedback may be used for the first tactile feedback signal. For example, the first tactile feedback signal may include a single pulse, multiple pulses (e.g., 2, 3, 4, or 5), extended pulses, combinations of long and short pulses (e.g., Morse code), a specific predefined series of short, medium, and / or long pulses, continuous pulses (e.g., while the contact remains in the center cell), and / or any other suitable different tactile feedback signal. The first tactile feedback signal may include one or more vibrations, electrical pulses, thermal or cold signals, or any other suitable type of tactile sensation.

[0115] In some implementations, the cell may be associated with the number 5. However, implementations include any suitable arrangement of numbers and / or characters, and any suitable number or character may be positioned in the center cell.

[0116] In step 705B, if the detected contact is not located at the center cell of the digital grid, the user equipment may generate a second haptic feedback signal. Similar to the first haptic feedback signal, any suitable haptic feedback can be used for the second haptic feedback signal. The first haptic feedback signal may have a first configuration, and the second haptic feedback may have a second configuration different from the first configuration. In one example, the first haptic feedback signal is two pulses, and the second haptic feedback signal is one pulse. In another example, the first haptic feedback has a higher intensity or amplitude than the second haptic feedback signal.

[0117] According to the implementation plan, the second tactile feedback signal can be associated with every cell except the center cell. The digital grid may include nine, ten, or any suitable number of other cells. Figure 8An example of a digital grid 801 on a user device 800 is illustrated. As shown, the numbers 1, 2, 3, 4, 6, 7, 8, and 9 can each be assigned to a corresponding cell, and each of these cells can be a neighboring cell or otherwise positioned around the central cell 810. The implementation is equally applicable to any other suitable digital grid or keyboard of size, shape, and / or configuration.

[0118] If a user feels the first haptic feedback signal, they are notified that they are touching the center cell (e.g., the number 5). If a user feels the second haptic feedback signal, they are notified that they are touching one of the surrounding cells. To gain spatial awareness, a user can slide their finger across the screen, searching for the first haptic feedback signal to locate the center cell. The user can then slide their finger to the desired number, knowing that each number has a predefined position relative to the center cell.

[0119] According to the implementation plan, users can swipe their fingers across the screen without selecting a number. To select a number, the user releases contact from the cell and location associated with that number. The number associated with the currently touched cell and touchscreen location can be the currently selectable number. As the user swipes their finger across the screen, the currently selectable number changes based on the currently touched cell and touchscreen location.

[0120] In other implementations, users can select numbers by providing selection instructions. For example, selection instructions can be predefined user inputs such as double-tapping, long-pressing, simultaneously touching two or more fingers, shaking the user's device, voice commands (e.g., "select" or "enter"), or any other suitable input. Thus, users can navigate the number grid based on haptic feedback signals and then provide selection instructions at the cells and locations associated with the desired number.

[0121] Therefore, in step 706, the user equipment can determine whether the contact has ended and / or detect a selection indication (e.g., double-click). If the user equipment determines that the contact has not ended and / or no selection indication has been detected, this can indicate to the user that they do not wish to select a previously selectable number, and the method can proceed to step 707. If the user equipment determines that the contact has ended and / or a selection indication has been detected, this can indicate to the user that they wish to select a currently selectable number, and the method can jump to step 708 to process the user's selection.

[0122] In step 707, the user equipment may detect movement that has reached a new location. For example, the one or more objects in contact with the touchscreen may slide across the touchscreen or otherwise move to a new cell while remaining in contact with the touchscreen.

[0123] When a new position is reached in step 707, the method can return to step 703, and the user equipment can determine the new cell of the digital grid that is now being touched. The user equipment can also determine which number is associated with the new cell and the corresponding touchscreen position, and update the currently selectable number to the number associated with the new cell and touchscreen position.

[0124] In response to the updated touchscreen position, cell, and selectable number, the method can repeat steps 704 and 705A / 705B. Therefore, the user device can generate another haptic feedback signal based on the updated position of the touch. This can be the first haptic feedback signal if the touch moves to the center cell, and the second haptic feedback signal if the touch moves to any other cell.

[0125] According to the implementation scheme, steps 703 to 707 can be repeated until the user ends contact with the touchscreen and / or a selection instruction is provided. As long as the user remains in contact, the user device can continuously update the currently selectable digits and provide haptic feedback whenever the touch moves to a new cell. Therefore, the user can feel the change whenever their finger moves to a new cell and the selectable digit changes.

[0126] In step 708, the user equipment can determine the number selected by the user based on the end of the contact. For example, when the contact ends, a currently selectable number can be selected as the chosen number. The currently selectable number can be maintained in a record (e.g., it can be updated at each instance in step 707), or it can be determined based on the final cell (e.g., the cell at the end of the contact). For example, if the final cell is associated with the number 2, the user equipment can determine that the user has selected the number 2.

[0127] In some implementations, the user equipment may provide additional haptic feedback signals when a number is selected. For example, in response to the end of contact, selection indication, and / or identification of the selected number, the user equipment may generate haptic feedback signals to convey to the user that a number has been selected and entered and / or to convey to the user that the user equipment is ready for subsequent number input.

[0128] In step 709, it can be with Figure 1 Step 107 is similar or identical to that in the previous step, in which the user equipment can store and / or transmit selected numbers.

[0129] In step 710, it can be with Figure 1 Step 108 is similar or identical to the previous step, allowing the user equipment to determine whether the PIN input is complete.

[0130] If the PIN input is not complete, the method can return to step 702 to begin the process for providing subsequent digit input (e.g., for the second PIN digit). Steps 702 through 710 can be repeated in this manner for each digit of the PIN. Once the PIN input is complete, the method can proceed to step 711.

[0131] In step 711, it can be with Figure 1 Similar to or the same as step 109, the user equipment can determine the PIN based on the selected combination of numbers.

[0132] In step 712, it can be with Figure 1 Step 110 is similar to or the same as in the previous step, in which the user equipment can process and / or transmit the PIN.

[0133] In some implementations, the digit 0 is associated with a second tactile feedback signal. In other implementations, the digit 0 may be associated with a unique tactile feedback signal that is different from the second tactile feedback signal, thereby making the digit 0 easier to identify and providing more orientation and location information.

[0134] In some implementations, the number 0 may be associated with the center cell along with the number 5. The user device may be configured such that a first selection indicator (e.g., a click) selects the number 5, while a second selection indicator (e.g., a double-click) selects the number 0.

[0135] In some implementations, a second haptic feedback signal can be assigned to cells located directly to the left, right, above, and below the center cell (e.g., the numbers 2, 4, 6, and 8). A third haptic feedback signal, distinct from the second, can be assigned to cells located diagonally opposite the center cell (e.g., the numbers 1, 3, 7, and 9). This provides more guidance to the user by differentiating slightly different movements from the center (e.g., to the left versus diagonally to the left), thus preventing incorrect number input.

[0136] In some implementations, the user equipment may not provide an audio tone or other audible indication that the current cell is being touched, thereby preventing eavesdropping.

[0137] In some implementations, in addition to haptic feedback, the user device may also provide audio information. For example, the user device may play audio tones, chimes, messages, and / or other sounds to notify the user that a selection has been received after each entered digit. In some implementations, the user device may use audio messages to notify the user how many digits have been entered after each digit input. For example, the user device may play audio messages such as "One digit entered," "Two digits entered," etc.

[0138] In some implementations, additional areas of the touchscreen can provide additional haptic or audio feedback. For example, a "clear" or "delete" button for erasing numeric input can be associated with an audio prompt of "clear" or "delete" when touched. As another example, a "complete" button can be associated with an audio prompt of "input," "complete," or "submit" when touched.

[0139] In some implementations, users can delete the entered numbers by selecting a delete button.

[0140] In some implementations, the user device can be configured to delete recent digital input in response to a delete instruction. The delete instruction can include any suitable form of user contact. For example, a circular or near-circular swipe contact can serve as a delete instruction. This functionality can be included instead of and / or in addition to a delete button (e.g., a selectable area of ​​the screen).

[0141] According to the implementation scheme, the touchscreen may not display any visual feedback or other visual information related to the selectable digits or the selected digits. Users can slide their fingers across a blank screen or a blank area of ​​the screen. For example, a digit grid may not be displayed. Therefore, the implementation scheme can advantageously reduce or eliminate visual cues and instead utilize touch-based communication between the user device and the user, thereby providing a safe mechanism for visually impaired individuals to input information into the user device.

[0142] While this article describes a digital grid, implementations also include any other suitable form of digital layout. For example, in some implementations, a digital turntable can be provided on a screen. Users can rotate the turntable by sliding their finger (or other object) along a circular path, thereby changing the currently selectable number.

[0143] Floating digital grid with haptic feedback

[0144] In another implementation, the digital grid can have dynamic positioning. The user equipment can provide a digital grid with haptic feedback, similar to the one described above. Figures 7 to 8 The digital grid described. However, instead of a digital grid with a predetermined position and layout on the touchscreen, the user device can dynamically position the digital grid in response to the user's initial touch point. For example, the initial touch point could be the location of the center cell (e.g., the number 5), and / or the digital grid could be centered at or near the initial touch point. Therefore, the user can always start navigating the digital grid from the center cell.

[0145] Figure 9 A flowchart illustrating a method 900 for digital input at a dynamically positioned digital grid is provided.

[0146] Users may expect or be prompted to enter a PIN on their device.

[0147] In step 901, the user equipment can detect contact with one or more objects on the user equipment's touchscreen. For example, the user can touch the touchscreen with one or more fingers, a stylus, or any other suitable object.

[0148] In step 902, the user equipment may provide a digital grid. For example, the user equipment may generate a digital grid on a touchscreen, where a set of numbers each corresponds to a specific cell at a specific location on the touchscreen. The digital grid may be positioned based on the location of the initial touch detection. For example, the digital grid may be centered at the location of the initial touch, and / or the center cell may be positioned at the location of the initial touch. The digital grid may or may not be visually displayed.

[0149] In some implementations, the digital grid can be smaller than the screen. For example, the width of the digital grid can be smaller than the width of the screen. The width of the digital grid can be a fraction or a portion of the screen width, such as half, one-third, or two-thirds of the screen width. Therefore, the screen can still accommodate the digital grid even if the user does not initially touch the center of the screen. In some implementations, the size of the digital grid can be dynamically presented based on the location of the initial contact. For example, the user equipment can configure the digital grid to occupy all the space between the initial user contact and the nearest edge, so that the digital grid can be as large as possible while still being centered on the initial contact point. Depending on the implementation, the overall shape of the digital grid, the relative size of each cell, and / or the relative positioning arrangement of the cells can remain the same.

[0150] In step 903, it can be similar to Figure 7 In step 705A, the user equipment can generate a first haptic feedback signal associated with the center cell of the digital grid. Additionally, the user equipment can set the number associated with the center cell (e.g., the number 5) as the currently selectable number.

[0151] In step 904, it can be similar to Figure 7 In step 706, the user device can determine whether the contact has ended and / or detect a selection indication (e.g., a single click or double click). If the user device determines that the contact has not ended and / or no selection indication has been detected, this can indicate to the user that they do not wish to select a previously selectable number (e.g., the number associated with the center cell), and the method can proceed to step 905. If the user device determines that the contact has ended and / or a selection indication has been detected, this can indicate to the user that they wish to select a currently selectable number (e.g., the number associated with the center cell), and the method can jump to step 908 to process the user's selection.

[0152] In step 905, it can be with Figure 7 The steps are the same as or similar to step 707 in the previous section, and the user equipment can detect movement that has come into contact with the new location.

[0153] In step 906, the user equipment can determine the updated location and the corresponding cell of the digital grid that is currently being touched. The user equipment can also determine which number is associated with the updated cell and the touchscreen location, and update the currently selectable number to the number associated with the updated cell.

[0154] As an example, if the contact moves to a new cell positioned diagonally upward and to the left relative to the initial contact, that new cell can be associated with the number 1. If the contact moves to a new cell positioned directly upward relative to the initial contact, that new cell can be associated with the number 2. If the contact moves to a new cell positioned diagonally upward and to the right relative to the initial contact, that new cell can be associated with the number 3. If the contact moves to a new cell positioned directly to the left relative to the initial contact, that new cell can be associated with the number 4. If the contact moves to a new cell positioned directly to the right relative to the initial contact, that new cell can be associated with the number 6. If the contact moves to a new cell positioned diagonally downward and to the left relative to the initial contact, that new cell can be associated with the number 7. If the contact moves to a new cell positioned directly downward relative to the initial contact, that new cell can be associated with the number 8. If the contact moves to a new cell positioned diagonally downward and to the right relative to the initial contact, that new cell can be associated with the number 9.

[0155] According to various implementation schemes, the contact can be moved to a new touchscreen location and cell via any appropriate process or movement. For example, to reach a new cell positioned diagonally upward and to the left relative to the initial contact, the contact can be moved directly there via diagonal movement. Alternatively, the contact can first move to the left and then upward.

[0156] Figure 10 An example of a dynamic digital grid 1001 on user device 1000 is illustrated. The center cell 1010 can be positioned at the location where the user initially contacts it. Two other cells are illustrated with positions relative to the dynamically presented center cell. The first cell 1020, located diagonally upwards and to the left of the center cell 1010, can be associated with the number 1. The second cell 1030, located directly upwards from the center cell 1010, can be associated with the number 2.

[0157] Return to reference Figure 9In step 907, the user device may generate another haptic feedback signal based on the updated location of the contact and the corresponding cell. Typically, this may not be the first haptic feedback signal, because the first haptic feedback signal may be uniquely associated with the center cell, and the contact has just left the center cell at this point. Instead, the user device may generate a second haptic feedback signal (e.g., similar to...). Figure 7 Step 705B in the process.

[0158] According to the implementation scheme, steps 904 to 907 can be repeated until the user ends contact with the touchscreen and / or provides a selection instruction. As long as the user maintains contact, the user device can continuously update the currently selectable digits and provide haptic feedback whenever the contact moves to a new cell. Therefore, the user can feel the change whenever their finger moves to a new cell and the selectable digit changes. At each instance of step 907, the user device can determine whether the cell is the center cell. If the cell is the center cell, the user device can provide a first haptic feedback signal. If the cell is not the center cell, the user device can provide a second haptic feedback signal or other haptic feedback signals.

[0159] In step 908, it can be with Figure 7 The steps in step 708 are the same or similar, and the user equipment can determine the number selected by the user based on the end of the contact.

[0160] In step 909, it can be with Figure 1 Step 107 and Figure 7 Similar to or the same as step 709, the user equipment may store and / or transmit selected numbers.

[0161] In step 910, it can be with Figure 1 Step 108 and Figure 7 Step 710 is similar or the same as in the previous step, and the user equipment can determine whether the PIN input is complete.

[0162] If PIN input is not completed, the method can return to step 901 to begin the process for providing subsequent digit input (e.g., for a second PIN digit). In some implementations, the digit grid can be repositioned for each user contact, each digit selection, and / or each instance of step 901. Steps 901 through 710 can be repeated in this manner for each digit of the PIN. Once PIN input is complete, the method can proceed to step 911.

[0163] In step 911, it can be with Figure 1 Step 109 and Figure 7 Step 711 is similar or the same, in which the user equipment can determine the PIN based on the selected combination of numbers.

[0164] In step 912, it can be with Figure 1 Step 110 and Figure 7 Step 712 is similar to or the same as in the previous step, in which the user equipment can process and / or transmit the PIN.

[0165] In some implementations, the digit 0 is associated with a second tactile feedback signal. In other implementations, the digit 0 may be associated with a unique tactile feedback signal that is different from the second tactile feedback signal, thereby making the digit 0 easier to identify and providing more orientation and location information.

[0166] In other implementations, in addition to the number 5, the number 0 may also be associated with the center cell. The user device may be configured such that a first selection instruction (e.g., a click) selects the number 5, while a second selection instruction (e.g., a double-click) selects the number 0.

[0167] In some implementations, a second haptic feedback signal may be assigned to cells located directly to the left, right, above, and below the center cell (e.g., the numbers 2, 4, 6, and 8). A third haptic feedback signal, distinct from the second, may be assigned to cells diagonally positioned relative to the center cell (e.g., the numbers 1, 3, 7, and 9). This provides more guidance to the user by differentiating slightly different movements from the center (e.g., to the left versus diagonally to the left), thus preventing incorrect number input. The terms "second haptic" and "third haptic" do not necessarily refer to the order in which the haptic feedback signals are generated, but may refer to the pattern or other quality of the haptic feedback. For example, in some implementations, a first haptic feedback signal may not be generated, and the second haptic feedback signal may be a first haptic signal provided sequentially in time.

[0168] In some implementations, the user equipment may not provide an audio tone or other audible indication that the current cell is being touched, thereby preventing eavesdropping.

[0169] In some implementations, in addition to haptic feedback, the user device may also provide audio information. For example, the user device may play audio tones, chimes, messages, and / or other sounds to notify the user that a selection has been received after each entered digit. In some implementations, the user device may use audio messages to notify the user how many digits have been entered after each digit input. For example, the user device may play audio messages such as "One digit entered," "Two digits entered," etc.

[0170] In some implementations, additional areas of the touchscreen can provide additional haptic or audio feedback. For example, a "clear" or "delete" button for erasing numeric input can be associated with an audio cue and / or haptic feedback signal indicating "clear" or "delete" when touched. As another example, a "complete" button can be associated with an audio cue and / or haptic feedback signal indicating "input," "complete," "submit," or "done" when touched.

[0171] In some implementations, users can delete the entered numbers by selecting a delete button.

[0172] In some implementations, the user device can be configured to delete recent digital input in response to a delete instruction. The delete instruction can include any suitable form of user contact. For example, a circular or near-circular swipe contact can serve as a delete instruction. This functionality can be included instead of and / or in addition to a delete button (e.g., a selectable area of ​​the screen).

[0173] In some implementations, additional areas of the touchscreen can provide additional haptic or audio feedback. For example, a "clear" or "delete" button for erasing numeric input can be associated with an audio cue and / or haptic feedback signal indicating "clear" or "delete" when touched. As another example, a "complete" button can be associated with an audio cue and / or haptic feedback signal indicating "input," "complete," "submit," or "done" when touched.

[0174] According to the implementation scheme, the touchscreen may not display any visual feedback or other visual information related to the selectable digits or the selected digits. Users can slide their fingers across a blank screen or a blank area of ​​the screen. For example, a digit grid may not be displayed. Therefore, the implementation scheme can advantageously reduce or eliminate visual cues and instead utilize touch-based communication between the user device and the user, thereby providing a safe mechanism for visually impaired individuals to input information into the user device.

[0175] Although Figure 9 While haptic feedback has been described, it may not be necessary in some implementations. For example, if a user knows that the center cell is always presented at the initial point of contact, the user may be able to swipe in the relevant direction without requiring navigation guidance provided by the haptic feedback in steps 903 and / or 907.

[0176] While this document describes a digital grid, implementations also include any other suitable form of digital layout. For example, in some implementations, a digital wheel can be provided on the screen. Users can rotate the wheel by sliding their finger (or other object) along a circular path, thereby changing the currently selectable number. The bottom area, draggable portion, or other starting position of the wheel can be presented upon initial user contact.

[0177] directional swipe with haptic feedback

[0178] In another implementation, the user device can associate numbers or characters with the direction of movement. For example, an upward swipe can be associated with the number 2. The swipe direction can include a range of directions or angles from the initial point (which can be represented by a cone or triangle).

[0179] Targeted swipes can include the above-mentioned... Figures 7 to 8 The floating number grid discussed shares some similarities because users can similarly directionally swipe to reach the desired cell associated with the desired number. However, the corner intersections of the grid (such as the corner intersections of cells for numbers 1, 2, 4, and 5) can potentially lead to unintended input because many locations are adjacent. For example, if a user expects to input the number 1, they might accidentally move to a cell for number 2 or 4 while moving through a corner intersection. The user might incorrectly input the number 2 or 4 instead of the expected number 1. In contrast, directional swipes avoid such crowded intersections. Instead of moving the contact to a specific ending position associated with the desired cell, the user can provide a swipe trajectory of any suitable length, which may have less possibility of ambiguity.

[0180] Figure 11 A flowchart illustrating a method 1100 for digital input via directional swiping is provided.

[0181] Users may expect or be prompted to enter a PIN on their device.

[0182] In step 1101, the user equipment can detect contact with one or more objects on the user equipment's touchscreen. For example, the user can touch the touchscreen with one or more fingers, a stylus, or any other suitable object. The contact can occur in any suitable area of ​​the touchscreen.

[0183] In step 1102, the user equipment may generate a first haptic feedback signal. The first haptic feedback signal may be provided to notify the user that contact has been established and that a directional swipe can begin. Any suitable haptic feedback may be used for the first haptic feedback signal. For example, the first haptic feedback signal may include a single pulse, multiple pulses (e.g., 2, 3, 4, or 5), extended pulses, combinations of long and short pulses (e.g., Morse code), a specific predefined series of short, medium, and / or long pulses, continuous pulses, and / or any other suitable different haptic feedback signal. The first haptic feedback signal may include one or more vibrations, electrical pulses, thermal or cold signals, or any other suitable type of haptic sensation.

[0184] In step 1103, the user equipment can detect the movement of the touch. The user can swipe the touch on the screen to indicate a desired number associated with the direction and trajectory of the swipe. The user equipment can measure the distance traveled by the swipe as the touch moves.

[0185] In step 1104, the user device may generate a second haptic feedback signal. The second haptic feedback signal may be generated in response to a predetermined length and / or time having been achieved by a contact movement. For example, a certain amount of movement distance (e.g., 1 cm, 2 cm, 3 cm, 4 cm, 5 cm, 6 cm, 7 cm, 8 cm, 9 cm, or 10 cm) and / or time (e.g., ½ second, 1 second, 2 seconds, 3 seconds, 4 seconds, or 5 seconds) may be sufficient to determine the expected trajectory of the movement. The second haptic feedback signal may be provided to notify the user that sufficient swipe movement has been received and that the user can disengage from contact.

[0186] Any suitable haptic feedback can be used for the second haptic feedback signal. In some embodiments, the second haptic feedback signal may differ from the first haptic feedback. As an example, the first haptic feedback may include two pulses, and the second haptic feedback signal may include a single pulse. In other embodiments, the second haptic feedback may be similar to or the same as the first haptic signal. For example, each of the first and second haptic feedback signals may include a single pulse. In other examples, the second haptic feedback signal may be configured based on an associated trajectory and number (e.g., six pulses configured for a trajectory corresponding to the number 6).

[0187] In step 1105, the user equipment may detect the end of contact and / or detect a selection indication (e.g., double-click). For example, the user may release the contact in response to a second haptic feedback signal. In some embodiments, the user may also provide a selection indication (e.g., double-click) to confirm the input.

[0188] In some implementations, after the second haptic feedback signal in step 1104, if the contact continues, the user device can continue to track the movement of the contact. For example, the user can continue to move the contact to provide a longer swipe, which allows for a more accurate determination of the intended trajectory. In some implementations, the method may not proceed to step 1106 until the user device detects the end of the contact and / or a selection indication. In other implementations, for efficiency, the method may proceed to step 1106 immediately after or simultaneously with the second haptic feedback signal in step 1104.

[0189] In step 1106, the user equipment can determine the trajectory (also known as directionality) of the contact movement. In some embodiments, the trajectory of movement can be defined by a line between two points. The first point can be the location of the initial contact and / or the contact location at the first tactile feedback signal in step 1102. The second point can be a predetermined distance from the first point, the contact location at the second tactile feedback signal in step 1104, and / or the location of contact disengagement. The trajectory can be determined in any other suitable manner, such as averaging the contact movement and / or assigning additional weights to the first portion, the middle portion, or the last portion of the movement.

[0190] In step 1107, the user equipment can determine the number selected by the user. For example, the user equipment can identify numbers or other characters associated with the trajectory.

[0191] Figure 12 An example trajectory diagram is shown. Figure 12In the diagram, center position 1210 indicates the location of the first point and / or initial contact. Various trajectory cones corresponding to different numbers are shown. Any suitable number or character can be associated with any suitable trajectory. For example, a trajectory diagonally upward and to the left relative to the initial contact (e.g., 135 degrees counterclockwise from the x-axis) can be associated with the number 1. A trajectory directly upward relative to the initial contact (e.g., 90 degrees counterclockwise from the x-axis) can be associated with the number 2. A trajectory diagonally upward and to the right relative to the initial contact (e.g., 45 degrees counterclockwise from the x-axis) can be associated with the number 3. A trajectory directly to the left relative to the initial contact (e.g., 180 degrees counterclockwise from the x-axis) can be associated with the number 4. A trajectory directly to the right relative to the initial contact (e.g., 0 degrees counterclockwise from the x-axis) can be associated with the number 6. A trajectory diagonally downward and to the left relative to the initial contact (e.g., 225 degrees counterclockwise from the x-axis) can be associated with the number 7. A trajectory that is directly downward relative to the initial contact (e.g., 270 degrees counterclockwise from the x-axis) can be associated with the number 8. A trajectory that is diagonally downward and to the right relative to the initial contact (e.g., 315 degrees counterclockwise from the x-axis) can be associated with the number 9. Each trajectory may include a range of directions (e.g., positive and / or negative 2 degrees, 5 degrees, 10 degrees, or any other suitable amount).

[0192] In some implementations, orientation (e.g., the x-axis) can be defined relative to the touchscreen. For example, the typical bottom of the touchscreen can be parallel to the x-axis, or otherwise define what a horizontal position is. In other implementations, orientation (e.g., the x-axis) can be defined relative to gravity. For example, the downward pull of gravity (e.g., as measured by instruments on the device) can be used to set the horizontal direction of the x-axis. This can advantageously improve the interpretation of user input in cases where the touchscreen is slightly rotated or tilted and / or the user is unaware of the touchscreen's orientation.

[0193] In some implementations, the user device can associate additional digits with shorter and / or longer movements. Thus, the trajectory can combine both the direction and length of the movement path. For example, a long downward swipe (e.g., 5 cm or 10 cm) can be associated with the digit 0. The user device can provide a second haptic feedback signal when the user has reached the distance traveled for the digit 8, and then a third haptic feedback signal if the contact continues to move an additional predetermined distance and / or time to reach the digit 0. As another example, the digit 5 ​​can be associated with little or no movement. Instead of a swipe, the user can press and hold a single location for a predetermined amount of time (e.g., a short tap, or a long press of one or more seconds) to input the digit 5. The user device can provide a second haptic feedback signal after the predetermined amount of time.

[0194] In some implementations, the user equipment screen may display a trajectory map, such as Figure 12 The trajectory diagram 1201 is shown. In other embodiments, the user equipment screen may be blank, black, or otherwise not display numbers or PIN-related information during the numeric input process.

[0195] Figures 13A to 13H An example of a contact detected at user equipment 1300 is illustrated. As shown, the implementation allows contact to be initiated in any suitable area of ​​the touchscreen. Furthermore, different contact instances can be initiated in different areas of the touchscreen. The user equipment can be able to determine the trajectory of the moving contact regardless of the initial contact point. Figure 13A The example illustrates user equipment 1300 detecting a moving contact with a downward trajectory, which can be associated with the number 8. Figure 13B An example is given where user equipment 1300 detects a moving contact with a downward trajectory and an extended contact distance (e.g., 5 cm, 10 cm, half the height of the touchscreen, and / or any other suitable distance), which may be associated with the number 0. Figure 13C The example illustrates user equipment 1300 detecting a moving contact with diagonal upward and rightward trajectories, which can be associated with the number 3. Figure 13D For example, user equipment 1300 detects stationary contact (e.g., no trajectory), which can be associated with the number 5. Figure 13E The example illustrates user equipment 1300 detecting a moving contact with diagonal downward and rightward trajectories, which can be associated with the number 9. Figure 13F The example illustrates user equipment 1300 detecting a moving contact with diagonal downward and leftward trajectories, which can be associated with the number 7. Figure 13G An example is given where user equipment 1300 detects a moving contact with a circular path (e.g., without a defined direction or trajectory), which can be associated with an erase command. Figure 13H The example illustrates a user equipment 1300 detecting two consecutive stationary contacts (e.g., a double-click), which can be associated with completing or entering a command (e.g., for entering a PIN, or for entering digits of a PIN).

[0196] Return to reference Figure 11 In step 1108, it can be with Figure 1 Step 107 and Figure 7 Step 709 and Figure 9 Step 909 is similar to or the same as that in the previous step, in which the user equipment can store and / or transmit selected numbers.

[0197] In step 1109, it can be with Figure 1 Step 108 and Figure 7 Steps 710 and Figure 9Step 910 is similar or identical to the previous step, allowing the user equipment to determine whether the PIN input is complete.

[0198] If the PIN input is not complete, the method can return to step 1101 to begin the process for providing subsequent digit input (e.g., for the second digit of the PIN). Steps 1101 through 1108 can be repeated in this manner for each digit of the PIN. Once the PIN input is complete, the method can proceed to step 1110.

[0199] In step 1110, it can be with Figure 1 Step 109 and Figure 7 Step 711 and Figure 9 Step 911 is similar or the same, in which the user equipment can determine the PIN based on the selected combination of numbers.

[0200] In step 1111, it can be with Figure 1 Step 110 and Figure 7 Steps 712 and Figure 9 Step 912 is similar to or the same as that in the previous step, in which the user equipment can process and / or transmit the PIN.

[0201] In some implementations, in addition to haptic feedback, the user device may also provide audio information. For example, the user device may play audio tones, chimes, messages, and / or other sounds to notify the user that a selection has been received after each entered digit. In some implementations, the user device may use audio messages to notify the user how many digits have been entered after each digit input. For example, the user device may play audio messages such as "One digit entered," "Two digits entered," etc.

[0202] In some implementations, additional areas of the touchscreen can provide additional haptic or audio feedback. For example, a "clear" or "delete" button for erasing numeric input can be associated with an audio prompt of "clear" or "delete" when touched. As another example, a "complete" button can be associated with audio prompts of "input," "complete," "submit," or "done" when touched.

[0203] In some implementations, users can delete the entered numbers by selecting a delete button.

[0204] In some implementations, the user device can be configured to delete recent digital input in response to a delete instruction. The delete instruction can include any suitable form of user contact. For example, a circular or near-circular swipe contact can serve as a delete instruction. This functionality can be included instead of and / or in addition to a delete button (e.g., a selectable area of ​​the screen).

[0205] According to the implementation plan, the touchscreen may not display any visual feedback or other visual information related to the selectable number or the selected number. Users can slide their fingers across a blank screen or a blank area of ​​the screen. For example, it may not display... Figure 12 The trajectory diagram 1201 shown in the figure. Therefore, the implementation can advantageously reduce or eliminate visual cues and instead utilize touch-based communication between the user device and the user, thereby providing a safe mechanism for visually impaired individuals to input information into the user device.

[0206] Although Figure 11 While haptic feedback has been described, it may not be necessary in some implementations. A user may be able to swipe in the relevant direction without requiring communication provided by haptic feedback.

[0207] Overview of Tactile Digital Input

[0208] The above discussion outlines several techniques for receiving touch-based user input at a user device. Each of these techniques can include communication with the user via haptic feedback. Further details can be found on... Figure 14 This describes a generalized approach to encapsulating each of these technologies.

[0209] Figure 14 A flowchart illustrating a method 1400 for digital input via haptic feedback is provided.

[0210] Users may expect or be prompted to enter a PIN on their device.

[0211] In step 1401, the user equipment may detect contact with one or more objects on the screen of the user equipment. This may include, for example... Figure 1 Step 101 in Figure 7 Step 702 in Figure 9 Step 901 and / or Figure 11 The features of step 1101 in the process.

[0212] In step 1402, the user equipment can detect movement of the contact. This may include, for example... Figure 1 Step 102 in Figure 7 Step 707 in the middle Figure 9 Step 905 and / or Figure 11 The features of step 1103 in the process.

[0213] In step 1403, the user equipment may generate one or more haptic feedback signals during contact and / or movement. This may include, for example... Figure 1 Steps 103 and / or 105 in the process Figure 7Steps 705A and / or 705B in the process Figure 9 Steps 903 and / or 907 and / or Figure 11 Features of steps 1102 and / or 1104 in the process.

[0214] In step 1404, the user equipment may detect the end of contact and / or selection indication. This may include, for example... Figure 1 Step 104 in Figure 7 Step 706 in Figure 9 Step 904 and / or Figure 11 The features of step 1105 in the process.

[0215] In step 1405, the user equipment may determine the selected number based on the end of the contact and / or selection indication. This may include, for example... Figure 1 Step 106 in Figure 7 Step 708 in the middle Figure 9 Step 908 and / or Figure 11 Features of steps 1106 and / or 1107 in the process.

[0216] In step 1406, the user equipment may store and / or transmit selected numbers. This may include, for example... Figure 1 Step 107 in Figure 7 Step 709 in Figure 9 Step 909 and / or Figure 11 The features of step 1108 in the process.

[0217] In step 1407, the user equipment can determine whether the PIN input is complete. This may include, for example... Figure 1 Step 108 in Figure 7 Step 710 in the middle Figure 9 Steps 910 and / or Figure 11 The features of step 1109 in the process.

[0218] If the PIN input is not complete, the method can return to step 1401 to begin the process for providing subsequent digit input (e.g., for a second PIN digit or another PIN digit). Steps 1401 through 1407 can be repeated in this manner for each digit of the PIN. Once the PIN input is complete, the method can proceed to step 1408.

[0219] In step 1408, the user equipment can determine the PIN based on the selected combination of numbers. This may include, for example... Figure 1 Step 109 in Figure 7 Step 711 in Figure 9 Step 911 and / or Figure 11 The features of step 1110 in the process.

[0220] In step 1409, the user equipment may process and / or transmit a PIN. This may include, for example... Figure 1 Step 110 in Figure 7 Step 712 in Figure 9 Steps 912 and / or Figure 11 The features of step 1111 in the middle.

[0221] Select the amount by swiping.

[0222] Other embodiments of the invention include targeted swiping to increase and / or decrease amounts. For example, a targeted swiping can be used to modify tip amounts (e.g., a percentage of a bill). As another example, a targeted swiping can be used to modify the amount of cash withdrawn from an ATM. Thus, visually impaired individuals can independently enter amounts.

[0223] Figure 15A This example illustrates how the tip increases with each swipe up. A swipe up on the touchscreen can increase the tip by a predetermined increment. For example, with each swipe up, the tip could increase by 1%, 5%, 10%, or any other suitable increment. In this example, the tip could increase from 5% to 10%.

[0224] Figure 15B Another example illustrating how the tip increases with an upward swipe. In this example, the tip can increase from 10% to 15%. A directional swipe can contact the touchscreen from any suitable area. This contact may not need to overlap with a button or selectable area associated with the desired tip amount.

[0225] Figure 15C This example illustrates how a swipe down reduces the tip amount. A swipe down on a touchscreen can reduce the tip amount by a predetermined increment. For example, with each swipe down, the tip amount could be reduced by 5%, 10%, or any other suitable increment. In this example, the tip could be reduced from 25% to 20%.

[0226] Figure 15D This example illustrates how to enter an amount using a selection indicator. A selection indicator, such as double-clicking, allows you to enter an amount that is currently set or selected (e.g., set by a previous swipe). In this example, the entered amount can be reduced by 15%.

[0227] Implementation schemes may include haptic feedback. For example, a haptic feedback signal can be generated whenever the user changes the amount. In some implementations, the haptic feedback signal can convey information about the amount. For example, each pulse of the haptic feedback signal can represent 5%, such that a haptic feedback signal with four pulses can indicate that the user has currently selected 20%.

[0228] Implementations may include audio feedback. For example, an audio confirmation (e.g., a bell or beep) may be generated whenever a user changes the amount. In some implementations, the audio may include voice assistance. For example, the voice may notify the user of the amount selected (e.g., "10%", "20% selected", "No tip", "Tip amount entered", "Total amount is...", "Payment successful", etc.).

[0229] The amount can start from a default amount. For example, the initial tip amount can be 0%, 10%, or 20%, and users can start by modifying the amount from these values.

[0230] User equipment

[0231] The implementation plan allows the user device to take any suitable form. The user device can be any suitable device with which the user can interact. For example, the user device can take the form of a mobile device (e.g., which may belong to the user) or an access device (e.g., which may belong to the service provider).

[0232] Figure 16 User equipment 1600 according to an embodiment is illustrated. User equipment 1600 may include device hardware 1604 coupled to system memory 1602.

[0233] Device hardware 1604 may include a processor 1606, a short-range antenna 1614, a long-range antenna 1616, an input element 1610, a user interface 1608, and an output element 1612 (which may be part of the user interface 1608). The processor 1606 may be implemented as one or more integrated circuits (e.g., one or more single-core or multi-core microprocessors and / or microcontrollers) and is used to control the operation of user equipment 1600. The processor 1606 may execute various programs in response to program code or computer-readable code stored in system memory 1602, and may maintain multiple concurrently executing programs or processes.

[0234] Examples of input element 1610 may include a microphone, keypad, touchscreen, sensor, etc. In some embodiments, user interface 1608 (which may also be referred to as an interactive element) may be configured for both input and output. For example, a touchscreen may be an interactive element configured to detect user touch to receive input and also configured to output information to the user via a visual display. Touchscreen may include a glass panel, a plastic panel, one or more sensors, and / or any other suitable component.

[0235] Examples of output element 1612 may include a speaker, a display screen, and a haptic feedback element. Output element 1612 may include any suitable element for providing haptic feedback. For example, one or more haptic feedback elements may be configured to vibrate, transmit electrical pulses, generate heat or cold (e.g., in a local space), or provide any other suitable form of haptic feedback. Haptic feedback elements may include one or more actuators, headpads, electrical pulse transmitters, or any other suitable haptic device or hardware for providing haptic feedback.

[0236] The long-range antenna 1616 may include one or more RF transceivers and / or connectors, which can be used by the user equipment 1600 to communicate with other devices and / or connect to external networks. The user interface 1608 may include any combination of input and output elements to allow the user to interact with the user equipment 1600 and invoke the functions of that user equipment. The short-range antenna 1614 may be configured to communicate with external entities via short-range communication media (e.g., using Bluetooth, Wi-Fi, infrared, NFC, etc.). The long-range antenna 1616 may be configured to communicate over the air with remote base stations and remote cellular or data networks.

[0237] System memory 1602 may be implemented using any combination of any number of non-volatile memories (e.g., flash memory) and volatile memories (e.g., DRAM, SRAM), any other non-transitory storage media, or combinations thereof. System memory 1602 may store computer code executable by processor 805 to perform any of the functions described herein. For example, system memory 1602 may include a computer-readable medium comprising code executable by processor 1606 for implementing a method comprising: a) detecting contact with one or more objects on a touchscreen; b) detecting movement of the contact on the touchscreen; c) generating one or more haptic feedback signals in response to the movement of the contact, each of the one or more haptic feedback signals being associated with a selectable digit; d) detecting at least one of an end of contact and a selection indication; e) determining a selected digit based on at least one of the end of contact and the selection indication; and f) storing or transmitting the selected digit.

[0238] The system memory 1602 may also store the transaction initiation module 1602A, the touch detection module 1602B, the tactile signal module 1602C, the confidentiality processing module 1602D, and / or the operating system 1602E, as well as other components.

[0239] The transaction initiation module 1602A may include instructions or code for initiating and conducting transactions with external devices, such as access devices or processing computers. The transaction initiation module may include code executable by the processor 1606 for generating and transmitting authorization request messages and receiving and forwarding authorization response messages. The transaction initiation module may also include code executable by the processor 1606 for establishing a local connection or otherwise interacting with external access devices.

[0240] The touch detection module 1602B may include instructions or code for detecting touch. The touch detection module may include code executable by the processor 1606 for detecting a touch of an object (e.g., a finger or stylus) on the touchscreen, determining the location of the touch on the touchscreen, identifying movement, determining the speed and / or direction of the movement, determining when the movement ends and / or when the contact is released and / or determining the final position of the contact before release.

[0241] The haptic signal module 1602C may include instructions or code for inducing haptic feedback. The haptic signal module may include code executable by the processor 1606 for controlling the haptic feedback element to generate a haptic feedback signal. The haptic feedback signal may be generated in response to a triggering event such as movement of a touch on a touchscreen. Depending on the triggering event, specific haptic feedback signals may be configured.

[0242] The confidentiality processing module 1602D may include instructions or code for processing confidential information. This module may include code executable by the processor 1606 for receiving a confidential information (e.g., a PIN) and determining whether the confidential information is valid. For example, the confidentiality processing module 1602D may include code that causes the processor 1606 to combine one or more input characters to form a received confidential information and compare the received confidential information with stored confidential information to determine whether the received confidential information is valid. In some embodiments, the confidentiality processing module 1602D may include code that causes the processor 1606 to transmit the received confidential information to a server computer for processing and to receive a response from the server computer indicating whether the confidential information has been successfully verified.

[0243] Any software component or function described in this application may be implemented as software code executable by a processor using, for example, conventional or object-oriented techniques and any suitable computer language (e.g., Java, C++, or Perl). The software code may be stored as a series of instructions or commands on a computer-readable medium such as random access memory (RAM), read-only memory (ROM), magnetic media (such as hard disk drives or floppy disks), or optical media (such as CD-ROMs). Any such computer-readable medium may reside on or within a single computing device, and may exist on or within different computing devices within a system or network.

[0244] The above description is illustrative and not restrictive. Many variations of the invention will become apparent to those skilled in the art upon review of this disclosure. Therefore, the scope of the invention may be determined not with reference to the above description, but rather with reference to the pending claims and their full scope or equivalents.

[0245] Without departing from the scope of the invention, one or more features of any embodiment may be combined with one or more features of any other embodiment.

[0246] Unless explicitly indicated otherwise, the use of “a / kind” or “the / described” is intended to mean “a / kind or a plurality of / kinds”.

[0247] All patents, patent applications, publications, and descriptions mentioned above are incorporated herein by reference in their entirety for all purposes. This is not an admission that they are prior art.

Claims

1. A method comprising: a) detecting, by a user device comprising a touchscreen, contact with one or more objects on the touchscreen; b) detecting, by the user device, movement of the contact on the touchscreen; c) generating, by the user device, one or more haptic feedback signals in response to the movement of the contact, each of the one or more haptic feedback signals being associated with a selectable number; d) detecting, by the user device, at least one of an end of the contact and a selection indication; e) determining, by the user device, a selected number based on the at least one of the end of the contact and the selection indication; and f) storing or transmitting, by the user device, the selected number.

2. The method of claim 1, further comprising: repeating steps a) through f) until the user device receives a secret formed by the selected number and at least one additional number.

3. The method of claim 1, wherein generating the one or more haptic feedback signals in response to the movement of the contact comprises: generating a first haptic feedback signal in response to a first portion of the movement, the first haptic feedback signal being associated with a first selectable number; and generating a second haptic feedback signal in response to a second portion of the movement, the second haptic feedback signal being associated with a second selectable number.

4. The method of claim 1, wherein the one or more haptic feedback signals are a plurality of haptic feedback signals, and generating the one or more haptic feedback signals in response to the movement of the contact comprises: sequentially generating each of the plurality of haptic feedback signals during the movement, wherein a first haptic feedback signal of the plurality of haptic feedback signals is associated with a first selectable number that is the number 1, and each subsequent haptic feedback signal of the plurality of haptic feedback signals is associated with a selectable number that is incremented by 1 relative to a previous haptic feedback signal.

5. The method of claim 4, wherein each of the plurality of haptic feedback signals comprises a number of vibration pulses equal to the selectable number.

6. The method of claim 5, wherein determining the selected number comprises identifying the selectable number associated with a most recent haptic feedback signal of the plurality of haptic feedback signals prior to the end of the contact or the selection indication.

7. The method of claim 5, wherein sequentially generating each of the plurality of haptic feedback signals comprises sequentially updating a current selectable number to be the selectable number associated with a most recent haptic feedback signal of the plurality of haptic feedback signals, and wherein determining the selected number comprises identifying the current selectable number at the end of the contact or at the selection indication.

8. The method of claim 4, wherein an initial point of contact on the touchscreen is a random location on the touchscreen, wherein the movement of the contact is continuous, wherein the movement of the contact does not follow a predefined pattern, and wherein the selection indication is a double tap. ​ 9. The method of claim 4, wherein the plurality of haptic feedback signals are generated at variable intervals.

10. The method of claim 9, wherein the variable intervals are distance intervals.

11. The method of claim 1, wherein the movement of the contact is circular, and wherein generating the one or more haptic feedback signals in response to the movement of the contact comprises generating a first subset of one or more haptic feedback signals during a first circle traced by the movement of the contact, and generating a second subset of one or more haptic feedback signals during a second circle traced by the movement of the contact, wherein the first subset and the second subset comprise different numbers of haptic feedback signals.

12. The method of claim 1, further comprising: in response to detecting the contact with the one or more objects on the touchscreen, providing a digital grid having a plurality of cells, each cell of the plurality of cells being associated with a corresponding number and a corresponding location on the touchscreen, and a center cell of the plurality of cells being positioned at an initial point of contact on the touchscreen.

13. The method of claim 12, wherein the initial point of contact on the touchscreen is not a center of the touchscreen, and wherein the digital grid is not visually displayed.

14. The method of claim 12, further comprising: in response to detecting the contact with the one or more objects on the touchscreen, generating a first haptic feedback signal, the first haptic feedback signal being associated with the center cell; and determining that the contact has moved to an adjacent cell of the plurality of cells, and wherein generating the one or more haptic feedback signals comprises generating a second haptic feedback signal in response to determining that the contact has moved to the adjacent cell of the plurality of cells, wherein the second haptic feedback signal has a second configuration that is different from a first configuration of the first haptic feedback signal.

15. The method of claim 13, wherein generating the one or more haptic feedback signals comprises updating a currently selectable number to the selectable number associated with a currently contacted cell of the plurality of cells, and wherein determining the selected number comprises identifying the currently selectable number at the end of the contact or at the selection indication.

16. The method of claim 1, further comprising: determining a trajectory of the movement based on a first location of an initial contact and a second location of the end of the contact, wherein determining the selected number comprises identifying a number associated with the trajectory.

17. The method of claim 16, further comprising: in response to detecting the contact with the one or more objects on the touchscreen, generating a first haptic feedback signal; and determining that the contact has moved a predetermined distance from an initial point of contact, and wherein generating the one or more haptic feedback signals comprises generating a second haptic feedback signal in response to determining that the contact has moved the predetermined distance.

18. The method of claim 17, wherein generating the second haptic feedback signal serves as the indication of the selected number sufficient to determine the movement of the contact, and wherein the selected number is a number associated with the track.

19. A user device comprising: a touch screen; an actuator configured to generate haptic feedback signals; a processor and a memory, the memory storing instructions that, when executed by the processor, cause the processor to perform steps comprising: a) detecting a contact with one or more objects on the touch screen; b) detecting movement of the contact on the touch screen; c) generating one or more haptic feedback signals in response to the movement of the contact, each of the one or more haptic feedback signals being associated with a selectable number; d) detecting at least one of an end of the contact and a selection indication; e) determining a selected number based on the at least one of the end of the contact and the selection indication; and f) storing or transmitting the selected number.

20. The user device of claim 19, wherein the user device is a mobile device or an access device.

Images