Device, method, and graphical user interface for providing feedback during interaction with intensity-sensitive button

Abstract

To provide devices, methods, and graphical user interfaces for providing feedback during interaction with an intensity-sensitive button.SOLUTION: An electronic device is configured to: display a home button configuration user interface having a plurality of different tactile output settings for a home button; while displaying the home button configuration user interface, detect selection of a respective tactile output setting; in accordance with detecting a first input of a first type on the home button, determine whether the respective tactile output setting is a first tactile output setting or a second tactile output setting; if the tactile output setting is the first tactile output setting, provide a first tactile output without dismissing the home button configuration user interface; and, if the respective tactile output setting is a second tactile output setting, provide a second tactile output without dismissing the home button configuration user interface.SELECTED DRAWING: Figure 5A13

Description

Technical Field

[0001] The present invention generally relates to an electronic device having a display and an intensity sensing button, including but not limited to an electronic device having a display and an intensity sensing home button.

Background Art

[0002] Many electronic devices having a display include mechanical buttons, such as a mechanical home button, to navigate between different user interfaces displayed on the electronic device. However, mechanical buttons provide little, if any, feedback to the user beyond a fixed down click and a fixed up click.

Summary of the Invention

[0003] Accordingly, there is a need for an electronic device that improves methods and interfaces for providing visual feedback, tactile feedback, and / or audio feedback during interaction with a button, thereby enabling a more efficient and intuitive user interface operation for the user. Such methods and interfaces can optionally complement or replace conventional methods of providing feedback during interaction with a button. Such methods and interfaces assist the user in understanding the connection between the provided input and the device response to that input, thereby reducing the number, degree, and / or type of inputs from the user, thereby creating a more efficient human-machine interface.

[0004] The above-mentioned drawbacks and other problems associated with user interfaces for electronic devices having buttons are reduced or eliminated by the disclosed devices that include one or more force-sensing buttons. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (e.g., a notebook computer, a tablet computer, or a handheld device). In some embodiments, the device is a personal electronic device (e.g., a wearable electronic device such as a watch). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensitive display (also known as a “touch screen” or “touch screen display”). In some embodiments, the device has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or sets of instructions stored in the memory for performing a plurality of functions. In some embodiments, the user interacts with the GUI primarily through a stylus and / or finger contact and gestures on the touch-sensitive surface. In some embodiments, the functions optionally include image editing, drawing, presenting, word processing, spreadsheet creation, game play, making a phone call, video conferencing, sending an email, instant messaging, training support, digital photography, digital video recording, web browsing, playing digital music, taking notes, and / or playing digital video. The executable instructions for performing those functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured to be executed by one or more processors.

[0005] In some embodiments, the method is performed in an electronic device having one or more sensors for detecting the intensity of contact with a display, a touch sensing surface, and a home button of the electronic device. The method includes displaying a first user interface on the display and detecting an input directed to the first user interface while the first user interface is being displayed. The method includes, in response to detecting the input directed to the first user interface, stopping the display of the first user interface and displaying a second user interface separate from the first user interface. The method includes detecting a contact on the home button while the second user interface is being displayed. The method includes, while continuously detecting the contact on the home button, (i) detecting an increase in the characteristic intensity of the contact that exceeds a first intensity threshold, (ii) in response to detecting the increase in the characteristic intensity of the contact with respect to the first intensity threshold, displaying a start of a transition back to the first user interface from the second user interface, and (iii) detecting a press input including an increase in the characteristic intensity of the contact that exceeds the first intensity threshold while displaying the start of the transition back to the first user interface from the second user interface, including detecting an input sequence. In response to detecting the input sequence, the method includes (i) according to a determination that the input sequence meets a first criterion (e.g., a first criterion that requires the characteristic intensity of the contact to increase beyond a second intensity threshold before the end of the press input is detected), (A) stopping the display of the second user interface and (B) redisplaying the first user interface on the display, and (ii) according to a determination that the input sequence meets a second criterion (e.g., a second criterion that requires the characteristic intensity of the contact to remain below the second intensity threshold before the end of the press input is detected), (A) reversing the start of the transition back to the first user interface from the second user interface and (B) redisplaying the second user interface on the display.

[0006] According to one embodiment, an electronic device includes a display unit configured to display a user interface, a touch sensing surface unit for receiving contacts, one or more sensor units for detecting the intensity of contact with the home button of the device, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more sensor units. The processing unit displays a first user interface on the display, detects an input indicated by the first user interface while the first user interface is being displayed, and in response to detecting the input indicated by the first user interface, (i) stops displaying the first user interface, (ii) displays a second user interface separate from the first user interface, detects a contact on the home button while the second user interface is being displayed, and while continuously detecting the contact on the home button, (i) detects an increase above a first intensity threshold in the characteristic intensity of the contact, (ii) in response to detecting the increase in the characteristic intensity of the contact above the first intensity threshold, displays the start of a transition back from the second user interface to the first user interface, (iii) while displaying the start of the transition back from the second user interface to the first user interface, detects an input sequence including detecting a pressing input including an increase above the first intensity threshold in the characteristic intensity of the contact, and in response to detecting the input sequence, (i) according to a determination that the input sequence meets a first criterion that requires the characteristic intensity of the contact to increase above a second intensity threshold before the end of the pressing input is detected, (A) stops displaying the second user interface, (B) redisplay the first user interface on the display, (ii) according to a determination that the input sequence meets a second criterion that requires, for example, the characteristic intensity of the contact to remain below the second intensity threshold before the end of the pressing input is detected, (A) reverses the start of the transition back from the second user interface to the first user interface, (B) redisplay the second user interface on the display.

[0007] According to one embodiment, the method is executed in an electronic device having a display and a touch sensing surface. The method includes displaying a first user interface and detecting a first input (e.g., a first input that matches a request to display a second user interface and a request to display a third user interface) while the first user interface is being displayed. The method includes starting to display a first animation transition from the first user interface to the second user interface in response to detecting the first input. The method includes detecting a second input while the first animation transition is being displayed. In response to detecting the second input, the method (i) according to a determination that the second input matches a request to display the third user interface and that the second input was received at a first time, (A) interrupt the first animation transition from the first user interface to the second user interface at a first point during the first animation transition, (B) display a second animation transition from the first point during the first animation transition to the third user interface, and (ii) according to a determination that the second input matches a request to display the third user interface and that the second input was received at a second time after the first time, (A) interrupt the first animation transition from the first user interface to the second user interface at a second point during the first animation transition after the first point during the first animation transition, (B) display a third animation transition different from the second animation transition from the second point during the first animation transition to the third user interface.

[0008] According to some embodiments, an electronic device includes a display unit configured to display a user interface, a touch sensing surface unit configured to receive contacts, and a processing unit coupled to the display unit and the touch sensing surface unit. The processing unit displays a first user interface and, while the first user interface is being displayed, detects a first input that matches a request to display a second user interface and a request to display a third user interface. In response to detecting the first input, the processing unit starts displaying a first animation transition from the first user interface to the second user interface. While the first animation transition is being displayed, the processing unit detects a second input and, in response to detecting the second input, (i) according to a determination that the second input matches a request to display the third user interface and the second input is received at a first time, (A) interrupts the first animation transition from the first user interface to the second user interface at a first point during the first animation transition, (B) displays a second animation transition from the first point during the first animation transition to the third user interface; (ii) according to a determination that the second input matches a request to display the third user interface and the second input is received at a second time after the first time, (A) interrupts the first animation transition from the first user interface to the second user interface at a second point during the first animation transition after the first point, (B) displays a third animation transition different from the second animation transition from the second point during the first animation transition to the third user interface.

[0009] According to some embodiments, the method is executed in an electronic device having a display, a touch sensing surface, and one or more haptic output generators that generate haptic output. The method includes displaying a home button configuration user interface on the display, including displaying a plurality of different haptic output settings for the home button, where the home button is usable on the device in a plurality of different contexts to dismiss the currently displayed user interface in response to detecting a first type of input on the home button. The method includes detecting a selection of each of the haptic output settings of the plurality of different haptic output settings for the home button while the home button configuration user interface is being displayed. The method includes detecting a first input of the first type on the home button while each respective haptic output setting for the home button is selected. The method includes, in response to detecting the first input of the first type on the home button, (i) providing, via one or more haptic output generators, a first haptic output corresponding to a first haptic output setting for the home button without dismissing the home button configuration user interface, according to a determination that each respective haptic output setting is the first haptic output setting for the home button; and (ii) providing, via one or more haptic output generators, a second haptic output corresponding to a second haptic output setting for the home button that is different from the first haptic output setting for the home button without dismissing the home button configuration user interface, according to a determination that each respective haptic output setting is the second haptic output setting for the home button that is different from the first haptic output setting.

[0010] According to some embodiments, an electronic device includes a display unit configured to display a user interface, a touch sensing surface unit that receives touches, one or more haptic output generators that generate haptic outputs, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more haptic output generators. The processing unit is configured to display on the display a home button configuration user interface that includes displaying a plurality of different haptic output settings for the home button, the home button being usable on the device in a plurality of different contexts to discard the currently displayed user interface in response to detecting a first type of input on the home button, detecting a selection of each of the plurality of different haptic output settings of the home button while the home button configuration user interface is being displayed, detecting a first input of the first type on the home button while each of the haptic output settings for the home button is selected, and in response to detecting the first input of the first type on the home button, (i) providing, via the one or more haptic output generators, a first haptic output corresponding to a first haptic output setting for the home button without discarding the home button configuration user interface, according to a determination that each of the haptic output settings is the first haptic output setting for the home button, and (ii) providing, via the one or more haptic output generators, a second haptic output corresponding to a second haptic output setting for the home button that is different from the first haptic output setting for the home button without discarding the home button configuration user interface, according to a determination that each of the haptic output settings is the second haptic output setting for the home button that is different from the first haptic output setting for the home button.

[0011] According to some embodiments, the method is executed in an electronic device having a display, a touch sensing surface, and one or more haptic output generators for generating haptic outputs. The method includes displaying a first user interface on the display, where the home button is usable on the device in a plurality of different contexts to discard the currently displayed user interface in response to detecting a first type of input on the home button. The method includes detecting a first input of the first type directed to the first user interface while the first user interface is being displayed. The method includes, in response to detecting the first input of the first type directed to the first user interface, (i) performing a first action via one or more haptic output generators and providing a first haptic output corresponding to the first action according to a determination that haptic output for the user interface is enabled in the electronic device, and (ii) ceasing to perform the first action and ceasing to provide at least a portion of the first haptic output corresponding to the first action according to a determination that haptic output for the user interface is disabled. The method includes detecting a second input of the first type on the home button after performing the first action. In response to detecting the second input of the first type on the home button, (i) performing a second action associated with the home button, and (ii) providing a haptic output associated with activation of the home button via one or more haptic output generators, regardless of whether haptic output for the user interface is enabled in the device.

[0012] According to some embodiments, an electronic device includes a display unit configured to display a user interface, a touch sensing surface unit that receives contacts, one or more haptic output generators that generate haptic outputs, and a processing unit coupled to the display unit, the touch sensing surface unit, and the one or more haptic output generators. The processing unit displays a first user interface on the display, and the home button is usable on the device in a plurality of different contexts to discard the currently displayed user interface in response to detecting a first type of input on the home button, and while the first user interface is being displayed, detects a first input of the first type indicated by the first user interface, and in response to detecting the first input of the first type indicated by the first user interface, (i) executes a first operation according to a determination that a user interface haptic output is activated in the electronic device, and provides a first haptic output corresponding to the first operation via one or more haptic output generators, (ii) executes the first operation according to a determination that the user interface haptic output is invalid, stops providing at least a portion of the first haptic output corresponding to the first operation, and after executing the first operation, detects a second input of the first type on the home button, and in response to detecting the second input of the first type on the home button, (i) executes a second operation related to the home button, (ii) provides a haptic output related to activation of the home button via one or more haptic output generators, regardless of whether the haptic output of the user interface is enabled in the device.

[0013] According to one embodiment, the method is performed in an electronic device having a display, a touch sensing surface, one or more haptic output generators for generating haptic output, and one or more sensors for detecting the intensity of contact with the home button of the device. The method includes displaying a user interface on the display and detecting an input sequence on the home button that includes detecting a first press input on the home button while the user interface is being displayed. Detecting the first press input includes detecting an increase in the characteristic intensity of the contact on the home button. In response to detecting the first press input on the home button, (i) according to a determination that the first press input includes an increase in the characteristic intensity of the contact that exceeds a first intensity threshold and the change in the characteristic intensity of the contact proximate to the time when the characteristic intensity of the contact increases above the first intensity threshold has a first value of an intensity change metric, (A) performing a first operation to change the user interface displayed on the display, (B) generating, via one or more haptic output generators, a first discrete haptic output corresponding to the increase in the characteristic intensity of the contact that exceeds the first intensity threshold; (ii) according to a determination that the first press input includes an increase in the characteristic intensity of the contact that exceeds a first intensity threshold and the change in the characteristic intensity of the contact proximate to the time when the characteristic intensity of the contact increases above the first intensity threshold has a second value of an intensity change metric that is different from the first value of the intensity change metric, (A) performing a first operation to change the user interface displayed on the display, (B) generating, via one or more haptic output generators, a second discrete haptic output corresponding to the increase in the characteristic intensity of the contact that exceeds the first intensity threshold and different from the first discrete haptic output.

[0014] According to some embodiments, an electronic device includes a display unit configured to display a user interface, a touch sensing surface unit for receiving contacts, one or more haptic output generators for generating haptic outputs, and one or more sensor units for detecting the intensity of contact with a home button of the device, and a processing unit coupled to the display unit, the touch sensing surface unit, the one or more haptic output generators, and the one or more sensor units. The processing unit is configured to display a user interface on the display and, while the user interface is being displayed, detect an input sequence on the home button, including detecting a first pressing input on the home button, where detecting the first pressing input includes detecting an increase in the characteristic intensity of the contact on the home button. In response to detecting the first pressing input on the home button: (i) if it is determined that the first pressing input includes an increase in the characteristic intensity of the contact above a first intensity threshold and the change in the characteristic intensity of the contact proximate to the time when the characteristic intensity of the contact increases above the first intensity threshold has a first value of an intensity change metric, then (A) perform a first operation to change the user interface displayed on the display, and (B) generate, via the one or more haptic output generators, a first discrete haptic output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold; (ii) if it is determined that the first pressing input includes an increase in the characteristic intensity of the contact above a first intensity threshold and the change in the characteristic intensity of the contact proximate to the time when the characteristic intensity of the contact increases above the first intensity threshold has a second value of an intensity change metric different from the first value of the intensity change metric, then (A) perform a first operation to change the user interface displayed on the display, and (B) generate, via the one or more haptic output generators, a second discrete haptic output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold and different from the first discrete haptic output.

[0015] According to one embodiment, the method is executed on an electronic device having a display, a touch sensing surface, one or more haptic output generators for generating haptic output, and one or more sensors for detecting the intensity of contact with a home button of the device. The method includes displaying a first user interface. While the first user interface is being displayed, the method detects (i) a first press input on the home button and (ii) a second press input on the home button detected after the first press input. In response to detecting the first press input and before detecting the second press input, the method provides a first non-visual output having a first non-visual output profile. The first non-visual output provides feedback indicating that the first press input has been detected and that the first non-visual output includes haptic output provided by one or more haptic output generators. In response to detecting an input sequence including the first press input and the second press input on the home button, (i) based on the amount of time between a first time corresponding to the first press input and a second time corresponding to the second press input, according to a determination that the first press input and the second press input are separate inputs, (A) perform a first action associated with the first press input and (B) provide a second non-visual output having the first non-visual output profile, the second non-visual output providing feedback indicating that the second press input has been detected and that the second non-visual output includes haptic output provided by one or more haptic output generators, and (ii) based on the amount of time between the first time and the second time, according to a determination that the first press input and the second press input are part of an input pattern, (A) perform a second action associated with the input pattern, the second action being different from the first action, and (B) provide a third non-visual output having a second non-visual output profile separate from the first non-visual output profile, the third non-visual output providing feedback indicating that the second press input has been detected and that the third non-visual output includes haptic output provided by one or more haptic output generators.

[0016] According to some embodiments, an electronic device includes a display unit configured to display a user interface, a touch sensing surface unit for receiving contacts, one or more haptic output generation units for generating haptic outputs, one or more sensor units for detecting the contact intensity with the home button of the device, and a processing unit coupled to the display unit, the touch sensing surface unit, the one or more haptic output generators, and the one or more sensor units.The processing unit displays a first user interface and, while the first user interface is being displayed, detects (i) a first pressing input on the home button and (ii) a second pressing input on the home button detected after the first pressing input. In response to detecting the first pressing input and before detecting the second pressing input, the processing unit provides a first non-visual output having a first non-visual output profile, and provides feedback indicating that the first non-visual output includes that the first pressing input has been detected and that the first non-visual output is a haptic output provided by one or more haptic output generators. In response to detecting an input sequence including the first pressing input and the second pressing input on the home button, (i) based on the amount of time between a first time corresponding to the first pressing input and a second time corresponding to the second pressing input, in accordance with a determination that the first pressing input and the second pressing input are separate inputs, (A) perform a first operation related to the first pressing input, (B) provide a second non-visual output having a first non-visual output profile, and provide feedback indicating that the second non-visual output includes that the second pressing input has been detected and that the second non-visual output is a haptic output provided by one or more haptic output generators; (ii) based on the amount of time between the first time and the second time, in accordance with a determination that the first pressing input and the second pressing input are part of an input pattern, (A) perform a second operation related to the input pattern, the second operation being different from the first operation, (B) provide a third non-visual output having a second non-visual output profile separate from the first non-visual output profile, and provide feedback indicating that the third non-visual output includes that the second pressing input has been detected and that the third non-visual output is a haptic output provided by one or more haptic output generators.

[0017] According to some embodiments, the method is executed in an electronic device having a display, a touch sensing surface, one or more haptic output generators for generating haptic outputs, and one or more sensors for detecting the intensity of contact with each button of the device. The method includes detecting an input on each button, and the one or more haptic output generators are used to generate a haptic output indicating that each button has been activated instead of a mechanical switch that detects the activation of each button when the button is mechanically depressed. The method, in response to detecting an input on each button, (i) according to a determination that the input meets an activation criterion, the activation criterion including a requirement that the input includes an intensity exceeding a respective intensity threshold to meet the activation criterion, provides a first haptic output having a first haptic output pattern including vibrations of 0.5 to 4 cycles of the one or more haptic output generators with respect to one or more corresponding neutral positions of the one or more haptic output generators, the vibrations of the one or more haptic output generators occurring at a frequency of 80 Hz to 400 Hz; and (ii) stops providing the first haptic output according to a determination that the input does not meet the activation criterion.

[0018] According to some embodiments, an electronic device includes a display unit configured to display a user interface, a touch sensing surface unit for receiving contacts, one or more haptic output generation units for generating haptic outputs, one or more sensor units for detecting a contact intensity with a home button of the device, and a processing unit coupled to the display unit, the touch sensing surface unit, the one or more haptic output generators, and the one or more sensor units. The processing unit is configured to detect inputs on respective buttons, and the one or more haptic output generators are used to generate haptic outputs indicating that respective buttons are activated, instead of mechanical switches that detect activation of respective buttons when the respective buttons are mechanically depressed. In response to detecting an input on a respective button, (i) according to a determination that the input meets an activation criterion, the activation criterion including a requirement that the input includes an intensity exceeding a respective intensity threshold to meet the activation criterion, a first haptic output having a first haptic output pattern including vibrations of 0.5 to 4 cycles of one or more haptic output generators with respect to one or more corresponding neutral positions of the one or more haptic output generators, the vibrations of the one or more haptic output generators occurring at a frequency of 80 Hz to 400 Hz, is provided, and (ii) according to a determination that the input does not meet the activation criterion, providing the first haptic output is stopped.

[0019] According to some embodiments, an electronic device includes a display, a touch sensing surface, one or more sensors that optionally detect the intensity of contact with the touch sensing surface, an intensity sensing button (e.g., a virtual or physical home button), one or more processors, a memory, and one or more programs. The one or more programs are stored in the memory and configured to be executed by the one or more processors. The one or more programs include instructions to perform or cause to be performed any of the operations of the methods described herein. According to some embodiments, a computer-readable storage medium stores instructions therein, which when executed by an electronic device comprising a display, a touch sensing surface, an intensity sensing button (e.g., a virtual or physical button), and optionally one or more sensors that detect the intensity of contact with the touch sensing surface, cause the device to perform or result in the performance of any of the operations of the methods described herein. According to some embodiments, a graphical user interface on an electronic device having a display, a touch sensing surface, optionally one or more sensors that detect the intensity of contact with the touch sensing surface, an intensity sensing button (e.g., a virtual or physical home button), a memory, and one or more processors that execute the one or more programs stored in the memory includes one or more of the elements displayed in any of the methods described herein, and the elements are updated in response to input as described in any of the methods described herein. According to some embodiments, an electronic device includes a display, a touch sensing surface, an intensity sensing button (e.g., a virtual or physical home button), optionally one or more sensors that detect the intensity of contact with the touch sensing surface, and means for performing or causing to be performed any of the operations of the methods described herein. According to some embodiments, an information processing apparatus used within an electronic device having a display, a touch sensing surface, an intensity sensing button (e.g., a virtual or physical home button), and optionally one or more sensors that detect the intensity of contact with the touch sensing surface includes means for performing or causing to be performed any of the operations of the methods described herein.

[0020] Thus, an electronic device having a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with a button of the device (e.g., a virtual or physical home button), optionally one or more sensors for detecting the intensity of contact with the touch sensing surface, one or more haptic output generators, optionally one or more device orientation sensors, and optionally a voice system, comprises an improved method and interface for providing feedback to a user during interaction with the button, thereby enhancing the effectiveness, efficiency, and user satisfaction of such a device. Such a method and interface can complement or replace conventional methods of providing tactile feedback to the user.

[0021] To better understand the various embodiments described, reference should be made to the following "Detailed Description of the Invention" in conjunction with the following drawings. Here, like reference numerals refer to corresponding parts throughout the drawings.

Brief Description of the Drawings

[0022]

Figure 1A

Figure 1B

Figure 1C

Figure 2A

Figure 2B

Figure 2C

Figure 3

Figure 4A

Figure 4B

Figure 4C

Figure 4D

Figure 4E

Figure 4F1

Figure 4F2

Figure 4F3

Figure 4F4

Figure 4G1

Figure 4G2

Figure 4G3

Figure 4G4

Figure 4H

Figure 4I

Figure 4J

Figure 4K

Figure 4L

Figure 4M

Figure 4N

Figure 4O

Figure 4P

Figure 4Q

Figure 5A1

Figure 5A2

Figure 5A3

Figure 5A4

Figure 5A5

Figure 5A6

Figure 5A7

Figure 5A8

Figure 5A9

Figure 5A10

Figure 5A11

Figure 5A12

Figure 5A13

Figure 5A14

Figure 5A15

Figure 5A16

Figure 5A17

Figure 5A18

Figure 5B1

Figure 5B2

Figure 5B3

Figure 5B4

Figure 5B5

Figure 5B6

Figure 5B7

Figure 5B8

Figure 5B9

Figure 5B10

Figure 5B11

Figure 5B12

Figure 5B13

Figure 5B14

Figure 5B15

Figure 5B16

Figure 5B17

Figure 5B18

Figure 5B19

Figure 5B20

Figure 5B21

Figure 5B22

Figure 5B23

Figure 5B24

Figure 5B25

Figure 5B26

Figure 5B27

Figure 5B28

Figure 5B29

Figure 5B30

Figure 5B31

Figure 5B32

Figure 5B33

Figure 5B34

Figure 5B35

Figure 5B36

Figure 5B37

Figure 5B38

Figure 5B39

Figure 5B40

Figure 5B41

Figure 5B42

Figure 5B43

Figure 5B44

Figure 5B45

Figure 5B46

Figure 5B47

Figure 5B48

Figure 5B49

Figure 5B50

Figure 5B51

Figure 5B52

Figure 5B53

Figure 5B54

Figure 5B55

Figure 5B56

Figure 5B57

Figure 5B58

Figure 5B59

Figure 5B60

Figure 5B61

Figure 5B62

Figure 5B63

Figure 5B64

Figure 5B65

Figure 5B66

Figure 5B67

Figure 5B68

Figure 5B69

Figure 5B70

Figure 5B71

Figure 5B72

Figure 5B73

Figure 5B74

Figure 5B75

Figure 5C1

Figure 5C2

Figure 5C3

Figure 5C4

Figure 5C5

Figure 5C6

Figure 5C7

Figure 5C8

Figure 5C9

Figure 5C10

Figure 5C11

Figure 5C12

Figure 5C13

Figure 5C14

Figure 5C15

Figure 5C16

Figure 5C17

Figure 5C18

Figure 5C19

Figure 6A1

Figure 6A2

Figure 6A3

Figure 6A4

Figure 6A5

Figure 6A6

Figure 6A7

Figure 6A8

Figure 6A9

Figure 6A10

Figure 6A11

Figure 6A12

Figure 6A13

Figure 6A14

Figure 6A15

Figure 6A16

Figure 6A17

Figure 6A18

Figure 6A19

Figure 6A20

Figure 6A21

Figure 6A22

Figure 6A23

Figure 6A24

Figure 6A25

Figure 6A26

Figure 6B1

Figure 6B2

Figure 6B3

Figure 6B4

Figure 6B5

Figure 6B6

Figure 6B7

Figure 6B8

Figure 6B9

Figure 6B10

Figure 6B11

Figure 6B12

Figure 6B13

Figure 6B14

Figure 6B15

Figure 6B16

Figure 6B17

Figure 6B18

Figure 6B19

Figure 6B20

Figure 6B21

Figure 6B22

Figure 6B23

Figure 6B24

Figure 6B25

Figure 6B26

Figure 7A

Figure 7B

Figure 7C

Figure 7D

Figure 7E

Figure 7F

Figure 7G

Figure 8

Figure 9A

Figure 9B

Figure 9C

Figure 9D

Figure 10

Figure 11A

Figure 11B

Figure 11C

Figure 11D

Figure 11E

Figure 12

Figure 13A

Figure 13B

Figure 13C

Figure 13D

Figure 14

Figure 15A

Figure 15B

Figure 15C

Figure 15D

Figure 15E

Figure 16

Figure 17A

Figure 17B

Figure 17C

Figure 17D

Figure 18

Figure 19A

Figure 19B

Figure 19C

Figure 20

[0023] Many electronic devices with displays include mechanical buttons, such as a mechanical home button, to navigate between different user interfaces displayed on the electronic device. However, mechanical buttons provide little, if any, feedback to the user beyond a fixed down - click and a fixed up - click. The methods described herein provide visual feedback, tactile feedback, and / or audio feedback during interaction with a button (e.g., a virtual or physical home button) that makes the operation of the user interface more efficient and intuitive for the user.

[0024] The methods, devices, and GUIs described herein use feedback to improve the interaction between the device and the user in multiple ways, ● providing visual feedback regarding activation of a user input device (e.g., a virtual or physical home button), ● providing visual feedback and tactile outputs in response to multiple types of inputs on a home button of the device, ● configuring the feedback provided by the home button, ● controlling user interface tactile and home button tactile, ● generating tactile outputs having different tactile output patterns depending on input - based metrics or user - interface - based metrics. ● providing a haptic output for a second click of a double - click input that is different from that for the first click of the double - click input; ● providing a discrete haptic output for indicating activation of a permanent non - mechanical button on the device.

[0025] Exemplary device Here, reference is made in detail to the embodiments shown in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various embodiments described. However, it will be apparent to those skilled in the art that the various embodiments described may be practiced without these specific details. In other instances, well - known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.

[0026] In this specification, terms such as first, second, etc. are used in some embodiments to describe various elements, but it will also be understood that these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, without departing from the scope of the various embodiments described, a first contact may be referred to as a second contact, and similarly, a second contact may be referred to as a first contact. Although both the first contact and the second contact are contacts, they are not the same contact unless the context clearly indicates otherwise.

[0027] The terms used in the description of the various embodiments described herein are for the purpose of describing particular embodiments only and are not intended to be limiting. As used in the description of the various embodiments described and in the appended claims, the singular forms "a", "an", and "the" are intended to include the plural form as well, unless the context clearly indicates otherwise. As used herein, the term "and / or" refers to and is also to be understood to include any and all possible combinations of one or more of the associated listed items. The terms "includes", "including", "comprises", and / or "comprising", when used herein, specify the presence of the stated feature, integer, step, operation, element, and / or component, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0028] As used herein, the term "if (when)" is optionally construed to mean "when", "upon", "in response to determining", or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (a stated condition or event) is detected" are optionally construed to mean "upon determining", "in response to determining", "upon detecting (the stated condition or event)", or "in response to detecting (the stated condition or event)", depending on the context.

[0029] Embodiments of an electronic device, a user interface for such a device, and related processes for using such a device are described. In some embodiments, the device is a portable communication device such as a mobile phone that also includes other functions such as PDA functionality and / or music player functionality. Exemplary embodiments of portable multifunctional devices include, but are not limited to, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, California. Other portable electronic devices such as laptop or tablet computers having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad) may optionally be used. Also, in some embodiments, it should be understood that the device is not a portable communication device but a desktop computer having a touch-sensitive surface (e.g., a touch screen display and / or a touch pad).

[0030] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices such as a physical keyboard, a mouse, and / or a joystick.

[0031] The device generally supports various applications such as one or more of a note-taking application, a drawing application, a presentation application, a word processing application, a website creation application, a disk authoring application, a spreadsheet application, a game application, a phone application, a video conferencing application, an email application, an instant messaging application, a training support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0032] Various applications executed on the device optionally use at least one common physical user interface device such as a touch-sensitive surface. One or more functions of the touch-sensitive surface, as well as the corresponding information displayed on the device, are optionally adjusted and / or changed from one application to the next and / or within each application. Thus, the common physical architecture of the device (such as a touch-sensitive surface) optionally supports various applications having a user interface that is intuitive and transparent to the user.

[0033] Here, attention is paid to an embodiment of a portable device having a touch-sensitive display. FIG. 1A is a block diagram showing a portable multifunctional device 100 having a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display system 112 may be referred to as a "touch screen" for convenience, and may simply be referred to as a touch-sensitive display. The device 100 includes a memory 102 (optionally including one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. The device 100 optionally includes one or more light sensors 164. The device 100 optionally includes one or more intensity sensors 165 for detecting the intensity of contact on the device 100 (such as a touch-sensitive surface such as the touch-sensitive display system 112 of the device 100). The device 100 includes one or more haptic output generators 167 for generating haptic output on the device 100 (such as generating haptic output on a touch-sensitive surface such as the touch-sensitive display system 112 of the device 100 or the touch pad 355 of the device 300). Those components optionally communicate through one or more communication buses or signal lines 103.

[0034] As used in this specification and the claims, the term "haptic output" refers to a physical displacement of a device relative to a position in front of the user, a physical displacement of a component of the device (e.g., a touch-sensing surface) relative to another component of the device (e.g., the housing), or a displacement of a component relative to the center of gravity of the device, that is detected by the user through the user's sense of touch. For example, in a situation where the device or a component of the device is in contact with a touch-sensitive surface of the user (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement is interpreted by the user as a tactile sensation corresponding to a perceived change in the physical characteristics of the device or the component of the device. For example, movement of a touch-sensing surface (e.g., a touch-sensing display or a trackpad) is optionally interpreted by the user as a "down click" or "up click" of a physical actuator button. In some cases, the user will feel a tactile sensation such as a "down click" or "up click" even when there is no movement of the physical actuator button associated with the touch-sensing surface that has been physically pressed (e.g., displaced) by the user's movement. As another example, movement of the touch-sensing surface is optionally interpreted or perceived by the user as "roughness" of the touch-sensing surface, even when there is no change in the smoothness of the touch-sensing surface. Such interpretation of a touch by the user is subject to the user's individual sensory perception, but there are many sensory perceptions of touch that are common to the majority of users. Thus, when a haptic output is described as corresponding to a particular sensory perception of the user (e.g., "up click", "down click", "roughness"), unless otherwise stated, the generated haptic output corresponds to a physical displacement of a device, or a component of the device, that produces the described sensory perception of a typical (or average) user.Using haptic output to provide haptic feedback to a user enhances the operability of the device, makes the user-device interface more efficient (e.g., by assisting the user in providing appropriate input when operating / interacting with the device and reducing user errors), and in addition, reduces the power consumption of the device and improves battery life by enabling the user to use the device more quickly and efficiently.

[0035] In some embodiments, the haptic output pattern specifies characteristics of the haptic output such as the amplitude of the haptic output, the shape of the moving waveform of the haptic output, the frequency of the haptic output, and / or the duration of the haptic output.

[0036] When a haptic output having different haptic output patterns is generated by a device (e.g., via one or more haptic output generators that move a movable mass to generate the haptic output), the haptic output can cause different tactile sensations when the user holds or touches the device. While the user's sense is based on the perception of the haptic output of the user, most users are able to distinguish changes in the waveform, frequency, and amplitude generated by the device. Thus, the waveform, frequency, and amplitude can be adjusted to indicate to the user that different operations have been performed. In that way, the characteristics (e.g., size, material, weight, stiffness, smoothness, etc.), behavior (e.g., vibration, displacement, acceleration, rotation, expansion, etc.), and / or interaction (e.g., collision, adhesion, repulsion, attraction, friction, etc.) of an object in a given environment (e.g., a user interface including graphical features and objects, a simulated physical environment having virtual boundaries and virtual objects, a real physical environment having physical boundaries and physical objects, and / or any combination of the above) are designed, selected, and / or formulated to simulate the haptic output patterns. The haptic output can, in some situations, reduce input errors in the operation of the device by the user and provide the user with beneficial feedback that increases efficiency. In addition, the haptic output is optionally generated to correspond to feedback not related to simulated physical characteristics such as input thresholds or object selection. Such haptic output can, in some situations, reduce input errors in the operation of the device by the user and provide the user with beneficial feedback that increases efficiency.

[0037] In some embodiments, haptic output having an appropriate haptic output pattern serves as a cue to the occurrence of a targeted event behind a scene within the user interface or within the device. Examples of targeted events include activation of affordances (e.g., physical buttons, virtual buttons, or toggle switches) provided on the device or within the user interface, success or failure of a requested action, reaching or exceeding a boundary within the user interface, entering a new state, switching the input focus between objects, activating a new mode, reaching or exceeding an input threshold, detecting or recognizing the type of an input or gesture, and the like. In some embodiments, the haptic output is provided to serve as a warning or alert for an upcoming event or result that occurs soon, unless a redirection or interruption input is detected in due course. Haptic output is also used in other contexts to enhance the user experience, improve the accessibility of the device to visually or motor-impaired users or other accessibility needs, and / or improve the efficiency and functionality of the user interface and / or device. The haptic output optionally involves an audio output and / or a change to the visible user interface, which further enhances the user's experience when the user interacts with the user interface and / or device, further facilitates the conveyance of information regarding the state of the user interface and / or device, and reduces input errors in the operation of the device by the user, increasing efficiency.

[0038] FIG. 4F1 provides a set of sample haptic output patterns that can be used individually or in combination with one or more conversions (e.g., modulation, amplification, truncation, etc.) or via the same, for various scenarios and various purposes such as those described above and those to be described with respect to the user interfaces and methods referred to herein, to generate suitable haptic feedback. FIGS. 4F2-4F4 are enlarged views of the graph shown in FIG. 4F1. This example of a palette of haptic outputs shows how a set of three waveforms and eight frequencies are used to generate an array of haptic output patterns. In addition to the haptic output patterns shown in this figure, each of these haptic output patterns has its amplitude optionally adjusted by changing the gain value for the haptic output pattern, as shown, for example, by changes in gain of 1.0, 0.75, 0.5, and 0.25 for full taps 80 Hz, full taps 200 Hz, mini taps 80 Hz, mini taps 200 Hz, micro taps 80 Hz, and micro taps 200 Hz, respectively, as shown in FIG. 4G1. FIGS. 4G2-4G4 are enlarged views of the graph shown in FIG. 4G1. As shown in FIG. 4G1, changing the gain of a haptic output pattern changes the amplitude of the pattern without changing the frequency of the pattern or the shape of the waveform. In some embodiments, since some haptic output generators are limited by how much force can be applied to the movable mass, changing the frequency of the haptic output pattern results in a smaller amplitude, such that the movement of the mass at higher frequencies is constrained to result in a smaller amplitude, ensuring that the acceleration required to create the waveform does not require a force outside the operating force range of the haptic output generator (e.g., the peak amplitudes of full taps at 230 Hz, 270 Hz, and 300 Hz are lower than the amplitudes of full taps at 80 Hz, 100 Hz, 125 Hz, and 200 Hz).

[0039] In FIG. 4F1, each column shows a haptic output pattern having a particular waveform. The waveform of the haptic output pattern is the neutral position (e.g., x) with respect to the time that the movable mass passes through to generate the haptic output in that haptic output pattern zero) represents a pattern of physical displacement with respect to. For example, the first set of haptic output patterns shown in the left column in FIG. 4F1 (e.g., the haptic output pattern of "full tap") each have a waveform including a complete two-cycle vibration (e.g., a vibration starting and ending at the neutral position and crossing the neutral position three times). The second set of haptic output patterns shown in the middle column of FIG. 4F1 (e.g., the haptic output pattern of "mini tap") have a waveform including a vibration including a complete one cycle (e.g., a vibration starting and ending at the neutral position and crossing the neutral position once). The third set of haptic output patterns shown in the right column of FIG. 4F1 (e.g., the haptic output pattern of "micro tap") have a waveform including a vibration including half of a complete one cycle (e.g., a vibration starting and ending at the neutral position and not crossing the neutral position). The waveforms of the haptic output patterns also include a start buffer and an end buffer representing a gradual speed increase and speed decrease of the movable mass at the start and end of the haptic output. The exemplary waveforms shown in FIGS. 4F1 to 4G1 represent the maximum and minimum limits of the movement of the movable mass in the x max value and x min value. For larger electronic devices having a larger movable mass, the minimum and maximum limits of the movement of the mass may be larger or smaller. The examples shown in FIGS. 4F1 to 4G1 illustrate the movement of the mass in one dimension, but the same principle also applies to the movement of the movable mass in two or three dimensions.

[0040] As shown in FIG. 4F1, each haptic output pattern has a corresponding characteristic frequency that affects the “pitch” of the tactile sensation felt by the user from the haptic output having that characteristic frequency. For continuous haptic output, the characteristic frequency represents the number of cycles (e.g., cycles per second) completed within a given time period by the movable mass of the haptic output generator. In the case of discrete haptic output, a discrete output signal (e.g., at 0.5 cycles, 1 cycle, or 2 cycles) is generated, and the characteristic frequency value specifies how fast the movable mass needs to move to generate the haptic output at that characteristic frequency. As shown in FIG. 4F1, for each type of haptic output (e.g., defined by each waveform such as full tap, mini tap, or micro tap), a higher frequency value corresponds to a faster movement (s) by the movable mass, and thus, generally, the time to complete the haptic output is shorter (e.g., including the start and end buffer times for the time to complete the number of cycles required for discrete haptic output). For example, a full tap with a characteristic frequency of 80 Hz takes longer to complete than a full tap with a characteristic frequency of 100 Hz (e.g., 35.4 ms vs. 28.3 ms in FIG. 4F1). Further, at a given frequency, a haptic output with more cycles of its waveform at that frequency takes longer to complete than a haptic output with fewer cycles of its waveform at the same frequency. For example, a full tap at 150 Hz takes longer to complete than a mini tap at 150 Hz (e.g., 19.4 ms vs. 12.8 ms), and a mini tap at 150 Hz takes longer to complete than a micro tap at 150 Hz (e.g., 12.8 ms vs. 9.4 ms). However, for haptic output patterns of different frequencies, this regularity may not apply (e.g., a haptic output with more cycles but a higher frequency may take less time than a haptic output with fewer cycles but a lower frequency, and vice versa may also occur). For example, at 300 Hz, a full tap takes the same time as a mini tap (e.g., 9.9 ms).

[0041] As shown in FIG. 4F1, the haptic output pattern also has a "strength" of the haptic sensation that a user can feel through a characteristic amplitude that affects the amount of energy contained in the haptic signal, or a haptic output having that characteristic amplitude. In some embodiments, the characteristic amplitude of the haptic output pattern refers to an absolute value or a normalized value representing the maximum displacement of the movable mass from the neutral position when generating the haptic output. In some embodiments, the characteristic amplitude of the haptic output pattern is adjustable by a gain factor (e.g., a value from 0 to 1) that is fixed or dynamically determined according to various conditions (e.g., customized based on the context and behavior of the user interface), and / or a preconfigured metric (e.g., an input-based metric and / or a user-interface-based metric). In some embodiments, an input-based metric (e.g., an intensity change metric or an input speed metric) measures the characteristics of the input (e.g., the rate of change of the characteristic intensity of contact in a pressing input, or the speed of movement of the contact across the touch-sensing surface) during the input that triggers the generation of the haptic output. In some embodiments, a user-interface-based metric (e.g., a metric of the speed across a boundary) measures the characteristics of the user interface element (e.g., the speed of movement of the element across a hidden or visible boundary in the user interface) during a user interface change that triggers the generation of the haptic output. In some embodiments, the characteristic amplitude of the haptic output pattern may be modulated by an "envelope", the peaks of adjacent cycles may have different amplitudes, and one of the above waveforms is further modulated by multiplying by an envelope parameter that changes over time (e.g., from 0 to 1) so as to gradually adjust some of the amplitudes of the haptic output over time while the haptic output is being generated.

[0042] For illustrative purposes, in FIG. 4F1, specific frequencies, amplitudes, and waveforms are represented by the sample tactile output pattern, but tactile output patterns with other frequencies, amplitudes, and waveforms can also be used for the same purpose. For example, waveforms of 0.5 to 4 cycles can be used. Also, other frequencies in the range of 60 Hz to 400 Hz can be used. Table 1 provides examples of specific haptic feedback behaviors, configurations, and their usage examples.

[0043]

Table 1-1

[0044]

Table 1-2

[0045]

Table 1-3

[0046] The examples shown in Table 1 indicate the range of environments in which haptic output can be generated for different inputs and events. Table 1 should not be construed as a requirement for the device to respond to each of the inputs or events listed using the haptic outputs shown. Rather, Table 1 is intended to explain how haptic output changes and / or is similar for different inputs and / or events (e.g., based on haptic output patterns, frequencies, gains, etc.). For example, Table 1 shows how the "event success" haptic output changes from the "event failure" haptic output and how the retarget haptic output differs from the impact haptic output.

[0047] FIGS. 4H - 4J show exemplary haptic audio output pattern vs. time used in connection with haptic output to simulate button clicks, according to some embodiments.

[0048] FIG. 4K shows an exemplary combination of a haptic output pattern and a tactile audio output pattern over time, according to some embodiments. FIGS. 4L-4Q expand the combination shown in FIG. 4K for clarity.

[0049] In FIG. 4H, when the rate of change of the contact intensity at the control activation threshold exceeds the threshold rate of change (e.g., when the contact is a "normal" strong / fast press), the top tactile audio pattern "click A1 audio" is, as shown in FIG. 4K (first row of the first click column) and the top of FIG. 4L, an audio output that is played with a "click A" normal mini-tap (230 Hz) to simulate the first down click in a "normal" first click. In this example, the "click A1 audio" is offset by 2 ms from the start of the "click A" normal mini-tap (230 Hz) haptic output. In some cases, the same "click A1 audio" and "click A" normal mini-tap (230 Hz) are played to simulate the first up click following the first down click. In some cases, the gain of the "click A1 audio" and / or the "click A" normal mini-tap (230 Hz) is reduced (e.g., by 50%) for the up click relative to the preceding down click.

[0050] When the change rate of the contact strength at the control activation threshold is below the threshold change rate (for example, when the contact is "weak" and / or a slow press), the top tactile audio pattern "click A1 audio" is also, as shown in FIGS. 4K (second row of the first click column) and the lower part of FIG. 4L, reproduced with a "click A" weak mini-tap (230 Hz) to simulate the first down click in the "weak" first click. To simulate the "weak" down click, the gains of the "click A1 audio" and the "click A" weak mini-tap (230 Hz) are reduced (for example, by 50%) for the "weak" down click compared to the "normal" down click. In this example, the "click A1 audio" is offset by 2 ms from the start of the "click A" weak mini-tap (230 Hz) tactile output. In some cases, the same "click A1 audio" and "click A" weak mini-tap (230 Hz) are reproduced to simulate the first up click following the first down click. In some cases, the gain of the "click A1 audio" and / or the "click A" weak mini-tap (230 Hz) is reduced (for example, by 50%) for the up click compared to the preceding down click.

[0051] In FIG. 4H, when the change rate of the contact strength at the control activation threshold exceeds the threshold change rate (for example, when the contact in the second click is a "normal" strong / fast press), the bottom haptic audio pattern "click A2 audio" is, as shown in FIG. 4K (the first row of the second click column) and the upper part of FIG. 4M, within a predetermined time period (for example, like the second click in a double click input), following the first click, an audio output that is reproduced together with the "click A" normal mini - tap (230 Hz) to simulate the second down - click in a "normal" second click. In this example, the "click A2 audio" is offset by 2 ms from the start of the "click A" normal mini - tap (230 Hz) haptic output. In some cases, the same "click A2 audio" and "click A" normal mini - tap (230 Hz) are reproduced to simulate the second up - click following the second down - click. In some cases, the gain of the "click A2 audio" and / or the "click A" normal mini - tap (230 Hz) is reduced (for example, by 50%) in the second up - click with respect to the preceding second down - click.

[0052] When the rate of change of the contact strength at the control activation threshold is below the threshold rate of change (e.g., when the contact is "weak" and / or a slow press), the bottom haptic audio pattern "Click A2 audio" is also, as shown in the lower part of FIG. 4K (the second row of the second click column) and FIG. 4M, within a predetermined time period (e.g., like the second click in a double click input), to simulate the second down click in a "weak" second click following the first click, it is played together with a "Click A" weak mini - tap (230 Hz). To simulate the "weak" down click, the gains of the "Click A2 audio" and the "Click A" weak mini - tap (230 Hz) are reduced (e.g., by 50%) with respect to the "normal" down click in the "weak" down click. In this example, the "Click A2 audio" is offset by 2 ms from the start of the "Click A" weak mini - tap (230 Hz) haptic output. In some cases, the same "Click A2 audio" and "Click A" weak mini - tap (230 Hz) are played to simulate a second up click following the second down click. In some cases, the gains of the "Click A2 audio" and / or the "Click A" weak mini - tap (230 Hz) are reduced (e.g., by 50%) with respect to the preceding second down click in the second up click.

[0053] In FIG. 4I, when the change rate of the contact strength at the control activation threshold exceeds the threshold change rate (for example, when the contact is a "normal" strong / fast press), the top haptic audio pattern "click B1 audio" is, as shown in FIG. 4K (the third row of the first click column) and the upper part of FIG. 4N, an audio output that is reproduced together with the "click B" normal mini-tap (270 Hz) in order to simulate the first down click in the "normal" first click. In this example, the "click B1 audio" is offset by 2.8 ms from the start of the "click B" normal mini-tap (270 Hz) haptic output. In some cases, the same "click B1 audio" and "click B" normal mini-tap (270 Hz) are reproduced to simulate the first up click following the first down click. In some cases, the gain of the "click B1 audio" and / or "click A" normal mini-tap (270 Hz) is reduced (for example, by 50%) in the up click with respect to the preceding down click.

[0054] When the rate of change of the contact strength at the control activation threshold is below the threshold rate of change (for example, when the contact is "weak" and / or a slow press), the top tactile audio pattern "Click B1 audio" is also, as shown in Figure 4K (the fourth row of the first click column) and the bottom of Figure 4N, played together with a "Click B" weak mini-tap (270 Hz) to simulate the first down-click in a "weak" first click. To simulate the "weak" down-click, the gains of the "Click B1 audio" and the "Click B" weak mini-tap (270 Hz) are reduced (for example, by only 50%) relative to the "normal" down-click in the "weak" down-click. In this example, the "Click B1 audio" is offset by only 2.8 ms from the start of the tactile output of the "Click B" weak mini-tap (270 Hz). In some cases, the same "Click B1 audio" and "Click B" weak mini-tap (270 Hz) are played to simulate the first up-click following the first down-click. In some cases, the gain of the "Click B1 audio" and / or the "Click B" weak mini-tap (230 Hz) is reduced (for example, by 50%) relative to the preceding down-click in the up-click.

[0055] In FIG. 4I, when the change rate of the contact strength at the control activation threshold exceeds the threshold change rate (for example, when the contact in the second click is a "normal" strong / fast press), the bottom haptic audio pattern "click B2 audio" is, as shown in FIG. 4K (the third row of the second click column) and the upper part of FIG. 4O, within a predetermined time period (for example, like the second click in a double click input), a voice output that is reproduced together with the "click B" normal mini - tap (270 Hz) to simulate the second down - click in a "normal" second click following the first click. In this example, the "click B2 audio" is offset by 2.8 ms from the start of the "click B" normal mini - tap (270 Hz) haptic output. In some cases, the same "click B2 audio" and the "click B" normal mini - tap (230 Hz) are reproduced to simulate the second up - click following the second down - click. In some cases, the gain of the "click B2 audio" and / or the "click B" normal mini - tap (270 Hz) is reduced (for example, by 50%) in the second up - click with respect to the preceding second down - click.

[0056] When the rate of change of the contact strength at the control activation threshold is below the threshold rate of change (e.g., when the contact is "weak" and / or a slow press), the bottom haptic audio pattern "Click B2 audio" is also, as shown in the lower part of FIG. 4K (the fourth row of the second click column) and FIG. 4O, within a predetermined time period (e.g., like the second click in a double click input), to simulate the second down click in a "weak" second click following the first click, it is played together with a "Click B" weak mini - tap (270 Hz). To simulate the "weak" down click, the gains of the "Click B2 audio" and the "Click B" weak mini - tap (270 Hz) are reduced (e.g., by only 50%) for the "weak" down click compared to the "normal" down click. In this example, the "Click B2 audio" is offset by only 2.8 ms from the start of the "Click B" weak mini - tap (270 Hz) haptic output. In some cases, the same "Click B2 audio" and "Click B" weak mini - tap (270 Hz) are played to simulate the second up click following the second down click. In some cases, the gain of the "Click B2 audio" and / or the "Click B" weak mini - tap (270 Hz) is reduced (e.g., by 50%) for the second up click compared to the preceding second down click.

[0057] In FIG. 4J, when the change rate of the contact strength at the control activation threshold exceeds the threshold change rate (for example, when the contact is a "normal" strong / fast press), the top tactile audio pattern "click C1 audio" is, as shown in FIG. 4K (the fifth row of the first click column) and the upper part of FIG. 4P, an audio output that is reproduced together with the "click C" normal mini-tap (300 Hz) in order to simulate the first down click in the "normal" first click. In this example, the "click C1 audio" is offset by 1.9 ms from the start of the "click C" normal mini-tap (300 Hz) tactile output. In some cases, the same "click C1 audio" and "click C" normal mini-tap (300 Hz) are reproduced to simulate the first up click following the first down click. In some cases, the gain of the "click C1 audio" and / or the "click C" normal mini-tap (300 Hz) is reduced (for example, by 50%) for the up click with respect to the preceding down click.

[0058] When the rate of change of the contact strength at the control activation threshold is below the threshold rate of change (for example, when the contact is "weak" and / or a slow press), the top tactile audio pattern "click C1 audio" is also, as shown in FIGS. 4K (the 6th row of the first click column) and the bottom of FIG. 4P, reproduced with a "weak" click C mini-tap (300 Hz) to simulate the first down click in the "weak" first click. To simulate the "weak" down click, the gains of the "click C1 audio" and the "click C" weak mini-tap (300 Hz) are reduced (for example, by 50%) for the "weak" down click relative to the "normal" down click. In this example, the "click C1 audio" is offset by 1.9 ms from the start of the tactile output of the "click C" weak mini-tap (300 Hz). In some cases, the same "click C1 audio" and "click C" weak mini-tap (270 Hz) are reproduced to simulate the first up click following the first down click. In some cases, the gains of the "click C1 audio" and / or the "click C" weak mini-tap (300 Hz) are reduced (for example, by 50%) for the up click relative to the preceding down click.

[0059] In FIG. 4J, when the change rate of the contact strength at the control activation threshold exceeds the threshold change rate (for example, when the contact in the second click is a "normal" strong / fast press), the bottom haptic audio pattern "click C2 audio" is, as shown in FIG. 4K (the fifth row of the second click column) and the upper part of FIG. 4Q, within a predetermined time period (for example, like the second click in a double click input), to simulate the second down click in a "normal" second click following the first click, it is an audio output played together with the "click C" normal mini-tap (300 Hz). In this example, the "click C2 audio" is offset by only 1.9 ms from the start of the "click C" normal mini-tap (300 Hz) haptic output. In some cases, the same "click C2 audio" and "click C" normal mini-tap (300 Hz) are played to simulate the second up click following the second down click. In some cases, the gain of the "click C2 audio" and / or the "click C" normal mini-tap (300 Hz) is reduced (for example, by 50%) in the second up click with respect to the preceding second down click.

[0060] When the rate of change of the contact strength at the control activation threshold is below the threshold rate of change (e.g., when the contact is "weak" and / or a slow press), the bottom haptic audio pattern "click C2 audio" is also, as shown in FIG. 4K (the 6th row of the second click column) and the bottom of FIG. 4Q, within a predetermined time period (e.g., like the second click in a double click input), to simulate the second down click in a "weak" second click following the first click, it is played together with a "click C" weak mini - tap (300 Hz). To simulate the "weak" down click, the gains of the "click C2 audio" and the "click C" weak mini - tap (300 Hz) are reduced (e.g., by 50%) for the "weak" down click compared to the "normal" down click. In this example, the "click C2 audio" is offset by 1.9 ms from the start of the "click C" weak mini - tap (300 Hz) haptic output. In some cases, the same "click C2 audio" and "click C" weak mini - tap (300 Hz) are played to simulate the second up click following the second down click. In some cases, the gains of the "click C2 audio" and / or the "click C" weak mini - tap (300 Hz) are reduced (e.g., by 50%) for the second up click compared to the preceding second down click.

[0061] Device 100 is merely an example of a portable multifunctional device. It should be understood that device 100 optionally may have more or fewer components than those shown, optionally may combine two or more components, or optionally may have a different configuration or arrangement of components. The various components shown in FIG. 1A are implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing circuits and / or application - specific integrated circuits.

[0062] Memory 102 optionally includes a high-speed random access memory and also optionally includes non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid state memory devices. Access to memory 102 by other components of device 100, such as CPU(s) 120 and peripheral interface 118, is optionally controlled by memory controller 122.

[0063] Peripheral interface 118 is used to couple the input and output peripheral devices of the device to CPU(s) 120 and memory 102. One or more processors 120 perform various functions for device 100 and operate or execute various software programs and / or instruction sets stored in memory 102 to process data.

[0064] In some embodiments, peripheral interface 118, CPU(s) 120, and memory controller 122 are optionally implemented on a single chip such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0065] The RF (radio frequency) circuit 108 transmits and receives RF signals, also called electromagnetic signals. The RF circuit 108 converts electrical signals into electromagnetic signals or electromagnetic signals into electrical signals and communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes well-known circuits for performing those functions, including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, etc. The RF circuit 108 optionally communicates wirelessly with other devices over a network such as the Internet, also referred to as the World Wide Web (WWW), an intranet, and / or a wireless network such as a cellular telephone network, a wireless local area network (LAN) and / or a metropolitan area network (MAN). The wireless communication optionally uses any of a plurality of communication standards, communication protocols, and communication technologies, including, as those communication standards, communication protocols, and communication technologies, the Global System for Mobile Communications (GSM) for mobile communications, the Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), long term evolution (LTE), near field communication (NFC), wideband code division multiple access (W-CDMA), code division multipleCode Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth (registered trademark), Wireless Fidelity (Wi-Fi) (registered trademark) (e.g., IEEE 802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11n), Voice over Internet Protocol (VoIP), WiMAX, protocols for email (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol including communication protocols not yet developed as of the filing date of this document, but not limited thereto.

[0066] The audio circuit 110, the speaker 111, and the microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into an electrical signal, and transmits the electrical signal to the speaker 111. The speaker 111 converts the electrical signal into human audible sound waves. The audio circuit 110 also receives the electrical signal converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally obtained from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., 212 of FIG. 2). The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device such as an output-only headset or a headset having both an output (e.g., headphones for one or both ears) and an input (e.g., a microphone).

[0067] The I / O subsystem 106 couples input / output peripherals on the device 100, such as the touch-sensing display system 112 and other input or control devices 116, to the peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, a light sensor controller 158, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive electrical signals from, and transmit electrical signals to, the other input or control devices 116. The other input or control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, the input controller(s) 160 are optionally coupled to (or not coupled to any of) a pointer device such as a keyboard, an infrared port, a USB port, a stylus, and / or a mouse. One or more buttons (e.g., 208, FIG. 2A) optionally include up / down buttons for volume control of the speaker 111 and / or the microphone 113. One or more buttons optionally include push buttons (e.g., 206, FIG. 2A).

[0068] The touch-sensing display system 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from and / or transmits electrical signals to the touch-sensing display system 112. The touch-sensing display system 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output corresponds to user interface objects. As used herein, the term "affordance" refers to a user-interactive graphical user interface object (e.g., a graphical user interface object configured to respond to input directed towards the graphical user interface object). Examples of user-interactive graphical user interface objects include, but are not limited to, buttons, sliders, icons, selectable menu items, switches, hyperlinks, or other user interface controls.

[0069] The touch-sensing display system 112 has a touch-sensing surface, sensor, or set of sensors that receives input from the user based on tactile and / or haptic contact. The touch-sensing display system 112 and the display controller 156 (along with any associated modules and / or instruction sets in the memory 102) detect contact (and any movement or interruption of the contact) on the touch-sensing display system 112 and translate the detected contact into an interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch-sensing display system 112. In one exemplary embodiment, the point of contact between the touch-sensing display system 112 and the user corresponds to the user's finger or stylus.

[0070] The touch sensing display system 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although in other embodiments other display technologies are used. The touch sensing display system 112 and the display controller 156 optionally include capacitive technology, resistive technology, infrared technology, and surface acoustic wave technology, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch sensing display system 112, including, but not limited to, any of a plurality of touch sensing technologies now known or later developed, to detect contact and any movement or interruption thereof. In an exemplary embodiment, projected mutual capacitance sensing technology, such as that found in the iPhone (registered trademark), iPod Touch (registered trademark), and iPad (registered trademark) from Apple Inc. (Cupertino, California), is used.

[0071] The touch sensing display system 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the video resolution of the touch screen is greater than 400 dpi (e.g., 500 dpi, 800 dpi, or higher). The user optionally uses any suitable object or appendage, such as a stylus, finger, etc., to contact the touch sensing display system 112. In some embodiments, the user interface is designed to function with finger-based contact and gestures, which may be less accurate than stylus-based input due to the larger area of finger contact on the touch screen. In some embodiments, the device converts rough finger-based input into a precise pointer / cursor position or commands for performing the user's desired action.

[0072] In some embodiments, in addition to the touch screen, device 100 optionally includes a touch pad (not shown) for activating or deactivating certain functions. In some embodiments, the touch pad, unlike the touch screen, is a touch-sensitive area of the device that does not display visual output. The touch pad is optionally a touch-sensitive surface separate from the touch-sensitive display system 112, or an extension of the touch-sensitive surface formed by the touch screen.

[0073] Device 100 also includes a power system 162 for powering various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., a battery, alternating current (AC)), a recharge system, a power outage detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with the generation, management, and distribution of power within a portable device.

[0074] Device 100 also optionally includes one or more light sensors 164. FIG. 1A shows a light sensor coupled to a light sensor controller 158 within the I / O subsystem 106. The light sensor(s) 164 optionally include a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. The light sensor(s) 164 receive light from the environment projected through one or more lenses and convert the light into data representing an image. In cooperation with the imaging module 143 (also referred to as a camera module), the light sensor(s) 164 optionally capture still images and / or video. In some embodiments, the light sensor is located on the back of device 100, opposite the touch-sensitive display system 112 on the front of the device, so that the touch screen can be used as a viewfinder for acquiring still images and / or video images. In some embodiments, another light sensor is located on the front of the device so that an image of the user can be acquired (e.g., for a self-portrait, for a video conference while the user is looking at other video conference participants on the touch screen, etc.).

[0075] Device 100 also optionally includes one or more contact intensity sensors 165. FIG. 1A shows a contact intensity sensor coupled to an intensity sensor controller 159 within I / O subsystem 106. The contact intensity sensor(s) 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrokinetic sensors, piezoelectric sensors, optical force sensors, capacitive touch sensing surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of contact on a touch sensing surface). The contact intensity sensor(s) 165 receives contact intensity information (e.g., pressure information or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is juxtaposed with or proximate to a touch sensing surface (e.g., touch sensing display system 112). In some embodiments, at least one contact intensity sensor is located on the back surface of device 100, opposite a touch screen display system 112 located on the front surface of device 100.

[0076] Device 100 also optionally includes one or more proximity sensors 166. FIG. 1A shows a proximity sensor 166 coupled to a peripheral device interface 118. Alternatively, proximity sensor 166 is coupled to an input controller 160 within I / O subsystem 106. In some embodiments, when a multifunctional device is placed near a user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables the touch sensing display system 112.

[0077] Device 100 also optionally includes one or more haptic output generators 167. FIG. 1A shows a haptic output generator coupled to a haptic feedback controller 161 within I / O subsystem 106. The haptic output generator(s) 167 optionally includes one or more electroacoustic devices, such as a speaker or other audio components, and / or electromechanical devices that convert energy into linear motion, such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other haptic output generating components (e.g., components that convert an electrical signal into a haptic output) on the device. The haptic output generator(s) 167 receives haptic feedback generation instructions from the haptic feedback module 133 and generates haptic outputs on device 100 that can be sensed by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed with or proximate to a touch sensing surface (e.g., touch sensing display system 112), and optionally generates haptic outputs by moving the touch sensing surface in a vertical direction (e.g., in / out of the surface of device 100) or a lateral direction (e.g., back / forth within the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is located on the back surface of device 100, opposite a touch sensing display system 112 located on the front surface of device 100.

[0078] Device 100 also optionally includes one or more accelerometers 168. FIG. 1A shows an accelerometer 168 coupled to the peripheral device interface 118. Alternatively, accelerometer 168 is optionally coupled to an input controller 160 within I / O subsystem 106. In some embodiments, information is displayed on a touch screen display in a portrait or landscape view based on analysis of data received from one or more accelerometers. Device 100 optionally includes, in addition to the accelerometer(s) 168, a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information regarding the position and orientation (e.g., portrait or landscape) of device 100.

[0079] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a touch / movement module (or instruction set) 130, a graphics module (or instruction set) 132, a haptic feedback module (or instruction set) 133, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Further, in some embodiments, as shown in FIGS. 1A and 3, memory 102 stores a device / global internal state 157. The device / global internal state 157 includes, if there is a currently active application, an active application state indicating which application is active, a display state indicating which application, view, or other information occupies various regions of the touch-sensing display system 112, a sensor state including information obtained from various sensors of the device and other input or control devices 116, and location and / or position information regarding the location and / or orientation of the device, among one or more of these.

[0080] The operating system 126 (e.g., an embedded operating system such as iOS, Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or VxWorks) includes various software components and / or drivers for controlling and managing overall system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware components and software components.

[0081] The communication module 128 also includes various software components for facilitating communication with other devices through one or more external ports 124 and for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FIREWIRE, etc.) are adapted to couple to other devices either directly or indirectly through a network (e.g., the Internet, a wireless local area network, etc.). In some embodiments, the external port is the same as, similar to, and / or compatible with a 30-pin connector used in some iPhone (registered trademark), iPod Touch (registered trademark), and iPad (registered trademark) devices from Apple Inc. of Cupertino, California. In some embodiments, the external port is the same as, similar to, and / or compatible with a Lightning connector used in some iPhone (registered trademark), iPod Touch (registered trademark), and iPad (registered trademark) devices from Apple Inc. of Cupertino, California.

[0082] The contact / motion module 130 optionally detects contact with the touch sensing display system 112 (in cooperation with the display controller 156) and contact with other touch sensing devices (e.g., a touch pad or a physical click wheel). The contact / motion module 130 includes software components for performing various operations related to the detection of contact (e.g., by a finger or a stylus), such as determining whether contact has occurred (e.g., detecting an event where a finger touches down), determining the intensity of the contact (e.g., the force or pressure of the contact, or something in place of the force or pressure of the contact), determining whether there is movement of the contact, tracking movement across the touch sensing surface (e.g., detecting a drag event of one or more fingers), and determining whether the contact has stopped (e.g., detecting an event where a finger lifts up or an interruption of the contact). The contact / motion module 130 receives contact data from the touch sensing surface. Optionally, determining the movement of the contact point represented by a series of contact data includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. Those operations are optionally applied to a single contact (e.g., contact by one finger or a stylus) or multiple simultaneous contacts (e.g., "multi-touch" / contact by multiple fingers). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touch pad.

[0083] The contact / motion module 130 optionally detects gesture inputs by the user. Different gestures on the touch sensing surface have different contact patterns (e.g., different motions, timing, and / or intensities of the detected contacts). Thus, gestures are optionally detected by detecting a specific contact pattern. For example, detecting a finger tap gesture includes detecting an event where the finger goes down and then detecting an event where the finger goes up (lifts off) at the same position (or substantially the same position) as the event where the finger went down (e.g., at the position of an icon). As another example, detecting a finger swipe gesture on the touch sensing surface includes detecting an event where the finger goes down, then detecting one or more finger drag events, and then detecting an event where the finger goes up (lifts off). Similarly, taps, swipes, drags, and other gestures are optionally detected for a stylus by detecting a specific contact pattern for the stylus.

[0084] In some embodiments, detecting a finger tap gesture depends on the length of time between detecting an event that the finger goes down and detecting an event that the finger goes up, and is not related to the intensity of finger contact between detecting the event that the finger goes down and detecting the event that the finger goes up. In some embodiments, a tap gesture is detected according to a determination that the length of time between an event that the finger goes down and an event that the finger goes up is shorter than a predetermined value (e.g., shorter than 0.1, 0.2, 0.3, 0.4, or 0.5 seconds), regardless of whether the intensity of finger contact during the tap meets a given intensity threshold such as a light press or a deep press intensity threshold (greater than a nominal contact detection intensity threshold). Thus, a finger tap gesture can meet a specific input criterion that does not require the characteristic intensity of contact to meet a given intensity threshold for a specific input criterion to be met. For clarity, finger contact in a tap gesture generally needs to meet a nominal contact detection intensity threshold below which contact is not detected in order for an event that the finger goes down to be detected. A similar analysis applies to detecting a tap gesture or other contact with a stylus. In cases where the device can detect contact of a finger or stylus hovering over the touch sensing surface, the nominal contact detection intensity threshold is optional and does not correspond to physical contact between the finger or stylus and the touch sensing surface.

[0085] In a similar manner, the same concept is applied to other types of gestures. For example, a swipe gesture, pinch gesture, spread gesture, and / or long press gesture are optionally detected based on meeting criteria that are either not related to the intensity of the contact included in the gesture or do not require the contact performing the gesture to reach an intensity threshold for recognition. For example, a swipe gesture is detected based on the amount of movement of one or more contacts, a pinch gesture is detected based on the movement of two or more contacts moving towards each other, a spread gesture is detected based on the movement of two or more contacts moving away from each other, and a long press gesture is detected based on the duration of the contact on the touch sensing surface that is less than a threshold amount of movement. In that way, the description that a particular gesture recognition criterion does not require the intensity of the contact(s) to meet respective intensity thresholds for the particular gesture recognition criterion to be met means that it is possible for a particular gesture recognition criterion to be met when the contact(s) in the gesture do not reach their respective intensity thresholds, and it is also possible for one or more of the contacts in the gesture to not reach their respective intensity thresholds or not exceed the intensity thresholds and still be met. In some embodiments, a tap gesture is detected based on a determination that a finger down event and a finger up event are detected within a predefined time period regardless of whether the contact exceeds or falls below its respective intensity threshold during the predefined time period, and a swipe gesture is detected based on a determination that the movement of the contact is greater than a predefined size even if the contact exceeds its respective intensity threshold at the end of the movement of the contact. Even in embodiments where the detection of the gesture is affected by the intensity of the contact performing the gesture (e.g., the device detects a long press faster when the intensity of the contact exceeds the intensity threshold or the device is slower to detect a tap input when the intensity of the contact is higher), as long as the criteria for recognizing the gesture can be met in situations where the contact does not reach a particular intensity threshold (e.g., even if the amount of time required to recognize the gesture changes), the detection of those gestures does not require the contact to reach a particular intensity threshold.

[0086] The contact intensity threshold, the duration threshold, and the movement threshold are combined in various different combinations in order to create heuristics for distinguishing between two or more different gestures that are directed at the same input element or region in some situations, thereby being effective in providing a richer set of user interactions and responses for multiple different interactions with the same input element. The description that a particular set of gesture recognition criteria does not require the intensity of the contact(s) to meet respective intensity thresholds in order for a particular gesture recognition criterion to be satisfied does not preclude the simultaneous evaluation of other intensity-dependent gesture recognition criteria for identifying other gestures that have criteria that are satisfied when the gesture includes contacts having intensities that exceed the respective intensity thresholds. For example, in some situations, a first gesture recognition criterion for a first gesture that does not require the intensity of the contact(s) to meet respective intensity thresholds in order for the first gesture recognition criterion to be satisfied is in a competing relationship with a second gesture recognition criterion for a second gesture that depends on the contact(s) reaching respective intensity thresholds. In such a competition, the gesture is optionally not recognized as satisfying the first gesture recognition criterion for the first gesture if the second gesture recognition criterion for the second gesture is satisfied first. For example, if the contact reaches the respective intensity thresholds before the contact moves a predefined amount of movement, a deep press gesture is detected instead of a swipe gesture. Conversely, if the contact moves a predefined amount of movement before the contact reaches the respective intensity thresholds, a swipe gesture is detected instead of a deep press gesture. Even in such situations, the first gesture recognition criterion for the first gesture still does not require the intensity of the contact(s) to meet respective intensity thresholds in order for the first gesture recognition criterion to be satisfied because the gesture is recognized by the first gesture recognition criterion as a swipe gesture if the contact remains below the respective intensity thresholds until the end of the gesture (e.g., a swipe gesture having a contact that does not increase to an intensity exceeding the respective intensity thresholds).In this way, certain gesture recognition criteria that do not require the intensity of the contact(s) to meet respective intensity thresholds for a particular gesture recognition criteria are such that, in some situations, (A) the intensity of the contact is ignored with respect to an intensity threshold (e.g., for a tap gesture), and / or (B) in some situations, where a competing set of intensity-dependent gesture recognition criteria (e.g., for a deep press gesture) recognize the input as corresponding to an intensity-dependent gesture before a particular gesture recognition criteria (e.g., for a long press gesture) that recognizes a gesture corresponding to the input (e.g., a long press gesture that competes with the deep press gesture for recognition) functions, the particular gesture recognition criteria (e.g., for a long press gesture) still depends on the intensity of the contact with respect to the intensity threshold in the sense that it does not function.

[0087] The graphic module 132 includes various known software components for rendering and displaying graphics on a touch-sensitive display system 112 or other display, including components for changing visual effects of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual characteristics). As used herein, the term "graphic" includes, but is not limited to, any object that can be displayed to a user, including text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, and the like.

[0088] In some embodiments, the graphic module 132 stores data representing the graphics that will be used. Each graphic is optionally assigned a corresponding code. The graphic module 132 receives, from an application or the like, one or more codes specifying the graphics to be displayed, along with coordinate data and other graphic characteristic data as needed, and then generates screen image data for output to the display controller 156.

[0089] The tactile feedback module 133 includes various software components for generating instructions to be used by the tactile output generator(s) 167 to generate tactile output at one or more locations on the device 100 in response to user interaction with the device 100.

[0090] The text input module 134 is optionally a component of the graphic module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application that requires text input).

[0091] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for location-based dialing, to the camera 143 as metadata for photos / videos, and to applications that provide location-based services such as weather widgets, local yellow page widgets, and map / navigation widgets).

[0092] The application 136 optionally includes the following modules (or sets of instructions), or subsets or supersets thereof. ● Contacts module 137 (which may also be referred to as an address book or contacts list), ● Phone module 138, ● Video conferencing module 139, ● Email client module 140, ● Instant messaging (IM) module 141, ● Training support module 142, ● Camera module 143 for still and / or video images, ● Image management module 144, ● Browser module 147, ● Calendar module 148, ● A widget module 149 that optionally includes one or more of a weather widget 149-1, a stock price widget 149-2, a calculator widget 149-3, an alarm clock widget 149-4, a dictionary widget 149-5, and other widgets obtained by the user, as well as a user-created widget 149-6. ● A widget creation module 150 for creating a user-created widget 149-6. ● A search module 151. ● A video and music player module 152 that optionally consists of a video player module and a music player module. ● A memo module 153. ● A map module 154, and / or ● An online video module 155.

[0093] Examples of other applications 136 that are optionally stored in the memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, Java-compatible applications, encryption, digital rights management, speech recognition, and speech replication.

[0094] In conjunction with the touch sensing display system 112, the display controller 156, the contact module 130, the graphic module 132, and the text input module 134, the contact module 137 includes executable instructions for managing an address book or contact list (e.g., stored in the application internal state 192 of the contact module 137 in the memory 102 or the memory 370), including adding a name(s) to the address book, deleting a name(s) from the address book, associating a phone number(s), an email address(es), an address(es), or other information with a name, associating an image with a name, classifying and sorting names, providing a phone number and / or an email address to initiate and / or facilitate communication by phone 138, video conference 139, email 140, or IM 141, and the like.

[0095] In cooperation with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch sensing display system 112, the display controller 156, the contact module 130, the graphic module 132, and the text input module 134, the phone module 138 includes executable instructions for entering a sequence of characters corresponding to a phone number, accessing one or more phone numbers in the address book 137, modifying the entered phone number, dialing each phone number, conducting a conversation, disconnecting or hanging up when the conversation is complete. As described above, the wireless communication is optional and uses any of a plurality of communication standards, protocols, and technologies.

[0096] In cooperation with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch sensing display system 112, display controller 156, optical sensor(s) 164, optical sensor controller 158, contact module 130, graphic module 132, text input module 134, contact list 137, and phone module 138, the video conferencing module 139 includes executable instructions to start, conduct, and end a video conference between the user and one or more other participants according to the user's instructions.

[0097] In cooperation with the RF circuit 108, touch sensing display system 112, display controller 156, contact module 130, graphic module 132, and text input module 134, the email client module 140 includes executable instructions to create, send, receive, and manage emails in response to the user's instructions. In cooperation with the image management module 144, the email client module 140 makes it very easy to create and send emails with still or video images captured by the camera module 143.

[0098] In cooperation with the RF circuit 108, the touch sensing display system 112, the display controller 156, the touch module 130, the graphic module 132, and the text input module 134, the instant message module 141 includes executable instructions for entering a series of characters corresponding to an instant message, modifying previously entered characters, and sending each instant message (e.g., using the Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for phone-based instant messages, or using XMPP, SIMPLE, Apple Push Notification Service (APNs), or IMPS for Internet-based instant messages), receiving instant messages, and viewing the received instant messages. In some embodiments, the instant messages sent and / or received optionally include graphics, photos, audio files, video files, and / or other attached files, such as those supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant message" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, APNs, or IMPS).

[0099] In conjunction with the RF circuit 108, touch sensing display system 112, display controller 156, contact module 130, graphic module 132, text input module 134, GPS module 135, map module 154, and music player module 146, the training support module 142 creates training (e.g., having time, distance, and / or calorie consumption goals), communicates with training sensors (within the sports device and smartwatch), receives training sensor data, calibrates sensors used to monitor training, selects and plays music for training, and includes executable instructions for displaying, storing, and transmitting training data.

[0100] In conjunction with the touch sensing display system 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact module 130, graphic module 132, and image management module 144, the camera module 143 includes executable instructions for capturing still images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of the still images or videos, and / or deleting still images or videos from the memory 102.

[0101] In conjunction with the touch sensing display system 112, display controller 156, contact module 130, graphic module 132, text input module 134, and camera module 143, the image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise operating on still images and / or video images, labeling, deleting, presenting (e.g., within a digital slide show or album), and storing them.

[0102] In combination with the RF circuit 108, the touch sensing display system 112, the display system controller 156, the touch module 130, the graphic module 132, and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet according to user instructions, including searching, linking, receiving, and displaying web pages or portions thereof, as well as attached files and other files linked to the web pages.

[0103] In combination with the RF circuit 108, the touch sensing display system 112, the display system controller 156, the touch module 130, the graphic module 132, the text input module 134, the email client module 140, and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying, and storing a calendar and data associated with the calendar (e.g., calendar items, lists of things to do, etc.) according to user instructions.

[0104] In conjunction with the RF circuit 108, the touch sensing display system 112, the display system controller 156, the contact module 130, the graphic module 132, the text input module 134, and the browser module 147, the widget module 149 is optionally a mini-application (e.g., weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) downloaded and used by the user, or a mini-application created by the user (e.g., user-created widget 149-6). In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript (registered trademark) file. In some embodiments, the widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! widget).

[0105] In cooperation with the RF circuit 108, the touch sensing display system 112, the display system controller 156, the contact module 130, the graphic module 132, the text input module 134, and the browser module 147, the widget creation module 150 includes executable instructions for creating a widget (e.g., changing a user-specified portion of a web page into a widget).

[0106] In cooperation with the touch sensing display system 112, the display system controller 156, the contact module 130, the graphic module 132, and the text input module 134, the search module 151 includes executable instructions for searching for text, music, sound, images, video, and / or other files in the memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) according to the user's instructions.

[0107] In cooperation with the touch-sensing display system 112, the display system controller 156, the contact module 130, the graphic module 132, the audio circuit 110, the speaker 111, the RF circuit 108, and the browser module 147, the video and music player module 152 includes executable instructions that enable a user to download and play recorded music or other sound files stored in one or more file formats such as MP3 or AAC files, and executable instructions to display, present, or otherwise play videos (e.g., on the touch-sensing display system 112 or on an external display connected wirelessly or via the external port 124). In some embodiments, the device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

[0108] In cooperation with the touch-sensing display system 112, the display controller 156, the contact module 130, the graphic module 132, and the text input module 134, the memo module 153 includes executable instructions to create and manage memos, lists of things to do, etc., according to the user's instructions.

[0109] In cooperation with the RF circuit 108, the touch-sensing display system 112, the display system controller 156, the contact module 130, the graphic module 132, the text input module 134, the GPS module 135, and the browser module 147, the map module 154 includes executable instructions to receive, display, modify, and store maps and data associated with the maps (e.g., driving directions, data about stores and other points of interest at or near a particular location, and other location-based data) according to the user's instructions.

[0110] In cooperation with the touch sensing display system 112, the display system controller 156, the touch module 130, the graphic module 132, the audio circuit 110, the speaker 111, the RF circuit 108, the text input module 134, the email client module 140, and the browser module 147, the online video module 155 includes executable instructions that enable a user to access, view, receive (e.g., by streaming and / or downloading), play (e.g., on the touch screen 112 or on an external display connected wirelessly or via the external port 124), send an email having a link to a particular online video, and manage in other ways. In some embodiments, instead of the email client module 140, an instant messaging module 141 is used to send a link to a particular online video.

[0111] Each of the specifically identified modules and applications corresponds to a set of executable instructions for performing one or more of the functions described above, as well as methods described in this application (e.g., methods performed by a computer as described herein and other information processing methods). Those modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures, or modules, and thus, various subsets of those modules may optionally be combined or otherwise rearranged in various embodiments. In some embodiments, the memory 102 optionally stores a subset of the specifically identified modules and data structures. Further, the memory 102 optionally stores additional modules and data structures not described above.

[0112] In some embodiments, device 100 is a device in which operations of a predefined set of functions on the device are exclusively performed through a touch screen and / or a touch pad. By using the touch screen and / or the touch pad as the main input control device for operating the device 100, the number of physical input control devices (such as push buttons, dials, etc.) on the device 100 can be optionally reduced.

[0113] The predefined set of functions that are exclusively performed through the touch screen and / or the touch pad optionally includes navigation between user interfaces. In some embodiments, when touched by the user, the touch pad navigates the device 100 from any user interface displayed on the device 100 to the main menu, the home menu, or the root menu. In such embodiments, the "menu button" is implemented using the touch pad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of the touch pad.

[0114] FIG. 1B is a block diagram showing exemplary components for event handling according to some embodiments. In some embodiments, memory 102 (in FIG. 1A) or 370 (in FIG. 3) includes an event sorting unit 170 (e.g., within operating system 126) and respective applications 136-1 (e.g., any one of the applications 136, 137~155, 380~390 described above).

[0115] The event sorting unit 170 receives event information and determines the application 136-1 to which the event information is to be distributed and the application view 191 of the application 136-1. The event sorting unit 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, the application 136-1 includes an application internal state 192 that indicates the current application view(s) displayed on the touch-sensitive display system 112 when the application is active or running. In some embodiments, the device / global internal state 157 is used by the event sorting unit 170 to determine which application(s) is / are currently active, and the application internal state 192 is used by the event sorting unit 170 to determine the application view 191 to which the event information is to be distributed.

[0116] In some embodiments, the application internal state 192 includes additional information such as one or more of resume information used when the application 136-1 resumes execution, user interface state information indicating information that is being or is ready to be displayed by the application 136-1, a state waiting queue for enabling the user to return to the previous state or view of the application 136-1, and a redo / undo waiting queue for the previous actions performed by the user.

[0117] The event monitor 171 receives event information from the peripheral device interface 118. The event information includes information about sub-events (e.g., a user's touch on the touch-sensing display system 112 as part of a multi-touch gesture). The peripheral device interface 118 transmits information received from the I / O subsystem 106, or sensors such as the proximity sensor 166, the accelerometer(s) 168, and / or the microphone 113 (through the audio circuit 110). The information that the peripheral device interface 118 receives from the I / O subsystem 106 includes information from the touch-sensing display system 112 or the touch-sensing surface.

[0118] In some embodiments, the event monitor 171 transmits requests to the peripheral device interface 118 at predetermined intervals. In response, the peripheral device interface 118 transmits event information. In other embodiments, the peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input that exceeds a predetermined noise threshold and / or is longer than a predetermined period).

[0119] In some embodiments, the event sorter 170 also includes the hit view determination module 172 and / or the active event recognition unit determination module 173.

[0120] The hit view determination module 172 provides software procedures for determining where in one or more views a sub-event has occurred when the touch-sensing display system 112 displays two or more views. The views are composed of controls and other elements that the user can see on the display.

[0121] Another aspect of the user interface associated with the application is a set of views, sometimes referred to herein as the application view or user interface window, within which information is displayed and touch-based gestures occur. The application view (of each application) where the touch is detected is optionally corresponding to a program level within the program hierarchy or view hierarchy of the application. For example, the lowest-level view where the touch is detected is optionally called the hit view, and the set of events recognized as appropriate input is optionally determined based at least in part on the hit view of the initial touch that starts the touch-based gesture.

[0122] The hit view determination module 172 receives information related to sub-events of the touch-based gesture. When the application has a plurality of views organized in a hierarchy, the hit view determination module 172 identifies the hit view as the lowest-level view within the hierarchy where the sub-event is to be processed. In most situations, the hit view is the lowest-level view where the starting sub-event (i.e., the first sub-event in a series of sub-events that form an event or potential event) occurs. Once the hit view is identified by the hit view determination module, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0123] The active event recognition unit determination module 173 determines which view(s) within the view hierarchy should receive a particular series of sub-events. In some embodiments, the active event recognition unit determination module 173 determines that only the hit view should receive a particular series of sub-events. In other embodiments, the active event recognition unit determination module 173 determines that all views including the physical location of the sub-events are views that are actively involved, and thus determines that all views that are actively involved should receive a particular series of sub-events. In other embodiments, even if a touch sub-event is completely restricted to an area associated with one particular view, the upper-level view in the hierarchy remains a view that is actively involved.

[0124] The event dispatcher module 174 sends event information to the event recognition unit (e.g., the event recognition unit 180). In embodiments including the active event recognition unit determination module 173, the event dispatcher module 174 distributes the event information to the event recognition unit determined by the active event recognition unit determination module 173. In some embodiments, the event dispatcher module 174 stores the event information obtained by each event receiving unit module 182 in the event queue.

[0125] In some embodiments, the operating system 126 includes the event sorter 170. Alternatively, the application 136-1 includes the event sorter 170. In still other embodiments, the event sorter 170 is an independent module or part of another module stored in the memory 102, such as the touch / motion module 130.

[0126] In some embodiments, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each including instructions for processing touch events that occur within respective views of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognition units 180. Typically, each application view 191 includes a plurality of event recognition units 180. In other embodiments, one or more of the event recognition units 180 are part of separate modules, such as a user interface kit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, each event handler 190 includes one or more of event data 179 received from data update unit 176, object update unit 177, GUI update unit 178, and / or event sorting unit 170. Optionally, event handler 190 utilizes or calls data update unit 176, object update unit 177, or GUI update unit 178 to update the internal state 192 of the application. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. Also, in some embodiments, one or more of data update unit 176, object update unit 177, and GUI update unit 178 are included in respective application views 191.

[0127] Each event recognition unit 180 receives event information (e.g., event data 179) from event sorting unit 170 and identifies an event from the event information. Event recognition unit 180 includes an event receiving unit 182 and an event comparing unit 184. In some embodiments, event recognition unit 180 also includes at least a subset of metadata 183 and event distribution instructions 188 (optionally including sub-event distribution instructions).

[0128] The event receiving unit 182 receives event information from the event sorting unit 170. The event information includes information about sub-events, for example, information about a touch or a movement of a touch. Depending on the sub-event, the event information also includes additional information such as the position of the sub-event. When the sub-event is related to the movement of a touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one orientation to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the posture of the device).

[0129] The event comparison unit 184 compares event information with predefined event or sub-event definitions, determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, the event comparison unit 184 includes an event definition 186. The event definition 186 includes definitions of events such as, for example, event 1 (187-1), event 2 (187-2), etc. (e.g., a predefined series of sub-events). In some embodiments, the sub-events in event 187 include, for example, the start of a touch, the end of a touch, the movement of a touch, the cancellation of a touch, and multiple touches. In one example, the definition of event 1 (187-1) is a double-tap on a displayed object. The double-tap includes, for example, a first touch (start of touch) at a predefined stage on the displayed object, a first lift-off (end of touch) at a predefined stage, a second touch (start of touch) at a predefined stage on the displayed object, and a second lift-off (end of touch) at a predefined stage. In another example, the definition of event 2 (187-2) is a drag on a displayed object. The drag includes, for example, a touch (or contact) at a predefined stage on the displayed object, movement of the touch across the touch-sensing display system 112, and lift-off of the touch (end of touch). In some embodiments, an event also includes information about one or more associated event handlers 190.

[0130] In some embodiments, the event definition 187 includes the definition of events for each user interface object. In some embodiments, the event comparison unit 184 performs a hit test to determine which user interface object is associated with the sub - event. For example, in an application view where three user interface objects are displayed on the touch - sensitive display system 112, when a touch is detected on the touch - sensitive display system 112, the event comparison unit 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub - event). If each of the displayed objects is associated with a respective event handler 190, the event comparison unit uses the result of the hit test to determine which event handler 190 should be activated. For example, the event comparison unit 184 selects the event handler associated with the sub - event and object that triggered the hit test.

[0131] In some embodiments, the definition for each event 187 also includes a delay action that delays the delivery of event information until it is determined whether a series of sub - events corresponds to the event type of the event recognition unit.

[0132] When each event recognition unit 180 determines that a series of sub - events does not match any of the events in the event definition 186, each event recognition unit 180 enters an event - impossible, event - failed, or event - ended state, and then ignores subsequent sub - events of the touch - based gesture. In this situation, if there are other event recognition units that remain active for the hit view, those event recognition units continue to track and process the sub - events of the ongoing touch - based gesture.

[0133] In some embodiments, each event recognition unit 180 includes metadata 183 having configurable properties, flags, and / or lists indicating how the event delivery system should actively participate in the event recognition unit that should execute sub-event delivery. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists indicating how event recognition units interact with each other or are allowed to interact. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists indicating whether sub-events are delivered to various levels in the view hierarchy or program hierarchy.

[0134] In some embodiments, each event recognition unit 180 activates an event handler 190 associated with the event when one or more specific sub-events of the event are recognized. In some embodiments, each event recognition unit 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is separate from sending (and deferring sending) sub-events to each hit view. In some embodiments, the event recognition unit 180 sets a flag associated with the recognized event, and the event handler 190 associated with the flag catches the flag and executes a predefined process.

[0135] In some embodiments, the event delivery command 188 includes a sub-event delivery command that delivers event information about sub-events without activating the event handler. Instead, the sub-event delivery command delivers the event information to an event handler associated with a series of sub-events or to a view actively involved. The event handler associated with a series of sub-events or a view actively involved receives the event information and executes a predefined process.

[0136] In some embodiments, the data update unit 176 creates and updates data used in application 136-1. For example, the data update unit 176 updates the phone numbers used in the contact module 137 or stores the video files used in the video player module 145. In some embodiments, the object update unit 177 creates and updates objects used in application 136-1. For example, the object update unit 177 creates a new user interface object or updates the position of a user interface object. The GUI update unit 178 updates the GUI. For example, the GUI update unit 178 prepares display information and sends the display information to the graphic module 132 for display on the touch-sensitive display.

[0137] In some embodiments, the event handler(s) 190 includes or has access to the data update unit 176, the object update unit 177, and the GUI update unit 178. In some embodiments, the data update unit 176, the object update unit 177, and the GUI update unit 178 are included in a single module of their respective application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0138] The foregoing description regarding event handling of a user's touch on the touch-sensitive display also applies to other forms of user input for operating the multifunctional device 100 using an input device, but it should be understood that not all of them are initiated on the touch screen. For example, mouse movement and mouse button presses optionally combined with single or multiple keyboard presses or holds, movement of contacts such as taps, drags, scrolls on a touch pad, pen stylus input, movement of the device, verbally detected eye movements, biometric input, and / or any combination thereof are optionally used as input corresponding to sub-events that define events to be recognized.

[0139] FIG. 1C is a block diagram illustrating a haptic output module, according to some embodiments. In some embodiments, the I / O subsystem 106 (e.g., the haptic feedback controller 161 (FIG. 1A) and / or other input controller(s) 160 (FIG. 1A)) includes at least some of the example components shown in FIG. 1C. In some embodiments, the peripheral device interface 118 includes at least some of the example components shown in FIG. 1C.

[0140] In some embodiments, the haptic output module includes a haptic feedback module 133. In some embodiments, the haptic feedback module 133 collects and combines haptic outputs (e.g., feedback in response to user input corresponding to a displayed user interface, and warnings indicating the execution of an operation or the occurrence of an event in the user interface of the electronic device) for user interface feedback from software applications on the electronic device. The haptic feedback module 133 includes one or more of a waveform module 123 (to provide waveforms used to generate the haptic output), a mixer 125 (to mix waveforms such as waveforms of different channels), a compressor 127 (to reduce or compress the dynamic range of the waveform), a low-pass filter 129 (to filter out high-frequency signal components in the waveform), and a thermal controller 131 (to adjust the waveform according to thermal conditions). In some embodiments, the haptic feedback controller 161 (FIG. 1A) includes the haptic feedback module 133. In some embodiments, separate units of the haptic feedback module 133 (or separate implementations of the haptic feedback module 133) are also included in an audio controller (e.g., the audio circuit 110 of FIG. 1A) and are used to generate audio signals. In some embodiments, a single haptic feedback module 133 is used to generate audio signals and to generate the waveforms of the haptic output.

[0141] In some embodiments, the tactile feedback module 133 also includes a trigger module 121 (e.g., a software application, an operating system, or other software module that determines to generate a tactile output and initiates a process to generate a corresponding tactile output). In some embodiments, the trigger module 121 generates a trigger signal for initiating the generation of a waveform (e.g., by the waveform module 123). For example, the trigger module 121 generates a trigger signal based on a preset timing reference. In some embodiments, the trigger module 121 receives a trigger signal from an external tactile feedback module 133 (e.g., in some embodiments, the tactile feedback module 133 receives a trigger signal from a hardware input processing module 146 located outside the tactile feedback module 133), and relays the trigger signal to other components within the tactile feedback module 133 (e.g., the waveform module 123), or to a software application that triggers an operation (e.g., using the trigger module 121) based on the activation of a hardware input device (e.g., a home button). In some embodiments, the trigger module 121 also receives a haptic feedback generation command (e.g., from the tactile feedback module 133, FIGS. 1A and 3). In some embodiments, the trigger module 121 generates a trigger signal in response to a haptic feedback module 133 (or the trigger module 121 within the haptic feedback module 133) that receives a haptic feedback command (e.g., from the haptic feedback module 133 of FIGS. 1A and 3).

[0142] The waveform module 123 receives, as input, a trigger signal (e.g., from the trigger module 121), and in response to the received trigger signal, provides a waveform for the generation of one or more tactile outputs (e.g., a waveform selected from a predetermined set of waveforms designed for use by the waveform module 123, such as the waveforms described in more detail below with reference to FIGS. 4F1 - 4G1).

[0143] The mixer 125 receives a waveform (e.g., waveform module 123) as input and synthesizes the waveform. For example, when the mixer 125 receives two or more waveforms (e.g., a first waveform on a first channel and a second waveform that at least partially overlaps the first waveform on a second channel), the mixer 125 outputs a synthesized waveform corresponding to the sum of the two or more waveforms. In some embodiments, the mixer 125 also modifies one or more of the two or more waveforms (e.g., by increasing the scale of a particular waveform(s) and / or decreasing the scale of the remainder of the waveform) to emphasize a particular waveform(s) across the remainder of the two or more waveforms. In some situations, the mixer 125 selects one or more waveforms to remove from the synthesized waveform (e.g., when there are more than three waveforms being requested to be output simultaneously by the haptic output generator 167, excluding the waveform from the oldest source).

[0144] The compressor 127 receives a waveform (e.g., the synthesized waveform from the mixer 125) as input and modifies the waveform. In some embodiments, the compressor 127 reduces the waveform (e.g., according to the physical specifications of the haptic output generator 167 (FIG. 1A) or 357 (FIG. 3)) such that the haptic output corresponding to the waveform is reduced. In some embodiments, the compressor 127 limits the waveform, such as by enforcing a predefined maximum amplitude on the waveform. For example, the compressor 127 reduces the amplitude of waveform portions that exceed a predetermined amplitude threshold while maintaining the amplitude of waveform portions below the predetermined amplitude threshold. In some embodiments, the compressor 127 reduces the dynamic range of the waveform. In some embodiments, the compressor 127 dynamically reduces the dynamic range of the waveform such that the synthesized waveform remains within the performance specifications (e.g., force and / or movable mass displacement limits) of the haptic output generator 167.

[0145] The low-pass filter 129 receives a waveform (e.g., the compressed waveform from the compressor 127) as input and filters (e.g., smoothes) the waveform (e.g., removes or reduces the high-frequency signal components of the waveform). For example, in some cases, the compressor 127 includes an external signal (e.g., a high-frequency signal component) in the compressed waveform that interferes with the generation of the haptic output according to the compressed waveform and / or exceeds the performance specifications of the haptic output generator 167 when the haptic output is generated. The low-pass filter 129 reduces or removes such external signals within the waveform.

[0146] The thermal controller 131 receives a waveform (e.g., the filtered waveform from the low-pass filter 129) as input and adjusts the waveform according to the thermal conditions of the device 100 (e.g., based on the internal temperature detected within the device 100, such as the temperature of the tactile feedback controller 161 and / or the external temperature detected by the device 100). For example, in some cases, the output of the tactile feedback controller 161 varies with temperature (e.g., the tactile feedback controller 161 generates a first haptic output when the tactile feedback controller 161 is at a first temperature and a second haptic output when the tactile feedback controller 161 is at a second temperature different from the first temperature in response to receiving the same waveform). For example, the magnitude (or amplitude) of the haptic output may vary with temperature. To reduce the influence of temperature changes, the waveform is modified (e.g., the amplitude of the waveform is increased or decreased based on the temperature).

[0147] In some embodiments, the tactile feedback module 133 (e.g., the trigger module 121) is coupled to the hardware input processing module 146. In some embodiments, the other input controller(s) 160 of FIG. 1A includes the hardware input processing module 146. In some embodiments, the hardware input processing module 146 receives input from the hardware input device 145 (e.g., other input or control device 116 of FIG. 1 such as a home button). In some embodiments, the hardware input device 145 is one of the touch sensing display system 112 (FIG. 1A), the keyboard / mouse 350 (FIG. 3), the touch pad 355 (FIG. 3), the other input or control device 116 (FIG. 1A), or an input device such as an intensity sensing home button (e.g., a home button having a mechanical actuator as shown in FIG. 2B or FIG. 2C). In some embodiments, the hardware input device 145 consists of an intensity sensing home button (e.g., a home button having a mechanical actuator as shown in FIG. 2B or FIG. 2C), and the touch sensing display system 112 (FIG. 1A), the keyboard / mouse 350 (FIG. 3), or the touch pad 355 (FIG. 3). In some embodiments, in response to an input from the hardware input processing module 145, the hardware input processing module 146 provides one or more trigger signals to the haptic feedback module 133 to indicate that a user input satisfying a predetermined input criterion, such as an input corresponding to a "click" of the home button (e.g., a "down click" or an "up click"), has been detected. In some embodiments, the haptic feedback module 133 provides a waveform corresponding to a "click" of the home button in response to an input corresponding to a "click" of the home button, and simulates the haptic feedback of pressing a physical home button.

[0148] In some embodiments, the haptic output module includes a haptic feedback controller 161 (the haptic feedback controller 161 of FIG. 1A) that controls the generation of haptic output. In some embodiments, the haptic feedback controller 161 is coupled to a plurality of haptic output generators, selects one or more of the plurality of haptic output generators, and transmits a waveform to the selected one or more haptic output generators to generate haptic output. In some embodiments, the haptic feedback controller 161 aligns a haptic output request corresponding to the activation of the hardware input device 145 with a haptic output request corresponding to a software event (e.g., a haptic output request from the haptic feedback module 133) (e.g., by increasing the scale of a particular waveform(s) and / or decreasing the scale of the remaining waveforms) to prioritize the haptic output corresponding to the activation of the hardware input device 145 over the haptic output corresponding to the software event, and modifies one or more of the two or more waveforms to emphasize a particular waveform(s) over the remainder of the two or more waveforms.

[0149] In some embodiments, the output of the haptic feedback controller 161 is coupled to an audio circuit of the device 100 (e.g., the audio circuit 110, FIG. 11A) to provide an audio signal to the audio circuit of the device 100. In some embodiments, the haptic feedback controller 161 provides both a waveform used to generate haptic output and an audio signal used to provide an audio output in relation to the generation of the haptic output. In some embodiments, the haptic feedback controller 161 modifies the audio signal and / or waveform (e.g., by delaying the audio signal and / or waveform) such that the audio output and the haptic output are synchronized. In some embodiments, the haptic feedback controller 161 includes a DA converter used to convert a digital waveform to an analog signal, and the analog signal is received by an amplifier 163 and / or a haptic output generator 167.

[0150] In some embodiments, the haptic output module includes an amplifier 163. In some embodiments, the amplifier 163 receives a waveform (e.g., from the haptic feedback controller 161) and amplifies the waveform before transmitting the amplified waveform to a haptic output generator 167 (e.g., either the haptic output generator 167 (FIG. 1A) or 357 (FIG. 3)). For example, the amplifier 163 amplifies the received waveform to a signal level according to the physical specifications of the haptic output generator 167 (e.g., the voltage and / or current required by the haptic output generator 167 to generate a haptic output such that the signal transmitted to the haptic output generator 167 corresponds to a haptic output for the waveform received from the haptic feedback controller 161), and transmits the amplified waveform to the haptic output generator 167. In response, the haptic output generator 167 generates a haptic output (e.g., by reciprocating a movable mass at one or more distances relative to the neutral position of the movable mass).

[0151] In some embodiments, the haptic output module includes a sensor 169 coupled to a haptic output generator 167. The sensor 169 detects a state or change in state (e.g., mechanical position, physical displacement, and / or movement) of the haptic output generator 167 or one or more components of the haptic output generator 167 (e.g., one or more moving parts such as a membrane used to generate a haptic output). In some embodiments, the sensor 169 is a magnetic field sensor (e.g., a Hall effect sensor) or other displacement and / or movement sensor. In some embodiments, the sensor 169 provides information (e.g., the position, displacement, and / or movement of one or more parts in the haptic output generator 167) to the haptic feedback controller 161, and in accordance with the information about the state of the haptic output generator 167 provided by the sensor 169, the haptic feedback controller 161 adjusts a waveform output from the haptic feedback controller 161 (e.g., the waveform transmitted to the haptic output generator 167, optionally via the amplifier 163).

[0152] FIG. 2 shows a portable multifunctional device 100 having a touch screen (e.g., touch sensing display system 112, FIG. 1A) according to some embodiments. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment, as well as in the embodiments described hereinafter, the user can select one or more of the graphics by performing gestures on the graphics using, for example, one or more fingers 202 (not drawn to an exact scale in the figure) or one or more styli 203 (not drawn to an exact scale in the figure). In some embodiments, selection of one or more of the graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, upward and / or downward), and / or rolling of a finger in contact with the device 100 (from right to left, from left to right, upward and / or downward). In some implementations or situations, an unexpected contact with a graphic does not select the graphic. For example, when the gesture corresponding to selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.

[0153] The device 100 also optionally includes one or more physical buttons, such as a "home" or menu button 204. As previously explained, the menu button 204 is optionally used to navigate to any application 136 in a set of applications that are optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key within a GUI displayed on the touch screen display.

[0154] In some embodiments, device 100 includes a touch screen display, a menu button 204, a push button 206 for turning the device on / off and locking the device, one or more volume adjustment buttons 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the power on / off on the device by pressing the button and holding it down for a predetermined time interval, lock the device by releasing the button before the predetermined time interval elapses while the button is held down, and / or unlock the device or initiate an unlock process. In some embodiments, device 100 also receives verbal input through microphone 113 to activate or deactivate some functions. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact on touch sensing display system 112 and / or one or more haptic output generators 167 for generating haptic output to the user of device 100.

[0155] Figures 2B-2C are exploded views of a first input device suitable for use in an electronic device shown in Figures 1A, 2A, 3, and / or 4A (e.g., home button 204). Figure 2B shows an example of an intensity sensing home button having a capacitive sensor used to determine a range of intensity values corresponding to the force applied to the intensity sensing home button. Figure 2C shows an example of a home button having a mechanical switch element. Referring to Figure 2B, input device stack 220 includes a cover element 222 and a trim 224. In the illustrated embodiment, trim 224 completely surrounds the sides of cover element 222 and the perimeter of the top surface of cover element 222. Other embodiments are not limited to this configuration. For example, in one embodiment, the sides and / or top surface of cover element 222 may be partially surrounded by trim 224. Alternatively, trim 224 may be omitted in other embodiments.

[0156] Both the cover element 222 and the trim 224 can be formed of a suitable opaque, transparent, and / or translucent material. For example, the cover element 222 may be made of glass, plastic, or sapphire, and the trim 224 may be made of metal or plastic. In some embodiments, one or more additional layers (not shown) can be disposed under the cover element 222. For example, if the cover element 222 is made of a transparent material, an opaque ink layer can be disposed under the cover element 222. The opaque ink layer can cover other components within the input device stack 220 so that other components are not visible through the transparent cover element 222.

[0157] The first circuit layer 226 can be disposed under the cover element 222. Any suitable circuit layer may be used. For example, the first circuit layer 226 may be a circuit board or a flexible circuit. The first circuit layer 226 can include one or more circuits, signal lines, and / or integrated circuits. In one embodiment, the first circuit layer 226 includes a biosensor 228. Any suitable type of biosensor can be used. For example, in one embodiment, the biosensor is a capacitive fingerprint sensor that captures at least one fingerprint when a user's finger(s) approaches and / or contacts the cover element 222.

[0158] The first circuit layer 226 may be attached to the bottom surface of the cover element 222 via an adhesive layer 230. Any suitable adhesive can be used as the adhesive layer. For example, a pressure-sensitive adhesive layer may be used as the adhesive layer 230.

[0159] The compliance layer 232 is disposed under the first circuit layer 226. In one embodiment, the compliance layer 232 includes an opening 234 formed in the compliance layer 232. The opening 234 exposes the upper surface of the first circuit layer 226 and / or the biosensor 228 during the assembly of the device stack 220. In an exemplary embodiment, the compliance layer 232 is disposed around the inner circumference of the trim 224 and / or the periphery of the cover element 222. Although the compliance layer 232 is depicted as circular, it can have any given shape and / or dimension, such as square or oval. Although the compliance layer 232 is shown as a continuous compliance layer in FIGS. 2B and 2C, other embodiments are not limited to this configuration. In some embodiments, a plurality of discrete compliance layers may be used within the device stack 220. Additionally, in some embodiments, the compliance layer 232 does not include an opening 234, and the compliance layer 232 extends over at least a portion of the input device stack 220. For example, the compliance layer 232 can extend over the bottom surface of the cover element 222 and the bottom surface of the first circuit layer 226, or over a portion of the bottom surface of the cover element 222 (e.g., surrounding the periphery of the cover element) and the bottom surface of the first circuit layer 226.

[0160] The second circuit layer 238 is located below the first circuit layer 226. Flexible circuits and circuit boards are an example of circuit layers that can be used for the second circuit layer 238. In some embodiments, the second circuit layer 238 can include a first circuit portion 240 and a second circuit portion 242. The first and second circuit portions 240, 242 can be electrically connected to each other.

[0161] The first circuit portion 240 can include a first set of one or more intensity sensor components included in the intensity sensor. In some embodiments, the first circuit portion 240 can be electrically connected to the first circuit layer 226. For example, if the first circuit layer 226 includes the biosensor 228, the biosensor 228 can be electrically connected to the first circuit portion 240 of the second circuit layer 238.

[0162] The second circuit portion 242 can include additional circuits such as signal lines, circuit components, integrated circuits, etc. In one embodiment, the second circuit portion 242 can include a board-to-board connector 244 that electrically connects the second circuit layer 238 to other circuits within the electronic device. For example, the second circuit layer 238 can be operably connected to a processing device using the board-to-board connector 244. Additionally or alternatively, the second circuit layer 238 may be operably connected to a circuit that transmits signals (e.g., sense signals) received from one or more intensity sensor components in the first circuit portion 240 to a processing device. Additionally or alternatively, the second circuit layer 238 may be operably connected to a circuit that provides signals (e.g., drive signals, reference signals) to one or more intensity sensor components in the first circuit portion 240.

[0163] In some embodiments, the first circuit portion 240 of the second circuit layer 238 may be attached to the bottom surface of the first circuit layer 226 using an adhesive layer 236. In a non-limiting example, a die attach film may be used to attach the first circuit portion 240 to the bottom surface of the first circuit layer 226.

[0164] The third circuit layer 246 is disposed below the first circuit portion 240 of the second circuit layer 238. The third circuit layer 246 may include a second set of one or more intensity sensor components included in the intensity sensor. The third circuit layer 246 is supported by and / or attached to a support element 248. In one embodiment, the support element 248 is attached to the trim 224 to form an enclosure for other components within the device stack 220. The support element 248 may be attached to the trim 224 using a suitable attachment mechanism.

[0165] The first set of one or more intensity sensor components in the first circuit portion 240 and the second set of one or more intensity sensor components in the third circuit layer 246 together form an intensity sensor. The intensity sensor can use any suitable intensity sensing technology. Exemplary sensing technologies include, but are not limited to, capacitive, piezoelectric, piezoresistive, ultrasonic, and magnetic ones.

[0166] In the example shown in FIGS. 2B and 2C, the intensity sensor is a capacitive force sensor. For a capacitive force sensor, the first set of one or more intensity sensor components includes a first set of one or more electrodes 250, and the second set of one or more force sensor components includes a second set of one or more electrodes 252. Although shown as square in FIGS. 2B and 2C, each electrode in the first and second sets 250, 252 of one or more electrodes can have any given shape (e.g., rectangular, circular). Additionally, the one or more electrodes in the first and second sets 250, 252 can be arranged in any given pattern (e.g., one or more rows and one or more columns).

[0167] FIGS. 2B and 2C show two electrodes in the first and second sets of one or more electrodes 250, 252. However, other embodiments are not limited to this configuration. The first and second sets 250, 252 of one or more electrodes can each be a single electrode or a plurality of individual electrodes. For example, if the first set of one or more electrodes is a single electrode, the second set of one or more electrodes comprises a plurality of individual electrodes. In some embodiments, the second set of one or more electrodes can be a single electrode, and the first set includes a plurality of individual electrodes. Alternatively, both the first and second sets of one or more electrodes can each include a plurality of individual electrodes.

[0168] Each electrode of the first set of one or more electrodes 250 is aligned with each electrode of the second set of one or more electrodes 252 in at least one direction (e.g., the vertical direction) to form one or more capacitors. When a force input is applied to the cover element 222 (e.g., the input surface of the input device), at least one electrode within the first set 250 moves closer to each electrode within the second set 252, changing the capacitance of the capacitor(s). The capacitance signal sensed from each capacitor represents the capacitance measurement of that capacitor. A processing device (not shown) is configured to receive the capacitance signal(s) and correlate the capacitance signal(s) to the magnitude of the force applied to the cover element 222. In some embodiments, the force sensor can be replaced with a switch element and different intensity thresholds can be used to determine an activation event.

[0169] In some embodiments, such as the embodiment shown in FIG. 2C, the switch element 54 can be disposed below the support element 248. The switch element 254 registers a user input when the force input applied to the cover element 222 exceeds a predetermined amount of force (e.g., a force threshold associated with the proximity of the distance between the first circuit portion 240 and the third circuit layer 246). Any suitable switch element can be used. For example, the switch element 254 can be a dome switch that collapses when the input of the force applied to the cover element 222 exceeds the force threshold. When collapsed, the dome switch terminates the circuit that is detected by the processing device and recognized as a user input (e.g., selection of an icon, function, or application). In one embodiment, the dome switch is arranged such that the top of the crushable dome is close to the bottom surface of the support plate 248. In another embodiment, the base of the crushable dome can be close to the bottom surface of the support plate 248.

[0170] Figure 3 is a block diagram of an exemplary multifunctional device having a display and a touch sensing surface, according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia playback device, a navigation device, an educational device (such as a child's learning toy), a gaming system, or a control device (e.g., a home or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more networks or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. Communication bus 320 optionally includes circuitry (sometimes called a chipset) that interconnects and controls communication between system components. Device 300 includes an input / output (I / O) interface 330 that typically includes a display 340 that is a touch screen display. I / O interface 330 also optionally includes a keyboard and / or a mouse (or other pointing device) 350, and a touch pad 355, a haptic output generator 357 for generating haptic output on device 300 (similar to the haptic output generator(s) 167 described above with reference to FIG. 1A), sensors 359 (e.g., light sensors, acceleration sensors, proximity sensors, touch sensing sensors, and / or contact intensity sensors similar to the contact intensity sensor(s) 165 described above with reference to FIG. 1A). Memory 370 includes high-speed random access memory such as DRAM, SRAM, DDR RAM, or other random access solid state memory devices, and also optionally includes non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid state storage devices. Memory 370 optionally includes one or more storage devices located remotely from the CPU(s) 310.In some embodiments, memory 370 stores programs, modules, and data structures similar to, or subsets of, the programs, modules, and data structures stored in memory 102 of portable multifunction device 100 (FIG. 1A). Additionally, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk authoring module 388, and / or a spreadsheet module 390, while memory 102 of portable multifunction device 100 (FIG. 1A) optionally does not store those modules.

[0171] Each of the elements in the above-specified FIG. 3 is optionally stored in one or more of the previously mentioned memory devices. Each of the above-specified modules corresponds to a set of instructions that perform the functions described above. The above-specified modules or programs (i.e., sets of instructions) need not be implemented as separate software programs, procedures, or modules, and thus various subsets of those modules are optionally combined in various embodiments or otherwise rearranged. In some embodiments, memory 370 optionally stores a subset of the above-specified modules and data structures. Additionally, memory 370 optionally stores additional modules and data structures not described above.

[0172] Attention is now directed to embodiments of a user interface (the "UI") optionally implemented on portable multifunction device 100.

[0173] FIG. 4A shows an exemplary user interface for a menu of applications on a portable multifunctional device 100, according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, the user interface 400 includes the following elements, or a subset or superset thereof. ● Signal strength indicator(s) 402 for wireless communication(s), such as cellular and Wi-Fi signals, ● Time 404, ● Bluetooth® indicator, ● Battery status indicator 406, ● Tray 408 including icons for frequently used applications, such as the following, ○ Icon 416 for the phone module 138, labeled "Phone," optionally including an indicator 414 of the number of missed calls or voicemail messages, ○ Icon 418 for the email client module 140, labeled "Mail," optionally including an indicator 410 of the number of unread emails, ○ Icon 420 for the browser module 147, labeled "Browser," and ○ Icon 422 for the video and music player module 152, also referred to as the iPod (a trademark of Apple Inc.) module 152, labeled "iPod," and ● Icons for other applications, such as the following, ○ Icon 424 for the IM module 141, labeled "Messages," ○ Icon 426 for the calendar module 148, labeled "Calendar," ○ Icon 428 for the image management module 144, labeled "Photos," ○ Icon 430 for the camera module 143, labeled "Camera," ○ An icon 432 for the online video module 155 labeled as 「Online Video」, ○ An icon 434 for the stock price widget 149-2 labeled as 「Stocks」, ○ An icon 436 for the map module 154 labeled as 「Maps」, ○ An icon 438 for the weather widget 149-1 labeled as 「Weather」, ○ An icon 440 for the alarm clock widget 149-4 labeled as 「Clock」, ○ An icon 442 for the training support module 142 labeled as 「Workout Suppor」, ○ An icon 444 for the memo module 153 labeled as 「Notes」, and ○ An icon 446 for the settings application or module that provides access to the settings related to the device 100 and its various applications 136.

[0174] Note that the labels of the icons shown in FIG. 4A are merely examples. For example, in some embodiments, the icon 422 for the video and music player module 152 is labeled as 「Music」 or 「Music Player」. Other labels are optionally used for the various application icons. In some embodiments, the label for each application icon includes the name of the application corresponding to the respective application icon. In some embodiments, the label of a particular application icon is separate from the name of the application corresponding to the particular application icon.

[0175] FIG. 4B shows an exemplary user interface on a device (e.g., device 300, FIG. 3) having a touch sensing surface 451 (e.g., tablet or touch pad 355, FIG. 3) separated from a display 450. Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 357) for detecting the intensity of a contact on touch sensing surface 451, and / or one or more haptic output generators 359 for generating a haptic output to a user of device 300.

[0176] Many of the following examples are given with reference to inputs on a touch screen display 112 (when the touch sensing surface and the display are combined), but in some embodiments, the device detects inputs on a touch sensing surface separated from the display, as shown in FIG. 4B. In some embodiments, the touch sensing surface (e.g., 451 in FIG. 4B) has a major axis (e.g., 452 in FIG. 4B) corresponding to a major axis (e.g., 453 in FIG. 4B) on the display (e.g., 450). According to those embodiments, the device detects contacts (e.g., 460 and 462 in FIG. 4B) with touch sensing surface 451 at positions (e.g., in FIG. 4B, 460 corresponds to 468 and 462 corresponds to 470) corresponding to respective positions on the display. Thus, when the touch sensing surface is separated from the display, user inputs (e.g., contacts 460 and 462 and their movement) detected by the device on the touch sensing surface (e.g., 451 in FIG. 4B) are used by the device to operate the user interface on a display (e.g., 450 in FIG. 4B) of the multifunctional device. It should be understood that a similar method is optionally used for other user interfaces described herein.

[0177] In addition, while the following examples are mainly given with reference to finger inputs (e.g., finger contact, finger tap gesture, finger swipe gesture, etc.), in some embodiments, one or more of those finger inputs may be replaced with inputs from another input device (e.g., mouse-based input or stylus input). For example, the swipe gesture may optionally be replaced with a mouse click (e.g., instead of contact), and then the cursor is moved along the path of the swipe (e.g., instead of the movement of the contact). As another example, the tap gesture may optionally be replaced with a mouse click while the cursor is positioned over the location of the tap gesture (e.g., instead of detecting contact and then ceasing to detect contact). Similarly, it should be understood that when multiple user inputs are detected simultaneously, multiple computer mice may optionally be used simultaneously, or a mouse and finger contact may optionally be used simultaneously.

[0178] As used herein, the term "focus selector" refers to an input element that indicates the current portion of the user interface with which the user is interacting. In some implementations that include a cursor or other location marker, the cursor functions as a "focus selector" such that when an input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 in FIG. 3, or touch-sensitive surface 451 in FIG. 4B) while the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations that include a touch screen display (e.g., touch-sensitive display system 112 in FIG. 1A, or touch screen in FIG. 4A) that enables direct interaction with user interface elements on the touch screen display, a contact detected on the touch screen functions as a "focus selector" such that when an input (e.g., a press input by the contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted according to the detected input. In some implementations, the focus is moved from one area of the user interface to another area of the user interface (e.g., by moving the focus from one button to another button using a tab key or arrow keys) without movement of a corresponding cursor or movement of the contact on the touch screen display. In those implementations, the focus selector moves in accordance with the movement of the focus between different areas of the user interface. Regardless of the specific form taken by the focus selector, the focus selector is generally a user interface element (or a contact on a touch screen display) that is controlled by the user to communicate the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface with which the user intends to interact).For example, the position of a focus selector (e.g., a cursor, a contact, or a selection box) over each button while a press input on a touch sensing surface (e.g., a touch pad or a touch screen) is detected indicates that the user intends to activate each button (as opposed to other user interface elements shown on the device's display).

[0179] As used in this specification and the claims, the term "intensity" of a contact on a touch-sensing surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact or a stylus contact) on the touch-sensing surface, or something that substitutes for the force or pressure of a contact on the touch-sensing surface (a proxy). The intensity of a contact has a range of values that includes at least four distinct values, and more typically, hundreds (e.g., at least 256) of individual values. The intensity of a contact is optionally determined (or, measured) using a variety of techniques, and a variety of sensors or combinations of sensors. For example, one or more force sensors under or adjacent to the touch-sensing surface are optionally used to measure the force at various points on the touch-sensing surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted average or sum) to determine the estimated force of the contact. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensing surface. Alternatively, the size and / or change in size of the contact area detected on the touch-sensing surface, the capacitance and / or change in capacitance of the touch-sensing surface in proximity to the contact, and / or the resistance and / or change in resistance of the touch-sensing surface in proximity to the contact are optionally used as a substitute for the force or pressure of a contact on the touch-sensing surface. In some implementations, the substitute measurement of the force or pressure of a contact is used directly to determine whether it exceeds an intensity threshold (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some implementations, the substitute measurement of the force or pressure of a contact is converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether it exceeds an intensity threshold (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of a contact as an attribute of a user input enables user access to additional device functionality that might otherwise not be easily possible for the user in a device of reduced size with a limited area for displaying affordances (e.g., on a touch-sensing display) and / or receiving user input (e.g., via a touch-sensing display, a touch-sensing surface, or a physical / mechanical control such as a knob or button).

[0180] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by the user (e.g., to determine whether the user has "clicked" on an icon). In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (e.g., the intensity thresholds are not determined by the activation thresholds of specific physical actuators and may be adjusted without changing the physical hardware of the device 100). For example, the mouse "click" threshold of a trackpad or touch screen display can be set to any of a wide range of default thresholds without changing the hardware of the trackpad or touch screen display. Further, in some implementations, the user of the device is provided with software settings for adjusting one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once by system-level click "intensity" parameters).

[0181] As used in this specification and the claims, the term "characteristic strength" of a contact refers to a characteristic of the contact based on one or more strengths of the contact. In some embodiments, the characteristic strength is based on a plurality of strength samples. The characteristic strength is optionally based on a predefined number of strength samples, or on a set of strength samples collected over a predefined time interval (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) for a predefined event (e.g., after detecting the contact, before detecting the lift-off of the contact, before or after detecting the start of movement of the contact, before detecting the end of the contact, before or after detecting an increase in the strength of the contact, and / or before or after detecting a decrease in the strength of the contact). The characteristic strength of the contact is optionally based on one or more of the maximum value of the strength of the contact, the mean value of the strength of the contact, the average value of the strength of the contact, the top 10% value of the strength of the contact, a value that is half of the maximum value of the strength of the contact, a value that is 90% of the maximum value of the strength of the contact, a value generated by low-pass filtering the strength of the contact over a predefined period, or at a predefined time. In some embodiments, the duration of the contact is used (e.g., when the characteristic strength is the average of the strength of the contact over time) in determining the characteristic strength. In some embodiments, the characteristic strength is compared to a set of one or more strength thresholds to determine whether the operation was performed by the user. For example, the set of one or more strength thresholds can include a first strength threshold and a second strength threshold. In this example, a first operation is performed as a result of a contact having a characteristic strength that does not exceed the first threshold, a second operation is performed as a result of a contact having a characteristic strength that exceeds the first threshold and does not exceed the second threshold, and a third operation is performed as a result of a contact having a characteristic strength that exceeds the second threshold. In some embodiments, the comparison between the characteristic strength and the one or more strength thresholds is used not to determine which of the first or second operations to perform, but to determine whether to perform one or more operations (e.g., to perform each option, or to refrain from performing each operation).

[0182] In some embodiments, it is identified for the purpose of determining a part of a gesture, characteristic intensity. For example, the touch sensing surface may receive a continuous swipe contact (e.g., a drag gesture) that transitions from a starting location to reach an ending location, and the intensity of the contact increases at this ending location. In this example, the characteristic intensity of the contact at the ending location may be based on only a part of that swipe contact (e.g., only the part at the ending location of the swipe contact), rather than the entire continuous swipe contact. In some embodiments, a smoothing algorithm may be applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm may optionally include one or more of a non - weighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some situations, these smoothing algorithms exclude small increases or decreases in the intensity of the swipe contact for the purpose of determining the characteristic intensity.

[0183] The figures of the user interface described herein optionally include charts of various intensities showing the current intensity of a contact on the touch sensing surface relative to one or more intensity thresholds (e.g., a contact detection intensity threshold IT 0 , a light press intensity threshold IT L , a deep press intensity threshold IT D (e.g., at least initially higher than IT L ), and / or one or more other intensity thresholds (e.g., an intensity threshold IT L lower than TI H ). This intensity chart is typically not part of the displayed user interface but is provided to assist in the interpretation of the figure. In some embodiments, the light press intensity threshold corresponds to the intensity at which the device performs an operation typically associated with clicking a button of a physical mouse or a trackpad. In some embodiments, the deep press intensity threshold corresponds to the intensity at which the device performs an operation different from the operation typically associated with clicking a button of a physical mouse or a trackpad. In some embodiments, below the light press intensity threshold (e.g., and below which the contact is no longer detected, a nominal contact detection intensity threshold IT0 When contact is detected at a characteristic intensity that exceeds (a certain level), the device moves the focus selector in accordance with the movement of the contact on the touch-sensing surface without performing an operation associated with a shallow press intensity threshold or a deep press intensity threshold. Generally, unless otherwise stated, those intensity thresholds are consistent across different sets of figures of the user interface.

[0184] In some embodiments, the device's response to an input detected by the device depends on criteria based on the contact intensity during the input. For example, for some "shallow press" inputs, a contact intensity exceeding a first intensity threshold during the input triggers a first response. In some embodiments, the device's response to an input detected by the device depends on criteria that include both the contact intensity and time-based criteria during the input. For example, for some "deep press" inputs, a contact intensity exceeding a second intensity threshold that is greater than the first intensity threshold for a shallow press during the input triggers a second response only if a delay time has elapsed between satisfying the first intensity threshold and satisfying the second intensity threshold. This delay time is typically less than 200 ms in duration (e.g., 40 ms, 100 ms, or 120 ms depending on the magnitude of the second intensity threshold, and the delay time increases as the second intensity threshold increases). This delay time helps to avoid accidental recognition of deep press inputs. As another example, for some "deep press" inputs, there is a period of reduced sensitivity that occurs after the time when the first intensity threshold is satisfied. During the period of reduced sensitivity, the second intensity threshold increases. This temporary increase in the second intensity threshold also helps to avoid accidental deep press inputs. For other deep press inputs, the response to the detection of a deep press input does not depend on time-based criteria.

[0185] In some embodiments, one or more of the input intensity threshold and / or the corresponding output vary based on one or more factors such as user settings, movement of contact, input timing, the application being executed, the rate at which the intensity is applied, the number of inputs occurring simultaneously, user history, environmental factors (e.g., ambient noise), the position of the focus selector, etc. Exemplary factors are described in U.S. Patent Application Nos. 14 / 399,606 and 14 / 624,296, which are hereby incorporated by reference in their entirety.

[0186] For example, FIG. 4C shows a dynamic intensity threshold 480 that varies over time based in part on the intensity of a touch input 476 over time. The dynamic intensity threshold 480 is the sum of two components, a first component 474 that decays over time after a predefined delay time p1 from when the touch input 476 is first detected, and a second component 478 that tracks the intensity of the touch input 476 over time. The initial high intensity threshold of the first component 474 reduces the chance of accidentally triggering a "deep press" response, while still allowing an immediate "deep press" response if the touch input 476 provides sufficient intensity. The second component 478 reduces the chance of accidentally triggering a "deep press" response due to gradual intensity variations in the touch input. In some embodiments, when the touch input 476 meets the dynamic intensity threshold 480 (e.g., at point 481 in FIG. 4C), a "deep press" response is triggered.

[0187] FIG. 4D shows another dynamic intensity threshold 486 (e.g., intensity threshold I D ). FIG. 4D also shows two other intensity thresholds, a first intensity threshold IT H and a second intensity threshold I L . In FIG. 4D, the touch input 484 meets the first intensity threshold IT H and the second intensity threshold IT L before time p2, but no response is provided until the delay time p2 has elapsed at time 482. Also, in FIG. 4D, the dynamic intensity threshold 486 is after a predefined delay time p1 has elapsed from time 482 (the second intensity threshold IT LThis type of dynamic intensity threshold decays over time, with the decay starting at time 488 when the response associated with the first intensity threshold I TH or the second intensity threshold I L Immediately after or simultaneously with triggering a response associated with a lower intensity threshold, such as TD and reducing the accidental triggering of related responses.

[0188] FIG. 4E illustrates yet another dynamic intensity threshold 492 (e.g., intensity threshold I D In FIG. 4E, the intensity threshold IT L The response associated with the intensity threshold I is triggered after a delay time p2 from when the touch input 490 is first detected. At the same time, the dynamic intensity threshold 492 decays after a predefined delay time p1 from when the touch input 490 is first detected. Thus, the intensity threshold I L A decrease in the intensity of touch input 490 followed by an increase in the intensity of touch input 490 after triggering a response associated with the intensity threshold I L Even when the intensity threshold IT D A response related to the

[0189] Shallow pressure intensity threshold IT L From an intensity below the shallow pressure intensity threshold IT L and deep pressure intensity threshold IT D An increase in the characteristic intensity of a contact to an intensity between is sometimes referred to as a "shallow press" input. D From intensity below the threshold IT D An increase in the characteristic intensity of a touch to an intensity above the touch-detection intensity threshold I 0 From the intensity below the contact detection intensity threshold IT 0 and shallow pressure intensity threshold IT L An increase in the characteristic intensity of a contact to an intensity between is sometimes referred to as detecting a contact on the touch surface. 0above the intensity up to the contact detection intensity threshold IT 0 A decrease in the characteristic intensity of contact to an intensity below 0 may sometimes be referred to as the detection of lift-off of the contact from the touch surface. In some embodiments, IT 0 is zero. In some embodiments, IT 0 is greater than zero. In some figures, shaded circles or ellipses are used to represent the intensity of contact on the touch sensing surface. In some figures, unshaded circles or ellipses are used to represent each contact on the touch sensing surface without specifying the intensity of each contact.

[0190] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes each pressing input, or in response to detecting each pressing input that is performed with each contact (or contacts), and each pressing input is detected based at least in part on detecting an increase in the intensity of a contact (or contacts) that exceeds a pressing input intensity threshold. In some embodiments, each operation is performed in response to detecting an increase in the intensity of each contact that exceeds a pressing input intensity threshold (e.g., each operation is performed on the "downstroke" of each pressing input). In some embodiments, the pressing input includes an increase in the intensity of each contact that exceeds a pressing input intensity threshold and a subsequent decrease in the intensity of the contact that is below the pressing input intensity threshold, and each operation is performed in response to detecting the subsequent decrease in the intensity of each contact that is below the pressing input threshold (e.g., each operation is performed on the "upstroke" of each pressing input).

[0191] In some embodiments, the device employs intensity hysteresis to avoid spurious inputs, sometimes referred to as "jitter", and the device defines or selects a hysteresis intensity threshold having a predefined relationship to the press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable ratio of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of each contact above the press input intensity threshold and a subsequent decrease in the intensity of the contact below the hysteresis intensity threshold corresponding to the press input intensity threshold, and each operation is performed in response to detecting the subsequent decrease in the intensity of each contact below the hysteresis intensity threshold (e.g., each operation is performed on the "upstroke" of each press input). Similarly, in some embodiments, a press input is detected only when the device detects an increase in the intensity of a contact from below the hysteresis intensity threshold to above the press input intensity threshold, and optionally, a subsequent decrease in the intensity of the contact to below the hysteresis intensity, and each operation is performed in response to detecting the press input (e.g., an increase in the intensity of the contact, or a decrease in the intensity of the contact, depending on the situation).

[0192] For ease of explanation, the description of operations performed in response to a pressing input associated with a pressing input strength threshold, or in response to a gesture including a pressing input, is optional and is triggered in response to detecting an increase in the intensity of contact above the pressing input strength threshold, an increase in the intensity of contact from an intensity below the hysteresis strength threshold to an intensity above the pressing input strength threshold, a decrease in the intensity of contact below the pressing input strength threshold, or a decrease in the intensity of contact below a hysteresis strength threshold corresponding to the pressing input strength threshold. Additionally, in embodiments described as performing an operation in response to detecting a decrease in the intensity of contact below the pressing input strength threshold, the operation is optional and is performed in response to detecting a decrease in the intensity of contact corresponding to and below a lower hysteresis strength threshold than the pressing input strength threshold. As described above, in some embodiments, the triggering of those responses also depends on criteria based on the time taken to be satisfied (e.g., the delay time elapsing between the first intensity threshold being satisfied and the second intensity threshold being satisfied). User Interface and Associated Processing

[0193] Attention is now paid to embodiments of a user interface ("UI") and associated processing that can be implemented on an electronic device such as a portable multifunctional device 100 or a device 300, comprising a display, a touch sensing surface, one or more haptic output generators for generating haptic output, one or more sensors for detecting the intensity of contact with a button of the device (e.g., a virtual or physical home button), and optionally one or more sensors for detecting the intensity of contact with the touch sensing surface.

[0194] Figures 5A1 - 5C19 illustrate exemplary user interfaces for providing haptic output and visual feedback in response to multiple types of input on a button (e.g., a physical home button or a virtual home button) of a device, according to some embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in Figures 7A - 7G, 9A - 9D, 11A - 11E, 13A - 13D, 15A - 15E, 17A - 17D, and 19A - 19C. For convenience of explanation, some embodiments are discussed with reference to operations performed on a device having a touch - sensing display system 112. In such embodiments, the focus selector is optionally one of each finger or stylus contact, a representative point corresponding to each finger or stylus contact (e.g., the centroid of each contact or a point associated with each contact), or the centroid of two or more contacts detected on the touch - sensing display system 112. However, similar operations are optionally performed on a device having a display 450 and another touch - sensing surface 451 in response to detecting a contact on the touch - sensing surface 451 while displaying the user interface shown in the figures on the display 450, together with the focus selector.

[0195] Figures 5A1 - 5A18 illustrate an exemplary user interface for providing tactile feedback and visual feedback for interaction with a button, according to some embodiments. Figures 5A1 - 5A18 show opening an application from the home screen and providing visual feedback and haptic output in response to multiple types of input on a home button (e.g., button 204).

[0196] Figure 5A1 illustrates a user interface 510 for a menu of an application (e.g., the primary page of a multi - page home screen) on a device 100, according to some embodiments. The user interface 510 includes elements similar to the user interface 400 described above with respect to Figure 4A, but for brevity, a comprehensive description of the elements of the user interface 510 is not provided here.

[0197] Figures 5A2 to 5A3 show an example of detecting an input on the Clock icon (e.g., a tap gesture by contact 502 in Figure 5A2) and displaying the user interface 512 (Figure 5A3) of the Clock application.

[0198] Figures 5A4 to 5A8 are examples of detecting a change in the intensity of a contact (e.g., contact 504) on the home button (e.g., button 204) and providing visual feedback regarding the activation of the home button according to the intensity (e.g., displaying the start of a transition back from the user interface 512 to the user interface 510). In Figure 5A4, since the intensity of contact 504-a has not yet reached the "hint" intensity threshold IT H no visual feedback is displayed. In Figures 5A5 to 5A7, as the intensity of contact 504 increases beyond the hint intensity threshold IT H the visual feedback changes dynamically according to the intensity of the contact. For example, as the intensity of the contact increases from Figure 5A5 to Figure 5A6, the transition from the user interface 512 to the user interface 510 (e.g., from the user interface 513-1 to the user interface 513-2) progresses, and as the intensity of the contact decreases from Figure 5A6 to 5A7, the transition from the user interface 512 to the user interface 510 reverses (e.g., from the user interface 513-2 to the user interface 513-1). Since the intensity of contact 504 does not increase beyond the light press intensity threshold IT L when the end of the input by contact 504 is detected, the user interface 512 of the Clock application is redisplayed on the display (Figure 5A8).

[0199] Figures 5A9 to 5A14 detect a change in the intensity of a contact (e.g., contact 508) on a home button (e.g., button 204) and provide visual feedback regarding the activation of the home button according to the intensity (e.g., display the start of a transition back from user interface 512 to user interface 510), and provide a haptic output in response to an input on the home button (e.g., button 204). In FIGS. 5A9 to 5A11, as the strength of the contact increases (e.g., from contact 508-a to contact 508-b, to contact 508-c), the transition from user interface 512 to user interface 510 (e.g., from user interface 513-1 to user interface 513-2, to user interface 513-3) progresses. In FIG. 5A11, when the intensity of contact 508-c increases to the "shallow press" intensity threshold IT L (e.g., a down click of button 204, or sometimes called a "press event"), device 100 provides a haptic output 503 (e.g., a mini-tap at 270 Hz with a gain of 0.5). In FIG. 5A13, when the intensity of contact 508-e decreases to the "shallow release" intensity threshold IT LR (e.g., an up click of button 204, or sometimes called a "release event"), device 100 provides a different haptic output such as haptic output 505 (e.g., a mini-tap at 270 Hz with a gain of 0.3). When the intensity of contact 508 increases to the shallow press intensity threshold IT L (e.g., FIG. 5A11), and after the end of the input by contact 508 is detected (e.g., by the release event in FIG. 5A13), the transition from user interface 512 to user interface 510 (e.g., from user interface 513-3 in FIG. 5A11 to user interface 513-4 in FIG. 5A12, to user interface 513-5 in FIG. 5A13, to user interface 510 in FIG. 5A14) continues to completion as shown in FIGS. 5A11 to 5A14. The haptic outputs shown in FIGS. 5A11 and 5A13 correspond to a first range of values of an intensity change metric (e.g., a "weak" intensity), as will be described below with respect to method 1500.

[0200] Figures 5A15-5A16 show an alternative sequence from Figure 5A12 if the pressing input by contact 508 does not lift off until the threshold time (e.g., long pressing time T LP ) has elapsed. In this case, the animated transition from user interface 512 to user interface 510 is interrupted (e.g., at user interface 513-6 in Figure 5A16), and user interface 515 (e.g., the auto assistant user interface) is displayed. In some embodiments, when the animated transition from user interface 512 to user interface 510 is interrupted, another animated transition (e.g., from the interruption point to user interface 515) is displayed as shown in user interface 514-1 of Figure 5A17. In some embodiments, as shown in Figure 5A16, if the intensity of contact 508-f is maintained above the shallow pressing intensity threshold IT LP during the threshold time (e.g., T L ), the device 100 provides a haptic output 507 (e.g., double micro tap 270 Hz or micro tap 270 Hz with a gain of 0.9). In some embodiments, as shown in Figure 5A18, when the transition to the auto assistant user interface (e.g., user interface 515 in Figure 5A18) is complete, the device 100 provides a haptic output 509 (e.g., double micro tap 270 Hz or micro tap 270 Hz with a gain of 0.9). In some embodiments, the device 100 either provides a haptic output (e.g., haptic output 507 in Figure 5A16) when the contact is held above the shallow pressing intensity threshold IT LP for the T L threshold time or provides a haptic output (e.g., haptic output 509 in Figure 5A18) when the auto assist user interface is complete, but not both.

[0201] In the examples of Figures 5A1-5A18, a pressing event (e.g., when the contact intensity increases up to the shallow pressing intensity threshold IT L ) and a releasing event (e.g., when the contact intensity is at the shallow press release intensity IT LRWhen it has decreased to), the haptic output for (for example, as will be described below with reference to FIGS. 5C1 to 5C9, when the second haptic output setting is selected) is shown as a 270 Hz mini-tap. In some embodiments, (for example, as will be described below with respect to FIGS. 5C13 to 5C19) when the first haptic output setting is selected, the haptic output in these examples can be a 230 Hz mini-tap. In some embodiments, (for example, as will be described below with respect to FIGS. 5C10 to 5C12) when the third haptic output setting is selected, the haptic output in these examples can be a 300 Hz mini-tap. Similarly, in FIGS. 5B1 to 5B75, the haptic outputs of the press event and the release event are shown as 270 Hz mini-taps (for example, when the second haptic output setting is selected), but when the first haptic output setting or the third haptic output setting is selected, the haptic outputs can be 230 Hz or 300 Hz mini-taps, respectively.

[0202] FIGS. 5B1 to 5B75 show an exemplary user interface for providing tactile and visual feedback for interaction with a button, according to some embodiments. FIGS. 5B1 to 5B75 show opening an application from a folder on the secondary page of a multi-page home screen and providing visual feedback and haptic output in response to multiple types of input on a home button (e.g., button 204).

[0203] FIG. 5B1 shows a user interface 520 for a menu of an application on device 100 (e.g., the secondary page of a multi-page home screen), according to some embodiments. User interface 520 includes elements similar to user interface 400 described above with respect to FIG. 4A, but for the sake of brevity, a comprehensive description of the elements of user interface 520 is not provided here.

[0204] FIGS. 5B2 to 5B3 show an example of detecting an input on a photo folder (e.g., a tap gesture by contact 530 in FIG. 5B2) and displaying a user interface 522 (FIG. 5B3) of the photo folder.

[0205] Figures 5B4 to 5B5 show an example of detecting an input (e.g., a tap gesture by contact 531 in FIG. 5B4) on a Pages icon of a user interface 522 for a word processor application (such as the Pages application by Apple Inc. in Cupertino, California) and displaying a user interface 524 of the Pages application (e.g., FIG. 5B5).

[0206] Figures 5B6 to 5B14 show an example of detecting temporally close double clicks (e.g., a first pressing event, followed by a first releasing event, and further followed by a second pressing event, where the first and second pressing events are detected within a threshold time amount relative to each other, such as a double click time threshold T DC ), and both the first and second pressing events occur before a threshold time amount such as an interrupt time threshold T I . Since both the first and second pressing events occur before the interrupt time threshold T I , an animation transition from a user interface 524 (e.g., the Pages application) to a user interface 522 (e.g., a photo folder) is interrupted at (e.g., at the first point where the second pressing event is detected, as shown in FIG. 5B10) the user interface 524 (e.g., the Pages application).

[0207] Figures 5B6 to 5B10 show the start of an animation transition from a user interface 524 (e.g., a page application) to a user interface 522 (e.g., a photo folder). In FIG. 5B6, when the intensity of contact 532 - a increases up to a shallow pressing intensity threshold IT L (e.g., the first down click of button 204, or sometimes referred to as the "first pressing event"), the device 100 provides a haptic output 571 (e.g., a mini - tap at a gain of 1, 270 Hz). In FIG. 5B8, when the intensity of contact 532 - c reaches a shallow pressing release intensity threshold IT LRWhen it decreases until (for example, the first up click of button 204, or what may also be called the "first release event"), device 100 provides a different haptic output such as haptic output 572 (for example, a mini - tap at 270 Hz with a gain of 0.5). In FIG. 5B10, while the intensity of contact 532 - e is within the second time within double - click time threshold T DC and below the shallow press intensity threshold IT on the home button L When it increases until (for example, the second down click of button 204, or what may also be called the "second press event"), device 100 provides another haptic output such as haptic output 573 (for example, a mini - tap at 270 Hz with a gain of 0.8). The haptic outputs shown in FIGS. 5B6, 5B8, and 5B10 correspond to a second range of values of the intensity change metric (for example, "normal" intensity) as described below with respect to method 1500.

[0208] In FIG. 5B10, when a second press event is detected, the animation transition from user interface 524 (for example, the Pages application) to user interface 522 (for example, the photo folder) is interrupted at a first point (for example, at user interface 525 - 5), and the animation transition to user interface 528 (for example, the multi - task user interface) starts from the interruption point. FIGS. 5B11 - 5B13 show the animation transitions from the interruption point to user interface 528 (for example, from user interface 526 - 1 in FIG. 5B11 to user interface 526 - 2 in FIG. 5B12, to user interface 526 - 3 in FIG. 5B13). FIG. 5B14 shows user interface 528 (for example, the multi - tasking user interface) with the Pages app (for example, user interface 524) on top.

[0209] Figures 5B15 - 5B16 show an example of detecting an input (e.g., a pressing input by contact 533 in Figure 5B15) on a home button (e.g., button 204) and displaying a user interface 524 of a Pages application (Figure 5B16). Figure 5B16 shows the same starting point as Figure 5B5. The haptic output shown in Figure 5B15 corresponds to a first range of values of an intensity change metric (e.g., "weak" intensity) as described below with respect to method 1500.

[0210] Figures 5B17 - 5B25 show an alternative sequence of Figures 5B6 - 5B14 starting from the user interface 524 of the Pages application shown in Figure 5B5. Figures 5B17 - 5B25 further show (compared to Figures 5B5 - 5B14) a double - click that is temporally separated (e.g., a first pressing event, followed by a first releasing event, and further followed by a second pressing event, where the first and second pressing events are detected within a threshold time amount of each other, such as a double - click time threshold T DC etc.). Both the first and second pressing events occur before a threshold time amount such as an interrupt time threshold T I etc. Since both the first and second pressing events occur before the interrupt time threshold T I the animated transition from the user interface 524 (e.g., the Pages application) to the user interface 522 (e.g., the photo folder) is interrupted (e.g., at the second point where the second pressing event is detected, as shown in Figure 5B21).

[0211] Figures 5B17 - 5B21 show the start of an animated transition from the user interface 524 (e.g., the page application) to the user interface 522 (e.g., the photo folder). In Figure 5B17, when the intensity of contact 534 - a increases up to a shallow pressing intensity threshold IT L (e.g., the first down - click of button 204, or the "first pressing event"), the device 100 provides a haptic output 575 (e.g., a mini - tap at 270 Hz with gain 1). In Figure 5B19, when the intensity of contact 534 - c reaches a shallow release intensity threshold ITLR When decreasing until (for example, the first up click of button 204, or "the first release event"), device 100 provides different haptic outputs such as haptic output 576 (for example, mini - tap 270 Hz with a gain of 0.5). In FIG. 5B21, the intensity of contact 534 - e on the home button is within the double - click time threshold T DC During the second time within (for example, the second down click of button 204, or the second press event), device 100 provides another haptic output such as haptic output 577 (for example, mini - tap 270 Hz with a gain of 0.8). The haptic outputs shown in FIGS. 5B17, 5B19, and 5B21 correspond to a second range of values of the intensity change metric (for example, "normal" intensity) as described below with respect to method 1500.

[0212] In FIG. 5B21, when a second press event is detected, the animation transition from user interface 524 (for example, Pages application) to user interface 522 (for example, photo folder) interrupts at a second point (for example, at user interface 525 - 6) that is slower than the first point (for example, at user interface 525 - 5 in FIG. 5B10), and the animation transition to user interface 528 (for example, multitasking user interface) starts from the second interruption point. FIGS. 5B22 - 5B24 show the animation transitions from the second interruption point to user interface 528 (for example, from user interface 527 - 1 in FIG. 5B22, to user interface 527 - 2 in FIG. 5B23, to user interface 527 - 3 in FIG. 5B24). FIG. 5B25 shows user interface 528 (for example, multitasking user interface) with the Pages application (for example, user interface 524) on top.

[0213] Figures 5B26 - 5B27 show an example of detecting an input (e.g., a pressing input by contact 535 in Figure 5B26) on a home button (e.g., button 204) and displaying a user interface 524 of a Pages application (Figure 5B27). Figure 5B27 shows the same starting point as Figure 5B5. The haptic output shown in Figure 5B26 corresponds to a first range of values of an intensity change metric (e.g., "weak" intensity) as described below with respect to method 1500.

[0214] Figures 5B28 - 5B38 show alternative sequences of Figures 5B6 - 5B14, 5B17 - 5B25 starting from the user interface 524 of the page application shown in Figure 5B5. Figures 5B28 - 5B38 further show an example of detecting a double - click that is more temporally distant (compared to Figures 5B5 - 5B14 and 5B16 - 5B25) (e.g., a first pressing event, followed by a first releasing event, followed by a second pressing event, where the first and second pressing events are detected within a threshold time amount of each other, such as a double - click time threshold T DC etc.), the first pressing event occurs before a threshold time amount such as an interrupt time threshold T I etc., and the second pressing event occurs after the interrupt time threshold T I etc. Since the second pressing event occurs after the interrupt time threshold T I etc., the animated transition from the user interface 524 (e.g., Pages application) to the user interface 522 (e.g., photo folder) does not interrupt before the animated transition to a multitasking user interface (e.g., user interface 529, Figure 5B38).

[0215] Figures 5B28 - 5B34 show an animated transition from the user interface 524 (e.g., page application) to the user interface 522 (e.g., photo folder). In Figure 5B28, the intensity of contact 536 - a is at a shallow pressing intensity threshold IT on the home button LWhen increasing until (for example, the first down click of button 204, or the first press event), device 100 provides a haptic output 579 (for example, a mini - tap at a gain of 1, 270 Hz). In FIG. 5B30, the intensity of contact 536 - c is the shallow press - release intensity threshold IT LR When decreasing until (for example, the first up click of button 204, or the first release event), device 100 provides a different haptic output such as haptic output 580 (for example, a mini - tap at a gain of 0.5, 270 Hz). In FIG. 5B32, the intensity of contact 536 - e is the double - click time threshold T DC During the second time within, the shallow press intensity threshold IT on the home button L When increasing until (for example, the second down click of button 204, or the second press event), device 100 provides another haptic output such as haptic output 581 (for example, a mini - tap at a gain of 0.8, 270 Hz). The haptic outputs shown in FIGS. 5B28, 5B30, and 5B32 correspond to a second range of values of the intensity change metric (for example, "normal" intensity) as described below with respect to method 1500.

[0216] In FIG. 5B32, when the second press event is detected, since the second press event occurs after the interrupt time threshold T I the animation transition from user interface 524 (for example, the Pages application) to user interface 522 (for example, the photo folder) is not interrupted. FIGS. 5B33 - 5B34 show the continuation of the animation transition from user interface 524 (for example, the Pages application) to user interface 522 (for example, the photo folder), and FIG. 5B35 shows user interface 522. FIGS. 5B36 - 5B37 show the animation transition from user interface 522 (for example, the photo folder) to user interface 529. FIG. 5B38 shows user interface 529 (for example, the multitasking user interface) with the photo folder (for example, user interface 522) at the top.

[0217] Figures 5B40 to 5B48 are alternative sequences of Figures 5B6 to 5B14, Figures 5B17 to 5B25, and Figures 5B28 to 5B38 starting from the user interface 524 of the page application shown in Figure 5B5. Figures 5B40 to 5B48 are for the double - click time threshold T dc This is an example of detecting two single - clicks when a second press event occurs after the double - click time threshold T DC has elapsed. Since the second press event occurs after the double - click time threshold T

[0218] Figures 5B40 to 5B46 show an animated transition from the user interface 524 (e.g., Pages application) to the user interface 522 (e.g., photo folder). In Figure 5B40, when the intensity of contact 537 - a increases up to the shallow - press intensity threshold IT L (e.g., the down - click of button 204, or the first press event), the device 100 provides a haptic output 582 (e.g., a mini - tap at a gain of 1, 270 Hz). In Figure 5B42, when the intensity of contact 537 - c decreases down to the shallow - release intensity threshold IT LR (e.g., the up - click of button 204, or the first release event), the device 100 provides a different haptic output such as haptic output 583 (e.g., a mini - tap at a gain of 0.5, 270 Hz). In Figure 5B45, when the intensity of contact 538 - a reaches the shallow - press intensity threshold IT DC on the home button after the double - click time threshold T LWhen increasing up to (for example, a down click of button 204, or a second pressing event), device 100 provides a haptic output 584 (for example, a mini - tap at 270 Hz with gain 1). In some embodiments, since both haptic outputs 584 (FIG. 5B45) are down clicks of a single - click input, they have the same characteristics (for example, a mini - tap at 270 Hz with gain 1) as haptic output 582 (FIG. 5B50). The haptic outputs shown in FIGS. 5B40, 5B42, and 5B45 correspond to a second range of values of the intensity change metric (for example, “normal” intensity) as described below with respect to method 1500.

[0219] In FIG. 5B45, when a second pressing event is detected, since the second pressing event is a separate single - click, the animated transition from user interface 524 (for example, Pages application) to user interface 522 (for example, photo folder) is not interrupted. FIG. 5B46 shows the continuation of the animated transition from user interface 524 (for example, Pages application) to user interface 522 (for example, photo folder), and FIG. 5B47 shows user interface 522. Although not shown, in some embodiments, device 100 displays an animated transition from user interface 522 (FIG. 5B47) to user interface 520 (FIG. 5B48).

[0220] FIG. 5B49 shows a comparison of alternative sequences from user interface 524 (for example, Pages application) as detailed above. The top row of FIG. 5B49 shows a double - click that is close in time, with both the first and second pressing events occurring before T I the sequence of FIGS. 5B5 - 5B14. The second row of FIG. 5B49 shows a double - click where the first and second pressing events are more separated in time, but both the first and second pressing events occur before T I the sequence of FIGS. 5B16 - 5B25. The third row of FIG. 5B49 shows a double - click where the first and second pressing events are more separated in time, and the first pressing event is TI occurs before, and the second pressing event occurs after T I and shows the sequence of FIGS. 5B27-5B38. The fourth row of FIG. 5B49 has two single clicks, the first pressing event occurs before T I and the second pressing event occurs after T DC and shows the sequence of FIGS. 5B39-5B48.

[0221] FIGS. 5B50-5B59 show yet another alternative sequence of FIGS. 5B5-5B15. In FIGS. 5B50-5B59, the animated transition from user interface 524 (e.g., Pages application) to user interface 522 (e.g., photo folder) does not start until after the first release event (e.g., FIG. 5B53). Although not shown, in some embodiments, the sequences of FIGS. 5B16-5B25, FIGS. 5B27-5B38, and / or FIGS. 5B39-5B48 have alternative sequences (e.g., FIGS. 5B19, 5B30, 5B42, respectively) in which the animated transition from user interface 524 (e.g., Pages application) to user interface 522 (e.g., photo folder) does not start until after the first release event.

[0222] FIGS. 5B60-5B61 show an example of detecting an input (e.g., a pressing input by contact 540 in FIG. 5B60) on the home button (e.g., button 204) and displaying the user interface 524 of the Pages application (FIG. 5B61). The haptic output shown in FIG. 5B60 corresponds to a first range (e.g., "weak" intensity) of values of the intensity change metric, as described below with respect to method 1500.

[0223] FIGS. 5B62-5B65 show a "weak" intensity down click and a "weak" intensity up click. In FIG. 5B63, due to the "weak" intensity, the intensity of contact 541-b is below the shallow press intensity threshold IT on the home button LWhen it increases up to (for example, for a range of intensity change metric values up to a predetermined unit of intensity per second such as 1250 grams per second), the device 100 provides a haptic output 590 (for example, a mini - tap at 270 Hz with a gain of 0.5). In FIG. 5B65, due to the "weak" intensity, the intensity of contact 541 - d is the shallow press - release intensity threshold IT LR When it decreases up to (for example, for a range of intensity change metric values up to a predetermined unit of intensity per second such as 1250 grams per second), the device 100 provides a haptic output 591 (for example, a mini - tap at 270 Hz with a gain of 0.25). In some embodiments, the haptic output of a "weak" up - click event is 50% of the haptic output of a "weak" down - click event. In some embodiments, the audio output of a "weak" up - click event is 50% of the audio output of a "weak" down - click event.

[0224] FIGS. 5B66 - 5B69 show "normal" intensity down - clicks and "normal" intensity up - clicks. In FIG. 5B66, due to the "normal" intensity, the intensity of contact 542 - b is the shallow press intensity threshold IT on the home button L When it increases up to (for example, for a range of intensity change metric values greater than a predetermined unit of intensity per second such as 1250 grams per second), the device 100 provides a haptic output 592 (for example, a mini - tap at 270 Hz with a gain of 1). In FIG. 5B69, due to the "normal" intensity, the intensity of contact 542 - d is the shallow press - release intensity threshold IT LR When it decreases up to (for example, for a range of intensity change metric values greater than a predetermined unit of intensity per second such as 1250 grams per second), the device 100 provides a haptic output 593 (for example, a mini - tap at 270 Hz with a gain of 0.5). In some embodiments, the haptic output of a "normal" up - click event is 50% of the haptic output of a "normal" down - click event. In some embodiments, the audio output of a "normal" up - click event is 50% of the audio output of a "normal" down - click event.

[0225] Figures 5B70 to 5B75 show an example of using the home button (e.g., button 204) as the "back" button. Figures 5B71 to 5B72 show an example of detecting an input (e.g., a pressing input by contact 543 in Figure 5B71) on the home button (e.g., button 204) while the user interface 522 (e.g., a photo folder) is being displayed, and in response, displaying the user interface 520 (e.g., the secondary page of a multi-page home screen having a photo folder). Figures 5B73 to 5B74 show an example of detecting an input (e.g., a pressing input by contact 544 in Figure 5B73) on the home button (e.g., button 204) while the user interface 520 (e.g., the secondary page of a multi-page home screen) is being displayed, and in response, displaying the user interface 510 (e.g., the primary page of a multi-page home screen). In some embodiments, as shown in Figure 5B75, when an input (e.g., a pressing input by contact 545) on the home button is detected while the primary page of the multi-page home screen (e.g., the user interface 510) is being displayed, the device 100 provides a haptic output 596 (e.g., a mini-tap at 270 Hz with a gain of 1), but the displayed user interface is not changed.

[0226] Figures 5C1 to 5C19 show exemplary user interfaces for a home button configuration process according to some embodiments. Figures 5C1 to 5C19 show examples of the home button configuration process while the user selects and tries multiple haptic output settings for the home button before selecting a haptic output setting for the home button on the device.

[0227] Figures 5C1 - 5C5 show an example of selecting "Settings", then "General", and then "Home Button". Figures 5C6 - 5C7 show an example of an animated transition to the user interface 564 (e.g., the home button configuration user interface where option 2 is selected). In Figure 5C8, the haptic output setting is currently selected as option 2. In some embodiments, option 2 is selected as the default haptic output setting. In some embodiments, option 2 corresponds to a second haptic output pattern such as a mini - tap at 270 Hz. In Figure 5C9, when the intensity of the contact 553 on the home button increases to the light press intensity threshold IT L up to, the device 100 provides a haptic output 561 (e.g., a mini - tap at 270 Hz) corresponding to the selected haptic output setting (e.g., option 2).

[0228] Figures 5C10 - 5C11 show an example of selecting option 3 (e.g., by a press input due to contact 554 on option 3, in Figure 5C10) and displaying the user interface 566 (e.g., the home button configuration user interface where option 3 is selected). Although not shown, in some embodiments, when option 2 returns to its original position and option 3 moves towards the home button (e.g., button 204), an animated transition is displayed between the user interface 564 (Figure 5C10) and the user interface 566 (Figure 5C11).

[0229] In Figure 5C11, the haptic output setting is currently selected as option 3. In some embodiments, option 3 corresponds to a third haptic output pattern such as a mini - tap at 300 Hz. In Figure 5C12, when the intensity of the contact 555 on the home button increases to the light press intensity threshold IT L up to, the device 100 provides a haptic output 565 (e.g., a mini - tap at 300 Hz) corresponding to the selected haptic output setting (e.g., option 3).

[0230] Figures 5C13 - 5C14 show an example where Option 1 is selected (e.g., by a pressing input through contact 556 on Option 1, Figure 5C13), and the user interface 568 (e.g., a home button configuration user interface where Option 1 is selected) is displayed. Although not shown, in some embodiments, when Option 3 returns to its original position and Option 1 moves towards the home button (e.g., button 204), an animated transition is displayed between the user interface 566 (Figure 5C13) and the user interface 568 (Figure 5C14).

[0231] In Figure 5C14, Option 1 is currently selected as the haptic output setting. In some embodiments, Option 1 corresponds to a first haptic output pattern such as a mini - tap at 230 Hz. In Figure 5C15, when the intensity of the contact 557 on the home button (e.g., button 204) increases up to the light - press intensity threshold IT L the device 100 provides a haptic output 567 (e.g., a mini - tap at 230 Hz) corresponding to the selected haptic output setting (e.g., Option 1).

[0232] Figures 5C16 - 5C17 show an example where "Done" is selected together with Option 1 (e.g., using a pressing input through contact 558 on the "Done" icon, Figure 5C16), and in response, the user interface 562 (e.g., the General Settings user interface, Figure 5C17) is displayed.

[0233] In Figure 5C18, when the intensity of the contact 559 on the home button (e.g., button 204) reaches the light - press intensity threshold IT LWhen it increases up to, the device 100 provides a haptic output 569 (e.g., mini - tap 230Hz) corresponding to the selected haptic output setting (e.g., option 1). In response to an input on the home button (e.g., button 204), a user interface 510 (e.g., the primary page of the multi - page home screen) is displayed (Figure 5C19). Figures 5A1 - 5A18 and 5B1 - 5B75 show haptic output settings for option 2, so it should be noted that the haptic output in these figures corresponds to the selected haptic output setting for option 2 (e.g., mini - tap 270Hz). When the user selects option 1 for the haptic output setting (as shown in Figure 5C16, for example), the haptic output in Figures 5A1 - 5A18 and 5B1 - 5B75 corresponds to the selected haptic output setting for option 1 (e.g., mini - tap 230Hz). Similarly, when the user selects option 3 for the haptic output setting, the haptic output in Figures 5A1 - 5A18 and 5B1 - 5B75 will correspond to the selected haptic output setting for option 3 (e.g., mini - tap 300Hz).

[0234] Figures 6A1 - 6B26 show an exemplary user interface for controlling the generation of user - interface haptic feedback and home - button haptic feedback according to some embodiments. The user interfaces in those figures are used to illustrate the processes described below, including the processes in Figures 13A - 13D. Some of the following examples are described with reference to inputs on a touch - screen display (combining a touch - sensing surface and a display), but in some embodiments, the device detects inputs on a touch - sensing surface 451 separate from the display 450, as shown in Figure 4B.

[0235] In some embodiments, the device provides a haptic output control setting (e.g., sound and haptic settings) that allows the user to turn on and off the generation of user - interface haptic output in the device.

[0236] Generally, a device generates various types of user interface haptic outputs in response to direct interaction with user interface elements, such as selection, manipulation, drag / drop, and / or activation of a user interface element via a focus selector (e.g., a pointer or a contact) positioned proximate to the user interface element when a user input is detected. The haptic output of the user interface generally involves a visual change in the user interface. For example, in some embodiments, the device provides a haptic output (e.g., a microtap (150 Hz)) in response to an input that picks up an item within the user interface (e.g., a long-press input by a sustained contact at a location corresponding to the item), the user interface shows an object lifting up towards the surface of the display, and the haptic output is timed to coincide with the end of the movement of the object. In addition to the user interface haptic output, the device also generates a haptic output in response to activation of a persistent button (e.g., a virtual home button or a non-mechanical home or back button) on the device. Activation of the button may or may not involve a corresponding visual change in the user interface. For example, in response to a press input on the home button, the device generates a haptic output, discards the currently displayed user interface, and displays the home screen. In response to another press input on the home button, the device generates a haptic output for the button press but continues to display the home screen (e.g., if the currently displayed home screen is the only home screen or the primary page of a multi-page home screen). Thus, in some contexts, it is possible for the user to turn off the user interface haptic output, e.g., to conserve power or reduce distrust. However, if the user only wants to turn off the user interface haptic output, it is prevented that the user accidentally turns off haptic output generation for the persistent button.

[0237] In some embodiments, the device provides non-visual feedback that includes both an audio output component and a haptic output component. One type of audio output either pairs with a visual change in the user interface or exists independently of visual changes in the user interface. For example, an audio alert, an incoming call tone, a music clip can be played without relying on haptic output and can function to alert the user of a change in a part of the user interface or the state of the device. In some embodiments, the device generates a specific audio output that is specifically associated with and enhances or supplements the haptic output. These types of audio outputs are herein referred to as "tactile audio outputs". In some embodiments, the non-visual feedback profile includes a haptic output pattern for the haptic output and an audio output pattern for the tactile audio output that evokes a certain tactile sensation in the user in association with the haptic output. The interaction between the frequency, amplitude, waveform, and / or timing of the tactile audio output and the corresponding haptic output generates a richer and more subtle tactile sensation for the user and makes the non-visual feedback more prominently felt by the user. In some situations, the device allows the user to control the generation of tactile audio outputs (e.g., tactile audio outputs corresponding to user interface haptic outputs and / or device / system haptic outputs (e.g., home button haptic outputs)) using general volume control and / or mute control, for example to conserve power and / or reduce distrust. However, the device also prevents the user from accidentally turning off the tactile audio for device / system haptic outputs (e.g., the audio associated with the haptic output for the activation of a persistent button).

[0238] Figures 6A1 - 6A26 show the generation of haptic output when the haptic output of the user interface is turned on on the device. Figures 6A1 - 6A26 show that when the user interface haptic output is turned on on the device, the device generates both the user interface haptic output and the system haptic output (e.g., haptic output for activating hardware or persistent buttons on the device). Figures 6B1 - 6B26 show that when the haptic output of the user interface is turned off on the device, the device generates the system haptic output (e.g., haptic output for activating hardware or persistent buttons on the device), but stops generating at least a portion of the user interface haptic output.

[0239] As shown in Figure 6A1, a control user interface (e.g., sound and tactile control user interface 680) includes several toggle settings for controlling sound and tactile output in the device. For example, the vibration of the ring setting 670 is set to "OFF" via the toggle control 671. The vibration in the silent setting 672 is set to "off" via the toggle control 673, and the user interface haptic output setting 674 is set to "on" via the toggle control 675. The sound and tactile control interface 680 further includes a volume controller 676 for setting the current volume for the ringer and alert sound output (e.g., by moving the volume indicator 677 along the volume controller 676). Further, changes by the button setting 678 are set to "OFF" via the toggle control 679.

[0240] While the user interface haptic output is turned on via the toggle control 675 in the device 100, the user interface tactile output and the system tactile output are generated. In FIGS. 6A2 - 6A4, an input by contact (e.g., contact 604) is detected on the touch screen 112 at a location corresponding to an application launch icon (e.g., icon 606 for launching the Mail application) on the home screen user interface (e.g., home screen 602). As shown in FIGS. 6A3 - 6A4, when the characteristic intensity of the contact 604 increases beyond the shallow pressure intensity threshold IT L the home screen 602 (excluding the icon 606) blurs (as shown by the intensity meter 610 in FIG. 6A4), and a menu (e.g., quick action menu 608) is presented on the blurred home screen 602 (as shown in FIG. 6A4). In addition, as shown in FIG. 6A4, in response to detecting an increase in the characteristic intensity of the contact 604 beyond the shallow pressure intensity threshold IT L the device 100 presents the quick action menu 608 and generates a haptic output 612 (e.g., a micro - tap (200 Hz) with a gain of 1.0).

[0241] FIGS. 6A5 - 6A8 show that while the contact 604 is maintained on the touch screen 112, the device detects the movement of the contact 604 from the location corresponding to the application launch icon 606 to the respective locations corresponding to the menu options 614, 616, 618, and 620. When the contact 604 moves to the location corresponding to each menu option 614, 616, 618, and 620, the device 100 generates respective haptic outputs (e.g., haptic outputs 622, 624, 628, and 630) (e.g., a micro - tap (270 Hz) with a gain of 0.4 and a minimum interval: 0.05 seconds) to indicate that the contact 604 has moved to a different menu option.

[0242] Figures 6A8 - 6A9 show that when contact 604 exceeds menu option 620, lift-off of contact 604 is detected. In response to the detection of lift-off of contact 604, device 100 launches the Mail application and displays a user interface of the Mail application corresponding to menu option 620 (e.g., email list user interface 622) as shown in Figure 6A10.

[0243] In Figures 6A11 - 6A13, at a location corresponding to an email item (e.g., item 626) within the list of email items, an input by another contact (e.g., contact 624) on touch screen 112 is detected. As shown in Figures 6A11 - 6A13, when the characteristic intensity of contact 624 increases beyond a shallow press intensity threshold IT L (as indicated by intensity meter 610 in Figure 6A13), the email list user interface 622 (excluding item 626) blurs, and a preview of item 626 (e.g., preview 628) is presented on the blurred email list user interface 622 (as shown in Figure 6A13). Additionally, as shown in Figure 6A13, in response to detecting an increase in the characteristic intensity of contact 624 beyond the shallow press intensity threshold IT L of contact 624, device 100 presents review 628 and generates a haptic output 630 (e.g., a micro tap (200 Hz) with a gain of 1.0).

[0244] Figures 6A13 - 6A16 show that while contact 624 is maintained on touch screen 112, the device detects a leftward movement from the pressing location of contact 624. Due to the leftward movement of contact 624, preview 628 is dragged towards the left side of touch screen 112. While preview 628 is being dragged towards the left side of touch screen 112, hidden menu option 632 (e.g., "Archive") gradually becomes visible from behind preview 628. In Figure 6A16, when contact 624 moves across a threshold position (e.g., a threshold position hidden to the left of the center line of touch screen 112) within the user interface for triggering an operation related to hidden menu option 632 (e.g., archiving an email item and deleting it from the email list), device 100 changes the color of menu option 632 to indicate that the threshold for triggering the archive operation has been met by the movement of preview 628. Further, device 100 generates a haptic output 634 (e.g., a micro - tap (270 Hz) with a gain of 1.0) along with a visual change in the user interface to indicate that the threshold for triggering the archive operation has been met by the movement of preview 628.

[0245] Figures 6A17 - 6A19 show that after contact 624 has crossed the threshold position (or dragged through preview 628) to trigger an archive operation, a lift - off of contact 624 is detected. In response to the detection of the lift - off of contact 624, device 100 performs an archive operation on the email corresponding to item 626, and item 626 is removed from the list of email items as shown in Figure 6A19.

[0246] In Figures 6A20 - 6A22, an input by another contact (e.g., contact 636) on touch screen 112 is detected at a location corresponding to another email item (e.g., item 638) within the list of email items. As shown in Figures 6A20 - 6A22, the characteristic intensity of contact 636 is below a light - press intensity threshold IT LWhen it increases above (as indicated by the intensity meter 610 in FIG. 6A22), the email list user interface 622 (excluding item 638) blurs, and a preview of item 638 (e.g., preview 640) is presented on the blurred email list user interface 622 (as shown in FIG. 6A22). Additionally, as shown in FIG. 6A22, in response to detecting an increase in the characteristic intensity of contact 636 above the shallow pressing intensity threshold IT of the contact 636 that exceeds (as indicated by the intensity meter 610 in FIG. 6A22), the email list user interface 622 (excluding item 638) blurs, and a preview of item 638 (e.g., preview 640) is presented on the blurred email list user interface 622 (as shown in FIG. 6A22). In addition, as shown in FIG. 6A22, in response to detecting an increase in the characteristic intensity of contact 636 above the shallow pressing intensity threshold IT of the contact 636 that exceeds (as indicated by the intensity meter 610 in FIG. 6A22), the device 100 presents the preview 640 and generates a haptic output 642 (e.g., a micro tap (200 Hz) with a gain of 1.0). L In response to detecting an increase above the shallow pressing intensity threshold IT of the contact 636 that exceeds (as indicated by the intensity meter 610 in FIG. 6A22), the device 100 presents the preview 640 and generates a haptic output 642 (e.g., a micro tap (200 Hz) with a gain of 1.0).

[0247] FIG. 6A23 shows detecting an increase in the characteristic intensity of contact 636 above a deep pressing intensity threshold IT while contact 636 is maintained on the touch screen 112 (e.g., on preview 640). In response to detecting an increase in the characteristic intensity of contact 636 above a deep pressing intensity threshold IT while contact 636 is maintained on the touch screen 112 (e.g., on preview 640), the device 100 stops displaying the preview 640 and, instead of the blurred email list user interface, displays a content display user interface 644 (e.g., a user interface that displays the content of email item 638). Further, the device 100 generates a haptic output 646 (e.g., a full tap (150 Hz), gain: 1.0) along with the display of the user interface 644. D FIG. 6A23 shows detecting an increase in the characteristic intensity of contact 636 above a deep pressing intensity threshold IT while contact 636 is maintained on the touch screen 112 (e.g., on preview 640). The device 100 stops displaying the preview 640 in response to detecting an increase in the characteristic intensity of contact 636 above a deep pressing intensity threshold IT, and instead of the blurred email list user interface, displays a content display user interface 644 (e.g., a user interface that displays the content of email item 638). Further, the device 100 generates a haptic output 646 (e.g., a full tap (150 Hz), gain: 1.0) along with the display of the user interface 644.

[0248] In FIG. 6A24, a lift-off of contact 636 is detected, and after the lift-off of contact 636 is detected, the user interface 644 is maintained.

[0249] FIG. 6A25 shows that while the user interface 644 is displayed on the touch screen 112, a pressing input by contact (e.g., contact 646) is detected on the home button 650 of the device 100. The device 100, in response to the pressing input (e.g., a shallow pressing intensity threshold IT LIn response to detecting an increase in the characteristic strength of contact 646 (above), a tactile output 648 (e.g., a mini - tap (230 Hz) with a gain of 1.0) is generated, indicating that the home button 650 is activated by a pressing input. FIG. 6A26 shows that in response to the activation of the home button 650 by a pressing input, the user interface 644 is discarded and the home screen 602 is displayed on the touch screen 112 instead of the user interface 644.

[0250] FIGS. 6B1 - 6B26 show the generation of tactile output when the user interface tactile output is turned off in the device. In particular, FIGS. 6B1 - 6B26 show that when the tactile output of the user interface is turned off in the device, the device continues to generate system tactile output (e.g., tactile output for activating hardware or persistent buttons on the device), but stops generating the tactile output of a specific user interface, except when the generation of the tactile output of the user interface is excluded from the control by the user's tactile output settings.

[0251] As shown in FIG. 6B1, the user interface tactile output setting 674 is set to "off" via the toggle control 675 in the audio and tactile control interface 680.

[0252] While the user interface tactile output is turned off via the toggle control 675 in the device 100, at least some of the user interface tactile outputs are no longer generated. In FIGS. 6B2 - 6B4, an input by contact (e.g., contact 605) is detected on the touch screen 112 at a location corresponding to the icon 606 for launching the Mail application on the home screen 602. As shown in FIGS. 6B3 - 6B4, the characteristic strength of contact 605 is a shallow pressing strength threshold IT LWhen it increases beyond (as shown by the intensity meter 610 in FIG. 6B4), the home screen 602 (excluding the icon 606) blurs, and the quick action menu 608 is presented on the blurred home screen 602 (as shown in FIG. 6B4). Additionally, as shown in FIG. 6B4, the device 100 presents the quick action menu 608 and generates a haptic output 613 (e.g., a micro tap (200 Hz) with a gain of 1.0) in response to detecting an increase beyond the shallow press intensity threshold IT of the characteristic intensity of the contact 605 L In response to detecting an increase beyond L , the quick action menu 608 is presented and a haptic output 613 (e.g., a micro tap (200 Hz) with a gain of 1.0) is generated. In this example, even if the haptic output 613 is a user interface haptic output, the haptic output for presenting the quick action menu in response to a press input is exempt from the control of the user interface haptic output settings. In other words, in some embodiments, the haptic output (e.g., a micro tap (200 Hz) with a gain of 1.0) associated with presenting the quick action menu in response to a press input on the application launch icon is always generated regardless of the current haptic output settings for the user interface haptic output.

[0253] Figures 6B5-6B8 show that while contact 605 is maintained on touch screen 112, the device detects movement of contact 605 from the location corresponding to application launch icon 606 to the respective locations corresponding to menu options 614, 616, 618, and 620. When contact 605 moves to the location corresponding to each menu option 614, 616, 618, and 620, device 100 generates haptic outputs 622, 624, 628, 630 (e.g., to indicate that contact 604 has moved to a different menu option. Contrasted with the scenario shown in FIGS. 6A5-6A8) to highlight that menu option and indicate that contact 605 has moved to a different menu option, but does not generate any haptic output associated with the visual changes occurring within the user interface. In other words, in some embodiments, device 100 stops generating haptic output for portions of the input (e.g., movement across individual menu options by contact 605) when the user interface haptic output is turned off, but continues to generate haptic output for other portions of the input (e.g., an increase in the intensity of contact 605 above a shallow press intensity threshold that causes quick action menu 608 to be displayed), regardless of whether the user interface haptic output is on or off.

[0254] Figures 6B8-6B9 show that when contact 605 exceeds menu option 620, lift-off of contact point 605 is detected. In response to detecting lift-off of contact 605, device 100 launches the Mail application and displays an email list user interface 622 corresponding to menu option 620, as shown in FIG. 6B10.

[0255] In FIGS. 6B11-6B13, at the location corresponding to item 626 within the list of email items, an input by another contact (e.g., contact 625) on touch screen 112 is detected. As shown in FIGS. 6B11-6B13, the characteristic intensity of contact 625 is a shallow press intensity threshold IT LWhen it increases above (as indicated by the intensity meter 610 in FIG. 6B13), the email list user interface 622 (excluding item 626) blurs, and the preview 628 is presented on the blurred email list user interface 622 (as shown in FIG. 6B13). Additionally, as shown in FIG. 6B13, the device 100 presents the preview 628 and generates a haptic output 631 (e.g., a micro tap (200 Hz) with a gain of 1.0) in response to detecting an increase above the shallow press intensity threshold IT of the characteristic intensity of the contact 625 L When detecting an increase above L , it presents the preview 628 and generates a haptic output 631 (e.g., a micro tap (200 Hz) with a gain of 1.0). In other words, in some embodiments, the haptic output (e.g., a micro tap (200 Hz) with a gain of 1.0) associated with presenting the preview in response to a press input on an item is always generated regardless of the current haptic output setting for the user interface haptic output.

[0256] Figures 6B13 - 6B16 show that while contact 625 is maintained on touch screen 112, the device detects a leftward movement from the press location of contact 625. Due to the leftward movement of contact 625, preview 628 is dragged towards the left side of touch screen 112. While preview 628 is being dragged towards the left side of touch screen 112, hidden menu option 632 (e.g., "Archive") is gradually revealed from behind preview 628. In Figure 6B16, when contact 625 moves across a threshold position (e.g., a hidden threshold position to the left of the center line of touch screen 112) within the user interface for triggering an operation related to hidden menu option 632 (e.g., archiving an email item and archiving from the email list), device 100 changes the color of menu option 632 to indicate that the threshold for triggering the archive operation has been met by the movement of preview 628. However, in contrast to the scenario shown in Figure 6A16, device 100 does not generate any haptic output along with the visual change of the user interface. In other words, device 100 has stopped generating haptic output for the user interface according to the current haptic output setting in the "off" state.

[0257] Figures 6B17 - 6B19 show that after contact 625 has crossed the threshold position (or dragged across preview 628) to trigger an archive operation, a lift - off of contact 625 is detected. In response to the detection of the lift - off of contact 625, device 100 performs an archive operation on the email corresponding to item 626, and item 626 is removed from the list of email items as shown in Figure 6B19.

[0258] In Figures 6B20 - 6B22, at the location corresponding to item 638 within the list of email items, an input by another contact (e.g., contact 637) on touch screen 112 is detected. As shown in Figures 6B20 - 6B22, the characteristic intensity of contact 637 is a shallow press intensity threshold IT LWhen it increases above (as shown by the intensity meter 610 in FIG. 6B22), the email list user interface 622 (excluding item 638) becomes blurred, and the preview 640 is presented on the blurred email list user interface 622 (as shown in FIG. 6B22). Further, as shown in FIG. 6B22, the device 100 detects an increase in the characteristic intensity of the contact 637 above the shallow pressing intensity threshold IT of the contact L In response to detecting an increase above, the device presents the preview 640 and generates a haptic output 643 (e.g., a micro tap (200 Hz) with a gain of 1.0) because the haptic output is exempted from the control by the current haptic output setting for turning off the haptic output of the user interface.

[0259] FIG. 6B23 shows that the contact 637 detects an increase in the characteristic intensity of the contact above the deep pressing intensity threshold IT on the touch screen 112 (e.g., while maintained on the preview 640). D In response to detecting an increase in the characteristic intensity of the contact 637 above the deep pressing intensity threshold, the device 100 stops displaying the preview 640 and displays the content display user interface 644 instead of the blurred email list user interface. Further, since the haptic output 647 is exempted from the control by the current haptic output setting for turning off the haptic output of the user interface, the device 100 generates a haptic output 647 (e.g., a full tap (150 Hz) with a gain of 1.0) along with the display of the user interface 644.

[0260] In FIG. 6B24, the lift-off of the contact 637 is detected, and after detecting the lift-off of the contact 637, the user interface 644 is maintained.

[0261] FIG. 6B25 shows that while the user interface 644 is displayed on the touch screen 112, a pressing input by a contact (e.g., contact 647) is detected on the home button 650 of the device 100. The device 100 detects a pressing input (e.g., a shallow pressing intensity threshold IT LIn response to detecting an increase in the characteristic strength of contact 647 that exceeds [the specified value], a haptic output 649 (e.g., a mini - tap (230 Hz) with a gain of 1.0) is generated to indicate that the home button 650 is activated by a pressing input. FIG. 6B26 shows that in response to the activation of the home button 650 by a pressing input, the user interface 644 is discarded and the home screen 602 is displayed on the touch screen 112 instead of the user interface 644.

[0262] Although not shown in FIGS. 6A1 - 6B26, haptic audio output can accompany some or all of the haptic outputs generated in the above example, depending on the specific prioritization of different considerations in various usage scenarios and power - saving configurations of the device. For example, in some embodiments, the haptic audio output is controlled by general device audio volume control and / or mute control.

[0263] In some embodiments, when a haptic output is generated, a haptic audio output is always generated regardless of whether the device is muted.

[0264] In some embodiments, when a system haptic output is generated, a haptic audio output is always generated regardless of whether the device is muted.

[0265] In some embodiments, when a user - interface haptic output is generated, a haptic audio output is always generated regardless of whether the device is muted.

[0266] In some embodiments, when a haptic output is generated, the haptic audio output is muted when the device is muted and is generated when the device is not muted.

[0267] In some embodiments, when a system haptic output is generated, the haptic audio output accompanying the system haptic output is muted when the device is muted and is generated when the device is not muted.

[0268] In some embodiments, when a user interface haptic output is generated, if the device is muted, the haptic audio output associated with the user interface haptic output is muted, and if the device is not muted, the haptic audio output associated with the user interface haptic output is generated.

[0269] In some embodiments, when the device generates a haptic audio having a haptic output, the device further generates a haptic audio output according to the characteristics of the generated haptic output. For example, the amplitude of the audio output increases as the amplitude of the corresponding haptic output increases. For example, the frequency of the audio output increases as the frequency of the corresponding haptic output increases. In some embodiments, the amount of change in a characteristic (e.g., amplitude or frequency) in the audio output is greater than the amount of change in the characteristic in the corresponding haptic output.

[0270] In some embodiments, when the device generates a haptic audio having a haptic output (e.g., a user interface haptic output controlled by a user interface haptic output setting), the device generates a haptic audio output having an amplitude adjusted based on the volume setting of the device. In some embodiments, when the device generates a haptic audio having a haptic output (e.g., a user interface haptic output exempt from control by a user interface haptic output setting), the device generates a haptic audio output having an amplitude that is not adjusted based on the volume setting of the device.

[0271] In some embodiments, regardless of the mute / unmute setting of the device, the device continues to generate a haptic audio output when the user interface haptic output is turned off. For example, for a haptic output not exempt from control by a user interface haptic output setting, when the haptic output is not generated, the device can generate an audio output instead of the haptic output to provide non-visual feedback to the user.

[0272] In some embodiments, when the user interface haptic output is on, the device simply turns off the haptic audio output (e.g., the haptic audio output of the user interface haptic output) according to the mute setting of the device.

[0273] Other variations of haptic output control and haptic output control are possible and are not comprehensively listed herein.

[0274] Figures 7A - 7C are flowcharts showing a method 700 for providing visual feedback regarding activation of a user input device according to some embodiments. Method 700 is executed on an electronic device (e.g., device 300, FIG. 3, or portable multifunctional device 100, FIG. 1A) having a display, a touch sensing surface, one or more sensors for detecting the intensity of contact with the touch sensing surface and / or respective buttons of the device (e.g., virtual or physical home buttons), and one or more haptic output generators for generating haptic output. In some embodiments, the display is a touch screen display and the touch sensing surface is on or incorporated into the display. In some embodiments, the display is separated from the touch sensing surface. In some embodiments, method 700 is stored in a non - transitory computer - readable storage medium (e.g., non - volatile computer - readable storage medium) and is controlled by instructions executed by one or more processors of the electronic device, such as one or more processors 122 (FIG. 1A) of device 100. For simplicity of explanation, method 700 is described below as being executed by device 100. Some operations of method 700 are optionally combined and / or the order of some operations is optionally changed.

[0275] Method 700 relates to displaying the start of visual feedback regarding the activation of a user input device (e.g., a virtual or physical home button) in response to detecting a precursor input (e.g., a light press) that matches an input (e.g., a press input) to activate the user input device. In some embodiments, when an input to activate the user input device is detected, a change to the user interface corresponding to the activation of the user input device is presented as a continuation of the visual feedback that is already being presented. If no input to activate the user input device is detected before the end of the precursor input, the visual feedback ceases to be displayed and the original state of the user interface is restored. Displaying the start of visual feedback regarding the activation of the user input device before the actual activation of the user input device provides the user with information regarding the effect of the input (e.g., activation of the home button to return to the home screen) and enables the user to make a decision regarding whether to continue with the completion of the input based on that information. Thus, the visual feedback assists the user in providing appropriate input during device operation / interaction, improves device operability by reducing user errors, and in addition, reduces device power consumption and improves battery life by enabling the user to use the device more quickly and efficiently.

[0276] In some embodiments, the home button of the device is a physical home button or a virtual home button (e.g., button 204, FIG. 5A1). In some embodiments, the device includes one or more sensors that detect the intensity of contact with a touch-sensitive surface. In some embodiments, the display is a touch-sensitive display. In some embodiments, the device includes one or more haptic output generators for generating haptic output. In some embodiments, in response to detecting a first type of input on the home button (a press input detected via depression of a mechanical switch or a press or release input, or by comparing the intensity of contact on the home button to an activation criterion based on one or more intensity thresholds, as described in more detail with reference to methods 900, 1300, 1500, and 1700), the home button (e.g., permanently displayed in each location or disposed in a permanent location on the device away from the display) is available on the device in a plurality of different contexts (e.g., optionally, the home screen of the device, a multitasking user interface, or an application such as a virtual assistant user interface or a previous view of a system user interface such as a previously displayed user interface) to discard the currently displayed user interface. For other aspects of configuring the haptics for home button activation, see methods 1100 and 1900 for more detailed description.

[0277] In some embodiments, the home button responds to multiple types of input, including a first type of input (e.g., a single click (e.g., one press input, or one press input followed by a release event)), a second type of input (e.g., a double click (e.g., a first press event followed by a first release event followed by a second press event, or a first press event followed by a first release event followed by a second press event followed by a second release event, where the first and second press events are detected within a threshold amount of time of each other)), a third type of input (e.g., a long press (e.g., having a first press event that does not lift off until a threshold amount of time has elapsed)), and a fourth type of input (e.g., a deep press (e.g., having a first press event that includes an increase in contact strength above a deep press intensity threshold within a threshold amount of time after an initial touch down of the contact)). In some embodiments, each type of input is associated with the dismissal of the currently displayed user interface, performs a corresponding operation, and optionally displays a corresponding user interface associated with that operation.

[0278] In method 700, and with reference to FIG. 7A, a device (e.g., device 100 of FIG. 5A1) displays (702) a first user interface (e.g., a home screen, or a primary page of a multi-home screen such as user interface 510 of FIG. 5A1) on a display. While the device is displaying the first user interface (e.g., user interface 510 of FIG. 5A1), the device detects (704) an input directed to the first user interface (e.g., a tap gesture by contact 502 on the Clock icon of FIG. 5A2). For example, the input directed to the first user interface is a touch input on a touch-sensing surface at a location corresponding to an activatable object within the first user interface or the entire user interface (not on the home button). As another example, the input directed to the first user interface is a touch input directed to an application launch icon, a folder icon, a notification, a menu option, a control affordance (e.g., for displaying a control user interface), or the user interface as a whole (e.g., a swipe input on the home screen, or a primary page of a multi-page home screen).

[0279] In response to detecting an input directed to the first user interface, the device stops displaying the first user interface (e.g., user interface 510 of FIG. 5A2) and displays (706) a second user interface (e.g., user interface 512 of the Clock application of FIG. 5A3) (e.g., the user interface of a first application, an enlarged folder superimposed on a darkened home screen, an enlarged notification superimposed on a darkened home screen, a control panel superimposed on a darkened home screen, a multi-task user interface that simultaneously presents each representation of a multi-user interface, a secondary page of a multi-page home screen, a notification screen, a widget screen, etc.) that is separate from the first user interface.

[0280] While the second user interface is being displayed, detect (708) a contact on the home button (e.g., contact 504-a shown in FIG. 5A4). While continuously detecting a contact on the home button, the device performs at least three operations (710). First, detect an increase in the characteristic strength of the contact that exceeds a first intensity threshold (e.g., hint intensity threshold IT H ). Second, in response to detecting an increase in the characteristic strength of the contact with respect to the first intensity threshold (e.g., as shown in FIGS. 5A5-5A6 and 5A9-5A10), the device displays the start of a transition back from the second user interface to the first user interface. Third, while displaying the start of the transition back from the second user interface to the first user interface, the device detects a press input that includes an increase in the characteristic strength of the contact that exceeds a first intensity threshold (e.g., hint intensity threshold IT H ), including detecting an input sequence (e.g., input sequence 504-a-504-e by contact 504 in FIGS. 5A4-5A7, or input sequence 508-a-508-e by contact 508 in FIGS. 5A9-5A13). (For example, the strength of the contact continues to increase after reaching the first intensity threshold and is displayed after the start of the transition from the second user interface to the first user interface.)

[0281] Referring now to FIG. 7B, in response to detecting the input sequence, the device determines (712) whether the input sequence meets a first criterion and / or whether the input sequence meets a second criterion. The input sequence is a first criterion, before the end of the press input is detected (e.g., as shown in FIG. 5A11), and (e.g., the second intensity threshold is a shallow press intensity threshold IT LThat is, according to the determination that the characteristic strength of the contact (where the second intensity threshold is higher than the first intensity threshold) satisfies the first criterion that requires the characteristic strength of the contact to increase above the second intensity threshold, (for example, detecting the end of the pressing input includes detecting the release input such as the lift-off of the contact from the contact sensing surface or the decrease in the characteristic strength of the contact below the release intensity threshold) (for example, as shown in FIG. 5A13) (for example, the release intensity threshold may be preconfigured to be above, below, or the same as the shallow pressing intensity threshold, or may be dynamically determined based on the input metric of the pressing input (for example, the rate of increase in contact strength)), the device stops the display of the second user interface and redisplays the first user interface on the display (for example, at the end of the transition from the second user interface to the first user interface, the first user interface is redisplayed and the second user interface is no longer displayed). For example, in FIGS. 5A8 to 5A14, the input sequence satisfies the first criterion, and at the end of the transition back from the user interface 510 to the user interface 510, the device 100 stops the display of the user interface 512 (FIG. 5A8) and redisplays the user interface 510 (for example, the user interfaces 513-1 to 513-5, FIGS. 5A9 to 5A13) (FIG. 5A14).

[0282] According to the determination that the input sequence satis...

Claims

1. 1. A method comprising:

1. An electronic device having a touch-sensitive surface, a display, and one or more sensors for detecting an intensity of contact with a home button of the device, comprising: displaying a first user interface on the display; detecting an input indicated on the first user interface while displaying the first user interface; in response to detecting the input indicated on the first user interface; ceasing the display of the first user interface; displaying a second user interface separate from the first user interface; Detecting a touch on the home button while displaying the second user interface; while continuously detecting said touch on said home button. detecting an increase in a characteristic intensity of the contact above a first intensity threshold; indicating an initiation of a transition from the second user interface back to the first user interface in response to detecting the increase in the characteristic intensity of the contact relative to the first intensity threshold; detecting an input sequence including detecting a press input including an increase in the characteristic intensity of the contact above the first intensity threshold while indicating the beginning of the transition from the second user interface back to the first user interface; In response to detecting the input, pursuant to determining that the input sequence satisfies a first criterion requiring that the characteristic intensity of the contact increase above a second intensity threshold before an end of the pressing input is detected; ceasing the display of the second user interface; redisplaying the first user interface on the display; and pursuant to determining that the input sequence satisfies a second criterion requiring that the characteristic intensity of the contact remain below the second intensity threshold before the end of the pressing input is detected; reversing the initiation of the transition from the second user interface back to the first user interface; redisplaying the second user interface on the display; and The method includes:

2. 2. The method of claim 1, wherein ceasing the display of the second user interface and redisplaying the first user interface includes displaying a continuation of the initiation of the transition from the second user interface back to the first user interface.

3. 3. The method of claim 1, wherein displaying the start of the transition from the second user interface back to the first user interface includes displaying at least a portion of the second user interface simultaneously with at least a portion of the first user interface.

4. The method of claim 1 , wherein the first user interface is a home screen that includes a plurality of application launch icons corresponding to different applications on the electronic device.

5. The method of claim 1 , wherein the first user interface and the second user interface are user interfaces of applications that are displayed consecutively.

6. The method of claim 1 , wherein indicating the start of the transition from the second user interface back to the first user interface comprises reducing a size of the second user interface.

7. The method of claim 6 , comprising revealing the first user interface from behind the second user interface while reducing the size of the second user interface.

8. the second user interface is a user interface of a first application; the first application corresponds to a first application launch icon in the first user interface; 8. The method of claim 6 or 7, wherein reducing a size of the second user interface comprises shrinking the second user interface towards a position of the first application launch icon on the first user interface.

9. the second user interface includes an enlargement folder; the expanded folder corresponds to a first folder icon in the first user interface; The method of claim 6 or 7, wherein reducing the size of the second user interface comprises shrinking the enlarged folder towards the location of the first folder icon on the first user interface.

10. 6. The method of claim 1, wherein indicating the start of the transition from the second user interface back to the first user interface includes shifting the second user interface laterally in a first direction.

11. The method of claim 10 , comprising revealing the first user interface while shifting the second user interface laterally in the first direction.

12. The method of claim 1 , wherein indicating the start of the transition from the second user interface back to the first user interface comprises fading the second user interface.

13. The method of claim 12 , comprising shifting the first user interface laterally in the first direction to cover the second user interface while fading out the second user interface.

14. 6. The method of claim 1, wherein indicating the start of the transition from the second user interface back to the first user interface includes changing a virtual depth of at least one of the first user interface and the second user interface.

15. the second user interface includes a representation of the first user interface; 6. The method of claim 1, wherein indicating the start of the transition from the second user interface back to the first user interface comprises enlarging a representation of the first user interface included in the second user interface and decreasing a virtual depth of the representation of the first user interface.

16. detecting the input sequence further includes detecting the characteristic intensity of the contact changing between the first intensity threshold and the second intensity threshold until the input sequence satisfies the first criterion; The method comprises:

16. The method of claim 1, further comprising: dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact in response to detecting that the characteristic intensity of the contact changes between the first intensity threshold and the second intensity threshold until the input sequence satisfies the first criterion.

17. Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes: The method of claim 16 , comprising dynamically modifying a blur radius applied to the first user interface according to the characteristic intensity of the contact.

18. Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes:

18. The method of claim 16 or 17, comprising dynamically revealing at least a portion of the first user interface according to the characteristic intensity of the contact.

19. Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes:

19. The method of claim 16, comprising dynamically shifting a position of the second user interface on the display in accordance with the characteristic intensity of the contact, revealing a corresponding amount of the first user interface while dynamically shifting the position of the second user interface in accordance with the characteristic intensity of the contact.

20. Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes:

20. The method of claim 16, comprising dynamically changing an opacity of the second user interface according to the characteristic intensity of the contact.

21. the second user interface being an enlarged version of a portion of the first user interface; Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes:

21. The method of claim 16, comprising dynamically resizing the second user interface according to the characteristic intensity of the contact.

22. the second user interface includes a representation of the first user interface; Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes:

22. The method of claim 16, comprising dynamically modifying a virtual depth of a representation of the first user interface in accordance with the characteristic intensity of the contact.

23. the first user interface is a home screen; the second user interface is a user interface of the first application; The method comprises: In response to detecting the input, 23. The method of claim 1, comprising terminating or suspending the first application in accordance with a determination that the input sequence satisfies the first criterion.

24. 23. The method of any one of claims 1 to 22, wherein the first user interface is a primary page of a multi-page home screen and the second user interface is a secondary page of a multi-page home screen.

25. the first user interface is a home screen, the home screen including a first folder icon corresponding to a first folder including one or more folder items; The method of claim 1 , wherein the second user interface includes an expanded view of the first folder that includes a larger representation of the one or more folder items.

26. the device includes one or more tactile output generators; The method comprises: In response to detecting the input, 26. The method of claim 1, comprising generating a first tactile output in accordance with determining that the input sequence satisfies the first criterion.

27. 27. The method of claim 1, comprising generating a tactile output upon detecting the increase in the characteristic intensity of the contact above the first intensity threshold.

28. 27. The method of claim 1, comprising ceasing to generate a tactile output in response to detecting the increase in the characteristic intensity of the contact above the first intensity threshold.

29. 29. The method of claim 1, further comprising: pursuant to a determination that the input sequence includes an increase in the characteristic intensity of the contact above the second intensity threshold and satisfaction of a long press criterion, interrupting an animated transition from the second user interface to the first user interface and displaying an animated transition to a third user interface associated with the long press criterion.

30. 30. The method of claim 1, further comprising: interrupting an animated transition from the second user interface to the first user interface to display an animated transition to a fourth user interface associated with the multi-click criterion in accordance with a determination that the input sequence includes an increase in the characteristic intensity of the contact above the second intensity threshold and satisfaction of a multi-click criterion.

31. 1. An electronic device comprising: A display and a touch-sensitive surface; one or more sensors for detecting the intensity of a contact with a home button of the device; one or more processors; Memory, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Displaying a first user interface on the display; Detecting an input indicated on the first user interface while displaying the first user interface; in response to detecting the input indicated on the first user interface; Stopping the display of the first user interface; displaying a second user interface separate from the first user interface; Detecting a touch on the home button while displaying the second user interface; while continuously detecting said touch on said home button. Detecting an increase in a characteristic intensity of the contact above a first intensity threshold; In response to detecting the increase in the characteristic intensity of the contact relative to the first intensity threshold, indicating an initiation of a transition from the second user interface back to the first user interface; detecting an input sequence including detecting a press input including an increase in the characteristic intensity of the contact above the first intensity threshold while indicating the beginning of the transition from the second user interface back to the first user interface; In response to detecting the input, pursuant to determining that the input sequence satisfies a first criterion requiring that the characteristic intensity of the contact increase above a second intensity threshold before an end of the pressing input is detected; ceasing the display of the second user interface; redisplaying the first user interface on the display; pursuant to determining that the input sequence satisfies a second criterion requiring that the characteristic intensity of the contact remain below the second intensity threshold before the end of the pressing input is detected; reversing the initiation of the transition from the second user interface back to the first user interface; redisplaying the second user interface on the display. Electronic devices.

32. 1. A computer-readable storage medium storing one or more programs that, when executed by an electronic device having a display, a touch-sensitive surface, and one or more sensors for detecting an intensity of contact with a home button of the device, cause the device to: Displaying a first user interface on the display; detecting an input indicated on the first user interface while displaying the first user interface; in response to detecting the input indicated on the first user interface; ceasing the display of the first user interface; displaying a second user interface separate from the first user interface; detecting a touch on the home button while displaying the second user interface; while continuously detecting said touch on said home button. detecting an increase in a characteristic intensity of the contact above a first intensity threshold; indicating an initiation of a transition from the second user interface back to the first user interface in response to detecting the increase in the characteristic intensity of the contact relative to the first intensity threshold; detecting an input sequence including detecting a press input including an increase in the characteristic intensity of the contact above the first intensity threshold while indicating the beginning of the transition from the second user interface back to the first user interface; In response to detecting the input, pursuant to determining that the input sequence satisfies a first criterion requiring that the characteristic intensity of the contact increase above a second intensity threshold before an end of the pressing input is detected; Stopping the display of the second user interface; redisplaying the first user interface on the display; pursuant to determining that the input sequence satisfies a second criterion requiring that the characteristic intensity of the contact remain below the second intensity threshold before the end of the pressing input is detected; reversing the initiation of the transition from the second user interface back to the first user interface; redisplaying the second user interface on the display; A computer-readable storage medium.

33. 1. An electronic device comprising: A display and a touch-sensitive surface; one or more sensors for detecting the intensity of a contact with a home button of the device; means for displaying a first user interface on the display; means for detecting an input indicated on the first user interface while displaying the first user interface; in response to detecting the input indicated on the first user interface; ceasing the display of the first user interface; displaying a second user interface separate from the first user interface; Detecting a touch on the home button while displaying the second user interface; while continuously detecting said touch on said home button. Detecting an increase in a characteristic intensity of the contact above a first intensity threshold; In response to detecting the increase in the characteristic intensity of the contact relative to the first intensity threshold, indicating an initiation of a transition from the second user interface back to the first user interface; means for detecting an input sequence, the input sequence including detecting a press input including an increase in the characteristic intensity of the contact above the first intensity threshold while indicating the beginning of the transition from the second user interface back to the first user interface; In response to detecting the input sequence, pursuant to determining that the input sequence satisfies a first criterion requiring that the characteristic intensity of the contact increase above a second intensity threshold before an end of the pressing input is detected; ceasing the display of the second user interface; redisplaying the first user interface on the display; pursuant to determining that the input sequence satisfies a second criterion requiring that the characteristic intensity of the contact remain below the second intensity threshold before the end of the pressing input is detected; reversing the initiation of the transition from the second user interface back to the first user interface; means for redisplaying the second user interface on the display; 1. An electronic device comprising:

34. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, and one or more sensors for detecting an intensity of contact with a home button of the device, comprising: means for displaying a first user interface on the display; means for detecting an input indicated on the first user interface while displaying the first user interface; in response to detecting the input indicated on the first user interface; ceasing the display of the first user interface; displaying a second user interface separate from the first user interface; Detecting a touch on the home button while displaying the second user interface; while continuously detecting said touch on said home button. Detecting an increase in a characteristic intensity of the contact above the first intensity threshold; In response to detecting the increase in the characteristic intensity of the contact relative to the first intensity threshold, indicating an initiation of a transition from the second user interface back to the first user interface; means for detecting an input sequence, the input sequence including detecting a press input including an increase in the characteristic intensity of the contact above the first intensity threshold while indicating the beginning of the transition from the second user interface back to the first user interface; In response to detecting the input sequence, pursuant to determining that the input sequence satisfies a first criterion requiring that the characteristic intensity of the contact increase above a second intensity threshold before an end of the pressing input is detected; ceasing the display of the second user interface; redisplaying the first user interface on the display; pursuant to determining that the input sequence satisfies a second criterion requiring that the characteristic intensity of the contact remain below the second intensity threshold before the end of the pressing input is detected; reversing the initiation of the transition from the second user interface back to the first user interface; means for redisplaying the second user interface on the display; An information processing device comprising:

35. 1. An electronic device comprising: A display and a touch-sensitive surface; one or more sensors for detecting the intensity of a contact with a home button of the device; one or more processors; A memory having stored thereon one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods according to claims 1 to 30; An electronic device comprising:

36. 31. A computer-readable storage medium storing one or more programs that, when executed by an electronic device having a display, a touch-sensitive surface, and one or more sensors for detecting intensity of contact with a home button of the device, cause the device to perform any of the methods recited in claims 1 to 30.

37. 31. A graphical user interface on an electronic device comprising a display, a touch-sensitive surface, one or more sensors for detecting intensity of contact with a home button of the device, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 1 to 30.

38. 1. An electronic device comprising: A display and a touch-sensitive surface; one or more sensors for detecting the intensity of a contact with a home button of the device; 31. An electronic device comprising: means for performing any of the methods according to claims 1 to 30.

39. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, and one or more sensors for detecting an intensity of contact with a home button of the device, comprising: An information processing apparatus comprising means for carrying out any of the methods according to claims 1 to 30.

40. 1. An electronic device comprising: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts, gestures, and other user inputs; one or more sensor units configured to detect an intensity of contact with the touch-sensitive surface unit; a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units, Displaying a first user interface on the display; Detecting an input indicated on the first user interface while displaying the first user interface; in response to detecting the input indicated on the first user interface; ceasing the display of the first user interface; displaying a second user interface separate from the first user interface; Detecting a touch on the home button while displaying the second user interface; while continuously detecting said touch on said home button. Detecting an increase in a characteristic intensity of the contact above a first intensity threshold; In response to detecting the increase in the characteristic intensity of the contact relative to the first intensity threshold, indicating an initiation of a transition from the second user interface back to the first user interface; detecting an input sequence including detecting a press input including an increase in the characteristic intensity of the contact above the first intensity threshold while indicating the beginning of the transition from the second user interface back to the first user interface; In response to detecting the input, pursuant to determining that the input sequence satisfies a first criterion requiring that the characteristic intensity of the contact increase above a second intensity threshold before an end of the pressing input is detected; Stopping the display of the second user interface; redisplaying the first user interface on the display; pursuant to determining that the input sequence satisfies a second criterion requiring that the characteristic intensity of the contact remain below the second intensity threshold before the end of the pressing input is detected; reversing the initiation of the transition from the second user interface back to the first user interface; a processing unit configured to redisplay the second user interface on the display; and An electronic device comprising:

41. 41. The electronic device of claim 40, wherein ceasing to display the second user interface and redisplaying the first user interface comprises displaying a continuation of an initiation of a transition from the second user interface back to the first user interface.

42. 42. The electronic device of claim 40 or 41, wherein indicating the start of the transition from the second user interface back to the first user interface comprises displaying at least a portion of the second user interface simultaneously with at least a portion of the first user interface.

43. 43. The electronic device of claim 40, wherein the first user interface is a home screen that includes a plurality of application launch icons corresponding to different applications on the electronic device.

44. 43. The electronic device of claim 40, wherein the first user interface and the second user interface are user interfaces of applications that are displayed consecutively.

45. 45. The electronic device of claim 40, wherein indicating the start of the transition from the second user interface back to the first user interface comprises reducing a size of the second user interface.

46. The processing unit includes:

46. ​​The electronic device of claim 45, configured to reveal the first user interface from behind the second user interface while reducing the size of the second user interface.

47. the second user interface is a user interface of a first application; the first application corresponds to a first application launch icon in the first user interface; 47. The electronic device of claim 45 or 46, wherein reducing a size of the second user interface comprises shrinking the second user interface towards a position of the first application launch icon on the first user interface.

48. the second user interface includes an enlargement folder; the expanded folder corresponds to a first folder icon in the first user interface; 47. The electronic device of claim 45 or 46, wherein reducing a size of the second user interface comprises shrinking the enlarged folder towards a position of the first folder icon on the first user interface.

49. indicating the beginning of the transition from the second user interface back to the first user interface includes shifting the second user interface laterally in a first direction.

45. An electronic device according to any one of claims 40 to 44.

50. The processing unit includes:

50. The electronic device of claim 49, configured to reveal the first user interface while shifting the second user interface laterally in the first direction.

51. 45. The electronic device of claim 40, wherein indicating the start of the transition from the second user interface back to the first user interface comprises fading the second user interface.

52. The processing unit includes:

52. The electronic device of claim 51, configured to shift the first user interface laterally in a first direction to cover the second user interface while fading out the second user interface.

53. 45. The electronic device of claim 40, wherein indicating the start of the transition from the second user interface back to the first user interface includes changing a virtual depth of at least one of the first user interface and the second user interface.

54. the second user interface includes a representation of the first user interface; 45. The electronic device of claim 40, wherein indicating the start of the transition from the second user interface back to the first user interface comprises enlarging a representation of the first user interface included in the second user interface and decreasing a virtual depth of the representation of the first user interface.

55. detecting the input sequence further includes detecting the characteristic intensity of the contact changing between the first intensity threshold and the second intensity threshold until the input sequence satisfies the first criterion; The processing unit includes:

55. The electronic device of claim 40, configured to dynamically progress and reverse the transition from the second user interface to the first user interface according to the characteristic intensity of the contact in response to detecting that the characteristic intensity of the contact changes between the first intensity threshold and the second intensity threshold until the input sequence satisfies the first criterion.

56. Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes:

56. The electronic device of claim 55, further comprising dynamically modifying a blur radius applied to the first user interface according to the characteristic intensity of the contact.

57. Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes:

57. An electronic device according to claim 55 or 56, comprising dynamically revealing at least a portion of the first user interface according to the characteristic intensity of the contact.

58. Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes:

58. The electronic device of claim 55, further comprising dynamically shifting a position of the second user interface on the display in accordance with the characteristic intensity of the contact, revealing a corresponding amount of the first user interface while dynamically shifting the position of the second user interface in accordance with the characteristic intensity of the contact.

59. Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes:

59. The electronic device of claim 55, further comprising dynamically changing an opacity of the second user interface according to the characteristic intensity of the contact.

60. the second user interface being an enlarged version of a portion of the first user interface; Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes:

60. The electronic device of claim 55, further comprising dynamically resizing the second user interface in accordance with the characteristic intensity of the contact.

61. the second user interface includes a representation of the first user interface; Dynamically progressing and reversing the transition from the second user interface to the first user interface according to the characteristic intensity of the contact includes:

61. The electronic device of claim 55, comprising dynamically modifying a virtual depth of a representation of the first user interface in accordance with the characteristic intensity of the contact.

62. the first user interface is a home screen; the second user interface is a user interface of the first application; The processing unit includes: In response to detecting the input sequence, 62. The electronic device of any one of claims 40 to 61, configured to terminate or suspend the first application in accordance with a determination that the input sequence satisfies the first criterion.

63. 62. The electronic device of any one of claims 40 to 61, wherein the first user interface is a primary page of a multi-page home screen and the second user interface is a secondary page of a multi-page home screen.

64. the first user interface is a home screen, the home screen including a first folder icon corresponding to a first folder including one or more folder items; 62. The electronic device of any one of claims 40 to 61, wherein the second user interface includes an expanded view of the first folder that includes a larger representation of one or more folder items.

65. the device includes one or more tactile output generators; The processing unit includes: In response to detecting the input sequence, 65. The electronic device of any one of claims 40 to 64, configured to generate a first tactile output in accordance with a determination that the input sequence satisfies the first criterion.

66. The processing unit includes:

66. The electronic device of any one of claims 40 to 65, configured to generate a tactile output upon detecting the increase in the characteristic intensity of the contact above the first intensity threshold.

67. The processing unit includes:

66. The electronic device of claim 40, configured to cease generating a tactile output in response to detecting the increase in the characteristic intensity of the contact above the first intensity threshold.

68. 68. The electronic device of claim 40, wherein the processing unit is configured to, in accordance with a determination that the input sequence includes an increase in the characteristic intensity of the contact above the second intensity threshold and satisfaction of a long press criterion, interrupt an animated transition from the second user interface to the first user interface and display an animated transition to a third user interface associated with the long press criterion.

69. 69. The electronic device of claim 40, wherein the processing unit is configured to, in accordance with a determination that the input sequence includes an increase in the characteristic intensity of the contact above the second intensity threshold and satisfaction of a multi-click criterion, interrupt an animated transition from the second user interface to the first user interface and display an animated transition to a fourth user interface associated with the multi-click criterion.

70. 1. A method comprising: In an electronic device having a touch-sensitive surface and a display, Displaying a first user interface; detecting a first input while displaying the first user interface, the first input corresponding to a request to display a second user interface and a request to display a third user interface; In response to detecting the first input, initiating a display of a first animated transition from the first user interface to the second user interface; detecting a second input while the first animation transition is displayed; In response to detecting the second input, in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a first time, interrupting the first animation transition from the first user interface to the second user interface at a first point during the first animation transition; displaying a second animated transition from the first point in the first animated transition to the third user interface; and in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a second time after the first time, interrupting the first animation transition from the first user interface to the second user interface at a second point in the first animation transition that is later than the first point in the first animation transition; and displaying a third animated transition from the second point in the first animated transition to the third user interface, the third animated transition being different from the second animated transition.

71. In response to detecting the second input, 71. The method of claim 70, comprising continuing to display the first animation transition pursuant to a determination that the second input meets a first criterion and that the second input was received at a third time that is later than the second time.

72. 72. The method of claim 70 or 71, wherein the first time and the second time occur before a threshold time for detecting a double click input that includes the first input.

73. 73. A method according to any one of claims 71 or 72, wherein the third time occurs after the threshold time for detecting a double click input that includes the first input.

74. 74. A method according to any one of claims 70 to 73, wherein the second input is a repetition of the first input.

75. 75. The method of any one of claims 70 to 74, wherein the first animation transition from the first user interface to the second user interface comprises movement of the first user interface in a first direction and the second animation transition comprises movement of the first user interface in a second direction distinct from the first direction.

76. In response to detecting the second input, upon determining that the second input corresponds to a request to display a fourth user interface distinct from the first, second, and third user interfaces; interrupting the first animation transition from the first user interface to the second user interface at a third point in the first animation transition that is distinct from the first and second points in the first animation transition; 76. The method of any one of claims 70 to 75, comprising displaying a fourth animated transition from the third point in the first animated transition to the fourth user interface, the fourth animated transition being different from the first, second, and third animated transitions.

77. 77. The method of claim 76, wherein the first animation transition from the first user interface to the second user interface comprises movement of the first user interface in a first direction, the fourth animation transition comprises movement of the first user interface in a second direction opposite the first direction, and the third animation transition is in a third direction orthogonal to the first and second directions.

78. In response to detecting the second input, upon determining that the second input corresponds to a request to transition to a fifth user interface; interrupting the first animation transition from the first user interface to the second user interface at a fourth point during the first animation transition; 78. The method of any one of claims 70 to 77, comprising displaying a fifth animated transition from the fourth point in the first animated transition to the fifth user interface, the fifth animated transition being different from the first, second, and third animated transitions.

79. while displaying the first user interface and prior to detecting the first input; detecting a precursor input to the first input; 80. The method of claim 70, comprising: in response to detecting the precursor input, displaying a hint animation comprising initiating the first animation transition from the first user interface to the second user interface.

80. the first user interface is a user interface of a first application; 80. The method of any one of claims 70 to 79, the method comprising generating the first animation transition according to a location of a first application launcher icon on the second user interface.

81. 81. The method of any one of claims 70 to 80, wherein detecting the first input includes detecting a first press input by a first contact on a home button, the first press input including an increase in the characteristic intensity of the first contact above a first intensity threshold followed by a decrease in the characteristic intensity of the first contact below a second intensity threshold.

82. 82. The method of claim 81, comprising generating a first tactile output in response to detecting an increase in the characteristic intensity of the first contact above the first intensity threshold.

83. 83. The method of claim 81 or 82, comprising generating a second tactile output in response to detecting a decrease in the characteristic intensity of the first contact below the second intensity threshold.

84. In response to detecting the second input, in response to a determination that the second input corresponds to a request to display the third user interface and that the second input was received at a fourth time that is later than the second time, continuing to display the first animated transition from the first user interface to the second user interface; and and displaying a fifth animated transition from an end of the first animated transition to the third user interface, the fifth animated transition being different from the second animated transition and the third animated transition.

85. In response to detecting the second input, 85. The method of any one of claims 70 to 84, comprising abandoning a transition to the third user interface in response to a determination that the second input does not match a request to display the third user interface.

86. 1. An electronic device comprising: A display and a touch-sensitive surface; one or more processors; Memory, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Displaying a first user interface; detecting a first input while displaying the first user interface, the first input corresponding to a request to display a second user interface and a request to display a third user interface; In response to detecting the first input, initiate a display of a first animated transition from the first user interface to the second user interface; detecting a second input while the first animation transition is being displayed; In response to detecting the second input, in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a first time, interrupting the first animation transition from the first user interface to the second user interface at a first point during the first animation transition; displaying a second animated transition from the first point in the first animated transition to the third user interface; in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a second time that is later than the first time, interrupting the first animation transition from the first user interface to the second user interface at a second point in the first animation transition that is after the first point in the first animation transition; displaying a third animation transition from the second point in the first animation transition to the third user interface, the third animation transition being different from the second animation transition. Electronic devices.

87. 1. A computer-readable storage medium storing one or more programs that, when executed by an electronic device having a display and a touch-sensitive surface, cause the device to: Displaying a first user interface; detecting a first input while displaying the first user interface, the first input corresponding to a request to display a second user interface and a request to display a third user interface; In response to detecting the first input, initiate a display of a first animated transition from the first user interface to the second user interface; detecting a second input while the first animation transition is being displayed; In response to detecting the second input, in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a first time, interrupting the first animation transition from the first user interface to the second user interface at a first point during the first animation transition; displaying a second animated transition from the first point in the first animated transition to the third user interface; in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a second time that is later than the first time, interrupting the first animation transition from the first user interface to the second user interface at a second point in the first animation transition that is after the first point in the first animation transition; displaying a third animation transition from the second point in the first animation transition to the third user interface, the third animation transition being different from the second animation transition; A computer-readable storage medium.

88. 1. An electronic device comprising: A display and a touch-sensitive surface; means for displaying a first user interface; means for detecting a first input while displaying the first user interface, the first input corresponding to a request to display a second user interface and a request to display a third user interface; means for initiating display of a first animated transition from the first user interface to a second user interface in response to detecting the first input; means for detecting a second input while the first animation transition is being displayed; In response to detecting the second input, in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a first time, interrupting the first animation transition from the first user interface to the second user interface at a first point during the first animation transition; displaying a second animated transition from the first point in the first animated transition to the third user interface; in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a second time that is later than the first time, interrupting the first animation transition from the first user interface to the second user interface at a second point in the first animation transition that is after the first point in the first animation transition; means for displaying a third animation transition from the second point in the first animation transition to the third user interface, the third animation transition being different from the second animation transition; An electronic device comprising:

89. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising: means for displaying a first user interface; means for detecting a first input while displaying the first user interface, the first input corresponding to a request to display a second user interface and a request to display a third user interface; means for initiating display of a first animated transition from the first user interface to a second user interface in response to detecting the first input; means for detecting a second input while the first animation transition is being displayed; In response to detecting the second input, in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a first time, interrupting the first animation transition from the first user interface to the second user interface at a first point during the first animation transition; displaying a second animated transition from the first point in the first animated transition to the third user interface; in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a second time that is later than the first time, interrupting the first animation transition from the first user interface to the second user interface at a second point in the first animation transition that is after the first point in the first animation transition; displaying a third animation transition from the second point in the first animation transition to the third user interface, the third animation transition being different from the second animation transition. and An information processing device comprising:

90. 1. An electronic device comprising: A display and a touch-sensitive surface; one or more processors; a memory storing one or more programs configured to be executed by said one or more processors, the one or more programs including instructions for carrying out any of the methods according to claims 70 to 85; An electronic device comprising:

91. 86. A computer-readable storage medium storing one or more programs comprising instructions that, when executed by an electronic device having a display and a touch-sensitive surface, cause the device to perform any of the methods described in claims 70 to 85.

92. 86. A graphical user interface on an electronic device having a display, a touch-sensitive surface, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 70 to 85.

93. 1. An electronic device comprising: A display and a touch-sensitive surface; Means for carrying out any of the methods according to claims 70 to 85; An electronic device comprising:

94. 1. An information processing device for use in an electronic device having a display and a touch-sensitive surface, comprising:

86. An information processing apparatus comprising means for carrying out any of the methods according to claims 70 to 85.

95. 1. An electronic device comprising: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts, gestures, and other user inputs; a processing unit coupled to the display unit and the touch-sensitive surface unit, Displaying a first user interface; detecting a first input while displaying the first user interface, the first input corresponding to a request to display a second user interface and a request to display a third user interface; In response to detecting the first input, initiate a display of a first animated transition from the first user interface to a second user interface; detecting a second input while the first animation transition is being displayed; In response to detecting the second input, in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a first time, interrupting the first animation transition from the first user interface to the second user interface at a first point during the first animation transition; displaying the second animated transition from the first point in the first animated transition to the third user interface; in response to determining that the second input corresponds to a request to display the third user interface and that the second input was received at a second time that is later than the first time, interrupting the first animation transition from the first user interface to the second user interface at a second point in the first animation transition that is after the first point in the first animation transition; displaying a third animation transition from the second point in the first animation transition to the third user interface, the third animation transition being different from the second animation transition. and a processing unit configured to:

96. The processing unit includes: In response to detecting the second input, 96. The electronic device of claim 95, configured to continue displaying the first animation transition pursuant to a determination that the second input meets a first criterion and that the second input was received at a third time that is later than the second time.

97. 97. The electronic device of claim 95 or 96, wherein the first time and the second time occur before a threshold time for detecting a double click input that includes the first input.

98. 98. The electronic device of claim 96 or 97, wherein the third time occurs after the threshold time for detecting a double click input that includes the first input.

99. 99. The electronic device of any one of claims 95 to 98, wherein the second input is a repetition of the first input.

100. 100. The electronic device of claim 95, wherein the first animation transition from the first user interface to the second user interface includes movement of the first user interface in a first direction and the second animation transition includes movement of the first user interface in a second direction distinct from the first direction.

101. The processing unit includes: In response to detecting the second input, upon determining that the second input corresponds to a request to display a fourth user interface distinct from the first, second, and third user interfaces; interrupting the first animation transition from the first user interface to the second user interface at a third point in the first animation transition that is distinct from the first and second points in the first animation transition; 101. The electronic device of claim 95, configured to display a fourth animated transition from the third point in the first animated transition to the fourth user interface, the fourth animated transition being different from the first, second, and third animated transitions.

102. 102. The electronic device of claim 101, wherein the first animated transition from the first user interface to the second user interface includes movement of the first user interface in a first direction, the fourth animated transition includes movement of the first user interface in a second direction opposite the first direction, and the third animated transition is in a third direction orthogonal to the first and second directions.

103. The processing unit includes: In response to detecting the second input, upon determining that the second input corresponds to a request to transition to a fifth user interface; interrupting the first animation transition from the first user interface to the second user interface at a fourth point during the first animation transition; 103. The electronic device of claim 95, configured to display a fifth animated transition from the fourth point in the first animated transition to the fifth user interface, the fifth animated transition being different from the first, second, and third animated transitions.

104. The processing unit includes: while displaying the first user interface and prior to detecting the first input; Detecting a precursor input to the first input; 104. The electronic device of claim 95, configured to display a hint animation in response to detecting the precursor input, the hint animation including initiating the first animation transition from the first user interface to the second user interface.

105. the first user interface is a user interface of a first application; 105. The electronic device of any one of claims 95 to 104, wherein the processing unit is configured to generate the first animation transition according to a location of a first application launcher icon on the second user interface.

106. 106. The electronic device of claim 95, wherein detecting the first input comprises detecting a first press input by a first contact on a home button, the first press input comprising an increase in the characteristic intensity of the first contact above a first intensity threshold followed by a decrease in the characteristic intensity of the first contact below a second intensity threshold.

107. The processing unit includes:

107. The electronic device of claim 106, configured to generate a first tactile output in response to detecting the increase in the characteristic intensity of the first contact above the first intensity threshold.

108. The processing unit includes:

108. The electronic device of claim 106 or 107, configured to generate a second tactile output in response to detecting the decrease in the characteristic intensity of the first contact below the second intensity threshold.

109. In response to detecting the second input, the processing unit: in response to a determination that the second input corresponds to a request to display the third user interface and that the second input was received at a fourth time that is later than the second time, continuing to display the first animated transition from the first user interface to the second user interface; 109. The electronic device of claim 95, configured to display a fifth animated transition from an end of the first animated transition to the third user interface, the fifth animated transition being different from the second animated transition and the third animated transition.

110. In response to detecting the second input, the processing unit:

110. The electronic device of claim 95, further configured to: abandon transitioning to the third user interface in accordance with a determination that the second input does not correspond to a request to display the third user interface.

111. 1. A method comprising: In an electronic device having a touch-sensitive surface, a display, and one or more tactile output generators, displaying a home button configuration user interface on the display including displaying a plurality of different tactile output settings for the home button, the home button being usable on a device in a plurality of different contexts to discard a currently displayed user interface in response to detecting a first type of input on the home button; detecting a selection of a respective tactile output setting for a home button of the plurality of different tactile output settings while displaying the home button configuration user interface; detecting a first input of the first type on the home button while the respective tactile output setting for the home button is selected; in response to detecting the first input of the first type on the home button; pursuant to determining that the respective tactile output setting is a first tactile output setting for the home button, providing, via the one or more tactile output generators, a first tactile output corresponding to the first tactile output setting for the home button without discarding the home button configuration user interface. pursuant to a determination that the respective tactile output setting is a second tactile output setting different from the first tactile output setting for the home button, providing, via the one or more tactile output generators, a second tactile output corresponding to the second tactile output setting for the home button without discarding the home button configuration user interface. The method includes:

112. in response to detecting the first input of the first type on the home button; 112. The method of claim 111, comprising: pursuant to a determination that the respective tactile output setting is a third tactile output setting different from the first tactile output setting and the second tactile output setting for the home button, providing a third tactile output corresponding to the third tactile output setting for the home button via the one or more tactile output generators without discarding the home button configuration user interface.

113. 113. The method of claim 111 or 112, comprising, in response to detecting a selection of a tactile output setting for each of the home buttons, presenting a prompt on a home button requesting a user to provide the first type of input.

114. 114. The method of any one of claims 111 to 113, wherein the first tactile output and the second tactile output have different frequencies and the same waveform.

115. in response to detecting the first input of the first type on the home button; providing a first audio output concurrently with the first tactile output in response to a determination that the respective tactile output setting is the first tactile output setting for the home button; and 115. The method of any one of claims 111 to 114, comprising: providing a second audio output simultaneously with the second tactile output in accordance with a determination that the respective tactile output setting is the second tactile output setting for the home button.

116. providing the first tactile output corresponding to the first tactile output setting for the home button includes providing the first tactile output in response to detecting a first portion of the first input of the first type; 116. The method of any one of claims 111 to 115, the method including providing, in response to detecting the first input of the first type on the home button, a first additional tactile output via the one or more tactile output generators in response to detecting a second portion of the first input of the first type in accordance with a determination that a respective tactile output setting is the first tactile output setting for the home button.

117. providing a first audio output simultaneously with the first tactile output in response to detecting the first portion of the first input of the first type; providing a first additional audio output simultaneously with the first additional tactile output in response to detecting the second portion of the first input of the first type; and 117. The method of claim 116, comprising:

118. 118. The method of claim 117, wherein the amplitudes of the first audio output and the first additional audio output differ by a first amount and the amplitudes of the first tactile output and the first additional tactile output differ by a second amount distinct from the first amount.

119. providing the second tactile output corresponding to the second tactile output setting for the home button includes providing the second tactile output in response to detecting a first portion of the first input of the first type; 116. The method of any one of claims 111 to 115, the method including providing, in response to detecting the first input of the first type on the home button, a second additional tactile output via the one or more tactile output generators in response to detecting a second portion of the first input of the first type in accordance with a determination that the respective tactile output setting is the second tactile output setting for the home button.

120. in response to detecting a selection of the respective tactile output setting for the home button; displaying a first animation display in which a representation of the first tactile output setting includes a movement toward the home button in response to determining that the respective tactile output setting is the first tactile output setting for the home button; 120. The method of any one of claims 111 to 119, comprising: displaying a second animation display in which a representation of the second tactile output setting includes movement toward the home button in accordance with a determination that the respective tactile output setting is the second tactile output setting for the home button.

121. 121. The method of claim 120, wherein the representation of the first tactile output configuration and the representation of the second tactile output configuration have the same shape as the home button.

122. 122. The method of claim 120, wherein the first animated display includes an animated representation of a first tactile output characteristic associated with the first tactile output setting, and the second animated display includes an animated representation of a second tactile output characteristic associated with the second tactile output setting.

123. in response to detecting the first input of the first type on the home button; modifying an appearance of a representation of the first tactile output setting in the home button configuration user interface in accordance with a determination that the respective tactile output setting is the first tactile output setting for the home button; and modifying an appearance of a representation of the second tactile output setting in the home button configuration user interface in accordance with a determination that the respective tactile output setting is the second tactile output setting for the home button.

124. 124. The method of any one of claims 111 to 123, comprising, while displaying the home button configuration user interface, displaying a first affordance that, when activated, causes the home button configuration user interface to be discarded and another user interface to be displayed in place of the home button configuration user interface.

125. Detecting activation of the first affordance while displaying the home button configuration user interface and the first affordance; In response to detecting the activation of the first affordance, ceasing display of the home button configuration user interface; displaying a respective user interface separate from the home button configuration user interface; detecting a second input of the first type on the home button while displaying the respective user interface; in response to detecting the second input of the first type on the home button; ceasing the display of each of said user interfaces; displaying a third user interface separate from each of the user interfaces; providing, via the one or more tactile output generators, respective tactile outputs corresponding to the respective tactile output settings for the home button selected at the time the affordance is activated; 125. The method of claim 124, comprising:

126. detecting a first input of a second type on the home button, the second type being distinct from the first type, while the respective tactile output setting for the home button is selected; in response to detecting the first input of the second type on the home button; pursuant to determining that the respective tactile output setting is the first tactile output setting for the home button, providing, via the one or more tactile output generators, the first tactile output corresponding to the first tactile output setting for the home button without discarding the home button configuration user interface. pursuant to determining that the respective tactile output setting is the second tactile output setting for the home button, providing, via the one or more tactile output generators, the second tactile output corresponding to the second tactile output setting for the home button without discarding the home button configuration user interface.

126. The method of any one of claims 111 to 125, comprising:

127. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: displaying a home button configuration user interface on the display including a display of a plurality of different tactile output settings for the home button, the home button being usable on the device in a plurality of different contexts to discard a currently displayed user interface in response to detecting a first type of input on the home button; detecting a selection of a respective tactile output setting for a home button of the plurality of different tactile output settings while displaying the home button configuration user interface; detecting a first input of the first type on the home button while the respective tactile output setting for the home button is selected; in response to detecting the first input of the first type on the home button; pursuant to determining that the respective tactile output setting is a first tactile output setting for the home button, providing, via the one or more tactile output generators, a first tactile output corresponding to the first tactile output setting for the home button without discarding the home button configuration user interface; pursuant to a determination that the respective tactile output setting is a second tactile output setting different from the first tactile output setting for the home button, providing, via the one or more tactile output generators, a second tactile output corresponding to the second tactile output setting for the home button without discarding the home button configuration user interface. Electronic devices.

128. 1. A computer-readable storage medium storing one or more programs that, when executed by an electronic device having a display, a touch-sensitive surface, and one or more tactile output generators, cause the device to: displaying a home button configuration user interface on the display including a representation of a plurality of different tactile output configurations for the home button, the home button being usable on the device in a plurality of different contexts to discard a currently displayed user interface in response to detecting a first type of input on the home button; detecting a selection of a respective tactile output setting for the home button of the plurality of different tactile output settings while displaying the home button configuration user interface; detecting a first input of the first type on the home button while the respective tactile output setting for the home button is selected; in response to detecting the first input of the first type on the home button; pursuant to determining that the respective tactile output setting is a first tactile output setting for the home button, causing, without discarding the home button configuration user interface, to provide, via the one or more tactile output generators, a first tactile output corresponding to the first tactile output setting for the home button; pursuant to a determination that the respective tactile output setting is a second tactile output setting different from the first tactile output setting for the home button, causing, without discarding the home button configuration user interface, to provide, via the one or more tactile output generators, a second tactile output corresponding to the second tactile output setting for the home button. A computer-readable storage medium.

129. 1. An electronic device comprising: A display and a touch-sensitive surface; one or more tactile output generators; means for displaying on the display a home button configuration user interface including an indication of a plurality of different tactile output settings for the home button, the home button being usable on the device in a plurality of different contexts for discarding a currently displayed user interface in response to detecting a first type of input on the home button; means for detecting a selection of a respective tactile output setting for a home button of the plurality of different tactile output settings while displaying the home button configuration user interface; means for detecting a first input of the first type on the home button while the respective tactile output setting for the home button is selected; in response to detecting the first input of the first type on the home button; pursuant to determining that the respective tactile output setting is a first tactile output setting for the home button, providing, via the one or more tactile output generators, a first tactile output corresponding to the first tactile output setting for the home button without discarding the home button configuration user interface; means for providing, pursuant to a determination that the respective tactile output setting is a second tactile output setting different from the first tactile output setting for the home button, via the one or more tactile output generators, a second tactile output corresponding to the second tactile output setting for the home button without discarding the home button configuration user interface; An electronic device comprising:

130. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, and one or more tactile output generators, comprising: means for displaying on the display a home button configuration user interface including an indication of a plurality of different tactile output settings for the home button, the home button being usable on the device in a plurality of different contexts for discarding a currently displayed user interface in response to detecting a first type of input on the home button; means for detecting a selection of a respective tactile output setting for a home button of the plurality of different tactile output settings while displaying the home button configuration user interface; means for detecting a first input of the first type on the home button while the respective tactile output setting for the home button is selected; in response to detecting the first input of the first type on the home button; pursuant to determining that the respective tactile output setting is a first tactile output setting for the home button, providing, via the one or more tactile output generators, a first tactile output corresponding to the first tactile output setting for the home button without discarding the home button configuration user interface; pursuant to determining that the respective tactile output setting is a second tactile output setting different from the first tactile output setting for the home button, providing, via the one or more tactile output generators, a second tactile output corresponding to the second tactile output setting for the home button without discarding the home button configuration user interface. and An information processing device comprising:

131. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators; one or more processors; a memory having stored thereon one or more programs configured to be executed by said one or more processors, said one or more programs including instructions for carrying out any of the methods according to claims 111 to 126; An electronic device comprising:

132. 127. A computer-readable storage medium storing one or more programs comprising instructions that, when executed by an electronic device having a display, a touch-sensitive surface, and one or more tactile output generators, cause the device to perform any of the methods described in claims 111 to 126.

133. A graphical user interface on an electronic device having a display, a touch-sensitive surface, one or more tactile output generators, memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 111 to 126.

134. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators; Means for carrying out any of the methods according to claims 111 to 126; An electronic device comprising:

135. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, and one or more tactile output generators, comprising:

127. An information processing apparatus comprising means for carrying out any of the methods described in claims 111 to 126.

136. 1. An electronic device comprising: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts, gestures, and other user inputs; one or more tactile output generation units configured to generate a tactile output; a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more tactile output generation units, the processing unit comprising: displaying a home button configuration user interface on the display including a representation of a plurality of different tactile output settings for the home button, the home button being usable on the device in a plurality of different contexts to discard a currently displayed user interface in response to detecting a first type of input on the home button; detecting a selection of a respective tactile output setting for a home button of the plurality of different tactile output settings while displaying the home button configuration user interface; detecting a first input of the first type on the home button while the respective tactile output setting for the home button is selected; in response to detecting the first input of the first type on the home button; pursuant to determining that the respective tactile output setting is a first tactile output setting for the home button, providing, via the one or more tactile output generators, a first tactile output corresponding to the first tactile output setting for the home button without discarding the home button configuration user interface; pursuant to determining that the respective tactile output setting is a second tactile output setting different from the first tactile output setting for the home button, providing, via the one or more tactile output generators, a second tactile output corresponding to the second tactile output setting for the home button without discarding the home button configuration user interface.

1. An electronic device configured to:

137. The processing unit, in response to detecting the first input of the first type on the home button, 137. The electronic device of claim 136, configured to provide, pursuant to a determination that the respective tactile output setting is a third tactile output setting different from the first tactile output setting and the second tactile output setting for the home button, via the one or more tactile output generators, a third tactile output corresponding to the third tactile output setting for the home button without discarding the home button configuration user interface.

138. The processing unit includes:

138. The electronic device of claim 136 or 137, configured to present a prompt requesting a user to provide the first type of input on the home button in response to detecting a selection of the respective tactile output setting for the home button.

139. 139. The electronic device of any one of claims 136 to 138, wherein the first tactile output and the second tactile output have different frequencies and the same waveform.

140. The processing unit includes: in response to detecting the first input of the first type on the home button; providing a first audio output concurrently with the first tactile output in response to a determination that the respective tactile output setting is the first tactile output setting for the home button; providing a second audio output simultaneously with the second tactile output in response to determining that the respective tactile output setting is the second tactile output setting for the home button.

140. An electronic device as claimed in any one of claims 136 to 139, configured so as to

141. providing the first tactile output corresponding to the first tactile output setting for the home button includes providing the first tactile output in response to detecting a first portion of the first input of the first type; the processing unit is configured to provide, in response to detecting the first input of the first type on the home button, a first additional tactile output via the one or more tactile output generators in response to detecting a second portion of the first input of the first type according to a determination that the respective tactile output configuration is the first tactile output configuration for the home button.

141. An electronic device as claimed in any one of claims 136 to 140.

142. The processing unit includes: providing a first audio output simultaneously with the first tactile output in response to detecting the first portion of the first input of the first type; providing a first additional audio output simultaneously with the first additional tactile output in response to detecting the second portion of the first input of the first type.

142. The electronic device of claim 141 configured as follows.

143. 143. The electronic device of claim 142, wherein the amplitudes of the first audio output and the first additional audio output differ by a first amount and the amplitudes of the first tactile output and the first additional tactile output differ by a second amount distinct from the first amount.

144. providing the second tactile output corresponding to the second tactile output setting for the home button includes providing the second tactile output in response to detecting a first portion of the first input of the first type; the processing unit is configured to provide, in response to detecting the first input of the first type on the home button, a second additional tactile output in response to detecting a second portion of the first input of the first type via the one or more tactile output generators in accordance with a determination that the respective tactile output setting is the second tactile output setting for the home button.

141. An electronic device according to any one of claims 136 to 140.

145. The processing unit includes: in response to detecting a selection of the respective tactile output setting for the home button; displaying a first animation representation in response to a determination that the respective tactile output setting is the first tactile output setting for the home button, the representation of the first tactile output setting including a movement toward the home button; displaying a second animation display in which a representation of the second tactile output setting includes a movement toward the home button in response to determining that the respective tactile output setting is the second tactile output setting for the home button.

145. An electronic device as claimed in any one of claims 136 to 144, configured so as to

146. 146. The electronic device of claim 145, wherein the representation of the first tactile output configuration and the representation of the second tactile output configuration have the same shape as the home button.

147. 147. The electronic device of claim 120, wherein the first animated display includes an animated representation of a first tactile output characteristic associated with the first tactile output setting, and the second animated display includes an animated representation of a second tactile output characteristic associated with the second tactile output setting.

148. The processing unit includes: in response to detecting the first input of the first type on the home button; modifying an appearance of a representation of the first tactile output setting in the home button configuration user interface in response to a determination that the respective tactile output setting is the first tactile output setting for the home button; modifying an appearance of a representation of the second tactile output setting in the home button configuration user interface in accordance with a determination that the respective tactile output setting is the second tactile output setting for the home button.

148. An electronic device as claimed in any one of claims 136 to 147, configured so as to

149. The processing unit includes:

149. The electronic device of any one of claims 136 to 148, configured to display a first affordance that, when activated while displaying the home button configuration user interface, causes the home button configuration user interface to be discarded and another user interface to be displayed in place of the home button configuration user interface.

150. The processing unit includes: Detecting activation of the first affordance while displaying the home button configuration user interface and the first affordance; In response to detecting the activation of the first affordance, ceasing display of the home button configuration user interface; displaying a respective user interface separate from the home button configuration user interface; detecting a second input of the first type on the home button while displaying the respective user interface; in response to detecting the second input of the first type on the home button; ceasing the display of each of said user interfaces; displaying a third user interface separate from each of the user interfaces; providing, via the one or more tactile output generators, respective tactile outputs corresponding to the respective tactile output settings for the home button selected at the time the affordance is activated.

150. The electronic device of claim 149, configured as follows.

151. The processing unit includes: detecting a first input of a second type on the home button, the second type being distinct from the first type, while the respective tactile output setting for the home button is selected; in response to detecting the first input of the second type on the home button; pursuant to determining that the respective tactile output setting is the first tactile output setting for the home button, providing, via the one or more tactile output generators, the first tactile output corresponding to the first tactile output setting for the home button without discarding the home button configuration user interface; pursuant to determining that the respective tactile output setting is the second tactile output setting for the home button, providing, via the one or more tactile output generators, the second tactile output corresponding to the second tactile output setting for the home button without discarding the home button configuration user interface.

151. An electronic device as claimed in any one of claims 136 to 150, configured so as to

152. 1. A method comprising: In an electronic device having a touch-sensitive surface, a display, and one or more tactile output generators, displaying a first user interface on the display, wherein a home button is usable on the device in a plurality of different contexts to discard a currently displayed user interface in response to detecting a first type of input on the home button; detecting a first input of the first type indicated at the first user interface while displaying the first user interface; in response to detecting the first input of the first type indicated on the first user interface; performing a first operation in response to determining that a user interface tactile output is enabled at the electronic device and providing, via the one or more tactile output generators, a first tactile output corresponding to the first operation; performing the first action and ceasing to provide at least a portion of the first tactile output corresponding to the first action in response to a determination that a user interface tactile output is disabled; detecting a second input of the first type on the home button after performing the first action; in response to detecting the second input of the first type on the home button; performing a second action associated with the home button; providing, via the one or more tactile output generators, a tactile output associated with activation of the home button, regardless of whether user interface tactile output is enabled on the device; A method comprising:

153. 153. The method of claim 152, wherein the first user interface is a user interface of a first application, the first action is manipulating the first application, and the second action includes discarding the first application.

154. detecting a first input on the home button of a second type distinct from the first type after performing the first action; in response to detecting the first input of the second type on the home button; performing a third action associated with the home button, the third action being distinct from the second action; providing, via the one or more tactile output generators, a tactile output associated with activation of the home button, regardless of whether user interface tactile output is enabled in the electronic device; 154. The method of any one of claims 152 or 153, comprising:

155. detecting a first input on the home button of a third type distinct from the first type after performing the first action; in response to detecting the first input of the third type on the home button; performing a fourth operation associated with the home button, the fourth operation being distinct from the second operation; and providing, via the one or more tactile output generators, a tactile output associated with activation of the home button, regardless of whether user interface tactile output is enabled in the electronic device; 155. The method of any one of claims 152 to 154, comprising:

156. 156. The method of any one of claims 152 to 155, wherein the first tactile output and the tactile output associated with activation of the home button are provided by the same one or more actuators of the one or more tactile output generators.

157. 157. The method of any one of claims 152 to 156, wherein a tactile output pattern of a corresponding tactile output provided in response to each input of the first type on the home button is user adjustable.

158. 158. The method of any one of claims 152 to 157, comprising, in response to detecting the second input of the first type on the home button, providing an audio output accompanied by the tactile output associated with activation of the home button, regardless of whether a user interface tactile output is enabled and regardless of whether audio output is muted on the device.

159. 159. The method of any one of claims 152 to 158, comprising, in response to detecting the second input of the first type on the home button, providing an audio output accompanied by the tactile output associated with activation of the home button, regardless of whether a user interface tactile output is enabled, wherein the volume of the audio output is independent of a current volume setting on the device.

160. in response to detecting the first input of the first type indicated on the first user interface; In response to a determination that the user interface tactile output is enabled, providing an audio output accompanied by the first tactile output in response to determining that audio output is not muted at the device; and ceasing to provide the audio output along with the first tactile output in response to determining that audio output is muted at the device; and 160. The method of any one of claims 152 to 159, comprising:

161. in response to detecting the first input of the first type indicated on the first user interface; In response to a determination that the user interface tactile output is enabled, providing an audio output accompanied by the first tactile output at a first volume determined based on the first level of audio output at the device in response to determining that audio output at the device is set to a first level; pursuant to determining that audio output at the device is set to a second level, providing the audio output accompanied by the first tactile output at a second volume different from the first volume and determined based on the second level of the audio output at the device; 161. The method of any one of claims 152 to 160, comprising:

162. in response to detecting the first input of the first type indicated on the first user interface; 162. The method of claim 160 or 161, comprising ceasing to provide the audio output accompanied by the first tactile output in accordance with a determination that a user interface tactile output has been disabled, regardless of whether audio output is muted at the device.

163. in response to detecting the first input of the first type indicated on the first user interface; 163. The method of any one of claims 152 to 162, comprising: in accordance with a determination that user interface tactile output is disabled and in accordance with a determination that the first action is a predetermined exempt action, providing, using the one or more tactile output generators, the first tactile output corresponding to the first action.

164. in response to detecting the first input of the first type indicated on the first user interface; In response to a determination that the user interface tactile output is disabled, providing, with the one or more tactile output generators, the first tactile output corresponding to the first motion in accordance with determining that the first motion is a first type of predetermined motion; performing the first action without providing a tactile output corresponding to the first action, using the one or more tactile output generators, in accordance with determining that the first action is a second type of predetermined action; and performing the first action in response to a determination that a user interface tactile output is enabled, and providing, using the one or more tactile output generators, the first tactile output corresponding to the first action, regardless of whether the first action is the first type of predetermined action or the second type of predetermined action; 164. The method of any one of claims 152 to 163, comprising:

165. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: displaying a first user interface on the display, a home button being usable on the device in a plurality of different contexts to dismiss a currently displayed user interface in response to detecting a first type of input on the home button; detecting a first input of the first type indicated at the first user interface while displaying the first user interface; in response to detecting the first input of the first type indicated on the first user interface; performing a first operation in response to determining that a user interface tactile output is enabled at the electronic device and providing, via the one or more tactile output generators, a first tactile output corresponding to the first operation; performing the first action and ceasing to provide at least a portion of the first tactile output corresponding to the first action in response to determining that a user interface tactile output is disabled; detecting a second input of the first type on the home button after performing the first action; in response to detecting the second input of the first type on the home button; Perform a second action associated with the home button; providing a tactile output associated with activation of the home button via the one or more tactile output generators, regardless of whether user interface tactile output is enabled on the device. The electronic device includes instructions for:

166. 1. A computer-readable storage medium storing one or more programs that, when executed by an electronic device having a display, a touch-sensitive surface, and one or more tactile output generators for generating tactile outputs, cause the device to: displaying a first user interface on the display, a home button being usable on the device in a plurality of different contexts to dismiss a currently displayed user interface in response to detecting a first type of input on the home button; detecting a first input of the first type indicated at the first user interface while displaying the first user interface; in response to detecting the first input of the first type indicated on the first user interface; performing a first operation in response to determining that a user interface tactile output is enabled at the electronic device, and causing, via the one or more tactile output generators, a first tactile output corresponding to the first operation; performing the first action and ceasing to provide at least a portion of the first tactile output corresponding to the first action in response to determining that a user interface tactile output is disabled; detecting a second input of the first type on the home button after performing the first action; in response to detecting the second input of the first type on the home button; performing a second action associated with the home button; causing, via the one or more tactile output generators, to provide a tactile output associated with activation of the home button, regardless of whether user interface tactile outputs are enabled on the device. A computer-readable storage medium.

167. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; means for displaying a first user interface on a display, a home button being usable on the device in a plurality of different contexts to discard a currently displayed user interface in response to detecting a first type of input on the home button; means for detecting a first input of the first type indicated on the first user interface while displaying the first user interface; in response to detecting the first input of the first type indicated on the first user interface; performing a first operation in response to determining that a user interface tactile output is enabled at the electronic device and providing, via the one or more tactile output generators, a first tactile output corresponding to the first operation; means for performing the first action and ceasing to provide at least a portion of the first tactile output corresponding to the first action in response to a determination that a user interface tactile output has been disabled; means for detecting a second input of the first type on the home button after performing the first action; in response to detecting a second input of the first type on the home button; Perform a second action associated with the home button; means for providing, via the one or more tactile output generators, a tactile output associated with activation of the home button, regardless of whether user interface tactile output is enabled on the device; An electronic device comprising:

168. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, and one or more tactile output generators for generating tactile outputs, comprising: means for displaying a first user interface on a display, a home button being usable on the device in a plurality of different contexts to discard a currently displayed user interface in response to detecting a first type of input on the home button; means for detecting a first input of a first type indicated on a first user interface while displaying said first user interface; in response to detecting the first input of the first type indicated on the first user interface; performing a first operation in response to determining that a user interface tactile output is enabled at the electronic device and providing, via the one or more tactile output generators, a first tactile output corresponding to the first operation; means for performing the first action and ceasing to provide at least a portion of the first tactile output corresponding to the first action in response to a determination that a user interface tactile output has been disabled; means for detecting a second input of the first type on the home button after performing the first action; in response to detecting the second input of the first type on the home button; Perform a second action associated with the home button; providing a tactile output associated with activation of the home button via the one or more tactile output generators, regardless of whether user interface tactile output is enabled on the device. and An information processing device comprising:

169. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more processors; Memory, and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described in claims 152 to 164.

170. 165. A computer-readable storage medium storing one or more programs comprising instructions that, when executed by an electronic device having a display, a touch-sensitive surface, and one or more tactile output generators for generating tactile outputs, cause the device to perform any of the methods recited in claims 152 to 164.

171. 165. A graphical user interface on an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods of claims 152 to 164.

172. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; Means for carrying out any of the methods according to claims 152 to 164; An electronic device comprising:

173. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, and one or more tactile output generators for generating tactile outputs, comprising: An information processing apparatus comprising means for carrying out any of the methods described in claims 152 to 164.

174. 1. An electronic device comprising: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts, gestures, and other user inputs; one or more tactile output generation units configured to generate a tactile output; a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more tactile output generation units, the processing unit comprising: displaying a first user interface on the display, a home button being usable on the device in a plurality of different contexts to dismiss a currently displayed user interface in response to detecting a first type of input on the home button; detecting a first input of the first type indicated at the first user interface while displaying the first user interface; in response to detecting the first input of the first type indicated on the first user interface; performing a first operation in response to determining that a user interface tactile output is enabled at the electronic device and providing, via the one or more tactile output generators, a first tactile output corresponding to the first operation; performing the first action and ceasing to provide at least a portion of the first tactile output corresponding to the first action in response to determining that a user interface tactile output is disabled; detecting a second input of the first type on the home button after performing the first action; in response to detecting the second input of the first type on the home button; Perform a second action associated with the home button; configured to provide, via the one or more tactile output generators, a tactile output associated with activation of the home button, regardless of whether user interface tactile outputs are enabled on the device. Electronic devices.

175. 175. The electronic device of claim 174, wherein the first user interface is a user interface of a first application, the first action is manipulating the first application, and the second action includes discarding the first application.

176. The processing unit includes: detecting a first input on the home button of a second type distinct from the first type after performing the first action; in response to detecting the first input of the second type on the home button; performing a third action associated with the home button, the third action being distinct from the second action; providing, via the one or more tactile output generators, a tactile output associated with activation of the home button, regardless of whether user interface tactile output is enabled on the electronic device.

176. An electronic device as claimed in any one of claims 174 or 175, configured so as to

177. The processing unit includes: detecting a first input on the home button of a third type distinct from the first type after performing the first action; in response to detecting the first input of the third type on the home button; performing a fourth action associated with the home button and distinct from the second action; providing, via the one or more tactile output generators, a tactile output associated with activation of the home button, regardless of whether user interface tactile output is enabled on the electronic device.

177. An electronic device as claimed in any one of claims 174 to 176, configured so as to

178. 178. The electronic device of any one of claims 174 to 177, wherein the first tactile output and the tactile output associated with activation of the home button are provided by the same one or more actuators of the one or more tactile output generators.

179. 179. The electronic device of any one of claims 174 to 178, wherein a tactile output pattern of a corresponding tactile output provided in response to each input of the first type on the home button is user adjustable.

180. The processing unit includes:

180. The electronic device of any one of claims 174 to 179, configured to, in response to detecting the second input of the first type on the home button, provide an audio output accompanied by the tactile output associated with activation of the home button, regardless of whether a user interface tactile output is enabled and regardless of whether audio output is muted on the device.

181. The processing unit includes:

181. The electronic device of any one of claims 174 to 180, configured in response to detecting the second input of the first type on the home button, to provide an audio output accompanied by the tactile output associated with activation of the home button, regardless of whether a user interface tactile output is enabled, and the volume of the audio output is independent of a current volume setting on the device.

182. The processing unit includes: in response to detecting the first input of the first type indicated on the first user interface; In response to a determination that the user interface tactile output is enabled, providing an audio output accompanied by the first tactile output in response to determining that an audio output is not muted at the device; ceasing to provide the audio output accompanied by the first tactile output in response to determining that audio output is muted at the device.

182. An electronic device as claimed in any one of claims 174 to 181, configured so as to

183. The processing unit includes: in response to detecting the first input of the first type indicated on the first user interface; In response to a determination that the user interface tactile output is enabled, pursuant to determining that audio output at the device is set to a first level, providing an audio output accompanied by the first tactile output at a first volume determined based on the first level of audio output at the device; providing the audio output accompanied by the first tactile output at a second volume, the second volume being determined based on the second level of the audio output at the device in response to determining that the audio output at the device is set to a second level; 183. An electronic device as claimed in any one of claims 174 to 182, configured so as to

184. The processing unit includes: in response to detecting the first input of the first type indicated on the first user interface; 184. The electronic device of claim 182 or 183, configured to cease providing the audio output accompanied by the first tactile output in accordance with a determination that a user interface tactile output is disabled, regardless of whether audio output is muted at the device.

185. The processing unit includes: in response to detecting the first input of the first type indicated on the first user interface; 185. The electronic device of any one of claims 174 to 184, configured to: provide, using the one or more tactile output generators, the first tactile output corresponding to the first action in accordance with a determination that user interface tactile output is disabled and in accordance with a determination that the first action is a predefined exempt action.

186. The processing unit includes: in response to detecting the first input of the first type indicated on the first user interface; In response to a determination that the user interface tactile output is disabled, pursuant to determining that the first motion is a first type of predetermined motion, providing, with the one or more tactile output generators, the first tactile output corresponding to the first motion; pursuant to determining that the first action is a second type of predetermined action, performing the first action with the one or more tactile output generators without providing a tactile output corresponding to the first action; performing the first action in response to determining that a user interface tactile output is enabled, and providing, using the one or more tactile output generators, the first tactile output corresponding to the first action, regardless of whether the first action is the first type of predetermined action or the second type of predetermined action.

186. An electronic device as claimed in any one of claims 174 to 185, configured so as to

187. 1. A method comprising: An electronic device having a touch-sensitive surface, a display, and one or more tactile output generators for generating a tactile output, the electronic device including one or more sensors for detecting an intensity of a contact with a home button of the device; displaying a user interface on the display; detecting an input sequence on the home button while displaying the user interface, the input sequence including detecting a first pressing input on the home button, the detecting the first pressing input including detecting an increase in a characteristic intensity of a contact on the home button; in response to detecting the first pressing input on the home button, responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above a first intensity threshold and a change in the characteristic intensity of the contact proximate a time at which the characteristic intensity of the contact increases above the first intensity threshold having a first value for an intensity change metric; performing a first operation to modify the user interface displayed on the display; generating, via the one or more tactile output generators, a first discrete tactile output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold; responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above the first intensity threshold and the change in the characteristic intensity of the contact proximate the time at which the characteristic intensity of the contact increases above the first intensity threshold has a second value for the intensity change metric that is different from the first value for the intensity change metric; performing the first operation to modify the user interface displayed on the display; generating, via the one or more tactile output generators, a second discrete tactile output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold and different from the first discrete tactile output; A method comprising:

188. the first discrete tactile output and the second discrete tactile output have the same waveform; the first discrete tactile output and the second discrete tactile output have different amplitudes. The method of claim 187.

189. 189. The method of any one of claims 187 or 188, wherein the first discrete tactile output is ceased while the characteristic intensity of the contact remains above the first intensity threshold.

190. 190. The method of any one of claims 187 to 189, wherein the second discrete tactile output is ceased while the characteristic intensity of the contact remains above the first intensity threshold.

191. 191. The method of any one of claims 187 to 190, wherein the first tactile output is generated for a first range of values ​​of the intensity change metric.

192. 192. The method of claim 191, wherein the second tactile output is generated for a second range of values ​​of the intensity change metric.

193. Detecting the input sequence on the home button further includes detecting a first release input on the home button following the first press input on the home button, and detecting the first release input includes detecting a decrease in the characteristic intensity of the contact on the home button; The method comprises: in response to detecting the first release input on the home button. pursuant to determining that the first release input includes a decrease in the characteristic intensity of the contact below a second intensity threshold and a change in the characteristic intensity of the contact proximate to a time at which the characteristic intensity of the contact decreases below the second intensity threshold has a third value for the intensity change metric; generating, via the one or more tactile output generators, a third discrete tactile output corresponding to the decrease in the characteristic intensity of the contact below the second intensity threshold; pursuant to determining that the first release input includes a decrease in the characteristic intensity of the contact below the second intensity threshold and the change in the characteristic intensity of the contact proximate the time at which the characteristic intensity of the contact decreases below the second intensity threshold has a fourth value for the intensity change metric that is different from the third value for the intensity change metric; generating, via the one or more tactile output generators, a fourth discrete tactile output corresponding to the decrease in characteristic intensity of the contact below the second intensity threshold, the fourth discrete tactile output being different from the third discrete tactile output; 193. The method of any one of claims 187 to 192, comprising:

194. generating the first and second tactile outputs includes applying a first modification to a base tactile output pattern according to the first and second values ​​of the intensity change metric, respectively; generating the third and fourth tactile outputs includes applying a second modification, distinct from the first modification, to the base tactile output pattern in accordance with the third and fourth values ​​of the intensity change metric, respectively. The method of claim 193.

195. 195. The method of any one of claims 193 or 194, wherein the second intensity threshold is different from the first intensity threshold.

196. 196. The method of any one of claims 187 to 195, wherein the first discrete tactile output and the second discrete tactile output are generated from a base tactile output pattern associated with a currently selected tactile output setting of a plurality of different tactile output settings for the home button.

197. 197. The method of any one of claims 187 to 196, wherein the home button is permanently displayed in the respective position or is located in a permanent location on the device away from the display.

198. 202. The method of any one of claims 187 to 197, wherein the intensity change metric is based on a rate of change of the characteristic intensity of the contact over time.

199. 200. The method of any one of claims 187 to 197, wherein the intensity-change metric is based on a rate of change of the characteristic intensity of the contact over time, measured at the time the characteristic intensity of the contact reaches an associated threshold intensity.

200. detecting the input sequence includes detecting a second press input on the home button, the second press input including detecting a second increase in the characteristic intensity of the contact on the home button; In response to detecting the second pressing input, the method further comprises: in response to a determination that the first pressure input and the second pressure input are part of a predetermined input pattern based on an amount of time between a first time point corresponding to the first pressure input and a second time point corresponding to the second pressure input; performing a second action associated with the predetermined input pattern, the second action being different from the first action; providing via the one or more tactile output generators a fifth separate tactile output separate from the first and second tactile outputs; 200. The method of any one of claims 187 to 199, comprising:

201. detecting the input sequence includes detecting a second press input on the home button, the second press input including detecting a second increase in the characteristic intensity of the contact on the home button; The method comprises: in response to detecting the first pressing input, providing a first audio output simultaneously with a respective one of the first and second tactile outputs generated in response to the first pressing input; In response to detecting the second pressing input, in response to a determination that the first pressure input and the second pressure input are part of a predetermined input pattern based on an amount of time between a first time point corresponding to the first pressure input and a second time point corresponding to the second pressure input; performing a second action associated with the input pattern, the second action being different from the first action; providing a fifth discrete tactile output via the one or more tactile output generators, the fifth tactile output being identical to a respective one of the first and second tactile outputs generated in response to the first pressure input; and providing a second audio output simultaneously with the fifth discrete tactile output, the second audio output and the first audio output having different audio output patterns; 200. The method of any one of claims 187 to 199, comprising:

202. in response to detecting the first pressing input on the home button, 202. The method of any one of claims 187 to 201, comprising changing the user interface from a first user interface to a second user interface regardless of the value of the intensity change metric corresponding to the first pressure input.

203. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors for detecting the intensity of a contact with a home button of the device; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: Displaying a user interface on the display; detecting an input sequence on the home button while displaying the user interface, including detecting a first press input on the home button, the detecting the first press input including detecting an increase in a characteristic intensity of a contact on the home button; in response to detecting the first pressing input on the home button, responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above a first intensity threshold and a change in the characteristic intensity of the contact proximate a time at which the characteristic intensity of the contact increases above the first intensity threshold having a first value for an intensity change metric; performing a first operation to modify the user interface displayed on the display; generating, via the one or more tactile output generators, a first discrete tactile output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold; responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above the first intensity threshold and the change in the characteristic intensity of the contact proximate the time at which the characteristic intensity of the contact increases above the first intensity threshold has a second value for the intensity change metric that is different from the first value for the intensity change metric; performing the first operation that modifies the user interface displayed on the display; generating, via the one or more tactile output generators, a second discrete tactile output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold and different from the first discrete tactile output. The electronic device includes instructions for:

204. 1. A computer-readable storage medium storing one or more programs that, when executed by an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors for detecting an intensity of a contact with a home button of the device, cause the device to: Displaying a user interface on the display; detecting an input sequence on the home button while displaying the user interface, the input sequence including detecting a first pressing input on the home button, the detecting the first pressing input including detecting an increase in a characteristic intensity of a contact on the home button; in response to detecting the first pressing input on the home button, responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above a first intensity threshold and a change in the characteristic intensity of the contact proximate a time at which the characteristic intensity of the contact increases above the first intensity threshold having a first value for an intensity change metric; performing a first operation that modifies the user interface displayed on the display; generating, via the one or more tactile output generators, a first discrete tactile output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold; responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above the first intensity threshold and the change in the characteristic intensity of the contact proximate the time at which the characteristic intensity of the contact increases above the first intensity threshold has a second value for the intensity change metric that is different from the first value for the intensity change metric; performing the first operation that modifies the user interface displayed on the display; generating, via the one or more tactile output generators, a second discrete tactile output responsive to an increase in the characteristic intensity of the contact above the first intensity threshold and different from the first discrete tactile output. A computer-readable storage medium containing instructions.

205. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors for detecting the strength of a contact with a home button of the device; means for displaying a user interface on said display; means for detecting an input sequence on the home button while displaying the user interface, including detecting a first press input on the home button, wherein detecting the first press input includes detecting an increase in a characteristic intensity of a contact on the home button; and in response to detecting the first pressing input on the home button, responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above a first intensity threshold and a change in the characteristic intensity of the contact proximate a time at which the characteristic intensity of the contact increases above the first intensity threshold having a first value for an intensity change metric; performing a first operation to modify the user interface displayed on the display; generating, via the one or more tactile output generators, a first discrete tactile output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold; responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above the first intensity threshold and the change in the characteristic intensity of the contact proximate the time at which the characteristic intensity of the contact increases above the first intensity threshold has a second value for the intensity change metric that is different from the first value for the intensity change metric; performing the first operation that modifies the user interface displayed on the display; means for generating, via the one or more tactile output generators, a second discrete tactile output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold and different from the first discrete tactile output; An electronic device comprising:

206. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors for detecting an intensity of contact with a home button of the device, comprising: means for displaying a user interface on said display; means for detecting an input sequence on the home button while displaying the user interface, including detecting a first press input on the home button, wherein detecting the first press input includes detecting an increase in a characteristic intensity of a contact on the home button; and in response to detecting the first pressing input on the home button, responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above a first intensity threshold and a change in the characteristic intensity of the contact proximate a time at which the characteristic intensity of the contact increases above the first intensity threshold having a first value for an intensity change metric; performing a first operation to modify the user interface displayed on the display; generating, via the one or more tactile output generators, a first discrete tactile output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold; responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above the first intensity threshold and the change in the characteristic intensity of the contact proximate the time at which the characteristic intensity of the contact increases above the first intensity threshold has a second value for the intensity change metric that is different from the first value for the intensity change metric; performing the first operation that modifies the user interface displayed on the display; generating, via the one or more tactile output generators, a second discrete tactile output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold, the second discrete tactile output being different from the first discrete tactile output. and An information processing device comprising:

207. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors for detecting the intensity of a contact with a home button of the device; one or more processors; Memory, and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described in claims 187 to 202.

208. 203. A computer-readable storage medium storing one or more programs comprising instructions that, when executed by an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors for detecting an intensity of contact with a home button of the device, cause the device to perform any of the methods recited in claims 187 to 202.

209. A graphical user interface on an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, one or more sensors for detecting an intensity of contact with a home button of the device, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods of claims 187 to 202.

210. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors for detecting the intensity of a contact with a home button of the device; Means for carrying out any of the methods according to claims 187 to 202; An electronic device comprising:

211. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors for detecting an intensity of contact with a home button of the device, comprising:

203. An information processing apparatus comprising means for performing any of the methods described in claims 187 to 202.

212. 1. An electronic device comprising: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts, gestures, and other user inputs; one or more tactile output generation units configured to generate a tactile output; one or more sensor units configured to detect the intensity of a contact with a home button of the device; a processing unit coupled to the display unit, the touch-sensitive surface unit, the one or more tactile output generation units, and the one or more sensor units, Displaying a user interface on the display; detecting an input sequence on the home button while displaying the user interface, including detecting a first press input on the home button, the detecting the first press input including detecting an increase in a characteristic intensity of a contact on the home button; in response to detecting the first pressing input on the home button, responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above a first intensity threshold and a change in the characteristic intensity of the contact proximate a time at which the characteristic intensity of the contact increases above the first intensity threshold having a first value for an intensity change metric; performing a first operation to modify the user interface displayed on the display; generating, via the one or more tactile output generators, a first discrete tactile output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold; responsive to a determination that the first pressure input includes an increase in the characteristic intensity of the contact above the first intensity threshold and the change in the characteristic intensity of the contact proximate the time at which the characteristic intensity of the contact increases above the first intensity threshold has a second value for the intensity change metric that is different from the first value for the intensity change metric; performing the first operation that modifies the user interface displayed on the display; a processing unit configured to generate, via the one or more tactile output generators, a second discrete tactile output corresponding to the increase in the characteristic intensity of the contact above the first intensity threshold, the second discrete tactile output being different from the first discrete tactile output; 1. An electronic device comprising:

213. the first discrete tactile output and the second discrete tactile output have the same waveform; the first discrete tactile output and the second discrete tactile output have different amplitudes. The electronic device of claim 212.

214. 214. The electronic device of claim 212 or 213, wherein the first discrete tactile output is terminated while the characteristic intensity of the contact remains above the first intensity threshold.

215. 215. The electronic device of any one of claims 212 to 214, wherein the second discrete tactile output is terminated while the characteristic intensity of the contact remains above the first intensity threshold.

216. 216. The electronic device of any one of claims 212 to 215, wherein the first tactile output is generated for a first range of values ​​of the intensity change metric.

217. 217. The electronic device of claim 216, wherein the second tactile output is generated at a second range of values ​​of the intensity change metric.

218. Detecting the input sequence on the home button further includes detecting a first release input on the home button following the first press input on the home button, and detecting the first release input includes detecting a decrease in the characteristic intensity of the contact on the home button; The processing unit includes: in response to detecting the first release input on the home button; pursuant to determining that the first release input includes a decrease in the characteristic intensity of the contact below a second intensity threshold and a change in the characteristic intensity of the contact proximate to a time at which the characteristic intensity of the contact decreases below the second intensity threshold has a third value for the intensity change metric; generating, via the one or more tactile output generators, a third discrete tactile output corresponding to the decrease in the characteristic intensity of the contact below the second intensity threshold; pursuant to determining that the first release input includes a decrease in the characteristic intensity of the contact below the second intensity threshold and the change in the characteristic intensity of the contact proximate the time at which the characteristic intensity of the contact decreases below the second intensity threshold has a fourth value for the intensity change metric that is different from the third value for the intensity change metric; generating, via the one or more tactile output generators, a fourth discrete tactile output corresponding to the decrease in the characteristic intensity of the contact below the second intensity threshold and different from the third discrete tactile output.

218. An electronic device as claimed in any one of claims 212 to 217, configured so as to

219. generating the first and second tactile outputs includes applying a first modification to a base tactile output pattern according to the first and second values ​​of the intensity change metric, respectively; generating the third and fourth tactile outputs includes applying a second modification, distinct from the first modification, to the base tactile output pattern in accordance with the third and fourth values ​​of the intensity change metric, respectively. The electronic device of claim 218.

220. 220. The electronic device of claim 218 or 219, wherein the second intensity threshold is different from the first intensity threshold.

221. 221. The electronic device of claim 212, wherein the first discrete tactile output and the second discrete tactile output are generated from a base tactile output pattern associated with a currently selected tactile output setting of a plurality of different tactile output settings for the home button.

222. 222. The electronic device of any one of claims 212 to 221, wherein the home button is permanently displayed in the respective position or located in a permanent location on the device away from the display.

223. 223. The electronic device of any one of claims 212 to 222, wherein the intensity change metric is based on a rate of change of the characteristic intensity of the contact over time.

224. 223. The electronic device of any one of claims 212 to 222, wherein the intensity change metric is based on a rate of change of the characteristic intensity of the contact over time, measured at the time the characteristic intensity of the contact reaches an associated threshold intensity.

225. detecting the input sequence includes detecting a second press input on the home button, and detecting the second press input includes detecting a second increase in the characteristic intensity of the contact on the home button; In response to detecting the second pressing input, the processing unit: in response to a determination that the first pressure input and the second pressure input are part of a predetermined input pattern based on an amount of time between a first time point corresponding to the first pressure input and a second time point corresponding to the second pressure input; performing a second action associated with the predetermined input pattern, the second action being different from the first action; providing via the one or more tactile output generators a fifth discrete tactile output distinct from the first and second tactile outputs.

225. An electronic device as claimed in any one of claims 212 to 224, configured so as to

226. detecting the input sequence includes detecting a second press input on the home button, and detecting the second press input includes detecting a second increase in the characteristic intensity of the contact on the home button; The processing unit includes: in response to detecting the first pressing input, providing a first audio output simultaneously with a respective one of the first and second tactile outputs generated in response to the first pressing input; In response to detecting the second pressing input, in response to a determination that the first pressure input and the second pressure input are part of a predetermined input pattern based on an amount of time between a first time point corresponding to the first pressure input and a second time point corresponding to the second pressure input; performing a second action associated with the input pattern, the second action being different from the first action; providing a fifth discrete tactile output via the one or more tactile output generators, the fifth tactile output being identical to a respective one of the first and second tactile outputs generated in response to the first pressure input; and configured to provide a second audio output simultaneously with the fifth discrete tactile output, the second audio output and the first audio output having different audio output patterns.

225. An electronic device as claimed in any one of claims 212 to 224, configured so as to

227. The processing unit includes: in response to detecting the first pressing input on the home button, changing a user interface from a first user interface to a second user interface regardless of the value of the intensity-change metric corresponding to the first pressure input.

227. An electronic device as claimed in any one of claims 212 to 226, configured so as to

228. 1. A method comprising: An electronic device having a touch-sensitive surface, a display, and one or more tactile output generators for generating a tactile output, the electronic device including one or more sensors for detecting an intensity of a contact with a home button of the device; Displaying a first user interface; While displaying the first user interface, a first press input on the home button; and detecting a second press input on the home button detected after the first press input; in response to detecting the first pressing input and prior to detecting the second pressing input, providing a first non-visual output having a first non-visual output profile, the first non-visual output providing feedback indicating that the first pressing input has been detected and that the first non-visual output includes a tactile output provided by the one or more tactile output generators; in response to detecting an input sequence including the first press input and the second press input on the home button; in response to a determination that the first pressure input and the second pressure input are separate inputs based on an amount of time between a first time point corresponding to the first pressure input and a second time point corresponding to the second pressure input; performing a first action associated with the first pressing input; providing a second non-visual output having the first non-visual output profile, the second non-visual output providing feedback indicating that the second pressure input has been detected, and the second non-visual output including a tactile output provided by the one or more haptic output generators; in response to a determination that the first pressure input and the second pressure input are part of an input pattern based on the amount of time between the first time point and the second time point; performing a second action associated with the input pattern, the second action being different from the first action; providing a third non-visual output having a second non-visual output profile distinct from the first non-visual output profile, the third non-visual output providing feedback indicating that the second pressure input has been detected, and the third non-visual output including a tactile output provided by the one or more tactile output generators; A method comprising:

229. The first time point is a time period during which the characteristic intensity of the first pressure input increases above a pressure intensity threshold; and a time during which the characteristic intensity of the first pressure input decreases below a release intensity threshold; 229. The method of claim 228, wherein the method is one of the following:

230. The second time point is a time during which the characteristic intensity of the second pressure input increases above a pressure intensity threshold; and a time during which the characteristic intensity of the second pressure input decreases below a release intensity threshold.

230. The method of any one of claims 228 or 229.

231. in response to detecting the input sequence including the first pressing input and the second pressing input, in response to a determination that the first pressing input and the second pressing input are separate inputs, 231. The method of any one of claims 228 to 230, comprising performing a third action associated with the second pressure input.

232. 232. The method of any one of claims 228 to 231, wherein performing the first action associated with the first pressing input comprises performing the first action in response to a release event of the first pressing input.

233. 233. The method of any one of claims 228 to 232, wherein the tactile output of the third non-visual output is different from the tactile output of the first non-visual output.

234. 234. The method of any one of claims 228 to 233, wherein a first audio output of the first non-visual output is different from a second audio output of the third non-visual output.

235. the first press input on the home button being a first press event corresponding to an increase in the characteristic intensity of the first contact on the home button above a press intensity threshold followed by a first release event corresponding to a decrease in the characteristic intensity of the first contact below a release intensity threshold; the second press input on the home button is a second press event corresponding to an increase in a characteristic intensity of a second contact on the home button above the pressure intensity threshold.

235. The method of any one of claims 228 to 234.

236. the first press input on the home button being a first press event corresponding to an increase in the characteristic intensity of the first contact on the home button above a press intensity threshold followed by a first release event corresponding to a decrease in the characteristic intensity of the first contact below a release intensity threshold; the second press input on the home button being a second press event corresponding to an increase in the characteristic intensity of the second contact on the home button above the pressure intensity threshold followed by a second release event corresponding to a decrease in the characteristic intensity of the second contact below the release intensity threshold.

235. The method of any one of claims 228 to 234.

237. in response to detecting the first pressing input on the home button, providing the first non-visual output having a first amplitude corresponding to the first value for the intensity-change metric in response to determining that the intensity-change metric of the first pressure input has a first value; providing the first non-visual output having a second amplitude corresponding to the second value for the intensity-change metric, the second amplitude being different from the first amplitude, in response to determining that the intensity-change metric of the first pressure input has a second value different from the first value; The method of claim 235 or 236, comprising:

238. in response to detecting the second press input on the home button, in response to a determination that the first pressing input and the second pressing input are separate inputs, providing the second non-visual output having a third amplitude corresponding to the third value for the intensity-change metric in response to determining that the intensity-change metric of the second pressure input has a third value; providing the second non-visual output having a fourth amplitude corresponding to the fourth value for the intensity-change metric, the fourth amplitude being different from the third amplitude, in response to determining that the intensity-change metric of the second pressure input has a fourth value different from the third value; in response to a determination that the first pressing input and the second pressing input are part of the input pattern, providing the third non-visual output having a fifth amplitude corresponding to the third value for the intensity-change metric in response to determining that the intensity-change metric of the second pressure input has the third value; and providing the third non-visual output having a sixth amplitude corresponding to the fourth value for the intensity-change metric, the sixth amplitude being different from the fifth amplitude, in response to determining that the intensity-change metric of the second pressure input has a fourth value; 238. The method of any one of claims 235 to 237, comprising:

239. initiating a display of a first animation transition from the first user interface to the second user interface in response to detecting the first press input, the first press input coinciding with a transition request to a second user interface and a transition request to a third user interface; in response to detecting the second press input, the second press input being detected while the first animation transition is being displayed, in response to determining that the second pressure input was received at a first time, interrupting the first animation transition from the first user interface to the second user interface at a first point during the first animation transition; displaying a second animated transition from the first point in the first animated transition to the third user interface; and in response to determining that the second pressure input was received at a second time that is later than the first time, interrupting the first animation transition from the first user interface to the second user interface at a second point in the first animation transition that is later than the first point in the first animation transition; displaying a third animation transition from the second point in the first animation transition to the third user interface, the third animation transition being different from the second animation transition; 239. The method of any one of claims 228 to 238, comprising:

240. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors for detecting the intensity of a contact with a home button of the device; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: Displaying a first user interface; While displaying the first user interface, a first press input on the home button; and Detecting a second press input on the home button detected after the first press input; in response to detecting the first pressure input and prior to detecting the second pressure input, providing a first non-visual output having a first non-visual output profile, the first non-visual output providing feedback indicating that the first pressure input has been detected and that the first non-visual output includes a tactile output provided by the one or more tactile output generators; in response to detecting an input sequence including the first press input and the second press input on the home button; in response to a determination that the first pressure input and the second pressure input are separate inputs based on an amount of time between a first time point corresponding to the first pressure input and a second time point corresponding to the second pressure input; performing a first action associated with the first pressure input; providing a second non-visual output having the first non-visual output profile, the second non-visual output providing feedback indicating that the second pressure input has been detected and that the second non-visual output includes a tactile output provided by the one or more haptic output generators; in response to a determination that the first pressure input and the second pressure input are part of an input pattern based on the amount of time between the first time point and the second time point; performing a second action associated with the input pattern, the second action being different from the first action; providing a third non-visual output having a second non-visual output profile distinct from the first non-visual output profile, the third non-visual output providing feedback indicating that the second pressure input has been detected and the third non-visual output including a tactile output provided by the one or more tactile output generators. The electronic device includes instructions for:

241. 1. A computer-readable storage medium storing one or more programs that, when executed by an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors for detecting an intensity of a contact with a home button of the device, cause the device to: Displaying a first user interface; While displaying the first user interface, a first press input on the home button; and detecting a second press input on the home button detected after the first press input; in response to detecting the first pressure input and prior to detecting the second pressure input, causing a first non-visual output having a first non-visual output profile to be provided, the first non-visual output providing feedback indicating that the first pressure input has been detected and that the first non-visual output includes a tactile output provided by the one or more tactile output generators; in response to detecting an input sequence including the first press input and the second press input on the home button; in response to a determination that the first pressure input and the second pressure input are separate inputs based on an amount of time between a first time point corresponding to the first pressure input and a second time point corresponding to the second pressure input; executing a first action associated with the first pressing input; providing a second non-visual output having the first non-visual output profile, the second non-visual output providing feedback indicating that the second pressure input has been detected and that the second non-visual output includes a tactile output provided by the one or more haptic output generators; in response to a determination that the first pressure input and the second pressure input are part of an input pattern based on the amount of time between the first time point and the second time point; performing a second action associated with the input pattern, the second action being different from the first action; and instructions to cause a third non-visual output to be provided having a second non-visual output profile distinct from the first non-visual output profile, the third non-visual output providing feedback indicating that the second pressure input has been detected and that the third non-visual output includes a tactile output provided by the one or more tactile output generators. A computer-readable storage medium.

242. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors for detecting the strength of a contact with a home button of the device; means for displaying a first user interface; While displaying the first user interface, a first press input on the home button; and means for detecting a second press input on the home button detected after the first press input; means for providing, in response to detecting the first pressure input and prior to detecting the second pressure input, a first non-visual output having a first non-visual output profile, the first non-visual output providing feedback indicating that the first pressure input has been detected and that the first non-visual output includes a tactile output provided by the one or more tactile output generators; in response to detecting an input sequence including the first press input and the second press input on the home button; in response to a determination that the first pressure input and the second pressure input are separate inputs based on an amount of time between a first time point corresponding to the first pressure input and a second time point corresponding to the second pressure input; performing a first action associated with the first pressure input; providing a second non-visual output having the first non-visual output profile, the second non-visual output providing feedback indicating that the second pressure input has been detected and that the second non-visual output includes a tactile output provided by the one or more haptic output generators; in response to a determination that the first pressure input and the second pressure input are part of an input pattern based on the amount of time between the first time point and the second time point; performing a second action associated with the input pattern, the second action being different from the first action; means for providing a third non-visual output having a second non-visual output profile distinct from the first non-visual output profile, the third non-visual output providing feedback indicating that the second pressure input has been detected and that the third non-visual output includes a tactile output provided by the one or more tactile output generators; An electronic device comprising:

243. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors for detecting an intensity of contact with a home button of the device, comprising: means for displaying a first user interface; While displaying the first user interface, a first press input on the home button; and means for detecting a second press input on the home button detected after the first press input; means for providing, in response to detecting the first pressure input and prior to detecting the second pressure input, a first non-visual output having a first non-visual output profile, the first non-visual output providing feedback indicating that the first pressure input has been detected and that the first non-visual output includes a tactile output provided by the one or more tactile output generators; in response to detecting an input sequence including the first press input and the second press input on the home button; in response to a determination that the first pressure input and the second pressure input are separate inputs based on an amount of time between a first time point corresponding to the first pressure input and a second time point corresponding to the second pressure input; performing a first action associated with the first pressure input; providing a second non-visual output having the first non-visual output profile, the second non-visual output providing feedback indicating that the second pressure input has been detected and that the second non-visual output includes a tactile output provided by the one or more haptic output generators; in response to a determination that the first pressure input and the second pressure input are part of an input pattern based on the amount of time between the first time point and the second time point; performing a second action associated with the input pattern, the second action being different from the first action; means for providing a third non-visual output having a second non-visual output profile distinct from the first non-visual output profile, the third non-visual output providing feedback indicating that the second pressure input has been detected and the third non-visual output including a tactile output provided by the one or more tactile output generators. Means, An information processing device comprising:

244. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors for detecting the intensity of a contact with a home button of the device; one or more processors; a memory having stored thereon one or more programs configured to be executed by said one or more processors, said one or more programs including instructions for carrying out any of the methods according to claims 228 to 239; An electronic device comprising:

245. 240. A computer-readable storage medium storing one or more programs that, when executed by an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile output, and one or more sensors for detecting intensity of contact with a home button of the device, cause the device to perform any of the methods described in claims 228 to 239.

246. A graphical user interface on an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, one or more sensors for detecting intensity of contact with a home button on the device, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface comprising a user interface displayed according to any of the methods of claims 228 to 239.

247. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors for detecting the intensity of a contact with a home button of the device; Means for carrying out any one of the methods according to claims 228 to 239; An electronic device comprising:

248. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors for detecting an intensity of contact with a home button of the device, comprising:

240. An information processing apparatus comprising means for carrying out any one of the methods described in claims 228 to 239.

249. 1. An electronic device comprising: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts, gestures, and other user inputs; one or more tactile output generation units configured to generate a tactile output; one or more sensor units configured to detect the intensity of a contact with a home button of the device; a processing unit coupled to the display unit, the touch-sensitive surface unit, the one or more tactile output generation units, and the one or more sensor units, Displaying a first user interface; While displaying the first user interface, a first press input on the home button; and Detecting a second press input on the home button detected after the first press input; in response to detecting the first pressure input and prior to detecting the second pressure input, providing a first non-visual output having a first non-visual output profile, the first non-visual output providing feedback indicating that the first pressure input has been detected and that the first non-visual output includes a tactile output provided by the one or more tactile output generators; in response to detecting an input sequence including the first press input and the second press input on the home button; in response to a determination that the first pressure input and the second pressure input are separate inputs based on an amount of time between a first time point corresponding to the first pressure input and a second time point corresponding to the second pressure input; performing a first action associated with the first pressure input; providing a second non-visual output having the first non-visual output profile, the second non-visual output providing feedback indicating that the second pressure input has been detected and that the second non-visual output includes a tactile output provided by the one or more haptic output generators; in response to a determination that the first pressure input and the second pressure input are part of an input pattern based on the amount of time between the first time point and the second time point; performing a second action associated with the input pattern, the second action being different from the first action; providing a third non-visual output having a second non-visual output profile distinct from the first non-visual output profile, the third non-visual output providing feedback indicating that the second pressure input has been detected, and the third non-visual output including a tactile output provided by the one or more tactile output generators. A processing unit configured as described above, An electronic device comprising:

250. The first time point is a time period during which the characteristic intensity of the first pressure input increases above a pressure intensity threshold; and a time during which the characteristic intensity of the first pressure input decreases below a release intensity threshold; The electronic device of claim 249, wherein the electronic device is one of:

251. The second time point is a time during which the characteristic intensity of the second pressure input increases above a pressure intensity threshold; and a time during which the characteristic intensity of the second pressure input decreases below a release intensity threshold; 251. The electronic device of claim 249 or 250, wherein:

252. The processing unit includes: in response to detecting the input sequence including the first pressing input and the second pressing input, in response to a determination that the first pressing input and the second pressing input are separate inputs, 252. The electronic device of any one of claims 249 to 251 configured to perform a third action associated with the second pressure input.

253. 253. The electronic device of any one of claims 249 to 252, wherein performing the first action associated with the first pressing input comprises performing the first action in response to a release event of the first pressing input.

254. 254. The electronic device of any one of claims 249 to 253, wherein the tactile output of the third non-visual output is different from the tactile output of the first non-visual output.

255. 255. The electronic device of any one of claims 249 to 254, wherein a first audio output of the first non-visual output is different from a second audio output of the third non-visual output.

256. the first press input on the home button being a first press event corresponding to an increase in a characteristic intensity of the first contact on the home button above a press intensity threshold followed by a first release event corresponding to a decrease in the characteristic intensity of the first contact below a release intensity threshold; the second press input on the home button is a second press event corresponding to an increase in a characteristic intensity of a second contact on the home button above the pressure intensity threshold.

256. An electronic device according to any one of claims 249 to 255.

257. the first press input on the home button being a first press event corresponding to an increase in a characteristic intensity of the first contact on the home button above a press intensity threshold followed by a first release event corresponding to a decrease in the characteristic intensity of the first contact below a release intensity threshold; the second press input on the home button being a second press event corresponding to an increase in the characteristic intensity of the second contact on the home button above the pressure intensity threshold followed by a second release event corresponding to a decrease in the characteristic intensity of the second contact below the release intensity threshold.

256. An electronic device according to any one of claims 249 to 255.

258. The processing unit includes: in response to detecting the first pressing input on the home button, providing the first non-visual output having a first amplitude corresponding to the first value for the intensity-change metric in response to determining that the intensity-change metric of the first pressure input has a first value; providing the first non-visual output having a second amplitude corresponding to the second value for the intensity-change metric, the second amplitude being different from the first amplitude, in response to determining that the intensity-change metric of the first pressure input has a second value different from the first value.

258. An electronic device as claimed in any one of claims 235 to 257, configured so as to

259. The processing unit includes: in response to detecting the second press input on the home button, in response to a determination that the first pressing input and the second pressing input are separate inputs, providing the second non-visual output having a third amplitude corresponding to the third value for the intensity-change metric in response to determining that the intensity-change metric of the second pressure input has a third value; providing the second non-visual output having a fourth amplitude corresponding to the fourth value for the intensity-change metric, the fourth amplitude being different from the third amplitude, in response to determining that the intensity-change metric of the second pressure input has a fourth value different from the third value; in response to a determination that the first pressure input and the second pressure input are part of the input pattern, providing the third non-visual output having a fifth amplitude corresponding to the third value for the intensity-change metric in response to determining that the intensity-change metric of the second pressure input has the third value; configured, in response to determining that the intensity-change metric of the second pressure input has a fourth value, to provide the third non-visual output having a sixth amplitude corresponding to the fourth value for the intensity-change metric, the sixth amplitude being different from the fifth amplitude.

259. An electronic device according to any one of claims 235 to 258.

260. The processing unit includes: in response to detecting the first press input, the first press input coinciding with a transition request to a second user interface and a transition request to a third user interface, initiate a display of a first animation transition from the first user interface to the second user interface; in response to detecting the second press input, the second press input being detected while the first animation transition is being displayed, in response to determining that the second pressure input was received at a first time, interrupting the first animation transition from the first user interface to the second user interface at a first point during the first animation transition; displaying a second animated transition from the first point in the first animated transition to the third user interface; in response to determining that the second pressure input was received at a second time that is later than the first time, interrupting the first animation transition from the first user interface to the second user interface at a second point in the first animation transition that is later than the first point in the first animation transition; displaying a third animation transition from the second point in the first animation transition to the third user interface, the third animation transition being different from the second animation transition.

260. An electronic device as claimed in any one of claims 249 to 259, configured so as to

261. 1. A method comprising: An electronic device having a touch-sensitive surface, a display, and one or more tactile output generators for generating a tactile output, the electronic device including one or more sensors for detecting an intensity of contact with respective buttons of the device; detecting an input on the respective button, wherein the one or more tactile output generators are used to generate a tactile output indicating that the respective button has been activated, instead of a mechanical switch that detects activation of the respective button when the respective button is mechanically depressed; and in response to detecting the input on the respective button; pursuant to determining that the input satisfies activation criteria, the activation criteria including a requirement that the input include an intensity above a respective intensity threshold in order to satisfy the activation criteria; providing the first tactile output having a first tactile output pattern including vibrations of 0.5 to 4 cycles of the one or more tactile output generators relative to one or more corresponding neutral positions of the one or more tactile output generators, the vibrations of the one or more tactile output generators occurring at a frequency of 80 Hz to 400 Hz; ceasing to provide the first tactile output in response to a determination that the input does not satisfy the activation criterion; and A method comprising:

262. 262. The method of claim 261, wherein the first tactile output pattern comprises 0.5 to 2 cycles of vibration of the one or more tactile output generators relative to the one or more corresponding neutral positions of the one or more tactile output generators.

263. 263. The method of any one of claims 261 or 262, wherein the first tactile output pattern comprises one to two cycles of vibration of the one or more tactile output generators relative to the one or more corresponding neutral positions of the one or more tactile output generators.

264. 264. The method of any one of claims 261 to 263, wherein the vibration of the one or more tactile output generators occurs at a frequency of between 200 Hz and 350 Hz.

265. 265. The method of any one of claims 261 to 264, wherein the vibration of the one or more tactile output generators occurs at a frequency of between 225 Hz and 325 Hz.

266. 266. The method of any one of claims 261 to 265, wherein the vibration of the one or more tactile output generators occurs at a variable frequency selected from two or more frequencies between 150 Hz and 400 Hz.

267. in response to detecting the input on the home button, providing the first tactile output having a first amplitude corresponding to the first value of an intensity-change metric in response to a determination that the input satisfies the activation criterion and a change in a characteristic intensity of the input proximate a time at which the characteristic intensity of the input increases above the respective intensity threshold has a first value for an intensity-change metric; providing the first tactile output having a second amplitude, different from the first amplitude, corresponding to the second value of the intensity-change metric in accordance with a determination that the input satisfies the activation criterion and the change in the characteristic intensity of the input proximate a time at which the characteristic intensity of the input increases above the respective intensity threshold has a second value for the intensity-change metric that is different from the first value for the intensity-change metric; 267. The method of any one of claims 261 to 266, comprising:

268. detecting a second input on the home button after detecting the input on the home button; in response to detecting the first input and prior to detecting the second input, providing the first tactile output having a third amplitude; in response to detecting an input sequence including the input and the second input, in response to determining that the input and the second input are separate inputs based on an amount of time between a first time point corresponding to the input and a second time point corresponding to the second input; providing a second tactile output having the third amplitude, the second tactile output providing feedback indicating that the second input has been detected; and in response to determining that the input and the second input are part of an input pattern based on the amount of time between the first time point and the second time point; providing a third tactile output having a fourth amplitude distinct from the third amplitude, the third tactile output providing feedback indicating that the second input has been detected; and 268. The method of any one of claims 261 to 267, comprising:

269. the input on the home button was detected while a first user interface was being displayed on the display; The method comprises: in response to detecting the input on the home button, upon determining that the input satisfies the activation criterion, ceasing display of the first user interface; and displaying a second user interface on the display; maintaining a display of the first user interface on the display in accordance with a determination that the input does not satisfy the activation criterion; and 269. The method of any one of claims 261 to 268, comprising:

270. 270. The method of claim 269, wherein the second user interface is a system user interface.

271. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors that detect the intensity of a contact with each button of the device; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising: detecting an input on the respective button, wherein the one or more tactile output generators are used to generate a tactile output indicating that the respective button is activated, instead of a mechanical switch that detects activation of the respective button when the respective button is mechanically depressed; in response to detecting the input on the respective button; pursuant to determining that the input satisfies activation criteria, the activation criteria including a requirement that the input include an intensity above a respective intensity threshold in order to satisfy the activation criteria; providing the first tactile output having a first tactile output pattern comprising vibrations of 0.5 to 4 cycles of the one or more tactile output generators relative to one or more corresponding neutral positions of the one or more tactile output generators, the vibrations of the one or more tactile output generators occurring at a frequency of 80 Hz to 400 Hz; ceasing to provide the first tactile output in response to determining that the input does not satisfy the activation criterion. The electronic device includes instructions for:

272. 1. A computer-readable storage medium storing one or more programs that, when executed by an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors for detecting intensity of contact with respective buttons of the device, cause the device to: detecting an input on the respective button, wherein the one or more tactile output generators are used to generate a tactile output indicating that the respective button is activated, instead of a mechanical switch that detects activation of the respective button when the respective button is mechanically depressed; in response to detecting the input on the respective button; pursuant to determining that the input satisfies activation criteria, the activation criteria including a requirement that the input include an intensity above a respective intensity threshold in order to satisfy the activation criteria; providing the first tactile output having a first tactile output pattern including vibrations of 0.5 to 4 cycles of the one or more tactile output generators relative to one or more corresponding neutral positions of the one or more tactile output generators, the vibrations of the one or more tactile output generators occurring at a frequency of 80 Hz to 400 Hz; ceasing providing the first tactile output in response to determining that the input does not satisfy the activation criterion. A computer-readable storage medium.

273. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors that detect the intensity of a contact with each button of the device; means for detecting an input on the respective button, wherein the one or more tactile output generators are used to generate a tactile output indicating that the respective button has been activated when the respective button is mechanically depressed in lieu of a mechanical switch that detects activation of the respective button; and in response to detecting the input on the respective button; upon determining that the input satisfies activation criteria, the activation criteria including a requirement that the input include an intensity above a respective intensity threshold in order to satisfy the activation criteria; providing a first tactile output having a first tactile output pattern including vibrations of 0.5 to 4 cycles of the one or more tactile output generators relative to one or more corresponding neutral positions of the one or more tactile output generators, the vibrations of the one or more tactile output generators occurring at a frequency of 80 Hz to 400 Hz; ceasing to provide the first tactile output in response to determining that the input does not satisfy the activation criterion. and An electronic device comprising:

274. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors for detecting an intensity of contact with respective buttons of the device, comprising: means for detecting an input on the respective button, wherein the one or more tactile output generators are used to generate a tactile output indicating that the respective button has been activated when the respective button is mechanically depressed in lieu of a mechanical switch that detects activation of the respective button; and in response to detecting the input on the respective button; upon determining that the input satisfies activation criteria, the activation criteria including a requirement that the input include an intensity above a respective intensity threshold in order to satisfy the activation criteria; providing a first tactile output having a first tactile output pattern including vibrations of 0.5 to 4 cycles of the one or more tactile output generators relative to one or more corresponding neutral positions of the one or more tactile output generators, the vibrations of the one or more tactile output generators occurring at a frequency of 80 Hz to 400 Hz; ceasing to provide the first tactile output in response to determining that the input does not satisfy the activation criterion. and An information processing device comprising:

275. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors that detect the intensity of a contact with each button of the device; one or more processors; Memory, and one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing any of the methods described in claims 249 to 260.

276. 261. A computer-readable storage medium storing one or more programs which, when executed by an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors for detecting intensity of contact with respective buttons of the device, cause the device to perform any of the methods described in claims 249 to 260.

277. 261. A graphical user interface on an electronic device comprising a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, one or more sensors for detecting intensity of contact with respective buttons of the device, a memory, and one or more processors for executing one or more programs stored in the memory, the graphical user interface including a user interface displayed according to any of the methods of claims 249 to 260.

278. 1. An electronic device comprising: A display and a touch-sensitive surface; and one or more tactile output generators for generating a tactile output; one or more sensors that detect the intensity of a contact with each button of the device; Means for carrying out any of the methods according to claims 249 to 260; An electronic device comprising:

279. 1. An information processing apparatus for use in an electronic device having a display, a touch-sensitive surface, one or more tactile output generators for generating tactile outputs, and one or more sensors for detecting an intensity of contact with respective buttons of the device, comprising:

261. An information processing apparatus comprising means for performing any of the methods described in claims 249 to 260.

280. 1. An electronic device comprising: a display unit configured to display a user interface; a touch-sensitive surface unit configured to detect contacts, gestures, and other user inputs; one or more tactile output generation units configured to generate a tactile output; one or more sensor units configured to detect the intensity of a contact with a respective button of the device; a processing unit coupled to the display unit, the touch-sensitive surface unit, the one or more tactile output generation units, and the one or more sensor units, detecting an input on the respective button, wherein the one or more tactile output generators are used to generate a tactile output indicating that the respective button is activated, instead of a mechanical switch that detects activation of the respective button when the respective button is mechanically depressed; in response to detecting the input on the respective button; upon determining that the input satisfies activation criteria, the activation criteria including a requirement that the input include an intensity above a respective intensity threshold in order to satisfy the activation criteria; providing a first tactile output having a first tactile output pattern including vibrations of 0.5 to 4 cycles of the one or more tactile output generators relative to one or more corresponding neutral positions of the one or more tactile output generators, the vibrations of the one or more tactile output generators occurring at a frequency of 80 Hz to 400 Hz; ceasing to provide the first tactile output in response to determining that the input does not satisfy the activation criterion. A processing unit configured as described above, An electronic device comprising:

281. 281. The electronic device of claim 280, wherein the first tactile output pattern comprises 0.5 to 2 cycles of vibration of the one or more tactile output generators relative to the one or more corresponding neutral positions of the one or more tactile output generators.

282. 282. The electronic device of claim 280, wherein the first tactile output pattern comprises one to two cycles of vibration of the one or more tactile output generators relative to the one or more corresponding neutral positions of the one or more tactile output generators.

283. 283. The electronic device of any one of claims 280 to 282, wherein the vibration of the one or more tactile output generators occurs at a frequency of between 200 Hz and 350 Hz.

284. 284. The electronic device of any one of claims 280 to 283, wherein the vibration of the one or more tactile output generators occurs at a frequency of between 225 Hz and 325 Hz.

285. 285. The electronic device of any one of claims 280 to 284, wherein the vibration of the one or more tactile output generators occurs at a variable frequency selected from two or more frequencies between 150 Hz and 400 Hz.

286. The processing unit includes: in response to detecting the input on the home button, providing the first tactile output having a first amplitude corresponding to the first value of the intensity-change metric pursuant to a determination that the input satisfies the activation criterion and a change in the characteristic intensity of the input proximate a time at which the characteristic intensity of the input increases above the respective intensity threshold has a first value for an intensity-change metric; providing the first tactile output having a second amplitude, different from the first amplitude, corresponding to the second value of the intensity-change metric in accordance with a determination that the input satisfies the activation criterion and the change in the characteristic intensity of the input proximate a time at which the characteristic intensity of the input increases above the respective intensity threshold has a second value for the intensity-change metric that is different from the first value for the intensity-change metric.

286. An electronic device as claimed in any one of claims 280 to 285, configured so as to

287. The processing unit includes: detecting a second input on the home button after detecting the input on the home button; providing the first tactile output having a third amplitude in response to detecting the first input and prior to detecting the second input; in response to detecting an input sequence including the input and the second input, in response to determining that the input and the second input are separate inputs based on an amount of time between a first time point corresponding to the input and a second time point corresponding to the second input; providing a second tactile output having the third amplitude, the second tactile output providing feedback indicating that the second input has been detected; in response to determining that the input and the second input are part of an input pattern based on the amount of time between the first time point and the second time point; and providing a third tactile output having a fourth amplitude distinct from the third amplitude, the third tactile output providing feedback indicating that the second input has been detected.

287. The electronic device of any one of claims 280 to 286, configured so as to

288. the input on the home button was detected while a first user interface was being displayed on the display; The processing unit includes: in response to detecting the input on the home button, upon determining that the input satisfies the activation criterion, ceasing the display of the first user interface; Displaying a second user interface on the display; maintaining a display of the first user interface on the display in accordance with a determination that the input does not satisfy the activation criterion.

288. An electronic device as claimed in any one of claims 280 to 287, configured so as to

289. 289. The electronic device of claim 288, wherein the second user interface is a system user interface.

Images