Device and method for operating a user interface with a stylus

Abstract

To provide an electronic device and method with faster or more efficient methods for manipulating user interfaces with a stylus.SOLUTION: An electronic device includes a touch-sensitive surface, a display, and one or more sensors to detect signals from a stylus. The electronic device is configured to: detect an input from the stylus; determine the characteristics of the input including a distance of the stylus relative to the touch-sensitive display and a direction of movement of the stylus, on the basis of the input; in response to detecting the input, displaying a mark on the display; and adjusting one or more characteristics of the mark, including opacity, width, and / or color, in accordance with virtual drawing means being emulated by the stylus, and changes in the characteristics of the input from the stylus.SELECTED DRAWING: Figure 5A

Description

[Technical Field] 【0001】 This application generally relates to electronic devices having a touch-sensitive surface, including, but not limited to, an electronic device having a touch-sensitive surface for operating a user interface with a stylus. [Background technology] 【0002】 The use of touch-sensitive surfaces as input devices for computers and other electronic computing devices has increased dramatically in recent years. Exemplary examples of touch-sensitive surfaces include touchpads and touchscreen displays. Such surfaces are widely used to interact with user interface objects on displays. 【0003】 The user interface can be operated using either a finger or a stylus. Finger input is more common than stylus input, partly because existing methods using a stylus are cumbersome and inefficient. [Overview of the project] 【0004】 Accordingly, electronic devices with a faster and more efficient method for manipulating a user interface with a stylus are disclosed herein. Such methods optionally complement or replace existing methods for manipulating a user interface with a stylus. Such methods reduce the number, range, and / or types of user input, creating a more efficient human-machine interface. With respect to battery-operated devices, such methods conserve power and increase the interval between battery recharging cycles. 【0005】 The defects and other problems associated with user interfaces for electronic devices having touch-sensitive surfaces are mitigated or eliminated by the disclosed device. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (e.g., a notebook computer, tablet computer, or handheld device). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensitive display (also known as a “touchscreen” or “touchscreen display”). In some embodiments, the device has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or instruction sets stored in memory to perform a plurality of functions. In some embodiments, the user interacts with the GUI primarily through stylus and / or finger touch and gestures on the touch-sensitive surface. In some embodiments, the functions optionally include image editing, drawing, presentation, word processing, website creation, disk authoring, spreadsheet creation, gameplay, making phone calls, video conferencing, sending emails, instant messaging, training support, digital photography, digital videography, web browsing, digital music playback, and / or digital video playback. Executable instructions for performing these functions are optionally included in a non-temporary computer-readable storage medium or in other computer program products configured to run by one or more processors. Executable instructions for performing these functions are optionally included in a temporary computer-readable medium or in other computer program products configured to run by one or more processors. 【0006】 An electronic device is disclosed herein that has an improved method for displaying and updating markers corresponding to the orientation of a stylus. Such a method optionally complements or replaces conventional methods for displaying markers. Such a method reduces the number, range, and / or types of user input, creating a more efficient human-machine interface. With respect to battery-operated devices, such a method saves power and increases the interval between battery charging. 【0007】 In some embodiments, the method is performed on an electronic device having a touch-sensitive display, the device including one or more sensors that detect signals from a stylus associated with the device, the stylus including a representative portion (e.g., the tip of the stylus). The method includes detecting the orientation of the stylus, corresponding to the distance of the stylus to the touch-sensitive display, the tilt of the stylus to the touch-sensitive display, and / or the orientation of the stylus to the touch-sensitive display; determining the position of the stylus on the touch-sensitive display corresponding to the detected orientation of the stylus; displaying a marker on the touch-sensitive display for the position determined before the stylus touches the touch-sensitive display, according to the orientation of the stylus; detecting changes in the distance, tilt, and / or orientation of the stylus before the stylus touches the touch-sensitive display; and updating the displayed marker on the touch-sensitive display in response to the detected changes. 【0008】 In some embodiments, the electronic device includes a touch-sensitive display unit configured to display a user interface and receive user contact (including stylus contact); one or more sensor units configured to detect signals from a stylus associated with the device; and a processing unit coupled to the touch-sensitive display unit and the one or more sensor units. The processing unit is configured to detect the orientation of the stylus, corresponding to the distance of the stylus to the touch-sensitive display unit, the tilt of the stylus to the touch-sensitive display unit, and / or the orientation of the stylus to the touch-sensitive display unit; to determine the position of the stylus on the touch-sensitive display unit corresponding to the detected orientation of the stylus; to enable the display of a marker on the touch-sensitive display unit at the position determined before the stylus touches the touch-sensitive display unit, according to the orientation of the stylus; to detect changes in the distance, tilt, and / or orientation of the stylus before the stylus touches the touch-sensitive display unit; and to update the displayed marker on the touch-sensitive display unit in response to the detected changes. 【0009】 Therefore, an electronic device comprising a display, a touch-sensitive surface, and one or more sensors that optionally detect signals from a stylus associated with the device, provides a faster and more efficient method for displaying and updating markers corresponding to the stylus's orientation, thereby improving the effectiveness, efficiency, and user satisfaction of such a device. Such a method can complement or replace conventional methods for displaying markers. 【0010】 This specification discloses an electronic device having an improved method for displaying and updating markers corresponding to the orientation of a stylus while the stylus is in contact with a device (e.g., the device's touch-sensitive display). Such a method optionally complements or replaces conventional methods for displaying markers. Such a method reduces the number, range, and / or types of user input, creating a more efficient human-machine interface. With respect to battery-operated devices, such a method conserves power and increases the interval between battery charging. 【0011】 In some embodiments, the method is performed on an electronic device having a touch-sensitive display, the device including one or more sensors for detecting signals from a stylus associated with the device, the stylus including a tip (or other representative portion). The method includes detecting a stylus orientation state corresponding to the position of the stylus tip on the touch-sensitive display, the tilt of the stylus relative to the touch-sensitive display, and the orientation of the stylus relative to the touch-sensitive display while the tip of the stylus is in contact with the touch-sensitive display; determining a first position on the touch-sensitive display corresponding to the detected orientation state of the stylus; displaying a marker on the touch-sensitive display at the first position corresponding to the detected orientation state of the stylus, which is a first offset from the position of the stylus tip on the touch-sensitive display; detecting a change in the orientation of the stylus; determining a second position on the touch-sensitive display corresponding to the change in the orientation of the stylus, which is a second offset from the position of the stylus tip on the touch-sensitive display, in response to the detection of a change in the orientation of the stylus; and displaying a marker on the touch-sensitive display at the second position. 【0012】 In some embodiments, the electronic device includes a touch-sensitive display unit configured to display a user interface and receive user contact (including stylus contact); one or more sensor units associated with the device and configured to detect signals from a stylus including an tip; and a processing unit coupled to the touch-sensitive display unit and the one or more sensor units. The processing unit is configured to detect the orientation of the stylus, corresponding to the position of the tip of the stylus on the touch-sensitive display unit, the tilt of the stylus relative to the touch-sensitive display unit, and the orientation of the stylus relative to the touch-sensitive display unit, while the tip of the stylus is in contact with the touch-sensitive display unit. It then determines a first position on the touch-sensitive display unit corresponding to the detected orientation of the stylus, and enables the display of a marker for the first position corresponding to the detected orientation of the stylus, which is located at a first offset from the position of the tip of the stylus on the touch-sensitive display unit. The processing unit is configured to detect a change in the orientation of the stylus, and in response to the detection of a change in the orientation of the stylus, it determines a second position on the touch-sensitive display unit corresponding to the change in the orientation of the stylus, which is located at a second offset from the position of the tip of the stylus on the touch-sensitive display unit, and enables the display of a marker for the second position on the touch-sensitive display unit. 【0013】 Therefore, an electronic device comprising a touch-sensitive display and one or more sensors for detecting signals from a stylus associated with the device may have a faster and more efficient method for displaying and updating markers corresponding to the orientation of the stylus while the stylus is in contact with the device (e.g., with the device's touch-sensitive display), thereby improving the effectiveness, efficiency, and user satisfaction of such a device. Such a method may complement or replace conventional methods for displaying markers. 【0014】 An electronic device is disclosed herein that has an improved method for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus. Such a method optionally complements or replaces conventional methods for displaying marks. Such a method reduces the number, range, and / or types of user input, creating a more efficient human-machine interface. With respect to battery-operated devices, such a method saves power and increases the interval between battery charging. 【0015】 In some embodiments, the method is performed in an electronic device comprising a touch-sensitive surface and a display, the device comprising one or more sensors for detecting signals from a stylus associated with the device. The method comprises detecting input from a stylus; determining a plurality of characteristics of the input from the stylus, including the orientation of the stylus to the touch-sensitive surface during input and the direction of movement of the stylus across the touch-sensitive surface during input ("orientation"); generating a mark to be displayed on the display having characteristics including opacity, width, and / or color, in response to the detection of input from the stylus; and adjusting one or more characteristics of the mark in accordance with a virtual drawing means emulated by the stylus and changes in the plurality of characteristics of the input from the stylus during input. 【0016】 In some embodiments, the electronic device includes a display unit configured to display a user interface, a touch-sensitive surface unit configured to receive user contact (including stylus contact), one or more sensor units configured to detect signals from a stylus associated with the device, and a processing unit coupled to the display unit, the touch-sensitive surface unit, and the one or more sensor units. The processing unit is configured to detect input from the stylus, determine a plurality of characteristics of the input from the stylus, including the orientation of the stylus to the touch-sensitive surface unit during input and the direction of movement of the stylus across the touch-sensitive surface unit during input ("orientation"), generate a mark to be displayed on the display unit having characteristics including opacity, width, and / or color, in response to the detection of input from the stylus, and adjust one or more characteristics of the mark in accordance with a virtual drawing means emulated by the stylus and changes in the plurality of characteristics of the input from the stylus during input. 【0017】 Therefore, an electronic device comprising a display, a touch-sensitive surface, and one or more sensors for detecting signals from a stylus associated with the device may have a faster and more efficient method for adjusting one or more characteristics of a mark according to the characteristics of the input from the stylus, thereby improving the effectiveness, efficiency, and user satisfaction of such a device. Such a method may complement or replace conventional methods for displaying marks. 【0018】 Electronic devices having an improved method for creating messages using stylus and finger input are disclosed herein. Such a method optionally complements or replaces conventional methods for creating messages using stylus and finger input. Such a method reduces the number, range, and / or types of user input, creating a more efficient human-machine interface. With respect to battery-operated devices, such a method conserves power and increases the interval between battery charging. 【0019】 In some embodiments, the method is performed on an electronic device having a touch-sensitive display, the device including one or more sensors for detecting signals from a stylus associated with the device. The method includes displaying a user interface for a communication application on the touch-sensitive display; detecting an input corresponding to a request to make a communication; displaying a keyboard for typing a text message in response to detecting an input corresponding to a request to make a communication, according to a determination that the input is finger input; and displaying a drawing canvas for generating a drawing message in response to a determination that the input is stylus input. 【0020】 In some embodiments, the electronic device includes a touch-sensitive display unit configured to display a user interface and receive user contact (including stylus contact), one or more sensor units configured to detect signals from a stylus associated with the device, and a processing unit coupled to the touch-sensitive display unit and the one or more sensor units. The processing unit is configured to enable the display of a user interface for a communication application on the touch-sensitive display unit, detect inputs corresponding to requests to create communications, and, in response to the detection of inputs corresponding to requests to create communications, enable the display of a keyboard for keying text messages according to a determination that the input is finger input, and enable the display of a drawing canvas for generating drawing messages according to a determination that the input is stylus input. 【0021】 In some embodiments, the method is performed on an electronic device having a touch-sensitive display, the device being associated with a first individual. The method includes displaying a user interface for a communication application, including an input area, which displays a content balloon on the touch-sensitive display containing instant messaging conversations between a first individual and a second individual, and an input area, which displays a content balloon containing instant messages exchanged between the first individual and a second individual, which display instant messaging conversations between the first individual and a second individual, which display instant messaging conversations between the first individual and a second individual, which display instant messaging conversations between the first individual and a second individual, which display instant messaging conversations between the first individual and a second individual, which display instant messaging conversations between the first individual and a second individual, which display an input area, which detects a selection of a digital image containing multiple colors, which detects an input to select a first color in the color palette, and which detects an input to select a first color in the color palette. The process includes detecting one or more drawing inputs on a digital image within an input area, drawing on the digital image in a first color according to the one or more drawing inputs, detecting a request to send the drawn digital image as an instant message to a second person in an instant messaging conversation, sending the drawn digital image as an instant message to the second person in the instant messaging conversation in response to detecting a request to send the drawn digital image as an instant message, and displaying the drawn digital image as an instant message in the instant messaging conversation on a touch-sensitive display. 【0022】 In some embodiments, an electronic device associated with a first individual includes a touch-sensitive display unit configured to display a user interface and receive user contact (including stylus contact), and a processing unit coupled to the touch-sensitive display unit. The processing unit is configured to enable the display of a user interface for a communication application, including an input area, which displays a content balloon on a touch-sensitive display unit containing an instant messaging conversation between a first individual and a second individual, and an input area, which displays an instant messaging conversation between a first individual and a second individual, which displays an instant messaging conversation between a first individual and a second individual, which displays an instant messaging conversation between a first individual and a second individual, which displays an instant messaging conversation between a first individual and a second individual, which displays a content balloon on a touch-sensitive display unit containing an instant messaging conversation between a first individual and a second individual, which displays an instant messaging conversation between a first individual and a second individual, which displays an instant messaging conversation conversation between a first individual and a second individual, which displays an instant messaging conversation conversation between a first individual and a second individual, which displays a content balloon containing an instant messaging conversation between a first individual and a second individual, which displays an instant messaging conversation conversation between a first individual and a second individual, which displays a content balloon containing an instant messaging conversation between a first individual and a second individual, which displays an instant messaging conversation conversation between a first individual and a second individual, which displays a content balloon containing an instant messaging conversation between a first individual and a second individual, which displays a content balloon on a touch-sensitive display unit containing an instant messaging conversation between a first individual and a second individual, which displays a content balloon on a touch-sensitive display unit containing an instant messaging conversation conversation between a first individual and a second individual, which displays a content balloon on a touch-sensitive display unit containing an instant messaging conversation conversation conversation between a first individual and a second individual, which displays a content balloon on a touch-sensitive display unit containing an instant messaging conversation conversation conversation conversation conversation a conversation conversation a conversation conversation a conversation conversation a conversation conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation a conversation 【0023】 In some embodiments, the method is performed on an electronic device having a touch-sensitive display, the device being associated with a first individual. The method includes displaying a user interface for a communication application, including an input area, a content balloon on the touch-sensitive display, which contains an instant messaging conversation between a first individual and a second individual, and a content balloon containing an instant message exchanged between the first individual and a second individual; receiving a signal indicating that the second individual is composing an instant message; displaying a key-input message creation indicator in the user interface for the communication application in response to receiving a signal indicating that the second individual is composing an instant message, in accordance with a determination that the second individual is key-inputting an instant message; displaying a drawing message creation indicator in the user interface for the communication application in accordance with a determination that the second individual is drawing an instant message; receiving an instant message created by the second individual; ceasing to display the key-input message creation indicator or the drawing message creation indicator in response to receiving an instant message created by the second individual corresponding to a displayed message creation indicator; and displaying a content balloon containing an instant message created by the second individual in the instant messaging conversation. 【0024】 According to some embodiments, an electronic device associated with a first individual includes a touch-sensing display unit configured to display a user interface and receive user contacts (including stylus contacts), and a processing unit coupled to the touch-sensing display unit. The processing unit enables the display of a user interface of a communication application that includes an instant messaging conversation between the first individual and a second individual, and an input area, on the touch-sensing display unit, having a content balloon with instant messages exchanged between the first individual and the second individual, receives a signal indicating that the second individual is creating an instant message, and in response to receiving the signal indicating that the second individual is creating an instant message, enables the display of a keystroke message creation indicator within the user interface of the communication application according to a determination that the second individual is keying in an instant message, enables the display of a drawing message creation indicator separate from the keystroke message creation indicator within the user interface of the communication application according to a determination that the second individual is drawing an instant message, receives an instant message created by the second individual, and in response to receiving the instant message created by the second individual corresponding to the displayed message creation indicator, discontinues enabling the display of the keystroke message creation indicator or the drawing message creation indicator, and enables the display of a content balloon including the instant message created by the second individual within the instant messaging conversation, and is configured as such. 【0025】 Thus, an electronic device comprising a touch sensing display and one or more sensors for detecting signals from a stylus optionally associated with the device provides a faster and more efficient way to create messages with stylus and finger inputs, thereby improving the effectiveness, efficiency, and user satisfaction of such devices. Such methods can complement or replace conventional methods for creating messages with stylus and finger inputs. 【0026】 An electronic device with an improved method for accessing a drawing application on a locked device is disclosed. Such methods optionally complement or replace conventional methods for accessing a drawing application on a locked device. Such methods reduce the number, range, and / or type of user inputs, creating a more efficient human machine interface. For battery-operated devices, such methods conserve power and increase the intervals between battery charges. 【0027】 In some embodiments, the method is performed on an electronic device having a touch-sensitive display, the device including one or more sensors for detecting signals from a stylus associated with the device. The method includes: displaying a lock screen user interface on the touch-sensitive display while the electronic device is in a locked state; detecting a first input from a stylus drawing on the touch-sensitive display while the lock screen user interface is displayed on the touch-sensitive display; displaying one or more marks of a drawing corresponding to the first input from the stylus on the lock screen user interface in response to the detection of the first input from the drawing stylus; detecting a second input from a stylus displaying a drawing application in restricted mode while the lock screen user interface is displaying one or more marks of a drawing corresponding to the first input from the stylus; and running the drawing application in restricted mode in response to the detection of the second input from the stylus displaying the drawing application to display one or more marks of a drawing within the drawing application. 【0028】 In some embodiments, the electronic device includes a touch-sensitive display unit configured to display a user interface and receive user contact (including stylus contact), one or more sensor units configured to detect signals from a stylus associated with the device, and a processing unit coupled to the touch-sensitive display unit and the one or more sensor units. The processing unit is configured to enable the display of a lock screen user interface on the touch-sensitive display unit while the electronic device is locked, to detect a first input from a stylus drawing on the touch-sensitive display unit while the display of the lock screen user interface is enabled on the touch-sensitive display unit, and in response to the detection of the first input from the drawing stylus, to enable the display of one or more marks of a drawing corresponding to the first input from the stylus on the lock screen user interface, and in response to the detection of the second input from the drawing stylus, to run the drawing application in restricted mode and enable the display of one or more marks within the drawing application. 【0029】 In some embodiments, the method is performed on an electronic device having a touch-sensitive display, the device including one or more sensors for detecting signals from a stylus associated with the device. The method includes displaying a lock screen user interface on the touch-sensitive display while the electronic device is locked; detecting user input while the lock screen user interface is displayed on the touch-sensitive display; replacing the display of the lock screen user interface with a display of a drawing application in a restricted session, according to a determination that the user input is a default input from a stylus; and maintaining the display of the lock screen user interface and discontinuing the display of the drawing application, according to a determination that the user input is a touch input from a finger. 【0030】 In some embodiments, the electronic device includes a touch-sensitive display unit configured to display a user interface and receive user contact (including stylus contact), one or more sensor units configured to detect signals from a stylus associated with the device, and a processing unit coupled to the touch-sensitive display unit and the one or more sensor units. The processing unit is configured to enable the display of a lock screen user interface on the touch-sensitive display unit while the electronic device is locked, to detect user input while the display of the lock screen user interface is enabled on the touch-sensitive display unit, and, according to a determination that the user input is the default input from a stylus, to replace the display of the lock screen user interface with a display of a drawing application in a restricted session, and, according to a determination that the user input is a touch input from a finger, to maintain the display of the lock screen user interface and discontinue the display of the drawing application. 【0031】 In some embodiments, the method is performed on an electronic device having a touch-sensitive display, the device including one or more sensors that detect signals from a stylus associated with the device. The method includes: displaying a lock screen user interface, including a lock screen image, on the touch-sensitive display while the electronic device is in a locked state; detecting a first input by a stylus on the touch-sensitive display, including detecting an initial contact by the stylus on the touch-sensitive display at the start of the first input while the lock screen user interface is displayed on the touch-sensitive display; detecting movement of the stylus across the touch-sensitive display during the first input; detecting lift-off of the stylus from the touch-sensitive display at the end of the first input; and drawing a first mark to be displayed on the lock screen image in accordance with the movement of the stylus across the touch-sensitive display, in response to the detection of movement of the stylus across the touch-sensitive display. This includes, in response to detecting the lift-off of the stylus from Ray, ceasing to display the lock screen user interface, including ceasing to display the lock screen image, displaying the user interface for a drawing application in a restricted session, displaying within the user interface for a drawing application in a restricted session a first mark drawn in accordance with the movement of the stylus across the touch-sensitive display during the first input, detecting a second input from the stylus on the touch-sensitive display while the user interface for a drawing application in a restricted session is being displayed, and drawing a second mark within the user interface for a drawing application in a restricted session, which is displayed together with the first mark, in response to detecting the second input from the stylus on the touch-sensitive display. 【0032】 In some embodiments, the electronic device includes a touch-sensitive display unit configured to display a user interface and receive user contact (including stylus contact), one or more sensor units configured to detect signals from a stylus associated with the device, and a processing unit coupled to the touch-sensitive display unit and the one or more sensor units. The processing unit enables the display of a lock screen user interface, including a lock screen image, on the touch-sensitive display unit while the electronic device is in a locked state, detects a first input by a stylus on the touch-sensitive display unit, including detecting an initial contact by a stylus on the touch-sensitive display unit at the start of the first input while the display of the lock screen user interface on the touch-sensitive display unit is enabled, detects the movement of the stylus across the touch-sensitive display unit during the first input, detects the lift-off of the stylus from the touch-sensitive display unit at the end of the first input, and, in response to detecting the movement of the stylus across the touch-sensitive display unit, draws a first mark to be displayed on the lock screen image in accordance with the movement of the stylus across the touch-sensitive display unit. In response to the detection of stylus lift-off from the unit, the system is configured to stop enabling the display of the lock screen user interface, including stopping the display of the lock screen image, enable the display of the user interface for drawing applications in restricted sessions, enable the display of a first mark drawn in accordance with the movement of the stylus across the touch-sensitive display unit during a first input within the user interface for drawing applications in restricted sessions, detect a second input from the stylus on the touch-sensitive display unit while the user interface for drawing applications in restricted sessions is enabled, and, in response to the detection of a second input from the stylus on the touch-sensitive display unit, draw a second mark that will be displayed together with the first mark within the user interface for drawing applications in restricted sessions. 【0033】 Therefore, an electronic device comprising a touch-sensitive display and one or more sensors for detecting signals from a stylus associated with the device provides a faster and more efficient method for accessing drawing applications on a locked device, thereby improving the effectiveness, efficiency, and user satisfaction of such a device. Such a method can complement or replace conventional methods for accessing drawing applications on a locked device. 【0034】 Electronic devices are disclosed herein that have a faster and more efficient method for selectively using virtual drawing means with a stylus. Such a method optionally complements or replaces conventional methods for emulating virtual drawing means with a stylus. Such a method reduces the number, range, and / or types of user input, creating a more efficient human-machine interface. With respect to battery-operated devices, such a method saves power and increases the interval between battery charging. 【0035】 In some embodiments, the method is carried out in an electronic device comprising a display, a touch-sensing surface, and one or more sensors for detecting signals from a stylus associated with the device. The method includes: displaying an electronic document on a display; detecting a first input from a stylus, including detecting initial contact by the stylus on a touch-sensitive surface while the electronic document is displayed on the display; determining several characteristics of the first input from the stylus, including the tilt of the stylus, which is the angle of the stylus with respect to the normal of the surface of the touch-sensitive surface; selecting a first virtual drawing means for the stylus to emulate, according to the determination that the tilt satisfies one or more selection criteria for a first virtual drawing means; selecting a second virtual drawing means, separate from the first virtual drawing means, for the stylus to emulate, according to the determination that the tilt satisfies one or more selection criteria for a second virtual drawing means; and generating a mark in the electronic document with the selected virtual drawing means in response to the detection of the first input from the stylus, after the stylus has selected one of the first and second virtual drawing means for emulation. 【0036】 In some embodiments, the electronic device includes a display unit configured to display a user interface, a touch-sensing surface unit configured to receive user contact (including stylus contact), one or more sensor units configured to detect signals from a stylus associated with the device, and a processing unit coupled to the display unit, the touch-sensing surface unit, and the one or more sensor units. The processing unit is configured to enable the display of an electronic document on the display unit, detect a first input from a stylus, including detecting initial contact by the stylus on the touch-sensing surface unit while the display of the electronic document on the display unit is enabled, determine several characteristics of the first input from the stylus, including the tilt of the stylus, which is the angle of the stylus with respect to the normal of the surface of the touch-sensing surface unit, select a first virtual drawing means for the stylus to emulate according to the determination that the tilt satisfies one or more selection criteria for a first virtual drawing means, select a second virtual drawing means separate from the first virtual drawing means for the stylus to emulate according to the determination that the tilt satisfies one or more selection criteria for a second virtual drawing means, and after selecting one of the first and second virtual drawing means for the stylus to emulate, generate a mark in the electronic document with the selected virtual drawing means in response to the detection of the first input from the stylus. 【0037】 Therefore, an electronic device comprising a display, a touch-sensitive surface, one or more sensors for detecting signals from a stylus associated with the device, and one or more sensors optionally for detecting the intensity of contact with the touch-sensitive surface, provides a faster and more efficient method for emulating virtual drawing means using a stylus, thereby improving the effectiveness, efficiency, and user satisfaction of such a device. Such a method can complement or replace conventional methods for emulating virtual drawing means using a stylus. 【0038】 An electronic device is disclosed herein that has an improved method for creating events in a calendar using handwritten input. Such a method optionally complements or replaces conventional methods for creating events in a calendar. Such a method reduces the number, range, and / or type of user input, creating a more efficient human-machine interface. With respect to battery-operated devices, such a method saves power and increases the interval between battery recharging. 【0039】 In some embodiments, the method is performed on an electronic device having a touch-sensitive display. The method includes displaying an electronic calendar on the touch-sensitive display, the displayed calendar including an area corresponding to a first day. The method further includes detecting a handwritten input on the touch-sensitive display, the handwritten input extending over less than all of the vertical portions of the first day in the displayed calendar. The method further includes, in response to detecting the handwritten input, displaying a graphic corresponding to the handwritten input over the vertical portion of the first day. The method further includes, while displaying the graphic corresponding to the handwritten input over the vertical portion of the first day, detecting an input corresponding to a request to create an event in the electronic calendar, and, in response to detecting the input corresponding to a request to create an event in the electronic calendar, creating an event in the first day in the electronic calendar having a start time and an end time, the start time and end time of the event according to the vertical portion of the first day. 【0040】 According to some embodiments, the electronic device includes a touch-sensitive display unit and a processing unit coupled to the touch-sensitive display unit. The touch-sensitive display unit is configured to display an electronic calendar on the touch-sensitive display unit, the displayed calendar including an area corresponding to a first day. The touch-sensitive display unit is further configured to detect handwriting input on the touch-sensitive display unit, the handwriting input extending over less than all of the vertical portions of the first day in the displayed calendar. In response to detecting the handwriting input, the touch-sensitive display unit displays a graphic corresponding to the handwriting input on the vertical portions of the first day, and while displaying the graphic corresponding to the handwriting input on the vertical portions of the first day, is further configured to detect an input corresponding to a request to create an event in the electronic calendar. In response to detecting an input corresponding to a request to create an event in the electronic calendar, the processing unit is configured to create an event in the first day of the electronic calendar having a start time and an end time, the start time and end time of the event according to the vertical portions of the first day. 【0041】 Therefore, an electronic device comprising a touch-sensitive display and one or more sensors that optionally detect the intensity of contact with the touch-sensitive surface provides a faster and more efficient method for creating calendar events, thereby improving the effectiveness, efficiency, and user satisfaction of such a device. Such a method can complement or replace conventional methods for creating calendar events. 【0042】 An electronic device is disclosed that has an improved method for selecting a portion of a video. Such a method optionally complements or replaces conventional methods for selecting a portion of a video. Such a method reduces the number, range, and / or types of user input, creating a more efficient human-machine interface. With respect to battery-operated devices, such a method saves power and increases the interval between battery charging. 【0043】 In some embodiments, the method is performed on an electronic device having a touch-sensitive display. The method includes displaying a video editing application that includes a timeline area for a video being edited. The method further includes detecting a gesture by touch on the touch-sensitive display. The gesture includes an initial contact with the timeline area by touch occurring at a first time position in the timeline area, movement of the contact across the touch-sensitive display after the initial contact with the timeline area, and lift-off of the contact at a position on the touch-sensitive display corresponding to a second time position in the timeline area. The method further includes selecting a portion of the video being edited in response to the detection of a gesture by touch on the touch-sensitive display. The selected portion of the video begins at the first time position and ends at the second time position. 【0044】 According to some embodiments, the electronic device includes a touch-sensitive display unit and a processing unit coupled to the touch-sensitive display unit. The touch-sensitive display unit is configured to display a video application, which includes a timeline area for a video being edited. The processing unit is configured to detect gestures by touch on the touch-sensitive display unit. The gesture includes an initial contact with the timeline area by touch occurring at a first time position in the timeline area, movement of the contact across the touch-sensitive display unit after the initial contact with the timeline area, and lift-off of the contact at a position on the touch-sensitive display unit corresponding to a second time position in the timeline area. The processing unit is also configured to select a portion of the video being edited in response to detecting a gesture by touch on the touch-sensitive display unit, the selected portion of the video starting at the first time position and ending at the second time position. 【0045】 Therefore, an electronic device comprising a display, a touch-sensitive surface, and one or more sensors that selectively detect the intensity of contact with the touch-sensitive surface provides a faster and more efficient method for selecting a portion of a video, thereby improving the effectiveness, efficiency, and user satisfaction of such a device. Such a method can complement or replace conventional methods for selecting a portion of a video. 【0046】 An electronic device having an improved method for displaying and using a menu with a stylus is disclosed herein. Such a method optionally complements or replaces conventional methods for displaying and using menus. Such a method reduces the number, range, and / or types of user input, creating a more efficient human-machine interface. With respect to battery-operated devices, such a method saves power and increases the interval between battery charging. 【0047】 In some embodiments, the method is performed on an electronic device having a touch-sensitive display, the device including one or more sensors for detecting signals from a stylus associated with the device. The method includes displaying a user interface on the touch-sensitive display; detecting that a stylus moves toward the touch-sensitive display without contacting the touch-sensitive display while the user interface is being displayed on the touch-sensitive display; determining whether the detected movement of the stylus toward the touch-sensitive display without contacting the touch-sensitive display satisfies one or more stylus movement criteria; displaying a menu containing a plurality of selectable menu options overlaid on the user interface in accordance with the determination that the detected movement of the stylus satisfies one or more stylus movement criteria; detecting the selection of a first menu option among the plurality of selectable menu options; and, in response to the detection of the selection of a first menu option among the plurality of selectable menu options, ceasing to display the menu by performing an action corresponding to the first menu option. 【0048】 In some embodiments, the electronic device includes a touch-sensitive display unit configured to display a user interface and receive user contact (including stylus contact), one or more sensor units configured to detect signals from a stylus associated with the device, and a processing unit coupled to the touch-sensitive display unit and the one or more sensor units. The processing unit is configured to enable the display of the user interface on the touch-sensitive display unit, detect when a stylus moves toward the touch-sensitive display unit without contacting the touch-sensitive display unit while the display of the user interface on the touch-sensitive display unit is enabled, determine whether the detected movement of the stylus toward the touch-sensitive display unit without contacting the touch-sensitive display unit satisfies one or more stylus movement criteria, enable the display of a menu overlaid on the user interface, including a plurality of selectable menu options, detect the selection of a first menu option among the plurality of selectable menu options, and, in response to the detection of the selection of a first menu option among the plurality of selectable menu options, perform the action corresponding to the first menu option and stop displaying the menu. 【0049】 Therefore, an electronic device comprising a touch-sensitive display and one or more sensors for detecting signals from a stylus associated with the device provides a faster and more efficient method for displaying and using menus with a stylus, thereby improving the effectiveness, efficiency, and user satisfaction of such a device. Such a method can complement or replace conventional methods for displaying menus. 【0050】 In some embodiments, an electronic device includes a display, a touch-sensitive surface, one or more sensors that optionally detect the intensity of contact with the touch-sensitive surface, one or more processors, memory, and one or more programs, the one or more programs being stored in memory and configured to be executed by the one or more processors, and the one or more programs including instructions to perform or cause to perform any of the operations described herein. In some embodiments, a computer-readable storage medium stores instructions internally, and when executed by an electronic device comprising a display, a touch-sensitive surface, and one or more sensors that optionally detect the intensity of contact with the touch-sensitive surface, the instructions cause or cause the device to perform any of the operations described herein. In some embodiments, a graphical user interface on an electronic device comprising a display, a touch-sensitive surface, one or more sensors that optionally detect the intensity of contact with the touch-sensitive surface, memory, and one or more processors that execute one or more programs stored in memory includes one or more of the elements displayed in any of the above methods, and these elements are updated in response to input as described in any of the methods described herein. In some embodiments, an electronic device includes a display, a touch-sensitive surface, one or more sensors for optionally detecting the intensity of contact with the touch-sensitive surface, and means for performing or causing to perform any of the operations described herein. In some embodiments, an information processing device for use in an electronic device comprising a display, a touch-sensitive surface, and one or more sensors for optionally detecting the intensity of contact with the touch-sensitive surface includes means for performing or causing to perform any of the operations described herein. 【0051】 Therefore, an electronic device comprising a display, a touch-sensitive surface, and one or more sensors that optionally detect the intensity of contact with the touch-sensitive surface provides a faster and more efficient method for manipulating a user interface with a stylus, thereby improving the effectiveness, efficiency, and user satisfaction of such a device. Such a method can complement or replace conventional methods for manipulating a user interface with a stylus. [Brief explanation of the drawing] 【0052】 To better understand the various embodiments described, please refer to the following "Modes for Carrying Out the Invention" in conjunction with the drawings. Here, similar reference numbers refer to the corresponding parts across those drawings. 【0053】 [Figure 1A] This is a block diagram showing a portable multifunctional device with a touch-sensitive display, according to several embodiments. 【0054】 [Figure 1B] This is a block diagram showing exemplary components for event handling according to several embodiments. 【0055】 [Figure 2] Several embodiments of a portable multifunctional device equipped with a touchscreen are shown. 【0056】 [Figure 3] This is a block diagram of an exemplary multifunctional device comprising a display and a touch-sensitive surface, according to several embodiments. 【0057】 [Figure 4] This is a block diagram of an exemplary electronic stylus according to several embodiments. 【0058】 [Figure 5A]The following shows the orientation of the stylus relative to the touch-sensing surface according to several embodiments. [Figure 5B] The following shows the orientation of the stylus relative to the touch-sensing surface according to several embodiments. 【0059】 [Figure 6A] The following are exemplary user interfaces for application menus in portable multifunction devices according to several embodiments. 【0060】 [Figure 6B] This document illustrates exemplary user interfaces for a multifunctional device having a touch-sensitive surface separate from the display, according to several embodiments. 【0061】 [Figure 7A] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 7B] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 7C] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 7D] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 7E] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 7F] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 7G] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 7H] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 7I] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 7J] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. 【0062】 [Figure 8A] This flowchart illustrates a method for displaying and updating markers corresponding to the orientation of a stylus, according to several embodiments. [Figure 8B] This flowchart illustrates a method for displaying and updating markers corresponding to the orientation of a stylus, according to several embodiments. [Figure 8C] This flowchart illustrates a method for displaying and updating markers corresponding to the orientation of a stylus, according to several embodiments. [Figure 8D] This flowchart illustrates a method for displaying and updating markers corresponding to the orientation of a stylus, according to several embodiments. 【0063】 [Figure 9] This is a functional block diagram of an electronic device according to several embodiments. 【0064】 [Figure 10A] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 10B] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 10C] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 10D] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 10E] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 10F] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 10G] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 10H] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 10I] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 10J] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. [Figure 10K] The following are exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. 【0065】 [Figure 11A] This flowchart illustrates a method for displaying and updating markers corresponding to the orientation of a stylus, according to several embodiments. [Figure 11B] This flowchart illustrates a method for displaying and updating markers corresponding to the orientation of a stylus, according to several embodiments. [Figure 11C] This flowchart illustrates a method for displaying and updating markers corresponding to the orientation of a stylus, according to several embodiments. [Figure 11D]This flowchart illustrates a method for displaying and updating markers corresponding to the orientation of a stylus, according to several embodiments. 【0066】 [Figure 12] This is a functional block diagram of an electronic device according to several embodiments. 【0067】 [Figure 13A] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13B] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13C] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13D] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13E] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13F] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13G] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13H] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13I]The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13J] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13K] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13L] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13M] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13N] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. [Figure 13O] The following are exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. 【0068】 [Figure 14A] This flowchart illustrates a method for adjusting one or more characteristics of a mark according to the characteristics of the input from a stylus, according to several embodiments. [Figure 14B] This flowchart illustrates a method for adjusting one or more characteristics of a mark according to the characteristics of the input from a stylus, according to several embodiments. [Figure 14C] This flowchart illustrates a method for adjusting one or more characteristics of a mark according to the characteristics of the input from a stylus, according to several embodiments. [Figure 14D] This flowchart illustrates a method for adjusting one or more characteristics of a mark according to the characteristics of the input from a stylus, according to several embodiments. [Figure 14E] This flowchart illustrates a method for adjusting one or more characteristics of a mark according to the characteristics of the input from a stylus, according to several embodiments. 【0069】 [Figure 15] This is a functional block diagram of an electronic device according to several embodiments. 【0070】 [Figure 16A] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16B] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16C] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16D] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16E] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16F] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16G] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16H] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16I] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16J]The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16K] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16L] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16M] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. [Figure 16N] The following are exemplary user interfaces for creating messages using stylus and finger input, according to several embodiments. 【0071】 [Figure 17A] This flowchart illustrates a method for creating messages using stylus and finger input, according to several embodiments. [Figure 17B] This flowchart illustrates a method for creating messages using stylus and finger input, according to several embodiments. [Figure 17C] This flowchart illustrates a method for creating messages using stylus and finger input, according to several embodiments. [Figure 18A] This flowchart illustrates a method for creating messages using stylus and finger input, according to several embodiments. [Figure 18B] This flowchart illustrates a method for creating messages using stylus and finger input, according to several embodiments. [Figure 19] This flowchart illustrates a method for creating messages using stylus and finger input, according to several embodiments. 【0072】 [Figure 20A] This is a functional block diagram of an electronic device according to several embodiments. 【0073】 [Figure 20B] This is a functional block diagram of an electronic device according to several embodiments. 【0074】 [Figure 21A] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21B] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21C] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21D] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21E] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21F] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21G] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21H] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21I] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21J] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21K]The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21L] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21M] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21N] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21O] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21P] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. [Figure 21Q] The following are exemplary user interfaces for accessing a drawing application for a locked device, according to several embodiments. 【0075】 [Figure 22A] This flowchart illustrates how to access a drawing application on a locked device, according to several embodiments. [Figure 22B] This flowchart illustrates how to access a drawing application on a locked device, according to several embodiments. 【0076】 [Figure 23A] This flowchart illustrates how to access a drawing application on a locked device, according to several embodiments. [Figure 23B] This flowchart illustrates how to access a drawing application on a locked device, according to several embodiments. 【0077】 [Figure 24A] This flowchart illustrates how to access a drawing application on a locked device, according to several embodiments. [Figure 24B] This flowchart illustrates how to access a drawing application on a locked device, according to several embodiments. 【0078】 [Figure 25] This is a functional block diagram of an electronic device according to several embodiments. 【0079】 [Figure 26A] The following are exemplary user interfaces for selecting and using a virtual drawing means with a stylus, according to several embodiments. [Figure 26B] The following are exemplary user interfaces for selecting and using a virtual drawing means with a stylus, according to several embodiments. [Figure 26C] The following are exemplary user interfaces for selecting and using a virtual drawing means with a stylus, according to several embodiments. [Figure 26D] The following are exemplary user interfaces for selecting and using a virtual drawing means with a stylus, according to several embodiments. [Figure 26E] The following are exemplary user interfaces for selecting and using a virtual drawing means with a stylus, according to several embodiments. [Figure 26F] The following are exemplary user interfaces for selecting and using a virtual drawing means with a stylus, according to several embodiments. [Figure 26G] The following are exemplary user interfaces for selecting and using a virtual drawing means with a stylus, according to several embodiments. [Figure 26H] The following are exemplary user interfaces for selecting and using a virtual drawing means with a stylus, according to several embodiments. 【0080】 [Figure 27A] This flowchart illustrates a method for selecting and using a virtual drawing means using a stylus, according to several embodiments. [Figure 27B] This flowchart illustrates a method for selecting and using a virtual drawing means using a stylus, according to several embodiments. [Figure 27C] This flowchart illustrates a method for selecting and using a virtual drawing means using a stylus, according to several embodiments. 【0081】 [Figure 28] This is a functional block diagram of an electronic device according to several embodiments. 【0082】 [Figure 29A] The following are exemplary user interfaces for creating calendar events according to several embodiments. [Figure 29B] The following are exemplary user interfaces for creating calendar events according to several embodiments. [Figure 29C] The following are exemplary user interfaces for creating calendar events according to several embodiments. [Figure 29D] The following are exemplary user interfaces for creating calendar events according to several embodiments. [Figure 29E] The following are exemplary user interfaces for creating calendar events according to several embodiments. [Figure 29F] The following are exemplary user interfaces for creating calendar events according to several embodiments. [Figure 29G] The following are exemplary user interfaces for creating calendar events according to several embodiments. [Figure 29H] The following are exemplary user interfaces for creating calendar events according to several embodiments. 【0083】 [Figure 30A] This is a flowchart illustrating a method for creating calendar events according to several embodiments. [Figure 30B] This is a flowchart illustrating a method for creating calendar events according to several embodiments. [Figure 30C] This is a flowchart illustrating a method for creating calendar events according to several embodiments. [Figure 30D] This is a flowchart illustrating a method for creating calendar events according to several embodiments. 【0084】 [Figure 31] This is a functional block diagram of an electronic device according to several embodiments. 【0085】 [Figure 32A] The following are exemplary user interfaces for selecting a portion of a video according to several embodiments. [Figure 32B] The following are exemplary user interfaces for selecting a portion of a video according to several embodiments. [Figure 32C] The following are exemplary user interfaces for selecting a portion of a video according to several embodiments. [Figure 32D] The following are exemplary user interfaces for selecting a portion of a video according to several embodiments. [Figure 32E] The following are exemplary user interfaces for selecting a portion of a video according to several embodiments. [Figure 32F] The following are exemplary user interfaces for selecting a portion of a video according to several embodiments. 【0086】 [Figure 33A] This flowchart illustrates a method for selecting a portion of a video according to several embodiments. [Figure 33B] This flowchart illustrates a method for selecting a portion of a video according to several embodiments. 【0087】 [Figure 34] This is a functional block diagram of an electronic device according to several embodiments. 【0088】 [Figure 35A] The following are exemplary user interfaces for displaying and using menus with a stylus, according to several embodiments. [Figure 35B] The following are exemplary user interfaces for displaying and using menus with a stylus, according to several embodiments. [Figure 35C] The following are exemplary user interfaces for displaying and using menus with a stylus, according to several embodiments. [Figure 35D] The following are exemplary user interfaces for displaying and using menus with a stylus, according to several embodiments. [Figure 35E] The following are exemplary user interfaces for displaying and using menus with a stylus, according to several embodiments. [Figure 35F] The following are exemplary user interfaces for displaying and using menus with a stylus, according to several embodiments. [Figure 35G] The following are exemplary user interfaces for displaying and using menus with a stylus, according to several embodiments. [Figure 35H] The following are exemplary user interfaces for displaying and using menus with a stylus, according to several embodiments. [Figure 35I] The following are exemplary user interfaces for displaying and using menus with a stylus, according to several embodiments. [Figure 35J] The following are exemplary user interfaces for displaying and using menus with a stylus, according to several embodiments. 【0089】 [Figure 36A]This flowchart illustrates a method for displaying and using a menu with a stylus, according to several embodiments. [Figure 36B] This flowchart illustrates a method for displaying and using a menu with a stylus, according to several embodiments. [Figure 36C] This flowchart illustrates a method for displaying and using a menu with a stylus, according to several embodiments. 【0090】 [Figure 37] This is a functional block diagram of an electronic device according to several embodiments. [Modes for carrying out the invention] 【0091】 This specification describes numerous different techniques for manipulating a user interface with a stylus. By using one or more of these techniques (optionally in combination with each other), the number, range, and / or types of user input can be reduced, providing a more efficient human-machine interface. This allows the user to use the stylus more quickly and efficiently with a device having a touch-sensitive surface. With respect to battery-operated devices, these improvements result in power savings and increased battery charging intervals. For the sake of simplicity, devices and methods, including some exemplary embodiments of these techniques, are described below. Figures 7A-7J show exemplary user interfaces for displaying and updating markers corresponding to the stylus's orientation before it touches the touch-sensitive surface. Figures 8A-8D are flowcharts illustrating how to display and update markers corresponding to the stylus's orientation before it touches the touch-sensitive surface. The processes shown in Figures 8A-8D are illustrated using the user interfaces of Figures 7A-7J. Figures 10A-10K show exemplary user interfaces for displaying and updating markers corresponding to the stylus's orientation while the stylus is touching the touch-sensitive surface. Figures 11A-11D are flowcharts illustrating how to display and update markers corresponding to the stylus's orientation while the stylus is touching the touch-sensitive surface. The processes in Figures 11A-11D are illustrated using the user interfaces in Figures 10A-10K. Figures 13A-13O show exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of the input from the stylus. Figures 14A-14E are flowcharts illustrating how to adjust one or more characteristics of a mark according to the characteristics of the input from the stylus. The processes in Figures 14A-14E are illustrated using the user interfaces in Figures 13A-13O. ●Figures 16A–16N show exemplary user interfaces for creating messages using stylus and finger input. Figures 17A–17C, 18A–18B, and 19 are flowcharts illustrating how to create messages using stylus and finger input. The processes in Figures 17A–17C, 18A–18B, and 19 are illustrated using the user interfaces of Figures 16A–16N. Figures 21A–21Q show exemplary user interfaces for accessing the drawing application for a locked device. Figures 22A–22B, 23A–23B, and 24A–24B are flowcharts illustrating how to access the drawing application for a locked device. The processes in Figures 22A–22B, 23A–23B, and 24A–24B are illustrated using the user interfaces in Figures 21A–21Q. Figures 26A-26H show exemplary user interfaces for selecting and using virtual drawing means using a stylus. Figures 27A-27C are flowcharts illustrating how to select and use virtual drawing means using a stylus. The process in Figures 27A-27C is illustrated using the user interfaces in Figures 26A-26H. Figures 29A-29H show exemplary user interfaces for creating calendar events. Figures 30A-30D are flowcharts illustrating how to create calendar events. The process shown in Figures 30A-30D is illustrated using the user interfaces in Figures 29A-29H. Figures 32A-32F show exemplary user interfaces for selecting a portion of a video. Figures 33A-33B are flowcharts illustrating how to select a portion of a video. The process shown in Figures 33A-33B is illustrated using the user interfaces of Figures 32A-32F. Figures 35A-35J show exemplary user interfaces for displaying and using menus with a stylus. Figures 36A-36C are flowcharts illustrating how to display and use menus with a stylus. The processes shown in Figures 36A-36C are illustrated using the user interfaces of Figures 35A-35J. Example device 【0092】 Here, embodiments shown in the accompanying drawings will be referred to in detail. The following detailed description includes numerous specific details to provide a complete understanding of the various embodiments described. However, it will be apparent to those skilled in the art that the various embodiments described can be practiced without these specific details. In other examples, well-known methods, procedures, components, circuits, and networks are not described in detail so as not to unnecessarily obscure the aspects of the embodiments. 【0093】 In this specification, terms such as "first," "second," etc., are used to describe various elements in some embodiments, but it will be understood that these elements should not be limited by those terms. These terms are used solely to distinguish one element from another. For example, without departing from the scope of the various embodiments described, a first contact may be referred to as a second contact, and similarly, a second contact may be referred to as a first contact. Both the first and second contacts are contacts, but they are not the same contact unless the context explicitly indicates otherwise. 【0094】 The terminology used in the descriptions of the various embodiments described herein is intended solely to describe specific embodiments and not to limit them. When used in the descriptions of the various embodiments described and in the appended claims, the singular forms "a," "an," and "the" are intended to also include the plural forms unless the context explicitly indicates otherwise. It should also be understood that, when used herein, the term "and / or" refers to and includes all possible combinations of one or more of the enumerated items relating to the description. It will be further understood that, when used herein, the terms "includes," "including," "comprises," and / or "comprising" specify the presence of the described features, integers, steps, actions, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, actions, elements, components, and / or groups thereof. 【0095】 As used herein, the term "if" is interpreted, at its discretion, as contextual, to mean "when," "upon," "in response to determining," or "in response to detecting." Similarly, the phrases "if it is determined" or "if (a stated condition or event) is detected" are interpreted, at its discretion, as contextual, to mean "upon determining," "in response to determining," "upon detecting (the stated condition or event)," or "in response to detecting (the stated condition or event)." 【0096】 Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, which also includes other functions, such as PDA functionality and / or music player functionality. Exemplary embodiments of portable multifunction devices include, without limitation, Apple Inc.'s (Cupertino, California) iPhone®, iPod Touch®, and iPad® devices. Other portable electronic devices, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads), are also used optionally. It should also be understood that in some embodiments, the device is not a portable communication device but a desktop computer with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). 【0097】 The following description refers to an electronic device having a display and a touch-sensitive surface. However, please understand that this electronic device may optionally include one or more other physical user interface devices such as a physical keyboard, mouse, and / or joystick. 【0098】 This device generally supports a variety of applications, including drawing applications, presentation applications, word processing applications, website creation applications, disk authoring applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, training support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications. 【0099】 Various applications running on this device optionally utilize at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface, as well as the corresponding information displayed on the device, are optionally adjusted and / or modified on an application-by-application basis and / or within the corresponding application. In this way, the device's common physical architecture (such as the touch-sensitive surface) optionally supports a variety of applications that have an intuitive and transparent user interface for the user. 【0100】 Next, we turn our attention to embodiments of portable devices equipped with touch-sensitive displays. Figure 1A is a block diagram of a portable multifunction device 100 equipped with a touch-sensitive display system 112 according to several embodiments. The touch-sensitive display system 112 may be referred to as a “touchscreen” for convenience, or simply as a touch-sensitive display. The device 100 includes a memory 102 (optionally including one or more computer-readable storage media), a memory controller 120, one or more processing units (CPUs) 122, a peripheral interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more intensity sensors 165 for detecting the intensity of contact on the device 100 (for example, on a touch-sensitive surface such as the touch-sensitive display system 112 of the device 100). Device 100 optionally includes one or more tactile output generators 163 for generating tactile output on Device 100 (for example, generating tactile output on a touch-sensitive surface such as the touch-sensitive display system 112 of Device 100 or the touchpad 355 of Device 300). These components optionally communicate via one or more communication buses or signal lines 103. 【0101】 As used herein and in the claims, the term “tactile output” means a physical displacement of the device relative to its previous position, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, which will be detected by the user through the user’s sense of touch. For example, in a situation where the device or a component of the device is in contact with the touch-sensitive surface of the user (e.g., the user’s fingers, palm, or other part of their hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical properties of the device or a component of the device. For example, the movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) may be optionally interpreted by the user as a “down-click” or “up-click” of a physical actuator button. In some cases, the user may feel a tactile sensation such as a “down-click” or “up-click” even when there is no movement of a physical actuator button associated with a touch-sensitive surface that has been physically pressed (e.g., displaced) by the user’s action. In another embodiment, movement of a touch-sensitive surface may be optionally interpreted or perceived by the user as "roughness" of the touch-sensitive surface, even if there is no change in the smoothness of the touch-sensitive surface. While such user interpretations of touch depend on the user's personal sensory perception, there are many touch sensory perceptions common to the majority of users. Therefore, when a tactile output is described as corresponding to a user's specific sensory perception (e.g., "up-click," "down-click," "roughness"), unless otherwise stated, the generated tactile output corresponds to the physical displacement of the device or its components that produce the described sensory perception of a typical (or average) user. 【0102】 Device 100 is merely one embodiment of a portable multifunction device, and it should be understood that Device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of those components. The various components shown in Figure 1A may be implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing circuits and / or application-specific integrated circuits. 【0103】 Memory 102 optionally includes high-speed random-access memory and optionally includes non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Access to memory 102 by other components of device 100, such as CPU(s) 122 and peripheral interface 118, is optionally controlled by memory controller 120. 【0104】 Using the peripheral interface 118, the input and output peripherals of this device can be connected to the CPU(s) 122 and memory 102. One or more processors 122 operate or execute various software programs and / or instruction sets stored in memory 102 in order to perform various functions for device 100 and to process data. 【0105】 In some embodiments, the peripheral interface 118, the CPU(s) 122, and the memory controller 120 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips. 【0106】 The RF (radio frequency) circuit 108 transmits and receives RF signals, also known as electromagnetic signals. The RF circuit 108 converts electrical signals to electromagnetic signals, or electromagnetic signals to electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes, but is not limited to, well-known circuits for performing these functions, including, but not limited to, antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, and memory. The RF circuit 108 optionally communicates wirelessly with networks such as the Internet (also known as the World Wide Web (WWW)), intranets and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs) and / or metropolitan area networks (MANs)) and other devices. Wireless communication uses one of several communication standards, protocols, and technologies at will. These communication standards, protocols, and technologies include Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-speed Downlink Packet Access (HSDPA), High-speed Uplink Packet Access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), Long-Term Evolution (LTE), Near Field Communication (NFC), and Wideband Code Division Multiple Access (BDC).(W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth®, Wireless Fidelity (Wi-Fi)® (e.g., IEEE 802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, Protocols for Email (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), Instant Messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging) Examples of suitable communication protocols include, but are not limited to, Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS), and / or Short Message Service (SMS), or any other communication protocols not yet developed as of the filing date of this document. 【0107】 The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral interface 118, converts this audio data into an electrical signal, and transmits this electrical signal to the speaker 111. The speaker 111 converts the electrical signal into human audible sound waves. The audio circuit 110 also receives the electrical signal converted from the sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and transmits this audio data to the peripheral interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or RF circuit 108 by the peripheral interface 118. In some embodiments, the audio circuit 110 further includes a headset jack (e.g., 212 in Figure 2). The headset jack provides an interface between the audio circuit 110 and a detachable audio input / output peripheral, such as an output-only headphone or a headset having both an output (e.g., headphones for one or both ears) and an input (e.g., a microphone). 【0108】 The I / O subsystem 106 connects input / output peripherals on device 100, such as the touch-sensitive display system 112 and other input or control devices 116, to the peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. One or more input controllers 160 receive electrical signals from and transmit electrical signals to the other input or control devices 116. The other input or control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, the input controller(s) 160 are optionally coupled to (or not coupled to) any of the following: a keyboard, an infrared port, a USB port, a stylus, and / or a pointer device such as a mouse. One or more buttons (e.g., 208 in Figure 2) optionally include up / down buttons for adjusting the volume of speaker 111 and / or microphone 113. One or more buttons optionally include push buttons (e.g., 206 in Figure 2). 【0109】 The touch-sensitive display system 112 provides input and output interfaces between the device and the user. The display controller 156 receives electrical signals from and / or transmits electrical signals to the touch-sensitive display system 112. The touch-sensitive display system 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as “graphics”). In some embodiments, some or all of the visual output corresponds to user interface objects. 【0110】 The touch-sensitive display system 112 has a touch-sensitive surface, sensor, or set of sensors that accept user input based on tactile / tactile contact. The touch-sensitive display system 112 and the display controller 156 (along with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of contact) on the touch-sensitive display system 112 and translate the detected contact into bidirectional interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch-sensitive display system 112. In one exemplary embodiment, the point of contact between the touch-sensitive display system 112 and the user corresponds to the user's finger or stylus. 【0111】 The touch-sensitive display system 112 optionally uses LCD (liquid crystal display) technology, LPD (light-emitting polymer display) technology, or LED (light-emitting diode) technology, but other display technologies are used in other embodiments. The touch-sensitive display system 112 and the display controller 156 optionally detect touch and any movement or interruption using any of several currently known or future-developed touch-sensing technologies, including but not limited to capacitive technology, resistive technology, infrared technology, and surface acoustic wave technology, as well as other proximity sensor arrays or other elements for determining one or more contact points with the touch-sensitive display system 112. In one exemplary embodiment, projected mutual capacitance sensing technology is used, as seen in iPhone®, iPod Touch®, and iPad® from Apple Inc. of Cupertino, California. 【0112】 The touch-sensitive display system 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the video resolution of the touchscreen exceeds 400 dpi (e.g., 500 dpi, 800 dpi, or higher). The user optionally touches the touch-sensitive display system 112 using any suitable object or attachment, such as a stylus or finger. In some embodiments, the user interface is designed to function with finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of ​​the finger on the touchscreen. In some embodiments, the device translates coarse finger-based input into precise pointer / cursor positions or commands to perform user-desired actions. 【0113】 In some embodiments, in addition to the touchscreen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display a visual output. The touchpad is optionally a touch-sensitive surface separate from the touch-sensitive display system 112, or an extension of the touch-sensitive surface formed by the touchscreen. 【0114】 Device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., a battery, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with the generation, management, and distribution of power within the portable device. 【0115】 Device 100 also optionally includes one or more optical sensors 164. Figure 1A shows optical sensors coupled to an optical sensor controller 158 in the I / O subsystem 106. The optical sensor(s) 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. The optical sensor(s) 164 receives light from the environment projected through one or more lenses and converts that light into data representing an image. In conjunction with the imaging module 143 (also referred to as the camera module), the optical sensor(s) 164 optionally captures still images and / or video. In some embodiments, the optical sensors are located on the back of Device 100, opposite the touch-sensitive display system 112 on the front of the device, so that the touchscreen can be enabled for use as a viewfinder for acquiring still images and / or video. In some embodiments, a separate light sensor is positioned on the front of the device to capture an image of the user (for example, for a selfie, or for a video conference, while the user is viewing other video conference participants on the touchscreen). 【0116】 Device 100 also optionally includes one or more contact strength sensors 165. Figure 1A shows a contact strength sensor coupled to a strength sensor controller 159 in the I / O subsystem 106. The contact strength sensor(s) 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, pressure-power sensors, optical force sensors, capacitive touch-sensing surfaces, or other strength sensors (e.g., sensors used to measure the force (or pressure) of contact on a touch-sensing surface). The contact strength sensor(s) 165 receives contact strength information (e.g., pressure information or a proxy for pressure information) from the environment. In some embodiments, at least one contact strength sensor is located on or near the touch-sensing surface (e.g., touch-sensing display system 112). In some embodiments, at least one contact strength sensor is located on the back of Device 100, opposite the touchscreen display system 112 located on the front of Device 100. 【0117】 Device 100 also optionally includes one or more proximity sensors 166. Figure 1A shows a proximity sensor 166 coupled to a peripheral interface 118. Alternatively, the proximity sensor 166 is coupled to an input controller 160 in the I / O subsystem 106. In some embodiments, if the multifunction device is positioned near the user's ear (for example, when the user is making a phone call), the proximity sensor turns off and disables the touch-sensitive display system 112. 【0118】 Device 100 also optionally includes one or more tactile output generators 163. Figure 1A shows a tactile output generator coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator(s) 163 optionally includes one or more electroacoustic devices, such as a speaker or other audio component, and / or electromechanical devices that convert energy into linear motion, such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component that converts an electrical signal into a tactile output on the device). The tactile output generator(s) 163 receives a tactile feedback generation command from the tactile feedback module 133 and generates a tactile output on device 100 that can be sensed by the user of device 100. In some embodiments, at least one tactile output generator is located on or near a touch-sensitive surface (e.g., a touch-sensitive display system 112) and optionally generates a tactile output by moving the touch-sensitive surface vertically (e.g., inward / outward from the surface of device 100) or laterally (e.g., forward / backward in the same plane as the surface of device 100). In some embodiments, at least one tactile output generator sensor is located on the back of device 100, opposite the touch-sensitive display system 112 located on the front of device 100. 【0119】 Device 100 also optionally includes one or more accelerometers 167, gyroscopes 168, and / or magnetometers 169 (e.g., as part of an inertial measurement unit (IMU)) for obtaining information about the device's position (e.g., attitude). Figure 1A shows sensors 167, 168, and 169 coupled to a peripheral interface 118. Alternatively, sensors 167, 168, and 169 are optionally coupled to an input controller 160 in an I / O subsystem 106. In some embodiments, information is displayed on a touchscreen display in portrait or landscape view based on an analysis of data received from one or more accelerometers. Device 100 optionally includes a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information about the device's position. 【0120】 In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a touch / motion module (or instruction set) 130, a location module (or instruction set) 131, a graphics module (or instruction set) 132, a haptic feedback module (or instruction set) 133, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Furthermore, in some embodiments, as shown in Figures 1A and 3, memory 102 stores a device / global internal state 157. The device / global internal state 157 includes one or more of the following: If there is an application currently active, the active application status indicates which application is active; the display status indicates which applications, views, or other information occupy various areas of the touch-sensitive display system 112; the sensor status includes information obtained from various sensors and other input or control devices 116 of the device; and the position and / or orientation information relating to the position and / or orientation of the device. 【0121】 An operating system 126 (for example, an embedded operating system such as iOS, Darwin®, RTXC®, LINUX®, UNIX®, OS X®, WINDOWS®, or VxWorks®) includes various software components and / or drivers for controlling and managing common system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware components and software components. 【0122】 The communication module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by the RF circuit 108 and / or external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire®, etc.) are adapted to connect to other devices directly or indirectly through a network (e.g., the Internet, Wi-Fi, etc.). In some embodiments, the external ports are multi-pin (e.g., 30-pin) connectors identical to, or similar to, and / or compatible with, the 30-pin connector used in some iPhone®, iPod Touch®, and iPad® devices from Apple Inc., Cupertino, California. In some embodiments, the external ports are Lightning connectors identical to, or similar to, and / or compatible with, the Lightning® connector used in some iPhone®, iPod Touch®, and iPad® devices from Apple Inc., Cupertino, California. 【0123】 The contact / motion module 130 optionally detects contact with the touch-sensitive display system 112 (in conjunction with the display controller 156) and contact with other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes software components for performing various operations related to contact detection (e.g., by a finger or stylus), such as determining whether contact has occurred (e.g., detecting a finger-down event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a substitute for the force or pressure of the contact), determining whether there is movement of the contact and tracking of movement across the touch-sensitive surface (e.g., detecting one or more finger-drag events), and determining whether the contact has been terminated (e.g., detecting a finger-up event or interruption of contact). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point represented by a series of contact data optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These actions can be optionally applied to a single contact (e.g., a single finger or stylus contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger and / or stylus contacts). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touchpad. 【0124】 The contact / motion module 130 optionally detects gesture input from the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different movements, timing, and / or intensity of contact detected). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture involves detecting a finger down event, followed by a finger up (lift-off) event at the same location (or substantially the same location) as the finger down event (e.g., at the icon's position). In another embodiment, detecting a finger swipe gesture on the touch-sensitive surface involves detecting a finger down event, followed by one or more finger drag events, and then a finger up (lift-off) event. Similarly, taps, swipes, drags, and other gestures are optionally detected with respect to the stylus by detecting specific contact patterns with respect to the stylus. 【0125】 In conjunction with the accelerometer 167, gyroscope 168, and / or magnetometer 169, the position module 131 optionally detects attitude information about the device, such as the device's orientation (roll, pitch, and / or yaw) within a specific coordinate system. The position module 130 includes software components for performing various operations related to detecting the device's position and detecting changes in the device's position. In some embodiments, the position module 131 uses information received from a stylus used with the device to detect attitude information about the stylus, such as detecting the stylus's orientation relative to the device and detecting changes in the stylus's orientation. 【0126】 The graphics module 132 includes various known software components for rendering and displaying graphics on the touch-sensitive display system 112 or other display, including components for modifying the visual effects of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual characteristics). As used herein, the term “graphics” includes, but is not limited to, any objects that can be displayed to a user, such as text, web pages, icons (including user interface objects such as soft keys), digital images, videos, and animations. 【0127】 In some embodiments, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from an application or the like, as needed, along with coordinate data and other graphic characteristic data, specifying the graphics to be displayed, and then generates screen image data to be output to the display controller 156. 【0128】 The haptic feedback module 133 includes various software components for generating commands used by a haptic output generator(s) 163 to generate haptic outputs at one or more locations on the device 100 in response to user interaction with the device 100. 【0129】 The text input module 134 is optionally a component of the graphics module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other applications that require text input). 【0130】 The GPS module 135 determines the device's location and provides this information for use in various applications (for example, to the telephone 138 for use in location-based dialing, to the camera 143 as picture / video metadata, and to applications that provide location-based services such as weather widgets, local yellow pages widgets, and map / navigation widgets). 【0131】 Application 136 optionally includes the following modules (or sets of instructions), or subsets or supersets thereof: ●Contact module 137 (sometimes also called the address book or contact list), ●Telephone module 138, ●Video conferencing module 139, ● Email client module 140, ● Instant messaging (IM) module 141, ●Training support module 142, ● Camera module 143 for still images and / or video images, ●Image management module 144, ● Browser module 147, ● Calendar module 148, ● A widget module 149 that optionally includes one or more of the following: weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, other widgets obtained by the user, and user-created widgets 149-6. ●Widget creation module 150 for creating user-created widget 149-6, ● Search module 151, ● A video and music player module 152, which optionally consists of a video player module and a music player module. ●Memo Module 153, ●Map module 154 and / or ●Video editing module 155. 【0132】 Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, Java®-enabled applications, encryption, digital rights management, speech recognition, and speech duplication. 【0133】 Together with the touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the contact module 137 includes executable instructions for managing an address book or contact list (stored, for example, in the application internal state 192 of the contact module 137 in memory 102 or memory 370), which include adding names(s) to the address book, deleting names(s) from the address book, associating telephone numbers(s) to names, email addresses(s) to names, addresses(s) to names, or other information, associating images to names, categorizing and sorting names, and providing telephone numbers or email addresses to initiate and / or facilitate communication by telephone 138, video conferencing 139, email 140, or IM 141. 【0134】 Together with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the telephone module 138 includes executable commands for inputting a series of characters corresponding to a telephone number, accessing one or more telephone numbers in the address book 137, modifying the entered telephone numbers, dialing each telephone number, conducting a conversation, and disconnecting or hanging up when the conversation is complete. As described above, wireless communication may selectively use any of several communication standards, protocols, and technologies. 【0135】 Together with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch-sensitive display system 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact module 130, graphics module 132, text input module 134, contact list 137, and telephone module 138, the video conferencing module 139 includes executable commands for starting, conducting, and ending video conferences between the user and one or more other participants, according to user instructions. 【0136】 Together with the RF circuit 108, touch-sensitive display system 112, display controller 156, contact module 130, graphic module 132, and text input module 134, the email client module 140 includes executable commands for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with the image management module 144, the email client module 140 makes it very easy to create and send emails containing still or video images captured by the camera module 143. 【0137】 Together with the RF circuit 108, touch-sensitive display system 112, display controller 156, contact module 130, graphic module 132, and text input module 134, the instant messaging module 141 includes executable instructions for inputting an instant message and a corresponding string, modifying the entered characters, sending each instant message (for example, using the Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for phone-based instant messaging, or using XMPP, SIMPLE, Apple Push Notification Service (APNs), or IMPS for internet-based instant messaging), and receiving and viewing the received instant message. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments, as supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, “instant messaging” means both telephone-based messages (e.g., messages sent using SMS or MMS) and internet-based messages (e.g., messages sent using XMPP, SIMPLE, APNs, or IMPS). 【0138】 Together with the RF circuit 108, touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module 152, the training support module 142 includes executable commands for creating training (e.g., with time, distance, and / or calorie consumption targets), communicating with training sensors (in sports devices and smartwatches), receiving training sensor data, calibrating sensors used to monitor training, selecting and playing music for training, and displaying, storing, and transmitting training data. 【0139】 Together with the touch-sensitive display system 112, display controller 156, optical sensor(s) 164, optical sensor controller 158, contact module 130, graphics module 132, and image management module 144, the camera module 143 includes executable instructions for capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, and / or deleting still images or videos from memory 102. 【0140】 Together with the touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable commands for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album) still images and / or videos, and storing them. 【0141】 Together with the RF circuit 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, the browser module 147 includes executable instructions for browsing the Internet in accordance with user instructions, including searching for, linking, receiving, and displaying web pages or parts thereof, as well as attachments and other files linked to web pages. 【0142】 Together with the RF circuit 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying, and storing calendars and data associated with them (e.g., calendar items, to-do lists, etc.) in accordance with user instructions. 【0143】 Together with the RF circuit 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphic module 132, text input module 134, and browser module 147, the widget module 149 is optionally a mini-application downloaded and used by the user (e.g., weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or a mini-application created by the user (e.g., user-created widget 149-6). In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript® file. In some embodiments, the widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., a Yahoo!® widget). 【0144】 Together with the RF circuit 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, the widget creation module 150 includes executable commands for creating widgets (for example, converting user-specified portions of a web page into widgets). 【0145】 Together with the touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions to search for text, music, sound, images, videos, and / or other files in memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions. 【0146】 Together with the touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, and browser module 147, the video and music player module 152 includes executable commands that allow the user to download and play recorded music or other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable commands that display, present, or otherwise play video (for example, on the touch-sensitive display system 112 or on an external display connected wirelessly or via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.). 【0147】 Together with the touch-sensitive display system 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the memo module 153 includes executable instructions for creating and managing memos, to-do lists, etc., according to user instructions. 【0148】 Together with the RF circuit 108, touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, the map module 154 includes executable commands that, in accordance with user instructions, receive, display, modify, and store maps and data associated with maps (e.g., driving directions, data about stores and other points of interest in or near a specific location, and other location-based data). 【0149】 Together with the touch-sensitive display system 112, display system controller 156, contact module 130, graphics module 132, audio circuit 110, speaker 111, and text input module 134, the video editing module 155 includes executable instructions that enable the user to edit movies and other videos (for example, iMovie® from Apple Inc. (Cupertino, California)). 【0150】 Each of the modules and applications identified above corresponds to an executable instruction set and a method of this application (e.g., a method performed by a computer and other information processing methods described herein) that perform one or more of the above functions. These modules (i.e., instruction sets) do not need to be implemented as separate software programs, procedures, or modules, and therefore various subsets of these modules may be optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 102 optionally stores a subset of the identified modules and data structures described above. Furthermore, memory 102 optionally stores additional modules and data structures not described above. 【0151】 In some embodiments, device 100 is a device in which the operation of a default set of functions on the device is performed exclusively via a touchscreen and / or touchpad. By using a touchscreen and / or touchpad as the primary input control device for the operation of device 100, the number of physical input control devices (push buttons, dials, etc.) on device 100 is optionally reduced. 【0152】 A default set of functions, performed exclusively via the touchscreen and / or touchpad, optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to the main menu, home menu, or root menu. In such embodiments, the “menu button” is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device instead of a touchpad. 【0153】 Figure 1B is a block diagram showing exemplary components for event processing according to several embodiments. In some embodiments, memory 102 (in Figure 1A) or 370 (in Figure 3) includes an event sorting unit 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any of the applications 136, 137-155, and 380-390 described above). 【0154】 The event sorting unit 170 receives event information and determines the application 136-1 and the application view 191 of application 136-1 to which the event information is distributed. The event sorting unit 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, application 136-1 includes an application internal state 192 that indicates the current application view(s) displayed on the touch-sensitive display system 112 when the application is active or running. In some embodiments, the device / global internal state 157 is used by the event sorting unit 170 to determine which application(s) are currently active, and the application internal state 192 is used by the event sorting unit 170 to determine the application view(s) to which the event information is distributed. 【0155】 In some embodiments, the application internal state 192 includes additional information such as resume information used when the application 136-1 resumes execution, user interface state information indicating that information is displayed or ready to be displayed by the application 136-1, a state queue to allow the user to return to a previous state or view of the application 136-1, and a redo / undo queue for actions previously performed by the user. 【0156】 The event monitor 171 receives event information from the peripheral interface 118. The event information includes information about sub-events (for example, a user touch on the touch-sensitive display system 112 as part of a multi-touch gesture). The peripheral interface 118 transmits information received from the I / O subsystem 106 or sensors such as the proximity sensor 166, one or more accelerometers 167, one or more gyroscopes 168, one or more magnetometers 169, and / or (via the audio circuit 110) the microphone 113. The information received by the peripheral interface 118 from the I / O subsystem 106 includes information from the touch-sensitive display system 112 or the touch-sensitive surface. 【0157】 In some embodiments, the event monitor 171 sends a request to the peripheral interface 118 at predetermined intervals. In response, the peripheral interface 118 transmits event information. In other embodiments, the peripheral interface 118 transmits event information only when a significant event occurs (e.g., receiving an input that exceeds a predetermined noise threshold and / or exceeds a predetermined duration). 【0158】 In some embodiments, the event sorting unit 170 also includes a hit view determination module 172 and / or an active event recognition determination module 173. 【0159】 The hit view determination module 172 provides a software procedure for determining where in one or more views a sub-event occurred when the touch-sensitive display system 112 displays one or more views. A view consists of a control unit and other elements that the user can see on the display. 【0160】 Another aspect of the user interface associated with an application is a set of views, which may be referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of each application) in which a touch is detected optionally corresponds to a program level within the application's program hierarchy or view hierarchy. For example, the lowest level view in which a touch is detected is optionally called a hit view, and the set of events recognized as appropriate input is optionally determined, at least in part, based on the hit view of the initial touch that initiates a touch-based gesture. 【0161】 The hit view determination module 172 receives information associated with sub-events of touch-based gestures. If the application has multiple views organized hierarchically, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchy whose sub-events should be processed. In most situations, the hit view is the lowest-level view where the initiating sub-event (i.e., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by the hit view determination module, the hit view typically receives all sub-events associated with the same touch or input source that identified it as a hit view. 【0162】 The active event recognition determination module 173 determines which view(s) in the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the active event recognition determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, the active event recognition determination module 173 determines that all views, including the physical location of the sub-event, are actively involved views, and therefore all actively involved views should receive a particular sequence of sub-events. In other embodiments, even if the touch sub-event is entirely confined to a region associated with a particular view, higher-level views in the hierarchy still remain actively involved views. 【0163】 The event dispatcher module 174 transmits event information to an event recognition unit (e.g., an event recognition unit 180). In embodiments including an active event recognition unit determination module 173, the event dispatcher module 174 distributes the event information to the event recognition unit determined by the active event recognition unit determination module 173. In some embodiments, the event dispatcher module 174 stores the event information acquired by each event receiving unit module 182 in an event queue. 【0164】 In some embodiments, the operating system 126 includes an event sorting unit 170. Alternatively, application 136-1 includes an event sorting unit 170. In yet another embodiment, the event sorting unit 170 is either a standalone module or part of another module stored in memory 102, such as a contact / motion module 130. 【0165】 In some embodiments, application 136-1 includes a plurality of event processing units 190 and one or more application views 191, each containing instructions for processing touch events occurring within each view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognition units 180. Typically, each application view 191 includes a plurality of event recognition units 180. In other embodiments, one or more of the event recognition units 180 are part of a separate module, such as a user interface kit (not shown) or a higher-level object from which application 136-1 inherits methods and other characteristics. In some embodiments, each event processing unit 190 includes one or more event data 179 received from a data update unit 176, an object update unit 177, a GUI update unit 178, and / or an event sorting unit 170. The event processing unit 190 optionally uses or calls the data update unit 176, the object update unit 177, or the GUI update unit 178 to update the application's internal state 192. Alternatively, one or more of the application views 191 include one or more corresponding event processing units 190. In some embodiments, one or more of the data update unit 176, object update unit 177, and GUI update unit 178 are included in the corresponding application view 191. 【0166】 The corresponding event recognition unit 180 receives event information (e.g., event data 179) from the event sorting unit 170 and identifies an event from that event information. The event recognition unit 180 includes an event receiving unit 182 and an event comparison unit 184. In some embodiments, the event recognition unit 180 also includes at least a subset of metadata 183 and event distribution commands 188 (optionally including sub-event distribution commands). 【0167】 The event receiving unit 182 receives event information from the event sorting unit 170. This event information includes information about sub-events, such as information about touches or the movement of touches. Depending on the sub-event, the event information may also include additional information, such as the location of the sub-event. When the sub-event involves a touch movement, the event information may optionally further include the speed and direction of the sub-event. In some embodiments, an event includes a rotation of the device from one orientation to another (for example, from portrait to landscape, or vice versa), and the event information includes corresponding information about the device's current orientation (also called the device's orientation). 【0168】 The event comparison unit 184 compares event information with a default event or sub-event definition and, based on the comparison, determines the event or sub-event, or determines or updates the state of the event or sub-event. In some embodiments, the event comparison unit 184 includes an event definition 186. The event definition 186 includes an event definition (e.g., a default sequence of sub-events), such as event 1 (187-1) and event 2 (187-2). In some embodiments, sub-events within event 187 include, for example, touch start, touch end, touch movement, touch cancellation, and multiple touches. In one embodiment, the definition of event 1 (187-1) is a double tap on a displayed object. A double tap includes, for example, a first touch (touch start) for a predetermined stage on the displayed object, a first lift-off (touch end) for the predetermined stage, a second touch (touch start) for the predetermined stage on the displayed object, and a second lift-off (touch end) for the predetermined stage. In another embodiment, the definition of event 2 (187-2) is a drag operation on a displayed object. A drag includes, for example, touching (or making contact with) a predetermined stage on a displayed object, moving the touch across the touch-sensitive display system 112, and lifting off the touch (ending the touch). In some embodiments, the event also includes information about one or more associated event processing units 190. 【0169】 In some embodiments, the event definition 187 includes an event definition for each user interface object. In some embodiments, the event comparison unit 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view where three user interface objects are displayed on the touch-sensitive display system 112, when a touch is detected on the touch-sensitive display system 112, the event comparison unit 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event processing unit 190, the event comparison unit uses the results of the hit test to determine which event processing unit 190 should be activated. For example, the event comparison unit 184 selects an event processing unit associated with the object that triggers the sub-event and the hit test. 【0170】 In some embodiments, the definition of each event 187 also includes a delay effect that delays the transmission of event information until it is determined whether the sequence of sub-events corresponds to the event type of the event recognition unit. 【0171】 If each event recognition unit 180 determines that a series of sub-events does not match any of the events in the event definition 186, each event recognition unit 180 enters an event impossible, event failed, or event terminated state and thereafter ignores subsequent sub-events of the touch-based gesture. In this situation, if there are other event recognition units that remain active with respect to the hit view, they continue to track and process the sub-events of the ongoing touch-based gesture. 【0172】 In some embodiments, each event recognition unit 180 includes metadata 183 having configurable properties, flags, and / or a list indicating how the event distribution system performs sub-event distribution to event recognition units in which it is actively involved. In some embodiments, the metadata 183 includes configurable properties, flags, and / or a list indicating how, or may interact with, the event recognition units. In some embodiments, the metadata 183 includes configurable properties, flags, and / or a list indicating whether sub-events are distributed to various levels within the view hierarchy or program hierarchy. 【0173】 In some embodiments, each event recognition unit 180 activates an event processing unit 190 associated with an event when one or more specific sub-events of an event are recognized. In some embodiments, each event recognition unit 180 delivers event information associated with the event to the event processing unit 190. Activating the event processing unit 190 is different from sending (and delaying the sending of) sub-events to the corresponding hit view. In some embodiments, the event recognition unit 180 throws a flag associated with the recognized event, and the event processing unit 190 associated with the flag catches the flag and performs default processing. 【0174】 In some embodiments, the event distribution command 188 includes a sub-event distribution command that distributes event information about a sub-event without activating an event processing unit. Instead, the sub-event distribution command distributes the event information to an event processing unit associated with a series of sub-events or to an actively involved view. The event processing unit associated with the series of sub-events or the actively involved view receives the event information and performs predetermined processing. 【0175】 In some embodiments, the data update unit 176 creates and updates data used in application 136-1. For example, the data update unit 176 updates telephone numbers used in contact module 137 or stores video files used in video player module 145. In some embodiments, the object update unit 177 creates and updates objects used in application 136-1. For example, the object update unit 177 creates new user interface objects or updates the position of user interface objects. The GUI update unit 178 updates the GUI. For example, the GUI update unit 178 prepares display information and sends it to the graphics module 132 for display on the touch-sensitive display. 【0176】 In some embodiments, the event processing unit(s) 190 includes, or can access, a data update unit 176, an object update unit 177, and a GUI update unit 178. In some embodiments, the data update unit 176, the object update unit 177, and the GUI update unit 178 are included in a single module of their respective applications 136-1 or application view 191. In other embodiments, they are included in two or more software modules. 【0177】 The above description of event processing for user touches on a touch-sensitive display also applies to other forms of user input for operating the multifunction device 100 using input devices, but it should be understood that not all of this begins on the touchscreen. For example, mouse movements and mouse button presses optionally matched to single or multiple keyboard presses or holds, touch movements such as taps, drags, and scrolls on a touchpad, pen stylus input, device movement, verbal instructions, detected eye movements, biometric input, and / or any combination thereof may be optionally used as inputs corresponding to sub-events that define the event to be recognized. 【0178】 Figure 2 shows a portable multifunctional device 100 equipped with a touchscreen (e.g., the touch-sensitive display system 112 in Figure 1A) according to several embodiments. The touchscreen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment, and in other embodiments described later, the user can select one or more graphics by making gestures on the graphics using, for example, one or more fingers 202 (not shown in the figure to an exact scale) or one or more styluses 203 (not shown in the figure to an exact scale). In some embodiments, the selection of one or more graphics occurs when the user disconnects from one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, right to left, upward and / or downward), and / or rolling of a finger in contact with the device 100 (from right to left, left to right, upward and / or downward). In some implementations or situations, accidental contact with a graphic does not result in the selection of that graphic. For example, if the gesture corresponding to selection is a tap, a swipe gesture sweeping over an application icon does not arbitrarily select the corresponding application. 【0179】 Device 100 also optionally includes one or more physical buttons, such as a "Home" or menu button 204. As previously stated, the menu button 204 is optionally used to navigate to any application 136 within a set of applications that can optionally run on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on a touchscreen display. 【0180】 In some embodiments, device 100 includes a touch screen display, menu button 204, push button 206 for turning the device on / off and locking the device, volume adjustment button(s) 208, subscriber identity module (SIM) card slot 210, headset jack 212, and docking / charging external port 124. Push button 206 is used optionally to turn the power on / off on the device by pressing the button and holding it pressed for a predefined time, to lock the device by pressing the button and releasing it before the predefined time has elapsed, and / or to unlock the device or initiate an unlock process. In some embodiments, device 100 also receives verbal input through microphone 113 to activate or deactivate some functions. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact on touch sensing display system 112 and / or one or more haptic output generators 163 for generating haptic output to the user of device 100. 【0181】 Figure 3 is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to several embodiments. Device 300 does not need to be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia playback device, navigation device, educational device (such as a children's learning toy), game system, or control device (e.g., a home or commercial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication buses 320 optionally include circuitry (sometimes called a chipset) that interconnects and controls communication between system components. Device 300 typically includes an input / output (I / O) interface 330, which includes a display 340, which is a touchscreen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 (similar to the tactile output generator(s) 163 described above with reference to Figure 1A) for generating tactile output on device 300, and sensors 359 (similar to the sensors 112, 164, 165, 166, 167, 168, and 169 described above with reference to Figure 1A, such as touch-sensing sensors, optical sensors, contact intensity sensors, proximity sensors, acceleration sensors, attitude sensors, and / or magnetic sensors). The memory 370 includes high-speed random-access memory such as DRAM, SRAM, DDR RAM, or other random-access solid-state memory devices, and optionally includes non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 370 optionally includes one or more storage devices located away from the CPU(s) 310.In some embodiments, memory 370 stores programs, modules, and data structures, or subsets thereof, that are similar to those stored in memory 102 of the portable multifunction device 100 (Figure 1A). Furthermore, memory 370 optionally stores additional programs, modules, and data structures that are not present in memory 102 of the portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk authoring module 388, and / or a spreadsheet module 390, while memory 102 of the portable multifunction device 100 (Figure 1A) does not optionally store these modules. 【0182】 Each of the elements of Figure 3 identified above is optionally stored in one or more of the memory devices described above. Each of the modules identified above corresponds to an instruction set for performing the function described above. The identified modules or programs (i.e., instruction sets) described above do not need to be implemented as separate software programs, procedures, or modules; therefore, in various embodiments, various subsets of these modules are optionally combined or rearranged in other ways. In some embodiments, memory 370 optionally stores a subset of the identified modules and data structures described above. Furthermore, memory 370 optionally stores additional modules and data structures not described above. 【0183】 FIG. 4 is a block diagram of an exemplary electronic stylus 203 according to some embodiments. The electronic stylus 203 may sometimes be simply referred to as a stylus. The stylus 203 includes a memory 402 (optionally including one or more computer-readable storage media), a memory controller 422, one or more processing units (CPUs) 420, a peripheral interface 418, an RF circuit 408, an input / output (I / O) subsystem 406, and other input or control devices 416. The stylus 203 optionally includes an external port 424 and one or more optical sensors 464. The stylus 203 optionally includes one or more intensity sensors 465 for detecting the intensity of contact of the stylus 203 on a device 100 (e.g., when the stylus 203 is used with a touch-sensitive surface such as the touch-sensitive display system 112 of the device 100) or on another surface (e.g., a tabletop surface). The stylus 203 optionally includes one or more haptic output generators 463 for generating haptic output on the stylus 203. These components optionally communicate via one or more communication buses or signal lines 403. 【0184】 In some embodiments, the term “tactile output” as described above refers to a physical displacement of an accessory (e.g., a stylus 203) of a device (e.g., device 100) relative to its previous position, a physical displacement of a component of the accessory relative to another component of the accessory, or a displacement of a component relative to the center of mass of the accessory, as detected by the user through the user’s sense of touch. For example, in a situation where the accessory or a component of the accessory is in contact with a touch-sensitive user’s surface (e.g., the user’s fingers, palm, or other part of their hand), the tactile output generated by the physical displacement is interpreted by the user as a tactile sensation corresponding to a perceived change in the physical properties of the accessory or a component of the accessory. For example, the movement of a component (e.g., the housing of the stylus 203) may be optionally interpreted by the user as a “click” of a physical actuator button. In some cases, the user may feel a tactile sensation such as a “click” even when there is no movement of a physical actuator button associated with a stylus that is physically pressed (e.g., displaced) by the user’s action. While such user interpretations of touch depend on the user's personal sensory perception, there are many touch sensory perceptions common to the majority of users. Therefore, when a tactile output is described as corresponding to a user's specific sensory perception (e.g., "click"), unless otherwise stated, the generated tactile output corresponds to the physical displacement of the device or its components that produce the described sensory perception of a typical (or average) user. 【0185】 Stylus 203 is merely one embodiment of an electronic stylus, and it should be understood that stylus 203 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of those components. The various components shown in Figure 4 are implemented in hardware, software, firmware, or a combination thereof, including one or more signal processing circuits and / or application-specific integrated circuits. 【0186】 Memory 402 optionally includes high-speed random-access memory and optionally includes non-volatile memory such as one or more flash memory devices or other non-volatile solid-state memory devices. Access to memory 402 by other components of the stylus 203, such as the CPU(s) 420 and peripheral interface 418, is optionally controlled by the memory controller 422. 【0187】 Using the peripheral interface 418, the input and output peripherals of this stylus can be connected to the CPU(s) 420 and memory 402. One or more processors 420 operate or execute various software programs and / or instruction sets stored in memory 402 to perform various functions for the stylus 203 and process data. 【0188】 In some embodiments, the peripheral interface 418, the CPU(s) 420, and the memory controller 422 are optionally implemented on a single chip, such as chip 404. In some other embodiments, they are optionally implemented on separate chips. 【0189】 The RF (radio frequency) circuit 408 transmits and receives RF signals, also known as electromagnetic signals. The RF circuit 408 converts electrical signals to electromagnetic signals, or electromagnetic signals to electrical signals, and communicates with device 100 or 300, communication networks, and / or other communication devices via electromagnetic signals. The RF circuit 408 optionally includes, but is not limited to, well-known circuits for performing these functions, including, but not limited to, antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, CODEC chipsets, subscriber identification module (SIM) cards, and memory. The RF circuit 408 optionally communicates wirelessly with networks such as the Internet, also known as the World Wide Web (WWW), intranets, and / or wireless networks such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs), and other devices. Wireless communication uses one of several communication standards, protocols, and technologies at will. These communication standards, protocols, and technologies include Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), and Code Division Multiple Access (W-CDMA).Bluetooth®, Wireless Fidelity® (Wi-Fi®) (e.g., IEEE 802.11a, IEEE 802.11ac, IEEE 802.11ax, IEEE 802.11b, IEEE 802.11g, and / or IEEE 802.11n), Voice over Internet Protocol (VoIP), Wi-MAX, protocols for email (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), Instant Messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE)), Instant Messaging and Presence Services (Instant Examples include, but are not limited to, Messaging and Presence Service (IMPS), and / or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document. 【0190】 The I / O subsystem 406 connects input / output peripherals on the stylus 203, such as other input or control devices 416, to the peripheral interface 418. The I / O subsystem 406 optionally includes one or more input controllers 460 for an optical sensor controller 458, an intensity sensor controller 459, a haptic feedback controller 461, and other input or control devices. One or more input controllers 460 receive electrical signals from and transmit electrical signals to the other input or control devices 416. The other input or control devices 416 optionally include physical buttons (e.g., push buttons, rocker buttons), dials, slider switches, click wheels, etc. In some alternative embodiments, the input controller(s) 460 are optionally coupled to (or not coupled to) either an infrared port and / or a USB port. 【0191】 The stylus 203 also includes a power system 462 for supplying power to various components. The power system 462 optionally includes a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with generating, managing, and distributing power within the portable device and / or portable accessory. 【0192】 The stylus 203 also optionally includes one or more optical sensors 464. Figure 4 shows the optical sensors coupled to the optical sensor controller 458 in the I / O subsystem 406. The optical sensor(s) 464 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The optical sensor(s) 464 receives light from the environment projected through one or more lenses and converts that light into data representing an image. 【0193】 The stylus 203 also optionally includes one or more contact intensity sensors 465. Figure 4 shows a contact intensity sensor coupled to an intensity sensor controller 459 in the I / O subsystem 406. The contact intensity sensor(s) 465 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, pressure-power sensors, optical force sensors, capacitive touch-sensing surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of contact on a surface). The contact intensity sensor(s) 465 receives contact intensity information (e.g., pressure information or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is located at or near the tip of the stylus 203. 【0194】 The stylus 203 also optionally includes one or more proximity sensors 466. Figure 4 shows a proximity sensor 466 coupled to a peripheral interface 418. Alternatively, the proximity sensor 466 is coupled to an input controller 460 in an I / O subsystem 406. In some embodiments, the proximity sensors determine the proximity of the stylus 203 to an electronic device (e.g., device 100). 【0195】 The stylus 203 also optionally includes one or more tactile output generators 463. Figure 4 shows a tactile output generator coupled to a tactile feedback controller 461 in the I / O subsystem 406. The tactile output generator(s) 463 optionally includes one or more electroacoustic devices, such as a speaker or other audio component, and / or electromechanical devices that convert energy into linear motion, such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component that converts an electrical signal into a tactile output on the device). The tactile output generator(s) 463 receives a tactile feedback generation command from the tactile feedback module 433 and generates a tactile output on the stylus 203 that can be sensed by the user of the stylus 203. In some embodiments, at least one tactile output generator is positioned on or adjacent to a stylus 203 (e.g., a body or housing) and optionally generates a tactile output by moving the stylus 203 vertically (e.g., parallel to the entire length of the stylus 203) or laterally (e.g., perpendicular to the entire length of the stylus 203). 【0196】 The stylus 203 also optionally includes one or more accelerometers 467, gyroscopes 468, and / or magnetometers 469 (for example, as part of an inertial measurement unit (IMU) for obtaining information about the position and attitude of the stylus 203). Figure 4 shows sensors 467, 468, and 469 coupled to a peripheral interface 418. Alternatively, sensors 467, 468, and 469 are optionally coupled to an input controller 460 in an I / O subsystem 406. The stylus 203 optionally includes a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information about the position of the stylus 203. 【0197】 In some embodiments, the software components stored in memory 402 include an operating system 426, a communications module (or instruction set) 428, a contact / motion module (or instruction set) 430, a position module (or instruction set) 431, and a Global Positioning System (GPS) module (or instruction set) 435. Furthermore, in some embodiments, as shown in Figure 4, memory 402 stores a device / global internal state 457. The device / global internal state 457 includes one or more of the following: a sensor state, which includes information obtained from various sensors and other input or control devices 416 of the stylus; an attitude state, which includes information about the attitude of the stylus relative to a device (e.g., device 100) (e.g., position, orientation, tilt, roll, and / or distance as shown in Figures 5A and 5B); and position information, which includes information about the position of the stylus (e.g., determined by the GPS module 435). 【0198】 An operating system 426 (for example, embedded operating systems such as iOS, Darwin®, RTXC®, LINUX®, UNIX®, OS X®, WINDOWS®, or VxWorks®) includes various software components and / or drivers for controlling and managing common system tasks (e.g., memory management, power management, etc.) and facilitates communication between various hardware components and software components. 【0199】 The communication module 428 facilitates communication with other devices via one or more optional external ports 424 and also includes various software components for processing data received by the RF circuit 408 and / or external ports 424. The external ports 424 (e.g., Universal Serial Bus (USB), FireWire®, etc.) are adapted to connect to other devices directly or indirectly through a network (e.g., the Internet, Wi-Fi, etc.). In some embodiments, the external ports are Lightning connectors identical to, or similar to, and / or compatible with, the Lightning® connectors used in some iPhone®, iPod Touch®, and iPad® devices from Apple Inc., Cupertino, California. 【0200】 The contact / motion module 430 optionally detects contact with the stylus 203 and other touch-sensitive devices of the stylus 203 (e.g., buttons or other touch-sensitive components of the stylus 203). The contact / motion module 430 includes software components for performing various operations related to contact detection (e.g., detection of the tip of the stylus on a touch-sensitive display such as the touchscreen 112 of device 100, or on another surface such as the surface of a desk), such as determining whether contact has occurred (e.g., detection of a touchdown event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a substitute for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement (e.g., across the touchscreen 112 of device 100), and determining whether the contact has been terminated (e.g., detection of a lift-off event or interruption of contact). In some embodiments, the contact / motion module 430 receives contact data from the I / O subsystem 406. Determining the movement of a contact point represented by a series of contact data optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. As described above, in some embodiments, one or more of these operations related to contact detection are performed by the device using the contact / motion module 130 (in addition to or instead of a stylus using the contact / motion module 430). 【0201】 The contact / motion module 430 optionally detects gesture input from the stylus 203. Different gestures on the stylus 203 have different contact patterns (e.g., different movements, timings, and / or intensity of contact detected). Thus, gestures are optionally detected by detecting specific contact patterns. For example, detecting a single tap gesture involves detecting a touchdown event (e.g., at the icon's location) followed by a lift-off event at the same location (or substantially the same location) as the touchdown event. In another embodiment, detecting a swipe gesture involves detecting a touchdown event followed by one or more stylus-dragging events, and then a lift-off event. As described above, in some embodiments, gesture detection is performed by the device using the contact / motion module 130 (in addition to or instead of the stylus using the contact / motion module 430). 【0202】 In conjunction with the accelerometer 467, gyroscope 468, and / or magnetometer 469, the position module 431 optionally detects attitude information about the stylus, such as the stylus's orientation (roll, pitch, and / or yaw) within a specific coordinate system. In conjunction with the accelerometer 467, gyroscope 468, and / or magnetometer 469, the position module 431 optionally detects stylus movement gestures, such as flicking, tapping, and rolling. The position module 431 includes software components for performing various actions related to detecting the position of the stylus within a specific coordinate system and detecting changes in the stylus's position. In some embodiments, the position module 431 detects the attitude state of the stylus relative to the device and detects changes in the attitude state of the stylus relative to the device. As described above, in some embodiments, the device 100 or 300 uses the position module 131 (in addition to or instead of using the position module 431 for the stylus) to determine the orientation of the stylus relative to the device and any changes in the orientation of the stylus. 【0203】 The haptic feedback module 433 includes various software components for generating instructions for use by the haptic output generator(s) 463 to generate haptic output at one or more locations on the stylus 203 in response to user interaction with the stylus 203. 【0204】 The GPS module 435 determines the location of the stylus and provides this information for use in various applications (e.g., applications that provide location-based services such as an application to find a lost device and / or accessory). 【0205】 Each of the modules and applications identified above corresponds to an executable set of instructions for performing one or more of the above functions and the methods described in this application (e.g., methods executed by a computer and other information processing methods described herein). These modules (i.e., sets of instructions) need not be implemented as separate software programs, procedures, or modules, and thus, various subsets of these modules may optionally be combined or rearranged in various embodiments. In some embodiments, the memory 402 optionally stores a subset of the identified modules and data structures described above. Further, the memory 402 optionally stores additional modules and data structures not described above. 【0206】 Figures 5A to 5B show the orientation of the stylus 203 relative to a touch-sensing surface (e.g., the touchscreen 112 of device 100) according to several embodiments. In some embodiments, the orientation of the stylus 203 corresponds to (or shows) the projection position of the tip (or other representative portion) of the stylus on the touch-sensing surface (e.g., the (x,y) position 504 in Figure 5A), the orientation of the stylus relative to the touch-sensing surface (e.g., the orientation 506 in Figure 5A), the tilt of the stylus relative to the touch-sensing surface (e.g., the tilt 512 in Figure 5B), and / or the distance of the stylus relative to the touch-sensing surface (e.g., the distance 514 in Figure 5B). In some embodiments, the orientation of the stylus 203 corresponds to (or shows) the pitch, yaw, and / or roll of the stylus (e.g., the orientation of the stylus relative to a specific coordinate system such as the touch-sensing surface (e.g., the touchscreen 112) or the ground). In some embodiments, the attitude state includes a set of attitude parameters (e.g., one or more attitude parameters). In some embodiments, the attitude state is detected according to one or more measurements from a stylus 203 transmitted to an electronic device (e.g., device 100). For example, the stylus measures its tilt (e.g., tilt 512 in Figure 5B) and / or orientation (e.g., orientation 506 in Figure 5A) and transmits the measurements to device 100. In some embodiments, instead of, or in combination with, the attitude state is detected according to raw outputs from one or more electrodes in the stylus, sensed by a touch-sensing surface (e.g., touchscreen 112 of device 100). For example, the touch-sensing surface receives raw outputs from one or more electrodes in the stylus and calculates the tilt and / or orientation of the stylus based on the raw outputs (optionally, in combination with attitude state information provided by the stylus based on sensor measurements generated by the stylus). 【0207】 Figure 5A shows a stylus 203 with respect to a touch-sensing surface (e.g., the touchscreen 112 of device 100) from a viewpoint directly above the touch-sensing surface, according to several embodiments. In Figure 5A, the z-axis 594 points in the direction away from the plane of the paper (i.e., perpendicular to the plane of the touchscreen 112), the x-axis 590 is parallel to the first edge (e.g., length) of the touchscreen 112, and the y-axis 592 is parallel to the second edge (e.g., width) of the touchscreen 112, and the y-axis 592 is perpendicular to the x-axis 590. 【0208】 Figure 5A shows the tip of the stylus 203 at position (x, y) 504. In some embodiments, the tip of the stylus 203 is the end of the stylus, configured to determine the proximity of the stylus to a touch-sensitive surface (e.g., touchscreen 112). In some embodiments, the projection of the stylus tip onto the touch-sensitive surface is an orthographic projection. In other words, the projection of the stylus tip onto the touch-sensitive surface is the point at the end of a line from the stylus tip to the touch-sensitive surface, perpendicular to the surface of the touch-sensitive surface (e.g., position (x, y) 504, where the stylus tip would touch the touch-sensitive surface if the stylus were moved directly along a path perpendicular to the touch-sensitive surface). In some embodiments, the (x, y) position of the lower left corner of the touchscreen 112 is position (0, 0) (e.g., position (0, 0) 502), and other (x, y) positions on the touchscreen 112 are relative to the lower left corner of the touchscreen 112. Alternatively, in some embodiments, the (0,0) position is located at another location on the touchscreen 112 (for example, at the center of the touchscreen 112), and the other (x,y) positions are relative to the (0,0) position on the touchscreen 112. 【0209】 Furthermore, Figure 5A shows a stylus 203 having an orientation 506. In some embodiments, the orientation 506 is the orientation of the projection of the stylus 203 onto the touchscreen 112 (e.g., the orthogonal projection of a line corresponding to the length of the stylus 203 or the line between the projections of two different points of the stylus 203 onto the touchscreen 112). In some embodiments, the orientation 506 is with respect to at least one axis in a plane parallel to the touchscreen 112. In some embodiments, the orientation 506 is with respect to a single axis in a plane parallel to the touchscreen 112 (e.g., axis 508 having a clockwise rotation angle from axis 508 in the range of 0 to 360 degrees, as shown in Figure 5A). Alternatively, in some embodiments, the orientation 506 is with respect to a pair of axes in a plane parallel to the touchscreen 112 (e.g., x-axis 590 and y-axis 592, as shown in Figure 5A, or a pair of axes associated with an application displayed on the touchscreen 112). 【0210】 In some embodiments, a marker (e.g., marker 516) is displayed on a touch-sensitive display (e.g., the touchscreen 112 of device 100). In some embodiments, marker 516 indicates where the stylus will touch (or mark) the touch-sensitive display before the stylus touches the touch-sensitive display. In some embodiments, marker 516 is a portion of a mark drawn on the touch-sensitive display. In some embodiments, marker 516 is separate from the mark drawn on the touch-sensitive display and corresponds to a virtual "pen tip" or other element indicating where the mark will be drawn on the touch-sensitive display. 【0211】 In some embodiments, the marker 516 is displayed according to the orientation of the stylus 203. For example, in some situations, the marker 516 is displaced from the (x,y) position 504 (as shown in Figures 5A and 5B), and in other situations, the marker 516 is not displaced from the (x,y) position 504 (for example, if the tilt 512 is zero degrees, the marker 516 is displayed at or near the (x,y) position 504). In some embodiments, the marker 516 is displayed with different colors, sizes (or radius or area), opacity, and / or other characteristics according to the orientation of the stylus. In some embodiments, the displayed marker corresponds to the thickness of the glass layer on the touch-sensitive display so that the marker is transmitted "on the pixels" of the touch-sensitive display through the marker, rather than being displayed "on the glass" covering the pixels. 【0212】 Figure 5B shows a stylus 203 relative to a touch-sensing surface (e.g., the touchscreen 112 of device 100) from a side view of the touch-sensing surface, according to several embodiments. In Figure 5B, the z-axis 594 points in a direction perpendicular to the plane of the touchscreen 112, the x-axis 590 is parallel to the first edge (e.g., length) of the touchscreen 112, and the y-axis 592 is parallel to the second edge (e.g., width) of the touchscreen 112, and the y-axis 592 is perpendicular to the x-axis 590. 【0213】 Figure 5B shows a stylus 203 having a tilt 512. In some embodiments, the tilt 512 is an angle with respect to the normal of the surface of the touch-sensing surface (also simply called the normal of the touch-sensing surface) (e.g., normal 510). As shown in Figure 5B, the tilt 512 is zero when the stylus is perpendicular / right to the touch-sensing surface (e.g., when the stylus 203 is parallel to the normal 510), and the tilt increases as the stylus is tilted closer to being parallel to the touch-sensing surface. 【0214】 Furthermore, Figure 5B shows the distance 514 of the stylus 203 relative to the touch-sensing surface. In some embodiments, the distance 514 is the distance from the tip of the stylus 203 to the touch-sensing surface in a direction perpendicular to the touch-sensing surface. For example, in Figure 5B, the distance 514 is the distance from the tip of the stylus 203 to position (x, y) 504. 【0215】 The terms “x-axis,” “y-axis,” and “z-axis,” as used herein, indicate specific directions in a particular figure, but it should be understood that these terms do not refer to absolute directions. In other words, the “x-axis” may be any corresponding axis, and the “y-axis” may be a specific axis separate from the x-axis. Generally, the x-axis is perpendicular to the y-axis. Similarly, the “z-axis” is separate from the “x-axis” and “y-axis,” and is generally perpendicular to both the “x-axis” and “y-axis.” 【0216】 Furthermore, Figure 5B shows the rotation of the roll 518 and stylus 203 around their entire length (long axis). 【0217】 Here, we turn our attention to an embodiment of a user interface ("UI") that is optionally implemented on the portable multifunction device 100. 【0218】 Figure 6A shows an exemplary user interface for an application menu on a portable multifunction device 100 according to several embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, the user interface 600 includes the following elements, or subsets or supersets thereof. ●Signal strength indicators (single or multiple) for wireless communication (single or multiple) such as cellular and Wi-Fi signals 602, ●Time 604, ●Bluetooth indicator 605, ●Battery status indicator 606, ●Tray 608, which includes icons for frequently used applications such as the following: ○Optionally including an indicator 614 for the number of missed calls or voicemail messages, an icon 616 labeled "Telephone" for the telephone module 138, An icon 618 for the email client module 140, labeled "Mail," optionally including an indicator 610 for the number of unread emails. ○ Icon 620 for browser module 147, labeled "Browser", and ○ Icon 622 for the video and music player module 152, also known as the iPod (trademark of Apple Inc.) module 152, labeled as "iPod", and ● Icons for other applications, such as the ones listed below. ○ Icon 624 for IM module 141, labeled "Message" ○ Icon 626 for calendar module 148, labeled "Calendar", ○ Icon 628 for image management module 144, labeled "Photo" ○ Icon 630 for camera module 143, labeled "Camera" ○ Icon 632 for video editing module 155, labeled "Video Editing" ○ Icon 634 for stock widget 149-2, labeled "Stock Price" ○ Icon 636 for map module 154, labeled "Map" ○ Icon 638 for weather widget 149-1, labeled "Weather" ○ Icon 640 for alarm clock widget 149-4, labeled "Clock" ○ Icon 642 for training support module 142, labeled "Training Support" ○ Icon 644 for memo module 153, labeled as "Memo", and ○ An icon 646 for a configuration application or module that provides access to settings related to device 100 and its various applications 136. 【0219】 It should be noted that the icon labels shown in Figure 6A are illustrative only. For example, in some embodiments, the icon 622 for the video and music player module 152 is labeled "Music" or "Music Player." Other labels are optionally used for various application icons. In some embodiments, the label for each application icon includes the name of the application to which that application icon corresponds. In some embodiments, the label for a particular application icon is different from the name of the application to which that particular application icon corresponds. 【0220】 Figure 6B shows an exemplary user interface on a device (e.g., device 300 in Figure 3) that has a touch-sensitive surface 651 (e.g., a tablet or touchpad 355 in Figure 3) separate from the display 650. Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of the sensors 359) for detecting the intensity of contact on the touch-sensitive surface 651, and / or one or more tactile output generators 359 for generating tactile output to the user of device 300. 【0221】 Figure 6B shows an exemplary user interface on a device (e.g., device 300 in Figure 3) that has a touch-sensitive surface 651 (e.g., tablet or touchpad 355 in Figure 3) separate from the display 650. Many of the following embodiments will be described with reference to input on the touchscreen display 112 (when the touch-sensitive surface and the display are combined), but in some embodiments, the device detects input on a touch-sensitive surface separate from the display, as shown in Figure 6B. In some embodiments, the touch-sensitive surface (e.g., 651 in Figure 6B) has a principal axis (e.g., 652 in Figure 6B) corresponding to a principal axis (e.g., 653 in Figure 6B) on the display (e.g., 650). According to these embodiments, the device detects contact with the touch-sensitive surface 651 (e.g., 660 and 662 in Figure 6B) at positions corresponding to each of the positions on the display (e.g., 660 corresponds to 668 and 662 corresponds to 670 in Figure 6B). Thus, when the touch-sensitive surface is separate from the display, user input detected by the device on the touch-sensitive surface (e.g., 651 in Figure 6B) (e.g., touches 660 and 662, and their movement) is used by the device to operate the user interface on the display of the multifunction device (e.g., 650 in Figure 6B). It should be understood that a similar method may be optionally used for other user interfaces described herein. 【0222】 Furthermore, while the following embodiments primarily refer to and describe finger input (e.g., finger touch, finger tap gesture, finger swipe gesture, etc.), it should be understood that in some embodiments, one or more of these finger inputs may be replaced by input from another input device (e.g., mouse-based input, or stylus input). For example, a swipe gesture may optionally be replaced with a mouse click (e.g., instead of touch), followed by cursor movement along the swipe path (e.g., instead of touch movement). In another embodiment, a tap gesture may optionally be replaced with a mouse click (e.g., instead of stopping touch detection after touch detection) while the cursor is positioned over the tap gesture. Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may be used simultaneously and optionally, or that a mouse and finger touch may be used simultaneously and optionally. 【0223】 As used herein, the term “focus selector” refers to an input element that indicates the current portion of the user interface with which the user is interacting. In some implementations, including a cursor or other location marker, the cursor acts as a “focus selector” when input (e.g., a press input) is detected on a touch-sensitive surface (e.g., the touchpad 355 in Figure 3, or the touch-sensitive surface 651 in Figure 6B), and while the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations, including a touchscreen display (e.g., the touch-sensitive display system 112 in Figure 1A, or the touchscreen in Figure 6A) that enables direct interaction with user interface elements on the touchscreen display, the contact detected on the touchscreen acts as a “focus selector,” so that when input (e.g., a press input by touch) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, that particular user interface element is adjusted according to the detected input. In some implementations, focus is moved from one area of ​​the user interface to another without corresponding cursor movement or touch movement on the touchscreen display (for example, by moving focus from one button to another using the tab key or arrow keys). In these implementations, the focus selector moves in accordance with the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector employs, the focus selector is, in general, a user interface element (or touch on the touchscreen display) controlled by the user to communicate the user's intended interaction with the user interface (for example, by indicating to the device the user interface element that the user intends to interact with).For example, the position of a focus selector (e.g., cursor, touch, or selection box) over a corresponding button while a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen) indicates that the user intends to activate that corresponding button (rather than other user interface elements displayed on the device's display). 【0224】 As used herein and in the claims, the term “strength” of contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of contact on a touch-sensitive surface (e.g., finger contact or stylus contact), or a proxy for the force or pressure of contact on a touch-sensitive surface. The strength of contact has a range of values, including at least four distinct values, and more typically hundreds of different values ​​(e.g., at least 256). The strength of contact is determined (or measured) optionally using various methods and various sensors, or combinations of sensors. For example, one or more force sensors placed below or adjacent to the touch-sensitive surface are optionally used to measure the force at various points on the touch-sensitive surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average or sum) to determine the estimated force of contact. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change in the contact area detected on the touch-sensitive surface, the capacitance and / or change in the touch-sensitive surface adjacent to the contact, and / or the resistance and / or change in the resistance of the touch-sensitive surface adjacent to the contact may be optionally used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the substitute measurement of the force or pressure of the contact is used directly to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some implementations, the substitute measurement of the force or pressure of the contact is converted to an estimated force or pressure, and this estimated force or pressure is used to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of contact as an attribute of user input allows for user access to additional device functions that might otherwise be difficult to access, in reduced-size devices where the area for displaying affordances (e.g., on a touch-sensitive display) and / or receiving user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical control such as a knob or button) is limited. 【0225】 In some embodiments, the contact / motion modules 130 and / or 430 use a set of one or more intensity thresholds to determine whether an action has been performed by a user (for example, whether a user has "clicked" on an icon). In some embodiments, at least a subset of the intensity thresholds is determined according to software parameters (for example, the intensity thresholds are not determined by activation thresholds of a particular physical actuator and can be adjusted without changing the physical hardware of device 100). For example, the mouse "click" threshold for a trackpad or touchscreen display can be set to one of a wide range of default thresholds without changing the trackpad or touchscreen display hardware. In addition, in some embodiments, the user of the device is provided with software settings to adjust one or more of the set of intensity thresholds (for example, by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds immediately after a system-level click of the "intensity" parameter). 【0226】 As used herein and in the claims, the term “characteristic intensity” of a contact refers to the characteristics of that contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predetermined number of intensity samples, or on a set of intensity samples collected within a predetermined period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) for a predetermined event (e.g., after detection of contact, before detection of lift-off of contact, before or after detection of the start of movement of contact, before detection of the end of contact, before or after detection of an increase in contact intensity, and / or before or after detection of a decrease in contact intensity). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum intensity of the contact, the mean value of the contact intensity, the average value of the contact intensity, the top 10% value of the contact intensity, half the maximum intensity of the contact intensity, 90% of the maximum intensity of the contact intensity, etc. In some embodiments, the duration of contact is used to determine characteristic intensity (for example, when characteristic intensity is the average intensity of contact over time). In some embodiments, characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an action was performed by a user. For example, the set of one or more intensity thresholds may include a first intensity threshold and a second intensity threshold. In this embodiment, a first action is performed as a result of contact with a characteristic intensity not exceeding the first threshold, a second action is performed as a result of contact with a characteristic intensity exceeding the first intensity threshold but not exceeding the second intensity threshold, and a third action is performed as a result of contact with a characteristic intensity exceeding the second intensity threshold. In some embodiments, the comparison between characteristic intensity and one or more intensity thresholds is not used to determine whether to perform the first or second action, but rather to determine whether to perform one or more actions at all (for example, whether to perform each option or to omit the performance of each action). 【0227】 In some embodiments, a portion of the gesture is identified for the purpose of determining characteristic intensity. For example, a touch-sensitive surface may receive a continuous swipe contact (e.g., a drag gesture) that transitions from a starting position to an ending position, where the intensity of the contact increases. In this embodiment, the characteristic intensity of the contact at the ending position may be based on only a portion of the continuous swipe contact (e.g., only the portion of the swipe contact at the ending position), rather than the entire continuous swipe contact. In some embodiments, a smoothing algorithm may be applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm may optionally include one or more of the following: a non-weighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some situations, these smoothing algorithms exclude small increases or decreases in the intensity of the swipe contact for the purpose of determining characteristic intensity. 【0228】 The user interface diagrams described herein include one or more intensity thresholds (e.g., contact detection intensity threshold IT0, light pressure intensity threshold IT0). L Deep pressure intensity threshold IT D (For example, at least initially I L (higher), and / or one or more other intensity thresholds (e.g., I L Lower intensity threshold I HThe system optionally includes charts of various intensity levels, showing the current intensity of contact on the touch-sensitive surface relative to the touch-sensitive surface. These intensity charts are typically not part of the displayed user interface but are provided to aid in the interpretation of those charts. In some embodiments, a light press intensity threshold corresponds to the intensity at which the device will perform an action typically associated with a physical mouse button or trackpad click. In some embodiments, a deep press intensity threshold corresponds to the intensity at which the device will perform an action different from the action typically associated with a physical mouse button or trackpad click. In some embodiments, if contact is detected at a characteristic intensity below the light press intensity threshold (for example, above a slight contact detection intensity threshold IT0 below which contact is no longer detected), the device moves the focus selector in accordance with the movement of contact on the touch-sensitive surface without performing an action associated with the light or deep press intensity threshold. Generally, unless otherwise specified, these intensity thresholds are consistent across different sets of user interface charts. 【0229】 In some embodiments, the device's response to an input detected by the device is based on a criterion based on the contact intensity between inputs. For example, for some "light press" inputs, a contact intensity exceeding a first intensity threshold between inputs triggers a first response. In some embodiments, the device's response to an input detected by the device is based on a criterion that includes both a contact intensity and time-based criterion between inputs. For example, for some "deep press" inputs, a contact intensity exceeding a second intensity threshold greater than a first intensity threshold for light presses between inputs triggers a second response only if a delay time has elapsed between the agreement with the first intensity threshold and the agreement with the second intensity threshold. This delay time is typically less than 200 ms (e.g., depending on the magnitude of the second intensity threshold, the delay time increases as the second intensity threshold increases, to 40 ms, 100 ms, or 120 ms). This delay time helps prevent accidental deep press inputs. In another embodiment, for some "deep press" inputs, there is a period of reduced sensitivity that occurs after the point in time when the first intensity threshold is met. During the period of reduced sensitivity, the second intensity threshold increases. This temporary increase in the second intensity threshold also helps prevent accidental deep press inputs. For other deep press inputs, the response to detecting deep press inputs is not based on a time-based criterion. 【0230】 In some embodiments, one or more input intensity thresholds and / or corresponding outputs vary based on one or more factors, such as user settings, contact movement, input timing, the application being run, the rate at which intensity is applied, the current number of inputs, user history, environmental factors (e.g., ambient noise), and the position of the focus selector. Illustrative factors are described in U.S. Patent Applications 14 / 399,606 and 14 / 624,296, which are incorporated herein by reference in their entirety. 【0231】 Light pressure intensity threshold IT L From strength below a light pressure intensity threshold IT L and deep pressure intensity threshold IT DAn increase in the characteristic strength of a contact to an intensity between that and is sometimes referred to as a "light press" input. A deep press intensity threshold IT D An increase in the characteristic strength of a contact from an intensity below the deep press intensity threshold IT to an intensity above the deep press intensity threshold IT D is sometimes referred to as a "deep press" input. An increase in the characteristic strength of a contact from an intensity below the contact detection intensity threshold IT0 to an intensity between the contact detection intensity threshold IT0 and the light press intensity threshold IT L is sometimes referred to as the detection of a contact on the touch surface. A decrease in the characteristic strength of a contact from an intensity above the contact detection intensity threshold IT0 to an intensity below the contact detection intensity threshold IT0 is sometimes referred to as the detection of a lift-off of a contact from the touch surface. In some embodiments, IT0 is zero. In some embodiments, IT0 is greater than zero. In some figures, shaded circles or ellipses are used to represent the intensity of a contact on the touch sensing surface. In some figures, unshaded circles or ellipses are used to represent each contact on the touch sensing surface without specifying the intensity of each contact. 【0232】 In some embodiments described herein, one or more operations are performed in response to the detection of a gesture that includes each press input, or in response to the detection of each press input performed at each contact (or contacts), and each of those press inputs is detected based at least in part on the detection of an increase in the intensity of a contact (or contacts) that exceeds a press input intensity threshold. In some embodiments, each operation is performed in response to the detection of an increase in the intensity of each contact that exceeds a press input intensity threshold (e.g., each operation is performed by the "downstroke" of each press input). In some embodiments, a press input includes an increase in the intensity of each contact that exceeds a press input intensity threshold and a subsequent decrease in the intensity of the contact that is below the press input intensity threshold, and each operation is performed in response to the detection of the subsequent decrease in the intensity of each contact that is below the press input threshold (e.g., each operation is performed by the "upstroke" of each press input). 【0233】 In some embodiments, the device employs intensity hysteresis to avoid unexpected inputs, which may be referred to as "jitter," and the device defines or selects a hysteresis intensity threshold that has a predetermined relationship with a pressing input intensity threshold (for example, the hysteresis intensity threshold is X intensity units lower than the pressing input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable ratio of the pressing input intensity threshold). Thus, in some embodiments, the pressing input includes an increase in the intensity of each contact above the pressing input intensity threshold, and a subsequent decrease in the intensity of the contact below the hysteresis intensity threshold corresponding to the pressing input intensity threshold, and each action is performed in response to the detection of the subsequent decrease in the intensity of each contact below that hysteresis intensity threshold (for example, each action is performed by the "upstroke" of each pressing input). Similarly, in some embodiments, a press input is detected only when the device detects an increase in contact intensity from below a hysteresis intensity threshold to above a press input intensity threshold, and optionally a decrease in subsequent contact intensity to below the hysteresis intensity, and the corresponding action is performed in response to the detection of that press input (e.g., depending on the situation, an increase in contact intensity or a decrease in contact intensity). 【0234】 For the sake of clarity, the description of actions performed in response to a press input associated with a press input intensity threshold, or in response to a gesture including that press input, is optionally triggered in response to the detection of an increase in contact intensity above the press input intensity threshold, an increase in contact intensity from below the hysteresis intensity threshold to above the press input intensity threshold, a decrease in contact intensity below the press input intensity threshold, or a decrease in contact intensity below the hysteresis intensity threshold corresponding to the press input intensity threshold. Furthermore, in embodiments described as performing an action in response to the detection of a decrease in contact intensity below the press input intensity threshold, that action is optionally performed in response to the detection of a decrease in contact intensity below a hysteresis intensity threshold corresponding to the press input intensity threshold and lower than that threshold. As described above, in some embodiments, these responses are also triggered by a matching time-based criterion (e.g., a delay time elapsed between a matching first intensity threshold and a matching second intensity threshold). User interface and related processes The system displays and updates a marker corresponding to the stylus's orientation before it touches the touch-sensitive surface. 【0235】 Some electronic devices use a stylus associated with them to provide an additional way of input to the device's touch-sensitive surface. For example, some cellular phones, laptops, and tablets have the ability to receive input from a stylus. However, for various reasons (e.g., the thickness of the stylus tip, the thickness of the glass on the device), users may find it difficult to know exactly where the bidirectional action of the stylus (e.g., marking) will occur before the stylus touches the touch-sensitive surface. The following embodiments address this problem by displaying and updating markers corresponding to the orientation of the stylus (e.g., the distance, tilt, and / or orientation of the stylus relative to the device's touch-sensitive display) before the stylus touches the touch-sensitive display. 【0236】 Figures 7A–7J show exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state, according to several embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in Figures 8A–8D. Some of the embodiments described below refer to input on a touchscreen display (for example, on the touchscreen 112, where the touch-sensing surface and the display are combined), but in some embodiments, the device detects input on a touch-sensing surface 651 separate from the display 650, as shown in Figure 6B. 【0237】 In some embodiments, the device is an electronic device comprising a separate display (e.g., display 650) and a separate touch-sensitive surface (e.g., touch-sensitive surface 651). In some embodiments, the device is a portable multifunction device 100, the display is a touch-sensitive display system 112, and the touch-sensitive surface includes a tactile output generator 163 on the display (Figure 1A). For ease of explanation, embodiments described with reference to Figures 7A-7J and 8A-8D will be described with reference to operations performed on a device comprising the touch-sensitive display system 112. In such embodiments, the focus selector is optionally the contact of each finger or stylus, a representative point corresponding to the finger or stylus contact (e.g., the center of each contact or a point associated with each contact), or the center of two or more contacts detected on the touch-sensitive display system 112. However, similar operations are optionally performed on a device comprising a display 650 and a separate touch-sensing surface 651, in response to the detection of contact on (or near) the touch-sensing surface 651, as described in Figures 7A to 7J, while the user interface shown in Figures 7A to 7J is displayed on the display 650. 【0238】 Figures 7A–7J illustrate exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state according to several embodiments. Figure 7A shows the touchscreen 112 along with additional details of the device 100 (e.g., speaker 111, light sensor 164, proximity sensor 166, etc.), but for clarity, Figures 7B–7J simply show the touchscreen 112 of the device 100 without showing other details of the device 100. Furthermore, Figure 7A shows the embodiment from a viewpoint directly above the touch-sensing surface (e.g., the touchscreen 112 of the device 100), while Figures 7B–7J show the embodiment from two viewpoints: a viewpoint directly above the touch-sensing surface (e.g., the touchscreen 112 of the device 100) and a side view of the touch-sensing surface. 【0239】 Figure 7A shows an embodiment in which a marker (e.g., marker 716-a) is displayed corresponding to the orientation of a stylus (e.g., stylus 203). In this embodiment, the stylus 203 has an orientation having an orientation of the stylus 203 relative to the touchscreen 112 (e.g., orientation 706-a) and a projection position of the tip of the stylus 203 on the touchscreen 112 (e.g., (x,y) position 704-a). As shown in Figure 7A, if the stylus 203 is positioned with the tip projection at orientation 706-a (e.g., about 315 degrees clockwise with respect to axis 508) and (x,y) position 704-a before the stylus 203 touches the touchscreen 112, then marker 716-a is displayed on the touchscreen 112 to indicate where the stylus 203 will touch (or mark) the touchscreen 112. In some embodiments, when the stylus is positioned in a first orientation, the marker is displaced in a first direction on the touchscreen 112 relative to the (x,y) position 704-a, and when the stylus is positioned in a second orientation separate from the first orientation, the marker is displaced in a second direction on the touchscreen 112 relative to the (x,y) position 704-a. For example, in Figure 5A, when the stylus 203 is positioned in orientation 506 (e.g., about 45 degrees clockwise rotation with respect to axis 508), the marker 516 is displaced southwest relative to the (x,y) position 504, and in Figure 7A, when the stylus 203 is positioned in orientation 706-a (e.g., about 315 degrees clockwise rotation with respect to axis 508), the marker 716-a is displaced southeast relative to the (x,y) position 704-a. 【0240】 Figures 7B to 7E show an embodiment in which the distance (e.g., distance 714) of a stylus (e.g., stylus 203) to a touch-sensitive display (e.g., touchscreen 112) is changed, and the displayed marker (e.g., marker 716) is updated in accordance with the change in distance. In Figures 7B to 7E, the orientation of the stylus (e.g., orientation 706-b), the (x,y) position of the tip of the stylus (e.g., (x,y) position 704-b), and the tilt of the stylus (e.g., tilt 712-a) remain constant, and as the stylus moves closer to the touch-sensitive display, the distance of the stylus to the touch-sensitive display changes (e.g., from distance 714-a to distance 714-b, distance 714-c, distance 714-d). Furthermore, as the stylus 203 moves closer to the touchscreen 112, the markers are updated on the touchscreen 112 (for example, from marker 716-b to marker 716-c, marker 716-d, marker 716-e). As shown in this embodiment, in some embodiments, as the stylus 203 moves closer to the touchscreen 112, the markers change their opacity (for example, by increasing the opacity), change their size (or radius or area) (for example, by decreasing the size), and / or change their color (for example, by darkening the color). 【0241】 Figures 7E-7G illustrate an embodiment in which the tilt (e.g., tilt 712) of a stylus (e.g., stylus 203) relative to a touch-sensitive display (e.g., touchscreen 112) is changed, and the displayed marker (e.g., marker 716) is updated in response to the change in tilt. In Figures 7E-7G, the orientation of the stylus (e.g., orientation 706-b), the (x,y) position of the tip of the stylus (e.g., (x,y) position 704-b), and the distance of the stylus from the touch-sensitive display (e.g., distance 714-d) remain constant, and as the stylus approaches the device 100 parallel to it and tilts, the tilt of the stylus changes (e.g., from tilt 712-a to tilt 712-b, tilt 712-c). As shown in this embodiment, as the tilt increases, the magnitude of the distance between the (x,y) position of the tip of the stylus and the marker increases until it reaches a predetermined maximum distance. In this embodiment, since marker 716-f (in Figure 7F) is at the predetermined maximum distance, the tilt of the stylus 203 changes from tilt 712-b (in Figure 7F) to tilt 712-c (in Figure 7G), but marker 716-f remains in the same position. 【0242】 Figure 7H shows an embodiment in which the display of a marker on a touch-sensitive display (e.g., touchscreen 112) is stopped when the stylus (e.g., stylus 203) is farther than a predetermined distance from the surface of the touch-sensitive display. Compared to Figure 7B, if the marker (e.g., marker 716-b) is displayed when the tip of the stylus 203 is below the threshold 710, then, as shown in Figure 7H, when the tip of the stylus 203 exceeds the threshold 710 (e.g., at a distance 714-e), the marker stops being displayed on the touchscreen 112. 【0243】 Figure 7I shows an embodiment in which a marker (e.g., marker 716-g) is displayed when a stylus (e.g., stylus 203) is in physical contact with the surface of a touch-sensitive display (e.g., touchscreen 112). In some embodiments, when the stylus 203 is in physical contact with the touchscreen 112, the distance of the stylus 203 away from the touchscreen 112 (e.g., distance 714-f) is calculated to be greater than zero (e.g., corresponding to the thickness of the glass layer on the touchscreen 112). In some embodiments, even when the stylus is in physical contact with the surface of the touch-sensitive display, the marker is updated in response to changes in orientation (as described above with respect to Figure 7A) and in response to changes in tilt (as described above with respect to Figures 7E-7G), but for brevity, the details are not repeated here. 【0244】 In some embodiments, both a marker and a mark are displayed when the stylus 203 is in physical contact with the touchscreen 112. In some embodiments, the marker corresponds to a virtual "pen tip" or other element indicating where the mark will be drawn on the touch-sensitive display. In some embodiments, the mark is a dot, line, stroke, etc., on the touch-sensitive display. In some embodiments, the marker corresponds to one end (end) of the mark. For example, if the mark being drawn is a line, the marker corresponds to (or adjacent to) the end of the line being drawn. In some embodiments, when the marker is displayed while the stylus is in physical contact with the surface of the touch-sensitive display, the shape (and optionally, color) of the marker corresponds to the shape (and optionally, color) of the tip of a virtual drawing means emulated by the stylus. For example, if the stylus is used as a virtual yellow highlighter, the marker is a yellow rectangle (corresponding to the chisel tip of the highlighter), and as the stylus is moved across the surface of the touch-sensitive display, the mark is generated (e.g., by propagating the size / shape / color of the marker along the path of the stylus). If the stylus is used as a virtual yellow highlighter, and the stylus touches down on a point on the touch-sensitive display and then lifts off without moving across the touch-sensitive display, a yellow rectangular mark (corresponding to the chisel tip of the highlighter) may appear on the point on the touch-sensitive display where the stylus touched down. 【0245】 Figure 7J shows an embodiment in which a mark (e.g., mark 718) is displayed and the display of a marker is stopped when a stylus (e.g., stylus 203) is in physical contact with the surface of a touch-sensitive display (e.g., touchscreen 112). 【0246】 Figures 8A–8D are flowcharts illustrating a method 800 for displaying and updating markers corresponding to the orientation of a stylus, according to several embodiments. The method 800 is performed in an electronic device (e.g., device 300 in Figure 3, or portable multifunction device 100 in Figure 1A) comprising a display and a touch-sensing surface. In some embodiments, the display is a touchscreen display, and the touch-sensing surface is on or integrated with the display (also simply called a touch-sensing display). In some embodiments, the display is separate from the touch-sensing surface. In some embodiments, the device includes one or more sensors for detecting signals from a stylus associated with the device, and the stylus includes a representative portion (e.g., the tip of the stylus). In some embodiments, the portion of the stylus other than the tip is used to estimate the position of the tip. Some operations of the method 800 are optionally combined, and / or the order of some operations is optionally changed. 【0247】 As described later, Method 800 provides an intuitive method for displaying and updating markers corresponding to the stylus's orientation. This method reduces the number, range, and / or types of user input when using a stylus to interact with an electronic device, thereby creating a more efficient human-machine interface. With respect to battery-operated electronic devices, power is saved and the interval between battery recharging is increased as the user can input with the stylus faster and more efficiently. 【0248】 The device detects the orientation of the stylus, which corresponds to (or indicates) the distance of the stylus to the touch-sensitive display, the tilt of the stylus to the touch-sensitive display, and / or the orientation of the stylus to the touch-sensitive display (802). For example, Figure 7B shows a stylus 203 in an orientation corresponding to distance 714-a, tilt 712-a, and orientation 706-b. In some embodiments, the orientation includes a set of orientation parameters (e.g., one or more orientation parameters). In some embodiments, the orientation is detected according to one or more measurements from the stylus transmitted to an electronic device. For example, the stylus measures its tilt and / or orientation and transmits these measurements to the electronic device. Alternatively, in some embodiments, the orientation is detected according to raw outputs from one or more electrodes in the stylus, which are sensed by the touch-sensitive display. For example, the touch-sensitive display receives raw outputs from one or more electrodes in the stylus and calculates the tilt and / or orientation of the stylus based on the raw outputs. 【0249】 In some embodiments, the tilt of the stylus is an angle with respect to the normal of the surface of the touch-sensitive display (also simply called the normal of the touch-sensitive display), and the orientation of the stylus is the orientation of the projection of the stylus onto the touch-sensitive display (e.g., the orthogonal projection of a line corresponding to the length of the stylus onto the touch-sensitive display or the line between the projections of two different points of the stylus) with respect to at least one axis in a plane parallel to the touch-sensitive display (804). For example, in Figure 5B, the tilt 512 of the stylus 203 is an angle with respect to the normal 510 of the touchscreen 112, and in Figure 5A, the orientation 506 of the stylus 203 is the orientation of the projection of the stylus 203 onto the touchscreen 112 with respect to axis 508. In some embodiments, the orientation of the projection of the stylus onto the touch-sensitive display is with respect to a single axis (e.g., a single axis with a clockwise rotation angle from this axis in the range of 0 to 360 degrees), such as axis 508 in Figure 5A. Alternatively, in some embodiments, the orientation of the stylus projection onto the touch-sensitive display is relative to a pair of axes (for example, the x and y axes, such as x-axis 590 and y-axis 592 in Figure 5A, or a pair of axes associated with the application displayed on the touch-sensitive display). 【0250】 In some embodiments, when the stylus is in physical contact with the surface of the touch-sensitive display, the distance of the stylus away from the touch-sensitive display is calculated to be greater than zero (for example, corresponding to the thickness of the glass layer on the touch-sensitive display (e.g., touchscreen 112) so that the marker is transmitted "on the pixels" of the display through the marker rather than "on the glass" covering the pixels) (806). In some embodiments, when the stylus is in physical contact with the surface of the touch-sensitive display, the distance of the stylus away from the touch-sensitive display is defined to be greater than zero. For example, in Figure 7I, when the stylus 203 is in physical contact with the surface of the touchscreen 112, the distance 714-f is calculated (or defined) to be greater than zero. 【0251】 In some embodiments, the orientation includes the position of the projection of the tip (or other representative portion) of the stylus onto the touch-sensitive display (808). In some embodiments, the tip of the stylus is the end of the stylus, configured to determine the proximity of the stylus to the touch-sensitive display. In some embodiments, the projection of the tip of the stylus onto the touch-sensitive display is an orthographic projection. In other words, the projection of the tip of the stylus onto the touch-sensitive display is the end point of a line from the tip of the stylus to the touch-sensitive display, perpendicular to the surface of the touch-sensitive display. For example, in Figure 5B, position (x, y) 504 is the projection of the tip of the stylus 203 onto the touchscreen 112, since this is the point where the tip of the stylus 203 would contact the touchscreen 112 if the stylus 203 were moved directly along a path perpendicular to the touchscreen 112 (e.g., along the path of the normal 510). 【0252】 In some embodiments, a first electrode of the stylus, detectable by an electronic device (e.g., by a mechanism in the device's touch-sensitive display), is located close to the tip of the stylus, and a second electrode of the stylus, detectable by an electronic device (e.g., by a mechanism in the device's touch-sensitive display), is displaced by a predetermined distance from the first electrode (810). In some embodiments, the first electrode of the stylus is located at (or near) the tip of the stylus, and the second electrode of the stylus is a ring displaced by a predetermined distance from the first electrode. In some embodiments, the stylus 203 has a first electrode at (or near) the tip of the stylus 203 and a second electrode which is a ring displaced by a predetermined distance from the first electrode, as shown in Figures 5A-5B, and both electrodes are detectable by device 100 (e.g., by a mechanism in the device 100's touchscreen 112). 【0253】 The device determines the position on the touch-sensitive display (e.g., touchscreen 112) corresponding to the detected orientation of the stylus (e.g., stylus 203) (812). Using Figures 5A-5B as an example, the position on the touchscreen 112 corresponding to the detected orientation of the stylus 203 is determined by the orientation 506, the (x, y) position 504, the tilt 512, and / or the distance 514. 【0254】 The device displays a marker on the touch-sensitive display (e.g., touchscreen 112) at a position determined before the stylus touches the touch-sensitive display, according to the orientation of the stylus (e.g., stylus 203) (814). In some embodiments, the displayed marker indicates where the stylus will touch / mark the touch-sensitive display before the stylus touches the touch-sensitive display. For example, in Figure 7B, before the stylus 203 touches the touchscreen 112 (because the stylus 203 is still at a distance 714-a from the touchscreen 112), the marker 716-b is displayed on the touchscreen 112. In some embodiments, the displayed marker corresponds to the thickness of the glass of the touch-sensitive display. 【0255】 In some embodiments, displaying a marker on a touch-sensitive display includes determining a color for the marker according to the background color of the touch-sensitive display at the determined location (816). In some embodiments, determining a color for the marker according to the background color of the touch-sensitive display at the determined location includes determining a color for the marker that contrasts with the background color of the touch-sensitive display at the determined location. For example, in some embodiments, if the background color of the touch-sensitive display is white, the determined color for the marker is gray, black, or another color that contrasts with white. For example, in Figure 7B, where the background color of the touchscreen 112 is white, the color for marker 716-b is gray. In another embodiment, in some embodiments, if the background color of the touch-sensitive display is black, the determined color for the marker is white, yellow, or another color that contrasts with black. 【0256】 The device detects changes in the distance, tilt, and / or orientation of the stylus (e.g., stylus 203) before the stylus touches the touch-sensitive display (e.g., touchscreen 112) (818). For example, Figures 7B–7E show the change in the distance of the stylus 203 from the touchscreen 112 before the stylus 203 touches the touchscreen 112 (e.g., from distance 714-a to distance 714-b, to distance 714-c, to distance 714-d). In another embodiment, Figures 7E–7G show the change in the tilt of the stylus 203 before the stylus 203 touches the touchscreen 112 (e.g., from tilt 712-a to tilt 712-b, to tilt 712-c). In another embodiment, Figures 5A and 7A show the change in orientation of the stylus 203 (for example, from orientation 506 to orientation 706-a) before the stylus 203 touches the touchscreen 112. 【0257】 In response to detecting a change, the device updates a marker displayed on the touch-sensitive display (e.g., touchscreen 112) (820). For example, Figures 7B-7E show how the displayed marker is updated in response to detecting a change in the distance of the stylus 203 from the touchscreen 112. As the distance changes from 714-a to 714-b, 714-c, and 714-d, the markers on the touchscreen 112 are updated from marker 716-b to marker 716-c, marker 716-d, and marker 716-e. In another embodiment, Figures 7E-7F show how the displayed marker is updated in response to detecting a change in the tilt of the stylus 203. As the tilt changes from tilt 712-a to tilt 712-b, the markers on the touchscreen 112 are updated from marker 716-e to marker 716-f. In another embodiment, Figures 5A and 7A show that the displayed marker is updated in response to a change in the orientation of the stylus 203. When the orientation changes from orientation 506 to orientation 706-a, the marker is updated on the touchscreen 112 from marker 516 to marker 716-a. 【0258】 In some embodiments, when the stylus (tip or other representative portion thereof) is at a first distance (perpendicular to the display) from the touch-sensitive display, the marker is displayed in a first color, and when the stylus is at a second distance (perpendicular to the display) distinct from the first distance from the touch-sensitive display, the marker is displayed in a second color distinct from the first color (822). In some embodiments, as the distance decreases, the color of the marker becomes darker. For example, in Figure 7B, when the tip of the stylus 203 is at a distance of 714-a from the touchscreen 112, the marker (e.g., marker 716-b) is displayed in light gray, and in Figure 7D, when the tip of the stylus 203 is at a distance of 714-c from the touchscreen 112 (e.g., closer to the touchscreen 112), the marker (marker 716-d) is displayed in a darker gray. 【0259】 In some embodiments, when the stylus (tip or other representative portion thereof) is at a first distance (perpendicular to the display) from the touch-sensitive display, the marker is of a first size (e.g., radius or area), and when the stylus is at a second distance (perpendicular to the display) distinct from the first distance from the touch-sensitive display, the marker is of a second size distinct from the first size (824). In some embodiments, as the distance decreases, the size of the marker decreases. For example, in Figure 7B, when the tip of the stylus 203 is at a distance of 714-a from the touchscreen 112, the marker (e.g., marker 716-b) is a large circle, and in Figure 7D, when the tip of the stylus 203 is at a distance of 714-c from the touchscreen 112 (e.g., closer to the touchscreen 112), the marker (marker 716-d) is a smaller circle. 【0260】 In some embodiments, when the stylus (tip or other representative portion thereof) is at a first distance (perpendicular to the display) from the touch-sensitive display, the marker has a first opacity, and when the stylus is at a second distance (perpendicular to the display) distinct from the first distance from the touch-sensitive display, the marker has a second opacity distinct from the first opacity (826). In some embodiments, as the distance decreases, the opacity of the marker increases. For example, in Figure 7B, when the tip of the stylus 203 is at a distance of 714-a from the touchscreen 112, the marker (e.g., marker 716-b) is less opaque, and in Figure 7D, when the tip of the stylus 203 is at a distance of 714-c from the touchscreen 112 (e.g., closer to the touchscreen 112), the marker (marker 716-d) is more opaque. 【0261】 In some embodiments, when the stylus is positioned on the touch-sensitive display in a first orientation, the marker is displaced in the first direction on the touch-sensitive display with respect to the projection of the tip (or other representative portion) of the stylus, and when the stylus is positioned on the touch-sensitive display in a second orientation separate from the first orientation, the marker is displaced in the second direction separate from the first orientation on the touch-sensitive display with respect to the projection of the tip (or other representative portion) of the stylus (828). In some embodiments, when the orientation of the stylus (e.g., stylus 203) changes, the orientation of the marker (e.g., marker 516 in Figure 5A) with respect to the projection of the tip of the stylus (e.g., position (x,y) 504 in Figure 5A) changes. For example, in Figure 5A, when the stylus 203 is positioned at orientation 506, the marker 516 is displaced in a first direction relative to the (x,y) position 504 (for example, the marker 516 is southwest of the (x,y) position 504, or the marker 516 is at a rotation angle of 225 degrees clockwise from the (x,y) position 504 with respect to the axis 508). In Figure 7A, when the stylus 203 is positioned at orientation 706-a, the marker 716-a is displaced in a second direction relative to the (x,y) position 704-a (for example, the marker 716 is southeast of the (x,y) position 704-a, or the marker 716-a is at a rotation angle of 135 degrees clockwise from the (x,y) position 704-a with respect to the axis 508). 【0262】 In some embodiments, when the stylus has a first tilt on the touch-sensitive display, the marker is displaced by a first distance on the touch-sensitive display in a direction parallel to the plane of the touch-sensitive display relative to the orthogonal projection of the tip of the stylus (or other representative portion), and when the stylus has a second tilt on the touch-sensitive display separate from the first tilt, the marker is displaced by a second distance on the touch-sensitive display in a direction parallel to the plane of the touch-sensitive display relative to the orthogonal projection of the tip of the stylus (830). In some embodiments, the method includes displacing the marker by a distance corresponding to the tilt of the stylus from the orthogonal projection of the tip of the stylus on the touch-sensitive display (e.g., position 504 in Figure 5B where the tip of the stylus would touch the touch-sensitive display if the stylus were moved directly along a path perpendicular to the touch-sensitive display (e.g., along the normal 510)). For example, in Figure 7E, when the stylus 203 has a first tilt (e.g., tilt 712-a), the marker 716-e is a first distance away from the (x,y) position 704-b, and in Figure 7F, when the stylus 203 has a second tilt (e.g., tilt 712-b), the marker 716-f is a second distance away from the (x,y) position 704-b. In some embodiments, the marker is displaced by a greater distance from the projection of the tip as the tilt of the stylus increases. For example, when the stylus 203 is positioned with an inclination of 712-a, the marker 716-e is displaced by a shorter distance relative to the (x,y) position 704-b (as shown in Figure 7E), and when the stylus 203 is positioned with an increased inclination of 712-b, the marker 716-f is displaced by a larger distance relative to the (x,y) position 704-b (as shown in Figure 7F). In some embodiments, as shown in Figure 5B, each distance from the orthogonal projection of the tip of the stylus is greater than zero but less than the distance between the point where the line projected along the entire length of the stylus intersects the touchscreen and the orthogonal projection position 504. 【0263】 In some embodiments, each distance does not exceed a predetermined maximum distance in a direction parallel to the plane of the touch-sensitive display (e.g., between the marker and the projection in a direction parallel to the plane of the touch-sensitive display) (832). For example, as shown in Figures 7E-7G, the first and second distances (as described above with respect to operation 830) do not exceed the predetermined maximum distance. In some embodiments, if the marker is already at the predetermined maximum distance, further increases in the tilt of the stylus do not increase the magnitude of the distance of the tip of the stylus to the projection. For example, as shown in Figures 7F-7G, the tilt of the stylus 203 increases from tilt 712-b to tilt 712-c, but the marker 716-f remains the same because it is already at the predetermined maximum distance with respect to the (x,y) position 704-b. 【0264】 In some embodiments, the details of operations 828, 830, and 832 apply even when the stylus (e.g., stylus 203) is in contact with the surface of a touch-sensitive display (e.g., touchscreen 112) (as described later, for example, with respect to operation 838 and method 1100). For example, in some embodiments, when the stylus 203 is in contact with the surface of the touchscreen 112, as described above with respect to operation 828, the orientation of the marker (e.g., marker 516 in Figure 5A) relative to the projection of the tip of the stylus (e.g., position (x,y) 504 in Figure 5A) changes. In another embodiment, in some embodiments, when the stylus 203 is in contact with the surface of the touchscreen 112, as described above with respect to operation 830, the magnitude of the distance between the marker (e.g., marker 516 in Figure 5A) and the projection of the tip of the stylus (e.g., position (x,y) 504 in Figure 5A) changes as the tilt of the stylus (e.g., marker 516 in Figure 5A) changes. Also in another embodiment, in some embodiments, when the stylus 203 is in contact with the surface of the touchscreen 112, as described above with respect to operation 832, the distance between the marker (e.g., marker 516 in Figure 5A) and the projection of the tip of the stylus (e.g., position (x,y) 504 in Figure 5A) does not exceed a predetermined maximum distance. 【0265】 In some embodiments, the device detects the movement of a stylus (e.g., the tip of the stylus) away from the surface of the touch-sensitive display, and in response to detecting the movement of the stylus away from the surface of the touch-sensitive display, the device updates the appearance of the marker on the touch-sensitive display based on the movement of the stylus, while maintaining the display of the marker, according to the determination that the stylus is less than a first distance away from the surface of the touch-sensitive display, and the device stops displaying the marker on the touch-sensitive display according to the determination that the stylus is greater than a second distance away from the surface of the touch-sensitive display (834). For example, as shown in Figures 7B-7G, if the tip of the stylus 203 is less than a first distance (e.g., threshold 710) away from the surface of the touchscreen 112, the device updates the appearance of the marker on the touchscreen 112 (for example, as the stylus 203 moves closer to the touchscreen 112, the marker becomes darker in color, more opaque, and / or smaller in size). Furthermore, as shown in Figure 7H, if the tip of the stylus 203 is farther from the surface of the touchscreen 112 than a second distance (e.g., threshold 710), the device stops displaying a marker on the touchscreen 112. In some embodiments, the first distance is the same as the second distance (e.g., as shown in Figures 7B and 7H, both the first and second distances are threshold 710). In some embodiments, the first distance is less than the second distance. 【0266】 In some embodiments, upon determining that the stylus is in physical contact with the surface of the touch-sensitive display, the device displays a mark on the touch-sensitive display according to its orientation, and the device ceases to display a marker on the touch-sensitive display (836). For example, as shown in Figure 7J, when the stylus 203 is in physical contact with the surface of the touchscreen 112, the device displays a mark 718 and ceases to display a marker on the touchscreen 112. 【0267】 In some embodiments, upon determination that a representative portion of the stylus (e.g., the tip of the stylus) is in physical contact with the surface of the touch-sensitive display, the device displays a marker on the touch-sensitive display according to its orientation, and the position of the marker on the touch-sensitive display is constrained such that the distance between the marker and the representative portion of the stylus in a direction parallel to the plane of the touch-sensitive display does not exceed a predetermined maximum distance (838). For example, if the tip of the stylus is in physical contact with the surface of the touch-sensitive display, the marker is displayed on the touch-sensitive display, with the distance between the marker and the tip in a direction parallel to the plane of the touch-sensitive display truncated. As shown in Figure 7I, for example, if the stylus 203 is in physical contact with the surface of the touchscreen 112, the device displays a marker 716-g, and the distance between the marker 716-g and the (x,y) position 704-b does not exceed a predetermined maximum distance (e.g., regardless of increasing tilt of the stylus 203). 【0268】 In some embodiments, before the stylus touches the surface of the touch-sensitive display (or comes within a predetermined distance of the touch-sensitive display), the device responds to the detected movement of the stylus by updating a marker and ceasing to modify the content of the application displayed on the touch-sensitive display; while the stylus is touching the surface of the touch-sensitive display (or is within a predetermined distance of the touch-sensitive display), the device responds to the detected movement of the stylus by modifying the content of the application displayed on the touch-sensitive display (840). In some embodiments, while the stylus is touching the surface of the touch-sensitive display, the device responds to the detected movement of the stylus by updating a marker. In some embodiments, while the stylus is touching the surface of the touch-sensitive display, the device ceases to display the marker (for example, as shown in Figure 7J). In some embodiments, modifying the content of the displayed application includes modifying any of the tools displayed by the application and / or modifying other content of the application. 【0269】 In some embodiments, in response to detecting that the stylus is in physical contact with the surface of the touch-sensitive display, the device smoothly transitions the (displayed) marker from a first state to a second state (842). In some embodiments, in response to detecting that the stylus is in physical contact with the surface of the touch-sensitive display, the marker transitions from a first state to a second state to indicate whether the stylus is interacting with the displayed content in a two-way manner. In some embodiments, the first state is a preview mode (e.g., a non-two-way mode in which the content is not modified by the movement of the stylus), and the second state is a two-way mode (e.g., a mode in which the content is modified by the movement of the stylus). Optionally, in some embodiments, the marker in the second state has greater opacity and / or a smaller radius than the marker in the first state. 【0270】 It should be understood that the specific order of operations described in Figures 8A-8D is merely illustrative and not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various ways of rearranging the operations described herein. Furthermore, it should be recognized that other processing details described herein (e.g., those described in the first paragraph of “Modes for Carrying Out the Invention” above) can also be applied in a manner similar to Method 800 described above in relation to Figures 8A-8D. For example, the stylus attitude state characteristics, movement, contact, gestures, user interface objects, and outputs described herein with reference to Method 800 optionally have one or more of the stylus attitude state characteristics, movement, contact, gestures, user interface objects, and outputs described herein with reference to other methods described herein (e.g., those described in the first paragraph of “Modes for Carrying Out the Invention” above). For brevity, these details will not be repeated here. 【0271】 In some embodiments, Figure 9 shows a functional block diagram of an electronic device 900 configured according to the principles of the various embodiments described. The functional blocks of this device are optionally implemented by hardware, software, firmware, or a combination thereof to perform the principles of the various embodiments described. Those skilled in the art will understand that the functional blocks described in Figure 9 can be optionally combined or separated into subblocks to perform the principles of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or separation of the functional blocks described herein, or further definitions. 【0272】 As shown in Figure 9, the electronic device 900 includes a touch-sensitive display unit 902 configured to display a user interface and receive user contact (including stylus contact), one or more sensor units 906 configured to detect signals from a stylus associated with the device, and a processing unit 908 coupled to the touch-sensitive display unit 902 and the one or more sensor units 906. In some embodiments, the processing unit 908 includes a detection unit 910, a position determination unit 912, a marker display unit 914, a change detection unit 916, an update unit 918, a mark display unit 920, and a content modification unit 922. 【0273】 The processing unit 908 is configured to detect the orientation of the stylus (for example, by the detection unit 910) corresponding to the distance of the stylus to the touch-sensitive display unit 902, the tilt of the stylus to the touch-sensitive display unit 902, and / or the orientation of the stylus to the touch-sensitive display unit 902, determine the position of the stylus on the touch-sensitive display unit 902 corresponding to the detected orientation of the stylus (for example, by the position determination unit 912), enable the display of a marker on the touch-sensitive display unit 902 at the position determined before the stylus touches the touch-sensitive display unit 902 according to the orientation of the stylus (for example, by the marker display unit 914), detect changes in the distance, tilt, and / or orientation of the stylus before the stylus touches the touch-sensitive display unit 902 (for example, by the change detection unit 916), and update the marker displayed on the touch-sensitive display unit 902 in response to the detection of a change (for example, by the update unit 918). 【0274】 The operation of the information processing method described above is optionally performed by activating one or more functional modules within the information processing device, such as a general-purpose processor (for example, those described above in relation to Figures 1A and 3) or an application-specific chip. 【0275】 The operations described above, with reference to Figures 8A-8D, are optionally performed by the components shown in Figures 1A-1B or Figure 9. For example, the detection operation 802, position determination operation 812, display operation 814, change detection operation 818, and update operation 820 are optionally performed by the event sorting unit 170, the event recognition unit 180, and the event processing unit 190. The event monitor 171 of the event sorting unit 170 detects contact (or near contact) on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to application 136-1. The corresponding event recognition unit 180 of application 136-1 compares the event information with the corresponding event definition 186 and determines whether the first contact (or near contact) (or device rotation) at the first position on the touch-sensitive surface corresponds to a default event or sub-event, such as the selection of an object on the user interface or the rotation of the device from one orientation to another. When each default event or sub-event is detected, the event recognition unit 180 activates the event processing unit 190 associated with the detection of that event or sub-event. The event processing unit 190 optionally uses or calls the data update unit 176 or the object update unit 177 to update the application's internal state 192. In some embodiments, the event processing unit 190 accesses the corresponding GUI update unit 178 to update what is displayed by the application. Similarly, it will be obvious to those skilled in the art how other processes can be performed based on the components shown in Figures 1A and 1B. While the stylus is touching the touch-sensitive surface, a marker corresponding to the stylus's orientation is displayed and updated. 【0276】 Some electronic devices use a stylus associated with them to provide an additional way of input to the device's touch-sensitive display. For example, some cellular phones, laptops, and tablets have the ability to receive input from a stylus. However, for various reasons (e.g., the thickness of the stylus tip, the thickness of the glass on the device, etc.), users may find it difficult to know exactly where the bidirectional action of the stylus (e.g., marking) will occur. The following embodiment addresses this problem by displaying and updating markers corresponding to the orientation of the stylus (e.g., the distance, tilt, and / or orientation of the stylus relative to the device's touch-sensitive display). The markers indicate where on the touch-sensitive display the mark will be made. The markers are offset from the tip of the stylus so that the stylus does not obstruct the view of the markers. The markers help the user position and use the stylus more accurately. 【0277】 Below, Figures 10A to 10K show exemplary user interfaces for displaying and updating markers corresponding to the stylus's orientation state. Figures 11A to 11D are flowcharts illustrating how to display and update markers corresponding to the stylus's orientation state. The processes in Figures 11A to 11D are illustrated using the user interfaces in Figures 10A to 10K. 【0278】 Figures 10A–10K show exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state according to several embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in Figures 11A–11D. Some of the embodiments described below are described with reference to input on a touchscreen display (for example, on touchscreen 112 when the touch-sensing surface and the display are combined), but in some embodiments the device detects input on a touch-sensing surface 651 separate from the display 650, as shown in Figure 6B. 【0279】 In some embodiments, the device is an electronic device comprising a separate display (e.g., display 650) and a separate touch-sensitive surface (e.g., touch-sensitive surface 651). In some embodiments, the device is a portable multifunction device 100, the display is a touch-sensitive display system 112, and the touch-sensitive surface includes a tactile output generator 163 on the display (Figure 1A). For ease of explanation, embodiments described with reference to Figures 10A-10K and 11A-11D will be described with reference to operations performed on a device comprising the touch-sensitive display system 112. In such embodiments, the focus selector is optionally the contact of each finger or stylus, a representative point corresponding to the finger or stylus contact (e.g., the center of each contact or a point associated with each contact), or the center of two or more contacts detected on the touch-sensitive display system 112. However, similar operations are optionally performed on a device comprising a display 650 and a separate touch-sensing surface 651, in response to the detection of contact on (or near) the touch-sensing surface 651, as described in Figures 10A to 10K, while the user interface shown in Figures 10A to 10K is displayed on the display 650. 【0280】 Figures 10A–10K show exemplary user interfaces for displaying and updating markers corresponding to the stylus orientation state according to several embodiments. Figure 10A shows the touchscreen 112 along with additional details of the device 100 (e.g., speaker 111, light sensor 164, proximity sensor 166, etc.), but for clarity, Figures 10B–10K simply show the touchscreen 112 of the device 100 without showing other details of the device 100. Furthermore, Figure 10A shows an embodiment from a viewpoint directly above the touch-sensing surface (e.g., the touchscreen 112 of the device 100), while Figures 10B–10K show embodiments from two viewpoints: a viewpoint directly above the touch-sensing surface (e.g., the touchscreen 112 of the device 100) and a side view of the touch-sensing surface. 【0281】 Figure 10A shows an embodiment in which a marker (e.g., marker 1016-a) is displayed corresponding to the orientation of a stylus (e.g., stylus 203). In this embodiment, the stylus 203 has an orientation having an orientation of the stylus 203 relative to the touchscreen 112 (e.g., orientation 1006-a) and a projection position of the tip of the stylus 203 on the touchscreen 112 (e.g., (x,y) position 1004-a). As shown in Figure 10A, when the stylus 203 is positioned with orientation 1006-a (e.g., about 315 degrees clockwise with respect to axis 508) and tip projection at (x,y) position 1004-a, marker 1016-a is displayed on the touchscreen 112 to indicate where the stylus 203 will touch (or mark) the touchscreen 112. In some embodiments, when the stylus is positioned in a first orientation, the marker is displaced in a first direction on the touchscreen 112 relative to the (x, y) position 1004-a, and when the stylus is positioned in a second orientation separate from the first orientation, the marker is displaced in a second direction on the touchscreen 112 relative to the (x, y) position 1004-a. 【0282】 Figures 10B to 10C show an embodiment in which the orientation (e.g., orientation 1006) of a stylus (e.g., stylus 203) relative to a touch-sensitive display (e.g., touchscreen 112) is changed, and the displayed marker is updated in accordance with the change in orientation (e.g., from displaying marker 1016-b at a first position to displaying marker 1016-c at a second position). In Figures 10B to 10C, the (x, y) position of the tip of the stylus (e.g., (x, y) position 1004-b), the tilt of the stylus (e.g., tilt 1012-a), and the distance of the stylus relative to the touch-sensitive display (e.g., distance 1014-a when the tip of the stylus is in contact with the touch-sensitive display) remain constant, while the orientation of the stylus relative to the touch-sensitive display changes (e.g., from orientation 1006-a to orientation 1006-b). When the orientation of the stylus 203 changes from orientation 1006-a (for example, a clockwise rotation angle of approximately 315 degrees relative to axis 508) to orientation 1006-b (for example, a clockwise rotation angle of approximately 45 degrees relative to axis 508), the displayed marker is updated on the touchscreen 112 (for example, from marker 1016-b to marker 1016-c). 【0283】 Figures 10C to 10E show an embodiment in which the tilt (e.g., tilt 1012) of a stylus (e.g., stylus 203) relative to a touch-sensitive display (e.g., touchscreen 112) is changed, and the displayed marker (e.g., marker 1016) is updated in accordance with the change in tilt. In Figures 10C to 10E, the orientation of the stylus (e.g., orientation 1006-b), the (x,y) position of the tip of the stylus (e.g., (x,y) position 1004-b), and the distance of the stylus from the touch-sensitive display (e.g., distance 1014-d when the tip of the stylus is in contact with the touch-sensitive display) remain constant, and as the stylus approaches the device 100 parallel to it and tilts, the tilt of the stylus changes (e.g., from tilt 1012-a to tilt 1012-b, tilt 1012-c). As shown in this embodiment, as the tilt increases, the magnitude of the distance between the (x,y) position of the tip of the stylus and the marker increases until it reaches a predetermined maximum distance. In this embodiment, since marker 1016-d (in Figure 10D) is at the predetermined maximum distance, the tilt of the stylus 203 changes from tilt 1012-b (in Figure 10D) to tilt 1012-c (in Figure 10E), but marker 1016-d remains in the same position. 【0284】 Figures 10F-10I illustrate embodiments in which the distance (e.g., distance 1014) of a stylus (e.g., stylus 203) to a touch-sensitive display (e.g., touchscreen 112) is varied, and a displayed marker (e.g., marker 1016) is updated in response to the change in distance. In some embodiments, the orientation includes the position of the projection of the tip (or other representative portion) of the stylus onto the touch-sensitive display. In some embodiments, the tip of the stylus is the end of the stylus, configured to determine the proximity of the stylus to the touch-sensitive display. In some embodiments, the projection of the tip of the stylus onto the touch-sensitive display is an orthographic projection. In other words, the projection of the tip of the stylus onto the touch-sensitive display is the end point of a line from the tip of the stylus to the touch-sensitive display, perpendicular to the surface of the touch-sensitive display. For example, in Figures 10F to 10I, position (x, y) 1004-b is the point where the tip of the stylus 203 would come into contact with the touchscreen 112 if the stylus 203 were moved directly along a path perpendicular to the touchscreen 112 (for example, along the path of the normal 510), and is therefore the projection of the tip of the stylus 203 onto the touchscreen 112. 【0285】 In Figures 10F to 10I, as the stylus moves away from the touch-sensitive display, the stylus's distance from the touch-sensitive display changes (for example, from distance 1014-b to distance 1014-c, distance 1014-d, and distance 1014-e), while the stylus's orientation (e.g., orientation 1006-b), the (x, y) position of the projection of the stylus tip (e.g., (x, y) position 1004-b), and the stylus's tilt (e.g., tilt 1012-a) remain constant. Furthermore, as the stylus 203 moves away from the touchscreen 112, the displayed markers are updated on the touchscreen 112 (for example, from marker 1016-e to marker 1016-f, marker 1016-g, and marker 1016-h). As shown in this embodiment, in some embodiments, as the stylus 203 moves closer to the touchscreen 112, the marker changes its opacity (e.g., by decreasing opacity), changes its size (or radius or area) (e.g., by increasing the size), and / or changes its color (e.g., by making the color brighter). 【0286】 Figure 10J shows an embodiment in which the display of markers on a touch-sensitive display (e.g., touchscreen 112) is stopped when the stylus (e.g., stylus 203) is farther than a predetermined distance from the surface of the touch-sensitive display. Compared with Figures 10F to 10I, if the markers (e.g., markers 1016-e, 1016-f, 1016-g, and 1016-h, respectively) are displayed when the tip of the stylus 203 is below the threshold 1010, then, as shown in Figure 10J, the markers will stop being displayed on the touchscreen 112 when the tip of the stylus 203 exceeds the threshold 1010. 【0287】 Figures 10B–10E show embodiments in which markers (e.g., markers 1016-b, markers 1016-c, and markers 1016-d) are displayed when a stylus (e.g., stylus 203) is in physical contact with the surface of a touch-sensitive display (e.g., touchscreen 112). In some embodiments, when the stylus 203 is in physical contact with the touchscreen 112, the distance of the stylus 203 away from the touchscreen 112 (e.g., distance 1014-a) is calculated to be greater than zero (e.g., corresponding to the thickness of the glass layer on the touchscreen 112). In some embodiments, when the stylus is in physical contact with the surface of the touch-sensitive display, the markers are updated in response to changes in orientation (as described above with respect to Figure 10A) and in response to changes in tilt (as described above with respect to Figures 10C–10E), but for brevity, the details are not repeated here. 【0288】 In some embodiments, both a marker and a mark are displayed when the stylus 203 is in physical contact with the touchscreen 112. In some embodiments, the marker corresponds to a virtual "pen tip" or other element indicating where the mark will be drawn on the touch-sensitive display. In some embodiments, the mark is a dot, line, stroke, etc., on the touch-sensitive display. In some embodiments, the marker corresponds to one end (end) of the mark. For example, if the mark being drawn is a line, the marker corresponds to (or adjacent to) the end of the line being drawn. In some embodiments, when the marker is displayed while the stylus is in physical contact with the surface of the touch-sensitive display, the shape (and optionally, color) of the marker corresponds to the shape (and optionally, color) of the tip of a virtual drawing means emulated by the stylus. For example, if the stylus is used as a virtual yellow highlighter, the marker is a yellow rectangle (corresponding to the chisel tip of the highlighter), and as the stylus is moved across the surface of the touch-sensitive display, the mark is generated (e.g., by propagating the size / shape / color of the marker along the path of the stylus). If the stylus is used as a virtual yellow highlighter, and the stylus touches down on a point on the touch-sensitive display and then lifts off without moving across the touch-sensitive display, a yellow rectangular mark (corresponding to the chisel tip of the highlighter) may appear on the point on the touch-sensitive display where the stylus touched down. 【0289】 Figure 10K shows an embodiment in which a mark (e.g., mark 1018) is displayed and the display of a marker is stopped when a stylus (e.g., stylus 203) is in physical contact with the surface of a touch-sensitive display (e.g., touchscreen 112). 【0290】 Figures 11A–11D are flowcharts illustrating a method 1100 for displaying and updating markers corresponding to the orientation state of a stylus, according to several embodiments. The method 1100 is performed in an electronic device (e.g., device 300 in Figure 3, or portable multifunction device 100 in Figure 1A) comprising a display and a touch-sensing surface. In some embodiments, the display is a touchscreen display, and the touch-sensing surface is on or integrated with the display (also simply called a touch-sensing display). In some embodiments, the display is separate from the touch-sensing surface. In some embodiments, the device includes one or more sensors for detecting signals from a stylus associated with the device, and the stylus includes an tip (or other representative portion). In some embodiments, portions on the stylus other than the tip are used to estimate the position of the tip. Some operations of the method 1100 are optionally combined, and / or the order of some operations is optionally changed. 【0291】 As described later, Method 1100 provides an intuitive method for displaying and updating markers corresponding to the stylus's orientation. The markers help the user position and use the stylus more accurately. This method reduces the number, range, and / or types of user input when using a stylus to interact with an electronic device, thereby creating a more efficient human-machine interface. With respect to battery-operated electronic devices, power is saved and the interval between battery recharging is increased as the user can input with the stylus faster and more efficiently. 【0292】 The device detects the orientation of the stylus (1102) while the tip (or other representative portion) of the stylus is in contact with the touch-sensitive display, corresponding to (or indicating) the position of the tip of the stylus on the touch-sensitive display, the tilt of the stylus relative to the touch-sensitive display, and the orientation of the stylus relative to the touch-sensitive display. Figure 10C shows the stylus 203 in an orientation corresponding to, for example, (x, y) position 1004-b, tilt 1012-a, and orientation 1006-b. In some embodiments, the orientation includes a set of orientation parameters (e.g., one or more orientation parameters). In some embodiments, the orientation is relative to the touch-sensitive display (e.g., touchscreen 112). In some embodiments, the orientation is detected according to one or more measurements from the stylus transmitted to an electronic device. For example, the stylus measures its tilt and / or orientation and transmits these measurements to the electronic device. Alternatively, in some embodiments, the orientation is detected according to raw outputs from one or more electrodes in the stylus, which are sensed by a touch-sensitive display. For example, the touch-sensitive display receives raw outputs from one or more electrodes in the stylus and calculates the tilt and / or orientation of the stylus based on the raw outputs. 【0293】 In some embodiments, the tilt of the stylus is an angle with respect to the normal of the surface of the touch-sensitive display (also simply called the normal of the touch-sensitive display), and the orientation of the stylus is the orientation of the projection of the stylus onto the touch-sensitive display (e.g., the orthogonal projection of a line corresponding to the length of the stylus onto the touch-sensitive display or the line between the projections of two different points of the stylus) with respect to at least one axis in a plane parallel to the touch-sensitive display (1104). For example, in Figure 5B, the tilt 512 of the stylus 203 is an angle with respect to the normal 510 of the touchscreen 112, and in Figure 5A, the orientation 506 of the stylus 203 is the orientation of the projection of the stylus 203 onto the touchscreen 112 with respect to axis 508. In some embodiments, the orientation of the projection of the stylus onto the touch-sensitive display is with respect to a single axis (e.g., a single axis with a clockwise rotation angle from this axis in the range of 0 to 360 degrees), such as axis 508 in Figure 5A. Alternatively, in some embodiments, the orientation of the stylus projection onto the touch-sensitive display is relative to a pair of axes (for example, the x and y axes, such as x-axis 590 and y-axis 592 in Figure 5A, or a pair of axes associated with the application displayed on the touch-sensitive display). 【0294】 In some embodiments, the orientation includes the distance of the stylus to the touch-sensitive display (1106). For example, in Figures 10B-10E, the distance of the stylus 203 to the touchscreen 112 is distance 1014-a (for example, when the tip of the stylus is in contact with the touchscreen 112). In another embodiment, in Figures 10F-10J, as the stylus moves away from the touchscreen 112, the distance of the stylus 203 to the touchscreen 112 changes (for example, from distance 1014-b to distance 1014-c, distance 1014-d, distance 1014-e, and distance 1014-f). 【0295】 In some embodiments, when the stylus is in physical contact with the surface of the touch-sensitive display, the distance of the stylus away from the touch-sensitive display is calculated to be greater than zero (for example, corresponding to the thickness of the glass layer on the touch-sensitive display (e.g., touchscreen 112) so that the marker is transmitted "on the pixels" of the display through the marker, rather than being displayed "on the glass" covering the pixels) (1108). In some embodiments, when the stylus is in physical contact with the surface of the touch-sensitive display, the distance of the stylus away from the touch-sensitive display is defined to be greater than zero. For example, in Figures 10B-10E, when the stylus 203 is in physical contact with the surface of the touchscreen 112, the distance 1014-a is calculated (or defined) to be greater than zero. 【0296】 In some embodiments, a first electrode of the stylus, detectable by an electronic device (e.g., by a mechanism in the device's touch-sensitive display), is located close to the tip of the stylus, and a second electrode of the stylus, detectable by an electronic device (e.g., by a mechanism in the device's touch-sensitive display), is displaced by a predetermined distance from the first electrode (1110). In some embodiments, the first electrode of the stylus is located at (or near) the tip of the stylus, and the second electrode of the stylus is a ring displaced by a predetermined distance from the first electrode. In some embodiments, the stylus 203 has a first electrode at (or near) the tip of the stylus 203 and a second electrode which is a ring displaced by a predetermined distance from the first electrode, as shown in Figures 5A-5B, and both electrodes are detectable by device 100 (e.g., by a mechanism in the touchscreen 112 of device 100). 【0297】 The device determines a first position on the touch-sensitive display (e.g., touchscreen 112) corresponding to the detected orientation of the stylus (e.g., stylus 203) (1112). Using Figure 10B as an example, the position on the touchscreen 112 corresponding to the detected orientation of the stylus 203 is determined by the (x, y) position 1004-b, the tilt 1012-a, and / or the orientation 1006-a. 【0298】 The device displays a marker on a touch-sensitive display (e.g., touchscreen 112) at a first position (determined by operation 1112) corresponding to a detected orientation of the stylus, which is a first offset from the position of the tip of the stylus on the touch-sensitive display (1114). For example, in Figure 10B, marker 1016-b is displayed at a first position corresponding to a detected orientation of the stylus 203, and marker 1016-b is a first offset from the (x,y) position 1004-b. In some embodiments, the mark drawn on the touch-sensitive display functions as the marker. In some embodiments, the marker is separate from the mark drawn on the touch-sensitive display. In some embodiments, as described above, the marker corresponds to a virtual “pen tip” or other element indicating where the mark would be drawn on the touch-sensitive display. In some embodiments, the mark is a dot, line, stroke, etc., on the touch-sensitive display. In some embodiments, as shown in Figure 10B, each offset includes the distance from the tip of the stylus to each mark, and the orientation (not shown) of the line between each mark and the tip of the stylus in a direction parallel to the plane of the touch-sensitive display. In some embodiments, the marked marks correspond to the thickness of the glass of the touch-sensitive display. 【0299】 In some embodiments, displaying a marker on a touch-sensitive display includes determining a color for the marker according to the background color of the touch-sensitive display at the determined location (1116). In some embodiments, determining a color for the marker according to the background color of the touch-sensitive display at the determined location includes determining a color for the marker that contrasts with the background color of the touch-sensitive display at the determined location. For example, in some embodiments, if the background color of the touch-sensitive display is white, the determined color for the marker is gray, black, or another color that contrasts with white. For example, in Figure 10B, where the background color of the touchscreen 112 is white, the color for marker 1016-b is black. In another embodiment, in some embodiments, if the background color of the touch-sensitive display is black, the determined color for the marker is white, yellow, or another color that contrasts with black. 【0300】 The device detects a change in the orientation of the stylus (e.g., stylus 203) (1118). For example, Figures 10B to 10C show a change in the orientation of stylus 203 (e.g., from orientation 1006-a to orientation 1006-b). 【0301】 In response to detecting a change in the orientation of the stylus (e.g., stylus 203), the device determines a second position on the touch-sensitive display (e.g., touchscreen 112) corresponding to the change in the orientation of the stylus, where the second position is a second offset from the position of the tip of the stylus on the touch-sensitive display (1120). For example, in Figure 10C, marker 1016-c is displayed at the second position corresponding to the detected orientation of the stylus 203, where marker 1016-c is a second offset from the (x,y) position 1004-b. 【0302】 In some embodiments, when the stylus is positioned in a first orientation on the touch-sensitive display, the marker is displaced in the first direction on the touch-sensitive display with respect to the projection of the tip (or other representative portion) of the stylus, and when the stylus is positioned in a second orientation separate from the first orientation on the touch-sensitive display, the marker is displaced in the second direction separate from the first orientation on the touch-sensitive display with respect to the projection of the tip (or other representative portion) of the stylus (1122). In some embodiments, when the orientation of the stylus (e.g., stylus 203) changes, the orientation of the marker (e.g., marker 1016-b in Figure 7B) with respect to the projection of the tip of the stylus (e.g., position 1004-b in Figure 7B) changes. For example, in Figure 10B, when the stylus 203 is positioned at orientation 1006-a, the marker 1016-b is displaced in a first direction relative to the (x,y) position 1004-b (for example, marker 1016-b is southeast of the (x,y) position 1004-b, or marker 1016-b is rotated 135 degrees clockwise from the (x,y) position 1004-b with respect to the axis 508). In Figure 10C, when the stylus 203 is positioned at orientation 1006-b, the marker 1016-c is displaced in a second direction relative to the (x, y) position 1004-b (for example, marker 1016-c is southwest of the (x, y) position 1004-b, or marker 1016-c is 225 degrees clockwise from the (x, y) position 1004-b with respect to the axis 508). 【0303】 In some embodiments, while the tip of the stylus on the touch-sensitive display is in a fixed position (for example, in Figures 10B-10D, position (x, y) 1004-b is in a fixed position), the device displays markers at two or more different positions on the touch-sensitive display (1124). For example, the method includes changing the position of the markers (for example, from a first position to a second position) while the position of the tip of the stylus on the touch-sensitive display remains the same. In Figures 10B and 10C, for example, while the tip of the stylus 203 on the touchscreen 112 is in a fixed position (for example, fixed at position (x, y) 1004-b), the device displays markers at two different positions on the touchscreen 112 (for example, position marker 1016-b and position marker 1016-c). Furthermore, in Figure 10D, as described below with respect to operation 1126, while the tip of the stylus 203 on the touchscreen 112 is in the same fixed position (for example, fixed at (x, y) position 1004-b), the device displays a marker at a third position on the touchscreen 112 (for example, at the position of marker 1016-d). 【0304】 In some embodiments, the device detects a change in the tilt of the stylus, and in response to detecting the change in the tilt of the stylus, the device determines a third position on the touch-sensitive display corresponding to the change in the tilt of the stylus, which is a third offset from the position of the tip of the stylus on the touch-sensitive display, and the device displays a marker at the third position on the touch-sensitive display (1126). For example, Figures 10C to 10D show a change in the tilt of the stylus 203 (e.g., from tilt 1012-a to tilt 1012-b), where the marker 1016-d is displayed at the third position corresponding to the orientation of the stylus 203, and the marker 1016-d is a third offset from the (x, y) position 1004-b. In some embodiments, the method includes (1) detecting a change in both the orientation and tilt of the stylus, and (2) in response to the detection of the changes in both the orientation and tilt of the stylus, (a) determining a fourth position on the touch-sensitive display corresponding to the change in orientation and tilt, which is a fourth offset from the position of the tip of the stylus on the touch-sensitive display, and (b) displaying a marker on the touch-sensitive display at the fourth position. In some embodiments, the method includes detecting a change in the position of the tip of the stylus on the touch-sensitive display, and displaying a marker at a different position in response to the detection of the change in the position of the tip of the stylus on the touch-sensitive display. 【0305】 In some embodiments, when the stylus has a first tilt on the touch-sensitive display, the marker is displaced by a first distance on the touch-sensitive display in a direction parallel to the plane of the touch-sensitive display with respect to the orthogonal projection of the tip (or other representative portion) of the stylus, and when the stylus has a second tilt on the touch-sensitive display, separate from the first tilt, the marker is displaced by a second distance on the touch-sensitive display in a direction parallel to the plane of the touch-sensitive display with respect to the orthogonal projection of the tip of the stylus (1128). In some embodiments, the method includes displacing the marker by a distance based on the tilt of the stylus from the position of the tip of the stylus on the touch-sensitive display (e.g., position (x,y) 1004-b in Figure 10C). For example, in Figure 10C, when the stylus 203 has a first tilt (e.g., tilt 1012-a), the marker 1016-c is a first distance away from the (x,y) position 1004-b, and in Figure 10D, when the stylus 203 has a second tilt (e.g., tilt 1012-b), the marker 1016-d is a second distance away from the (x,y) position 1004-b. In some embodiments, the marker is displaced by a greater distance from the projection of the tip (or the position of the tip on the touch-sensitive display) as the tilt of the stylus increases. For example, when the stylus 203 is positioned with an inclination of 1012-a, the marker 1016-c is displaced by a shorter distance relative to the (x,y) position 1004-b (as shown in Figure 10C), and when the stylus 203 is positioned with an increased inclination of 1012-b, the marker 1016-d is displaced by a larger distance relative to the (x,y) position 1004-b (as shown in Figure 10D). 【0306】 In some embodiments, each distance does not exceed a predetermined maximum distance in a direction parallel to the plane of the touch-sensitive display (e.g., between the marker and the (x,y) position of the tip of the stylus in a direction parallel to the plane of the touch-sensitive display) (1130). For example, as shown in Figures 10D-10E, the first and second distances (as described above with respect to operation 1128) do not exceed the predetermined maximum distance. In some embodiments, if the marker is already at the predetermined maximum distance, further increases in the tilt of the stylus do not increase the magnitude of the distance to the (x,y) position of the tip of the stylus. For example, as shown in Figures 10D-10E, the tilt of the stylus 203 increases from tilt 1012-b to tilt 1012-c, but the marker 1016-d remains the same because it is already at the predetermined maximum distance to the (x,y) position 1004-b. 【0307】 In some embodiments, the device detects the movement of a stylus (e.g., the tip of the stylus) away from the surface of the touch-sensitive display, and in response to detecting the movement of the stylus away from the surface of the touch-sensitive display, the device updates the appearance of the marker on the touch-sensitive display based on the movement of the stylus, while maintaining the display of the marker, according to the determination that the stylus is less than a first distance away from the surface of the touch-sensitive display, and the device stops displaying the marker on the touch-sensitive display according to the determination that the stylus is greater than a second distance away from the surface of the touch-sensitive display (1132). For example, as shown in Figures 10F-10I, if the tip of the stylus 203 is less than a first distance (e.g., threshold 1010) away from the surface of the touchscreen 112, the device updates the appearance of the marker on the touchscreen 112 (for example, as the stylus 203 moves away from the touchscreen 112, the marker becomes brighter in color, less opaque, and / or larger in size). Furthermore, as shown in Figure 10J, if the tip of the stylus 203 is farther from the surface of the touchscreen 112 than a second distance (e.g., threshold 1010), the device stops displaying a marker on the touchscreen 112. In some embodiments, the first distance is the same as the second distance (e.g., as shown in Figures 10F-10J, both the first and second distances are threshold 1010). In some embodiments, the first distance is less than the second distance. 【0308】 In some embodiments, upon determination that a representative portion of the stylus (e.g., the tip of the stylus) is in physical contact with the surface of the touch-sensitive display, the device displays a marker on the touch-sensitive display according to its orientation, and the position of the marker on the touch-sensitive display is constrained such that the distance between the marker and the representative portion of the stylus in a direction parallel to the plane of the touch-sensitive display does not exceed a predetermined maximum distance (1134). For example, if the tip of the stylus is in physical contact with the surface of the touch-sensitive display, the marker is displayed on the touch-sensitive display with the distance between the marker and the tip in a direction parallel to the plane of the touch-sensitive display truncated. As shown in Figures 10D-10E, for example, if the stylus 203 is in physical contact with the surface of the touchscreen 112, the device displays marker 1016-d, and the distance between marker 1016-g and (x,y) position 1004-b does not exceed a predetermined maximum distance (e.g., regardless of increasing tilt of the stylus 203). 【0309】 It should be understood that the specific order of operations described in Figures 11A-11D is merely illustrative and not intended to indicate that the described order is the only order in which the operations can be performed. Those skilled in the art will recognize various ways of rearranging the operations described herein. Furthermore, it should be recognized that other processing details described herein (e.g., those described in the first paragraph of “Modes for Carrying Out the Invention” above) can also be applied in a manner similar to Method 1100 described above in relation to Figures 11A-11D. For example, the stylus attitude state characteristics, movement, contact, gestures, user interface objects, and outputs described herein with reference to Method 1100 optionally have one or more of the stylus attitude state characteristics, movement, contact, gestures, user interface objects, and outputs described herein with reference to other methods described herein (e.g., those described in the first paragraph of “Modes for Carrying Out the Invention” above). For brevity, these details will not be repeated here. 【0310】 In some embodiments, Figure 12 shows a functional block diagram of an electronic device 1200 configured according to the principles of the various embodiments described. The functional blocks of this device are optionally implemented by hardware, software, firmware, or a combination thereof to perform the principles of the various embodiments described. Those skilled in the art will understand that the functional blocks described in Figure 12 are optionally combined or separated into subblocks to perform the principles of the various embodiments described. Accordingly, the description herein optionally supports any possible combination or separation of the functional blocks described herein, or further definitions. 【0311】 As shown in Figure 12, the electronic device 1200 includes a touch-sensitive display unit 1202 configured to display a user interface and receive user contact (including stylus contact), one or more sensor units 1206 associated with the device and configured to detect signals from a stylus including its tip, and a processing unit 1208 coupled to the touch-sensitive display unit 1202 and the one or more sensor units 1206. In some embodiments, the processing unit 1208 includes a detection unit 1210, a position determination unit 1212, a marker display unit 1214, a change detection unit 1216, and an update unit 1218. 【0312】 The processing unit 1208, while the tip of the stylus is in contact with the touch-sensitive display unit 1202, detects the orientation of the stylus corresponding to the position of the tip of the stylus on the touch-sensitive display unit 1202, the tilt of the stylus relative to the touch-sensitive display unit 1202, and the orientation of the stylus relative to the touch-sensitive display unit 1202 (for example, by the detection unit 1210), determines a first position on the touch-sensitive display unit 1202 corresponding to the detected orientation of the stylus (for example, by the position determination unit 1212), and on the touch-sensitive display unit 1202, the tip of the stylus on the touch-sensitive display unit 1202 The system is configured to enable the display of a marker for a first position corresponding to the detected orientation of the stylus, which is at a first offset from the position (for example, by the marker display unit 1214), detect changes in the orientation of the stylus (for example, by the change detection unit 1216), determine a second position on the touch-sensing display unit 1202 corresponding to the change in the orientation of the stylus, which is at a second offset from the position of the tip of the stylus on the touch-sensing display unit 1202 (for example, by the position determination unit 1212), and enable the display of a marker for the second position on the touch-sensing display unit 1202 (for example, by the marker display unit 1214). 【0313】 The operation of the information processing method described above is optionally performed by activating one or more functional modules within the information processing device, such as a general-purpose processor (for example, those described above in relation to Figures 1A and 3) or an application-specific chip. 【0314】 The operations described above, with reference to Figures 11A to 11D, are optionally performed by the components shown in Figures 1A to 1B or Figure 12. For example, the detection operation 1102, the position determination operation 1112, the display operation 1114, the change detection operation 1118, and the determination / display operation 1120 are optionally performed by the event sorting unit 170, the event recognition unit 180, and the event processing unit 190. The event monitor 171 of the event sorting unit 170 detects contact (or near contact) on the touch-sensitive display 112, and the event dispatcher module 174 distributes the event information to application 136-1. The corresponding event recognition unit 180 of application 136-1 compares the event information with the corresponding event definition 186 and determines whether the first contact (or near contact) (or device rotation) at the first position on the touch-sensitive surface corresponds to a default event or sub-event, such as the selection of an object on the user interface or the rotation of the device from one orientation to another. When each default event or sub-event is detected, the event recognition unit 180 activates the event processing unit 190 associated with the detection of that event or sub-event. The event processing unit 190 optionally uses or calls the data update unit 176 or the object update unit 177 to update the application's internal state 192. In some embodiments, the event processing unit 190 accesses the corresponding GUI update unit 178 to update what is displayed by the application. Similarly, it will be obvious to those skilled in the art how other processes can be performed based on the components shown in Figures 1A and 1B. Adjust one or more characteristics of the mark according to the characteristics of the input from the stylus. 【0315】 Some electronic devices use a stylus associated with them to provide an additional way of input to the device's touch-sensitive surface. For example, some cellular phones, laptops, and tablets have the ability to receive input from a stylus. However, users may desire a stylus to emulate one or more virtual drawing tools (e.g., pencils, brushes, brush pens, etc.), in which case using a stylus with the device provides a user experience similar to using a drawing tool on paper. In addition, users may desire a stylus and device to provide drawing capabilities that exceed those possible with drawing tools on paper (for example, changing from marking with a red pen when the stylus is moving to the right to marking with a blue pen when the stylus is moving to the left, or changing from marking with a red pen when the stylus contact strength is low to marking with a blue pen when the stylus contact strength is high). The following embodiments address these problems by adjusting one or more characteristics of marks from a stylus according to the characteristics of a virtual drawing means emulated by a stylus and the input from the stylus. 【0316】 Figures 13A to 13O below illustrate exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. Figures 14A to 14E are flowcharts illustrating a method for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. The processes in Figures 14A to 14E are illustrated using the user interfaces of Figures 13A to 13O. 【0317】 Figures 13A–13O show exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in Figures 14A–14E. Some of the embodiments described below refer to input on a touchscreen display (for example, on touchscreen 112, where the touch-sensing surface and the display are combined), but in some embodiments, the device detects input on a touch-sensing surface 651 separate from the display 650, as shown in Figure 6B. 【0318】 In some embodiments, the device is an electronic device comprising a separate display (e.g., display 650) and a separate touch-sensitive surface (e.g., touch-sensitive surface 651). In some embodiments, the device is a portable multifunction device 100, the display is a touch-sensitive display system 112, and the touch-sensitive surface includes a tactile output generator 163 on the display (Figure 1A). For ease of explanation, embodiments described with reference to Figures 13A-13O will be described with reference to operations performed on a device comprising the touch-sensitive display system 112. In such embodiments, the focus selector is optionally the contact of each finger or stylus, a representative point corresponding to the finger or stylus contact (e.g., the center of each contact or a point associated with each contact), or the center of two or more contacts detected on the touch-sensitive display system 112. However, similar operations are optionally performed on a device comprising a display 650 and a separate touch-sensing surface 651, in response to the detection of contact on (or near) the touch-sensing surface 651, as described in Figures 13A to 13O, while the user interface shown in Figures 13A to 13O is displayed on the display 650. 【0319】 Figures 13A–13O illustrate exemplary user interfaces for adjusting one or more characteristics of a mark according to the characteristics of input from a stylus, according to several embodiments. Figure 13A shows the touchscreen 112 along with additional details of device 100 (e.g., speaker 111, light sensor 164, proximity sensor 166, etc.), but for clarity, Figures 13B–13O simply show the touchscreen 112 of device 100 without showing other details of device 100. Furthermore, Figure 13A shows an embodiment from a viewpoint directly above the touch-sensing surface (e.g., the touchscreen 112 of device 100), while Figures 13B–13O show embodiments from two viewpoints, a viewpoint directly above the touch-sensing surface (e.g., the touchscreen 112 of device 100) and a side view of the touch-sensing surface. 【0320】 Figure 13A shows an embodiment in which a marker (e.g., marker 1316-a) corresponding to the orientation of a stylus (e.g., stylus 203) is displayed. In this embodiment, the stylus 203 has an orientation having an orientation of the stylus 203 relative to the touchscreen 112 (e.g., orientation 1306-a) and a projection position of the tip of the stylus 203 on the touchscreen 112 (e.g., (x,y) position 1304-a). As shown in Figure 13A, when the stylus 203 is positioned with orientation 1306-a (e.g., about 315 degrees clockwise with respect to axis 508) and tip projection at (x,y) position 1304-a, marker 1316-a is displayed on the touchscreen 112 to indicate where the stylus 203 will touch (or mark) the touchscreen 112. In some embodiments, when the stylus is positioned in a first orientation, the marker is displaced in a first direction on the touchscreen 112 relative to the (x, y) position 1304-a, and when the stylus is positioned in a second orientation separate from the first orientation, the marker is displaced in a second direction on the touchscreen 112 relative to the (x, y) position 1304-a. 【0321】 In some embodiments, the orientation of the stylus during input from the stylus is not a single static orientation, but rather the orientation of the stylus generally changes during input from the stylus (and may be referred to as multiple characteristics of the input from the stylus). For example, multiple characteristics of the input from the stylus 203 include the orientation of the stylus 203 relative to the touchscreen 112 (e.g., orientation 1306-a), the direction of movement of the stylus 203 across the touchscreen 112 during input ("direction"), the tilt of the stylus 203 relative to the touchscreen 112, the contact intensity of the stylus 203 on the touchscreen 112, and / or the speed of movement of the stylus 203 on or near the touchscreen 112. 【0322】 Figures 13B-13C and 13H-13L show embodiments in which markers (e.g., markers 1316-b, markers 1316-c, markers 1316-h, markers 1316-i, markers 1316-j, markers 1316-k, and markers 1316-l) are displayed when a stylus (e.g., stylus 203) is in physical contact with the surface of a touch-sensitive surface (e.g., touchscreen 112). In some embodiments, when the stylus 203 is in physical contact with the touchscreen 112, the distance of the stylus 203 away from the touchscreen 112 (e.g., distance 1314-a) is calculated to be greater than zero (e.g., corresponding to the thickness of the glass layer on the touchscreen 112). In some embodiments, when the stylus is in physical contact with the surface of the touch-sensitive surface, the marker is updated in response to changes in orientation (as described below with respect to Figures 13B-13C) and in response to changes in tilt (as described above), but for brevity, the details will not be repeated here. 【0323】 In some embodiments, both a marker and a mark are displayed when the stylus 203 is in physical contact with the touchscreen 112 (e.g., in Figures 13H–13L). In some embodiments, the marker corresponds to a virtual "pen tip" or other element indicating where a mark will be drawn on the touch-sensitive display (e.g., the touchscreen 112). In some embodiments, the mark is a dot, line, stroke, etc., on the touch-sensitive display. In some embodiments, the marker corresponds to one end (end) of the mark (e.g., in Figures 13D–13G and Figures 13M–13O). For example, if the mark being drawn is a line, the marker corresponds to (or adjacent to) the end of the line being drawn. In some embodiments, when the marker is displayed while the stylus is in physical contact with the surface of the touch-sensitive display, the shape (and optionally, color) of the marker corresponds to the shape (and optionally, color) of the tip of a virtual drawing means emulated by the stylus. For example, if the stylus is used as a virtual yellow highlighter, the marker is a yellow rectangle (corresponding to the chisel tip of the highlighter), and as the stylus moves across the surface of the touch-sensitive display, a mark is generated (e.g., by propagating the size / shape / color of the marker along the path of the stylus). If the stylus is used as a virtual yellow highlighter and the stylus touches down on a point on the touch-sensitive display and then lifts off without moving across the touch-sensitive display, a yellow rectangle mark (corresponding to the marker, which is the chisel tip of the highlighter) may appear on the point on the touch-sensitive display where the stylus touched down. 【0324】 Figures 13B to 13C show an embodiment in which the orientation (e.g., orientation 1306) of a stylus (e.g., stylus 203) relative to a touch-sensitive display (e.g., touchscreen 112) is changed, and the displayed marker is updated in accordance with the change in orientation (e.g., from displaying marker 1316-b at a first position to displaying marker 1316-c at a second position). In Figures 13B to 13C, the (x, y) position of the tip of the stylus (e.g., (x, y) position 1304-b), the tilt of the stylus (e.g., tilt 1312-a), and the distance of the stylus relative to the touch-sensitive display (e.g., distance 1314-a when the tip of the stylus is in contact with the touch-sensitive display) remain constant, while the orientation of the stylus relative to the touch-sensitive display changes (e.g., from orientation 1306-a to orientation 1306-b). When the orientation of the stylus 203 changes from orientation 1306-a (for example, a clockwise rotation angle of approximately 315 degrees relative to axis 508) to orientation 1306-b (for example, a clockwise rotation angle of approximately 45 degrees relative to axis 508), the displayed marker is updated on the touchscreen 112 (for example, from marker 1316-b to marker 1316-c). 【0325】 Figures 13D–13E show embodiments in which the orientation of a stylus (e.g., stylus 203) is changed during input, and the mark (e.g., mark 1330) is adjusted by changing the width of the mark in response to the change in orientation. In Figures 13D–13E, the orientation of the stylus (e.g., orientation 1306-b), the tilt of the stylus (e.g., tilt 1312-a), and the distance of the stylus from the touch-sensitive display (e.g., the distance when the tip of the stylus is in contact with the touch-sensitive display 1314-a) remain constant, while the orientation of the stylus changes (e.g., moving downward at (x,y) position 1304-c to moving upward at (x,y) position 1304-d). In some embodiments, the stylus 203 in Figures 13D–13E emulates a pen for calligraphy. In Figure 13D, as the stylus 203 moves in one direction (e.g., downward), the width of the mark (e.g., mark 1330-a of marker 1316-d) increases, and in Figure 13E, as the stylus 203 moves in another direction (e.g., upward), the width of the mark (e.g., mark 1330-b of marker 1316-e) decreases. In some embodiments, as shown in Figures 13D-13E, there is a gradual transition from a first (e.g., narrow) width while the stylus is moving in a first direction (e.g., upward) to a second (e.g., wide) width while the stylus is moving in a second direction opposite to the first direction (e.g., downward). 【0326】 In some embodiments, the color of the mark changes in response to a change in the orientation of the stylus 203. In some embodiments, the mark has a subtle color change with the change in orientation. For example, when the stylus 203 moves in a first direction, the color of the mark (e.g., mark 1330) is a lighter color, and when the stylus 203 moves in a second direction, the color of the mark (e.g., mark 1330) is a darker version of the same color. Using Figures 13D-13E as examples, in some embodiments, when the stylus 203 moves downward (and the width of the mark increases), the color of the mark is light blue, and when the stylus 203 moves upward (and the width of the mark decreases), the color of the mark is a darker blue. 【0327】 Figures 13F-13G show embodiments in which the tilt (e.g., tilt 1312) of a stylus (e.g., stylus 203) relative to a touch-sensitive display (e.g., touchscreen 112) is changed, and the mark (e.g., mark 1332) is adjusted by increasing the width of the mark as the tilt increases in response to the change in tilt. In Figures 13F-13G, the orientation of the stylus (e.g., orientation 1306-b) and the distance of the stylus from the touch-sensitive display (e.g., distance 1314-a when the tip of the stylus is in contact with the touch-sensitive display) remain constant, and as the stylus tilts to approach parallel to the touchscreen 112 during input from the stylus 203, the tilt of the stylus changes (e.g., from tilt 1312-b to tilt 1312-c). In some embodiments, the stylus 203 in Figures 13F-13G emulates a brush. As shown in this embodiment, as the inclination increases, the width of the marks (e.g., mark 1332) increases. In Figure 13F, when the inclination is relatively small (e.g., inclination 1312-b), the width of the marks is narrow (e.g., mark 1316-f), and in Figure 13G, when the inclination is relatively large (e.g., inclination 1312-c), the width of the marks is thick (e.g., mark 1316-g). 【0328】 Figures 13H to 13J show an embodiment in which the contact strength of the stylus during input (e.g., a parameter corresponding to the contact strength of the stylus (e.g., stylus 203) on the touch-sensing surface (e.g., touchscreen 112)) is changed, and the mark (e.g., mark 1334) is adjusted by increasing the width of the mark in response to the change in contact strength. In Figures 13H to 13J, the orientation of the stylus (e.g., orientation 1306-b), the tilt of the stylus (e.g., tilt 1312-a), and the distance of the stylus from the touch-sensing display (e.g., distance 1314-a when the tip of the stylus is in contact with the touch-sensing display) remain constant, and as the contact strength increases during input from stylus 203, the contact strength of the stylus changes (e.g., from contact strength 1322-a in Figure 13H to contact strength 1322-b in Figure 13I, and contact strength 1322-c in Figure 13J). In some embodiments, the stylus 203 in Figures 13H–13J emulates a pencil, pen, or brush. As shown in Figures 13H–13J, as the contact intensity increases (for example, as indicated by the darkening of contact intensity 1322 corresponding to contact intensity 1320), the width of the mark (e.g., mark 1334) increases. In Figure 13H, when the contact intensity is relatively low (e.g., at contact intensity 1322-a), the width of the mark is narrow (e.g., at mark 1316-h). In Figure 13I, when the contact intensity is intermediate (e.g., at contact intensity 1322-b), the width of the mark is intermediate (e.g., at mark 1316-i). In Figure 13J, when the contact intensity is relatively high (e.g., at contact intensity 1322-c), the width of the mark is thick (e.g., at mark 1316-j). 【0329】 In addition, although not shown in Figures 13H-13J, in some embodiments, the color of the mark changes in response to changes in the contact strength of the stylus 203. In some embodiments, as the contact strength increases, the color of the mark progressively transitions from a first color to a second color. In some embodiments, as the contact strength of the stylus 203 increases, the color of the mark (e.g., mark 1334) changes from a first color (e.g., red) to a second color (e.g., blue), and the color of the mark during the progressive transition includes a mixture of the first and second colors (e.g., purple). Using Figures 13H-13J as an example for illustration, as the contact strength of the stylus 203 increases, the color of the mark (e.g., mark 1334) progressively transitions from red to blue (e.g., red, purple, blue). In Figure 13H, when the contact strength is relatively low (e.g., at contact strength 1322-a), the mark color is red (e.g., at marker 1316-h). In Figure 13I, when the contact strength is intermediate (e.g., at contact strength 1322-b), the mark color is purple (e.g., a mixture of red and blue at marker 1316-i). In Figure 13J, when the contact strength is relatively high (e.g., at contact strength 1322-c), the mark color is blue (e.g., at marker 1316-j). Similarly, in some embodiments, as the contact strength decreases, the mark color gradually transitions from a second color to a first color. 【0330】 Figures 13K–13L show embodiments in which the contact strength of a stylus (e.g., stylus 203) is varied during input, and the mark (e.g., mark 1336) is adjusted by increasing the opacity of the mark as the contact strength increases. In Figures 13K–13L, the orientation of the stylus (e.g., orientation 1306-b), the tilt of the stylus (e.g., tilt 1312-a), and the distance of the stylus from the touch-sensitive display (e.g., distance 1314-a when the tip of the stylus is in contact with the touch-sensitive display) remain constant, and as the contact strength increases during input from stylus 203, the contact strength of the stylus changes (e.g., from contact strength 1322-d in Figure 13K to contact strength 1322-e in Figure 13L). In some embodiments, the stylus 203 in Figures 13K–13L emulates a pencil, ballpoint pen, or brush. As shown in Figures 13K to 13L, as the contact intensity increases (for example, as indicated by the darkening of contact intensity 1322, which corresponds to contact intensity 1320), the opacity of the mark (e.g., mark 1336) increases. In Figure 13K, when the contact intensity is relatively low (e.g., at contact intensity 1322-d), the opacity of the mark is light (e.g., at marker 1316-k). In Figure 13L, when the contact intensity is higher (e.g., at contact intensity 1322-e), the opacity of the mark is darker (e.g., at marker 1316-l). 【0331】 Figure 13M shows an embodiment in which the speed of movement of the stylus (e.g., stylus 203) is varied during input, and the mark (e.g., mark 1338) is adjusted in response to the change in speed by decreasing the width of the mark as the speed increases. For example, if the speed of movement of the stylus 203 increases to complete one stroke of mark 1338-a, the width of mark 1338-a decreases. In some embodiments, the mark is adjusted in response to the change in speed by increasing the width of the mark as the speed decreases. For example, if the speed of movement of the stylus 203 decreases at the end of mark 1338-b, the width of mark 1338-b increases. In some embodiments, the stylus 203 in Figure 13M emulates a brush for Chinese calligraphy (or other fonts). Alternatively, in some embodiments, the mark is adjusted in response to the change in speed by increasing the width of the mark as the speed increases, or decreasing the width of the mark as the speed decreases. 【0332】 Figures 13N–13O illustrate embodiments in which the difference (angle) between the orientation and direction of the stylus being input (e.g., stylus 203) is changed, and the width of the mark is adjusted as the difference between orientation and direction changes. In Figures 13N–13O, the orientation of the stylus (e.g., orientation 1306-b), the tilt of the stylus (e.g., tilt 1312-a), and the distance of the stylus from the touch-sensitive display (e.g., the distance when the tip of the stylus is in contact with the touch-sensitive display 1314-a) remain constant, while the orientation of the stylus changes (e.g., moving downward at (x,y) position 1304-m to moving to the right at (x,y) position 1304-n). In some embodiments, the stylus 203 in Figures 13N–13O emulates a chisel-tip drawing means (e.g., a highlighter, a dry-erasable marker, etc.). In Figure 13N, when the stylus 203 moves in one direction (e.g., approximately 180 degrees clockwise around the axis 508) while maintaining a first orientation (e.g., approximately 45 degrees clockwise around the axis 508), the difference (angle) between the orientation and the direction is the first difference (e.g., approximately 135 degrees), and the mark (e.g., mark 1340) has a first width (e.g., a narrow width). In Figure 13O, when the stylus 203 moves in a second direction (e.g., approximately 90 degrees clockwise around the axis 508) while maintaining a first orientation (e.g., approximately 45 degrees clockwise around the axis 508), the difference (angle) between the orientation and the direction is the second difference (e.g., approximately 4...

Claims

[Claim 1] An electronic device comprising a touch-sensitive surface and a display, wherein the electronic device includes one or more sensors for detecting signals from a stylus associated with the electronic device, To detect input from the stylus, The orientation of the stylus with respect to the touch sensing surface during the input, and The direction of movement of the stylus across the touch-sensing surface during the input ("direction") Determining a plurality of characteristics of the input from the stylus, including, In response to detecting the input from the stylus, To generate a mark having properties including opacity, width, and / or color, which is displayed on the display, The virtual drawing means emulated by the stylus, and Adjusting one or more characteristics of the mark in accordance with the changes in the plurality of characteristics of the input from the stylus during the input, wherein adjusting one or more characteristics of the mark includes adjusting the width of the mark based on the difference in angle between the direction and orientation of the stylus with respect to the touch sensing surface, A method that includes this. [Claim 2] The method according to claim 1, wherein the orientation of the stylus is the orientation of the projection of the stylus onto the touch-sensing surface with respect to at least one axis in a plane parallel to the touch-sensing surface. [Claim 3] To detect the change in direction in the input, In response to detecting the change in the direction, the mark is adjusted by changing the width of the mark when the direction changes. The method according to claim 1, including the method described in claim 1. [Claim 4] To detect the change in direction in the input, In response to detecting the change in the direction, the mark is adjusted by changing the color of the mark when the direction changes. The method according to claim 1, including the method described in claim 1. [Claim 5] The method according to claim 1, wherein the plurality of characteristics of the input from the stylus include the inclination of the stylus, which is an angle with respect to the normal of the surface of the touch sensing surface. [Claim 6] To detect the change in the tilt of the stylus, In response to detecting the change in the tilt of the stylus, the mark is adjusted by increasing the width of the mark when the tilt increases. The method according to claim 5, including the method described in claim 5. [Claim 7] The method according to claim 1, wherein the plurality of characteristics of the input from the stylus include contact intensity, which is a parameter corresponding to the intensity of contact of the stylus on the touch-sensing surface. [Claim 8] To detect the change in the contact strength of the stylus during the input, In response to detecting the change in the contact strength, the mark is adjusted by increasing the opacity of the mark when the contact strength increases. The method according to claim 7, including the method described in claim 7. [Claim 9] To detect the change in the contact strength of the stylus, In response to detecting the change in the contact strength, the mark is adjusted by increasing the width of the mark when the contact strength increases. The method according to claim 7, including the method described in claim 7. [Claim 10] To detect the change in the contact strength of the stylus, In response to detecting the change in the contact strength, the mark is adjusted by changing the color of the mark when the contact strength changes. The method according to claim 7, including the method described in claim 7. [Claim 11] To detect a change in one or more of the multiple characteristics of the input from the stylus, In response to detecting the change in one or more of the aforementioned characteristics, the virtual drawing means emulated by the stylus is changed from the first virtual drawing means to the second virtual drawing means, The method according to claim 1, including the method described in claim 1. [Claim 12] The virtual drawing means emulated by the stylus is a first virtual drawing means, and while the stylus is not actively involved in marking the display, a first change in the plurality of characteristics of the input from the stylus is detected. In response to detecting a first change in the plurality of characteristics of the input from the stylus, the system switches from the first virtual drawing means to a second virtual drawing means different from the first virtual drawing means. While the virtual drawing means emulated by the stylus is the second virtual drawing means, a second change in the plurality of characteristics of the input from the stylus is detected, In response to detecting the second change in the plurality of characteristics of the input from the stylus, In accordance with the determination that the stylus is not actively involved in marking the display, the system switches from the second virtual drawing means to the third virtual drawing means. The selection of the second virtual drawing means is maintained in accordance with the determination that the stylus is actively involved in marking the display. The method according to claim 1, including the method described in claim 1. [Claim 13] To detect changes in the speed of movement of the stylus on or near the touch sensing surface, In response to detecting the change in speed, the mark is adjusted by decreasing the width of the mark when the speed increases. The method according to claim 1, including the method described in claim 1. [Claim 14] The method according to claim 1, wherein the virtual drawing means emulated by the stylus is one of a group of virtual drawing means, and the method includes adjusting the width of the mark for each of the four virtual drawing means within the group of drawing means according to different characteristics of the input from the stylus. [Claim 15] The method according to claim 1, wherein the virtual drawing means emulated by the stylus is one of a group of virtual drawing means, and the method includes adjusting the opacity of the mark for each of the two virtual drawing means within the group of drawing means according to different characteristics of the input from the stylus. [Claim 16] The method according to claim 1, wherein the virtual drawing means emulated by the stylus is one of a group of virtual drawing means, and the method includes adjusting distinct characteristics of the mark for each of the two virtual drawing means within the group of drawing means in response to a change in the same characteristics of the input. [Claim 17] It is an electronic device, The display and Touch-sensitive surface and One or more sensors that detect signals from a stylus associated with the electronic device, One or more processors, Memory and One or more programs, An electronic device comprising, wherein one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs include instructions for performing the method according to any one of claims 1 to 16. [Claim 18] A computer program including instructions, which, when executed by an electronic device comprising a display, a touch-sensing surface, and one or more sensors for detecting signals from a stylus associated with the electronic device, includes instructions causing the electronic device to perform the method according to any one of claims 1 to 16.

Images