User interface for displaying handwritten content on electronic device

Abstract

Some embodiments described in the present disclosure relate to an electronic device that provides for entry of text into one or more text entry areas within a document displayed in a user interface. Some embodiments described in the present disclosure relate to an electronic device that provides a presentation of indicia having a thickness that depends on the direction in which a drawing input is received. Some embodiments described in the present disclosure relate to an electronic device that provides presentation of simulated markings that merge or overlap with other simulated markings. Some embodiments described in the present disclosure relate to an electronic device that provides scrolling and moving a content entry palette in a user interface based on movement of an input to the content entry palette.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 365,864, filed June 4, 2022, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field

[0003] The present invention generally relates to electronic devices that display handwritten content, and user interaction with such devices. Background Art

[0004] In recent years, users' interactions with electronic devices have increased significantly. These devices can be devices such as computers, tablet computers, televisions, multimedia devices, mobile devices, etc.

[0005] In some cases, a user wishes to enter text into one or more text entry areas within a document displayed on an electronic device. In some cases, a user wishes to generate an analog marker that varies in width. In some cases, a user wishes to generate an analog marker that overlaps or merges with other analog markers. In some cases, a user desires to manipulate user interface areas to provide handwritten content on an electronic device. Enhancing these interactions can improve the user's experience with the device and reduce user interaction time, which is particularly important when the input device is battery-powered. Summary of the Invention

[0006] Some embodiments described in the present disclosure relate to electronic devices that provide for entering text into one or more text entry areas within a document displayed in a user interface. Some embodiments described in the present disclosure relate to electronic devices that provide for presenting a marker having a thickness that depends on the direction in which drawing input is received. Some embodiments described in the present disclosure relate to electronic devices that provide for presenting an analog marker that merges or overlaps with other analog markers. Some embodiments described in the present disclosure relate to electronic devices that provide for scrolling and moving a content entry palette in a user interface based on movement of input to the content entry palette.

[0007] It is understood that the use of personally identifiable information should be subject to privacy policies and practices that are generally recognized to meet or exceed industry or government requirements for maintaining user privacy. Specifically, personally identifiable information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use, and the nature of authorized use should be clearly stated to users. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, in which like reference numerals designate corresponding parts throughout the several views.

[0009] Figure 1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display according to some embodiments.

[0010] Figure 1B is a block diagram illustrating example components for event processing according to some embodiments.

[0011] Figure 2 A portable multifunction device with a touch screen according to some embodiments is shown.

[0012] Figure 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments.

[0013] Figure 4A An exemplary user interface for an application menu on a portable multifunction device according to some embodiments is shown.

[0014] Figure 4B An exemplary user interface is shown for a multifunction device having a touch-sensitive surface separate from the display according to some embodiments.

[0015] Figure 5A A personal electronic device according to some embodiments is shown.

[0016] Figure 5B is a block diagram illustrating a personal electronic device according to some embodiments.

[0017] Figures 5C to 5D Example components of a personal electronic device with a touch-sensitive display and an intensity sensor are shown according to some embodiments.

[0018] Figures 5E to 5H Exemplary components and user interfaces of a personal electronic device according to some embodiments are shown.

[0019] Figure 5I A block diagram illustrating an exemplary architecture for a device according to some embodiments of the present disclosure is shown.

[0020] Figures 6A to 6CC Illustrated are exemplary ways in which an electronic device facilitates entry of text into one or more text entry areas within a document according to some embodiments of the present disclosure.

[0021] Figures 7A to 7Kis a flow chart illustrating a method of facilitating entry of text into one or more text entry areas within a document according to some embodiments of the present disclosure.

[0022] Figures 8A to 8K An exemplary manner of presenting a marker having a thickness that depends on the direction in which the drawing input is received is illustrated according to some embodiments of the present disclosure.

[0023] 9A to 9D is a flow chart illustrating an exemplary method of rendering a marker having a thickness that depends on the direction in which a drawing input is received, according to some embodiments of the present disclosure.

[0024] Figures 10A to 10P Illustrated are exemplary ways of presenting analog indicia that merge or overlap with other analog indicia according to some embodiments of the present disclosure.

[0025] Figures 11A to 11K is a flow chart illustrating a method of presenting an analog marker that is merged or overlapped with other analog markers according to some embodiments of the present disclosure.

[0026] Figures 12A to 12M Illustrated are exemplary ways in which an electronic device facilitates scrolling a content entry palette and moving the content entry palette within a user interface according to some embodiments of the present disclosure.

[0027] 13A to 13F is a flow chart illustrating a method of facilitating scrolling and moving a content entry palette within a user interface, according to some embodiments of the present disclosure. DETAILED DESCRIPTION

[0028] The following description sets forth exemplary methods, parameters, etc. However, it should be recognized that such description is not intended to limit the scope of the present disclosure, but is provided as a description of exemplary embodiments.

[0029] There is a need for electronic devices that provide efficient methods for entering text into one or more text entry areas within a document displayed in a user interface. In some embodiments, when a content entry mode is active, the electronic device displays a text entry field at a corresponding location in the document based on the location of the text entry area in the document in response to detecting a corresponding gesture. In some embodiments, the text entry field is selectable to initiate a process for entering text into a text entry field associated with the text entry area. Such techniques can reduce the cognitive burden on users using such devices. In addition, such techniques can reduce processor power and battery power that would otherwise be wasted on redundant user input.

[0030] There is a need for electronic devices that provide efficient methods for presenting markers having a thickness that depends on the direction in which drawing input is received. In some embodiments, in response to detecting an input that includes movement (e.g., of an input device or another object (such as a user's finger)), the electronic device displays a simulated marker corresponding to the movement. In some embodiments, the thickness of the marker depends on the manner in which the movement is performed, where the marker along a first dimension is thicker or thinner depending on the direction in which the marker is generated along the first dimension, and the marker along a second dimension has an intermediate thickness regardless of the direction in which the marker is generated along the second dimension. Such techniques can reduce the cognitive burden on users using such devices. In addition, such techniques can reduce processor power and battery power that would otherwise be wasted on redundant user input.

[0031] Electronic devices are needed that provide efficient methods for presenting analog tags that are merged or overlapped with other analog tags. In some embodiments, in response to detecting an input for generating a tag, the electronic device presents a representation of a tag that is merged with a tag generated by an input received within a threshold time and / or overlapped with a tag generated by an input received before exceeding the threshold time. In some embodiments, the value of the visual characteristics (e.g., darkness and / or color saturation) possessed by the overlapping portion of the merged tags is the same as the value of the visual characteristics of the non-overlapping portion of the tag. In some embodiments, the value of the visual characteristics possessed by the overlapping portion of the overlapping tags is different from the value of the visual characteristics of the non-overlapping portion of the tag. Such technology can reduce the cognitive burden of users using such devices. In addition, such technology can reduce processor power and battery power that would otherwise be wasted on redundant user input.

[0032] There is a need for electronic devices that provide efficient methods for scrolling and moving a content entry palette within a user interface in response to detecting input to the content entry palette. In some embodiments, the electronic device scrolls through multiple user interface objects within the content entry palette in response to detecting input that includes movement in a first direction. In some embodiments, the electronic device moves the content entry palette within the user interface in response to detecting input that includes movement in a second direction different from the first direction. Such techniques can reduce the cognitive burden on users using such devices. Additionally, such techniques can reduce processor power and battery power that would otherwise be wasted on redundant user input.

[0033] Although the following description uses the terms "first" and / or "second" to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first touch can be named a second touch and similarly, a second touch can be named a first touch without departing from the scope of the various described embodiments. Both the first touch and the second touch are touches, but they are not the same touch.

[0034] The terms used in the description of the various described embodiments herein are only for the purpose of describing specific embodiments and are not intended to be limiting. As used in the description of the various described embodiments and in the appended claims, the singular forms "a" and "the" are intended to also include plural forms, unless the context clearly indicates otherwise. It will also be understood that the terms "and / or" used herein refer to and encompass any and all possible combinations of one or more items in the associated listed items. It will also be understood that the terms "comprises" and / or "comprising" when used in this specification specify the presence of stated features, integers, steps, operations, elements and / or parts, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or their groupings.

[0035] The term "if" is optionally interpreted to mean "when," "upon," or "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that," or "if [stated condition or event] is detected" are optionally interpreted to mean "upon determining," or "in response to determining," or "upon detecting [stated condition or event]," or "in response to detecting [stated condition or event]," depending on the context.

[0036] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or music player functions. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple Watch from Apple Inc. (Cupertino, California). Devices, iPod Equipment and Device. Other portable electronic devices, such as laptops or tablets with touch-sensitive surfaces (e.g., touch screen displays and / or touch pads), are optionally used. It should also be understood that in some embodiments, the device is not a portable communication device, but rather a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or touch pads).

[0037] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick.

[0038] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a rendering application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0039] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (such as the touch-sensitive surface) optionally supports various applications with a user interface that is intuitive and clear to the user.

[0040] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1A is a block diagram illustrating a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. Touch-sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes referred to as or referred to as a "touch-sensitive display system." Device 100 includes memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and external ports 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact force sensors 165 for detecting the intensity of contacts on device 100 (e.g., a touch-sensitive surface, such as touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0041] As used in this specification and claims, the term "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a surrogate (surrogate) for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​that includes at least four different values ​​and more typically includes hundreds of different values ​​(e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some implementations, the force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine an estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or its change, the capacitance of the touch-sensitive surface near the contact and / or its change, and / or the resistance of the touch-sensitive surface near the contact and / or its change are optionally used as a surrogate for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the surrogate measurement of the contact force or pressure is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the surrogate measurement). In some embodiments, the surrogate measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of the user input allows the user to access additional device functionality that would otherwise be inaccessible to the user on a smaller device with limited real estate, which is used to display an indication (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).

[0042] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of a device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device that will be detected by a user using the user's sense of touch. For example, when a device or a component of the device is in contact with a surface that is touch-sensitive to a user (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation that corresponds to a perceived change in a physical property of the device or component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" on a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click," even when the physical actuation button associated with the touch-sensitive surface that was physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when the smoothness of the touch-sensitive surface does not change, movement of the touch-sensitive surface may optionally be interpreted or sensed by the user as "roughness" of the touch-sensitive surface. While such a user's interpretation of touch will be limited by the user's individualized sensory perceptions, many sensory perceptions of touch are common to most users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "press click," "release click," "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or a component thereof that would generate that sensory perception for a typical (or average) user.

[0043] It should be understood that device 100 is merely one example of a portable multifunction device and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both, including one or more signal processing and / or application specific integrated circuits.

[0044] Memory 102 optionally includes high-speed random access memory and optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0045] Peripherals interface 118 may be used to couple the device's input and output peripherals to CPU 120 and memory 102. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data. In some embodiments, peripherals interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0046] RF (radio frequency) circuitry 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuitry 108 converts electrical signals into / from electromagnetic signals and communicates with a communication network and other communication devices via the electromagnetic signals. RF circuitry 108 optionally includes well-known circuitry for performing these functions, including but not limited to an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a codec chipset, a subscriber identity module (SIM) card, memory, and the like. RF circuitry 108 optionally communicates with networks and other devices via wireless communications, such as the Internet (also known as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuitry 108 optionally includes well-known circuitry for detecting near-field communication (NFC) fields, such as via a short-range communication radio. The wireless communication optionally uses any of a variety of communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed ​​Downlink Packet Access (HSDPA), High Speed ​​Uplink Packet Access (HSUPA), Evolution, Data Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11d), IEEE 802.11e, IEEE 802.11f, IEEE 802.11g, IEEE 802.11g), IEEE 802.11f, IEEE 802.11g ... 11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)) and / or Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this document.

[0047] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset with both output (e.g., a single or dual-ear headset) and input (e.g., a microphone).

[0048] The I / O subsystem 106 couples input / output peripherals on the device 100, such as the touch screen 112 and other input control devices 116, to a peripherals interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from / to the other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons and / or rocker buttons), dials, slide switches, joysticks, click wheels, and the like. In some alternative embodiments, the input controllers 160 are optionally coupled to any (or none) of the following: a keyboard, an infrared port, a USB port, and a pointing device such as a mouse. One or more buttons (e.g., Figure 2 208) optionally includes an up / down button for volume control of the speaker 111 and / or microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2 206 in the ).

[0049] A quick press of the push button optionally releases the lock on the touch screen 112 or optionally initiates the process of unlocking the device using gestures on the touch screen, as described in U.S. patent application Ser. No. 11 / 322,549, filed Dec. 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," (i.e., U.S. Pat. No. 7,657,849), which is hereby incorporated by reference in its entirety. A long press of the push button (e.g., 206) optionally turns the device 100 on or off. The functions of one or more buttons are optionally user-customizable. The touch screen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

[0050] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or sends electrical signals to the touch screen. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0051] The touch screen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on tactile and / or haptic contact. The touch screen 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of that contact) on the touch screen 112 and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.

[0052] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch screen 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112 to detect contact and any movement or interruption thereof. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in the Apple ® Touch Controller from Apple Inc. (Cupertino, California). and iPod The technology used in

[0053] The touch-sensitive display in some embodiments of the touch screen 112 is optionally similar to the multi-touch-sensitive touchpads described in the following U.S. Patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.), and / or U.S. Patent Publication 2002 / 0015024A1, each of which is hereby incorporated by reference in its entirety. However, the touch screen 112 displays visual output from the device 100, whereas a touch-sensitive touchpad does not provide visual output.

[0054] The touch-sensitive display in some embodiments of the touch screen 112 is described in the following applications: (1) U.S. patent application No. 11 / 381,313, filed on May 2, 2006, “Multipoint Touch Surface Controller”; (2) U.S. patent application No. 10 / 840,862, filed on May 6, 2004, “Multipoint Touchscreen”; (3) U.S. patent application No. 10 / 903,964, filed on July 30, 2004, “Gestures For Touch Sensitive Input Devices”; (4) U.S. patent application No. 11 / 048,264, filed on January 31, 2005, “Gestures For Touch Sensitive Input Devices”; (5) U.S. patent application No. 11 / 038,590, filed on January 18, 2005, “Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices”; (6) U.S. patent application Ser. No. 11 / 228,758, filed Sep. 16, 2005, “Virtual Input Device Placement On A Touch Screen User Interface”; (7) U.S. patent application Ser. No. 11 / 228,700, filed Sep. 16, 2005, “Operation Of A Computer With A Touch Screen Interface”; (8) U.S. patent application Ser. No. 11 / 228,737, filed Sep. 16, 2005, “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”; and (9) U.S. patent application Ser. No. 11 / 367,749, filed Mar. 3, 2006, “Multi-Functional Hand-Held Device”. All of these applications are incorporated herein by reference in their entirety.

[0055] The touch screen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally uses any suitable object or appendage, such as a stylus, a finger, or the like, to contact the touch screen 112. In some embodiments, the user interface is designed to work primarily through finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of ​​a finger on the touch screen. In some embodiments, the device converts rough finger-based input into precise pointer / cursor positioning or commands for performing the actions desired by the user.

[0056] In some embodiments, the device 100 is a portable computing system that communicates with a display generation component (e.g., via wireless communication, via wired communication). The display generation component is configured to provide a visual output, such as a display via a CRT display, a display via an LED display, or a display via image projection. In some embodiments, the display generation component is integrated with the computer system (e.g., an integrated display and / or touch screen 112). In some embodiments, the display generation component is separate from the computer system (e.g., an external monitor and / or projection system). As used herein, "displaying" content includes displaying content (e.g., video data rendered or decoded by the display controller 156) by transmitting data (e.g., image data or video data) to an integrated or external display generation component via a wired or wireless connection to visually generate the content.

[0057] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface that is separate from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.

[0058] Device 100 also includes a power system 162 for powering the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, power fault detection circuitry, a power converter or inverter, a power status indicator (e.g., a light emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.

[0059] Device 100 optionally also includes one or more optical sensors 164 . Figure 1AAn optical sensor is shown coupled to the optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. In conjunction with the imaging module 143 (also called a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, facing away from the touchscreen display 112 on the front of the device, enabling the touchscreen display to be used as a viewfinder for still and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, allowing the user to optionally capture an image of the user for video conferencing while viewing other video conference participants on the touchscreen display. In some embodiments, the positioning of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor in the device housing), allowing a single optical sensor 164 to be used with the touchscreen display for both video conferencing and still and / or video image acquisition.

[0060] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1A A contact force sensor is shown coupled to force sensor controller 159 in I / O subsystem 106. Contact force sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of a contact on a touch-sensitive surface). Contact force sensor 165 receives contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the back of device 100, opposite touch screen display 112 located on the front of device 100.

[0061] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1AA proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is optionally coupled to the input controller 160 in the I / O subsystem 106. The proximity sensor 166 is optionally implemented as described in the following U.S. patent application serial numbers: 11 / 241,839, entitled “Proximity Detector In Handheld Device”; 11 / 240,788, entitled “Proximity Detector In Handheld Device”; 11 / 620,702, entitled “Using Ambient Light Sensor To Augment Proximity Sensor Output”; 11 / 586,862, entitled “Automated Response To And Sensing Of User Activity In Portable Devices”; and 11 / 638,251, entitled “Methods And Systems For Automatic Configuration Of Peripherals,” which are hereby incorporated by reference in their entireties. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables the touch screen 112.

[0062] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1A A tactile output generator is shown coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components; and / or electromechanical devices for converting energy into linear motion such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components for converting electrical signals into tactile outputs on the device). The contact force sensor 165 receives tactile feedback generation instructions from the tactile feedback module 133 and generates tactile outputs on the device 100 that can be felt by the user of the device 100. In some embodiments, at least one tactile output generator is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112) and optionally generates tactile outputs by moving the touch-sensitive surface vertically (e.g., inward / outward toward the surface of the device 100) or laterally (e.g., back and forth in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.

[0063] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 is shown coupled to the peripherals interface 118. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. The accelerometer 168 optionally implements as described in the following U.S. Patent Publication Nos. 20050190059, entitled “Acceleration-based Theft Detection System for Portable Electronic Devices” and 20060017692, entitled “Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer,” both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed on the touch screen display in a portrait view or a landscape view based on analysis of data received from one or more accelerometers. The device 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) in addition to the accelerometer 168 for obtaining information about the position and orientation (e.g., portrait or landscape) of the device 100.

[0064] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 ( Figure 1A ) or 370( Figure 3 ) storage device / global internal state 157, such as Figure 1A and Figure 3 . The device / global internal state 157 includes one or more of the following: active application state, which indicates which application, if any, is currently active; display state, which indicates what applications, views, or other information occupy various areas of the touch screen display 112; sensor state, which includes information obtained from the device's various sensors and input control devices 116; and position information relating to the device's position and / or posture.

[0065] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, and / or power management), and facilitates communication between various hardware components and software components.

[0066] The communication module 128 facilitates communication with other devices through one or more external ports 124 and also includes various software components for processing data received by the RF circuit 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB) and / or FireWire) are suitable for coupling directly to other devices or indirectly through a network (e.g., the Internet and / or wireless LAN). In some embodiments, the external ports are connected to (trademark of Apple Inc.) devices.

[0067] The contact / motion module 130 optionally detects contact with the touch screen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger down event), determining the strength of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there has been movement of the contact and tracking the movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has ceased (e.g., detecting a finger up event or contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to a single point of contact (e.g., a single-finger contact) or multiple points of contact simultaneously (e.g., "multi-touch" / multiple-finger contact). In some embodiments, the contact / motion module 130 and display controller 156 detect contact on the touchpad.

[0068] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by a user (e.g., to determine whether a user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds are determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and can be adjusted without changing the physical hardware of the device 100). For example, a mouse "click" threshold for a touchpad or touchscreen can be set to any one of a large range of predefined thresholds without changing the touchpad or touchscreen display hardware. Additionally, in some embodiments, a software setting is provided to the user of the device for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by utilizing a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).

[0069] Contact / motion module 130 optionally detects gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Thus, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event.

[0070] The graphics module 132 includes various known software components for rendering and displaying graphics on the touch screen 112 or other display, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0071] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from the application, for example, specifying the graphics to be displayed, along with coordinate data and other graphic attribute data if necessary, and then generates screen image data for output to the display controller 156.

[0072] Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator 167 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .

[0073] Text input module 134, which is optionally a component of graphics module 132, provides a soft keyboard for entering text in various applications (eg, contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0074] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing; to the camera 143 as picture / video metadata; and to applications that provide location-based services, such as a weather widget, a local yellow pages widget, and a map / navigation widget).

[0075] Application 136 optionally includes the following modules (or instruction sets), or a subset or superset thereof:

[0076] Contacts module 137 (sometimes called address book or contact list);

[0077] Telephone module 138;

[0078] Video conferencing module 139;

[0079] Email client module 140;

[0080] Instant messaging (IM) module 141;

[0081] Fitness support module 142;

[0082] A camera module 143 for still and / or video images;

[0083] Image management module 144;

[0084] Video player module;

[0085] Music player module;

[0086] Browser module 147;

[0087] Calendar module 148;

[0088] Widget module 149, which optionally includes one or more of the following: weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets acquired by the user and user-created widgets 149-6;

[0089] A widget creator module 150 for forming user-created widgets 149-6;

[0090] Search module 151;

[0091] Video and music player module 152, which combines the video player module and the music player module;

[0092] Note module 153;

[0093] Map module 154; and / or

[0094] Online video module 155.

[0095] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.

[0096] In combination with the touch screen 112, display controller 156, touch / motion module 130, graphics module 132 and text input module 134, the contacts module 137 is optionally used to manage an address book or contact list (for example, stored in the application internal state 192 of the contacts module 137 in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140 or IM 141; and so on.

[0097] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, phone module 138 is optionally used to enter a character sequence corresponding to a phone number, access one or more phone numbers in contacts module 137, modify an entered phone number, dial the corresponding phone number, conduct a conversation, and disconnect or hang up when the conversation is complete. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.

[0098] In combination with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact / motion module 130, the graphics module 132, the text input module 134, the contact module 137 and the telephone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting and terminating a video conference between a user and one or more other participants in accordance with user instructions.

[0099] In conjunction with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.

[0100] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for entering a character sequence corresponding to an instant message, modifying previously entered characters, transmitting the corresponding instant message (e.g., using the Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0101] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154, and the music player module, the fitness support module 142 includes executable instructions for creating a workout (e.g., with time, distance, and / or calorie burn goals); communicating with fitness sensors (sports equipment); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for a workout; and displaying, storing, and transmitting fitness data.

[0102] In combination with the touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132 and image management module 144, the camera module 143 includes executable instructions for the following operations: capturing still images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of the still images or videos, or deleting the still images or videos from the memory 102.

[0103] In conjunction with touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0104] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet in accordance with user instructions, including searching for, linking to, receiving and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0105] In combination with the RF circuitry 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the email client module 140, and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying, and storing calendars and data associated with the calendars (e.g., calendar entries and / or to-do lists) in accordance with user instructions.

[0106] In conjunction with the RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, the widget module 149 is a mini-application that is optionally downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or created by a user (e.g., user-created widget 149-6). In some embodiments, a widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, a widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., a Yahoo! widget).

[0107] In combination with the RF circuitry 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, the widget creator module 150 is optionally used by a user to create widgets (e.g., converting a user-specified portion of a web page into a widget).

[0108] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.

[0109] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch screen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).

[0110] In conjunction with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the note module 153 includes executable instructions for creating and managing notes, to-do lists, etc. according to user instructions.

[0111] In combination with the RF circuitry 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, the map module 154 is optionally used to receive, display, modify, and store maps and data associated with the maps (e.g., driving directions, data relating to stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.

[0112] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes instructions for allowing a user to access, browse, receive (e.g., by streaming and / or downloading), play back (e.g., on the touch screen or on an external display connected via external port 124), send emails with links to specific online videos, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send links to specific online videos. Additional descriptions of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed on June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed on December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are hereby incorporated by reference in their entirety.

[0113] Each of the modules and applications described above corresponds to an executable instruction set for performing one or more of the functions described above and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not have to be implemented as independent software programs, processes, or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, a video player module is optionally combined with a music player module into a single module (e.g., Figure 1AIn some embodiments, the memory 102 optionally stores a subset of the above modules and data structures. In addition, the memory 102 optionally stores additional modules and data structures not described above.

[0114] In some embodiments, device 100 is a device where operation of a predefined set of functions on the device is performed exclusively through a touch screen and / or a touchpad. By using a touch screen and / or a touchpad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on device 100 is optionally reduced.

[0115] A predefined set of functions that are exclusively performed through the touch screen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to a main menu, home menu, or root menu. In such embodiments, the touchpad is used to implement a "menu button." In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a touchpad.

[0116] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).

[0117] The event classifier 170 receives event information and determines the application 136-1 and the application view 191 of the application 136-1 to which the event information is to be delivered. The event classifier 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, the application 136-1 includes an application internal state 192 that indicates one or more current application views that are displayed on the touch-sensitive display 112 when the application is active or executing. In some embodiments, the device / global internal state 157 is used by the event classifier 170 to determine which application(s) are currently active, and the application internal state 192 is used by the event classifier 170 to determine the application view 191 to which the event information is to be delivered.

[0118] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when application 136-1 resumes execution, user interface state information indicating that information is being displayed or is ready to be displayed by application 136-1, a state queue for enabling the user to return to a previous state or view of application 136-1, and a repeat / undo queue of previous actions taken by the user.

[0119] Event monitor 171 receives event information from peripherals interface 118. The event information includes information about sub-events (e.g., a user touch on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuit 110). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

[0120] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).

[0121] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.

[0122] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.

[0123] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to programmatic levels within the application's programmatic or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as a hit view, and the set of events that are recognized as correct input is optionally determined based at least in part on the hit view of the initial touch that started the touch-based gesture.

[0124] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should handle the sub-events. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.

[0125] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, views higher in the hierarchy will still remain actively participating views.

[0126] Event dispatcher module 174 dispatches event information to event recognizers (e.g., event recognizer 180). In embodiments that include active event recognizer determination module 173, event dispatcher module 174 delivers the event information to the event recognizer determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores the event information in an event queue, which is retrieved by corresponding event receiver 182.

[0127] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or part of another module stored in memory 102, such as contact / motion module 130.

[0128] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events that occur within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes multiple event recognizers 180. In other embodiments, one or more of event recognizers 180 are part of a separate module, such as a user interface toolkit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177, or GUI updater 178 to update the application internal state 192. Alternatively, one or more of the application views 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of the data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0129] A corresponding event identifier 180 receives event information (e.g., event data 179) from event classifier 170 and identifies an event based on the event information. Event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0130] The event receiver 182 receives event information from the event classifier 170. The event information includes information about sub-events such as touches or touch movements. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of a touch, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a portrait orientation to a landscape orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).

[0131] The event comparator 184 compares the event information with predefined event or sub-event definitions and determines the event or sub-event based on the comparison, or determines or updates the state of the event or sub-event. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 includes the definition of the event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, the sub-events in event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on the displayed object, and a second lift-off (touch end) of a predetermined duration. In another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0132] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler that is associated with the sub-event and the object that triggered the hit test.

[0133] In some embodiments, the definition of the corresponding event (187) also includes a delay action that delays the delivery of the event information until it has been determined that the sub-event sequence does or does not correspond to the event type of the event identifier.

[0134] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definitions 186, the corresponding event recognizer 180 enters the event impossible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0135] In some embodiments, corresponding event recognizers 180 include metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery for actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0136] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates the event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferred sending) the sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with the flag obtains the flag and performs a predefined process.

[0137] In some embodiments, event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with the sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or the actively participating view receives the event information and executes a predetermined process.

[0138] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the positioning of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on a touch-sensitive display.

[0139] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0140] It should be understood that the above discussion of event handling for user touches on a touch-sensitive display also applies to other forms of user input utilizing input devices to operate the multifunction device 100, and not all user input is initiated on a touch screen. For example, mouse movement and mouse button presses, optionally in conjunction with single or multiple keyboard presses or holddowns; contact movement on a touchpad, such as taps, drags, and / or scrolls; stylus input; movement of the device; spoken commands; detected eye movement; biometric input; and / or any combination thereof, are optionally used as input corresponding to sub-events defining the event to be recognized.

[0141] Figure 2A portable multifunction device 100 with a touch screen 112 according to some embodiments is illustrated. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more of the graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of the one or more graphics occurs when the user breaks contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or rolling of the finger that has made contact with the device 100 (from right to left, from left to right, up and / or down). In some implementations or in some cases, inadvertent contact with a graphic does not select the graphic. For example, a swipe gesture that sweeps over an application icon does not select the corresponding application when the gesture corresponding to selection is a tap.

[0142] In some embodiments, the stylus 203 is an active device and includes one or more electronic circuits. For example, the stylus 203 includes one or more sensors and one or more communication circuits (such as the communication module 128 and / or the RF circuit 108). In some embodiments, the stylus 203 includes one or more processors and a power system (e.g., similar to the power system 162). In some embodiments, the stylus 203 includes an accelerometer (such as the accelerometer 168), a magnetometer, and / or a gyroscope that can determine the positioning, angle, position, and / or other physical characteristics of the stylus 203 (e.g., such as whether the stylus is put down, tilted toward or away from the device, and / or close to or away from the device). In some embodiments, the stylus 203 communicates with the electronic device (e.g., via the communication circuit, through a wireless communication protocol such as Bluetooth) and transmits the sensor data to the electronic device. In some embodiments, the stylus 203 can determine (e.g., via an accelerometer or other sensor) whether the user is holding the device. In some embodiments, the stylus 203 can accept tap input (e.g., a single or double tap) from a user on the stylus 203 (e.g., received by an accelerometer or other sensor) and interpret the input as a command or request to perform a function or change to a different input mode.

[0143] The device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications optionally being executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.

[0144] In some embodiments, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on / off and for locking the device, one or more volume adjustment buttons 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing the button and holding it in the depressed state for a predefined time interval; to lock the device by pressing the button and releasing it before the predefined time interval has elapsed; and / or to unlock the device or initiate an unlocking process. In an alternative embodiment, the device 100 also accepts voice input for activating or deactivating certain functions via the microphone 113. The device 100 also optionally includes one or more contact force sensors 165 for detecting the intensity of contact on the touch screen 112, and / or one or more tactile output generators 167 for generating tactile output for the user of the device 100.

[0145] Figure 3 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments. The device 300 does not have to be portable. In some embodiments, the device 300 is a laptop, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a gaming system, or a control device (e.g., a home controller or an industrial controller). The device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as a chipset) that interconnect system components and control communications between system components. The device 300 includes an input / output (I / O) interface 330 having a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above referenced device). Figure 1A Tactile output generator 167 as described above), sensor 359 (e.g., optical sensor, acceleration sensor, proximity sensor, touch sensitive sensor and / or contact intensity sensor (similar to the above reference Figure 1A310). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU 310. In some embodiments, memory 370 stores data related to portable multifunction device 100 ( Figure 1A ) or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100( Figure 1A )'s memory 102 optionally does not store these modules.

[0146] Figure 3 Each element in the above-mentioned elements in is optionally stored in one or more memory devices of the memory device mentioned previously.Each module in the above-mentioned modules corresponds to the instruction set for performing the function described above.Above-mentioned modules or programs (for example, instruction set) need not be implemented as independent software programs, processes or modules, and therefore the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments.In some embodiments, memory 370 optionally stores the subset of above-mentioned modules and data structure.In addition, memory 370 optionally stores additional modules and data structure not described above.

[0147] Attention is now turned to an embodiment of a user interface, optionally implemented on, for example, portable multifunction device 100 .

[0148] Figure 4A An exemplary user interface for an application menu on portable multifunction device 100 is illustrated according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:

[0149] Signal strength indicators 402 for wireless communications such as cellular and Wi-Fi signals;

[0150] Time 404;

[0151] Bluetooth indicator 405;

[0152] Battery status indicator 406;

[0153] A tray 408 with icons for commonly used applications, such as:

[0154] o An icon 416 labeled "Phone" for the phone module 138, which optionally includes an indicator 414 of the number of missed calls or voicemails;

[0155] o An icon 418 of the email client module 140 labeled "Mail," which optionally includes an indicator 410 of the number of unread emails;

[0156] o An icon 420 labeled "Browser" for the browser module 147; and

[0157] ○ Video and music player module 152 (also known as iPod (Apple Inc.

[0158] (a trademark of Apple Inc.)) module 152) labeled "iPod" icon 422; and

[0159] Icons for other apps, such as:

[0160] o Icon 424 of the IM module 141 labeled "Messages";

[0161] o Icon 426 labeled "Calendar" of calendar module 148;

[0162] o Icon 428 labeled "Photos" of the image management module 144;

[0163] o An icon 430 labeled “Camera” for the camera module 143;

[0164] o An icon 432 labeled "Online Video" of the online video module 155;

[0165] ○ Icon 434 labeled “Stock Market” of the Stock Market widget 149-2;

[0166] o An icon 436 labeled "Map" for the map module 154;

[0167] ○ Icon 438 labeled “Weather” of weather widget 149-1;

[0168] ○ Icon 440 labeled “Clock” of the alarm clock widget 149-4;

[0169] o An icon 442 labeled “Fitness Support” of the fitness support module 142;

[0170] o An icon 444 labeled "Notes" for the notes module 153; and

[0171] o An icon 446 of a settings application or module labeled “Settings” that provides access to settings for the device 100 and its various applications 136 .

[0172] It should be pointed out that Figure 4A The illustrated icon labels are merely exemplary. For example, the icon 422 of the video and music player module 152 is labeled "Music" or "Music Player." Other labels are optionally used for various application icons. In some embodiments, the label of a respective application icon includes the name of the application corresponding to the respective application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.

[0173] Figure 4B A touch-sensitive surface 451 (eg, touch screen display 112) is illustrated as being separate from a display 450 (eg, touch screen display 112). Figure 3 tablet or touchpad 355) of the device (e.g., Figure 3 Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting intensity of contacts on touch-sensitive surface 451 and / or one or more tactile output generators 357 for generating tactile output for a user of device 300.

[0174] Although some of the examples below will be given with reference to input on a touch screen display 112 (where the touch-sensitive surface and display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a main axis (e.g., Figure 4B 453) corresponding to the main axis (for example, Figure 4B According to these embodiments, the device detects a position corresponding to a corresponding position on the display (e.g., Figure 4B , 460 corresponds to 468 and 462 corresponds to 470 ) at contact with touch-sensitive surface 451 (e.g., Figure 4B 460 and 462 in FIG. 4. Thus, when the touch-sensitive surface (e.g., Figure 4B 451) and a display of a multi-function device (e.g., Figure 4BWhen the user interface 450 in FIG. 1 is separated, the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.

[0175] Additionally, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). For another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting the contact, followed by ceasing to detect the contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or mice and finger contacts are optionally used simultaneously.

[0176] Figure 5A An exemplary personal electronic device 500 is illustrated. The device 500 includes a body 502. In some embodiments, the device 500 may include components related to devices 100 and 300 (e.g., Figures 1A to 4B ) some or all of the features described in . In some embodiments, device 500 has a touch-sensitive display screen 504, referred to hereinafter as touch screen 504. Alternatively, or in addition to touch screen 504, device 500 also has a display and a touch-sensitive surface. As with devices 100 and 300, in some embodiments, touch screen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of the contact (e.g., touch) applied. The one or more intensity sensors of touch screen 504 (or touch-sensitive surface) can provide output data representing the intensity of the touch. The user interface of device 500 can respond to the touch based on the intensity of the touch, which means that touches of different intensities can invoke different user interface operations on device 500.

[0177] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related patent applications: International Patent Application Serial No. PCT / US2013 / 040061, entitled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” filed on May 8, 2013, published as WIPO Patent Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, entitled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” filed on November 11, 2013, published as WIPO Patent Publication No. WO / 2014 / 105276, each of which is hereby incorporated by reference in its entirety.

[0178] In some embodiments, the device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508 (if included) can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, the device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) can allow the device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watchbands, bracelets, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow the user to wear the device 500.

[0179] Figure 5B An exemplary personal electronic device 500 is depicted. In some embodiments, the device 500 may include information about Figure 1A 、 Figure 1B and Figure 3Some or all of the components described. Device 500 has a bus 512 that operatively couples an I / O portion 514 to one or more computer processors 516 and a memory 518. The I / O portion 514 can be connected to a display 504, which can have a touch-sensitive component 522 and optionally a strength sensor 524 (e.g., a contact strength sensor). In addition, the I / O portion 514 can be connected to a communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, the input mechanism 506 is optionally a rotatable input device or a depressible input device and a rotatable input device. In some examples, the input mechanism 508 is optionally a button.

[0180] In some examples, input mechanism 508 is optionally a microphone. Personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which are operatively connected to I / O portion 514.

[0181] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may, for example, cause the computer processors to perform the techniques described below, including processes 700, 900, 1100, and / or 1300 (Figures 7, 9, 11, and / or 13). A computer-readable storage medium may be any medium that can tangibly contain or store computer-executable instructions for use by or in conjunction with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memory such as flash memory, solid-state drives, and the like. The personal electronic device 500 is not limited to Figure 5B components and configurations, but may include other components or additional components in a variety of configurations.

[0182] In addition, in the method described herein where one or more steps depend on having met one or more conditions, it should be understood that the method can be repeated in multiple repetitions so that in the process of repetition, all conditions of the steps in the method of determining the method have been met in different repetitions of the method. For example, if the method needs to perform the first step (if the condition is met), and perform the second step (if the condition is not met), then those of ordinary skill will know that the steps stated are repeated until both the condition is met and the condition is not met (in no particular order). Therefore, the method described as having one or more steps depending on having met one or more conditions can be rewritten as a method of repeating until each condition described in the method is met. However, this does not require a system or computer-readable medium to declare that the system or computer-readable medium includes instructions for performing a contingent operation based on the satisfaction of the corresponding one or more conditions, and is therefore able to determine whether a possible situation has been met without explicitly repeating the steps of the method until all conditions of the steps in the method of determining the method have been met. Those of ordinary skill in the art will also understand that, similar to the method with a contingent step, a system or computer-readable storage medium can repeat the steps of the method as needed multiple times to ensure that all contingent steps have been performed.

[0183] As used herein, the term "indicator" refers to an indication that is optionally provided on device 100, 300, and / or 500 ( Figure 1A 、 Figure 3 and Figures 5A to 5B ) is a user-interactive graphical user interface object displayed on a display screen of a computer. For example, an image (e.g., an icon), a button, and text (e.g., a hyperlink) optionally each constitute an affordance.

[0184] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), a focus selector is displayed on a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4B In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in FIG, the particular user interface element is adjusted according to the detected input. In the case of a touch screen display (e.g., a touch screen display) that enables direct interaction with user interface elements on the touch screen display Figure 1A touch-sensitive display system 112 or Figure 4AIn some implementations of the touch screen 112 in the display, a contact detected on the touch screen acts as a "focus selector," such that when input (e.g., a press input by the contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted according to the detected input. In some implementations, the focus moves from one area of ​​the user interface to another area of ​​the user interface without corresponding movement of a cursor or movement of a contact on the touch screen display (e.g., by using a tab key or arrow keys to move the focus from one button to another); in these implementations, the focus selector moves according to the movement of the focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is generally a user interface element (or contact on the touch screen display) that is controlled by the user to deliver the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface with which the user desires to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touch screen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).

[0185] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted off, before or after contact begins to move, before contact ends, before or after contact is detected to increase in intensity, and / or before or after contact is detected to decrease in intensity). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of the intensity of the contact, the mean value of the intensity of the contact, the average value of the intensity of the contact, the value at the top 10% of the intensity of the contact, the half-maximum value of the intensity of the contact, the 90% maximum value of the intensity of the contact, etc. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the intensity of the contact over time). In some embodiments, the feature strength is compared to a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact whose feature strength does not exceed the first threshold results in a first operation, a contact whose feature strength exceeds the first strength threshold but does not exceed the second strength threshold results in a second operation, and a contact whose feature strength exceeds the second threshold results in a third operation. In some embodiments, a comparison between the feature strength and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding operation or to abandon the corresponding operation) rather than to determine whether to perform the first operation or the second operation.

[0186] Figure 5C Detecting multiple contacts 552A-552E on touch-sensitive display 504 using multiple intensity sensors 524A-524D is shown. Figure 5C Also included is an intensity graph that shows the current intensity measurements of intensity sensors 524A-524D relative to intensity units. In this example, the intensity measurements of intensity sensors 524A and 524D are both 9 intensity units, and the intensity measurements of intensity sensors 524B and 524C are both 7 intensity units. In some implementations, the cumulative intensity is the sum of the intensity measurements of multiple intensity sensors 524A-524D, which in this example is 32 intensity units. In some embodiments, each contact is assigned a corresponding intensity, which is a portion of the cumulative intensity. Figure 5D554. The cumulative strength assigned to contacts 552A-552E based on their distance from the center of force 554 is shown. In this example, each of contacts 552A, 552B, and 552E is assigned a strength of the contact of 8 strength units of the cumulative strength, and each of contacts 552C and 552D is assigned a strength of the contact of 4 strength units of the cumulative strength. More generally, in some embodiments, each contact j is assigned a corresponding strength Ij that is a portion of the cumulative strength A according to a predefined mathematical function Ij=A·(Dj / ΣDi), where Dj is the distance of the corresponding contact j from the center of force, and ΣDi is the sum of the distances of all corresponding contacts (e.g., i=1 to the last) from the center of force. The reference may be performed using an electronic device similar to or identical to device 100, 300, or 500. Figure 5C-5D In some embodiments, the characteristic intensity of the contact is based on one or more intensities of the contact. In some embodiments, the intensity sensor is used to determine a single characteristic intensity (e.g., a single characteristic intensity of a single contact). It should be noted that the intensity map is not part of the displayed user interface, but is included in the Figure 5C-5D To assist readers.

[0187] In some embodiments, portions of a gesture are identified for use in determining characteristic strength. For example, the touch-sensitive surface optionally receives a continuous swipe contact that transitions from a starting position and reaches an ending position where the contact strength increases. In this example, the characteristic strength of the contact at the ending position is optionally based only on a portion of the continuous swipe contact, rather than the entire swipe contact (e.g., only the portion of the swipe contact at the ending position). In some embodiments, a smoothing algorithm is optionally applied to the intensity of the swipe contact before determining the characteristic strength of the contact. For example, the smoothing algorithm optionally includes one or more of the following: an unweighted sliding average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow peaks or dips in the intensity of the swipe contact to achieve the purpose of determining the characteristic strength.

[0188] The intensity of the contact on the touch-sensitive surface is optionally characterized relative to one or more intensity thresholds, such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform an operation typically associated with clicking a button of a physical mouse or trackpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform an operation different from the operation typically associated with clicking a button of a physical mouse or trackpad. In some embodiments, when a contact is detected with a characteristic intensity below the light press intensity threshold (e.g., and above a nominal contact detection intensity threshold, contacts below the nominal contact detection intensity threshold are no longer detected), the device will move the focus selector in accordance with the movement of the contact on the touch-sensitive surface, without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally speaking, unless otherwise stated, these intensity thresholds are consistent between different groups of user interface illustrations.

[0189] An increase in contact feature intensity from an intensity below a light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a "light press" input. An increase in contact feature intensity from an intensity below a deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a "deep press" input. An increase in contact feature intensity from an intensity below a contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting a contact on the touch surface. A decrease in contact feature intensity from an intensity above the contact detection intensity threshold to an intensity below the contact detection intensity threshold is sometimes referred to as detecting a contact lifted from the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.

[0190] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting an increase in the intensity of the contact (or multiple contacts) to above a press input intensity threshold. In some embodiments, the corresponding operation is performed in response to detecting an increase in the intensity of the corresponding contact to above the press input intensity threshold (e.g., a "down stroke" of the corresponding press input). In some embodiments, the press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below the press input intensity threshold, and the corresponding operation is performed in response to detecting a subsequent decrease in the intensity of the corresponding contact to below the press input threshold (e.g., an "up stroke" of the corresponding press input).

[0191] Figure 5E-5HDetection of a gesture is shown, the gesture comprising contact 562 with an intensity from below Figure 5E Light press intensity threshold in L ”) increases to a value higher than Figure 5H The deep press intensity threshold in D ”). On the displayed user interface 570 including application icons 572A-572D displayed in the predefined area 574, when the cursor 576 is displayed over the application icon 572B corresponding to application 2, a gesture performed using the contact 562 is detected on the touch-sensitive surface 560. In some embodiments, the gesture is detected on the touch-sensitive display 504. The intensity sensor detects the intensity of the contact on the touch-sensitive surface 560. The device determines whether the intensity of the contact 562 is within the deep press intensity threshold (e.g., “IT D ”) reaches a peak above. Contact 562 is maintained on touch-sensitive surface 560. In response to detecting the gesture, and according to the intensity rising to the deep press intensity threshold (e.g., “IT D ”) above contact 562, displays scaled representations 578A-578C (e.g., thumbnails) of documents recently opened for Application 2, as shown in FIG. Figures 5F to 5I In some embodiments, the intensity is a characteristic intensity of the contact compared to one or more intensity thresholds. It should be noted that the intensity map for contact 562 is not part of the displayed user interface, but is included in the Figure 5E-5H To assist readers.

[0192] In some embodiments, the display of representations 578A-578C includes animation. For example, representation 578A is initially displayed near application icon 572B, as shown in FIG. Figure 5F As the animation progresses, representation 578A moves upward and representation 578B is displayed near application icon 572B, as shown. Figure 5G Then, representation 578A moves upward, 578B moves upward toward representation 578A, and representation 578C is displayed near application icon 572B, as shown in FIG. Figure 5H . Indicators 578A-578C form an array above icon 572B. In some embodiments, the animation progresses according to the intensity of contact 562, such as Figure 5F-5G , where representations 578A-578C appear and decrease as the intensity of contact 562 moves toward a deep press intensity threshold (e.g., “IT D ”) increases and moves upward. In some embodiments, the intensity according to which the animation progresses is the characteristic intensity of the contact. The reference may be performed using an electronic device similar to or identical to device 100, 300, or 500. Figures 5E to 5H The operation described.

[0193] Figure 5I A block diagram illustrating an exemplary architecture for device 580 according to some embodiments of the present disclosure is shown. Figure 5I In an embodiment, media content or other content is optionally received by device 580 via network interface 582, which is optionally a wireless connection or a wired connection. One or more processors 584 optionally execute any number of programs stored in memory 586 or storage devices, which optionally include instructions for performing one or more of the methods and / or processes described herein (e.g., methods 700, 900, 1100, and / or 1300).

[0194] In some embodiments, the display controller 588 causes the various user interfaces of the present disclosure to be displayed on the display 594. In addition, input to the device 580 is optionally provided by a remote control 590 via a remote control interface 592, which is optionally a wireless or wired connection. In some embodiments, the input to the device 580 is provided by a multifunction device 591 (e.g., a smartphone) on which a remote control application is running that configures the multifunction device to simulate remote control functionality, as will be described in more detail below. In some embodiments, the multifunction device 591 corresponds to Figure 1A and Figure 2 Device 100, Figure 3 Device 300 and Figure 5A It should be understood that one or more of the devices 500 in Figure 5I The embodiments are not meant to limit the features of the device of the present disclosure, and other components that facilitate other features described in the present disclosure are optionally included. Figure 5I In some embodiments, the device 580 optionally corresponds to Figure 1A and Figure 2 The multifunctional device 100, Figure 3 Device 300 and Figure 5A One or more of the devices 500 in; the network interface 582 optionally corresponds to Figure 1A and Figure 2 RF circuit 108, external port 124 and peripheral device interface 118 in the Figure 3 One or more of the network communication interfaces 360 in; the processor 584 optionally corresponds to Figure 1A The processor 120 and Figure 3 One or more of the CPUs 310 in; the display controller 588 optionally corresponds to Figure 1A The display controller 156 and Figure 3 One or more of the I / O interfaces 330 in; the memory 586 optionally corresponds to Figure 1A The memory 102 and Figure 3 One or more of the memories 370 in; the remote control interface 592 optionally corresponds to Figure 1A The peripheral device interface 118 and the I / O subsystem 106 (and / or its components) in Figure 3 One or more of the I / O interfaces 330 in; the remote control 590 optionally corresponds to and / or includes Figure 1A Speaker 111, touch-sensitive display system 112, microphone 113, optical sensor 164, contact intensity sensor 165, tactile output generator 167, other input control devices 116, accelerometer 168, proximity sensor 166 and I / O subsystem 106 and Figure 3 One or more of keyboard / mouse 350, touchpad 355, tactile output generator 357, and contact intensity sensor 359 in FIG. 4 and touch-sensitive surface 451 in FIG. 4 ; and display 594 optionally corresponds to Figure 1A and Figure 2 The touch-sensitive display system 112 and Figure 3 One or more of the displays 340 in .

[0195] In some embodiments, the device employs intensity hysteresis to avoid unexpected inputs, sometimes referred to as "jitter," where the device defines or selects a hysteresis intensity threshold that has a predefined relationship to a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below a hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the hysteresis intensity threshold (e.g., an "upstroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the contact intensity increases from an intensity equal to or below the hysteresis intensity threshold to an intensity equal to or above the press input intensity threshold and, optionally, that the contact intensity subsequently decreases to an intensity equal to or below the hysteresis intensity, and a corresponding operation is performed in response to detecting the press input (e.g., an increase in contact intensity or a decrease in contact intensity, depending on the circumstances).

[0196] For ease of explanation, a description of an operation performed in response to a press input associated with a press input intensity threshold or in response to a gesture including a press input is optionally triggered in response to detecting any of the following: contact intensity increasing above the press input intensity threshold, contact intensity increasing from an intensity below a hysteresis intensity threshold to an intensity above the press input intensity threshold, contact intensity decreasing below the press input intensity threshold, and / or contact intensity decreasing below a hysteresis intensity threshold corresponding to the press input intensity threshold. Additionally, in examples where an operation is described as being performed in response to detecting that the intensity of the contact decreases below the press input intensity threshold, the operation is optionally performed in response to detecting that the intensity of the contact decreases below a hysteresis intensity threshold that corresponds to and is less than the press input intensity threshold.

[0197] As used herein, an "installed application" refers to a software application that has been downloaded to an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched (e.g., become open) on the device. In some embodiments, a downloaded application becomes an installed application using an installer that extracts program portions from the downloaded software package and integrates the extracted portions with the computer system's operating system.

[0198] As used herein, the term "open application" or "executing application" refers to a software application that has persisted state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or executing application is optionally any of the following types of applications:

[0199] The active app currently displayed on the display of the device on which the app is being used;

[0200] Background applications (or background processes), which are not currently displayed but for which one or more processes are being processed by one or more processors; and

[0201] Not running but stored in memory (volatile and non-volatile respectively)

[0202] A suspended or dormant application that contains status information that can be used to resume execution of the application.

[0203] As used herein, the term "closed application" refers to a software application that does not retain state information (e.g., the state information of a closed application is not stored in the device's memory). Therefore, closing an application includes stopping and / or removing the application's application process and removing the application's state information from the device's memory. Generally speaking, when in a first application, opening a second application does not close the first application. When the second application is displayed and the first application stops displaying, the first application becomes a background application.

[0204] Attention is now turned to an embodiment of a user interface ("UI") and associated processes implemented on an electronic device, such as portable multifunction device 100, device 300, or device 500.

[0205] User interface and associated processes

[0206] Document filling

[0207] Users interact with electronic devices in a variety of different ways. In some embodiments, the electronic device presents one or more text entry areas in a document of the user interface. The embodiments described below provide a method in which the electronic device facilitates the entry of text into one or more text entry areas in response to detecting user input, depending on one or more characteristics of the one or more text entry areas. Enhancing interaction with the device reduces the amount of time required for the user to perform an operation, thereby reducing the power consumption of the device and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, this person is optionally referred to as a user of the device.

[0208] Figures 6A to 6CC The electronic device according to some embodiments of the present disclosure facilitates the entry of text into one or more text entry areas within a document. The embodiments in these figures are used to illustrate the process described below, including reference to Figures 7A to 7K The process described.

[0209] Figures 6A to 6CC Illustrated is the operation of electronic device 500 for entering text into one or more text entry areas within a document. Figure 6A The device 500 is illustrated as displaying a user interface 600 (e.g., via a display device, via a display generation component, or via a touch screen). In some examples, the user interface 600 is displayed via a display generation component. In some embodiments, the display generation component is a hardware component (e.g., including electronic components) capable of receiving display data and displaying a user interface. In some embodiments, examples of display generation components include a touch screen display (e.g., touch screen 504), a monitor, a television, a projector, an integrated, discrete, or external display device, or any other suitable display device in communication with the device 500.

[0210] In some embodiments, user interface 600 is a user interface of a content creation application. For example, the content creation application is a document viewing application, a note taking application, and / or a document markup application. In some embodiments, the content creation application is an application installed on device 500.

[0211] exist Figure 6A, user interface 600 is displaying document 602. In some embodiments, user interface 600 includes one or more selectable options associated with document 602. For example, user interface 600 includes one or more options for changing the viewing mode of document 602 (e.g., adding a bookmark or displaying a table of contents), one or more options for changing the name / title of document 602 (e.g., changing the name of the document from "Document 1"), one or more options for increasing or decreasing the size of document 602, one or more options for sharing document 602 (e.g., via email, messaging, or other applications), one or more options for activating a content entry mode for document 602, one or more options for changing the size of document 602, and / or one or more options for searching within document 602 (e.g., searching the text of document 602 for specified keywords).

[0212] In some embodiments, as similarly mentioned above, selection of selectable option 614-1 causes the electronic device 500 to enter a content entry mode at the electronic device 500. For example, in Figure 6A , selection of selectable option 614-1 causes the electronic device 500 to activate a text entry mode for the document 602. In some embodiments, as described herein below, while the text entry mode is active at the electronic device 500, the electronic device 500 provides for entering text (e.g., font-based text) in the document 602 in response to detecting user input to the document 602. In some embodiments, as described herein below, the electronic device 500 provides for entering text in the document 602 by displaying a text entry field in the document 602 based on the user input to the document 602.

[0213] exist Figure 6B In FIG, the electronic device 500 detects a selection input 603b for a selectable option 614-1 in the user interface 600. For example, in Figure 6B , the electronic device 500 detects an object (e.g., a user's finger or an input device such as a stylus) providing a tap or touch input on the touch screen 504 for the selectable option 614-1. Figure 6C As shown, in response to detecting the selection of selectable option 614-1, electronic device 500 activates a content entry mode (eg, a text entry mode) for document 602. Figure 6C , the electronic device 500 displays the selectable option 614 - 1 with a visual effect (eg, highlighted, bolded, shaded, and / or colored) indicating that the content entry mode is active for the document 602 .

[0214] As mentioned above, when content entry mode is active for document 602, electronic device 500 facilitates entry of text into document 602 in response to detecting user input to document 602. In some embodiments, electronic device 500 facilitates entry of text into document 602 based on the structure of document 602. For example, in Figure 6C , when the electronic device 500 activates the content entry mode (e.g., in response to detecting a selection of the selectable option 614-1), the electronic device 500 evaluates the metadata associated with the document 602 to determine whether the document 602 includes any preset text entry areas. In some embodiments, if the electronic device 500 determines that the document 602 includes one or more preset text entry areas, the electronic device 500 displays the one or more preset text entry areas with a visual effect. For example, in Figure 6C In FIG. 6 , the electronic device 500 determines that the document 602 includes preset text entry areas 605-1 and 605-2. Figure 6C As shown, the electronic device 500 optionally highlights, shades, bolds, and / or colors the preset text entry areas 605-1 and 605-2 to indicate that input to the text entry areas 605-1 and / or 605-2 causes the electronic device 500 to facilitate entry of text into the text entry areas 605-1 and / or 605-2. For example, if the electronic device 500 detects input (e.g., selection input, such as a tap or touch input) to the preset text entry areas 605-1 and / or 605-2, the electronic device 500 displays a soft keyboard for entering text into the preset text entry areas 605-1 and / or 605-2, and / or one or more user interface objects that can be selected to enter suggested text into the preset text entry areas 605-1 and / or 605-2, as similarly described in more detail below.

[0215] exist Figure 6C , detect input for the corresponding part of the document 602. For example, Figure 6CAs shown, the electronic device 500 detects a corresponding gesture (e.g., a double-click or dual-touch input) 603c-1 or a selection input 603c-2 at a location in the document 602 near the location of the first text entry area 606-1. As mentioned above, when the content entry mode is activated for the document 602, the electronic device 500 evaluates the structure of the document 602 to facilitate text entry in the document 602. In some embodiments, the electronic device 500 determines the location of a text entry area in the document 602 (e.g., different from a preset text entry area such as the preset text entry areas 605-1 and 605-2 described above) based on an evaluation of one or more visual elements of the document 602. For example, the electronic device 500 determines the location in the document 602 where a text entry field configured to display text in response to user input is to be created based on the graphic elements and / or text elements of the document 602. In some embodiments, the electronic device 500 determines the position of the first text entry area 606-1 in the document based on the text tag "First" in the document 602 and the graphic line following the text tag (e.g., adjacent to the text tag).

[0216] In some embodiments, in response to detecting a corresponding gesture (e.g., selecting input 603c-1 or 603c-2) at a location near the location of the first text entry area 606-1 (e.g., within a threshold distance such as 0.1 cm, 0.25 cm, 0.5 cm, 1 cm, 2 cm, 3 cm, 4 cm, 5 cm, or 10 cm of the first text entry area 606-1), the electronic device 500 displays a text entry field at a corresponding location in the document 602 based on the location of the first text entry area 606-1, as described below. In some embodiments, a type of text entry field displayed at a corresponding location in the document 602 can be selected before the text entry field is displayed at the corresponding location. For example, Figure 6D In some embodiments, in response to detecting a selection input, the electronic device 500 displays a menu element in the document 602 (e.g., before displaying a text entry field at a corresponding location in the document 602). In some embodiments, the menu element includes one or more selectable options that can be selected to select the type of text entry field to be displayed at the corresponding location. For example, Figure 6D As shown, the menu elements include a selectable option 607-1 that can be selected to display a check mark entry field at a corresponding position, a selectable option 607-2 that can be selected to display a font-based text entry field at a corresponding position, and / or a selectable option 607-3 that can be selected to display a signature entry field at a corresponding position in the document 602.

[0217] exist Figure 6DIn the embodiment, the electronic device 500 detects a selection input (e.g., a tap or touch input) 603d for a selectable option 607-2 in the menu element. In some embodiments, in response to detecting the selection of the selectable option 607-2, the electronic device 500 displays a first text entry field 608-1 at a corresponding position in the document 602 based on the position of the first text entry area 606-1, such as Figure 6E For example, Figure 6E As shown, the electronic device 500 displays a text box that can be selected to initiate a process for entering text into the text box for display at the first text entry area 606-1. In some embodiments, the corresponding position where the first text entry area 606-1 is displayed overlaps at least partially with the first text entry area 606-1. For example, Figure 6E As shown, the electronic device 500 displays a first text entry field 608 - 1 next to the text label “Name” and above the graphic line in the document 602 .

[0218] In some embodiments, the electronic device 500 displays the first text entry field 608-1 at a size that is based on the size of the first text entry area 606-1. Figure 6E As shown, the first text entry field 608-1 includes a first length and a first height. In some embodiments, the electronic device 500 displays the first text entry field 608-1 with a first length and a first height that are respectively based on the length and height associated with the first text entry area 606-1. For example, the length of the first text entry area 606-1 extends the length of the graphic line, and the height of the first text entry area 606-1 includes the blank (e.g., white) space above the graphic line and below the text label "Name" in the document 602. Thus, as Figure 6E As shown, the electronic device 500 optionally displays the first text entry field 608-1 at a first height that occupies the white space between the graphic line and the text label "Last Name," and displays the text entry field 608-1 at a first length that extends the length of the graphic line of the first text entry area 606-1.

[0219] In some embodiments, the electronic device 500 displays the first text entry field 608-1 at a size that is based on the size of the text that can be displayed in the first text entry field 608-1. For example, the document 602 is associated with a font size setting that determines the size of the font in which the text is displayed in the first text entry field 608-1. In some embodiments, the first height of the first text entry field 608-1 is based on the size of the font determined by the font size setting. For example, the first height of the first text entry field 608-1 has a value that is greater than or equal to the size (e.g., vertical size) of the font in which the text is displayed in the first text entry field 608-1.

[0220] exist Figure 6E , when the content entry mode is active for the document 602, the electronic device 500 detects a corresponding gesture (e.g., double-click or dual touch input) 603e at a location near the second text entry area 606-2 in the document 602. Figure 6E , the electronic device 500 detects a double-click input at a position within the above-described threshold distance of the position of the second text entry area 606-2 in the document 602. As similarly described above, the second text entry area 606-2 is determined by the electronic device 500 based on the text label "Last" in the document 602 and the graphic line adjacent to the text label.

[0221] In some embodiments, in response to detecting a corresponding gesture near the second text entry area 606-2, the electronic device 500 displays the second text entry field 608-2 at a second corresponding position based on the position of the second text entry area 606-2 in the document 602, such as Figure 6F For example, Figure 6F As shown, the electronic device 500 displays the second text entry field 608-2 in a blank (e.g., white) space adjacent to the text label "Last Name" and above the graphic line in the document 602. In some embodiments, as similarly described above, the second text entry field 608-2 is displayed at a size (e.g., height and / or length) determined by the electronic device 500 based on the size of the second text entry area 606-2.

[0222] exist Figure 6F , the electronic device 500 detects a selection input (e.g., a tap or touch input) 603f for the first text entry field 608-1 in the document 602. In some embodiments, in response to detecting the selection of the first text entry field 608-1, the electronic device 500 initiates a process for entering text into the first text entry field 608-1. For example, Figure 6G As shown, the electronic device 500 displays a soft keyboard 611 in the user interface 600 for entering text into the first text entry field 608-1 (e.g., via selection of one or more keys of the keyboard 611). In some embodiments, the electronic device 500 displays the first text entry field 608-1 with a visual indication of focus (e.g., bold, highlighted, colored, shaded), thereby indicating that selecting one or more keys of the keyboard 611 will cause the electronic device 500 to display the corresponding text in the first text entry field 608-1.

[0223] exist Figure 6GIn the embodiment, the electronic device 500 detects a selection input (e.g., a tap or touch input) 603g for one or more keys of the keyboard 611 in the user interface 600. In some embodiments, in response to detecting the selection of one or more keys of the keyboard 611, the electronic device 500 displays text 609-1 corresponding to the selected one or more keys in the first text entry field 608-1, such as Figure 6H For example, Figure 6H As shown, the electronic device 500 displays the font-based text "Jo" at the position of the text cursor 617 in the text entry field 608-1. In some embodiments, the text 609-1 is displayed in a font determined based on the font settings associated with the document 602. For example, the text 609-1 is displayed in a font that is a predefined font, selected by the user, and / or based on the font of the text labels in the document 602 (e.g., the text labels "First Name" and / or "Last Name").

[0224] Additionally, in some embodiments, when the electronic device 500 detects selection of one or more keys of the keyboard 611, the electronic device 500 displays one or more user interface objects that can be selected to enter the suggested text into the first text entry field 608-1. Figure 6H As shown, the electronic device 500 displays one or more user interface objects above the keyboard 611 including text labels (e.g., "Jo", John, Joe) that indicate suggested text to be entered into the first text entry field 608-1 when the one or more user interface objects are selected.

[0225] exist Figure 6H In some embodiments, the electronic device 500 detects additional selection input (e.g., tap or touch input) for a key of the keyboard 611. In response to detecting the selection of an additional key of the keyboard 611, the electronic device 500 updates the display of the text 609-1 in the first text entry field 608-1, such as Figure 6I For example, Figure 6I As shown, the electronic device 500 updates the text 609 - 1 to include the word “John” based on the selected key of the keyboard 611 .

[0226] In some embodiments, the electronic device 500 initiates a process for entering text into the second text entry field 608-2 in response to detecting the end of input into the first text entry field 608-1. Figure 6I, the electronic device 500 detects the end of the selection of one or more keys of the keyboard 611, and / or detects the selection of a corresponding key (e.g., a “return” key or a “tab” key) of the keyboard 611 that causes the electronic device 500 to move the current focus to the second text entry field 608-2. Figure 6I As shown, the electronic device 500 displays the second text entry field 608-2 with a visual indication of focus and maintains display of the keyboard 611 for entering text into the second text entry field 608-2 in a manner similar to that described above.

[0227] In some embodiments, the electronic device 500 initiates a process for entering text into the second text entry field 608-2 in response to detecting the end of input into the first text entry field 608-1 because the second text entry field 608-2 is spatially subsequent to the first text entry field 608-1. Figure 6I 8-1, the second text entry field 608-2 is located to the right of the first text entry field 608-1, and the second text entry field is spatially after the first text entry field 608-1 (e.g., for right-to-left languages, including English, which is the language in which the text of the document 602 is written). In some embodiments, for example, if the second text entry field 608-2 is located above the first text entry field 608-1, the electronic device 500 will initiate a process for entering text into the preset text entry area 605-1 rather than the second text entry field 608-2 because the preset text entry area 605-1 will be spatially after the first text entry field 608-1 in the document 602.

[0228] In some embodiments, the electronic device 500 displays one or more user interface objects 612 that can be selected to enter the suggested text into the second text entry area 608-2, such as Figure 6I For example, Figure 6IAs shown, after moving the focus from the first text entry field 608-1 to the second text entry field 608-2, the electronic device 500 displays one or more user interface objects 612 at the position of the second text entry field 608-2. In some embodiments, the one or more user interface objects 612 include text labels (e.g., "Smith", "Stuart", "Jackson"), which indicate suggested text to be entered into the second text entry field 608-2 in response to detecting a selection of the one or more user interface objects 612. In some embodiments, the suggested text is determined based on the context associated with the second text entry area 606-2. For example, as mentioned above, the second text entry area 606-2 includes the text label "surname" and is located next to the first text entry area 606-1 including the text label "name". Additionally, as described above, the user enters the text "John" into the first text entry field 608-1 associated with the first text entry area 606-1 in the document 602. In some embodiments, the electronic device 500 uses the context to determine suggested text associated with one or more user interface objects 612, namely, last names that are commonly associated with the name "John" and / or known last names at the electronic device 500 (e.g., the last name of a user of the electronic device 500).

[0229] exist Figure 6I In the embodiment, the electronic device 500 detects a selection input (e.g., a tap or touch input) 603i for a first user interface object among one or more user interface objects 612. In some embodiments, in response to detecting the selection of the first user interface object, the electronic device 500 displays a suggested text 609-2 corresponding to the first user interface object in the second text entry field 608-2, such as Figure 6J For example, Figure 6J As shown, the electronic device 500 displays the text "Smith" corresponding to the first user interface object in the second text entry field 608-2. In some embodiments, the electronic device 500 stops displaying the keyboard 611 and the visual indication of focus after detecting the end of input into the second text entry field 608-2. For example, the electronic device 500 stops displaying the keyboard 611 and the visual indication of focus on the second text entry field 608-2 in response to detecting a selection of a selectable option for stopping displaying the keyboard 611 and / or detecting a swipe gesture (e.g., swipe down) directed to the keyboard 611.

[0230] exist Figure 6J, when the content entry mode is active and when the first text entry field 606-1 and the second text entry field 606-2 are displayed, the electronic device 500 detects a corresponding gesture 603j near the third text entry area 606-3. For example, as similarly described above, the electronic device 500 detects a double-click input at a position within the above-described threshold distance of the third text entry area 606-3. In some embodiments, in response to detecting the corresponding gesture near the third text entry area 606-3, the electronic device 500 displays the third text entry field 608-3 at a third corresponding position in the document 602 based on the position of the third text entry area 606-3, as Figure 6K Additionally, as similarly described above, the electronic device 500 optionally displays the third text entry field 608 - 3 at a size that is based on the size of the third text entry area 606 - 3 in the document 602 .

[0231] exist Figure 6K , the electronic device 500 detects a selection input (e.g., a tap or touch input) 603k for the third text entry field 608-2 in the document 602. In some embodiments, as similarly described above, in response to detecting the selection of the third text entry field 608-2, the electronic device 500 initiates a process for entering text into the third text entry field 608-2, such as Figure 6L For example, Figure 6L As shown, the electronic device 500 displays the keyboard 611 and displays the third text entry field with a visual indication of focus, as similarly described above.

[0232] In some embodiments, initiating the process for entering text into the third text entry field 608-2 includes providing for automatic entry of text into one or more text entry fields in the document 602. For example, Figure 6L As shown, keyboard 611 includes a selectable option 615 that is selectable for initiating a process for automatically entering text into third text entry field 608-3. Figure 6L , the electronic device 500 detects a selection input (eg, a tap or touch input) 603I for a selectable option 615 .

[0233] In some embodiments, in response to detecting a selection of the selectable option 615, the electronic device 500 displays one or more selectable options that can be selected for entering the automatically generated text into one or more text entry fields in the document 602, such as Figure 6M For example, Figure 6MAs shown, the electronic device 500 displays: a selectable option 617-1 that can be selected to enter text corresponding to the home address associated with the user of the electronic device 500 in the third text entry field 608-3; a selectable option 617-2 that can be selected to enter text corresponding to the work address associated with the user of the electronic device 500 in the third text entry field 608-3; a selectable option 617-3 that can be selected to customize the text corresponding to the address associated with the user; and / or a selectable option 617-4 that can be selected to navigate back (e.g., redisplay the keyboard 611). In some embodiments, the electronic device 500 generates and displays selectable options 617-1 and 617-2 based on the context of the third text entry area 606-3. For example, as similarly described above, the electronic device 500 displays selectable options 617-1 and 617-2 based on the text labels "Address" and "Street" near the third text entry area 606-3. In some embodiments, text corresponding to a home address (e.g., associated with selectable option 617-1) and / or text corresponding to a work address (e.g., associated with selectable option 617-2) is saved in the memory of the electronic device 500 (e.g., in response to a previous user action of providing and subsequently saving the text. For example, in response to user input that classifies and saves text for future generation of address-related text via an automatic generation feature associated with selectable option 615, the text corresponding to the home address and the text corresponding to the work address are classified and saved by the electronic device 500 as text associated with the address. In some embodiments, the selectable options 617-1 and 617-2 include a preview (e.g., a portion) of the text that will be automatically entered into the third text entry area 608-3 by the electronic device 500 in response to detecting selection of the selectable options 617-1 and 617-2.

[0234] exist Figure 6M In some embodiments, in response to detecting the selection of the selectable option 617-1, the electronic device 500 displays the text corresponding to the selectable option 617-1 in the third text entry field 608-3, such as Figure 6N For example, Figure 6N As shown, electronic device 500 displays text “1234 Elm Street” corresponding to a home address associated with a user of electronic device 500 .

[0235] In some embodiments, the electronic device 500 displays text corresponding to the selectable option 617-1 in a plurality of text entry fields in response to detecting selection of the selectable option 617-1. Figure 6N As shown, the electronic device 500 displays the text corresponding to the home address associated with the user in the third text entry field 608-3, the fourth text entry field 608-4, the fifth text entry field 608-5 and the sixth text entry field 608-6. In some embodiments, the electronic device 500 automatically generates and displays text entry fields 608-4 to 608-6 in response to detecting the selection of selectable option 617-1. For example, the electronic device 500 displays the fourth text entry field 608-4 at a position based on the position of the fourth text entry area 606-4, displays the fifth text entry field 608-5 at a position based on the position of the fifth text entry area 606-5, and displays the sixth text entry field 608-6 at a position based on the position of the sixth text entry area 606-6. As described similarly above, the electronic device 500 displays the text entry fields 608-4 to 608-6 with corresponding sizes based on the sizes of the text entry areas 606-4 to 606-6, respectively. In some embodiments, the electronic device 500 displays the text entry fields 608-4 to 608-6 in response to detecting an input (e.g., a corresponding gesture, such as a double-click) at a corresponding location in the document 602 that is near the text entry areas 606-4 to 606-6 (e.g., within the threshold distance described above for these text entry areas). Figure 6L Text entry fields 608-4 through 608-6 are displayed in response to detecting user input prior to selection of selectable option 615.

[0236] Furthermore, in some embodiments, the portion of the text displayed in the text entry fields 608-3 through 608-6 that corresponds to the home address associated with the user is determined based on the shared context of the text entry areas 606-3 through 606-6. For example, as similarly discussed above, the electronic device 500 determines that the text entry areas 606-3 through 606-6 collectively have a context corresponding to an address (e.g., based on the text label "address" in the document 602). Figure 6N , in response to detecting selection of selectable option 617-1, the electronic device 500 displays text 609-3 corresponding to the street address in the home address associated with the user in the third text entry field 608-3 based on the text label "Street" in the third text entry area 606-3. Additionally, the electronic device 500 displays text corresponding to the city in the home address associated with the user (e.g., "Springwood") in the fourth text entry field 608-4 based on the text label "City" in the fourth text entry area 608-5. Similarly, in Figure 6N, the electronic device 500 displays text corresponding to the state in the home address associated with the user (e.g., "OH") in the fifth text entry field 608-5 based on the text label "State" in the fifth text entry area 606-5, and displays text corresponding to the zip code in the home address associated with the user (e.g., "91234") in the sixth text entry field 608-6 based on the text label "Zip Code" in the sixth text entry area 606-6.

[0237] exist Figure 6N , when the text 609-3 is displayed in the third text entry field 608-3, the electronic device 500 detects a selection input (e.g., a tap or touch input) 603n for the third text entry field 608-3. In some embodiments, in response to detecting the selection of the third text entry field 608-3, the electronic device 500 initiates a process for modifying the text 609-3 in the third text entry field 608-3, such as Figure 6O For example, Figure 6O As shown, the electronic device 500 redisplays the keyboard 611 and displays the text cursor 617 together with the text 609-3 in the third text entry field 608-3. Figure 6O , the electronic device 500 detects a selection input (eg, a triple tap or touch input) 603o for the text 609-3 in the third text entry field 608-3.

[0238] In some embodiments, in response to detecting the selection of text 609-3, the electronic device 500 selects the text 609-3 in the third text entry field 608-3. Figure 6P As shown, the electronic device 500 displays the text 609-3 with a visual effect (e.g., highlighting, shading, bolding, and / or coloring) indicating that the text 609-3 is selected. Figure 6P As shown, the electronic device 500 displays a menu element 619 in the user interface 600. For example, Figure 6P , menu element 619 includes one or more selectable options that are selectable to cause the electronic device 500 to perform one or more corresponding operations involving the selected text 609-3, such as cutting the selected text, copying the selected text, changing the appearance of the selected text, and / or sharing the selected text (e.g., in a message or email). Figure 6P , the electronic device 500 detects a selection input (eg, a tap or touch input) 603p for a selectable option 618-1 in a menu element 619.

[0239] In some embodiments, in response to detecting selection of the selectable option 618-1, the electronic device 500 initiates a process for changing the appearance of the selected text 609-3, such as Figure 6Q For example, Figure 6Q As shown, the electronic device 500 displays a subset of selectable options for changing the appearance of the selected text 609-3, such as bolding the selected text, italicizing the selected text, underlining the selected text, and / or changing the font associated with the selected text. Figure 6Q , the electronic device 500 detects a selection input (e.g., a tap or touch input) 603q for a selectable option 618-2 in a menu element 619. In some embodiments, in response to detecting the selection of the selectable option 618-2, the electronic device 500 initiates a process for changing the font associated with the selected text 609-3 in the third text entry field 608-3. For example, the electronic device 500 displays one or more user interface elements for changing the font associated with the selected text from a first font to a second font.

[0240] In some embodiments, in response to detecting input to change the font associated with the selected text 609-3, the electronic device 500 updates the display of the text 609-3 in the third text entry field 608-3 to have a second font (e.g., Times New Roman) in the document 602 based on the input, as shown in FIG. Figure 6R In some embodiments, when the electronic device 500 changes the font associated with text in one text entry field in the document 602, the electronic device 500 changes the font associated with all text in all text entry fields in the document 602. For example, Figure 6R As shown, when the electronic device 500 changes the font associated with the text 609-3 in the third text entry field 608-3, the electronic device 500 also changes the font associated with the text 609-1 in the first text entry field 608-1, the text 609-2 in the second text entry field 608-2, and the text in text entry fields 608-4 to 608-6.

[0241] exist Figure 6S In the embodiment, when the content entry mode is active, the electronic device 500 detects a corresponding gesture (e.g., double-click or dual touch input) 603s directed to the document 602. In some embodiments, the electronic device 500 detects the corresponding gesture 603s at a location that is not located near any text entry area including a preset text entry area in the document 602. For example, the electronic device 500 detects the corresponding gesture 603s at a location that is located near the nearest text entry area (e.g., Figure 6NA corresponding gesture 603s is detected at a position outside the above-mentioned threshold distance of the text entry area 605-6 and / or the text entry area 606-1).

[0242] In some embodiments, in response to detecting the corresponding gesture 603s, the electronic device 500 displays a text entry field 608-7 in the document 602 at a location based on the location where the corresponding gesture 603s was detected, such as Figure 6T For example, in Figure 6T , the center point of the text entry field 608-7 is displayed at the location in the document 602 where the corresponding gesture 603s is detected. In some embodiments, the electronic device 500 displays the text entry field 608-7 in the document 602 with a predefined size. For example, Figure 6T , because the text entry field 608-7 is not detected near any text entry area in the document 602, the electronic device 500 displays the text entry field 608-7 at a default size (e.g., and not based on the size of any of the text entry areas in the document 602, as similarly described above).

[0243] In some embodiments, the size of the text entry field 608-7 can be changed in response to user input in the document 602. For example, Figure 6T As shown, the electronic device 500 displays a text entry field 608-7 having one or more resize handles 621. Figure 6T As shown, the text entry field 608-7 is optionally displayed with a first resize handle 621a (e.g., on the right end of the text entry field 608-7) and a second resize handle 621b (e.g., on the left end of the text entry field 608-7). In some embodiments, one or more resize handles can be selected to initiate a process for changing the size of the text entry field 608-7 in the document 602.

[0244] In some embodiments, one or more resize handles 621 are displayed along with the text entry field, depending on the type of text entry field in the document 602. For example, the electronic device 500 displays a first resize handle 621a and a second resize handle 621b for user-created text entry fields such as text entry fields 608-1 to 608-7, but does not display the first resize handle and the second resize handle for preset text entry areas such as text entry areas 605-1 and 605-2. Figure 6T , the electronic device 500 detects a selection input (eg, tap and hold) 603t for the second resize handle 621b, followed by movement of the second resize handle 621b in a left direction in the user interface 600.

[0245] In some embodiments, in response to detecting input to the second resize handle 621b, the electronic device 500 changes the size of the text entry field 608-7 according to the movement of the input, such as Figure 6U For example, Figure 6U As shown, the electronic device 500 increases the size (e.g., length) of the text entry field 608-7 in a left direction and by a corresponding amount based on the movement of the input 603t. In some embodiments, the text entry field 608-7 can be moved within the document 602 in response to user input to the text entry field 608-7. For example, in Figure 6U , the electronic device 500 detects a selection input (eg, a tap and hold) 603u for a portion of the text entry field 608-7, followed by movement of the portion of the text entry field 608-7 in a left direction in the user interface 600.

[0246] In some embodiments, in response to detecting input to the text entry field 608-7, the electronic device 500 moves the text entry field 608-7 to a position 606-7 in the document 602 according to the movement of the input, such as Figure 6V For example, Figure 6V As shown, the electronic device 500 moves the text entry field 608-7 in a leftward direction and by a corresponding amount based on the movement of the input 603u. Figure 6V , the electronic device 500 detects a selection input (eg, a tap or touch input) 603v for the text entry field 608-7 in the document 602.

[0247] In some embodiments, in response to detecting selection of the text entry field 608-7, the electronic device 500 initiates a process for entering text into the text entry field 608-7, such as Figure 6W For example, Figure 6W As shown, the electronic device 500 transfers the document 602 upward in the user interface 600 and displays the keyboard 611. In some embodiments, the keyboard 611 includes a selectable option 622 that can be selected to display a content entry palette for providing handwriting input in the document 602 in the user interface 600. Figure 6W , the electronic device 500 detects a selection input (eg, a tap or touch input) 603w for a selectable option 622 in the keyboard 611.

[0248] In some embodiments, in response to detecting selection of the selectable option 622, the electronic device 500 displays a content entry palette 625 in the user interface 600, such as Figure 6XAs shown. In some embodiments, the content entry palette 625 is a user interface element that includes one or more selectable options associated with the content in the user interface 600. For example, the content entry palette 625 includes an option to change the color of the content in the content entry area (e.g., change the color of existing content or change the color of future content inserted by the user), an option to change the font of the text in the content entry area (e.g., change the font of existing text or change the font of future text inserted by the user), an option to attach or insert a rich object (e.g., a file, an image, a web-based link, etc.), an option to select a content entry tool, and / or an option to display a soft keyboard for inserting font-based text in the content entry area. In some embodiments, the content entry palette 625 corresponds to the menu 804 described below with reference to the series of Figures 8.

[0249] exist Figure 6X , text entry tool 626-1 is currently active (e.g., as shown by a representation of text entry tool 626-1 displayed above other entry tools in content entry palette 625). In some embodiments, when text entry tool 626-1 is selected, electronic device 500 is activated in a text entry mode in which handwriting input detected by electronic device 500 (e.g., corresponding to handwritten text) is converted to font-based text in user interface 600. As mentioned above, in some embodiments, user interface 600 is configured to receive handwriting input (e.g., drawing and / or handwriting input via a stylus device such as stylus 623) and display a representation of the handwriting input (e.g., if drawing and / or handwriting input is provided).

[0250] exist Figure 6Y , while text entry tool 626-1 is active, electronic device 500 has detected contact with touch screen 504 provided by stylus 623 (e.g., controlled by a user of electronic device 500). While maintaining contact with touch screen 504, electronic device 500 detects handwriting movement by stylus 623. In some embodiments, in response to detecting the handwriting movement, electronic device 500 displays a representation of handwriting input 627 in user interface 600, such as Figure 6Y In some embodiments, a representation of the handwritten input is displayed simultaneously with the receipt of the input. Figure 6Y , the representation of handwriting input 627 includes the handwritten text "john.smith@example" according to the handwriting movement.

[0251] exist Figure 6Z , the electronic device 500 has detected the end of the handwriting input provided by the stylus 623. For example, Figure 6ZAs shown, after detecting handwriting movement (e.g., corresponding to the handwritten text "john.smith@example.com"), the electronic device 500 detects the lifting of the stylus 623 from the touch screen 504. In some embodiments, as Figure 6Z As shown, in response to detecting the end of the handwriting input, the electronic device 500 converts the representation of the handwriting input 627 into font-based text 609-4. Figure 6Z As shown, the electronic device 500 displays text 609-4 in the text entry field 608-7 in the document 602. In some embodiments, the electronic device 500 displays the text 609-4 in a size based on the size of the text entry field 608-7, as similarly described above. Additionally, as similarly described above, the electronic device 500 optionally displays the text 609-4 using a font based on a font setting associated with the document 602 (e.g., selected or predetermined).

[0252] exist Figure 6AA , while content entry mode is still active for document 602, electronic device 500 detects selection input (e.g., a tap or touch input) 603aa for selectable option 614-1 in user interface 600. As mentioned above, selectable option 614-1 is selectable to activate content entry mode (e.g., text entry mode) at electronic device 500 for document 602. In some embodiments, in response to detecting selection of selectable option 614-1 while content entry mode is active, electronic device 500 deactivates content entry mode at electronic device 500. For example, Figure 6BB As shown, the electronic device 500 no longer displays the selectable option 614-1 with a visual effect (e.g., highlighting, shading, bolding, and / or coloring) in the user interface 600. Additionally, in some embodiments, the electronic device 500 stops displaying the text entry fields 608-1 to 608-7 in the document 602, such as Figure 6BB In addition, Figure 6BB As shown, the electronic device 500 optionally uses text entry fields 608 - 1 through 608 - 7 to hold a display of text entered into the document 602 .

[0253] exist Figure 6BB , when the content entry mode is not active for the document 602, the electronic device 500 detects a corresponding gesture (e.g., double-click or double touch input) 603bb for the document 602. Figure 6BB As shown, when the content entry mode is not active, the electronic device 500 detects a corresponding gesture 603bb at a position near the text entry area 606-1 (eg, within the threshold distance of the text entry area as described above). Figure 6BBAs shown, the position where the corresponding gesture 603bb is detected corresponds to the position of the text 609 - 1 in the document 602 .

[0254] In some embodiments, in response to detecting the corresponding gesture, the electronic device 500 selects the text 609-1 in the document 602, such as Figure 6CC For example, Figure 6CC As shown, the electronic device 500 displays the text 609-1 with a visual effect (e.g., highlighted, shaded, bolded, and / or colored) indicating that the text 609-1 is selected. In some embodiments, the electronic device 500 selects the text 609-1 in response to detecting the corresponding gesture because the content entry mode is not active for the document 602. For example, as previously described above, if the corresponding gesture is detected when the content entry mode is active, the electronic device 500 will initiate a process for modifying the text 609-1 (e.g., editing the text, adding additional text, changing the appearance of the text, and / or deleting the text) because the text 609-1 will still be displayed in the text entry field 608-1 (e.g., in Figure 6AA middle).

[0255] Figures 7A to 7K is a flow chart illustrating a method 700 for facilitating entry of text into one or more text entry areas within a document according to some embodiments of the present disclosure. Method 700 is optionally executed on an electronic device (such as device 100, device 300, device 500), as described above with reference to Figure 1A to Figure 1B 、 Figures 2 to 3 、 Figures 4A to 4B and Figures 5A to 5H Some operations in method 700 are optionally combined, and / or the order of some operations is optionally changed.

[0256] As described below, according to some embodiments of the present disclosure, method 700 provides a method for an electronic device to enter text into one or more text entry areas within a document. This method reduces the cognitive burden on a user when interacting with the device user interface of the present disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charges.

[0257] In some embodiments, method 700 is performed at an electronic device (e.g., 500) that communicates with a display generation component (e.g., 504) and one or more input devices. For example, the electronic device is a mobile device (e.g., a tablet, a smartphone, a media player, or a wearable device) that includes wireless communication circuitry and optionally communicates with one or more of a mouse (e.g., external), a trackpad (optionally integrated or external), a touchpad (optionally integrated or external), a remote control device (e.g., external), another mobile device (e.g., separate from the electronic device), a handheld device (e.g., external), and / or a controller (e.g., external). In some embodiments, the display generation component is a display (optionally a touch screen display) integrated with the electronic device, an external display such as a monitor, a projector, a television, or a hardware component (optionally integrated or external) for projecting a user interface or making a user interface visible to one or more users.

[0258] In some embodiments, the electronic device displays (702a) a document (e.g., Figure 6A 602 in the electronic device). For example, the electronic device displays a portable document format (PDF) document or other document type within a document viewing application operated on the electronic device. In some embodiments, the document includes multiple text entry areas. For example, the document includes visual indications (e.g., lines or boxes) and / or text indications (e.g., text labels) indicating corresponding locations in the document where text (e.g., written text and / or font-based text) or other content is to be entered. In some embodiments, the multiple text entry areas do not include a text entry field (e.g., a predefined control element that enables a user of the electronic device to enter text directly into the document).

[0259] In some embodiments, while displaying a document, the electronic device detects (702b) a first input to the document via one or more input devices, such as Figure 6C Input 603c-1 or 603c-2 shown. For example, the electronic device detects a corresponding gesture provided by a user of the electronic device. In some embodiments, the corresponding gesture is provided by a predefined portion of the user (e.g., by a finger of the user). In some embodiments, the corresponding gesture is provided by a hardware writing tool (e.g., a stylus) that communicates with the electronic device. In some embodiments, the corresponding gesture includes a tap gesture (e.g., a double-click gesture) detected on a touch-sensitive surface (e.g., on a touch screen display of the electronic device) or other surface. In some embodiments, the surface with which the first input interacts is a touch-sensitive surface, such as a touch screen 504, a physical surface on which the document is projected, or a simulated surface corresponding to at least a portion of the document.

[0260] In some embodiments, in response to detecting a first input (702c), while the document is in a corresponding operation mode (e.g., a text entry, form filling, or form creation operation mode), a first position (such as a first position) within a first threshold distance (e.g., 0.25 cm, 0.5 cm, 0.75 cm, 1 cm, 1.5 cm, 2 cm, 3 cm, 5 cm, or 10 cm) of a first text entry area in the document is detected according to the first input. Figure 6C 603c-1) for input at a location near the first text entry area 606-1, wherein the first text entry area does not include a text entry field, the electronic device displays (702d) the first text entry field at a corresponding location in the document based on (e.g., automatically selected by the electronic device) the first text entry area via the display generation component, such as Figure 6E The first text entry field 608-1 is shown displayed, where the corresponding position is within a first threshold distance of the first text entry area. For example, the electronic device generates a first text entry field and displays the first text entry field at a position in the document based on the position of the first text entry area. In some embodiments, the corresponding position at which the first text entry field is displayed is different from the first position in the document where the first input is detected. In some embodiments, the corresponding position is a predefined position within a first threshold distance of the first text entry area. For example, the corresponding position is a single position determined based on the size of the first text entry area, the position of the first text entry area in the document, and / or the context of the first text entry area, as discussed in more detail below. In some embodiments, the electronic device determines the corresponding position without receiving user input that limits the size of the first text entry area, the position of the first text entry area, and / or the context of the first text entry area. In some embodiments, the electronic device displays the first text entry field at a first size based on the first text entry area (e.g., the size of the first text entry area and / or the location of the first text entry area in the document, which is optionally determined by the device based on surrounding content in the document and / or the size of the area / space available between such surrounding content). In some embodiments, the first text entry field enables a user to enter text, such as by inputting into the first text entry field (e.g., Figure 6F In some embodiments, if the electronic device detects input at a location in the document that is outside a first threshold distance of the first text entry area, the electronic device abandons displaying the first text entry field at the corresponding location in the document.

[0261] In some embodiments, when the document is in a corresponding operation mode, based on a first input, a second position (such as a first position) different from the first position is located within a first threshold distance (e.g., 0.25 cm, 0.5 cm, 0.75 cm, 1 cm, 1.5 cm, 2 cm, 3 cm, 5 cm, or 10 cm) of a first text entry area in the document. Figure 6C As shown, for the determination of input 603c-2) at a position near the first text entry area 606-1, the electronic device displays (702e) a first text entry field at a corresponding position in the document, such as Figure 6E The first text entry field 608-1 is shown displayed. For example, as long as the location of the input is within a first threshold distance of the first text entry area, the electronic device generates the first text entry field and displays the first text entry field at the same location in the document based on the location of the first text entry area, regardless of where the first input is detected. In some embodiments, while the electronic device is displaying the first text entry field at the corresponding location, user input associated with the text entry field enables text to be entered into the document at the first text entry field. For example, input corresponding to selection of the first text entry field enables text to be entered into the first text entry field (e.g., via a keyboard user interface object such as a keyboard displayed by the display generating component). Figure 6G In some embodiments, after displaying the first text entry field, the electronic device displays a corresponding user interface element (e.g., a text insertion cursor, such as a cursor) in the first text entry field indicating that text can be entered into the first text entry field (e.g., using a keyboard similarly described above). Figure 6H In some embodiments, input corresponding to selection of one or more keys of the keyboard causes the electronic device to display one or more characters corresponding to the selected keys in the first text entry field, such as Figure 6H Character 609-1 is shown displayed in response to detecting selection of one or more keys. Displaying a text entry field based on the location of a text entry area in a document in response to detecting a corresponding gesture at a location a threshold distance from the location of the text entry area reduces the number of inputs required to enter text into the document at the text entry area and / or enables automatic display of the text entry field, thereby improving user-device interaction.

[0262] In some embodiments, in response to detecting a first input (704a), a text entry field located in an existing text entry field (such as Figure 6IUpon determining a third position different from the first and second positions within a second threshold distance (e.g., 0.05 cm, 0.1 cm, 0.15 cm, 0.25 cm, 0.5 cm, 0.75 cm, 1 cm, 1.5 cm, 2 cm, 5 cm, or 10 cm) of the text entry field 608-2 in the text entry field, the electronic device initiates (704b) a method for performing a text entry such as Figure 6I 6. The process of entering text into an existing text entry field via the displayed soft keyboard 611 is shown. For example, if the first input described above with reference to steps 702a-702e is directed to a third location, the third location is optionally where an existing text entry field is located (e.g., present / integrated in the document and / or opened in response to user input such as a text entry field before the first input is detected). Figure 6E In some embodiments, the process of initiating the entry of text into the text entry field includes displaying a soft keyboard associated with the user interface via a display generation component, as described similarly above with reference to steps 702a-702e. In some embodiments, the process of initiating the entry of text into the text entry field includes displaying a text cursor in the text entry field indicating that the text will be entered into the text entry field (e.g., in response to user input (e.g., selection of one or more keys of a soft keyboard, an integrated hardware keyboard, or an external keyboard in communication with the electronic device)). The process of initiating the entry of text into an existing text entry field in response to detecting a corresponding gesture at a position a threshold distance from the position of an existing text entry field reduces the number of inputs required to enter text into a document at the text entry field, and / or enables text to be automatically entered into the text entry field, thereby improving user-device interaction.

[0263] In some embodiments, in response to detecting a first input (706a) (such as Figure 6E 603e), according to the first input, a second text entry area (such as Figure 6E The electronic device determines a third position different from the first position and the second position within a first threshold distance (e.g., 0.25 cm, 0.5 cm, 0.75 cm, 1 cm, 1.5 cm, 2 cm, 3 cm, 5 cm, or 10 cm) from the second text entry area 606-2 in the document, and displays (706b) a second text entry field at a second corresponding position based on (e.g., automatically selected by the electronic device) the second text entry area in the document via the display generation component, such as Figure 6FAs shown, a second text entry field 608-2 is displayed, wherein the second corresponding position is within a first threshold distance of the second text entry area. For example, the electronic device generates a text entry field and displays the text entry field at a position in the document based on the position of the second text entry area, as similarly described above with reference to steps 702a-702e. Displaying the text entry field based on the position of the text entry area in the document in response to detecting a corresponding gesture at a position that is a threshold distance from the position of the text entry area reduces the number of inputs required to enter text into the document at the text entry area and / or enables the text entry field to be automatically displayed, thereby improving user-device interaction.

[0264] In some embodiments, in response to detecting an input corresponding to a request to enter text into a first text entry field (such as Figure 6G 603g) for one or more keys of the keyboard 611, the electronic device displays the first text (708a) in the first text entry field with a corresponding characteristic having a first value, such as Figure 6H 6. As shown, text 609-1 is displayed in the first text entry field 606-1. For example, when displaying the first text entry field, if the electronic device detects an input corresponding to a request to enter text into the first text entry field (e.g., as similarly described above with reference to steps 702a-702e), the electronic device displays the first text in the first text entry field. In some embodiments, the first text is font-based text displayed using a first font. For example, the first text is displayed with a first value of size, color, and / or weight (e.g., thickness and / or coarseness) determined by the first font in the document.

[0265] In some embodiments, in response to detecting input corresponding to a request to enter text into a second text entry field, the electronic device displays the second text in the second text entry field with corresponding characteristics having the first value (708b), such as Figure 6J 8-2 is shown in the second text entry field 608-2. For example, when the second text entry field is displayed, if the electronic device detects an input corresponding to a request to enter text into the second text entry field, the electronic device displays the second text in the second text entry field. In some embodiments, the second text is a font-based text displayed using the first font described above. For example, the second text has the same size, color, and / or weight values ​​as the first text displayed in the first text entry field, such as Figure 6JThe texts 609-1 and 609-2 are shown displayed in the same font size. Displaying the first text in the first text entry field and the second text in the second text entry field in the document with the same font size enables the first text and the second text to have a consistent appearance and / or enables the font to be automatically maintained between different text entry fields in the document, thereby improving user-device interaction.

[0266] In some embodiments, the document and the text correspond to a corresponding characteristic having a first value (such as Figure 6I The document is then associated with a setting for the font of the text 609-1 in the first text entry field 606-1 in the document (710a). For example, the setting for the text associated with the document determines the font of the text to be entered into the text entry field of the document. In some embodiments, changing the setting for the text changes the font of the text to be entered. In some embodiments, the first value for the font determines the size, color, and / or weight of the text, as similarly described above with reference to steps 708a-708b.

[0267] In some embodiments, in response to detecting input corresponding to a request to enter text into a first text entry field (such as Figure 6H 603h) for one or more keys of the keyboard 611, the electronic device displays the first text (eg, Figure 6I 609-1)(710b). For example, if the electronic device detects an input corresponding to a request to enter text into a first text entry field, the electronic device displays the first text displayed using the font described above in the first text entry field. For example, the first text has a size, color, and / or thickness value that is the same as the set size, color, and / or thickness value. Displaying text in a text entry field with a font determined based on the text setting in which the document's text entry field is displayed enables the text to have a consistent appearance across multiple text entry fields and / or enables the font to be automatically maintained between different text entry fields in a document, thereby improving user-device interaction.

[0268] In some embodiments, the document includes a second text entry field (e.g., Figure 6J ), the second text entry field including the corresponding text (e.g., Figure 6J 609-2)(712a) (e.g., corresponding text displayed in a second text entry field using a corresponding font, as similarly described above with reference to steps 708a-708b). In some embodiments, after displaying the first text entry field (such as Figure 6K608-3), the electronic device detects (712b) via one or more input devices a second input corresponding to a request to enter text into the first text entry field, such as Figure 6K 6. The electronic device detects selection input 603k for text entry field 608-3 as shown. For example, the electronic device detects input for the first text entry field via a soft keyboard associated with the user interface (e.g., keyboard 611) or via an external keyboard in communication with the electronic device, as similarly described above with reference to steps 702a-702e. In some embodiments, when the first text entry field has current focus (e.g., when a text cursor is displayed within the first text entry field), the electronic device detects selection of one or more keys of the keyboard.

[0269] In some embodiments, in response to detecting the second input, the electronic device displays (712c) the first text in the first text entry field with a corresponding characteristic having a first value via the display generation component according to the second input, such as Figure 6O As shown in the text entry field 608-3, text 609-3 is displayed in the same font as the text 609-2 in the text entry field 608-2. For example, the electronic device displays a first text including one or more characters corresponding to one or more keys selected by the user. In some embodiments, the electronic device uses the corresponding font of the corresponding text displayed in the second text entry field to display the first text as font-based text. For example, the first text has the same size, color and / or thickness values ​​as the size, color and / or thickness values ​​of the corresponding text displayed in the first text entry field.

[0270] In some embodiments, while displaying first text in a first text entry field with a corresponding characteristic having a first value, the electronic device detects (712d) via one or more input devices a third input corresponding to a request to display the first text with a corresponding characteristic having a second value different from the first value, such as Figures 6P to 6Q For example, the electronic device detects input corresponding to a request to change the font of the first text 609-3 displayed in the first text entry field. In some embodiments, the electronic device detects a selection of the first text (such as via Figure 6O 603o), followed by making the electronic device such as via Figures 6P to 6Q Inputs 603p and 603q in the input sequence change the font of the first text.

[0271] In some embodiments, in response to detecting the third input (712e), the electronic device displays (712f) the first text in the first text entry field with a corresponding characteristic having a second value via the display generation component, such as Figure 6R The text 609-3 is shown in the text entry field 608-3 in a different font. For example, the electronic device changes the font in which the first text is displayed according to the third input. In some embodiments, the electronic device displays the first text in different values ​​of size, color, and / or weight determined based on the selected font.

[0272] In some embodiments, the electronic device displays (712g) the corresponding text in the second text entry field with the corresponding characteristic having the second value via the display generation component, such as Figure 6R As shown, text 609-2 is displayed in a different font in the text entry field 608-2. For example, the electronic device changes the font in which the corresponding text is displayed based on the third input. In some embodiments, after detecting the third input, the corresponding text has the same size, color, and / or weight values ​​as the size, color, and / or weight values ​​of the first text. Therefore, changing the font of the text in one text entry field in the document causes the electronic device to change the text in multiple (e.g., all) text entry fields containing text in the document (such as Figure 6R Changing the font of the second text in the second text entry field and the first text in the first text entry field in response to detecting an input to change the font of the first text in the first text entry field enables the fonts of the first text and the second text to maintain a consistent appearance and / or enables the fonts of text in different text entry fields to be automatically changed in the document, thereby improving user-device interaction.

[0273] In some embodiments, the first text entry area (e.g., Figure 6C The text entry area 608-1 in the example is selected based on (eg, automatically selected by the electronic device) a text entry area 608-1 in the example. Figure 6A 602) is determined to be a text entry area (714). For example, when the document is in a corresponding operating mode (e.g., when Figure 6BAfter detecting the selection of selectable option 614-1 as shown, the electronic device evaluates one or more visual elements of the document to determine the existence of a text entry area and / or a predefined text entry field in the document. In some embodiments, as similarly described below with reference to steps 716a-720, the electronic device evaluates graphic elements, text elements and / or space elements (e.g., white / blank space) to determine the existence of a text entry area and / or a predefined text entry field in the document. Determining a text entry area in a document based on an evaluation of visual elements of the document reduces the number of inputs required to create a text entry field at a location based on the text entry area in the document, and / or enables the automatic creation of a text entry field at a location based on the text entry area in the document, thereby improving user-device interaction.

[0274] In some embodiments, one or more visual elements of the document include a first graphic line (716a), such as Figure 6C For example, the document includes a horizontal line with a blank space above the horizontal line. If the document is a physical document (e.g., printed on paper) and handwriting input is provided above the horizontal line, the handwritten text will be written in the blank space.

[0275] In some embodiments, the first text entry area is placed by the electronic device at a location in the user interface that has a predetermined spatial relationship to a graphic line in the document (716b), such as Figure 6C In the embodiment of the present invention, the text entry area 606-1 is placed above the horizontal line. For example, the electronic device places the first text entry area in the blank space (e.g., a portion of the blank space) above the horizontal line in the document. Therefore, when the electronic device displays the first text entry field at the corresponding position based on the first input, the first text entry field is (e.g., at least partially) displayed in the blank space above the horizontal line in the document. Determining the text entry area in the document based on the position of the graphic line in the document reduces the number of inputs required to create a text entry field at a position based on the position of the graphic line in the document, and / or enables the text entry field to be automatically created at a position based on the position of the graphic line in the document, thereby improving user-device interaction.

[0276] In some embodiments, evaluating one or more visual elements of a document includes determining whether the document includes one or more text entry areas of a first type (718a), such as Figure 6CIn some embodiments, the electronic device determines that the document includes preset / predefined text entry areas 605-1 and 605-2 in the document. For example, the electronic device determines whether the document includes any preset / predefined text entry areas in the document. In some embodiments, the first type of text entry area is selectable to initiate a process for entering text into the corresponding text entry area without having to first create a text entry field at a location based on the location of the corresponding text entry area. In some embodiments, the electronic device determines that the document includes the first type of text entry area based on metadata associated with the document and / or visual characteristics of the text entry area (e.g., if the text entry area includes a box / rectangle).

[0277] In some embodiments, the first text entry area (e.g., Figure 6C The text entry area 606-1 in the example is a second type (718b) different from the first type. For example, because the electronic device responds to the first input (e.g., in response to Figure 6C 603c-1 or 603c-2) to create a first text entry field, as described above with reference to steps 702a-702e, so the first text entry area is not a preset / predefined text entry area. Therefore, when the document is in the corresponding operation mode, the second type of text entry area (e.g., Figure 6E The text entry areas 606-1 and / or 606-2 in FIG. 10 are selectable to create text entry fields at locations based on the locations of the text entry areas (e.g., Figure 6F The text entry fields 608-1 and / or 608-2 in the document are selected, and the first type of text entry area is selectable to enter text into the text entry area. Determining the location of the preset text entry area in the document based on an evaluation of visual elements of the document reduces the number of inputs required to enter text at the preset text entry area in the document and / or enables text to be automatically entered into the preset text entry area, thereby improving user-device interaction.

[0278] In some embodiments, the first text entry field (720) is displayed at a first size based on (e.g., automatically selected by the electronic device) a corresponding size of the first text entry area, such as Figure 6EAs shown, the first text entry field 606-1 is displayed at a size that is based on the size of the first text entry area 606-1. For example, when the electronic device displays the first text entry field at a corresponding position in the document, the size (e.g., dimensions, such as length and / or height) of the first text entry field is determined based on the detected size of the first text entry area with which the first text entry field is associated. In some embodiments, the size of the first text entry field is equal to the size of the first text entry area. In some embodiments, the size of the first text entry field is different from the size of the first text entry area. In some embodiments, if the document includes a second text entry area separate from the first text entry area, the electronic device displays the text entry field located at a position based on the second text entry area at a size that is based on the size of the second text entry area, such as Figure 6K The text entry field 608-3 is shown. For example, if the second text entry area (e.g., Figure 6K If the text entry area 606-3 in the second text entry area is larger than the first text entry area (e.g., in size), the electronic device displays a text entry field at the second text entry area in a second size that is larger than the first size of the first text entry field, such as Figure 6K As shown, the text entry field 608-3 is displayed at a size that is larger than the size of the first text entry field 608-1. Similarly, if the second text entry area is smaller than the first text entry area, the electronic device displays the text entry field at the second text entry area at a second size that is smaller than the first size of the first text entry field. Displaying the text entry field in the document at a size based on the size of the text entry area with which the text entry field is associated enables text entered into the text entry field to remain close to the text entry area and / or enables the text entry field to be displayed without having to select a size for the text entry field, thereby improving user-device interaction.

[0279] In some embodiments, the respective size of the first text entry area includes a respective length (722a) based on (e.g., automatically selected by the electronic device) an available length in the document at the location of the text entry area in the document, such as Figure 6C 6. In some embodiments, the first size of the first text entry field includes a first length (722b), such as a first length (722b) of the first text entry field, such as a first length (722b) of the first text entry field, and a first length (722b) of the first text entry field. Figure 6EFor example, when the first text entry field is displayed, the first text entry field extends a first length in the document.

[0280] In some embodiments, the first length is based on (e.g., automatically selected by the electronic device) a corresponding length (722c), such as displaying the first text entry field 608-1 with a length that is the length of a horizontal graphic line extending the first text entry area 606-1. For example, the first length of the first text entry field is equal to the corresponding length of the text entry area, such as for Figure 6E , is similarly shown as the text entry field 606-1 in . In some embodiments, the first length of the first text entry field is different from (e.g., but proportional to) the corresponding length of the text entry area. In some embodiments, if the document includes a second text entry area separate from the first text entry area, the electronic device displays the text entry field located at a position based on the second text entry area with a length based on the length of the second text entry area. For example, if the second text entry area is larger than the first text entry area (e.g., has a longer length than the first text entry area), the electronic device displays the text entry field at the second text entry area with a second length that is greater than the first length of the first text entry field, such as Figure 6K As shown, the text entry field 608-3 is displayed with a length that is longer than the length of the first text entry field 608-1. Similarly, if the second text entry area is smaller than the first text entry area, the electronic device displays the text entry field at the second text entry area with a second length that is smaller than the first length of the first text entry field. Displaying the text entry field in the document with a length based on the length of the text entry area with which the text entry field is associated enables text entered into the text entry field to remain close to the text entry area and / or enables the text entry field to be displayed without having to select a length for the text entry field, thereby improving user-device interaction.

[0281] In some embodiments, the respective size of the first text entry area includes a respective height (724a) based on an available height in the document at the location of the text entry area in the document (e.g., automatically selected by the electronic device), such as Figure 6C, the amount of blank space above the horizontal graphic line in the first text entry area 606-1 in the document. For example, if the first text entry area includes a visual element such as a vertical graphic line or a graphic box, the corresponding height of the first text entry area is based on the height of the vertical graphic line or the graphic box. In some embodiments, if the first text entry area includes blank space within the document, the corresponding height of the first text entry area is based on the amount of blank space. For example, the height of the first text entry area is based on the amount of blank space between lines of text or visual elements surrounding the first text entry area. In some embodiments, the first size of the first text entry field includes a first height (724b), such as Figure 6E For example, when the first text entry field is displayed, the first text entry field has a first height in the document.

[0282] In some embodiments, the first height is based on (e.g., automatically selected by the electronic device) a corresponding height (724c), such as Figure 6E 6. The first text entry field 606-1 is shown as being displayed at a height that occupies the blank space above the horizontal line of the graphic of the first text entry field 608-1. For example, the first height of the first text entry field is equal to the corresponding height of the text entry area. In some embodiments, the first height of the first text entry field is different from (e.g., but proportional to) the corresponding height of the text entry area. In some embodiments, if the document includes a second text entry area that is separate from the first text entry area (e.g., Figure 6F 606-2), the electronic device displays the text entry field at the position based on the second text entry area in a size based on the size of the second text entry area, such as Figure 6F For example, if the second text entry area is larger than the first text entry area (e.g., has a greater height than the first text entry area), the electronic device displays the text entry field at the second text entry area at a second height that is greater than the first height of the first text entry field, such as Figure 6F As shown, the text entry field 608-2 is displayed at a height greater than the height of the first text entry field 608-1. Similarly, if the second text entry area is smaller than the first text entry area, the electronic device displays the text entry field at a second height less than the first height of the first text entry field at the second text entry area. Displaying the text entry field in the document at a height based on the height of the text entry area with which it is associated enables text entered into the text entry field to remain close to the text entry area and / or enables the text entry field to be displayed without having to select a height for the text entry field, thereby improving user-device interaction.

[0283] In some embodiments, the first size of the first text entry field includes a font size setting based on (e.g., automatically selected by the electronic device) the text in the first text entry field, such as Figure 6H ) for displaying the text 609-1. For example, as similarly described above with reference to steps 710a-710b, the font size setting for the text determines the font of the text to be entered into the first text entry field in the document. In some embodiments, the font size setting for the text in the first text entry field is a predefined (e.g., default) value, a value selected by a user of the electronic device, and / or a value determined based on the size of other text in the document (e.g., text displayed in other text entry fields and / or text entry areas). In some embodiments, the first height of the first text entry field is equal to the height of the font determined by the font size setting. In some embodiments, the first height of the first text entry field is different from (e.g., but proportional to) the height of the font determined by the font size setting, such as Figure 6H The height of the first text entry field 608-1 is shown to be greater than the font size of the text 609-1. In some embodiments, if the font size setting of the text in the first text entry field changes (e.g., from a first value to a second, different value), the electronic device changes the first height of the first text entry field to a second height that is different from the first height. Displaying the text entry field in the document at a height based on the font size setting of the text in the text entry field enables text with that font size to be entered into the text entry field without clipping or obscuring the text, and / or enables the text entry field to be displayed without having to select a height for the text entry field, thereby improving user-device interaction.

[0284] In some embodiments, the document includes a second text entry area (728a) (eg, separate from the first text entry area), such as Figure 6B In some embodiments, before detecting the first input and while the document is in the corresponding operating mode (728b), based on the determination that the second text entry area includes a text entry field of the first type, the electronic device displays (728c) the second text entry area via the display generation component with a first visual characteristic having a first value, such as Figure 6CThe preset text entry area 605-1 is shown displayed with a visual effect (e.g., highlighted). For example, when the corresponding operating mode of the document is active at the electronic device, if the electronic device determines that the second text entry area includes a preset / predefined text entry field, the electronic device displays the second text entry area with a first visual characteristic having a first value. In some embodiments, displaying the second text entry area with a first visual characteristic having a first value includes highlighting the text entry area by a first amount, shading the text entry area by a first amount, bolding the text entry area by a first amount, and / or changing the color of the text entry area when the document is in the corresponding operating mode. In some embodiments, a text entry field is a preset / predefined text entry field if the text entry field is included in the document without user input to create the text entry field, such as Figure 6C 6. The text entry areas 605-1 and 605-2 are displayed in the absence of user input. For example, the electronic device determines that the second text entry area includes a preset / predefined text entry field based on metadata associated with the document and / or visual elements such as boxes / rectangles that are selectable to enter text into the text entry field.

[0285] In some embodiments, based on a determination that the second text entry area does not include a text entry field of the first type, the electronic device forgoes (728d) displaying the second text entry area with the first visual characteristic having the first value, such as Figure 6F The display of the text entry field 608-2 with a visual effect is shown abandoned. For example, if the electronic device determines that the second text entry area does not include a preset / predefined text entry field, the electronic device does not display the second text entry area with a first visual characteristic having a first value. In some embodiments, because the second text entry area does not include a preset / predefined text entry field, the electronic device does not highlight, shade, bold and / or change the color of the second text entry area in the second text entry area. For example, the electronic device does not change the display of the second text entry area in the document. Displaying the text entry area with corresponding visual characteristics based on the determination that the text entry area includes a preset text entry field promotes the discovery that the text entry area includes the current text entry field and / or promotes user input to enter text into the text entry area without displaying additional controls, thereby improving user-device interaction.

[0286] In some embodiments, while the second text entry area is displayed and while the document is in a corresponding operating mode, the electronic device detects (730a) input to the second text entry area, such as a selection of text entry area 605-1, via one or more input devices. For example, the electronic device detects a selection (e.g., a tap or touch input) to the second text entry area. In some embodiments, the electronic device detects a selection made via an external input device in communication with the electronic device (e.g., a click or selection made via a key / button of an external keyboard, mouse, or trackpad).

[0287] In some embodiments, in response to detecting the input (730b), based on a determination that the second text entry area includes a first type of text entry field (e.g., a preset / predefined text entry field), the electronic device displays (730c) via the display generation component one or more user interface objects that are selectable to enter the suggested text into the second text entry field, such as Figure 6I In some embodiments, the electronic device displays one or more user interface objects in a portion of the second text entry area, such as Figure 6I In some embodiments, one or more user interface objects include a text label (e.g., Figure 6I , "Smith," "Stuart," and / or "Jackson" in the second text entry area, which text labels indicate suggested text to be entered into the second text entry field if one or more user interface objects are selected. In some embodiments, the electronic device generates suggested text based on the context of the second text entry area, as similarly described with reference to steps 736a-736d.

[0288] In some embodiments, based on a determination that the second text entry area does not include a text entry field of the first type (e.g., the second text entry area does not include a preset / predefined text entry field and / or no user input is received to create a text entry field at the second text entry area), the electronic device forgoes (730d) displaying one or more user interface objects (e.g., and displaying a text entry field in document 602, such as Figure 6GIn some embodiments, the electronic device performs different operations based on the input. For example, the electronic device creates a text entry field at a location based on the location of the second text entry area in the document. Displaying a user interface object that is selectable to enter suggested text into the preset text entry field in response to detecting input into the text entry area associated with the preset text entry field reduces the number of inputs required to enter text in the text entry area and / or enables text to be automatically entered into the text entry area, thereby improving user-device interaction.

[0289] In some embodiments, in response to detecting a first input (732a), when the document is not in a corresponding operating mode, a first position (such as a first position) within a first threshold distance (e.g., 0.25 cm, 0.5 cm, 0.75 cm, 1 cm, 1.5 cm, 2 cm, 3 cm, 5 cm, or 10 cm) of a first text entry area in the document is detected. Figure 6BB The electronic device abandons (732b) displaying the first text entry field at the corresponding position in the document, such as Figure 6CC As shown, the electronic device abandons displaying the text entry field at the text entry area 606-1. In some embodiments, when the document is not in the corresponding operating mode, based on the determination of the first input for the second position within the first threshold distance of the first text entry area, the electronic device abandons (732c) displaying the first text entry field at the corresponding position. For example, after selecting the selectable option associated with the document viewing application that is displaying the document, the document operates in the corresponding operating mode. In some embodiments, if the selectable option that can be selected to activate the corresponding mode is not selected when the first input is detected, the electronic device does not display the first text entry field at the corresponding position, regardless of whether the first input is detected at a position within the first threshold distance of the first text entry area. For example, the electronic device performs different operations based on the first input. In some embodiments, the electronic device selects a portion of the text at the first position or the second position targeted by the first input (for example, highlights the portion), such as Figure 6CC 6. The text 609-1 at the selected text entry area 606-1 is shown. In some embodiments, the electronic device activates a selectable option (e.g., a hyperlink) at the first position or the second position to which the first input is directed. Abandoning displaying a text entry field in a document in response to detecting a corresponding gesture for a document when the corresponding operating mode is inactive avoids inadvertently creating a text entry field in the document and / or enables different operations involving the document to be performed according to the corresponding gesture, thereby improving user-device interaction.

[0290] In some embodiments, in response to detecting a first input (734a), when the document is in a corresponding operation mode, a third position (such as a position that is different from the first position and the second position) is located within a first threshold distance (e.g., 0.25 cm, 0.5 cm, 0.75 cm, 1 cm, 1.5 cm, 2 cm, 3 cm, 5 cm, or 10 cm) that is not located in any text entry area in the document according to the first input. Figure 6S Based on the determination of the input 603s in the document, the electronic device displays (734b) the first text entry area at a second corresponding position in the document that is different from the corresponding position and is based on (e.g., automatically selected by the electronic device) the third position and is irrelevant to the structure of the document, such as Figure 6T As shown, a text entry field 608-7 is displayed in the document 602 at a location based on the location where the input 603s is detected. For example, if a corresponding gesture for a first input is detected away from any text entry area in the document, the electronic device creates a first text entry field at a location based on a third location where the first input is detected. In some embodiments, the second corresponding location in the document is the same as or overlaps with the third location where the first input is detected. In some embodiments, the first text entry field is displayed at a second corresponding location that is independent of the structure of the document (e.g., independent of visual elements (e.g., lines, text labels, and / or boxes) included in the document). Displaying a text entry field based on a location where a corresponding gesture is detected that is outside a threshold distance from the location of a text entry area in the document reduces the number of inputs required to enter text into the document, and / or enables the text entry field to be automatically displayed at the location of the corresponding gesture, thereby improving user-device interaction.

[0291] In some embodiments, a first text entry field (e.g., Figure 6K 608-3), the electronic device detects (736a) via one or more input devices a second input corresponding to a request to enter text into the first text entry field, such as Figure 6K For example, the electronic device detects a selection (e.g., a tap or touch input) for the first text entry field. In some embodiments, the electronic device detects a selection made via an external input device in communication with the electronic device (e.g., a click or selection made via a key / button of an external keyboard, mouse, or trackpad).

[0292] In some embodiments, in response to detecting the second input (736b), a first option (e.g., Figure 6LUpon selection of the display key in the tray 611 (option 615) and a determination that the first text entry field is associated with the first type of text, the electronic device displays (736c) via the display generation component a first user interface object selectable to enter the first suggested text of the first type into the first text entry field, such as Figure 6M The user interface object 617-1 is shown. In some embodiments, in response to detecting the second input, the electronic device displays a first option for generating suggested text. For example, in response to detecting the selection of the first option, if the first text entry field is associated with a first type of text, the electronic device displays a first user interface object that can be selected to enter the first suggested text of the first type into the first text entry field. As discussed below with reference to step 738, the first type of text is determined based on the context of the first text entry area with which the first text entry field is associated. In some embodiments, the first user interface object includes a text label (e.g., Figure 6M In some embodiments, the first text entry field is displayed with text corresponding to a prompt for the first text entry field. For example, the text corresponding to the prompt is based on text of the first type, and selection of the first text entry field causes the text corresponding to the prompt to no longer be displayed.

[0293] In some embodiments, based on the second input including a selection of a first option (e.g., option 615) that is selectable to generate suggested text for entry into the first text entry field and a determination that the first text entry field is associated with a second type of text that is different from the first type of text, the electronic device displays (736d) via the display generation component a second user interface object that is selectable to enter second suggested text of the second type into the first text entry field, such as Figure 6M The user interface object 617-2 is shown displayed, wherein the first suggested text is different from the second suggested text. For example, in response to detecting a selection of the first option, if the first text entry field is associated with a second type of text, the electronic device displays a second user interface object that can be selected to enter the second suggested text of the second type into the first text entry field. As discussed below with reference to claim 19, the second type of text is determined based on the context of the first text entry area with which the first text entry field is associated. In some embodiments, the second user interface object includes a text label (e.g., Figure 6MIn one embodiment, a text label indicates a second suggested text to be entered into the first text entry field if the second user interface object is selected. Displaying a user interface object selectable for entering a particular type of suggested text into the text entry field in response to detecting an input corresponding to a request to enter text into the text entry field reduces the number of inputs required to enter text into the text entry field and / or enables a particular type of text to be automatically entered into the text entry field, thereby improving user-device interaction.

[0294] In some embodiments, the first text entry field (e.g., Figure 6K Whether the text entry field 608-3 in the document is associated with the first type of text or the second type of text is based on (eg, automatically selected by the electronic device) a first text entry area within the document (eg, Figure 6K For example, the electronic device determines the type of suggested text to suggest based on the context of the first text entry area with which the first text entry field is associated. In some embodiments, as similarly described above with reference to step 714, the document includes one or more visual elements that are evaluated to determine the presence of a text entry area in the document. One such visual element includes a text label that optionally identifies a text entry area in the document. For example, a text label of the first type (e.g., a "surname" text label or an "address" text label, such as Figure 6K Similarly shown) causes the electronic device to determine that the first text entry field is associated with a first type of text. Thus, the first suggested text entered into the first text entry field in response to selection of the first user interface object is text of the first type (e.g., text corresponding to a suggested name or a suggested address). Alternatively, for example, a second type of text label (e.g., a "phone" text label or an "email" text label) causes the electronic device to determine that the first text entry field is associated with a second type of text. Thus, the second suggested text entered into the first text entry field in response to selection of the second user interface object is text of the second type (e.g., text corresponding to a suggested phone number or a suggested email address). Displaying a user interface object that is selectable for entering suggested text based on the context of the text entry area reduces the number of inputs required to enter a particular type of text into a text entry field and / or enables a particular type of text to be automatically entered into a text entry field, thereby improving user-device interaction.

[0295] In some embodiments, the document includes a first text entry field (e.g., Figure 6L 608-3) shares at least one characteristic with a second text entry field (e.g., Figure 6NIn some embodiments, after displaying the first user interface object (e.g., Figure 6M When selecting the user interface object 617-1 in the first user interface object, the electronic device detects (740b) via one or more input devices a third input corresponding to a selection of the first user interface object, such as Figure 6M For example, the electronic device detects a tap or touch input to the first user interface object. In some embodiments, the electronic device detects a selection made via an external input device in communication with the electronic device (e.g., a click or selection made via a key / button of an external keyboard, mouse, or trackpad).

[0296] In some embodiments, in response to detecting the third input (740c), the electronic device displays (740d) the first suggested text associated with the first user interface object in the first text entry field via the display generation component, such as Figure 6N As shown, text 609-3 is displayed in the text entry field 608-3. For example, the first suggested text corresponds to the text label indicated by the first user interface object (e.g., as described above with reference to steps 736a-736d). In some embodiments, the first suggested text includes the first portion of the text of the text label indicated by the first user interface object, such as Figure 6N The street name shown is "1234 Elm Street".

[0297] In some embodiments, the electronic device displays (740e) a third suggested text associated with the first user interface object in the second text entry field via the display generation component, such as Figure 6N As shown, text 609-3 is displayed in the text entry field 608-4, where the third suggested text is related to the first suggested text based on at least one characteristic shared (e.g., automatically selected by the electronic device). For example, the third suggested text includes a second portion of the text of the text label indicated by the first user interface object that is different from the first portion. In some embodiments, the first suggested text and the third suggested text are text of the first type. For example, if the first type of text corresponds to Figure 6N Similarly, if the user's home address is shown, the first suggestion text includes the first part of the home address, and the third suggestion text includes the second part of the home address (e.g., Figure 6N). If the first type of text corresponds to the user's name, the first suggested text optionally includes the user's first name, and the third suggested text optionally includes the user's last name. Entering suggested text into the first and second text entry fields of the document in response to detecting selection of a user interface object for entering suggested text into the first text entry field reduces the number of inputs required to enter a particular type of text into the first and second text entry fields and / or enables automatic entry of the particular type of text into the first and second text entry fields, thereby improving user-device interaction.

[0298] In some embodiments, the document includes a second text entry field (742a) (eg, separate from the first text entry field), such as Figure 6F In some embodiments, the first text entry field (e.g., Figure 6F 608-1), the electronic device detects (742b) via one or more input devices a second input corresponding to a request to enter text into the first text entry field, such as Figure 6F For example, the electronic device detects the selection input 603f via a soft keyboard associated with the user interface (e.g., Figure 6G Input to the first text entry field is performed using a keyboard 611 in the electronic device or via an external keyboard in communication with the electronic device, as similarly described above with reference to steps 702a-702e. In some embodiments, when the first text entry field has current focus (e.g., when a text cursor is displayed within the first text entry field), the electronic device detects selection of one or more keys of the keyboard, such as Figure 6G Input 603g in.

[0299] In some embodiments, in response to detecting the second input, the electronic device displays (742c) the first text in the first text entry field via the display generation component according to the second input, such as Figure 6H 6. As shown, text 609-1 is displayed in the first text entry field 608-1. For example, the electronic device displays the first text including one or more characters corresponding to the one or more keys selected by the user. In some embodiments, the electronic device displays the first text as font-based text in the first text entry field in the document.

[0300] In some embodiments, the first text is displayed in the first text entry field (e.g., Figure 6IAfter entering the text in 609-1), the electronic device initiates (742d) a process for entering text into the second text entry field without detecting an input corresponding to a request to enter text into the second text entry field, such as Figure 6I As shown, a user interface object 612 is automatically displayed that can be selected to enter the suggested text into the second text entry field 608-2. For example, after the electronic device detects the end of the second input, the electronic device moves the current focus to the second text entry field in the document, such as Figure 6I The second text entry field 608-2 is shown displayed in the focus indication. In some embodiments, detecting the end of the second input includes detecting a corresponding key on the keyboard (e.g., Figure 6H In some embodiments, detecting the end of the second input includes determining that a threshold amount of time (e.g., 0.1 seconds, 0.25 seconds, 0.4 seconds, 0.5 seconds, 1 second, 1.5 seconds, 2 seconds, 3 seconds, 4 seconds, 5 seconds, or 10 seconds) has passed since the first text was displayed in the first text entry field (e.g., after detecting the end of selection of a key of the keyboard). In some embodiments, the electronic device initiates a process for entering text into the second text entry field without detecting input to the second text entry field (e.g., selection of a text entry field corresponding to a request to enter text into the second text entry field). Initiating a process for entering text into a second text entry field in a document after entering text into a first text entry field in the document reduces the number of inputs required to enter text into the second text entry field after entering text into the first text entry field, and / or enables text to be automatically entered into the second text entry field after entering text into the first text entry field, thereby improving user-device interaction.

[0301] In some embodiments, initiating the process for entering text into the second text entry field includes displaying, via the display generation component, one or more user interface objects (e.g., Figure 6I For example, when the current focus is on a first text displayed in a first text entry field and then shifts to a second text entry field, the electronic device displays one or more user interface objects that can be selected to enter the suggested text into the second text entry field. In some embodiments, as similarly described above with reference to steps 736a-736d, the one or more user interface objects include a text label (e.g., Figure 6IDisplaying a user interface object selectable for entering text in a second text entry field in a document after entering text into a first text entry field in the document reduces the number of inputs required to enter text into the second text entry field after entering text into the first text entry field and / or enables automatic entry of text into the second text entry field after entering text into the first text entry field, thereby improving user-device interaction.

[0302] In some embodiments, the second text entry field is responsive to user input (e.g., Figure 6E 603e) is created in the document, and the second text entry field is spatially after the first text entry field in the document (746) (e.g., in Figure 6F 8-1). For example, the temporal order in which the electronic device initiates the process for entering text into the corresponding text entry fields is based on the spatial order of the text entry fields in the document, rather than the sequence in which the user created the text entry fields. In some embodiments, even if the second text entry field is created in response to user input before the first input to create the first text entry field is detected, the electronic device initiates the process for entering text into the second text entry field because the second text entry field is spatially arranged after the first text entry field in the document. For example, the second text entry field is displayed adjacent to the first text entry field (and / or to the right of the first text entry field for left-to-right languages, or to the left of the first text entry field for right-to-left languages) (e.g., Figure 6F Automatically initiating a process for entering text in a second text entry field in a document based on the spatial arrangement of the second text entry field relative to the first text entry field reduces the number of inputs required to enter text into the second text entry field after entering the text into the first text entry field and / or enables automatic entry of text into the second text entry field after entering the text into the first text entry field, thereby improving user-device interaction.

[0303] In some embodiments, when the first text entry field is displayed at the corresponding location, the electronic device detects (748a) handwriting input on a surface (e.g., a touch screen surface of the electronic device or a touch-sensitive surface of an input device in communication with the electronic device) via one or more input devices, such as Figure 6YThe handwriting input provided by the stylus 623 on the touch screen 504 is shown, wherein the handwriting input is for the first text entry field (eg, Figure 6Y For example, the electronic device detects that an object (e.g., a finger or an input device such as a stylus) contacts the surface and provides handwriting corresponding to the handwritten text. In some embodiments, upon detecting handwriting input, the electronic device displays a representation of the handwriting input (e.g., handwritten letters, numbers, and / or special characters) in the first text entry field according to the handwriting input, such as Figure 6Y Representation of handwritten input 627 in .

[0304] In some embodiments, in response to detecting handwriting input, the electronic device displays (748b) first text based on (e.g., automatically selected by the electronic device) the handwriting input in a first text entry field via a display generation component, such as displaying text 609-4 in text entry field 608-7. Figure 6Z For example, the electronic device represents the handwriting input (e.g., Figure 6Y In some embodiments, the electronic device determines the font-based text to be displayed in the first text entry field based on characteristics of the representation of the handwriting input (e.g., the shape, size, and / or thickness of the handwritten characters). In some embodiments, the electronic device determines the font-based text to be displayed in the first text entry field based on characteristics of the representation of the handwriting input (e.g., the shape, size, and / or thickness of the handwritten characters). In some embodiments, a content entry mode (such as a handwriting entry mode that causes handwriting input to be converted to font-based text in a document) is active at the electronic device (e.g., in response to detecting a selection of option 622, such as Figure 6W In one embodiment, the electronic device detects handwriting input when the user enters the text entry field. Displaying text in a text entry field in a document in response to detecting handwriting input directed to the text entry field reduces the number of inputs required to enter text into the text entry field and / or enables handwriting input to be automatically entered as text in the text entry field, thereby improving user-device interaction.

[0305] In some embodiments, in response to detecting a first input (750a) such as Figure 6C 603c-1 or 603c-2 in the input, is to display the first text entry field (for example, Figure 6E Before entering the text entry field 608-1 in the first text entry field, the electronic device displays (750b) via one or more input devices one or more selectable options that can be selected to select the type of the first text entry field, such as Figure 6DSelectable options 607-1 to 607-3 are shown. For example, before the electronic device displays the first text entry field in response to detecting the first input and when the document is in the corresponding operating mode, the electronic device displays one or more selectable options in the document for selecting the type of the first text entry field. In some embodiments, the one or more selectable options are displayed in a menu element in the document. In some embodiments, the one or more selectable options include a check box (e.g., Figure 6D 607-1), a text entry box (e.g., Figure 6D 607-2) and / or a signature entry box (e.g., Figure 6D In some embodiments, the electronic device detects the selection of one of the one or more selectable options (e.g., by Figure 6D After the selection provided by input 603d in the first text entry field (e.g., Figure 6E Displaying one or more selectable options that can be selected to select the type of text entry field in the document before displaying the text entry field reduces the number of inputs required to select the type of the text entry field and / or enables automatic selection of the type of the text entry field, thereby improving user-device interaction.

[0306] In some embodiments, in response to detecting the first input, a first text entry field (e.g., a first size, a predetermined size, and / or a selected size) is displayed at a corresponding location. Figure 6T In some embodiments, when the first text entry field is displayed at a first size at a corresponding position, the electronic device detects (752b) via one or more input devices a second input corresponding to a request to display the first text entry field at a second size different from the first size, such as Figure 6T For example, the electronic device detects input 603t for a portion of the first text entry field that is selectable to initiate a process for changing the size of the first text entry field from a first size to a second size. In some embodiments, as described below with reference to steps 752a-752c, the electronic device detects input 603t for one or more resizing elements (e.g., Figure 6T The second input of 621a and 621b).

[0307] In some embodiments, in response to detecting the second input, the electronic device displays (752c) the first text entry field in a second size at a corresponding position via the display generation component, such as Figure 6U For example, the electronic device increases or decreases the size of the first text entry field at the corresponding position in the document. In some embodiments, the size of the first text entry field is changed according to whether the first text entry field is not a predefined text entry field in the document (e.g., integrated with the document) (such as Figure 6T The electronic device may determine the size of the text entry field in the document. For example, if the second input is for a second text entry field in the document that is a predefined text entry field, the electronic device may abandon changing the size of the second text entry field in the document. Changing the size of the text entry field in the document in response to detecting an input corresponding to a request to change the size of the text entry field reduces the number of inputs required to change the size of the text entry field and / or enables a larger or smaller amount of text to be entered into the text entry field, thereby improving user-device interaction.

[0308] In some embodiments, the second input is directed to one or more selectable user interface objects (754) displayed with the first text entry field, such as Figure 6T . For example, a first text entry field is displayed with one or more resizing elements that are selectable to initiate a process for changing the size of the first text entry field in the document. In some embodiments, the one or more resizing elements are movable in the document to cause the electronic device to change the size of the first text entry field. For example, displaying the first text entry field at a second size is based on the magnitude and direction of the movement of the one or more resizing elements. In some embodiments, the one or more resizing elements include a first resizing element (e.g., resizing handle 621b) displayed at a first end (e.g., left side) of the first text entry field and a second resizing element (e.g., resizing handle 621a) displayed at a second end of the second text entry field. In some embodiments, if the second input includes movement of the first resizing element in a first direction (e.g., left direction) by a corresponding magnitude, such as Figure 6T As shown, if the resize handle 621b moves to the left, the electronic device increases the size of the first text entry field, such as Figure 6UThe size of the text entry field 608-7 is shown to be increased. If the second input includes movement of the first resizing element in a second direction (e.g., to the right) by a corresponding amount, the electronic device reduces the size of the first text entry field. Similarly, if the second input includes movement of the second resizing element in the first direction by a corresponding amount, the electronic device reduces the size of the first text entry field in the document. If the second input includes movement of the second resizing element in the second direction by a corresponding amount, the electronic device increases the size of the first text entry field. In some embodiments, for predefined text entry fields such as Figure 6T For example, as described above with reference to steps 752a-752c, if the document includes a second text entry field as a predefined text entry field, the electronic device does not display the one or more selectable user interface objects together with the second text entry field, such as Figure 6T 6. The foregoing of displaying the preset text entry areas 605-1 and 605-2 along with the resize handles 621a and 621b is shown. Resizing a text entry field in a document in response to detecting input to one or more resize elements displayed with the text entry field reduces the number of inputs required to resize the text entry field and / or enables more or less text to be entered into the text entry field, thereby improving user-device interaction.

[0309] In some embodiments, the first input includes a predefined number of contacts (e.g., one, two, or three times) between an object (e.g., a user's finger and / or an external input device such as a stylus) and a surface (e.g., touch screen 504) within a time threshold (e.g., 0.025 seconds, 0.05 seconds, 0.1 seconds, 0.15 seconds, 0.25 seconds, 0.5 seconds, 0.75 seconds, 1 second, 1.5 seconds, 2 seconds, or 3 seconds) (756). For example, the electronic device detects a double-click gesture detected on a touch-sensitive surface (e.g., on a touch screen display of the electronic device) or other surface, as similarly described above with reference to steps 702a-702e. Displaying a text entry field based on the location of a text entry area in a document in response to detecting a double-click gesture at a location that is a threshold distance from the location of the text entry area reduces the number of inputs required to enter text into the document at the text entry area and / or enables the text entry field to be automatically displayed, thereby improving user-device interaction.

[0310] It should be understood that Figures 7A to 7KThe particular order in which the operations are described in the description is merely exemplary and is not intended to indicate that the described order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize many ways to reorder the operations described herein. Additionally, it should be noted that the details of other processes described herein with reference to other methods described herein (e.g., methods 900, 1100, and / or 1300) also apply in a similar manner to the details of the processes described above with reference to the methods 900, 1100, and / or 1300. Figures 7A to 7K Method 700. For example, the operation of the electronic device described above with reference to method 700 to enter text into one or more text entry areas within a document optionally includes one or more of the following features: presenting a mark having a width that depends on the direction of movement of the input used to generate the mark, presenting a mark that merges or overlaps with other marks, and / or scrolling and moving the content entry palette in the user interface in response to user input (e.g., methods 900, 1100, and / or 1300). For the sake of brevity, these details are not repeated here.

[0311] The operations in the above information processing method are optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (e.g., a processor in combination with a processor). Figure 1A to Figure 1B 、 Figure 3 、 5A to 5I In addition, the above reference Figures 7A to 7K The described operations are optionally performed by Figure 1A to Figure 1B . For example, display operations 702a, 702d, 702e, 706b, 712c, 712f, 712g, 728c, 730c, 734b, 736c, 736d, 740d, 740e, 742c, 748b, 750b, and 752c, and detection operations 702b, 712b, 712d, 730a, 736a, 740b, 742b, 748a, and 752b are optionally implemented by event classifier 170, event recognizer 180, and event handler 190. When a corresponding predefined event or sub-event is detected, event recognizer 180 activates event handler 190 associated with the detection of the event or sub-event. Event handler 190 optionally utilizes or calls data updater 176 or object updater 177 to update application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly know how to update the content displayed by the application based on the GUI updater 178. Figure 1A to Figure 1B The components depicted in the implementation of other processes.

[0312] Simulated calligraphy

[0313] Users interact with electronic devices in a variety of different ways. In some embodiments, the electronic device presents a mark in the content entry area in response to detecting a drawing input provided by the user. The embodiments described below provide a way for a computer system to display a mark with a thickness that varies according to the direction in which the mark is drawn. For example, displaying a mark with varying thickness in this way creates a simulated calligraphy effect. Enhancing interaction with the device reduces the amount of time required for the user to perform an operation, thereby reducing the power consumption of the device and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, this person is optionally referred to as a user of the device.

[0314] Figures 8A to 8K Illustrated are exemplary ways of presenting a marker having a thickness that depends on the direction in which the drawing input is received, according to some embodiments of the present disclosure. The embodiments in these figures are used to illustrate the process described below, including reference to 9A to 9D The process described.

[0315] Figure 8A The electronic device 500 is illustrated as displaying a user interface 800 of a content creation application. For example, the content creation application is a drawing application, a note-taking application, and / or a document markup application. The user interface 800 includes a content entry area 802. In some embodiments, in response to detecting input to the content entry area 802, the electronic device 500 displays a markup based on the input, thereby enabling the user to create content including, for example, handwriting and / or drawings in the content entry area 802 by providing input.

[0316] In some embodiments, the electronic device 500 detects input provided via an input device 823. In some embodiments, the input device 823 is a stylus, such as a passive stylus or an active stylus. In some embodiments, the electronic device 500 includes one or more sensors (e.g., included in the touch screen 504) for detecting the position of a portion of the input device 823 (e.g., the tip) when the portion is in contact with or within a threshold distance of a surface (e.g., of the touch screen 504). An example threshold distance is provided below in the description of method 900.

[0317] The user interface 800 also includes a menu 804 for defining settings for markings created in response to detecting input provided by the input device 823. The menu 804 optionally shares one or more features with the menu described below with reference to method 1300. For example, the menu 804 includes an undo option 806-1, a redo option 806-2, multiple tool options 808-1, 808-2, 808-3, and 808-4, a keyboard option 811a, and an option 811a for displaying additional menus. In some embodiments, in response to detecting a selection of the undo option 806-1, the electronic device 500 stops displaying the markings corresponding to the most recently received input from the input device 823. In some embodiments, in response to detecting a selection of the redo option 806-2, the electronic device 500 displays the markings most recently removed by selecting the undo option 806-1. In some embodiments, in response to detecting a selection of the text tool 808-1, the electronic device 500 converts the handwriting provided by the input device 823 into typed text, including one or more steps of method 700 described above. In some embodiments, in response to detecting selection of the pen tool 808-2, the electronic device 500 displays simulated pen markings in response to input provided by the input device 823. In some embodiments, in response to detecting selection of the marker tool 808-3, the electronic device 500 displays simulated marker markings in response to input provided by the input device 823, including one or more steps of method 1100 described below. In some embodiments, in response to detecting selection of the calligraphy tool 808-4, the electronic device 500 displays simulated calligraphy markings in response to input provided by the input device 823, as described in reference to FIG. Figures 8A to 8H and method 900. In some embodiments, in response to detecting a selection of one of the color options 810a-810d, the electronic device 500 changes the color of the mark displayed in response to detecting input received from the input device 823. In some embodiments, in response to detecting a selection of the keyboard option 811a, the electronic device 500 displays a soft keyboard that enables the electronic device 500 to insert text into the content entry area 802 in response to one or more inputs to the soft keyboard. In some embodiments, in response to detecting a selection of the menu option 811b, the electronic device 500 displays a menu with additional content creation options.

[0318] like Figure 8AAs shown, calligraphy tool 808-4 is selected in user interface 800. Thus, in response to detecting one or more inputs provided by input device 823, electronic device 500 displays calligraphic marks. For example, the calligraphic marks have a thickness that depends on the direction in which the marks are drawn using input device 823. In some embodiments, the thickness of the marks further depends on the angle of input device 823 relative to the drawing / writing surface and additional characteristics 812. In some embodiments, characteristic 812 is the pressure and / or speed at which the input is provided using input device 823. Figure 8A , the electronic device 500 detects movement of the input device 823 when the input device 823 is touching the drawing / writing surface (e.g., the surface of the touch screen 504), when the calligraphy tool 808-4 is selected, when the input device 823 is at a first angle relative to the writing / drawing surface, and when the characteristic 812 has a first value 814-1. Figure 8A As shown, the movement of the input device 823 is a downward movement along the writing / drawing surface. Figure 8A For the input shown, the electronic device 500 presents a mark in the content entry area 802, such as Figures 8B to 8C shown.

[0319] In some embodiments, in response to Figure 8A In the illustrated input, the electronic device 500 presents an animation of ink spreading in the content entry area 802 while the input device 823 of the content entry area 802 moves thereon while providing a portion of the input, as shown in FIG. Figure 8B As shown. Figure 8B In some embodiments, the electronic device 500 displays the marker 816-1 with an animation of the marker 816-1 expanding in width. Figure 8C Extension of thickness shown.

[0320] exist Figure 8C , the electronic device 500 is shown indicia 816-1 at its final thickness, which depends on the thickness of the electronic device 500. Figure 8A The direction of movement of the input device 823 during the input is shown, the angle of the input device 823 relative to the writing / drawing surface, and the value of the characteristic 812. In some embodiments, the electronic device 500 displays the thickest markings in response to receiving the input that includes a downward movement of the input device 823, compared to markings in other directions with the same value of the characteristic 812 and the same angle of the input device 823 relative to the drawing / writing surface.

[0321] exist Figure 8C, while the input device 823 is being pressed against the writing / drawing surface at the same angle as the angle at which the mark 816-1 was drawn and at the same value 814-1 of the characteristic 812 as when the mark 816-1 was drawn, the electronic device 500 detects another input including movement of the input device 823. Figure 8C As shown, the input comprises horizontal movement of the input device 823 along the writing / drawing surface. Figure 8C For the illustrated input, the electronic device 500 displays a mark having a thickness smaller than that of the mark 816-1, such as Figure 8D shown.

[0322] Figure 8D The electronic device 500 is shown in response to Figure 8C In some embodiments, the electronic device 500 displays an animation of the expansion of the marker 816-2 in response to the input, which is similar to the animation described above with reference to FIG. Figure 8B The animation, wherein the final thickness of the mark 816-2 is Figure 8D As described above, the angle of the input device 823 relative to the drawing / writing surface and the value 812-1 of the characteristic 814 are the same for the marker 816-1 and the marker 816-2, but because the orientations of the markers 816-1 and 816-2 are different, the thicknesses of the markers 816-1 and 816-2 are different. Figure 8D As shown, the mark 816-1 drawn in a downward motion is thicker than the mark 816-2 drawn in a horizontal motion. In some embodiments, the thickness of the mark 816-2 will be the same regardless of whether the input used to draw the mark 816-2 includes a left-to-right motion or a right-to-left motion.

[0323] exist Figure 8D , while the input device 823 is being pressed against the writing / drawing surface at the same angle as the angle at which the marks 816-1 and 816-2 were drawn and at the same value 812-1 of the characteristic 814 as the value 814-1 of the characteristic 812 when the marks 816-1 and 816-2 were drawn, the electronic device 500 detects another input including movement of the input device 823. Figure 8D As shown, the input comprises an upward vertical movement of the input device 823 along the writing / drawing surface. Figure 8D For the illustrated input, the electronic device 500 displays a mark having a thickness smaller than that of the mark 816-2, such as Figure 8E shown.

[0324] Figure 8E The electronic device 500 is shown in response to Figure 8DIn some embodiments, the electronic device 500 displays an animation of the expansion of the marker 816-3 in response to the input, which is similar to the animation described above with reference to FIG. Figure 8B The animation, wherein the final thickness of the mark 816-3 is Figure 8E As described above, for marker 816-1, marker 816-2, and marker 816-3, the angle of the input device 823 relative to the drawing / writing surface and the value 812-1 of the characteristic 814 are the same, but because the orientations of markers 816-1, 816-2, and 816-3 are different, the thicknesses of markers 816-1, 816-2, and 816-3 are different. Figure 8E As shown, the mark 816-1 drawn in the downward motion is thicker than the mark 816-2 drawn in the horizontal motion, and the marks 816-1 and 816-2 are thicker than the mark 816-3 drawn in the upward motion.

[0325] In some embodiments, in response to input comprising a bending motion of the input device 823 along the writing / drawing surface, the electronic device 500 renders a mark having a thickness that varies along each segment of the mark according to the direction of the motion of the input device 823 in drawing each respective segment, as described below with reference to Figures 8I to 8K Described in more detail. In some embodiments, in response to an input comprising diagonal movement of the input device 823 along the writing / drawing surface, the electronic device 500 presents a mark having a thickness that depends on the vertical component of the movement. For example, if the angle of the input device 823 and the value of the characteristic 812 are the same for two marks, a mark drawn with a diagonal downward motion will be thicker than a mark drawn with a diagonal upward motion. As another example, if the angle of the input device 823 and the value of the characteristic 812 are the same for two marks, a mark drawn with a diagonal downward motion in which the downward motion is greater than the horizontal motion will be thicker than a mark drawn with a diagonal downward motion in which the horizontal motion is greater than the downward motion.

[0326] In some embodiments, the electronic device 500 displays the thickest markings in response to upward movement of the input device 823 along the writing / drawing surface, and displays the thinnest markings in response to downward movement of the input device 823 along the writing / drawing surface. In some embodiments, the electronic device 500 displays markings of the same width in response to downward or upward movement of the input device 823 along the writing / drawing surface, and varies the thickness of horizontal markings depending on whether the markings are drawn with a left-to-right or right-to-left motion of the input device 823 along the writing / drawing surface.

[0327] As described above, in some embodiments, the thickness of the indicia displayed by the electronic device 500 depends on the value of the characteristic 812. Figure 8F The example shows that the characteristic 812 has Figures 8A to 8E The electronic device 500 is shown with the markers 816-1, 816-2, and 816-3 drawn when the value 814-1 is illustrated. Figure 8F , when property 812 has a value of 814-2 and the angle of input device 823 relative to the writing / drawing surface is the same as the angle of input device 823 when creating marks 816-1, 816-2, and 816-3, electronic device 500 receives input including an upward movement of input device 823. Figure 8F For the illustrated input, the electronic device 500 displays a mark having a smaller thickness than the mark 816-3, such as Figure 8G shown.

[0328] Figure 8G The electronic device 500 is shown in response to Figure 8F 816-4 is displayed using the illustrated input. Both marker 816-3 and marker 816-4 were drawn with the input device 823 at the same angle relative to the writing / drawing surface by moving the input device 823 upward along the writing / drawing surface, but marker 816-4 is thinner than marker 816-3 because property 812 has a value 814-2 when marker 816-4 is drawn, which is less than the value 814-1 of property 812 when marker 816-3 is drawn. Thus, in some embodiments, the thickness of the marker displayed by the electronic device 500 depends on the value of property 812.

[0329] like Figure 8G As shown, when characteristic 812 has a value 814-2 that is the same as the value 814-2 of characteristic 812 when mark 816-4 was drawn and the angle of input device 823 relative to the writing / drawing surface is vertical compared to the angle of input device 823 relative to the writing / drawing surface when mark 816-4 was drawn, electronic device 500 receives input including an upward movement of input device 823. Figure 8G The electronic device 500 displays the input as shown. Figure 8H Marking shown.

[0330] Figure 8H The electronic device 500 is shown in response to Figure 8G 816-5 is displayed by the input device 823 as illustrated. Both marker 816-4 and marker 816-5 were drawn with the input device 823 moving upward along the writing / drawing surface at the value 814-2 of the characteristic 812, but marker 816-5 is thinner than marker 816-4 because the angle of the input device 823 relative to the writing / drawing surface when drawing marker 816-5 is more vertical than when drawing marker 816-4. Thus, in some embodiments, the thickness of the marker displayed by the electronic device 500 depends on the angle of the input device 823 relative to the writing / drawing surface.

[0331] In some embodiments, the thickness of the marking displayed by the electronic device 500 depends on the direction of movement of the input device 823 when drawing the marking, the value of the characteristic 812, and the angle of the input device 823 relative to the writing / drawing surface. In some embodiments, these characteristics affect the thickness of the marking, as shown in Table 1 below:

[0332] Relatively thin markings Relatively medium mark Relatively thick markings Move up Horizontal movement Move down Low value of characteristic 812 The value of the middle characteristic 812 High value of characteristic 812 More vertical input device 823 angle Medium input device 823 angle More horizontal input device 823 angle

[0333] Table 1

[0334] Because the thickness of a marker depends on multiple characteristics of the input that caused the display of the marker, in some cases, the relative thickness of two markers may not correspond to the relative value of one of these characteristics if one or more other characteristics correspond to different relative thicknesses of the two markers. For example, if a first upward marker is drawn with a high value of characteristic 812 and / or a relatively horizontal angle of the input device 823, and a second downward marker is drawn with a low value of characteristic 812 and / or a relatively vertical angle of the input device 823, the upward marker may have a greater thickness than the downward marker. As another example, if a first marker is drawn with a downward movement of the input device 823 and / or a relatively horizontal angle, and a second marker is drawn with an upward movement of the input device 823 and / or a relatively vertical angle, the first marker drawn with a relatively low value of characteristic 812 may be thicker than the second marker drawn with a relatively high value of characteristic 812. As another example, if a first marker is drawn with a downward movement and / or a relatively high value for characteristic 812, and a second marker is drawn with an upward movement and / or a relatively low value for characteristic 812, the first marker drawn at a relatively vertical angle of the input device 823 may be thicker than the second marker drawn at a relatively horizontal angle of the input device 823.

[0335] In some embodiments, because the thickness of a mark depends on the direction in which the mark is drawn, two marks with the same shape may have different thickness profiles if they are drawn in different directions. For example, a shape drawn clockwise will have a different thickness profile than a shape drawn counterclockwise, as shown in FIG. Figures 8I to 8K As stated.

[0336] exist Figure 8I , the electronic device 500 receives input comprising a clockwise movement of the input device 823 along the writing / drawing surface when the characteristic 812 has a value 814-2. In some embodiments, the input device 823 starts and ends at the same location, thereby creating a closed circular shape. In response to Figure 8I The electronic device 500 displays the input as shown. Figure 8J The shape shown.

[0337] Figure 8J The electronic device 500 is shown in response to Figure 8I The illustrated input displays shape 816-6. Shape 816-6 includes a relatively thick segment 818-3 drawn when the input device 823 moves downward, a relatively thin segment 818-4 drawn when the input device 823 moves upward, and medium segments 818-1 and 818-2 drawn when the input device 823 moves horizontally. Figure 8J As shown, the thickness of shape 816-6 varies between segments 818-1, 818-2, 818-3, and 818-4, depending on the proportions of the vertical and horizontal components of the movement of input device 823 as the various locations of shape 816-6 are being drawn and whether the vertical portion is being drawn upward or downward.

[0338] like Figure 8J As shown, when the angle of input device 823 and the value 814-2 of characteristic 812 are the same as when shape 816-6 was drawn, electronic device 500 receives input comprising counterclockwise movement of input device 823 along the writing / drawing surface. In some embodiments, input device 823 starts and ends at the same position, thereby creating a closed circular shape. In some embodiments, Figure 8J The profile of the movement of input device 823 in is the same as the profile of the movement of input device 823 when drawing shape 816-6, but the movement of input device 823 is in the opposite direction (e.g., counterclockwise as opposed to clockwise). Figure 8J As shown in the input, the electronic device 500 displays Figure 8K The shape shown.

[0339] Figure 8K The electronic device 500 is shown in response to Figure 8J The illustrated input displays shape 816-7. Shape 816-7 includes a relatively thick segment 820-4 drawn when the input device 823 moves downward, a relatively thin segment 820-3 drawn when the input device 823 moves upward, and medium segments 820-1 and 820-2 drawn when the input device 823 moves horizontally. Figure 8K As shown, the thickness of shape 816-7 varies between segments 820-1, 820-2, 820-3, and 820-4 depending on the proportions of the vertical and horizontal components of the movement of input device 823 and whether the vertical portion is drawn upward or downward when the various locations of shape 816-6 are being drawn.

[0340] like Figure 8KAs shown, although shapes 816-6 and 816-7 have the same outline, the thickness of the outlines of shapes 816-6 and 816-7 is different because shapes 816-6 and 816-7 are drawn in different directions. For example, shape 816-6 has a thick portion 818-3 on the right, while shape 816-7 has a thick portion 820-4 on the left because shape 816-6 was drawn in a clockwise direction and had a downward shift on the right, while shape 816-7 was drawn in a counterclockwise direction and had a downward shift on the left. As another example, shape 816-6 has a thin portion 818-3 on the left, while shape 816-7 has a thin portion 820-4 on the right because shape 816-6 was drawn in a clockwise direction and had an upward shift on the left, while shape 816-7 was drawn in a counterclockwise direction and had an upward shift on the right.

[0341] 9A to 9D is a flow chart illustrating an exemplary method of presenting a marker having a thickness that depends on the direction in which the drawing input is received according to some embodiments of the present disclosure. Method 900 is optionally performed at an electronic device such as device 100, device 300, device 500, device 501, device 510, and device 591, as described above with reference to Figure 1A to Figure 1B 、 Figures 2 to 3 、 Figures 4A to 4B and 5A to 5I Some operations in method 900 may be optionally combined, and / or the order of some operations may be optionally changed.

[0342] As described below, method 900 provides for interacting with an analog marker, including modifying the width of the analog marker based on the direction in which the analog marker is drawn. This method reduces the cognitive burden on a user when interacting with the device user interface of the present disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charges.

[0343] In some embodiments, method 900 is performed at an electronic device (e.g., 500) that communicates with a display generation component (e.g., 504) and one or more input devices (e.g., 504 and / or 823), such as at Figure 8A For example, the electronic device is the electronic device described above with reference to method 700. In some embodiments, the display generation component is the display generation component described above with reference to method 700.

[0344] In some embodiments, the electronic device (e.g., 500) displays (901a) a user interface (e.g., 800) including a content entry area (e.g., 802) (e.g., a canvas area) via a display generation component (e.g., 504), such as in Figure 8A In some embodiments, the user interface is a user interface described with respect to methods 1100 and / or 1300. In some embodiments, the content entry area is an area of ​​the user interface in which the computer system displays a drawing and / or handwriting in response to a drawing and / or handwriting input detected using one or more input devices. For example, the computer system uses a stylus, an electronic pencil, or similar input device and / or a touch-sensitive surface (such as a touchpad, tablet computer, or touch screen for the content entry area) to detect drawing and / or handwriting. In some embodiments, the content entry area has a simulated paper background, such as an empty background, a line background, a dot background, or a grid background. For example, the user interface is a user interface of a note-taking application or a drawing application. In some embodiments, the content entry area is a document including text, images, tables, and / or charts. For example, the user interface is a user interface of a document reading and / or editing application, and the handwriting and / or drawing are markups on the document.

[0345] In some embodiments, while displaying a user interface (e.g., 800) (901b) including a content entry area (e.g., 802), the electronic device (e.g., 500) receives (902c) drawing input for the content entry area (e.g., 802) via one or more input devices, such as in Figure 8A In some embodiments, such as Figure 8A In some embodiments, the drawing input is provided by an object such as a stylus (e.g., 823), a digital pen, or similar input device, or a part of the user's body (e.g., a finger). In some embodiments, the electronic device uses an input device (such as a touch-sensitive surface or other surface, including one of the touch-sensitive surfaces described above) to detect the position of an object or a part of an object (e.g., the tip of a stylus). In some embodiments, detecting the drawing input includes detecting movement of the object while the object is in contact with or within a threshold distance (e.g., 0.05 cm, 0.1 cm, 0.2 cm, 0.3 cm, 0.5 cm, 1 cm, 2 cm, 3 cm, or 5 cm) of the touch-sensitive surface or other surface. In some embodiments, the surface with which the object interacts and / or contacts as part of the drawing input is a touch-sensitive surface, a physical surface onto which the user interface is projected, or a virtual surface corresponding to at least a portion of the user interface.

[0346] In some embodiments, while displaying a user interface (e.g., 800) (901b) including a content entry area (e.g., 802), in response to receiving a drawing input (901d), the drawing input includes movement in a first direction (such as in a first direction) along a first axis of a surface (e.g., a display, a touch-sensitive display, or a touch-sensitive surface). Figure 8A), the electronic device (e.g., 500) displays (901e) a representation (e.g., 816-1) of the drawing input in the content entry area (e.g., 802) via the display generation component (e.g., 504) according to the movement in the first direction along the first axis, wherein the representation (e.g., 816-1) of the drawing input includes a first portion aligned with the first axis and having a first line thickness, such as Figure 8C In some embodiments, the representation of the drawing input includes a mark at the location where a portion of the first input device moves during movement of the first input device. For example, the representation of the drawing input includes a mark on the touch screen at the location where the tip of the stylus moves when the electronic device detects the drawing input. In some embodiments, the movement of the object includes movement in a first direction and movement in another direction orthogonal to the first axis. For example, the first axis is vertical and the other direction is right or left. As another example, the first axis is horizontal and the other direction is up or down.

[0347] In some embodiments, while displaying a user interface (e.g., 800) (901b) including a content entry area (e.g., 802), in response to receiving a drawing input (901d), the drawing input includes movement along a first axis of a surface (e.g., 504) in a second direction different from the first direction (such as in Figure 8DIn some embodiments, the electronic device (e.g., 500) displays (901f) a representation of the drawing input (e.g., 816-3) in the content entry area (e.g., 802) via the display generation component (e.g., 504) according to the movement in the second direction along the first axis, wherein the representation of the drawing input (e.g., 816-3) includes a second portion aligned with the first axis and having a second line thickness different from the first line thickness. In some embodiments, the first direction is up, the second direction is down, and the axis is a vertical axis. In some embodiments, the first direction is left, the second direction is right, and the axis is a horizontal axis. In some embodiments, the movement of the input device includes movement in the second direction and movement in another direction orthogonal to the first axis in a manner similar to that described above. In some embodiments, the representation of the drawing input includes a portion drawn in the first direction with a first line thickness and a portion drawn in the second direction with a second line thickness. In some embodiments, the first line thickness is greater than the second line thickness. In some embodiments, the second line thickness is greater than the first line thickness. In some embodiments, the drawing input has one or more additional characteristics that affect the width of the representation of the drawing input, such as force, speed, and / or thickness and / or the type of simulated pen tip selected when the drawing input is received. In some embodiments, in response to receiving a first drawing input including one or more additional characteristics having a first value that includes movement of a first input device in a first direction, the electronic device displays a representation of the drawing input including a first portion having a first line thickness. In some embodiments, in response to receiving a second drawing input including one or more additional characteristics having a first value that includes movement of the first input device in a second direction, the electronic device displays a representation of the drawing input including a second portion having a second line thickness. In some embodiments, if the one or more additional characteristics of the first and second drawing inputs have the same value, but the first drawing input includes movement in the first direction and the second drawing input includes movement in the second direction, then the representation of the first drawing input and the second drawing input have different thicknesses because they include movement in the first direction or the second direction, respectively.

[0348] Displaying representations of drawing input with varying line thicknesses depending on the direction in which the drawing is drawn enhances user interaction with a computer system by providing an efficient way to create drawings and / or handwriting with varying line thicknesses with fewer drawing strokes, and therefore input.

[0349] In some embodiments, such as Figure 8EIn some embodiments, the electronic device receives one or more drawing inputs that include a movement component on both the vertical axis and the horizontal axis, such as a diagonal movement. In some embodiments, in response to receiving a drawing input that includes a diagonal movement, the electronic device displays a representation of the drawing input with a line thickness corresponding to the movement component. For example, the representation of a drawing input that includes a downward diagonal movement is thicker than the representation of a drawing input that includes an upward diagonal movement. Displaying a vertical line drawn with a downward movement as thicker than a vertical line drawn with an upward movement enhances user interaction with the electronic device by reducing the number of inputs required to create a simulated calligraphy effect.

[0350] In some embodiments, in response to receiving a drawing input (904a), the drawing input includes movement in a third direction along a second axis orthogonal to the first axis (such as in Figure 8C In some embodiments, the electronic device (e.g., 500) displays (904b) a representation of the drawing input (e.g., 816-2) in the content entry area based on the movement in the third direction along the second axis, wherein the representation of the drawing input (e.g., 816-2) includes a third portion aligned with the second axis and having a third line thickness that is different from the first line thickness and the second line thickness. In some embodiments, the first axis is a vertical axis and the second axis is a horizontal axis. In some embodiments, in response to receiving a drawing input that includes a diagonal movement, the electronic device displays the representation of the drawing input with a line thickness corresponding to the movement component, as described above with reference to at least step 904a. For example, the representation of a drawing input that includes a downward diagonal movement that is more vertical than horizontal is thicker than the representation of a drawing input that includes a downward diagonal movement that is more horizontal than vertical. In some embodiments, the first axis is a horizontal axis and the second axis is a vertical axis. Displaying the representation of the drawing input that includes movement along the second axis at the third thickness enhances user interaction with the electronic device by reducing the input required to create a simulated calligraphy effect.

[0351] In some embodiments, such as Figure 8EIn some embodiments, in response to receiving a drawing input that includes a diagonal movement, the electronic device displays a representation of the drawing input with a line thickness corresponding to the movement component, as described above with reference to at least step 904a. For example, the representation of a drawing input that includes a downward diagonal movement that is more vertical than horizontal is thicker than the representation of a drawing input that includes a downward diagonal movement that is more horizontal than vertical, and the representation of a drawing input that includes a downward diagonal movement that is more horizontal than vertical is thicker than the representation of a drawing input that includes an upward diagonal movement. Displaying the representation of the drawing input that includes movement along the second axis at a third thickness between the first thickness and the second thickness enhances user interaction with the electronic device by reducing the input required to create a simulated calligraphy effect.

[0352] In some embodiments, a first portion of a representation of a drawing input (e.g., 816-1) is displayed (such as in Figure 8C ) includes an animation (908a) showing a first portion of a representation (e.g., 816-1) of a drawing input expanding from having a line thickness less than a first line thickness to having the first line thickness (such as in Figure 8B In some embodiments, the animation begins while the drawing input is still being detected. For example, while the second portion of the drawing input is still being received, the electronic device displays an animated expansion of a portion of the representation of the drawing input that corresponds to the portion of the drawing input that has been received. In some embodiments, the electronic device displays a first portion of the representation of the drawing input at a first line thickness while still displaying the animation of the second portion of the representation of the first drawing input.

[0353] In some embodiments, a second portion of the representation of the drawing input (e.g., 816-3) is displayed (such as in Figure 8E ) includes an animation (908b) showing a second portion of the representation of the drawing input (e.g., 816-3) expanding from a line thickness that is less than the second line thickness to having the second line thickness. In some embodiments, the thickness of the first portion of the representation at the start of the animation is the same as the thickness of the second portion of the representation at the start of the animation, even if the first line thickness and the second line thickness are different. In some embodiments, if the first line thickness is greater than the second line thickness, the thickness of the first portion of the representation at the start of the animation is greater than the thickness of the second portion of the representation at the start of the animation. In some embodiments, if the first line thickness is less than the second line thickness, the thickness of the first portion of the representation at the start of the animation is less than the thickness of the second portion of the representation at the start of the animation.

[0354] Animating the increase in line thickness of a representation of drawing input over time enhances user interaction with a computer system by providing enhanced visual feedback to the user.

[0355] In some embodiments, in response to receiving a drawing input (910a), the drawing input includes applying a first amount (e.g., 814-1) of pressure (e.g., characteristic 812) to the surface (e.g., 504) to move in a corresponding direction (e.g., Figure 8D ), the electronic device (e.g., 500) displays (910b) a representation (e.g., 816-3) of the drawing input via the display generation component (e.g., 504) according to the movement in the corresponding direction, wherein the representation (e.g., 816-3) of the drawing input includes a third portion having a third line thickness, such as Figure 8E In some embodiments, the electronic device detects the pressure of the drawing input using one or more sensors of a touch-sensitive surface and / or one or more sensors of a stylus or other input device with which the user "draws."

[0356] In some embodiments, in response to receiving a drawing input (910a), the drawing input includes movement in a corresponding direction (such as in Figure 8F ), the electronic device (e.g., 500) displays (910c) a representation (816-4) of the drawing input via the display generation component (e.g., 504) according to the movement in the corresponding direction, wherein the representation (e.g., 816-4) of the drawing input includes a fourth portion having a fourth line thickness different from the third line thickness, such as Figure 8GIn some embodiments, if the second amount of pressure is greater than the first amount of pressure, the fourth line thickness is greater than the third line thickness. In some embodiments, if the second amount of pressure is greater than the first amount of pressure, the fourth line thickness is less than the third line thickness. In some embodiments, the line thickness of the representation of the drawing input depends on the pressure included in the drawing input and the direction of the movement included in the drawing input. For example, in response to detecting that the drawing input includes movement in a first direction with a first pressure, the line thickness is the first line thickness; in response to detecting that the drawing input includes movement in the first direction with a second pressure greater than the first pressure, the line thickness is thicker than the first line thickness; and in response to detecting that the drawing input includes movement in the first direction with a third pressure less than the first pressure, the line thickness is less than the first line thickness. As another example, in response to detecting that the drawing input includes movement in a second direction with the first pressure, the line thickness is the second line thickness; in response to detecting that the drawing input includes movement in the second direction with a second pressure greater than the first pressure, the line thickness is thicker than the second line thickness; and in response to detecting that the drawing input includes movement in the second direction with the third pressure less than the first pressure, the line thickness is less than the second line thickness. Varying the line thickness of the representation of the drawing input based on the pressure of the drawing input enhances user interaction with the computer system by providing additional controls for varying the thickness of the representation of the drawing input without requiring interaction with displayed options.

[0357] In some embodiments, in response to receiving a drawing input (912a), the drawing input includes moving the object (e.g., 823) in a corresponding direction (such as at a first angle) relative to the surface (e.g., 504). Figure 8F ), the electronic device (e.g., 500) displays (912b) a representation (e.g., 816-4) of the drawing input via the display generation component (e.g., 504) according to the movement in the corresponding direction, wherein the representation (e.g., 816-4) of the drawing input includes a third portion having a third line thickness, such as Figure 8G In some embodiments, the electronic device detects the angle of the object using one or more sensors in the touch-sensitive surface, one or more cameras, and / or one or more sensors included in the object (e.g., a stylus). Figure 8F , the angle is the angle between the stylus (eg, 823) that the user is using to write / draw and the surface (eg, 504) that is the writing / drawing surface.

[0358] In some embodiments, in response to receiving a drawing input (912a), the drawing input includes moving the object (e.g., 823) in a corresponding direction (e.g., at a second angle relative to the surface (e.g., 504) that is different from the first angle. Figure 8G), the electronic device (e.g., 500) displays (912c) a representation (e.g., 816-5) of the drawing input via the display generation component (e.g., 504) according to the movement in the corresponding direction, wherein the representation (e.g., 816-5) of the drawing input includes a fourth portion having a fourth line thickness different from the third line thickness, such as Figure 8H In some embodiments, if the first angle is greater than the second angle, the third line thickness is thinner than the fourth line thickness. In some embodiments, if the first angle is greater than the second angle, the third line thickness is thicker than the fourth line thickness. For example, in response to detecting that the drawing input includes movement in a first direction while the object is at a first angle, the line thickness is the first line thickness; in response to detecting that the drawing input includes movement in the first direction at an angle less than the first angle, the line thickness is thicker than the first line thickness; and in response to detecting that the drawing input includes movement in the first direction while the object is at an angle greater than the first angle, the line thickness is less than the first line thickness. As another example, in response to detecting that the drawing input includes movement in a second direction while the object is at a second angle, the line thickness is the second line thickness; in response to detecting that the drawing input includes movement in the second direction while the object is at an angle less than the second angle, the line thickness is thicker than the second line thickness; and in response to detecting that the drawing input includes movement in the second direction while the object is at an angle greater than the second angle, the line thickness is less than the second line thickness. Changing the line thickness of the representation of the drawing input based on the angle of the object during the drawing input enhances user interaction with the computer system by providing additional controls for changing the thickness of the representation of the drawing input without requiring interaction with displayed options.

[0359] In some embodiments, in response to receiving a drawing input (914a), a determination is made based on the drawing input including movement along a contour corresponding to a shape (e.g., at a first speed, pressure, and angle between the object and the surface), wherein the movement follows the contour in a first corresponding direction, such as in Figure 8I In the embodiment of the present invention, the electronic device (e.g., 500) displays (914b) via the display generation component (e.g., 504) a first representation of a shape (e.g., 816-6) corresponding to the drawing input, wherein the first representation of the shape (e.g., 816-6) has a first visual appearance, such as in Figure 8J In some embodiments, the visual appearance includes how the thickness of the line of the representation changes as the position along the representation changes. For example, Figure 8KIn some embodiments, the first visual appearance of the representation 816-6 includes a thick portion 818-3 along the right side of the representation 816-6 and a thin portion 813-4 along the left side of the representation 816-6 connected by intermediate portions 818-1 and 818-2 along the top and bottom of the representation 816-6, respectively. In some embodiments, the shape is a circle, an oval, a square, a triangle, or a star. In some embodiments, the shape includes a curve. In some embodiments, the shape includes a straight line. In some embodiments, the first corresponding direction is clockwise or counterclockwise.

[0360] In some embodiments, in response to receiving a drawing input (914a), a determination is made based on the drawing input including movement along a contour corresponding to a shape (e.g., at a first speed, pressure, and angle between the object and the surface), wherein the movement follows the contour in a second corresponding direction different from the first corresponding direction, such as in Figure 8J In the embodiment of the present invention, the electronic device (e.g., 500) displays (914c) via the display generation component (e.g., 504) a second representation of the shape (e.g., 816-7) corresponding to the drawing input, wherein the second representation of the shape (e.g., 816-7) has a second visual appearance different from the first visual appearance, such as in Figure 8K For example, Figure 8K 816-7 includes a thin portion 820-3 along the right side of representation 816-7 and a thick portion 820-4 along the left side of representation 816-7 connected by intermediate portions 820-1 and 820-2 along the top and bottom of representation 816-7, respectively. In some embodiments, the portion of the shape drawn in the first direction has a first line thickness, and the portion of the shape drawn in the second direction has a second line thickness, so that if the shape is drawn clockwise, the different portions will have the first thickness and the second thickness, respectively, and the same will be true if the shape is drawn counterclockwise. In some embodiments, the first corresponding direction is clockwise or counterclockwise. Displaying representations of drawing input with different visual appearances depending on the direction in which the shape is drawn enhances user interaction with the computer system by reducing the input required to create simulated calligraphy effects.

[0361] In some embodiments, such as Figure 8K , the first representation of the shape (e.g., 816-6) includes a right portion of the first representation of the shape (e.g., 818-3) having a third line thickness and a left portion of the first representation of the shape (e.g., 816-6) having a fourth line thickness greater than the third line thickness (916a). Figure 8KRepresentation 816-7 in has the line thickness profile described above with reference to step 916c. In some embodiments, the shape is a circle, and the right portion includes the portion of the circle having the vertical line on the right side of the circle, and the left portion includes the portion of the circle having the vertical line on the left side of the circle.

[0362] In some embodiments, such as Figure 8K , the second representation of the shape (e.g., 816-7) includes a right portion (e.g., 816-3) of the second representation of the shape (e.g., 820-7) having a fourth line thickness and a left portion (e.g., 820-4) of the second representation of the shape (e.g., 816-7) having a third line thickness (916b). Figure 8K The representation 816-6 in FIG. 816-6 has the line thickness profile described above with reference to step 916b. In some embodiments, the shape is a circle, and the right portion includes the portion of the circle having the vertical line on the right side of the circle, and the left portion includes the portion of the circle having the vertical line on the left side of the circle. Displaying the representation of the drawing input with different line thickness profiles depending on the direction in which the shape is drawn enhances user interaction with the computer system by reducing the input required to create a simulated calligraphy effect.

[0363] In some embodiments, such as Figure 8A In some embodiments, when a calligraphy tool (e.g., 808-4) is selected in a user interface element (e.g., 810) in a user interface (e.g., 800) that includes multiple representations of drawing tools used in a drawing input (e.g., 808-1 to 808-4), a drawing input is received (918a). In some embodiments, the user interface element has one or more characteristics described below with reference to method 1300. In some embodiments, the user interface element includes multiple drawing tools, including the drawing tools described with reference to methods 700, 1100, and / or 1300. In some embodiments, in response to detecting selection of a different drawing tool that does not include a representation of the drawing input that is displayed with different line thicknesses depending on the direction of movement included in the drawing input, the electronic device displays representations of subsequent drawing inputs with line thicknesses that are independent of the direction of movement included in the drawing input. For example, if a drawing tool other than the calligraphy tool is selected when receiving the drawing input, the line thickness will be the same regardless of whether the movement along the first axis is in the first direction or the second direction. Providing a simulated calligraphic effect in response to selecting a calligraphy tool in a user interface element enhances user interaction with a computer system by reducing input required to create the simulated calligraphic effect and providing an efficient way to stop creating the simulated calligraphic effect.

[0364] It should be understood that 9A to 9DThe particular order in which the operations are described in the description is merely exemplary and is not intended to indicate that the order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize many ways to reorder the operations described herein. Additionally, it should be noted that the details of other processes described herein with respect to other methods described herein (e.g., methods 700, 1100, and / or 1300) also apply in a similar manner to the details of the processes described above with respect to 9A to 9D Method 900 is described. For example, the operation of the electronic device displaying a marker having a varying width as described above with reference to method 900 optionally includes one or more of the following features described herein with reference to other methods described herein (e.g., methods 700, 1100, and / or 1300): entering text into a text entry area, displaying merge and overlap markers, and / or manipulating a content entry palette. For the sake of brevity, these details are not repeated here.

[0365] The operations in the above information processing method are optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (e.g., a processor in combination with a processor). Figure 1A to Figure 1B 、 Figure 3 、 5A to 5I In addition, the above reference 9A to 9D The operation is optionally performed by Figure 1A to Figure 1B 170, and / or 901f, and / or the receiving operation 901c are optionally implemented by the event classifier 170, the event identifier 180, and the event handler 190. When a corresponding predefined event or sub-event is detected, the event identifier 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally utilizes or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, a person of ordinary skill in the art will clearly understand how to update the content displayed by the application based on the event classifier 170. Figure 1A to Figure 1B The components depicted in the implementation of other processes.

[0366] Merging and overlapping simulation markers

[0367] Users interact with electronic devices in a variety of different ways. In some embodiments, the electronic device presents a marker in the content entry area in response to detecting a drawing input provided by the user. The embodiments described below provide ways for a computer system to display a marker that is merged with or overlaps an existing marker, depending on how much time has passed between receiving the input corresponding to the marker. Enhanced interaction with the device reduces the amount of time required for the user to perform an action, thereby reducing the power consumption of the device and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, that person is optionally referred to as a user of the device.

[0368] Figures 10A to 10P The embodiments in these figures are used to illustrate the process described below, including reference to Figures 11A to 11K Describe the process.

[0369] Figure 10A The electronic device 500 is illustrated displaying a user interface 1000 of a content creation application, the user interface including a content entry area 1002 and a menu 1004. In some embodiments, the content creation application and user interface 1000 are similar to the content creation application and user interface described above with reference to method 900. In some embodiments, the input device 1023 is similar to the input devices described above with reference to methods 900 and / or 1100.

[0370] The menu 1004 of the user interface 1000 includes options for defining settings for a markup created in response to detecting input provided by the input device 1023. The menu 1004 optionally has one or more features in common with the menus described with reference to methods 700, 900, and / or 1300. For example, the menu 1004 includes an undo option 1006-1, a redo option 1006-2, multiple tool options 1008-1, 1008-2, 1008-3, and 1008-4, a keyboard option 1011a, and an option 1011a for displaying additional menus. In some embodiments, these options function similarly to the options described above with reference to method 900.

[0371] like Figure 10AAs shown, the brush tool 1008-4 is active in the content creation application. In some embodiments, in response to receiving input comprising movement of the input device 1023 along a surface (e.g., the surface of the touch screen 504), the electronic device 500 displays a simulated watercolor brush mark. In some embodiments, the watercolor brush mark comprises simulated water and simulated paint that spreads within an area of ​​the content entry area 1002 having a simulated "wet" property (referred to herein as "wet" due to simulated water). In some embodiments, the amount of simulated water and simulated ink displayed in response to the input depends on characteristics 1012, such as the value of the velocity or pressure applied by the input device 1023 when the input is detected.

[0372] exist Figure 10A , when the brush tool 1008-4 is selected and when the property 1012 has a value 1014-1, the electronic device 500 detects an input comprising movement of the input device 1023 along the writing / drawing surface. Figure 10A The electronic device 500 presents the input FIG. 10B...

Claims

1. A method comprising: At an electronic device in communication with a display generating component and one or more input devices: displaying the document via the display generation component; While displaying the document, detecting a first input to the document via the one or more input devices; as well as In response to detecting the first input: When the document is in a corresponding operation mode, based on determining that the first input is for a first position within a first threshold distance of a first text entry area in the document, wherein the first text entry area does not include a text entry field, displaying a first text entry field at a corresponding position based on the first text entry area in the document via the display generation component, wherein the corresponding position is within the first threshold distance of the first text entry area; as well as When the document is in the corresponding operation mode, based on determining that the first input is directed to a second position different from the first position and located within the first threshold distance of the first text entry area in the document, The first text entry field is displayed at the corresponding position in the document.

2. The method according to claim 1, further comprising: In response to detecting the first input: Based on determining that the first input is for a third location different from the first location and the second location that is within a second threshold distance of an existing text entry field, a process for entering text into the existing text entry field is initiated.

3. The method according to any one of claims 1 to 2, further comprising: In response to detecting the first input: Based on determining that the first input is for a third position different from the first position and the second position and located within the first threshold distance of a second text entry area different from the first text entry area, a second text entry field is displayed at a second corresponding position based on the second text entry area in the document via the display generation component, wherein the second corresponding position is located within the first threshold distance of the second text entry area.

4. The method according to claim 3, wherein: In response to detecting an input corresponding to a request to enter text into the first text entry field, the electronic device displays first text in the first text entry field with a corresponding characteristic having a first value; and In response to detecting input corresponding to a request to enter text into the second text entry field, the electronic device displays second text in the second text entry field with the corresponding characteristic having the first value.

5. The method according to any one of claims 1 to 4, wherein: The document is associated with a setting of the text corresponding to a respective property having a first value; and In response to detecting input corresponding to a request to enter text into the first text entry field, the electronic device displays first text in the first text entry field with the corresponding characteristic having the first value.

6. The method according to any one of claims 1 to 5, wherein the document comprises a second text entry field, the second text entry field comprising the respective text in the respective property having the first value, the method further comprising: detecting, via the one or more input devices, a second input corresponding to a request to enter text into the first text entry field while displaying the first text entry field at the corresponding position in accordance with the first input; in response to detecting the second input, displaying, via the display generation component, first text in the first text entry field with the corresponding characteristic having the first value in accordance with the second input; while the first text is displayed in the first text entry field with the corresponding characteristic having the first value, detecting, via the one or more input devices, a third input corresponding to a request to display the first text with the corresponding characteristic having a second value different from the first value; as well as In response to detecting the third input: displaying, via the display generation component, the first text in the first text entry field with the corresponding property having the second value; as well as The corresponding text is displayed in the second text entry field with the corresponding property having the second value via the display generation component.

7. The method according to any one of claims 1 to 6, wherein the first text entry area is determined to be a text entry area based on an evaluation of one or more visual elements of the document.

8. The method according to claim 7, wherein: The one or more visual elements of the document include a first graphic line; and The first text entry area is placed by the electronic device at a location in the user interface that has a predetermined spatial relationship with a graphic line in the document.

9. The method according to any one of claims 7 to 8, wherein: The evaluation of the one or more visual elements of the document includes a determination of whether the document includes one or more text entry areas of a first type; and The first text entry area is of a second type different from the first type.

10. The method according to any one of claims 7 to 9, wherein: The first text entry field is displayed at a first size based on a corresponding size of the first text entry area.

11. The method according to claim 10, wherein: the respective size of the first text entry area comprises a respective length based on an available length in the document at a location of the text entry area in the document; The first size of the first text entry field comprises a first length; and The first length is based on the corresponding length.

12. The method according to any one of claims 10 to 11, wherein: the respective size of the first text entry area comprises a respective height based on an available height in the document at a location of the text entry area in the document; The first size of the first text entry field includes a first height; and The first height is based on the corresponding height.

13. The method according to any one of claims 10 to 12, wherein: The first size of the first text entry field includes a first height, the first height being set based on a font size of text in the first text entry field.

14. The method according to any one of claims 1 to 13, wherein the document includes a second text entry area, the method further comprising: Before detecting the first input and while the document is in the corresponding operating mode: Based on determining that the second text entry area includes a text entry field of a first type, displaying the second text entry area with a first visual characteristic having a first value via the display generation component; as well as Based on determining that the second text entry area does not include a text entry field of the first type, displaying the second text entry area with the first visual characteristic having the first value is abandoned.

15. The method according to claim 14, further comprising: detecting input to the second text entry area via the one or more input devices while the second text entry area is displayed and while the document is in a corresponding operation; as well as In response to detecting the input: Based on determining that the second text entry area includes a text entry field of the first type, displaying, via the display generation component, one or more user interface objects selectable to enter suggested text into the second text entry field; And based on determining that the second text entry area does not include the first type of text entry field, abandoning displaying the one or more user interface objects.

16. The method according to any one of claims 1 to 15, further comprising: In response to detecting the first input: when the document is not in the corresponding operation mode, based on determining that the first input is for the first position within the first threshold distance of the first text entry area in the document, abandoning displaying the first text entry field at the corresponding position in the document; as well as When the document is not in the corresponding operation mode, based on determining that the first input is for the second position within the first threshold distance of the first text entry area, displaying the first text entry field at the corresponding position is abandoned.

17. The method according to any one of claims 1 to 16, further comprising: In response to detecting the first input: When the document is in the corresponding operation mode, based on determining that the first input is directed to a third position different from the first position and the second position and within the first threshold distance of any text entry area in the document, the first text entry area is displayed at a second corresponding position in the document via the display generation component, wherein the second corresponding position is different from the corresponding position, is based on the third position and is independent of the structure of the document.

18. The method according to any one of claims 1 to 17, further comprising: detecting, via the one or more input devices, a second input corresponding to a request to enter text into the first text entry field while displaying the first text entry field at the corresponding position in accordance with the first input; as well as In response to detecting the second input: displaying, via the display generating component, a first user interface object selectable to enter first suggested text of the first type into the first text entry field based on determining that the second input includes a selection of a first option selectable to generate suggested text for entry into the first text entry field and that the first text entry field is associated with text of a first type; as well as Based on determining that the second input includes a selection of the first option that can be selected to generate suggested text for entry in the first text entry field and that the first text entry field is associated with a second type of text that is different from the first type of text, a second user interface object that can be selected to enter second suggested text of the second type into the first text entry field is displayed via the display generation component, wherein the first suggested text is different from the second suggested text.

19. The method of claim 18, wherein whether the first text entry field is associated with the first type of text or the second type of text is based on a context of the first text entry area within the document.

20. The method of any one of claims 18 to 19, wherein the document includes a second text entry field that shares at least one characteristic with the first text entry field, the method further comprising: while displaying the first user interface object in accordance with the second input, detecting, via the one or more input devices, a third input corresponding to a selection of the first user interface object; as well as In response to detecting the third input: displaying, via the display generating component, in the first text entry field, the first suggested text associated with the first user interface object; as well as A third suggested text associated with the first user interface object is displayed in the second text entry field via the display generation component, wherein the third suggested text is related to the first suggested text based on the shared at least one characteristic.

21. The method of any one of claims 1 to 20, wherein the document includes a second text entry field, the method further comprising: detecting, via the one or more input devices, a second input corresponding to a request to enter text into the first text entry field while displaying the first text entry field at the corresponding position in accordance with the first input; In response to detecting the second input, displaying first text in the first text entry field via the display generation component according to the second input; as well as After displaying the first text in the first text entry field, a process for entering text into the second text entry field is initiated without detecting input corresponding to a request to enter text into the second text entry field.

22. The method of claim 21, wherein initiating the process for entering text into the second text entry field comprises: One or more user interface objects selectable to enter suggested text into the second text entry field are displayed via the display generating component.

23. A method according to any one of claims 21 to 22, wherein the second text entry field is created in the document in response to user input before the first input is detected, and the second text entry field is spatially after the first text entry field in the document.

24. The method according to any one of claims 1 to 23, further comprising: detecting, via the one or more input devices, handwriting input on a surface while the first text entry field is displayed at the corresponding location, wherein the handwriting input is for the first text entry field; as well as In response to detecting the handwriting input, first text based on the handwriting input is displayed in the first text entry field via the display generation component.

25. The method according to any one of claims 1 to 24, further comprising: In response to detecting the first input: Prior to displaying the first text entry field at the corresponding location, one or more selectable options are displayed via the one or more input devices that are selectable to select a type of the first text entry field.

26. The method according to any one of claims 1 to 25, wherein the first text entry field is displayed at the corresponding position in a first size in response to detecting the first input, the method further comprising: while displaying the first text entry field at the corresponding position at the first size, detecting, via the one or more input devices, a second input corresponding to a request to display the first text entry field at a second size different from the first size; as well as In response to detecting the second input, the first text entry field is displayed at the corresponding position and in the second size via the display generation component.

27. The method of claim 26, wherein the second input is directed to one or more selectable user interface objects displayed with the first text entry field.

28. A method according to any one of claims 1 to 27, wherein the first input comprises a predefined number of contacts between the object and the surface within a time threshold of each other.

29. An electronic device comprising: one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for: Displaying the document via a display generation component; While displaying the document, detecting a first input to the document via one or more input devices; and In response to detecting the first input: When the document is in a corresponding operation mode, based on determining that the first input is for a first position within a first threshold distance of a first text entry area in the document, wherein the first text entry area does not include a text entry field, displaying a first text entry field at a corresponding position based on the first text entry area in the document via the display generation component, wherein the corresponding position is within the first threshold distance of the first text entry area; as well as When the document is in the corresponding operation mode, based on determining that the first input is for a second location different from the first location located within the first threshold distance of the first text entry area in the document, displaying the first text entry field at the corresponding location in the document.

30. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising the following operations: Displaying the document via a display generation component; While displaying the document, detecting a first input to the document via one or more input devices; as well as In response to detecting the first input: When the document is in a corresponding operation mode, based on determining that the first input is directed to a first location within a first threshold distance of a first text entry area in the document, wherein the first text entry area does not include a text entry field, displaying, via the display generation component, a first text entry field at a corresponding position in the document based on the first text entry area, wherein the corresponding position is within the first threshold distance of the first text entry area; as well as When the document is in the corresponding operation mode, based on determining that the first input is for a second location different from the first location located within the first threshold distance of the first text entry area in the document, displaying the first text entry field at the corresponding location in the document.

31. An electronic device comprising: one or more processors; Memory; means for displaying the document via the display generating means; means for detecting a first input to the document via one or more input devices while displaying the document; and means for, in response to detecting the first input: When the document is in a corresponding operation mode, based on determining that the first input is directed to a first location within a first threshold distance of a first text entry area in the document, wherein the first text entry area does not include a text entry field, displaying, via the display generation component, a first text entry field at a corresponding position in the document based on the first text entry area, wherein the corresponding position is within the first threshold distance of the first text entry area; as well as When the document is in the corresponding operation mode, based on determining that the first input is for a second location different from the first location located within the first threshold distance of the first text entry area in the document, displaying the first text entry field at the corresponding location in the document.

32. An information processing device used in an electronic device, the information processing device comprising: means for displaying the document via the display generating means; means for detecting a first input to the document via one or more input devices while displaying the document; and means for, in response to detecting the first input: When the document is in a corresponding operation mode, based on determining that the first input is directed to a first location within a first threshold distance of a first text entry area in the document, wherein the first text entry area does not include a text entry field, displaying, via the display generation component, a first text entry field at a corresponding position in the document based on the first text entry area, wherein the corresponding position is within the first threshold distance of the first text entry area; as well as When the document is in the corresponding operation mode, based on determining that the first input is for a second location different from the first location located within the first threshold distance of the first text entry area in the document, displaying the first text entry field at the corresponding location in the document.

33. An electronic device comprising: one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing any one of the methods according to claims 1 to 28.

34. A non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform any one of the methods according to claims 1 to 28.

35. An electronic device comprising: one or more processors; Memory; and Means for carrying out any of the methods according to claims 1 to 28.

36. An information processing device used in an electronic device, the information processing device comprising: Means for carrying out any of the methods according to claims 1 to 28.

37. A method comprising: At an electronic device in communication with a display generating component and one or more input devices: displaying, via the display generation component, a user interface including a content entry area; When the user interface including the content entry area is displayed: receiving, via the one or more input devices, a drawing input directed to the content entry area; In response to receiving the drawing input: Based on determining that the drawing input includes movement in a first direction along a first axis of a surface, displaying, via the display generation component, a representation of the drawing input in the content entry area based on the movement in the first direction along the first axis, wherein the representation of the drawing input includes a first portion aligned with the first axis and having a first line thickness; and Based on determining that the drawing input includes movement along the first axis of the surface in a second direction different from the first direction, displaying the representation of the drawing input in the content entry area via the display generation component based on the movement along the first axis in the second direction, wherein the representation of the drawing input includes a second portion aligned with the first axis and having a second line thickness different from the first line thickness.

38. The method of claim 37, wherein the first direction is downward along a vertical axis, the second direction is upward along the vertical axis, and the first line thickness is greater than the second line thickness.

39. The method according to any one of claims 37 to 38, further comprising: In response to receiving the drawing input: Based on determining that the drawing input includes movement in a third direction along a second axis orthogonal to the first axis, displaying a representation of the drawing input in the content entry area based on the movement in the third direction along the second axis, wherein the representation of the drawing input includes a third portion aligned with the second axis and having a third line thickness different from the first line thickness and the second line thickness.

40. The method of claim 39, wherein the third line thickness is between the first line thickness and the second line thickness.

41. A method according to any one of claims 37 to 40, wherein: Displaying the first portion of the representation of the drawing input includes: displaying an animation of the first portion of the representation of the drawing input expanding from having a line thickness less than the first line thickness to having the first line thickness, and Displaying the second portion of the representation of the drawing input includes displaying an animation of the second portion of the representation of the drawing input expanding from having a line thickness less than the second line thickness to having the second line thickness.

42. The method according to any one of claims 37 to 41, further comprising: In response to receiving the drawing input: based on determining that the drawing input includes movement in a corresponding direction exerted on the surface with a first amount of pressure, displaying via the display generation component the representation of the drawing input based on the movement in the corresponding direction, wherein the representation of the drawing input includes a third portion having a third line thickness; as well as Based on determining that the drawing input includes movement in the corresponding direction applied on the surface with a second amount of pressure different from the first amount of pressure, displaying, via the display generation component, the representation of the drawing input based on the movement in the corresponding direction, wherein the representation of the drawing input includes a fourth portion having a fourth line thickness different from the third line thickness.

43. The method according to any one of claims 37 to 42, further comprising: In response to receiving the drawing input: Based on determining that the drawing input includes movement in a corresponding direction while the object has a first angle relative to the surface, displaying via the display generation component the representation of the drawing input based on the movement in the corresponding direction, wherein the representation of the drawing input includes a third portion having a third line thickness; and Based on determining that the drawing input includes movement in the corresponding direction when the object has a second angle relative to the surface that is different from the first angle, displaying the representation of the drawing input via the display generation component based on the movement in the corresponding direction, wherein the representation of the drawing input includes a fourth portion having a fourth line thickness that is different from the third line thickness.

44. The method according to any one of claims 37 to 43, further comprising: In response to receiving the drawing input: displaying, via the display generation component, a first representation of the shape corresponding to the drawing input, wherein the first representation of the shape has a first visual appearance, based on determining that the drawing input includes movement following a contour corresponding to a shape, wherein the movement follows the contour in a first respective direction; as well as Based on determining that the drawing input includes movement that follows the outline corresponding to the shape, wherein the movement follows the outline in a second corresponding direction different from the first corresponding direction, displaying, via the display generation component, a second representation of the shape corresponding to the drawing input, wherein the second representation of the shape has a second visual appearance different from the first visual appearance.

45. The method of claim 44, wherein: The first representation of the shape includes a right portion of the first representation of the shape having a third line thickness and a left portion of the first representation of the shape having a fourth line thickness greater than the third line thickness, and The second representation of the shape includes a right portion of the second representation of the shape having the fourth line thickness and a left portion of the second representation of the shape having the third line thickness.

46. ​​A method according to any one of claims 37 to 45, wherein the drawing input is received when a calligraphy tool is selected in a user interface element in the user interface, the user interface element comprising a plurality of representations of drawing tools used in the drawing input.

47. An electronic device comprising: one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for: displaying, via a display generation component, a user interface including a content entry area; When the user interface including the content entry area is displayed: receiving, via one or more input devices, drawing input for the content entry area; In response to receiving the drawing input: Based on determining that the drawing input includes movement in a first direction along a first axis of a surface, displaying, via the display generation component, a representation of the drawing input in the content entry area based on the movement in the first direction along the first axis, wherein the representation of the drawing input includes a first portion aligned with the first axis and having a first line thickness; and Based on determining that the drawing input includes movement along the first axis of the surface in a second direction different from the first direction, displaying the representation of the drawing input in the content entry area via the display generation component based on the movement along the first axis in the second direction, wherein the representation of the drawing input includes a second portion aligned with the first axis and having a second line thickness different from the first line thickness.

48. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising: displaying, via a display generation component, a user interface including a content entry area; When the user interface including the content entry area is displayed: receiving, via one or more input devices, drawing input for the content entry area; In response to receiving the drawing input: Based on determining that the drawing input includes movement in a first direction along a first axis of a surface, displaying, via the display generation component, a representation of the drawing input in the content entry area based on the movement in the first direction along the first axis, wherein the representation of the drawing input includes a first portion aligned with the first axis and having a first line thickness; and Based on determining that the drawing input includes movement along the first axis of the surface in a second direction different from the first direction, displaying the representation of the drawing input in the content entry area via the display generation component based on the movement along the first axis in the second direction, wherein the representation of the drawing input includes a second portion aligned with the first axis and having a second line thickness different from the first line thickness.

49. An electronic device comprising: one or more processors; Memory; means for displaying, via the display generating means, a user interface including a content entry area; A component for performing the following operations when displaying the user interface including the content entry area: receiving, via one or more input devices, drawing input for the content entry area; In response to receiving the drawing input: Based on determining that the drawing input includes movement in a first direction along a first axis of a surface, displaying, via the display generation component, a representation of the drawing input in the content entry area based on the movement in the first direction along the first axis, wherein the representation of the drawing input includes a first portion aligned with the first axis and having a first line thickness; and Based on determining that the drawing input includes movement along the first axis of the surface in a second direction different from the first direction, displaying the representation of the drawing input in the content entry area via the display generation component based on the movement along the first axis in the second direction, wherein the representation of the drawing input includes a second portion aligned with the first axis and having a second line thickness different from the first line thickness.

50. An information processing device used in an electronic device, the information processing device comprising: means for displaying, via the display generating means, a user interface including a content entry area; A component for performing the following operations when displaying the user interface including the content entry area: receiving, via one or more input devices, drawing input for the content entry area; In response to receiving the drawing input: Based on determining that the drawing input includes movement in a first direction along a first axis of a surface, displaying, via the display generation component, a representation of the drawing input in the content entry area based on the movement in the first direction along the first axis, wherein the representation of the drawing input includes a first portion aligned with the first axis and having a first line thickness; and Based on determining that the drawing input includes movement along the first axis of the surface in a second direction different from the first direction, displaying the representation of the drawing input in the content entry area via the display generation component based on the movement along the first axis in the second direction, wherein the representation of the drawing input includes a second portion aligned with the first axis and having a second line thickness different from the first line thickness.

51. An electronic device comprising: one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing any of the methods according to claims 37 to 46.

52. A non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods according to claims 37 to 46.

53. An electronic device comprising: one or more processors; Memory; and Means for performing any of the methods according to claims 37 to 46.

54. An information processing device used in an electronic device, the information processing device comprising: Means for performing any of the methods according to claims 37 to 46.

55. A method comprising: At an electronic device in communication with a display generating component and one or more input devices: displaying, via the display generation component, a user interface including a content entry area; When the user interface including the content entry area is displayed: receiving, via the one or more input devices, a first drawing input directed to the content entry area, the first drawing input comprising a first movement detected by the one or more input devices; in response to receiving the first drawing input, displaying, via the display generation component, a first representation of the first drawing input in the content entry area according to the first movement, the first representation of the first drawing input including a visual characteristic having a first value; as well as When the user interface including the first representation of the first drawing input is displayed in the content entry area: receiving, via the one or more input devices, a second drawing input comprising a second movement, the second movement comprising a portion of the movement at a location corresponding to at least a portion of the first representation of the first drawing input; as well as In response to receiving the second drawing input: displaying a second representation of the second drawing input overlapping the first representation of the first drawing input in response to determining that the time between the first drawing input and the second drawing input is greater than a predetermined time threshold, in: a first portion of the second representation of the second drawing input that does not overlap with the first representation of the first drawing input has the visual characteristic of the first value; and a second portion of the second representation of the second drawing input that coincides with the first representation of the first drawing input has the visual property at a second value, wherein the visual property at the second value is different from the visual property at the first value; and Based on determining that the time between the first drawing input and the second drawing input is less than the predetermined time threshold, displaying the second representation of the second drawing input merged with the first representation of the first drawing input, wherein: The first portion of the second representation of the second drawing input that does not overlap with the first representation of the first drawing input has the visual characteristic of the first value; and The second portion of the second representation of the second drawing input that coincides with the first representation of the first drawing input has the visual characteristic of the first value.

56. The method of claim 55, wherein the visual characteristic is darkness, and the first value of the visual characteristic corresponds to less darkness than the second value of the visual characteristic.

57. The method according to any one of claims 55 to 56, further comprising: In response to receiving the first drawing input, a simulated wetness region of the content entry area is defined, wherein displaying the first representation of the first drawing input includes displaying the first representation of the first drawing input in the simulated wetness region of the content entry area.

58. The method of claim 57, further comprising: In response to receiving the first drawing input, displaying a first simulated paint diffused in the simulated wet region of the content entry area, wherein the first representation of the first drawing input includes the first simulated paint.

59. The method according to any one of claims 57 to 58, further comprising: In response to receiving the second drawing input, based on determining that the time between the first drawing input and the second drawing input is less than the predetermined time threshold, displaying a second simulated paint included in the second representation of the second drawing input, the second simulated paint diffused in the simulated wetness region of the content entry area defined in response to receiving the first drawing input.

60. The method according to any one of claims 57 to 59, further comprising: In response to receiving the second drawing input, based on determining that the time between the first drawing input and the second drawing input is greater than the predetermined time threshold, displaying a second simulated paint included in the second representation of the second drawing input, the second simulated paint not spreading in the simulated wetness region of the content entry area defined in response to receiving the first drawing input.

61. The method of any one of claims 55 to 60, wherein: Displaying the first representation of the first drawing input includes: displaying simulated paint within a simulated wetness region of the content entry area including simulated water, the simulated wetness region being defined by the first drawing input, Based on determining that the first input includes a first amount of pressure, the first representation includes a first amount of simulated pigment and a first amount of simulated water, and Based on determining that the first input includes a second pressure quantity different from the first pressure quantity, the first representation includes a second quantity of simulated pigment that differs from the first quantity of simulated pigment by a first difference, and the first representation includes a second quantity of simulated water that differs from the first quantity of simulated water by a second difference that is less than the first difference.

62. The method of any one of claims 55 to 60, further comprising: In response to receiving the first drawing input: displaying the first representation of the first drawing input in a first color based on determining that the first input includes a first amount of pressure; as well as Based on determining that the first input includes a second amount of pressure different from the first amount of pressure, the first representation of the first drawing input is displayed in a second color different from the first color.

63. The method according to any one of claims 55 to 62, further comprising: In response to receiving the first drawing input: displaying the first representation of the first drawing input with a first gradient toward a boundary of the first representation based on determining that the first input includes a first amount of pressure; as well as Based on determining that the first input includes a second amount of pressure different from the first amount of pressure, the first representation of the first drawing input is displayed with a second gradient different from the first gradient toward the boundary of the first representation.

64. A method according to any one of claims 55 to 63, wherein the first representation of the first drawing input comprises a simulated pigment diffused in a simulated wetness region defined by the first drawing input, and the simulated pigment diffuses no further than a boundary of the simulated wetness region.

65. The method according to any one of claims 55 to 64, further comprising: receiving, via the one or more input devices, corresponding drawing input for a simulated wet area of ​​the content entry area; as well as In response to receiving the corresponding drawing input, displaying simulated paint diffused in the simulated wet area, wherein: the simulated pigment diffuses a first amount in a first direction and a second amount in a second direction based on determining that the corresponding drawing input corresponds to a first location in the simulated wetness region; and Based on determining that the corresponding drawing input corresponds to a second location in the simulated wetness region that is different from the first location, the simulated paint is diffused a third amount in the first direction and a fourth amount in the second direction.

66. The method of any one of claims 55 to 65, further comprising: In response to receiving the first drawing input: An animation is displayed in which the first representation of the first drawing input transitions from having a wet appearance to a dry appearance, wherein a duration of the animation corresponds to the predetermined time threshold.

67. The method of any one of claims 55 to 66, wherein displaying the first representation of the first drawing input comprises: displaying the first representation of the first drawing input at a second visual characteristic of a first value based on determining that the amount of time that has elapsed since receiving the first drawing input is less than the predetermined time threshold, and Based on determining that the amount of time that has elapsed since receiving the first drawing input is greater than the predetermined time threshold, displaying the first representation of the first drawing input with the second visual characteristic at a second value different from the first value.

68. The method of any one of claims 55 to 67, wherein the first drawing input and the second drawing input are received when an analog marker tool is selected for a drawing input in the user interface.

69. The method of any one of claims 55 to 67, wherein the first drawing input and the second drawing input are received when a simulated paint brush tool is selected for drawing input in the user interface.

70. The method according to any one of claims 55 to 69, further comprising: receiving, via the one or more input devices, an input corresponding to a request to display the first representation of the first drawing input and the second representation of the second drawing input at a second zoom level different from the first zoom level while displaying the first representation of the first drawing input and the second representation of the second drawing input at a first resolution amount at a first zoom level; as well as In response to receiving the input corresponding to the request to display the first representation of the first drawing input and the second representation of the second drawing input at the second zoom level, displaying the first representation of the first drawing input and the second representation of the second drawing input at the first resolution via the display generation component.

71. The method of any one of claims 55 to 70, wherein when a first drawing tool is selected for drawing input in the user interface, the first drawing input and the second drawing input are received, and the method further comprises: receiving a third drawing input via the one or more input devices when a second drawing tool different from the first drawing tool is selected in the user interface; as well as In response to receiving the third drawing input, a third representation of the third drawing input is displayed overlapping the first representation of the first drawing input regardless of whether a time between the second drawing input and the third drawing is less than the predetermined time threshold.

72. The method of any one of claims 55 to 71, wherein the first drawing input is received when a first drawing color is selected in the user interface, and the second drawing input is received when a second drawing color different from the first drawing color is selected in the user interface, and the method further comprises: When displaying the user interface including the first representation of the first drawing input in the content entry area, in response to receiving the second drawing input, based on determining that the time between the first drawing input and the second drawing input is less than the predetermined time threshold: displaying the second portion of the second representation of the second drawing input that coincides with the first representation of the first drawing input in a third color based on the first color and the second color; as well as The first portion of the second representation of the second drawing input that does not overlap with the first representation of the first drawing input is displayed in the second color.

73. A method according to any one of claims 55 to 72, wherein the start of the second input corresponds to a position of the first representation of the first drawing input.

74. A method according to any one of claims 55 to 73, wherein a start of the second input does not correspond to a position of the first representation of the first drawing input.

75. The method of any one of claims 55 to 74, further comprising: When the first representation of the first drawing input and the second representation of the second drawing input are displayed in the content entry area of ​​the user interface: receiving a third drawing input via the one or more input devices; and In response to receiving the third drawing input, based on determining that a time between the first drawing input and the third drawing input is greater than the predetermined time threshold and a time between the first drawing input and the second drawing input is less than the predetermined time threshold, displaying a third representation of the third drawing input, wherein the third representation of the third drawing input overlaps the first representation of the first drawing input and merges with the second representation of the second drawing input.

76. The method of any one of claims 55 to 57, wherein the visual characteristic is opacity, and the first value of the visual characteristic corresponds to less opacity than the second value of the visual characteristic.

77. The method of any one of claims 55 to 76, wherein: Displaying the first representation of the first drawing input includes: displaying the first representation of the first drawing input at a first opacity amount, and Displaying the second representation of the second drawing input includes displaying the second representation of the second drawing input at the first opacity amount based on determining that the time between the first drawing input and the second drawing input is less than the predetermined time threshold.

78. A method according to any one of claims 55 to 77, wherein the visual characteristic is the color saturation of a given color, and the first visual characteristic of the first value corresponds to a smaller color saturation of the given color than the second visual characteristic of the second value.

79. The method of any one of claims 55 to 78, wherein: Displaying the first representation of the first drawing input includes: displaying the first representation of the first drawing input with a first color saturation measure of a given color, and Displaying the second representation of the second drawing input includes displaying the second representation of the second drawing input in the first color saturation metric of the given color based on determining that the time between the first drawing input and the second drawing input is less than the predetermined time threshold.

80. An electronic device comprising: one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for: displaying, via a display generation component, a user interface including a content entry area; When the user interface including the content entry area is displayed: receiving, via one or more input devices, a first drawing input directed to the content entry area, the first drawing input comprising a first movement detected by the one or more input devices; in response to receiving the first drawing input, displaying, via the display generation component, a first representation of the first drawing input in the content entry area according to the first movement, the first representation of the first drawing input including a visual characteristic having a first value; as well as When the user interface including the first representation of the first drawing input is displayed in the content entry area: receiving, via the one or more input devices, a second drawing input comprising a second movement, the second movement comprising a portion of the movement at a location corresponding to at least a portion of the first representation of the first drawing input; as well as In response to receiving the second drawing input: Based on determining that a time between the first drawing input and the second drawing input is greater than a predetermined time threshold, displaying a second representation of the second drawing input overlapping the first representation of the first drawing input, wherein: a first portion of the second representation of the second drawing input that does not overlap with the first representation of the first drawing input has the visual characteristic of the first value; and a second portion of the second representation of the second drawing input that coincides with the first representation of the first drawing input has the visual property at a second value, wherein the visual property at the second value is different from the visual property at the first value; and Based on determining that the time between the first drawing input and the second drawing input is less than the predetermined time threshold, displaying the second representation of the second drawing input merged with the first representation of the first drawing input, wherein: The first portion of the second representation of the second drawing input that does not overlap with the first representation of the first drawing input has the visual characteristic of the first value; and The second portion of the second representation of the second drawing input that coincides with the first representation of the first drawing input has the visual characteristic of the first value.

81. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising: displaying, via a display generation component, a user interface including a content entry area; When the user interface including the content entry area is displayed: receiving, via one or more input devices, a first drawing input directed to the content entry area, the first drawing input comprising a first movement detected by the one or more input devices; in response to receiving the first drawing input, displaying, via the display generation component, a first representation of the first drawing input in the content entry area according to the first movement, the first representation of the first drawing input including a visual characteristic having a first value; as well as When the user interface including the first representation of the first drawing input is displayed in the content entry area: receiving, via the one or more input devices, a second drawing input comprising a second movement, the second movement comprising a portion of the movement at a location corresponding to at least a portion of the first representation of the first drawing input; as well as In response to receiving the second drawing input: Based on determining that a time between the first drawing input and the second drawing input is greater than a predetermined time threshold, displaying a second representation of the second drawing input overlapping the first representation of the first drawing input, wherein: a first portion of the second representation of the second drawing input that does not overlap with the first representation of the first drawing input has the visual characteristic of the first value; and a second portion of the second representation of the second drawing input that coincides with the first representation of the first drawing input has the visual property at a second value, wherein the visual property at the second value is different from the visual property at the first value; and Based on determining that the time between the first drawing input and the second drawing input is less than the predetermined time threshold, displaying the second representation of the second drawing input merged with the first representation of the first drawing input, wherein: The first portion of the second representation of the second drawing input that does not overlap with the first representation of the first drawing input has the visual characteristic of the first value; and The second portion of the second representation of the second drawing input that coincides with the first representation of the first drawing input has the visual characteristic of the first value.

82. An electronic device comprising: one or more processors; Memory; means for displaying, via the display generating means, a user interface including a content entry area; A component for performing the following operations when displaying the user interface including the content entry area: receiving, via one or more input devices, a first drawing input directed to the content entry area, the first drawing input comprising a first movement detected by the one or more input devices; in response to receiving the first drawing input, displaying, via the display generation component, a first representation of the first drawing input in the content entry area according to the first movement, the first representation of the first drawing input including a visual characteristic having a first value; and means for performing the following operations when displaying the user interface including the first representation of the first drawing input in the content entry area: receiving, via the one or more input devices, a second drawing input comprising a second movement, the second movement comprising a portion of the movement at a location corresponding to at least a portion of the first representation of the first drawing input; as well as In response to receiving the second drawing input: Based on determining that a time between the first drawing input and the second drawing input is greater than a predetermined time threshold, displaying a second representation of the second drawing input overlapping the first representation of the first drawing input, wherein: a first portion of the second representation of the second drawing input that does not overlap with the first representation of the first drawing input has the visual characteristic of the first value; and a second portion of the second representation of the second drawing input that coincides with the first representation of the first drawing input has the visual property at a second value, wherein the visual property at the second value is different from the visual property at the first value; and Based on determining that the time between the first drawing input and the second drawing input is less than the predetermined time threshold, displaying the second representation of the second drawing input merged with the first representation of the first drawing input, wherein: The first portion of the second representation of the second drawing input that does not overlap with the first representation of the first drawing input has the visual characteristic of the first value; and The second portion of the second representation of the second drawing input that coincides with the first representation of the first drawing input has the visual characteristic of the first value.

83. An information processing device used in an electronic device, the information processing device comprising: means for displaying, via the display generating means, a user interface including a content entry area; A component for performing the following operations when displaying the user interface including the content entry area: receiving, via one or more input devices, a first drawing input directed to the content entry area, the first drawing input comprising a first movement detected by the one or more input devices; in response to receiving the first drawing input, displaying, via the display generation component, a first representation of the first drawing input in the content entry area according to the first movement, the first representation of the first drawing input including a visual characteristic having a first value; and means for performing the following operations when displaying the user interface including the first representation of the first drawing input in the content entry area: receiving, via the one or more input devices, a second drawing input comprising a second movement, the second movement comprising a portion of the movement at a location corresponding to at least a portion of the first representation of the first drawing input; as well as In response to receiving the second drawing input: Based on determining that a time between the first drawing input and the second drawing input is greater than a predetermined time threshold, displaying a second representation of the second drawing input overlapping the first representation of the first drawing input, wherein: a first portion of the second representation of the second drawing input that does not overlap with the first representation of the first drawing input has the visual characteristic of the first value; and a second portion of the second representation of the second drawing input that coincides with the first representation of the first drawing input has the visual property at a second value, wherein the visual property at the second value is different from the visual property at the first value; and Based on determining that the time between the first drawing input and the second drawing input is less than the predetermined time threshold, displaying the second representation of the second drawing input merged with the first representation of the first drawing input, wherein: The first portion of the second representation of the second drawing input that does not overlap with the first representation of the first drawing input has the visual characteristic of the first value; and The second portion of the second representation of the second drawing input that coincides with the first representation of the first drawing input has the visual characteristic of the first value.

84. An electronic device comprising: one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing any of the methods according to claims 55 to 79.

85. A non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods described in claims 55 to 79.

86. An electronic device comprising: one or more processors; Memory; and Means for performing any of the methods according to claims 55 to 79.

87. An information processing device used in an electronic device, the information processing device comprising: Means for performing any of the methods according to claims 55 to 79.

88. A method comprising: At an electronic device in communication with a display generating component and one or more input devices: displaying, via the display generation component, a user interface including a user interface area, wherein the user interface area includes a plurality of user interface objects; While displaying the user interface including the user interface area, receiving a first input to the user interface area via the one or more input devices; as well as In response to receiving the first input: scrolling the plurality of user interface objects within the user interface area in accordance with the first input while maintaining a position of the user interface area in the user interface based on a determination that the first input includes movement in a first direction and satisfies one or more criteria; as well as Based on determining that the first input includes movement in a second direction different from the first direction, the user interface area is moved within the user interface based on the first input without scrolling the plurality of user interface objects within the user interface area.

89. The method of claim 88, further comprising: After scrolling the plurality of user interface objects within the user interface area in accordance with the first input and in accordance with determining that the first input includes movement in the first direction and satisfies the one or more criteria: detecting, via the one or more input devices, a second input to the user interface area; and In response to detecting the second input: Based on determining that the second input includes movement in the first direction and does not satisfy the one or more criteria, moving the user interface area within the user interface based on the second input, wherein the one or more criteria include a criterion that is not satisfied when the movement of the second input corresponds to movement past an end of the multiple user interface objects in the user interface area.

90. The method of claim 89, wherein: Before detecting the first input, a first set of user interface objects in the plurality of user interface objects is visible in the user interface area; and Scrolling the plurality of user interface objects in the user interface area includes stopping display of one or more user interface objects in the first set of user interface objects in the user interface area.

91. The method of any one of claims 89 to 90, wherein: Before detecting the first input, a first set of user interface objects among the plurality of user interface objects is visible in the user interface area, and a second set of user interface objects among the plurality of user interface objects that is different from the first set of user interface objects is not visible in the user interface area; and Scrolling the plurality of user interface objects within the user interface area includes displaying, via the display generation component, one or more user interface objects in the second set of user interface objects within the user interface area.

92. The method of any one of claims 89 to 91, further comprising: When the second input is detected: Based on determining that the second input includes movement in the first direction and does not satisfy the one or more criteria, and before moving the user interface area within the user interface based on the second input, moving the multiple user interface objects within the user interface area based on a first portion of the movement in the first direction in the second input, wherein moving the user interface area within the user interface is performed based on a second portion of the movement in the first direction of the second input that is subsequent to the first portion.

93. The method of any one of claims 88 to 92, further comprising: detecting, via the one or more input devices, an end of the first input while the user interface area is moved within the user interface in accordance with the first input including movement in the second direction; as well as In response to detecting the end of the first input: displaying, via the display generation component, the user interface area at a first predetermined portion of the user interface based on determining that the user interface area is within a first threshold distance of a first predetermined portion of the user interface when the end of the first input is detected; as well as Based on determining that the user interface area is within the first threshold distance of a second predetermined portion of the user interface that is different from the first predetermined portion when the end of the first input is detected, the user interface area is displayed at the second predetermined portion of the user interface.

94. The method of any one of claims 88 to 93, wherein: When the first input is detected, the user interface area is displayed in the user interface at a first size; and Upon detecting the first input, based on determining that the first input includes movement in the second direction and satisfies the one or more criteria, the user interface area is displayed in the user interface at a second size that is smaller than the first size when the user interface area moves within the user interface based on the first input.

95. The method of any one of claims 88 to 94, wherein when the first input is detected, the user interface area is displayed at a first size in the user interface, the method further comprising: Upon moving the user interface area within the user interface in accordance with the first input comprising movement in the second direction and satisfying the one or more criteria: detecting, via the one or more input devices, an end of the first input; as well as In response to detecting the end of the first input: displaying the user interface area in the user interface at the first size via the display generation component based on determining that the user interface area is located at a first position in the user interface when the end of the first input is detected; as well as The user interface area is displayed in the user interface at a second size different from the first size based on determining that the user interface area is located at a second position in the user interface different from the first position when the end of the first input is detected.

96. The method of any one of claims 88 to 95, wherein when the first input is detected, the user interface area is displayed in a first orientation relative to the user interface, the method further comprising: Upon moving the user interface area within the user interface in accordance with the first input comprising movement in the second direction and satisfying the one or more criteria: detecting, via the one or more input devices, an end of the first input; as well as In response to detecting the end of the first input: displaying, via the display generation component, the user interface area at the first orientation relative to the user interface based on the first position based on a determination that the user interface area is located at a first position in the user interface when the end of the first input is detected; as well as Based on determining that the user interface area is located at a second position in the user interface different from the first position when the end of the first input is detected, the user interface area is displayed at a second orientation relative to the user interface different from the first orientation based on the second position.

97. The method of any one of claims 88 to 96, wherein: The user interface area is a content entry palette; and The plurality of user interface objects includes a plurality of selectable content entry tools.

98. The method of any one of claims 88 to 97, wherein when the first input is detected, a first user interface object of the plurality of user interface objects is selected and, after scrolling the plurality of user interface objects within the user interface area in accordance with the first input, the first user interface object is not displayed in the user interface area, the method further comprising: After scrolling the plurality of user interface objects in the user interface area in accordance with the first input, and while the first user interface object is not displayed in the user interface area, detecting a second input via the one or more input devices, the second input comprising a content entry input using a content entry tool corresponding to the first user interface object; as well as When the second input is detected: displaying, in the user interface via the display generating component, a representation of the content entry input based on the second input and on the content entry tool; as well as The plurality of user interface objects are scrolled in the user interface area so that the first user interface object is displayed in the user interface area.

99. A method according to any one of claims 88 to 98, wherein the second direction is within a first threshold that is orthogonal to the first direction.

100. An electronic device comprising: one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for: displaying, via a display generation component, a user interface including a user interface area, wherein the user interface area includes a plurality of user interface objects; While displaying the user interface including the user interface area, receiving a first input to the user interface area via one or more input devices; as well as In response to receiving the first input: scrolling the plurality of user interface objects within the user interface area in accordance with the first input while maintaining a position of the user interface area in the user interface based on a determination that the first input includes movement in a first direction and satisfies one or more criteria; as well as Based on determining that the first input includes movement in a second direction different from the first direction, the user interface area is moved within the user interface based on the first input without scrolling the plurality of user interface objects within the user interface area.

101. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising: displaying, via a display generation component, a user interface including a user interface area, wherein the user interface area includes a plurality of user interface objects; While displaying the user interface including the user interface area, receiving a first input to the user interface area via one or more input devices; as well as In response to receiving the first input: scrolling the plurality of user interface objects within the user interface area in accordance with the first input while maintaining a position of the user interface area in the user interface based on a determination that the first input includes movement in a first direction and satisfies one or more criteria; as well as Based on determining that the first input includes movement in a second direction different from the first direction, the user interface area is moved within the user interface based on the first input without scrolling the plurality of user interface objects within the user interface area.

102. An electronic device comprising: one or more processors; Memory; means for displaying, via the display generation means, a user interface including a user interface area, wherein the user interface area includes a plurality of user interface objects; means for receiving, via one or more input devices, a first input directed to the user interface area while displaying the user interface including the user interface area; and means for, in response to receiving the first input: scrolling the plurality of user interface objects within the user interface area in accordance with the first input while maintaining a position of the user interface area in the user interface based on a determination that the first input includes movement in a first direction and satisfies one or more criteria; as well as Based on determining that the first input includes movement in a second direction different from the first direction, the user interface area is moved within the user interface based on the first input without scrolling the plurality of user interface objects within the user interface area.

103. An information processing device used in an electronic device, the information processing device comprising: means for displaying, via the display generation means, a user interface including a user interface area, wherein the user interface area includes a plurality of user interface objects; means for receiving, via one or more input devices, a first input directed to the user interface area while displaying the user interface including the user interface area; and means for, in response to receiving the first input: scrolling the plurality of user interface objects within the user interface area in accordance with the first input while maintaining a position of the user interface area in the user interface based on a determination that the first input includes movement in a first direction and satisfies one or more criteria; as well as Based on determining that the first input includes movement in a second direction different from the first direction, the user interface area is moved within the user interface based on the first input without scrolling the plurality of user interface objects within the user interface area.

104. An electronic device comprising: one or more processors; Memory; and One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing any of the methods according to claims 88 to 99.

105. A non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods described in claims 88 to 99.

106. An electronic device comprising: one or more processors; Memory; and Means for performing any of the methods according to claims 88 to 99.

107. An information processing device used in an electronic device, the information processing device comprising: Means for performing any of the methods according to claims 88 to 99.

Images