Handwriting input on electronic device

Abstract

To enhance user interaction including handwriting desired text on a touch screen display of an electronic device by using a stylus or another handwriting device.SOLUTION: An electronic device receives a handwriting input in a text input field, converts the handwriting input into font-based text, selects and deletes text on the basis of an input from a stylus, inserts the text into existing text on the basis of the input from the stylus, manages timing for converting the handwriting input into font-based text, presents a handwriting input menu, controls characteristics of the handwriting input on the basis of selection on the handwriting input menu, presents an automatic completion proposal, converts the handwriting input into the font-based text, and displays options in a content input palette.SELECTED DRAWING: None

Description

[Technical Field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of U.S. Provisional Patent Application No. 62 / 843,976, filed May 6, 2019, U.S. Provisional Patent Application No. 62 / 859,413, filed June 10, 2019, and U.S. Provisional Patent Application No. 63 / 020,496, filed May 5, 2020, the contents of which are incorporated by reference herein in their entireties for all purposes. Technical Field

[0002] TECHNICAL FIELD This specification relates generally to electronic devices that accept handwritten input and user interaction with such devices. [Background technology]

[0003] In recent years, user interaction with electronic devices has increased significantly, which may be devices such as computers, tablet computers, televisions, multimedia devices, mobile devices, etc.

[0004] In some situations, a user may wish to input text on an electronic device or otherwise interact with the electronic device using a stylus. In some situations, a user may wish to handwrite desired text on a touchscreen display of the electronic device using a stylus or other handwriting device. Enhancing these interactions improves the user experience with the device and reduces user interaction time, which is especially important when the input device is battery-operated.

[0005] It is understood that use of personally identifiable information should comply with generally recognized privacy policies and practices that meet or exceed industry or government requirements for maintaining user privacy. In particular, personally identifiable information data should be managed and handled in a manner that minimizes the risk of unintended or unauthorized access or use, and the nature of permitted uses should be clearly indicated to users. Summary of the Invention

[0006] Some embodiments described in the present disclosure are directed to receiving handwritten input in a text input field and converting the handwritten input to font-based text. Some embodiments described in the present disclosure are directed to selecting and deleting text using a stylus. Some embodiments of the present disclosure are directed to inserting text into existing text using a stylus. Some embodiments of the present disclosure are directed to managing the timing of converting handwritten input to font-based text. Some embodiments of the present disclosure are directed to presenting a handwriting menu on an electronic device. Some embodiments of the present disclosure are directed to controlling characteristics of the handwritten input based on a selection on the handwriting menu. Some embodiments of the present disclosure are directed to presenting auto-complete suggestions. Some embodiments of the present disclosure are directed to converting handwritten input to font-based text. Some embodiments of the present disclosure are directed to displaying options in a content input palette. [Brief explanation of the drawings]

[0007] For a better understanding of the various embodiments described, please refer to the following detailed description in conjunction with the following drawings, in which like reference numerals refer to corresponding parts throughout:

[0008] [Figure 1A]FIG. 1 is a block diagram illustrating a portable multifunction device with a touch-sensitive display according to some embodiments.

[0009] [Figure 1B] FIG. 2 is a block diagram illustrating example components for event processing, according to some embodiments.

[0010] [Figure 2] FIG. 1 illustrates a portable multifunction device with a touch screen according to some embodiments.

[0011] [Figure 3] FIG. 1 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface in accordance with some embodiments.

[0012] [Figure 4A] 1 illustrates an exemplary user interface for a menu of applications on a portable multifunction device according to some embodiments.

[0013] [Figure 4B] 1 illustrates an exemplary user interface for a multifunction device with a touch-sensitive surface that is separate from the display, according to some embodiments.

[0014] [Figure 5A] FIG. 1 illustrates a personal electronic device according to some embodiments.

[0015] [Figure 5B] FIG. 1 is a block diagram illustrating a personal electronic device according to some embodiments.

[0016] [Figure 5C] FIG. 1 illustrates exemplary components of a personal electronic device having a touch-sensitive display and intensity sensor, according to some embodiments. [Figure 5D] FIG. 1 illustrates exemplary components of a personal electronic device having a touch-sensitive display and intensity sensor, according to some embodiments.

[0017] [Figure 5E] 1 illustrates example components and a user interface of a personal electronic device according to some embodiments. [Figure 5F] 1 illustrates example components and a user interface of a personal electronic device according to some embodiments. [Figure 5G] 1 illustrates example components and a user interface of a personal electronic device according to some embodiments. [Figure 5H] 1 illustrates example components and a user interface of a personal electronic device according to some embodiments.

[0018] [Figure 5I] 1 illustrates a block diagram of an example architecture of a device according to some embodiments of the present disclosure.

[0019] [Figure 6A] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6B] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6C] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6D] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6E] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6F]1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6G] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6H] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6I] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6J] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6K] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6L] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6M] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6N] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6O] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6P] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6Q] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6R] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6S] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6T] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6U] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6V] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6W] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6X] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6Y] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6Z] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6AA] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6BB] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6CC] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6DD] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6EE]1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6FF] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6GG] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6HH] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6II] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6JJ] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6KK] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6LL] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6MM] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6NN] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6OO] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6PP] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6QQ] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6RR] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6SS] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6TT] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6UU] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6VV] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6WW] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6XX] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 6YY] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments.

[0020] [Figure 7A] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments. [Figure 7B] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments. [Figure 7C] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments. [Figure 7D] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments. [Figure 7E]1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments. [Figure 7F] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments. [Figure 7G] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments. [Figure 7H] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments. [Figure 7I] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments.

[0021] [Figure 8A] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8B] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8C] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8D] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8E] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8F] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8G] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8H]1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8I] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8J] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8K] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8L] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8M] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8N] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8O] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8P] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8Q] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8R] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8S] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8T] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8U] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8V] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8W] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8X] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8Y] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8Z] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8AA] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8BB] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8CC] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8DD] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8EE] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8FF] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8GG]1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8HH] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8II] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8JJ] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8KK] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8LL] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments. [Figure 8MM] 1 illustrates an exemplary method by which an electronic device interprets handwritten input to select or delete text, according to some embodiments.

[0022] [Figure 9A] 1 is a flow diagram illustrating a method for interpreting handwritten input to select or delete text, according to some embodiments. [Figure 9B] 1 is a flow diagram illustrating a method for interpreting handwritten input to select or delete text, according to some embodiments. [Figure 9C] 1 is a flow diagram illustrating a method for interpreting handwritten input to select or delete text, according to some embodiments. [Figure 9D] 1 is a flow diagram illustrating a method for interpreting handwritten input to select or delete text, according to some embodiments. [Figure 9E] 1 is a flow diagram illustrating a method for interpreting handwritten input to select or delete text, according to some embodiments. [Figure 9F]1 is a flow diagram illustrating a method for interpreting handwritten input to select or delete text, according to some embodiments. [Figure 9G] 1 is a flow diagram illustrating a method for interpreting handwritten input to select or delete text, according to some embodiments.

[0023] [Figure 10A] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10B] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10C] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10D] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10E] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10F] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10G] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10H] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10I] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10J] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10K] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10L] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10M] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10N] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10O] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10P] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10Q] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10R] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10S] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10T] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10U] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10V] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10W] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10X] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10Y]1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10Z] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10AA] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10BB] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10CC] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10DD] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10EE] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10FF] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10GG] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10HH] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10II] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10JJ] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10KK] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10LL]1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10MM] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10NN] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10OO] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10PP] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10QQ] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10RR] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10SS] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10TT] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10UU] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10VV] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10WW] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10XX] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10YY]1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10ZZ] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10AAA] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10BBB] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10CCC] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10DDD] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10EEE] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10FFF] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10GGG] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10HHH] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10III] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10JJJ] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10KKK] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10LLL]1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10MMM] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10NNN] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10OOO] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10PPP] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10QQQ] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10RRR] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments. [Figure 10SSS] 1 illustrates an exemplary method for an electronic device to insert handwritten input into existing text, according to some embodiments.

[0024] [Figure 11A] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11B] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11C] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11D] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11E] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11F]1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11G] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11H] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11I] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11J] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11K] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11L] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments. [Figure 11M] 1 is a flow diagram illustrating a method for inserting handwritten input into existing text according to some embodiments.

[0025] [Figure 12A] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12B] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12C] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12D] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12E]1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12F] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12G] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12H] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12I] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12J] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12K] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12L] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12M] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12N] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12O] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12P]1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12Q] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12R] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12S] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12T] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12U] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12V] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12W] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12X] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12Y] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12Z] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12AA]1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12BB] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12CC] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12DD] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12EE] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12FF] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12GG] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12HH] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12II] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12JJ] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12KK] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12LL]1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12MM] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12NN] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12OO] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12PP] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12QQ] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12RR] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments. [Figure 12SS] 1 illustrates an example method for managing timing of an electronic device converting handwritten text to font-based text, according to some embodiments.

[0026] [Figure 13A] 1 is a flow diagram illustrating a method for managing the timing of converting handwritten text to font-based text, according to some embodiments. [Figure 13B] 1 is a flow diagram illustrating a method for managing the timing of converting handwritten text to font-based text, according to some embodiments. [Figure 13C] 1 is a flow diagram illustrating a method for managing the timing of converting handwritten text to font-based text, according to some embodiments. [Figure 13D] 1 is a flow diagram illustrating a method for managing the timing of converting handwritten text to font-based text, according to some embodiments. [Figure 13E] 1 is a flow diagram illustrating a method for managing the timing of converting handwritten text to font-based text, according to some embodiments. [Figure 13F] 1 is a flow diagram illustrating a method for managing the timing of converting handwritten text to font-based text, according to some embodiments. [Figure 13G] 1 is a flow diagram illustrating a method for managing the timing of converting handwritten text to font-based text, according to some embodiments.

[0027] [Figure 14A] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14B] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14C] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14D] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14E] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14F] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14G] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14H] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14I]1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14J] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14K] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14L] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14M] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14N] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14O] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14P] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14Q] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14R] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14S] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14T] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14U] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments. [Figure 14V] 1 illustrates an exemplary method for an electronic device to present a handwriting input menu, according to some embodiments.

[0028] [Figure 15A] 1 is a flow diagram illustrating a method for presenting a handwriting input menu according to some embodiments. [Figure 15B] 1 is a flow diagram illustrating a method for presenting a handwriting input menu according to some embodiments. [Figure 15C] 1 is a flow diagram illustrating a method for presenting a handwriting input menu according to some embodiments. [Figure 15D] 1 is a flow diagram illustrating a method for presenting a handwriting input menu according to some embodiments. [Figure 15E] 1 is a flow diagram illustrating a method for presenting a handwriting input menu according to some embodiments. [Figure 15F] 1 is a flow diagram illustrating a method for presenting a handwriting input menu according to some embodiments.

[0029] [Figure 16A] 1 is a flow diagram illustrating a method for controlling characteristics of handwriting input based on selections on a handwriting input menu, according to some embodiments. [Figure 16B] 1 is a flow diagram illustrating a method for controlling characteristics of handwriting input based on selections on a handwriting input menu, according to some embodiments. [Figure 16C] 1 is a flow diagram illustrating a method for controlling characteristics of handwriting input based on selections on a handwriting input menu, according to some embodiments. [Figure 16D] 1 is a flow diagram illustrating a method for controlling characteristics of handwriting input based on selections on a handwriting input menu, according to some embodiments.

[0030] [Figure 17A] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17B] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17C] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17D] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17E] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17F] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17G] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17H] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17I] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17J] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17K] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17L] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17M] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17N] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17O] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17P] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17Q] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17R]1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17S] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17T] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17U] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17V] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments. [Figure 17W] 1 illustrates an exemplary method for an electronic device to present auto-completion suggestions, according to some embodiments.

[0031] [Figure 18A] 1 is a flow diagram illustrating a method for presenting auto-complete suggestions according to some embodiments. [Figure 18B] 1 is a flow diagram illustrating a method for presenting auto-complete suggestions according to some embodiments. [Figure 18C] 1 is a flow diagram illustrating a method for presenting auto-complete suggestions according to some embodiments. [Figure 18D] 1 is a flow diagram illustrating a method for presenting auto-complete suggestions according to some embodiments. [Figure 18E] 1 is a flow diagram illustrating a method for presenting auto-complete suggestions according to some embodiments. [Figure 18F] 1 is a flow diagram illustrating a method for presenting auto-complete suggestions according to some embodiments. [Figure 18G] 1 is a flow diagram illustrating a method for presenting auto-complete suggestions according to some embodiments. [Figure 18H] 1 is a flow diagram illustrating a method for presenting auto-complete suggestions according to some embodiments. [Figure 18I] 1 is a flow diagram illustrating a method for presenting auto-complete suggestions according to some embodiments.

[0032] [Figure 19A] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19B] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19C] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19D] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19E] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19F] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19G] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19H] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19I] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19J] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19K] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19L] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19M]1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19N] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19O] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19P] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19Q] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19R] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19S] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19T] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19U] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19V] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19W] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19X] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19Y] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19Z] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19AA] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments. [Figure 19BB] 1 illustrates an exemplary method by which an electronic device converts handwritten input into font-based text, according to some embodiments.

[0033] [Figure 20A] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments. [Figure 20B] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments. [Figure 20C] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments. [Figure 20D] 1 is a flow diagram illustrating a method for converting handwritten input to font-based text according to some embodiments.

[0034] [Figure 21A] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21B] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21C] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21D] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21E] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21F] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21G] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21H] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21I] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21J] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21K] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21L] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21M] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21N] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21O] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21P] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21Q] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21R]1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21S] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21T] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21U] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21V] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21W] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21X] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21Y] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21Z] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21AA] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21BB] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21CC] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments. [Figure 21DD] 1 illustrates an exemplary manner in which an electronic device displays options in a content entry palette, according to some embodiments.

[0035] [Figure 22A] 1 is a flow diagram illustrating a method for displaying options in a content entry palette according to some embodiments. [Figure 22B] 1 is a flow diagram illustrating a method for displaying options in a content entry palette according to some embodiments. [Figure 22C] 1 is a flow diagram illustrating a method for displaying options in a content entry palette according to some embodiments. [Figure 22D] 1 is a flow diagram illustrating a method for displaying options in a content entry palette according to some embodiments. [Figure 22E] 1 is a flow diagram illustrating a method for displaying options in a content entry palette according to some embodiments. [Figure 22F] 1 is a flow diagram illustrating a method for displaying options in a content entry palette according to some embodiments. [Figure 22G] 1 is a flow diagram illustrating a method for displaying options in a content entry palette according to some embodiments. [Figure 22H] 1 is a flow diagram illustrating a method for displaying options in a content entry palette according to some embodiments. [Figure 22I] 1 is a flow diagram illustrating a method for displaying options in a content entry palette according to some embodiments. [Figure 22J] 1 is a flow diagram illustrating a method for displaying options in a content entry palette according to some embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0036] The following description sets forth example methods, parameters, etc. However, it should be recognized that such description is not intended as a limitation on the scope of the present disclosure, but rather is provided as a description of example embodiments.

[0037] There is a need for electronic devices that provide efficient methods for receiving and interpreting handwriting input (e.g., from a stylus or other handwriting input device). Such techniques can reduce the cognitive burden on users of such devices. Furthermore, such techniques can reduce processor and battery power that is otherwise wasted on redundant user input.

[0038] In the following description, terms such as "first" and "second" are used to describe various elements, but these elements should not be limited by these terms. These terms are used only to distinguish one element from another. For example, a first touch can be referred to as a second touch, and similarly, a second touch can be referred to as a first touch, without departing from the scope of the various embodiments described. Although a first touch and a second touch are both touches, they are not the same touch.

[0039] The terminology used in the description of various embodiments set forth herein is for the purpose of describing particular embodiments only and is not intended to be limiting. In the description of the various embodiments set forth and in the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. Also, as used herein, the term "and / or" should be understood to refer to and include any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms "includes," "including," "comprises," and / or "comprising," as used herein, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0040] The term "if" is interpreted, optionally, depending on the context, to mean "when" or "upon," or "in response to determining" or "in response to detecting." Similarly, the phrases "if it is determined" or "if [a stated condition or event] is detected" are interpreted, optionally, depending on the context, to mean "upon determining" or "in response to determining," or "upon detecting [the stated condition or event]" or "in response to detecting [the stated condition or event]."

[0041] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as PDA and / or music player functions. Exemplary embodiments of portable multifunction devices include, but are not limited to, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc. of Cupertino, California. Optionally, other portable electronic devices, such as laptops or tablet computers having a touch-sensitive surface (e.g., a touchscreen display and / or touchpad), are also used. It should also be understood that in some embodiments, the device is not a portable communication device, but rather a desktop computer having a touch-sensitive surface (e.g., a touchscreen display and / or touchpad).

[0042] In the following discussion, electronic devices are described that include a display and a touch-sensitive surface, however, it should be understood that the electronic device optionally includes one or more other physical user-interface devices, such as a physical keyboard, a mouse, and / or a joystick.

[0043] The device typically supports a variety of applications such as one or more of a drawing application, a presentation application, a word processing application, a website creation application, a disc authoring application, a spreadsheet application, a gaming application, a telephone application, a video conferencing application, an email application, an instant messaging application, a training support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.

[0044] Various applications running on the device optionally use at least one common physical user-interface device, such as a touch-sensitive surface. One or more features of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or changed for each application and / or within each application. In this way, the common physical architecture of the device (such as the touch-sensitive surface) optionally supports various applications with user interfaces that are intuitive and transparent to the user.

[0045] Attention now turns to embodiments of portable devices with touch-sensitive displays. FIG. 1A is a block diagram illustrating portable multifunction device 100 having touch-sensitive display system 112, according to some embodiments. Touch-sensitive display 112 may conveniently be referred to as a "touch screen" and may also be known or referred to as a "touch-sensitive display system." Device 100 includes memory 102 (optionally including one or more computer-readable storage media), memory controller 122, one or more processing units (CPUs) 120, peripherals interface 118, RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, input / output (I / O) subsystem 106, other input control devices 116, and external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact intensity sensors 165 that detect the intensity of a contact on device 100 (e.g., a touch-sensitive surface, such as touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more tactile output generators 167 that generate tactile output on device 100 (e.g., generate tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touchpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0046] As used herein and in the claims, the term “intensity” of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or a proxy for the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values ​​that includes at least four distinct values ​​and more typically includes hundreds (e.g., at least 256) distinct values. The intensity of a contact is optionally determined (or measured) using various techniques and various sensors or combinations of sensors. For example, one or more force sensors under or adjacent to the touch-sensitive surface are optionally used to measure force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine an estimated force of the contact. Similarly, a pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change in the contact area detected on the touch-sensitive surface, the capacitance and / or change in the capacitance of the touch-sensitive surface proximate the contact, and / or the resistance and / or change in the capacitance of the touch-sensitive surface proximate the contact are optionally used as a surrogate for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the surrogate measure of the force or pressure of the contact is used directly to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is described in units corresponding to the surrogate measure). In some implementations, the surrogate measure of the contact force or pressure is converted to an estimate of the force or pressure, and the estimate of the force or pressure is used to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using contact intensity as an attribute of user input allows users to access additional device functionality (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls such as knobs or buttons) that may not otherwise be accessible to users on devices of reduced size that have limited footprint for displaying affordances.

[0047] As used herein and in the claims, the term “tactile output” refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, that will be detected by a user with the user's sense of touch. For example, in a situation where a device or a component of a device is in contact with a touch-sensitive surface of a user (e.g., the fingers, palm, or other part of the user's hand), the tactile output produced by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in a physical property of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a “downclick” or “upclick” of a physical actuator button. In some cases, a user feels a tactile sensation such as a “downclick” or “upclick” even when there is no movement of a physical actuator button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's action. As another example, movement of a touch-sensitive surface is optionally interpreted or perceived by a user as "roughness" of the touch-sensitive surface, even when there is no change in the smoothness of the touch-sensitive surface. While such user interpretation of touch depends on the user's personal sensory perception, there are many sensory perceptions of touch that are common to the majority of users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "upclick," "downclick," "roughness"), unless otherwise specified, the generated tactile output corresponds to a physical displacement of the device, or a component of the device, that produces the described sensory perception for a typical (or average) user.

[0048] It should be understood that device 100 is only one example of a portable multifunction device, and that device 100 optionally has more or fewer components than those shown, optionally combines two or more components, or optionally has a different configuration or arrangement of its components. The various components shown in Figure 1A are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing circuits and / or application specific integrated circuits.

[0049] Memory 102 optionally includes high-speed random access memory, and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0050] Peripheral interface 118 may be used to couple input and output peripherals of the device to CPU 120 and memory 102. One or more processors 120 operate or execute various software programs and / or instruction sets stored in memory 102 to perform various functions and process data for device 100. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0051] RF (radio frequency) circuitry 108 transmits and receives RF signals, also called electromagnetic signals. RF circuitry 108 converts electrical signals to electromagnetic signals and electromagnetic signals to communicate with communication networks and other communication devices via electromagnetic signals. RF circuitry 108 optionally includes well-known circuitry for performing these functions, including, but not limited to, an antenna system, an RF transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a CODEC chipset, a subscriber identity module (SIM) card, memory, etc. RF circuitry 108 optionally communicates via wireless communication with networks, such as the Internet, also known as the World Wide Web (WWW), an intranet, and / or wireless networks, such as cellular telephone networks, wireless local area networks (LANs) and / or metropolitan area networks (MANs), and with other devices. RF circuitry 108 optionally includes well-known circuitry for detecting near field communication (NFC) fields, such as by short-range radios. Wireless communication optionally includes, but is not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPA), Long Term Evolution (LTE), and other standards.evolution (LTE), near field communications (NFC), wideband code division multiple access (W-CDMA), code division multiple access (CDMA), time division multiple access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, and / or IEEE 802.11ac), voice over Internet Protocol (VoIP), Wi-MAX, protocols for email (e.g., Internet message access protocol (IMAP) and / or post office protocol (POP)), instant messaging (e.g., extensible messaging and presence protocol), The present invention may use any of a number of communication standards, protocols, and technologies, including the Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (XMPP), the Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), the Instant Messaging and Presence Service (IMPS), and / or the Short Message Service (SMS), or any other suitable communication protocol, including communication protocols not yet developed as of the filing date of this application.

[0052] Audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and device 100. Audio circuit 110 receives audio data from peripherals interface 118, converts the audio data into electrical signals, and transmits the electrical signals to speaker 111. Speaker 111 converts the electrical signals into sound waves audible to humans. Audio circuit 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuit 110 converts the electrical signals into audio data and transmits the audio data to peripherals interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to memory 102 and / or RF circuit 108 by peripherals interface 118. In some embodiments, audio circuit 110 also includes a headset jack (e.g., 212 in FIG. 2 ). The headset jack provides an interface between audio circuitry 110 and a detachable audio input / output peripheral, such as an output-only headphone or a headset with both an output (e.g., mono or binaural headphones) and an input (e.g., a microphone).

[0053] I / O subsystem 106 couples input / output peripherals on device 100, such as touchscreen 112 and other input control devices 116, to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, light sensor controller 158, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. One or more input controllers 160 receive / send electrical signals from / to other input control devices 116. Other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, input controller(s) 160 are optionally coupled to any (or none) of a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. The one or more buttons (e.g., 208 in FIG. 2) optionally include up / down buttons for volume control of speaker 111 and / or microphone 113. The one or more buttons optionally include a push button (e.g., 206 in FIG. 2).

[0054] As described in U.S. Patent Application No. 11 / 322,549, filed December 23, 2005, "Unlocking a Device by Performing Gestures on an Unlock Image," U.S. Patent No. 7,657,849, which is incorporated herein by reference in its entirety, a quick press of a push button optionally unlocks touchscreen 112 or, optionally, initiates the process of unlocking the device using gestures on the touchscreen. A longer press of a push button (e.g., 206) optionally turns power on or off to device 100. The functionality of one or more of the buttons is optionally customizable by the user. Touchscreen 112 is used to implement virtual or soft buttons and one or more soft keyboards.

[0055] Touch-sensitive display 112 provides an input and output interface between the device and a user. Display controller 156 receives and / or sends electrical signals to touchscreen 112. Touchscreen 112 displays visual output to the user. This visual output optionally includes graphics, text, icons, animation, and any combination thereof (collectively "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user-interface objects.

[0056] Touchscreen 112 has a touch-sensitive surface, sensor, or set of sensors that accepts input from a user based on haptic and / or tactile contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction sets in memory 102) detects contacts (and any movement or cessation of contact) on touchscreen 112 and translates the detected contacts into interactions with user interface objects (e.g., one or more softkeys, icons, web pages, or images) displayed on touchscreen 112. In an exemplary embodiment, the point of contact between touchscreen 112 and the user corresponds to the user's finger.

[0057] Touchscreen 112 optionally uses LCD (liquid crystal display), LPD (light emitting polymer display), or LED (light emitting diode) technology, although other display technologies are used in other embodiments. Touchscreen 112 and display controller 156 optionally use any of a number of now known or later developed touch sensing technologies to detect contact and any movement or disruption thereof, including, but not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements that determine one or more points of contact with touchscreen 112. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as that found in the iPhone® and iPod Touch® from Apple Inc. of Cupertino, California.

[0058] The touch-sensitive display in some embodiments of touchscreen 112 is optionally similar to the multi-touch-sensing touchpad described in U.S. Patent Nos. 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman), and / or U.S. Patent Publication No. 2002 / 0015024 A1, each of which is incorporated by reference herein in its entirety. However, touchscreen 112 displays visual output from device 100, whereas touch-sensitive touchpads do not provide visual output.

[0059] Touch-sensitive displays in some embodiments of touchscreen 112 are described in the following applications: (1) U.S. patent application Ser. No. 11 / 381,313, filed May 2, 2006, entitled "Multipoint Touch Surface Controller"; (2) U.S. patent application Ser. No. 10 / 840,862, filed May 6, 2004, entitled "Multipoint Touchscreen"; (3) U.S. patent application Ser. No. 10 / 903,964, filed July 30, 2004, entitled "Gestures For Touch Sensitive Input Devices"; (4) U.S. patent application Ser. No. 11 / 048,264, filed January 31, 2005, entitled "Gestures For Touch Sensitive Input Devices"; (5) U.S. patent application Ser. No. 11 / 038,590, filed January 18, 2005, entitled "Mode-Based Graphical User Interfaces For Touch Sensitive Input"; No. 11 / 228,758, filed September 16, 2005, entitled "Virtual Input Device Placement On A Touch Screen User Interface," (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, entitled "Operation Of A Computer With A Touch Screen Interface," (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, entitled "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard," and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, entitled "Multi-Functional Hand-Held Device," all of which are incorporated herein by reference in their entireties.

[0060] Touchscreen 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. A user optionally contacts touchscreen 112 using any suitable object or accessory, such as a stylus, a finger, or the like. In some embodiments, the user interface is designed to operate primarily using finger-based contact and gestures, which may not be as precise as stylus-based input due to the larger contact area of ​​a finger on the touchscreen. In some embodiments, the device translates the coarse finger input into precise pointer / cursor positions or commands to perform the action desired by the user.

[0061] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad (not shown) for activating or deactivating certain functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display visual output. The touchpad is optionally a touch-sensitive surface separate from touchscreen 112 or an extension of the touch-sensitive surface formed by the touchscreen.

[0062] Device 100 also includes a power system 162 that provides power to the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., battery, alternating current (AC)), a recharging system, power failure detection circuitry, power converters or inverters, power status indicators (e.g., light emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of electrical power within a portable device.

[0063] Device 100 also optionally includes one or more light sensors 164. FIG. 1A shows a light sensor coupled to light sensor controller 158 in I / O subsystem 106. Light sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. Light sensor 164 receives light from the environment projected through one or more lenses and converts the light into data representing an image. Light sensor 164 optionally works in conjunction with imaging module 143 (also called a camera module) to capture still images or video. In some embodiments, the light sensor is located on the back side of device 100 opposite touchscreen display 112 on the front of the device, so that the touchscreen display can be used as a viewfinder for capturing still images and / or video. In some embodiments, the light sensor is located on the front of the device so that an image of a user is optionally acquired for a videoconference while the user views other videoconference participants on the touchscreen display. In some embodiments, the position of the light sensor 164 can be changed by the user (e.g., by rotating the lens and sensor within the device housing), so that a single light sensor 164 is used for both video conferencing and capturing still images and / or video, along with a touchscreen display.

[0064] Device 100 also optionally includes one or more contact intensity sensors 165. FIG. 1A shows a contact intensity sensor coupled to intensity sensor controller 159 in I / O subsystem 106. Contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of a contact on a touch-sensitive surface). Contact intensity sensor 165 receives contact intensity information (e.g., pressure information, or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is juxtaposed with or proximate to the touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact intensity sensor is located on the back of device 100, opposite touchscreen display 112, which is located on the front of device 100.

[0065] Device 100 also optionally includes one or more proximity sensors 166. Figure 1A shows proximity sensor 166 coupled to peripheral interface 118. Alternatively, proximity sensor 166 is optionally coupled to input controller 160 within I / O subsystem 106. Proximity sensor 166 optionally functions as described in U.S. patent application Ser. Nos. 11 / 241,839, "Proximity Detector In Handheld Device," 11 / 240,788, "Proximity Detector In Handheld Device," 11 / 620,702, "Using Ambient Light Sensor To Augment Proximity Sensor Output," 11 / 586,862, "Automated Response To And Sensing Of User Activity In Portable Devices," and 11 / 638,251, "Methods And Systems For Automatic Configuration Of Peripherals," which are incorporated herein by reference in their entireties. In some embodiments, when the multifunction device is placed near the user's ear (eg, when the user is making a phone call), the proximity sensor turns off and disables touchscreen 112.

[0066] Device 100 also optionally includes one or more tactile output generators 167. FIG. 1A shows tactile output generators coupled to haptic feedback controller 161 in I / O subsystem 106. Tactile output generator 167 optionally includes one or more electroacoustic devices, such as speakers or other audio components, and / or electromechanical devices that convert energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other tactile output generating components (e.g., components that convert electrical signals into tactile output on the device). Contact intensity sensor 165 receives tactile feedback generation instructions from haptic feedback module 133 and generates a tactile output on device 100 that can be sensed by a user of device 100. In some embodiments, at least one tactile output generator is juxtaposed with or proximate to a touch-sensitive surface (e.g., touch-sensitive display system 112) and generates a tactile output, optionally by moving the touch-sensitive surface vertically (e.g., in / out of the surface of device 100) or horizontally (e.g., back and forth in the same plane as the surface of device 100). In some embodiments, at least one tactile output generator sensor is located on the back of device 100, opposite touchscreen display 112, which is located on the front of device 100.

[0067] Device 100 also optionally includes one or more accelerometers 168. FIG. 1A shows accelerometer 168 coupled to peripherals interface 118. Alternatively, accelerometer 168 is optionally coupled to input controller 160 in I / O subsystem 106. Accelerometer 168 optionally functions as described in U.S. Patent Publication No. 20050190059, "Acceleration-based Theft Detection System for Portable Electronic Devices," and U.S. Patent Publication No. 20060017692, "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer," both of which are incorporated by reference herein in their entireties. In some embodiments, information is displayed on the touchscreen display in portrait or landscape orientation based on an analysis of data received from the one or more accelerometers. Device 100 optionally includes, in addition to accelerometer(s) 168, a magnetometer (not shown), and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information regarding the location and orientation (e.g., portrait or landscape) of device 100.

[0068] In some embodiments, software components stored in memory 102 include operating system 126, communications module (or instruction set) 128, touch / motion module (or instruction set) 130, graphics module (or instruction set) 132, text input module (or instruction set) 134, Global Positioning System (GPS) module (or instruction set) 135, and applications (or instruction sets) 136. Additionally, in some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) stores device / global internal state 157, as shown in FIGS. 1A and 3. Device / global internal state 157 includes one or more of: active application state indicating which applications, if any, are currently active; display state indicating which applications, views, or other information occupy various regions of touchscreen display 112; sensor state including information obtained from the device's various sensors and input control devices 116; and location information regarding the device's position and / or orientation.

[0069] Operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers that control and manage general system tasks (e.g., memory management, storage control, power management, etc.) and facilitate communication between various hardware and software components.

[0070] Communications module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by RF circuitry 108 and / or external port 124. External port 124 (e.g., Universal Serial Bus (USB), FIREWIRE, etc.) is adapted to couple to other devices directly or indirectly via a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is a multi-pin (e.g., 30-pin) connector that is the same as, similar to, and / or compatible with the 30-pin connector used on iPod® (trademark of Apple Inc.) devices.

[0071] Contact / motion module 130, optionally in cooperation with display controller 156, detects contact with touchscreen 112 and other touch-sensing devices (e.g., a touchpad or physical click wheel). Contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact occurs (e.g., detecting a finger-down event), determining the intensity of the contact (e.g., the force or pressure of the contact, or a surrogate for the force or pressure of the contact), determining whether there is contact movement and tracking the movement across the touch-sensitive surface (e.g., detecting one or more finger-drag events), and determining whether the contact has stopped (e.g., detecting a finger-up event or an interruption of the contact). Contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point, as represented by the series of contact data, optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These actions are optionally applied to a single contact (e.g., a single finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, contact / motion module 130 and display controller 156 detect contacts on the touchpad.

[0072] In some embodiments, contact / motion module 130 uses one or more sets of intensity thresholds to determine whether an action has been performed by a user (e.g., to determine whether a user has “clicked” on an icon). In some embodiments, at least a subset of the intensity thresholds are determined according to software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator, but can be adjusted without modifying the physical hardware of device 100). For example, the mouse “click” threshold of a trackpad or touchscreen display can be set to any of a wide range of pre-defined thresholds without modifying the trackpad or touchscreen display hardware. Additionally, in some implementations, a user of the device is provided with a software setting to adjust one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once via a system-level click “intensity” parameter).

[0073] Contact / motion module 130 optionally detects gesture input by a user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different movements, timing, and / or intensities of detected contacts). Thus, gestures are optionally detected by detecting particular contact patterns. For example, detecting a finger tap gesture includes detecting a finger down event, followed by detecting a finger up (lift off) event at the same location (or substantially the same location) as the finger down event (e.g., the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger down event, followed by one or more finger drag events, followed by detecting a finger up (lift off) event.

[0074] Graphics module 132 includes various known software components that render and display graphics on touchscreen 112 or other display, including components that vary the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual characteristics) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including, but not limited to, text, web pages, icons (such as user interface objects including soft keys), digital images, video, animation, etc.

[0075] In some embodiments, graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. Graphics module 132 receives one or more codes specifying the graphics to be displayed, including coordinate data and other graphic characteristic data, as needed, from an application or the like, and then generates screen image data to output to display controller 156.

[0076] The tactile feedback module 133 includes various software components for generating instructions used by the tactile output generator 167, which generates tactile outputs at one or more locations on the device 100 in response to a user's interaction with the device 100.

[0077] Text input module 134 is optionally a component of graphics module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).

[0078] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing, to the camera 143 as photo / video metadata, and to applications that provide location-based services such as weather widgets, local yellow pages widgets, and map / navigation widgets).

[0079] Application 136 optionally includes the following modules (or sets of instructions), or a subset or superset thereof: ● a contacts module 137 (sometimes called an address book or contact list); ● Telephone module 138, ● Videoconferencing module 139; ● an email client module 140; ● Instant messaging (IM) module 141; ● Training support module 142, ● a camera module 143 for still images and / or video; ● Image management module 144; ● Video player module, ● Music player module, ● Browser module 147, ● Calendar module 148, • a widget module 149 optionally including one or more of a weather widget 149-1, a stocks widget 149-2, a calculator widget 149-3, an alarm clock widget 149-4, a dictionary widget 149-5, and other widgets obtained by the user, and a user-created widget 149-6; ● a widget creator module 150 for creating user-created widgets 149-6; ● Search module 151, a video and music player module 152 that integrates a video player module and a music player module; ● Memo module 153, Map module 154, and / or ● Online video module 155.

[0080] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice duplication.

[0081] Contacts module 137, in conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, is optionally used to manage an address book or contact list (e.g., stored in memory 102 or in the application internal state 192 of contacts module 137 in memory 370). These include adding a name to an address book, removing a name(s) from an address book, associating phone number(s), email address(es), physical address(es), or other information with a name, associating an image with a name, categorizing and sorting names, providing phone numbers or email addresses to initiate and / or facilitate communication by phone 138, video conferencing module 139, email 140, or IM 141, and the like.

[0082] Telephone module 138, in conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, is optionally used to enter character sequences corresponding to telephone numbers, access one or more telephone numbers in contacts module 137, modify entered telephone numbers, dial respective telephone numbers, place calls, and disconnect and hang up when the call is completed. As previously mentioned, wireless communication optionally uses any of a number of communication standards, protocols, and technologies.

[0083] Videoconferencing module 139 includes executable instructions to cooperate with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, light sensor 164, light sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138 to initiate, conduct, and end a videoconference between a user and one or more other participants according to the user's commands.

[0084] Email client module 140, in conjunction with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, contains executable instructions for composing, sending, receiving, and managing emails in response to user commands. In conjunction with image management module 144, email client module 140 greatly facilitates the creation and sending of emails with still or video images captured by camera module 143.

[0085] Instant messaging module 141 includes executable instructions, in cooperation with RF circuitry 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, for entering character sequences corresponding to instant messages, modifying previously entered characters, sending respective instant messages (e.g., using Short Message Service (SMS) or Multimedia Message Service (MMS) protocols for telephony-based instant messaging, or XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, sent and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments, such as those supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, "instant messaging" refers to both telephony-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0086] The training support module 142 includes executable instructions to cooperate with the RF circuitry 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module to create workouts (e.g., with time, distance, and / or calorie burn goals), communicate with training sensors (sports devices), receive training sensor data, calibrate sensors used to monitor workouts, select and play music for workouts, and display, store, and transmit workout data.

[0087] Camera module 143, in conjunction with touchscreen 112, display controller 156, light sensor 164, light sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, contains executable instructions for capturing and storing still images or video (including video streams) in memory 102, modifying the characteristics of the still images or video, or deleting the still images or video from memory 102.

[0088] Image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still and / or video images in conjunction with touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and camera module 143.

[0089] Browser module 147, in conjunction with RF circuitry 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, contains executable instructions for browsing the Internet according to user commands, including retrieving, linking to, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.

[0090] The calendar module 148 includes executable instructions to cooperate with the RF circuitry 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the email client module 140, and the browser module 147 to create, display, modify, and store calendars and data associated with the calendars (e.g., calendar items, to-do lists, etc.) according to user instructions.

[0091] Widget module 149, in conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, optionally provides mini-applications (e.g., weather widget 149-1, stocks widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) downloaded and used by a user, or mini-applications created by a user (e.g., user-created widget 149-6). In some embodiments, a widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, a widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! Widgets).

[0092] The widget creator module 150, in conjunction with the RF circuitry 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, and the browser module 147, is optionally used by a user to create a widget (e.g., turn a user-specified portion of a web page into a widget).

[0093] The search module 151 includes executable instructions for working in conjunction with the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134 to search for text, music, sound, images, video, and / or other files in the memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with a user's commands.

[0094] Video and music player module 152 includes executable instructions that, in conjunction with touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, enable a user to download and play pre-recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing videos (e.g., on touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (a trademark of Apple Inc.).

[0095] The notes module 153 includes executable instructions for working with the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134 to create and manage notes, to-do lists, and the like according to user commands.

[0096] Map module 154, in conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, is used to receive, display, modify, and store maps and data associated with maps (e.g., driving directions, data regarding businesses and other points of interest at or near a particular location, and other location-based data), optionally in accordance with user instructions.

[0097] Online video module 155, in conjunction with touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, contains instructions that enable a user to access, browse for, receive (e.g., by streaming and / or downloading), and play (e.g., on the touchscreen or on an external display connected via external port 124) particular online videos, send emails with links to particular online videos, and otherwise manage online videos in one or more file formats, such as H.264. In some embodiments, instant messaging module 141 is used to send links to particular online videos, rather than email client module 140. For additional description of online video applications, see U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled "Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos," the contents of which are incorporated herein by reference in their entireties.

[0098] The above-identified modules and applications each correspond to sets of executable instructions that perform one or more of the functions previously described and methods described herein (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., sets of instructions) need not be implemented as separate software programs, procedures, or modules; thus, in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. For example, a video player module is optionally combined with a music player module into a single module (e.g., video and music player module 152 of FIG. 1A). In some embodiments, memory 102 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 102 optionally stores additional modules and data structures not described above.

[0099] In some embodiments, device 100 is a device in which operation of a predetermined set of functions on the device is performed solely via a touchscreen and / or touchpad. Using the touchscreen and / or touchpad as the primary input control device for operation of device 100 optionally reduces the number of physical input control devices (push buttons, dials, etc.) on device 100.

[0100] The set of predefined functions performed only through the touchscreen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 to a main menu, home menu, or root menu from any user interface displayed on device 100. In such embodiments, a "menu button" is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device rather than a touchpad.

[0101] 1B is a block diagram illustrating exemplary components for event processing, according to some embodiments. In some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3) includes event sorter 170 (e.g., within operating system 126) and a respective application 136-1 (e.g., any of applications 137-151, 155, 380-390 described above).

[0102] Event sorter 170 receives the event information and determines which application 136-1 to deliver the event information to and application view 191 for application 136-1. Event sorter 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192 that indicates the current application view that is displayed on touch-sensitive display 112 when the application is active or running. In some embodiments, device / global internal state 157 is used by event sorter 170 to determine which application(s) is currently active, and application internal state 192 is used by event sorter 170 to determine which application(s) is / are currently active, and application internal state 192 is used by event sorter 170 to determine which application view 191 to deliver the event information to.

[0103] In some embodiments, application internal state 192 includes additional information such as one or more of resume information to be used when application 136-1 resumes execution, user interface state information indicating or ready to display information being displayed by application 136-1, state cues that allow the user to return to a previous state or view of application 136-1, and redo / undo cues of previous actions taken by the user.

[0104] Event monitor 171 receives event information from peripherals interface 118. The event information includes information about sub-events (e.g., a user touch as part of a multi-touch gesture on touch-sensitive display 112). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, accelerometer(s) 168, and / or microphone 113 (via audio circuitry 110). Information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.

[0105] In some embodiments, event monitor 171 sends requests to peripherals interface 118 at predetermined intervals. In response, peripherals interface 118 transmits event information. In other embodiments, peripherals interface 118 transmits event information only when there is a significant event (e.g., receipt of an input above a predetermined noise threshold and / or for more than a predetermined duration).

[0106] In some embodiments, event sorter 170 also includes a hit view determination module 172 and / or an active event recognizer determination module 173 .

[0107] Hit view determination module 172 provides software procedures that determine where a sub-event occurred within one or more views when touch-sensitive display 112 displays more than one view. A view consists of the controls and other elements that a user can see on the display.

[0108] Another aspect of a user interface associated with an application is the set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the respective application) in which the touch is detected optionally corresponds to a programmatic level within the application's programmatic or view hierarchy. For example, the lowest-level view in which the touch is detected is optionally referred to as the hit view, and the set of events that are recognized as appropriate inputs is optionally determined based at least in part on the hit view of the initial touch that initiates the touch gesture.

[0109] Hit view determination module 172 receives information related to sub-events of a touch-based gesture. When an application has multiple views organized hierarchically, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should process the sub-events. In most situations, the hit view is the lowest-level view in which an initiating sub-event occurs (e.g., the first sub-event in a sequence of sub-events that form an event or potential event). Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source identified as the hit view.

[0110] Active event recognizer determination module 173 determines which view(s) in the view hierarchy should receive the particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive the particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that contain the physical location of the sub-event are actively participating views, and therefore all actively participating views should receive the particular sequence of sub-events. In other embodiments, even if the touch sub-event is completely confined to the area associated with one particular view, views higher in the hierarchy still remain actively participating views.

[0111] Event dispatcher module 174 dispatches event information to event recognizers (e.g., event recognizer 180). In embodiments that include active event recognizer determination module 173, event dispatcher module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event dispatcher module 174 stores event information obtained by each event receiver 182 in an event queue.

[0112] In some embodiments, operating system 126 includes event sorter 170. Alternatively, application 136-1 includes event sorter 170. In still other embodiments, event sorter 170 is a stand-alone module or is part of another module stored in memory 102, such as contact / motion module 130.

[0113] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each containing instructions for processing touch events that occur within a respective view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, each application view 191 includes multiple event recognizers 180. In other embodiments, one or more of event recognizers 180 are part of a separate module, such as a user interface kit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some embodiments, each event handler 190 includes one or more of data updater 176, object updater 177, GUI updater 178, and / or event data 179 received from event sorter 170. Event handler 190 optionally utilizes or invokes data updater 176, object updater 177, or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views 191 include one or more respective event handlers 190. Also, in some embodiments, one or more of the data updater 176, the object updater 177, and the GUI updater 178 are included in each application view 191.

[0114] Each event recognizer 180 receives event information (e.g., event data 179) from event sorter 170 and identifies an event from the event information. Event recognizer 180 includes event receiver 182 and event comparator 184. In some embodiments, event recognizer 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (optionally including sub-event delivery instructions).

[0115] Event receiver 182 receives event information from event sorter 170. The event information includes information about a sub-event, e.g., a touch or a movement of a touch. Depending on the sub-event, the event information also includes additional information, such as the position of the sub-event. When the sub-event involves a movement of a touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, the event includes a rotation of the device from one orientation to another (e.g., from portrait to landscape or vice versa), and the event information includes corresponding information about the current orientation of the device (also called the device's attitude).

[0116] The event comparator 184 compares the event information with predefined event or sub-event definitions and determines the event or sub-event, or determines or updates the state of the event or sub-event, based on the comparison. In some embodiments, the event comparator 184 includes an event definition 186. The event definition 186 includes definitions of events (e.g., a predefined sequence of sub-events), such as Event 1 (187-1) and Event 2 (187-2). In some embodiments, sub-events within Event 1 (187) include, for example, touch start, touch end, touch movement, touch cancellation, and multiple touches. In one example, the definition for Event 1 (187-1) is a double tap on a displayed object. The double tap includes, for example, a first touch on a displayed object relative to a predetermined stage (touch start), a first lift-off (touch end) relative to the predetermined stage, a second touch on a displayed object relative to the predetermined stage (touch start), and a second lift-off (touch end) relative to the predetermined stage. In another example, a definition of event 2 (187-2) is a drag on a displayed object. Drag includes, for example, a touch (or contact) on the displayed object to a predetermined stage, a movement of the touch across the touch-sensitive display 112, and a lift-off of the touch (touch end). In some embodiments, the event also includes information about one or more associated event handlers 190.

[0117] In some embodiments, event definition 187 includes a definition of the event for each user interface object. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, if a touch is detected on touch-sensitive display 112 in an application view in which three user interface objects are displayed on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a respective event handler 190, event comparator 184 uses the results of the hit test to determine which event handler 190 to activate. For example, event comparator 184 selects the event handler associated with the sub-event and object that triggers the hit test.

[0118] In some embodiments, each event 187 definition also includes a delay action that delays transmission of the event information until it is determined whether the sequence of sub-events corresponds to the event type of the event recognizer.

[0119] If the respective event recognizer 180 determines that the sequence of sub-events does not match any of the events in the event definition 186, the respective event recognizer 180 enters an event-disabled, event-failed, or event-ended state and thereafter ignores the next sub-event of the touch-based gesture. In this situation, any other event recognizers that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.

[0120] In some embodiments, each event recognizer 180 includes metadata 183 with configurable properties, flags, and / or lists that indicate to actively participating event recognizers how the event delivery system should perform sub-event delivery. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact with each other or how event recognizers are allowed to interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how sub-events are delivered to various levels in the view or programmatic hierarchy.

[0121] In some embodiments, each event recognizer 180 activates an event handler 190 associated with an event when one or more specific sub-events of the event are recognized. In some embodiments, each event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is separate from sending (and postponing sending) sub-events to the respective hit view. In some embodiments, the event recognizer 180 pops a flag associated with the recognized event, and the event handler 190 associated with the flag captures the flag and performs a predetermined process.

[0122] In some embodiments, the event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with a set of sub-events or to an actively participating view. The event handler associated with the set of sub-events or the actively participating view receives the event information and performs predetermined processing.

[0123] In some embodiments, data updater 176 creates and updates data used by application 136-1. For example, data updater 176 updates phone numbers used by contacts module 137 or stores video files used by a video player module. In some embodiments, object updater 177 creates and updates objects used by application 136-1. For example, object updater 177 creates new user interface objects or updates the positions of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on the touch-sensitive display.

[0124] In some embodiments, event handler(s) 190 include or have access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the respective application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.

[0125] It should be understood that the foregoing description of event processing of a user's touch on a touch-sensitive display also applies to other forms of user input for operating multifunction device 100 using input devices, although not all of them are initiated on a touchscreen. For example, mouse movements and mouse button presses, contact movements such as tapping, dragging, scrolling on a touchpad, optionally coordinated with single or multiple keyboard presses or holds, pen stylus input, device movement, verbal commands, detected eye movement, biometric input, and / or any combination thereof, are optionally utilized as inputs corresponding to sub-events that define the recognized event.

[0126] FIG. 2 illustrates portable multifunction device 100 having touchscreen 112, according to some embodiments. The touchscreen optionally displays one or more graphics within user interface (UI) 200. In this embodiment, as well as other embodiments described below, a user may select one or more of the graphics by performing a gesture on the graphics, for example, using one or more fingers 202 (not drawn to scale) or one or more styluses 203 (not drawn to scale). In some embodiments, selection of one or more graphics is performed when the user breaks contact with the one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (left to right, right to left, upward and / or downward), and / or rolling (right to left, left to right, upward and / or downward) of a finger in contact with device 100. In some implementations or situations, accidental contact with a graphic does not select the graphic, for example, if the gesture corresponding to selection is a tap, a swipe gesture sweeping over an application icon optionally does not select the corresponding application.

[0127] In some embodiments, the stylus 203 is an active device and includes one or more electronic circuits. For example, the stylus 203 includes one or more sensors and one or more communication circuits (such as the communication module 128 and / or the RF circuitry 108). In some embodiments, the stylus 203 includes one or more processors and a power system (e.g., similar to the power system 162). In some embodiments, the stylus 203 includes an accelerometer (such as the accelerometer 168), a magnetometer, and / or a gyroscope that can determine the position, angle, location, and / or other physical characteristics of the stylus 203 (e.g., whether the stylus is positioned downward, tilted toward or away from the device, and / or positioned near or far from the device). In some embodiments, the stylus 203 communicates with an electronic device (e.g., via a wireless communication protocol such as Bluetooth via the communication circuitry) and transmits sensor data to the electronic device. In some embodiments, the stylus 203 can determine whether the user is holding the device (e.g., via the accelerometer or other sensors). In some embodiments, the stylus 203 can accept tap input (e.g., a single tap or a double tap) on the stylus 203 from a user (e.g., received by an accelerometer or other sensor) and can interpret the input as a command or request to perform a function or to change to a different input mode.

[0128] Device 100 also optionally includes one or more physical buttons, such as a "home" button or menu button 204. As previously mentioned, menu button 204 is optionally used to navigate to any application 136 within a set of applications running on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key within a GUI displayed on touchscreen 112.

[0129] In some embodiments, device 100 includes touchscreen 112, menu button 204, pushbuttons 206 for powering the device on / off and locking the device, volume control buttons 208, subscriber identity module (SIM) card slot 210, headset jack 212, and external docking / charging port 124. Pushbutton 206 is optionally used to power the device on / off by pressing and holding the button down for a predetermined period of time, to lock the device by pressing and releasing the button before the predetermined time has elapsed, and / or to unlock the device or initiate the unlocking process. In alternative embodiments, device 100 also accepts verbal input via microphone 113 for activating or deactivating certain functions. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of a contact on touchscreen 112 and / or one or more tactile output generators 167 for generating a tactile output for a user of device 100.

[0130] FIG. 3 is a block diagram of an exemplary multifunction device having a display and a touch-sensitive surface, according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a child's learning toy), a gaming system, or a control device (e.g., a home or commercial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 interconnecting these components. Communication bus 320 optionally includes circuitry (sometimes called a chipset) that interconnects and controls communication between system components. Device 300 includes input / output (I / O) interface 330, including display 340, which is typically a touchscreen display. I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 that generates tactile output on device 300 (e.g., similar to tactile output generator 167 described above with reference to FIG. 1A ), and sensors 359 (e.g., light, acceleration, proximity, touch-sensing, and / or contact intensity sensors similar to contact intensity sensor 165 described above with reference to FIG. 1A ). Memory 370 includes high-speed random-access memory such as DRAM, SRAM, DDR RAM, or other random-access solid-state memory devices, and optionally includes non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU(s) 310.In some embodiments, memory 370 stores programs, modules, and data structures similar to, or a subset of, programs, modules, and data structures stored in memory 102 of portable multifunction device 100 (FIG. 1A). Additionally, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores drawing module 380, presentation module 382, ​​word processing module 384, website creation module 386, disc authoring module 388, and / or spreadsheet module 390, whereas memory 102 of portable multifunction device 100 (FIG. 1A) optionally does not store these modules.

[0131] Each of the above-identified elements of FIG. 3 is optionally stored in one or more of the memory devices mentioned above. Each of the above-identified modules corresponds to an instruction set that performs the function described above. The above-identified modules or programs (e.g., instruction sets) need not be implemented as separate software programs, procedures, or modules; thus, in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. In some embodiments, memory 370 optionally stores a subset of the above-identified modules and data structures. Additionally, memory 370 optionally stores additional modules and data structures not described above.

[0132] Attention is now optionally directed to user interface embodiments implemented, for example, on portable multifunction device 100.

[0133] 4A shows an exemplary user interface for a menu of applications on portable multifunction device 100, according to some embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof: ● signal strength indicator(s) 402 for wireless communication(s), such as cellular and Wi-Fi signals; ● Time 404, ● Bluetooth indicator 405, ● Battery status indicator 406; A tray 408 with icons of frequently used applications, such as: o An icon 416 for the phone module 138, labeled "Phone", which optionally includes an indicator 414 of the number of missed calls or voicemail messages; o An icon 418 for the email client module 140, labeled "Mail", optionally including an indicator 410 of the number of unread emails; ○ An icon 420 for the browser module 147, labeled "Browser"; and o An icon 422 for the video and music player module 152, also called the iPod (trademark of Apple Inc.) module 152, labeled "iPod"; and ● Icons of other applications, such as: ○ Icon 424 of IM module 141, labeled "Messages" ○ Icon 426 of the calendar module 148, labeled "Calendar" ○ Icon 428 in the image management module 144, labeled "Photos" ○ An icon 430 of the camera module 143, labeled "camera"; ○ Icon 432 of the online video module 155, labeled "Online Video"; Icon 434 of Stocks widget 149-2, labeled "Stock Prices" ○ Icon 436 of map module 154, labeled "Map" ○ Icon 438 of weather widget 149-1, labeled "Weather" ○ Icon 440 of alarm clock widget 149-4, labeled "Clock" ○ Icon 442 of Training Support module 142, labeled "Training Support"; icon 444 of the Notes module 153, labeled "Notes"; and o A settings application or module icon 446 labeled "Settings" that provides access to settings for the device 100 and its various applications 136.

[0134] 4A are merely exemplary. For example, icon 422 of video and music player module 152 is labeled "music" or "music player," although other labels are optionally used for various application icons. In some embodiments, the label for each application icon includes the name of the application corresponding to the respective application icon. In some embodiments, the label for a particular application icon is different from the name of the application corresponding to that particular application icon.

[0135] 4B shows an example user interface on a device (e.g., device 300 of FIG. 3 ) that has touch-sensitive surface 451 (e.g., tablet or touchpad 355 of FIG. 3 ) that is separate from display 450 (e.g., touchscreen display 112). Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) that detect the intensity of a contact on touch-sensitive surface 451, and / or one or more tactile output generators 357 that generate a tactile output for a user of device 300.

[0136] Although some of the following examples are given with reference to input on touchscreen display 112 (which combines a touch-sensitive surface and a display), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, as shown in FIG. 4B . In some embodiments, the touch-sensitive surface (e.g., 451 in FIG. 4B ) has a primary axis (e.g., 452 in FIG. 4B ) that corresponds to a primary axis (e.g., 453 in FIG. 4B ) on the display (e.g., 450). According to these embodiments, the device detects contact with touch-sensitive surface 451 (e.g., 460 and 462 in FIG. 4B ) at locations that correspond to respective locations on the display (e.g., in FIG. 4B , 460 corresponds to 468 and 462 corresponds to 470). In this way, user input (e.g., contacts 460 and 462 and their movement) detected by the device on the touch-sensitive surface (e.g., 451 in FIG. 4B ) is used by the device to operate a user interface on the display (e.g., 450 in FIG. 4B ) of the multifunction device when the touch-sensitive surface is separate from the display. It should be understood that similar methods are optionally used for the other user interfaces described herein.

[0137] Additionally, while the following examples are given primarily with reference to finger input (e.g., finger contact, finger tap gesture, finger swipe gesture), it should be understood that in some embodiments, one or more of the finger inputs are replaced with input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of a contact) followed by movement of a cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click (e.g., instead of detecting a contact and then ceasing contact detection) while the cursor is located over the location of the tap gesture. Similarly, it should be understood that when multiple user inputs are detected simultaneously, multiple computer mice are optionally used simultaneously, or a mouse and finger contacts are optionally used simultaneously.

[0138] FIG. 5A shows an exemplary personal electronic device 500. Device 500 includes a main body 502. In some embodiments, device 500 can include some or all of the features described with respect to devices 100 and 300 (e.g., FIGS. 1A-4B ). In some embodiments, device 500 has a touch-sensitive display screen 504, hereafter touch screen 504. Alternatively, or in addition to touch screen 504, device 500 has a display and a touch-sensitive surface. Similar to devices 100 and 300, in some embodiments, touch screen 504 (or the touch-sensitive surface) optionally includes one or more intensity sensors that detect the intensity of contact (e.g., touches) being applied. The one or more intensity sensors of touch screen 504 (or the touch-sensitive surface) can provide output data representing the intensity of the touch. The user interface of device 500 can respond to touches based on their intensity, meaning that touches of different intensities can invoke different user interface actions on device 500.

[0139] For exemplary techniques for detecting and processing touch intensity, see, for example, related applications International Patent Application No. PCT / US2013 / 040061, filed May 8, 2013, entitled "Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application," published as International Patent Application No. WO / 2013 / 169849, and International Patent Application No. PCT / US2013 / 069483, filed November 11, 2013, entitled "Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships," published as International Patent Application No. WO / 2014 / 105276, each of which is incorporated herein by reference in its entirety.

[0140] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508, if included, may be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, may allow device 500 to be attached to, for example, hats, eyewear, earrings, necklaces, shirts, jackets, bracelets, watch bands, chains, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow device 500 to be worn by a user.

[0141] FIG. 5B illustrates an exemplary personal electronic device 500. In some embodiments, device 500 can include some or all of the components described with respect to FIGS. 1A, 1B, and 3. Device 500 has a bus 512 that operably couples an I / O section 514 to one or more computer processors 516 and a memory 518. I / O section 514 can be connected to a display 504, which can have touch-sensing components 522 and, optionally, an intensity sensor 524 (e.g., a contact intensity sensor). Additionally, I / O section 514 can be connected to a communication unit 530 that receives application and operating system data using Wi-Fi, Bluetooth, near-field communication (NFC), cellular, and / or other wireless communication technologies. Device 500 can include input mechanisms 506 and / or 508. Input mechanism 506 is optionally a rotatable input device or a depressible and rotatable input device, for example. In some examples, input mechanism 508 is optionally a button.

[0142] In some embodiments, input mechanism 508 is optionally a microphone. Personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which may be operably connected to I / O section 514.

[0143] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, can cause the computer processors to perform the techniques described below, including processes 700, 900, 1100, 1300, 1500, 1600, 1800, 2000, and 2200 (FIGS. 7, 9, 11, 13, 15, 16, 18, 20, 22). A computer-readable storage medium may be any medium that can tangibly contain or store computer-executable instructions used by or in connection with an instruction execution system, apparatus, or device. In some embodiments, the storage medium is a transitory computer-readable storage medium. In some embodiments, the storage medium is a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium may include, but is not limited to, magnetic, optical, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and resident solid-state memory such as flash, solid-state drives, etc. The personal electronic device 500 is not limited to the components and configuration of FIG. 5B and may include other or additional components in multiple configurations.

[0144] As used herein, the term "affordance" optionally refers to a user-interactive graphical user interface object displayed on a display screen of device 100, 300, and / or 500 (FIGS. 1A, 3, and 5A-5B). For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) each, optionally, constitute an affordance.

[0145] As used herein, the term “focus selector” refers to an input element that indicates the current portion of the user interface with which the user is interacting. In some implementations involving a cursor or other position marker, the cursor acts as the “focus selector,” such that when input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 of FIG. 3 or touch-sensitive surface 451 of FIG. 4B) while the cursor is positioned over a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations involving a touchscreen display (e.g., touch-sensitive display system 112 of FIG. 1A or touchscreen 112 of FIG. 4A) that allows direct interaction with user interface elements on the touchscreen display, a detected contact on the touchscreen acts as the “focus selector,” such that when input (e.g., a press input by contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, the particular user interface element is adjusted according to the detected input. In some implementations, focus is moved from one region of the user interface to another region of the user interface without a corresponding cursor movement or contact movement on the touchscreen display (e.g., by using the tab key or arrow keys to move focus from one button to another), and in these implementations, the focus selector moves to follow the movement of focus between various regions of the user interface. Regardless of the specific form the focus selector takes, the focus selector is generally a user interface element (or contact on a touchscreen display) that is controlled by the user to communicate the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface through which the user intends to interact).For example, while a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of a focus selector (e.g., a cursor, touch, or selection box) over a corresponding button indicates that the user intends to activate that corresponding button (and not other user interface elements shown on the device's display).

[0146] As used herein and in the claims, the term "characteristic intensity" of a contact refers to a characteristic of that contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on a plurality of intensity samples. The characteristic intensity is optionally based on a predetermined number of intensity samples, i.e., a set of intensity samples collected during a predetermined time period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) associated with a predetermined event (e.g., after detecting the contact, before detecting lift-off of the contact, before or after detecting the start of contact movement, before detecting the end of the contact, before or after detecting an increase in the intensity of the contact, and / or before or after detecting a decrease in the intensity of the contact). The characteristic intensity of the contact is optionally based on one or more of the maximum intensity of the contact, the mean intensity of the contact, the average intensity of the contact, the top 10 percentile intensity of the contact, half the maximum intensity of the contact, 90 percent of the maximum intensity of the contact, etc. In some embodiments, the duration of the contact is used in determining the characteristic intensity (e.g., when the characteristic intensity is an average of the intensity of the contact over time). In some embodiments, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an action is performed by the user. For example, the set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, a contact having a characteristic intensity that does not exceed the first threshold results in a first action, a contact having a characteristic intensity above the first intensity threshold but not above the second intensity threshold results in a second action, and a contact having a characteristic intensity above the second threshold results in a third action. In some embodiments, the comparison between the characteristic intensity and the one or more thresholds is not used to determine whether the first action or the second action should be performed, but rather is used to determine whether one or more actions should be performed (e.g., whether to perform the respective action or to forgo performing the respective action).

[0147] FIG. 5C illustrates the detection of multiple contacts 552A-552E on the touch-sensitive display screen 504 by multiple intensity sensors 524A-524D. FIG. 5C additionally includes an intensity diagram illustrating the current intensity measurements of intensity sensors 524A-524D relative to intensity units. In this example, intensity sensors 524A and 524D each measure 9 intensity units, and intensity sensors 524B and 524C each measure 7 intensity units. In some implementations, the aggregate intensity is the sum of the intensity measurements of multiple intensity sensors 524A-524D, which in this example is 32 intensity units. In some embodiments, each contact is assigned a respective intensity that is a fraction of the aggregate intensity. FIG. 5D illustrates assigning aggregate intensities to contacts 552A-552E based on their distance from the center of force 554. In this example, contacts 552A, 552B, and 552E are each assigned a contact intensity of 8 intensity units of aggregate intensity, and contacts 552C and 552D are each assigned a contact intensity of 4 intensity units of aggregate intensity. More generally, in some implementations, each contact j is assigned a respective intensity Ij, which is a fraction of aggregate intensity A, according to a predetermined mathematical function Ij=A·(Dj / ΣDi), where Dj is the distance from the center of force to the respective contact j, and ΣDi is the sum of the distances from the center of force to all respective contacts (e.g., from i=1 to the end). The operations described with reference to FIGS. 5C-5D can be performed using electronic devices similar to or identical to device 100, 300, or 500. In some embodiments, the characteristic intensity of a contact is based on one or more intensities of the contact. In some embodiments, an intensity sensor is used to determine a single characteristic intensity (e.g., a single characteristic intensity of a single contact). Note that the intensity diagrams are not part of the displayed user interface, but are included in FIGS. 5C-5D as an aid to the reader.

[0148] In some embodiments, a portion of the gesture is identified for purposes of determining the characteristic intensity. For example, the touch-sensitive surface optionally receives successive swipe contacts that transition from a start position to an end position, where the intensity of the contact increases. In this example, the characteristic intensity of the contact at the end position is optionally based on only a portion of the successive swipe contacts (e.g., only the portion of the swipe contact at the end position), rather than the entire swipe contact. In some embodiments, a smoothing algorithm is optionally applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of an unweighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some situations, these smoothing algorithms eliminate narrow spikes or dips in the intensity of the swipe contact for purposes of determining the characteristic intensity.

[0149] The intensity of a contact on the touch-sensitive surface is optionally characterized with respect to one or more intensity thresholds, such as a contact-detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device performs an action normally associated with clicking a physical mouse button or trackpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device performs an action different from an action normally associated with clicking a physical mouse button or trackpad. In some embodiments, when a contact is detected having a characteristic intensity below the light press intensity threshold (e.g., and above a nominal contact-detection intensity threshold below which the contact is not detected), the device follows the movement of the contact on the touch-sensitive surface and moves the focus selector without performing an action associated with the light press intensity threshold or the deep press intensity threshold. In general, unless otherwise specified, these intensity thresholds are consistent across various sets of values ​​for a user interface.

[0150] An increase in the characteristic intensity of a contact from an intensity below the light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold may be referred to as inputting a "light press." An increase in the characteristic intensity of a contact from an intensity below the deep press intensity threshold to an intensity above the deep press intensity threshold may be referred to as inputting a "deep press." An increase in the characteristic intensity of a contact from an intensity below the contact-detection intensity threshold to an intensity between the contact-detection intensity threshold and the light press intensity threshold may be referred to as detecting a contact on the touch surface. A decrease in the characteristic intensity of a contact from an intensity above the contact-detection intensity threshold to an intensity below the contact-detection intensity threshold may be referred to as detecting a lift-off of the contact from the touch surface. In some embodiments, the contact-detection intensity threshold is zero. In some embodiments, the contact-detection intensity threshold is greater than zero.

[0151] In some embodiments described herein, one or more actions are performed in response to detecting a gesture including a respective press input or in response to detecting a respective press input performed by a respective contact (or multiple contacts), where the respective press inputs are detected based at least in part on detecting an increase in intensity of the contact (or multiple contacts) above a press input intensity threshold. In some embodiments, the respective actions are performed in response to detecting an increase in intensity of the respective contact above the press input intensity threshold (e.g., a “downstroke” of the respective press input). In some embodiments, the press input includes an increase in intensity of the respective contact above the press input intensity threshold followed by a decrease in intensity of the contact below the press input intensity threshold, and the respective actions are performed in response to detecting a subsequent decrease in intensity of the respective contact below the press input threshold (e.g., an “upstroke” of the respective press input).

[0152] Figures 5E-5H show the light press intensity thresholds (e.g., "IT L ") to the deep press intensity threshold (e.g., "IT D5 illustrates the detection of a gesture including a press input corresponding to an increase in the intensity of contact 562 to an intensity above a deep press intensity threshold (e.g., "IT D ") and reaches a peak. Contact 562 is maintained on touch-sensitive surface 560. In response to detecting the gesture, a deep press intensity threshold (e.g., "IT D "), reduces the scale of the contact 562 to display reduced-scale representations 578A-578C (e.g., thumbnails) of recently opened documents for app2, as shown in FIGS. 5F-5I. In some embodiments, this intensity, which is compared to one or more intensity thresholds, is the characteristic intensity of the contact. Note that the intensity diagrams for contact 562 are not part of the displayed user interface, but are included in FIGS. 5E-5H as an aid to the reader.

[0153] In some embodiments, the display of representations 578A-578C includes animation. For example, as shown in FIG. 5F, representation 578A is first displayed adjacent to application icon 572B. As the animation progresses, as shown in FIG. 5G, representation 578A moves upward and representation 578B is displayed adjacent to application icon 572B. Then, as shown in FIG. 5H, representation 578A moves upward and representation 578B moves upward toward representation 578A, and representation 578C is displayed adjacent to application icon 572B. Representations 578A-578C form an array above icon 572B. In some embodiments, the animation progresses according to the intensity of contact 562, as shown in FIGS. 5F-5G, as the intensity of contact 562 exceeds a deep press intensity threshold (e.g., "ITD "), representations 578A-578C appear and move upward. In some embodiments, the intensity on which the animation progression is based is a characteristic intensity of the contact. The operations described with reference to FIGS. 5E-5H can be performed using electronic devices similar to or identical to device 100, 300, or 500.

[0154] 5I shows a block diagram of an exemplary architecture of device 580 according to some embodiments of the present disclosure. In the embodiment of FIG. 5I, media or other content is optionally received by device 580 via network interface 582, which is optionally a wireless or wired connection. One or more processors 584 optionally execute any number of programs stored in memory 586 or storage. Memory 586 or storage optionally includes instructions to perform one or more of the methods and / or processes described herein (e.g., methods 700, 900, 1100, 1300, 1500, 1600, 1800, 2000, and 2200).

[0155] In some embodiments, display controller 588 causes various user interfaces of the present disclosure to be displayed on display 594. Additionally, input to device 580 is optionally provided by remote control 590 via remote interface 592. Remote interface 592 is optionally wireless or wired. In some embodiments, as described in more detail below, input to device 580 is provided by multifunction device 591 (e.g., a smartphone) on which a remote control application that configures multifunction device 591 runs to simulate remote control functionality. In some embodiments, multifunction device 591 corresponds to one or more of device 100 of FIGS. 1A and 2, device 300 of FIG. 3, and device 500 of FIG. 5A. It is understood that the embodiment of FIG. 5I is not intended to limit the features of the devices of the present disclosure, and other components for facilitating other features described in this disclosure are also optionally included in the architecture of FIG. 5I. 1A and 2, device 300 of FIG. 3, and device 500 of FIG. 5A. Network interface 582 optionally corresponds to one or more of RF circuitry 108, external port 124, and peripherals interface 118 of FIG. 1A and 2, and network communication interface 360 ​​of FIG. 3. Processor 584 optionally corresponds to one or more of processor(s) 120 of FIG. 1A and CPU(s) 310 of FIG. 3. Display controller 588 optionally corresponds to one or more of display controller 156 of FIG. 1A and I / O interface 330 of FIG. 3. Memory 586 optionally corresponds to one or more of memory 102 of FIG. 1A and memory 370 of FIG. 3. Remote interface 592 optionally corresponds to one or more of peripherals interface 118 and I / O subsystem 106 (and / or components thereof) of FIG. 1A, and I / O interface 330 of FIG.Remote 590 optionally corresponds to and / or includes one or more of speaker 111, touch-sensitive display system 112, microphone 113, light sensor(s) 164, contact intensity sensor(s) 165, tactile output generator(s) 167, other input control devices 116, accelerometer(s) 168, proximity sensor 166, and I / O subsystem 106 of FIG. 1A , keyboard / mouse 350, touchpad 355, tactile output generator(s) 357, and contact intensity sensor(s) 359 of FIG. 3 , and touch-sensitive surface 451 of FIG. 4 , and display 594 optionally corresponds to one or more of touch-sensitive display system 112 of FIGS. 1A and 2 , and display 340 of FIG. 3 .

[0156] In some embodiments, the device employs intensity hysteresis to avoid accidental input, sometimes referred to as “jitter,” and the device defines or selects a hysteresis intensity threshold that has a predetermined relationship to the press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units below the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the press input intensity threshold). Thus, in some embodiments, the press input includes an increase in the intensity of each contact above the press input intensity threshold followed by a decrease in the intensity of the contact below a hysteresis intensity threshold corresponding to the press input intensity threshold, and a respective action is performed in response to detecting a subsequent decrease in the intensity of each contact below the hysteresis intensity threshold (e.g., an “upstroke” of each press input). Similarly, in some embodiments, a press input is detected only when the device detects an increase in the intensity of the contact from an intensity below the hysteresis intensity threshold to an intensity above the press input intensity threshold, and optionally a subsequent decrease in the intensity of the contact to an intensity below the hysteresis intensity, and a respective action is performed in response to detecting the press input (e.g., an increase in the intensity of the contact or a decrease in the intensity of the contact, as the case may be).

[0157] For ease of explanation, descriptions of operations performed in response to a press input associated with a press input intensity threshold, or a gesture including a press input, are optionally triggered in response to detecting any of: an increase in the intensity of the contact above the press input intensity threshold; an increase in the intensity of the contact from an intensity below a hysteresis intensity threshold to an intensity above the press input intensity threshold; a decrease in the intensity of the contact below the press input intensity threshold; and / or a decrease in the intensity of the contact below a hysteresis intensity threshold corresponding to the press input intensity threshold. Further, in examples where an operation is described as being performed in response to detecting a decrease in the intensity of the contact below a press input intensity threshold, the operation is optionally performed in response to detecting a decrease in the intensity of the contact below a hysteresis intensity threshold corresponding to and lower than the press input intensity threshold.

[0158] As used herein, an "installed application" refers to a software application that has been downloaded onto an electronic device (e.g., device 100, 300, and / or 500) and is ready to run (e.g., opened) on the device. In some embodiments, a downloaded application becomes an installed application by an installation program that extracts program portions from a downloaded package and integrates the extracted portions with the computer system's operating system.

[0159] As used herein, the terms "open application" or "running application" refer to a software application that has retained state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or running application is, optionally, any one of the following types of application: ● the active application currently displayed on the display screen of the device on which the application is being used; Background applications (or background processes) that are not currently displayed, but for which one or more processes are being processed by one or more processors; and A suspended or hibernated application that is not running but has state information stored in memory (volatile and non-volatile, respectively) and that can be used to resume execution of the application.

[0160] As used herein, the term "closed application" refers to a software application that does not have retained state information (e.g., state information for a closed application is not stored in the device's memory). Thus, closing an application includes stopping and / or removing the application process for the application and removing state information for the application from the device's memory. Generally, opening a second application during a first application does not close the first application. When the second application is displayed and the first application is terminated, the first application becomes a background application.

[0161] Attention is now directed to embodiments of user interfaces (“UIs”) and related processes implemented on an electronic device such as portable multifunction device 100, device 300, or device 500. User Interface and Related Processes Convert handwriting to text

[0162] Users interact with electronic devices in many different ways, including entering text into the electronic device. In some embodiments, the electronic device provides a virtual keyboard (e.g., a soft keyboard) that mimics the layout of a physical keyboard and allows the user to select characters to enter. The embodiments described below provide a method for an electronic device to accept handwritten input from a handwriting input device (e.g., a stylus) and convert the handwritten input into font-based text (e.g., computer text, digital text, etc.). Enhancing interaction with the device reduces the amount of time a user needs to perform an action, thus reducing the device's power usage and increasing battery life for battery-powered devices. It is understood that people use devices. When a person uses a device, that person is optionally referred to as the device's user.

[0163] 6A-6YY illustrate exemplary ways in which an electronic device converts handwritten input into font-based text. The embodiments in these figures are used to illustrate the processes described below, including the processes described with reference to FIGS. 7A-7I.

[0164] 6A-6YY illustrate operation of an electronic device 500 that converts handwritten input into font-based text. FIG. 6A illustrates an exemplary device 500 that includes a touchscreen 504. As shown in FIG. 6A, the electronic device 500 presents a user interface 600. In some embodiments, the user interface 600 is any user interface that includes one or more text entry fields (e.g., text entry areas). In some embodiments, a text entry field (e.g., text entry area) is a user interface element into which a user can enter text (e.g., letters, characters, words, etc.). For example, a text entry field may be a text field on a form, a URL entry element on a browser, a login field, etc. In other words, it is any user interface element into which a user can enter text and perform edits, deletes, copies, cuts, etc., or any other text-based operation. It is understood that a text entry field (e.g., text entry area) is not limited to user interface elements that accept only text, but may also be a user interface element that can accept and display audio and / or visual media.

[0165] In some embodiments, as shown in Figure 6A, user interface 600 is of an internet browser application displaying (e.g., navigating) a passenger information entry user interface (e.g., for purchasing airline tickets). It is understood that the examples shown in Figures 6A-6YY are illustrative and should not be considered limiting to only the illustrated user interfaces and / or applications. In some embodiments, user interface 600 includes text entry fields 602-1 through 602-9 into which a user can enter text to fill in each text entry field (e.g., information about two passengers).

[0166] In Figure 6B, user input is received (e.g., detected) on touchscreen 504 from stylus 203. As shown in Figure 6B, stylus 203 touches down on touchscreen 504. In some embodiments, stylus 203 touches down on touchscreen 504 to provide handwritten input 604-1. For example, as shown in Figure 6B, handwritten input 604-1 is for the character "12." In some embodiments, if the handwritten input is performed entirely within a text input field, the handwritten input is interpreted as a request to enter text within the respective text input field. In some embodiments, if the handwriting is performed within a threshold area near the boundary of a text input field, the handwritten input is still interpreted as a request to enter text within the respective text input field. In some embodiments, text input fields have a margin of error or tolerance such that handwriting that is slightly outside the literal boundaries of the text input field (e.g., 1 mm, 2 mm, 3 mm, 5 mm, 3-point, 6-point, 12-point, etc.) is still considered a request to enter text within the respective text input field. In some embodiments, handwriting that starts outside the boundaries of the text input field but falls within the boundaries of the text input field is considered to be a request to enter text within the respective text input field. In some embodiments, handwriting that has most of its strokes within the text input field is considered to be a request to enter text within the respective text input field. In some embodiments, handwriting that starts within a text input field but extends outside the text input field, and optionally into another text input field, is still considered to be a request to enter text within the respective text input field (e.g., not another text input field).In some embodiments, providing a margin of error or tolerance around the boundaries of the text entry field allows the system to accept handwritten input that is not entirely within the text entry field (e.g., is larger than the text entry field, "misses" the text entry field, or unintentionally extends beyond the boundaries of the text entry field).

[0167] 6B, handwritten input 604-1 is directed toward text input field 602-3. In some embodiments, handwritten input 604-1 begins slightly outside of text input field 602-3 (e.g., within the margin of error or tolerance of text input field 602-3) and / or optionally has the majority of its strokes within the boundaries of text input field 602-3. Thus, in some embodiments, handwritten input 602-1 is interpreted as a request to enter the character "12" into text input field 602-3.

[0168] 6C, the user continues handwriting input 604-1 and writes "1234" in text input field 602-3. In some embodiments, the user further provides handwriting input 604-2, which corresponds to an "E." In some embodiments, handwriting input 604-2 begins outside the boundaries of text input field 602-3, but the majority of handwriting input 604-2 is within the boundaries of text input field 602-3, such that handwriting input 604-2 is considered a request to enter text into text input field 602-3. In some embodiments, whether handwriting input is considered to be a request to enter text into a particular text input field is based on an analysis of each character (e.g., whether each character is considered to be directed at the respective text input field), each word (e.g., whether each word as a whole is considered to be directed at the respective text input field), or the entire sequence of handwriting input (e.g., whether the entire sequence from initial touchdown until the handwriting input pauses for a threshold amount of time (e.g., 0.5 seconds, 1 second, 2 seconds, 3 seconds, 5 seconds) or ends is considered to be directed at the respective text input field).

[0169] In FIG. 6D , the user continues handwriting 604-2 and writes “Elm” in text input field 602-3. In some embodiments, this is after a threshold amount of time (e.g., 0.5 seconds, 1 second, 2 seconds, 3 seconds, 5 seconds) has elapsed since the user entered handwriting input 604-1 (e.g., “1234”). In some embodiments, after the threshold amount of time, device 600 determines that handwriting input 604-1 corresponds to the characters “1234.” In other words, device 600 analyzes handwriting input 604-1 and recognizes the user's writing as the characters “1234.” In some embodiments, handwriting input 604-1 changes color and / or opacity to indicate that handwriting input 604-1 has been recognized by device 500 and / or that handwriting input 604-1 is being converted to font-based text (e.g., computer text, digital text). For example, handwriting input 604-1 turns gray as handwriting input 604-1 is being converted to font-based text. In some embodiments, the color and / or opacity change is part of an animation of converting the handwritten input 604-1 to font-based text (e.g., the handwritten input turns gray for a short period of time, such as 0.2 seconds, 0.3 seconds, 0.5 seconds, 1 second, etc., during the animation of converting the handwritten input to font-based text). In some embodiments, when the handwritten input is received, an animation of the handwritten input changing color and / or opacity (e.g., ink drying effects, etc.) similar to the ink drying animation described below with respect to method 2000 (e.g., and / or described with respect to FIGS. 19B-19I) is displayed. In some embodiments, the ink drying effect animation is performed while the handwritten input is being received (e.g., optionally before the device begins the process of converting the handwritten input to font-based text). In some embodiments, the ink drying effect animation is performed as the handwritten input is converted to font-based text (e.g., as part of the animation of converting the handwritten input to font-based text).

[0170] 6E, the user enters handwritten input 604-3 corresponding to the word "Streat." In some embodiments, handwritten input 604-3 begins within the boundaries of text input field 602-3, ends outside the boundaries of text input field 602-3, and enters the boundaries of text input field 602-4. In some embodiments, handwritten input 604-3 is considered to be a request to enter text into text input field 602-3 (e.g., directed at text input field 602-3), even though handwritten input 604-3 leaves the boundaries of text input field 602-3 and enters the boundaries of text input field 602-4.

[0171] In some embodiments, handwritten input 604-1 is converted to font-based text. In some embodiments, font-based text is text entered using a conventional text entry system, such as a physical keyboard or a soft keyboard. In some embodiments, the text is formatted using a particular font style. For example, font-based text may be 12-point Times New Roman or 10-point Arial. In some embodiments, handwritten input 604-3 is converted after a threshold amount of delay (e.g., 0.5 seconds, 1 second, 2 seconds, 3 seconds, 5 seconds). In some embodiments, visual characteristics of handwritten input 604-3 are changed to indicate that handwritten input 604-3 is being converted (e.g., as depicted in FIG. 6D ), and then handwritten input 604-3 is converted. In some embodiments, the visual characteristics of handwritten input 604-3 do not change before conversion.

[0172] In some embodiments, the size of the handwritten input after conversion is the default font size of the text input field. In some embodiments, the size of the handwritten input changes before the handwritten input is converted to font-based text. In some embodiments, the size of the font-based text matches the size of the handwritten input, in which case the size of the font-based text is changed to match the default size of the text input field (e.g., the size is changed after the animation of changing the handwritten input to font-based text). In some embodiments, the size changes during the animation of the handwritten input to font-based text. In some embodiments, the animation of converting the handwritten input to font-based text includes morphing the handwritten input into font-based text. In some embodiments, the handwritten input is broken down (e.g., into fragments or particles) and reassembled as font-based text (e.g., as described below with respect to method 2000). In some embodiments, the handwritten input dissolves or fades out and dissolves in or fades in the font-based text. In some embodiments, the handwriting input moves toward the final position of the font-based text while dissolving (e.g., aligns itself with the text entry area or any existing text), and the font-based text appears simultaneously while moving toward the final position. Thus, in some embodiments, the handwriting input and the font-based text may be displayed on the display simultaneously during at least a portion of the animation (e.g., to reduce animation time).

[0173] In Figure 6F, the user enters handwritten input 604-4, which corresponds to the characters "Apt." In some embodiments, handwritten input 604-4 is completely outside of any text input field (e.g., both text input fields 604-3 and 602-4). In some embodiments, handwritten input 604-4 is executed in quick succession after handwritten input 604-3, such that it is considered to be in the same sequence of handwritten inputs as handwritten input 604-3 (e.g., 0.25 seconds, 0.5 seconds, 1 second, 2 seconds, and 5 seconds after the writing of handwritten input 604-3). In some embodiments, because handwritten input 604-4 is considered to be in the same sequence of inputs as handwritten input 604-3, handwritten input 604-4 is also considered to be a request to enter text into (e.g., directed at) text input field 602-3.

[0174] 6G illustrates the user lifting the stylus 203 off of contact with the touchscreen 504 after completing writing handwritten inputs 602-4 through 604-4. In some embodiments, in response to lifting the stylus 203 off the touchscreen 504 for a threshold amount of time (e.g., 0.5 seconds, 1 second, 2 seconds, 3 seconds, 5 seconds), the device 500 analyzes, interprets, and converts the handwritten input into font-based text, as shown in FIG. 6H. As shown in FIG. 6H, each of the converted handwritten inputs 604-2 through 604-4 is entered into the text input field 602-3 and is visually aligned with the text input field 602-3 and, optionally, with the converted handwritten input 604-1.

[0175] 6I, after lifting stylus 203 off touchscreen 504 for a threshold amount of time (e.g., 0.5 seconds, 1 second, 2 seconds, 3 seconds, 5 seconds), the user continues to input handwritten input 604-5. However, because the user has paused handwritten input, any further handwritten input is no longer considered to be within the same sequence of handwritten inputs as handwritten input 604-3 and handwritten input 604-4. Thus, in the example shown in FIG. 6I, further handwritten inputs, such as handwritten input 604-5, are analyzed separately to determine which text input field the handwritten input is directed to (e.g., in this case, text input field 602-4).

[0176] 6J , in some embodiments, when a user enters handwritten input 604-5 near or at the end of text input field 602-4 (e.g., within 1 mm, 2 mm, 3 mm, etc.), text input field 602-4 expands horizontally to accommodate the additional handwritten input. For example, after a user writes the character "1," text input field 602-4 optionally expands to provide room for the user to write the character "2," etc. Alternatively, in some embodiments, after a user writes the character "1," text input field 602-4 does not expand. However, after a user writes the character "2" outside of text input field 602-4, text input field 602-4 expands to encompass the character "2."

[0177] In Figure 6K, the user continues entering handwriting input 604-5, writing "1234." In some embodiments, handwriting input 604-5 has reached the end of touchscreen 504 to the point where text input field 602-4 cannot expand further horizontally, so text input field 602-4 expands vertically to provide the user with additional lines to continue entering handwriting input, as shown in Figure 6K.

[0178] In some embodiments, after the user lifts the stylus 203 off the touchscreen 504 for a threshold amount of time (e.g., 0.5 seconds, 1 second, 2 seconds, 3 seconds, 5 seconds), the device 500 analyzes, interprets, and converts the handwritten input (e.g., handwritten input 604-5) to font-based text. In some embodiments, as described above, the user paused the handwriting input for a threshold amount of time (e.g., 0.5 seconds, 1 second, 2 seconds, 3 seconds, 5 seconds) such that the handwritten input 604-5 was not considered a continuation of handwritten input 604-3 or handwritten input 604-5 (e.g., so that the handwritten input could optionally be entered into text input field 602-3), and therefore the handwritten input 604-5 is entered into text input field 602-4 instead of text input field 602-3. In some embodiments, simultaneously with or after the handwritten input 604-5 is converted to font-based text, the text input field 602-4 returns to its original size.

[0179] 6M-6O illustrate alternative ways in which device 500 provides additional space for continued handwriting input when the handwriting input approaches or reaches the end of a text input field. In FIG. 6M, a user provides handwriting input 604-5 at or near the end of text input field 602-4. In some embodiments, as shown in FIG. 6N, handwriting input 604-5 is shifted left from the end of text input field 602-4 to provide the user with room to continue entering handwriting input. In some embodiments, handwriting input 604-5 is shifted left after the user completes writing a character (e.g., after a short lift-off of 0.2 seconds, 0.4 seconds, 0.6 seconds, 1 second, 2 seconds, etc.). In some embodiments, the shifting of handwriting input leftward occurs simultaneously with the widening of the text input field. In some embodiments, after the user lifts the stylus 203 off the touchscreen 504 for a threshold amount of time (e.g., 0.5 seconds, 1 second, 2 seconds, 3 seconds, 5 seconds), the device 500 converts the handwritten input 604-5 into font-based text, as shown in FIG. 6O.

[0180] In FIG. 6P, handwritten input 604-6 is detected (e.g., received) on touchscreen 504 in text input field 602-5. In some embodiments, handwritten input 604-6 is difficult to recognize. For example, device 500's confidence in the written characters in handwritten input 604-6 is below a threshold confidence level (e.g., 25% confidence, 50% confidence, 75% confidence, etc.). In some embodiments, if the confidence in the characters written by the user is below the threshold confidence level, a popup with suggested font-based text is displayed to the user, as shown in FIG. 6Q.

[0181] In some embodiments, the popup 606 appears over the handwritten input 604-6 or otherwise within proximity (e.g., within 5 mm, 1 cm, 1.5 cm, 3 cm, etc.) of the handwritten input 604-6. In some embodiments, the word or character associated with the popup 606 is highlighted. In some embodiments, the popup 606 includes the highest-confidence interpretation of the handwritten input 604-6 (e.g., "Salem"). In some embodiments, the popup 606 includes two or more potential interpretations of the handwritten input 604-6 (e.g., corresponding to one or more selectable options). In some embodiments, the popup 606 is selectable to trigger conversion of the handwritten input 604-6 to a selected interpretation (e.g., as opposed to conversion after a threshold time delay or other time-based heuristic). In some embodiments, the popup 606 appears after the user lifts the stylus 203 off the touchscreen 504 and the device 600 has had the opportunity to analyze and interpret the entire handwritten sequence (e.g., an entire word, an entire sentence, a string of characters, etc.). In some embodiments, popup 606 is displayed at any time while the user is performing handwriting input, and is updated as the user writes additional characters that are recognized by device 500. For example, popup 606 optionally first appears and displays "Sa" after the user writes "Sa." In such an example, when the user writes "l," popup 606 is updated to display "Sal." In some embodiments, after the user writes "em," popup 606 is updated to display "Salem" (e.g., in some embodiments, the popup is updated with a new character after each character, or after several characters).In some embodiments, popup 606 is displayed regardless of the confidence level of the interpretation of the handwritten input (e.g., popup 606 optionally always displays, providing the user with a way to “accept” the proposed font-based text and cause conversion of the handwritten input to the proposed font-based text regardless of the timer being used to determine when to convert the handwritten text to font-based text). In some embodiments, popup 606 includes a selectable option to reject the proposal or otherwise dismiss popup 606. In some embodiments, dismissing the popup or dismissing the proposal does not prevent handwritten input 604-6 from being converted at all. In some embodiments, dismissing the popup or dismissing the proposal prevents handwritten input 604-6 from being converted at that time, but handwritten input 604-6 is still optionally converted at a later time based on other heuristics, such as a timer-based conversion heuristic.

[0182] As shown in Figure 6R, device 500 detects a tap on touchscreen 504 from stylus 203 that selects popup 606. In some embodiments, in response to user input selecting popup 606 (e.g., selecting the selectable option that corresponds to the proposed font-based text "Salem"), device 500 replaces handwritten input 604-6 with font-based text, as shown in Figure 6S. In some embodiments, as described above, replacing (e.g., converting) the handwritten input with font-based text optionally includes changing the size and / or shape of the handwritten input, optionally including performing an animation that converts the handwritten input to the font-based text, and optionally including aligning the font-based text with a text input field (e.g., text input field 602-5) or optionally aligning the font-based text with any existing text in the text input field (optionally in a manner similar to the process described below with respect to method 2000).

[0183] In some embodiments, based on the device 500's confidence level in the written characters in the handwriting input 604-6, the converted font-based text is displayed in a different position within the text input field. For example, if the device 500's confidence level is below a threshold level (e.g., 25% confidence, 50% confidence, 75% confidence, etc.), the converted font-based text is not aligned with any existing text or text input field. Instead, in some embodiments, the converted font-based text is left in the same position as the original handwriting input, indicating to the user that the device 500 is not confident in the conversion. In some embodiments, if the confidence level is above the threshold level, the converted font-based text is aligned with any existing text in the text input field or is aligned to the left of the text input field (e.g., if there is no existing text).

[0184] 6T-6W illustrate embodiments in which a text input field expands its boundaries to provide a more comfortable or natural writing position based on the location of the text input field on the display. In FIG. 6T, user input is detected from stylus 203 touching down (e.g., tap input, long press input (e.g., tap and hold), etc.) on touchscreen 504 in text input field 602-8. In some embodiments, text input field 602-8 is located at or near the bottom of touchscreen 504 (e.g., bottom third, bottom half, bottom quarter, etc.). In some embodiments, it is awkward for a user to write with stylus 203 on the bottom of touchscreen 504 because the user has little or no surface on which to rest the user's palm while writing. Thus, in some embodiments, device 500 determines, based on the location of the text input field with which the user is interacting, that the text input field should expand upward so that the user can provide handwriting input in a less uncomfortable location. Thus, as shown in FIG. 6U, in response to receiving a tap or selection input on text entry field 602-8, the boundaries of text entry field 602-8 expand vertically upward. In some embodiments, text entry field 602-8 expands to the midpoint of the screen, to the two-thirds point of the screen, etc. In some embodiments, text entry field 602-8 expands horizontally and vertically.

[0185] In Figure 6V, user input is received from the stylus 203 providing handwriting input 604-7 writing the word "Bob" in the enlarged text input field 602-8. In some embodiments, the determination of whether the handwriting input is directed to or corresponds to a request to enter text into the enlarged text input field 602-8 is the same as the determination for entering text into a non-enlarged text input field. In some embodiments, after completing the writing of the handwriting input 604-7 (e.g., after liftoff of the stylus 203 and / or detection of further handwriting input for a threshold amount of time (e.g., 0.5 seconds, 1 second, 2 seconds, 3 seconds, 5 seconds)), the handwriting input 604-7 is converted to font-based text, and the text input field 602-8 returns to its original size and shape (e.g., simultaneously with, after, or before the conversion), as shown in Figure 6W.

[0186] In Figure 6X, user input from stylus 203 is detected on touchscreen 504 outside the boundaries of any text entry field. In some embodiments, if the user input does not meet any of the criteria for determining whether the user input is directed at a text entry field or a request to enter text into a text entry field, the user input is not considered to be handwritten text entry. In some embodiments, if the user input is not handwritten text entry, the gestures performed by the user input are not displayed on the screen. In some embodiments, when a user is performing handwritten text entry, the user's handwriting of letters and words appears on the screen at the location and time the input is received. In contrast, in some embodiments, when a user is not performing handwritten text entry, the user's gestures do not appear on the screen. Similarly, in some embodiments, the user input is interpreted as a non-text input command or a non-text input gesture based on the element the user is interacting with and the characteristics of the input. For example, in Figure 6X, device 500 detects that the user is initiating an upward scroll input (e.g., touching down on touchscreen 504 with stylus 203 and moving upward while continuously touching touchscreen 504). In some embodiments, in response to the upward scroll input from stylus 203, user interface 600 is scrolled upward in accordance with the movement of the scroll input, as shown in Figure 6Y. As shown in Figures 6X-6Y, the user's upward gesture while touching down on touchscreen 504 is not displayed on touchscreen 504 (e.g., in contrast to when the user is performing text input using stylus 203).

[0187] 6Z-6MM illustrate an exemplary method for receiving handwritten input within a multi-line text entry field. In FIG. 6Z, device 500 displays user interface 610 including text entry fields 612-1 and 612-2. In some embodiments, text entry field 612-2 is a multi-line text entry field capable of receiving and displaying multiple lines of text. In FIG. 6AA, text 616-1 has been added to text entry field 612-1, and text entry field 612-2 is receiving handwritten input 616-2. In some embodiments, when handwritten input 616-2 reaches or begins to reach the horizontal edge of text entry field 612-2, pop-up 618 is displayed, presenting a selectable option for creating a new line of text for input. In some embodiments, creating a new line of text includes increasing the size of the text entry field vertically (e.g., optionally based on the size of the handwritten input) to accommodate the additional handwritten input. For example, as shown in Figure 6BB, user input is detected with stylus 203 selecting popup 618 to create (e.g., insert) a new line of text. In some embodiments, as a result of the user input, text input field 612-2 expands its bottom boundary downward to create a line of text for the user to provide additional handwritten input, as shown in Figure 6CC.

[0188] In Figure 6DD, an additional handwritten input 616-3 is received from the stylus 203 into the newly created space in the text input field 612-2. In some embodiments, as shown in Figure 6EE, the device 500 receives handwritten input 616-4. In some embodiments, handwritten input 616-4 is received in the text input field 612-2 at a vertical position below handwritten input 616-3. However, in some embodiments, because handwritten input 616-4 is not a threshold distance below handwritten input 616-3 (e.g., overlaps at least partially with the vertical space of handwritten input 616-3, 1 mm below handwritten input 616-3, 2 mm below handwritten input 616-3, etc.), handwritten input 616-4 is not considered to be written on a different line from handwritten input 616-3 and is not considered a request to insert a new line of text.

[0189] In Figure 6FF, handwritten input 616-5 is received beyond a threshold distance of handwritten input 616-3 (e.g., 1 mm, 2 mm, 3 mm, etc. below handwritten input 616-3). In some embodiments, even though handwritten input 616-5 is generally received outside the boundaries of text input field 612-2 (e.g., only slightly overlapping the area of ​​text input field 612-2), handwritten input 616-5 is considered to be a request to enter text on a new line within text input field 612-2 because handwritten input 616-5 was entered immediately after handwritten input 616-4 without a significant delay and / or there are no additional text input fields below text input field 612-2. In some embodiments, in response to receiving handwritten input 616-5 below the threshold distance of handwritten input 616-3, text input field 612-2 creates a new line of text to contain handwritten input 616-5, as shown in Figure 6GG.

[0190] In Figure 6HH, user input is received from stylus 203 tapping on a space in text input field 612-2 below handwritten input 616-5, corresponding to a request to add a new line of text. In some embodiments, in response to receiving the tap input (e.g., a long press input), text input field 612-2 further expands text input field 612-2 to create space for the new line of text, as shown in Figure 6II. In Figures 6JJ-6KK, handwritten input 616-6 is received in the space for the new line of text. In Figure 6LL, after the user completes the handwritten input and lifts stylus 203 off touch screen 504, device 500 optionally converts the handwritten input to font-based text. In some embodiments, after the handwritten input is converted to font-based text, text input field 612-2 returns to its original size and shape, as shown in Figure 6MM. In some embodiments, if the text in the text entry field 612-2 overflows the size of the text entry field 612-2, a scroll bar or navigation element (not shown) is provided to allow the user to view the overflowed text.

[0191] 6NN-6RR illustrate exemplary criteria for converting handwritten input to font-based text. In FIG. 6NN, device 500 displays user interface 620 corresponding to a notepad application. In some embodiments, user interface 620 includes a text entry area 622 in which a user can enter multiple lines of text. In FIG. 6OO, handwritten input 624-1 is received in text entry area 622. In some embodiments, handwritten input 624-1 includes punctuation after one or more characters or words (e.g., a comma in FIG. 6OO). In some embodiments, in response to detecting the punctuation, the handwritten input before and including the punctuation is analyzed and converted to font-based text, as shown in FIG. 6PP. In some embodiments, the conversion is performed after a short time delay (e.g., according to method 1300).

[0192] In Figure 6PP, further handwritten input 624-2 is received in text input area 622. In some embodiments, as shown in Figure 6QQ, handwritten input 624-2 is converted after a specific time delay after the user finishes writing handwritten input 624-2. In some embodiments, device 500 recognizes handwritten input 624-2 as a word that the user has finished writing, at which time handwritten input 624-2 is converted. In some embodiments, handwritten input 624-2 is converted after device 500 detects that the user has started writing on a different line from handwritten input 624-2 (e.g., handwritten input 624-3). In Figure 6QQ, handwritten input 624-3 is received in text input area 622. In some embodiments, handwritten input 624-3 includes a word (e.g., "o'clock") to which additional characters cannot be added. In some embodiments, when device 500 detects that no additional characters can be added to a recently written word, the handwritten input up to the word to which no additional characters can be added is analyzed and converted to font-based text, as shown in FIG. 6RR. In some embodiments, the word to which no additional characters can be added is a word to which no further characters can be added to create a valid word based on the device's default dictionary. In other words, any additional characters to that word would create a non-existent word (e.g., no combination of additional characters would create a valid word). In some embodiments, handwritten input 624-3 is converted to font-based text because the user has written a threshold number of words (e.g., three words, five words, six words, etc.).

[0193] 6SS-6YY illustrate an exemplary method for transmitting font-based text from a first electronic device to a second electronic device. In FIG. 6SS, device 500 is in communication with device 631. In some embodiments, device 631 is a set-top box or other electronic device (e.g., device 580) in communication with display 632. In some embodiments, device 500 communicates with device 631 wirelessly via a wireless communication protocol (e.g., WiFi, WiFi Direct, NFC, IR, RF, etc.). In some embodiments, device 631 is in communication with other electronic devices, such as device 590 and / or device 591, that can remotely control device 631. In some embodiments, as shown in FIG. 6SS, device 631 displays user interface 634 that includes text entry field 636. Thus, in some embodiments, device 631 expects user input to enter text into text entry field 636. In some embodiments, device 500 displays user interface 630 corresponding to a remote control application for remotely controlling device 631. In some embodiments, user interface 630 includes a text entry area that can accept handwritten input. For example, in FIG. 6TT, handwritten input 638 is detected within the text entry area of ​​user interface 630. In some embodiments, after receiving handwritten input 638 (or while receiving handwritten input 638), handwritten input 638 is converted to font-based text, as shown in FIG. 6UU. In some embodiments, in response to converting handwritten input 638 to font-based text (or simultaneously with converting handwritten input 638 to font-based text), text is transmitted to device 631 and, optionally, entered and displayed within text entry field 636.

[0194] 6VV-6YY illustrate alternative exemplary methods of transmitting font-based text from a first electronic device to a second electronic device. In some embodiments, as shown in FIG. 6VV, device 631 displays one or more text input fields (e.g., text input fields 644-1 through 644-4) on user interface 642. In some embodiments, device 631 transmits data regarding the one or more text input fields to device 500 (or device 500 otherwise receives data regarding the one or more text input fields). In some embodiments, device 500 displays one or more text input fields on user interface 640. In some embodiments, the one or more text input fields mimic the position and arrangement of corresponding text input fields on display 632. In some embodiments, device 500 does not mimic the position and arrangement of the text input fields.

[0195] In Figure 6WW, handwritten input 648 is received in text input field 646-1 on user interface 640 of device 500. In some embodiments, after the user completes handwritten input 648 and lifts off stylus 203 (e.g., as shown in Figure 6XX), device 500 converts handwritten input 648 to font-based text, as shown in Figure 6YY. In some embodiments, after or simultaneously with converting handwritten input 648 to font-based text, device 500 transmits the text to device 631. In some embodiments, in response to receiving the text, device 631 enters and displays the received text in text input field 644-1 (e.g., corresponding to text input field 646-1).

[0196] Figures 7A-7I are flow diagrams illustrating a method 700 for converting handwritten input to font-based text. Method 700 is optionally performed on an electronic device such as device 100, device 300, device 500, device 501, device 510, and device 591 as described above with reference to Figures 1A-1B, 2-3, 4A-4B, and 5A-5I. Some operations in method 700 are optionally combined and / or the order of some operations is optionally changed.

[0197] As described below, method 700 provides a way to convert handwritten input into font-based text. This method reduces the cognitive burden on a user when interacting with the user interface of a device of the present disclosure, thereby creating a more efficient human-machine interface. For battery-operated electronic devices, improving the efficiency of the user's interaction with the user interface conserves power and increases the time between battery charges.

[0198] In some embodiments, an electronic device in communication with a touch-sensitive display (e.g., an electronic device such as device 100, device 300, device 500, device 501, or device 591, a mobile device including a touchscreen (e.g., a tablet, smartphone, media player, or wearable device), or a computer including a touchscreen) displays (702) a user interface including a first text entry area (e.g., a user interface having a text field or text entry area into which a user can enter text) on the touch-sensitive display, as in FIG. 6A . For example, the user interface is in a form having multiple text fields (or text entry areas), and selection of a particular text field (e.g., with a finger) optionally displays a soft keyboard for entering text into the text field. In some embodiments, a physical keyboard is optionally used to enter text into each text field.

[0199] In some embodiments, while displaying the user interface, the electronic device receives (704) user input via the touch-sensitive display, including handwritten input directed to a first text entry area, such as in FIG. 6B (e.g., receiving handwritten input on or near the text field (or text entry area)). In some embodiments, the user input is received from a stylus or other writing device. In some embodiments, the user input is received from a finger. In some embodiments, handwritten input is directed to a first text entry field when the handwritten input is received at a location on or near the text entry field (or text entry area). In some embodiments, handwritten input indicating a request to enter text into the text entry field (or text entry area) is considered to be directed to the first text entry field. For example, handwritten input beginning in a text field (or text entry area) optionally indicates that the entire sequence of handwritten input is intended to be entered within the text field (or text entry area), even if a portion (e.g., some or all) of the handwritten input extends outside the text field (or text entry area). In some embodiments, user input that begins outside the text field (or text entry area), but that results in a substantial amount of handwriting within the text field (or text entry area), is optionally considered to be an intent to enter text within the text field (or text entry area) (e.g., 30%, 50%, etc. falls within the text field or text entry area). In some embodiments, the text entry field (or text entry area) includes a predetermined margin of error where handwriting within a certain distance from the text entry field (or text entry area) is considered to be handwriting within the text entry field (or text entry area).In some embodiments, user input that is completely outside the text field (or text entry area) is considered to be an intent to enter text into the text field (or text entry area) if the timing of the input indicates that the input is a continuation of handwritten input that should be entered into the text field (e.g., the user continues writing without a pause or with a short pause, and the writing extends beyond the text field).

[0200] In some embodiments, while receiving user input, the electronic device displays (706) a representation of the handwriting input in a user interface at a location corresponding to the text input area, such as in FIG. 6B (e.g., displays a handwriting path on the display at the location where the handwriting input is received as the input is received). In some embodiments, as the user “draws” on the touch-sensitive display, the display shows the user’s handwriting input at the location where the input was received. In some embodiments, if handwriting input is received in a text field, the handwriting path is shown in the text field. More generally, in some embodiments, the handwriting path is shown wherever handwriting input is received on the touch-sensitive display. In some embodiments, displaying the handwriting input occurs after receipt of each character, word, sentence, or the like. In some embodiments, user input using an input device (e.g., a stylus, a finger, etc.) that is not determined to be handwriting input (e.g., input not directed at a text input field or area) does not cause a simultaneous display of the input path.

[0201] In some embodiments, after displaying a representation of the handwritten input in the user interface (708), as in FIG. 6E (e.g., after finishing handwriting input or after starting handwriting input while the user is still entering additional handwritten input), pursuant to a determination that the user input meets one or more first criteria (e.g., replacing the handwritten input with text (e.g., computer text) optionally depends on several criteria including timing of writing, use of particular words and / or characters, punctuation, sentence structure of the handwritten input, and / or interaction with other user interface elements), as in FIG. 6E , the electronic device stops displaying at least a portion of the representation of the handwritten input and displays font-based text corresponding to at least a portion of the representation of the handwritten input in the text entry area (710) (e.g., removes at least a portion of the handwritten input on the display and displays computerized text (e.g., font-based text) corresponding to the removed portion of the handwritten input in the text entry field).

[0202] In some embodiments, this substitution occurs while input is being received (e.g., a first portion of handwritten input is replaced while the user is still entering a second portion of handwritten input). In some embodiments, the substitution occurs after input has ended (e.g., after a threshold amount of time without receiving handwritten input, after the user has finished writing a word or sentence, or after some other end-of-input criterion has been met). In some embodiments, the substitution occurs after displaying suggested text to the user and receiving input to select or confirm the suggested text.

[0203] In some embodiments, the system determines the characters and / or words written by the user in the handwritten input and converts them to computerized text. For example, the handwritten input is optionally replaced with text in 12-point Times New Roman font (e.g., or other suitable font). In some embodiments, the font-based text is 10-point size, 12-point size, etc., and optionally in Arial, Calibri, Times New Roman, etc. In some embodiments, the computerized text (e.g., font-based text) replaces the handwritten input. In some embodiments, the font-based text is displayed before or after a portion of the handwritten input is removed from the display (e.g., 0.5 seconds before or after, 1 second before or after, 3 seconds before or after, etc.). In some embodiments, an animation is shown of converting the handwritten input to computerized text or otherwise removing the handwritten input and displaying the computerized text. In some embodiments, the location of the computerized text is superimposed over the location where the handwritten input was before conversion. In some embodiments, the computerized text is smaller in size than the handwritten input (e.g., the font size is smaller than the handwritten input). In some embodiments, the handwritten input is converted to font-based text having the same size as the handwritten input (e.g., the size of the font-based text matches the handwritten input), and then the font-based text is updated to its final size (e.g., the default size of the font-based text or the default size of the text entry area). In some embodiments, the size of the handwritten input is changed to the final size of the font-based text (e.g., the default size of the font-based text or the default size of the text entry area), and then the handwritten input is converted to font-based text (e.g., with its final size matching the final size of the handwritten input). In some embodiments, the size of the handwritten input is not changed, and the font-based text appears already at its final size without changing from its initial size to its final size to match the size of the handwritten input.Similarly, in some embodiments, the position of the text is optionally updated before or after the conversion. In some embodiments, the handwritten input is moved to a final position before the conversion, and the font-based text appears (e.g., as it is converted) at the position of the handwritten input before it moved to its final position, or the font-based text appears (e.g., as it is converted) at the final position without animation moving the font-based text from its initial position to its final position. In some embodiments, the animation includes any combination (e.g., and in any order) of changing size and / or position of the handwritten input or font-based text, resulting in a final position and size from the initial position and size of the handwritten input. In some embodiments, regardless of the size of the user's writing, the representation of the handwritten text is displayed at the final size of the font-based text (e.g., the default size of the font-based text or the default size of the text entry area). In some embodiments, as a result of the conversion operation, the font-based text is provided to the text entry or text entry area as text input. In some embodiments, the animation of the conversion of handwritten text to font-based text is similar to or shares similar characteristics with the conversion of handwritten input to font-based text described below with respect to method 2000. In some embodiments, when the handwritten input is converted to font-based text, an animation is displayed in which the handwritten input dissolves into the particle and moves to where the font-based position appears, similar to the animation described below with respect to method 2000 (e.g., and / or described below with respect to Figures 19I-19N and / or with respect to Figures 19O-19V).

[0204] In some embodiments, after displaying a representation of the handwriting input in the user interface (708), as in FIG. 6C (e.g., after finishing handwriting or starting handwriting while the user is still entering additional handwriting input), pursuant to a determination that the user input does not satisfy one or more first criteria, the electronic device maintains display of the representation of the handwriting input without displaying font-based text in the text input area (712), as in FIG. 6C (e.g., does not convert the handwriting input to font-based text if the criteria for converting text are not met). In some embodiments, after the criteria are met (e.g., if the criteria are related to timing or if more input is required to satisfy the criteria for converting text), the handwriting input is converted at a later time. In some embodiments, the handwriting input cannot be recognized and is not converted to computer text. In some embodiments, unrecognized handwriting input is ignored or interpreted as a command. In some embodiments, the trail of the handwriting input remains on the display and is not removed. For example, the handwriting input is interpreted as a drawing instead of handwriting input, and thus the drawing remains displayed in the text input area.

[0205] The above-described method of converting handwritten input to text (e.g., by receiving input at or near a text input field and replacing the handwritten input with text if certain criteria are met) allows an electronic device to provide a user with the ability to input text by writing directly on a user interface (e.g., by accepting handwritten input, automatically determining text corresponding to the handwritten input, and entering the text into the respective text input field). This simplifies the interaction between the user and the electronic device (e.g., by allowing the user to handwrite text directly on a touchscreen display without requiring the user to select the respective text field and then enter the text into the text field using a keyboard (e.g., a physical or virtual keyboard), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently while reducing errors in device use.

[0206] In some embodiments, displaying font-based text corresponding to at least a portion of the representation of the handwritten input in the text entry area occurs while continuing to receive handwritten input (e.g., displaying font-based text while still receiving handwritten input), as in FIG. 6B (714). In some embodiments, the handwritten input is converted “live” as the input is received. In some embodiments, the conversion occurs after each word (or, optionally, after every two, three, four words, etc.). In some embodiments, the conversion occurs after a specified time delay. In some embodiments, the conversion occurs after some trigger event. In some embodiments, when the conversion is “live,” the handwritten input is converted to font-based text while the user is still writing additional words or characters.

[0207] The above-described method of converting handwritten input to text (e.g., by displaying font-based text while continuing to receive handwritten input) allows an electronic device to provide a user with the ability to receive immediate feedback on the text the user is writing (e.g., by accepting handwritten input and converting it to text while the user continues to provide handwritten input). This simplifies the interaction between the user and the electronic device (e.g., by allowing the user to verify that the conversion is correct without having to wait until all of the input is converted at once or until a separate input is performed to trigger the conversion), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently while reducing errors in device use.

[0208] In some embodiments, displaying font-based text corresponding to at least a portion of the representation of the handwritten input in the text entry area occurs in response to detecting a pause in the handwritten input that is longer than a time threshold (e.g., 0.5, 1, 2, 3, 5 seconds) (716), as in FIG. 6H (e.g., performing conversion of the handwritten input to font-based text after the user pauses the handwritten input for a certain time threshold). For example, if the user writes a particular phrase and stops writing for a threshold amount of time, the system converts the phrase to font-based text. In some embodiments, after the pause provides a balance between improving text recognition and reducing delays in converting the handwritten text, recognition of the text is improved by converting the handwritten text by considering strings of words.

[0209] The above-described method of converting handwritten input to text (e.g., by displaying font-based text after a pause in handwriting input) allows an electronic device to convert handwritten text without unnecessarily disrupting a user (e.g., by converting handwritten text after a user pauses handwriting input). This simplifies the interaction between a user and the electronic device, enhances the usability of the electronic device, and makes the user-device interface more efficient by allowing a user to use the electronic device more quickly and efficiently while reducing errors in device use.

[0210] In some embodiments, after displaying the representation of the handwritten input within the user interface, as in FIG. 6Q, the electronic device simultaneously displays (718) on the touch-sensitive display at least a portion of the representation of the handwritten input (720), as in FIG. 6Q, and selectable options (724) corresponding to font-based text that corresponds to at least the portion of the representation of the handwritten input (e.g., displaying a popup or other type of dialog box having one or more selectable options that, when selected, cause the system to convert the portion of the representation of the handwritten input to font-based text), as in FIG. 6Q. In some embodiments, the selectable options are suggestions of font-based text after converting the portion of the handwritten input. In some embodiments, the popup is displayed when the confidence in the recognition of the handwritten input falls below a certain threshold. For example, if the system is unsure of what the user's handwritten input is, the popup can provide the user with one or more choices of what to convert the handwritten input to. In some embodiments, if the user continues to handwrite while the popup is displayed, the suggested text in the popup continues to update based on the continued handwritten input. For example, the handwritten input continues to be interpreted and evaluated, and the suggestions continue to update to reflect new characters or words added to the handwritten input. In some embodiments, a popup is displayed for each word, in some embodiments, a popup is displayed for the entire handwritten input, in some embodiments, a popup is displayed for a subset of words in the handwritten input (e.g., 2 words, 3 words, 4 words, etc.).

[0211] In some embodiments, ceasing the display of at least a portion of the representation of handwritten input and displaying font-based text corresponding to at least a portion of the representation of handwritten input in the text entry area occurs in response to detecting a selection of a selectable option (726), as in FIG. 6S (e.g., the conversion occurs in response to the user selecting a selectable option). In some embodiments, if the user does not select a selectable option, the conversion is not performed. In some embodiments, the conversion is performed at a later time (e.g., when another selectable option is presented to the user or when other conversion criteria are met). In some embodiments, if the user is presented with multiple suggestions of font-based text, the option selected by the user is the option that is displayed.

[0212] The above-described method of presenting handwriting conversion options to a user (e.g., by displaying selectable options for converting handwritten text) enables an electronic device to present a user with options for whether to convert handwritten text and what to convert the handwritten text to (e.g., by converting the handwritten text when the user selects a selectable option and confirms the conversion). This simplifies the interaction between the user and the electronic device (e.g., by allowing the user to visually verify the conversion and approve and / or confirm the conversion without requiring the user to confirm the conversion after the conversion and then make any necessary edits if the conversion is incorrect), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently while reducing errors in device use.

[0213] In some embodiments, as in FIG. 6G , the text input area includes a text input field (728) (e.g., font-based text is entered into the text field to which the user's handwriting input is directed). In some embodiments, the determination of which text field the user's handwriting input is directed is based on characteristics of the handwriting input. In some embodiments, if the handwriting input is biased within a given text field, the font-based text is entered into the given text field. In some embodiments, if the handwriting input starts in a given text field, the font-based text is entered into the given text field. In some embodiments, if the handwriting input ends in a given text field, the font-based text is entered into the given text field. In some embodiments, if the handwriting input overlaps more than one text input field, the font-based text is entered into the text input field that more of the handwriting input overlaps. In some embodiments, if the handwriting input is entirely outside of a text input field, but part of the determined sequence of words is entered into a given text input field, the entirely outside handwriting input is entered into the given text field.

[0214] The above-described method for inputting font-based text (e.g., by converting the font-based text and entering it into a text input field) enables an electronic device to input a user's handwritten input into an appropriate text field (e.g., by converting the handwritten text and displaying the font-based text in a text input field that accepts the font-based text). This simplifies interaction between the user and the electronic device (e.g., by entering the converted text into the appropriate text field without requiring the user to precisely provide the handwritten input into the desired text input field and without requiring the user to separately move the converted text into the text input field after conversion), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0215] In some embodiments, as in FIG. 6G , at least a portion of the handwritten input includes handwritten input detected within the boundaries of the text input area and handwritten input detected outside the boundaries of the text input area (730) (e.g., handwritten text that partially overlaps a given text input area but also extends outside the given text input area is optionally entered within the given text input area). In some embodiments, if the handwritten input starts in a given text field, the font-based text is entered into the given text field. In some embodiments, if the handwritten input ends within a given text field, the font-based text is entered into the given text field. In some embodiments, if the handwritten input overlaps more than one text input field, the font-based text is entered into the text input field that is overlapped by more of the handwritten input.

[0216] The above-described method of accepting handwritten input (e.g., by recognizing handwritten input both inside and outside the text input area as directed at the text input area) enables the electronic device to provide users with compatibility with natural handwriting characteristics (e.g., by accepting handwritten text that potentially extends outside the text input area but is not entirely within the text input area). This simplifies interaction between the user and the electronic device (e.g., by accepting natural handwritten input that may be large and extend outside a given text input area without requiring the user to write entirely within the given text input area for the handwritten input to be accepted), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing users to use the electronic device more quickly and efficiently.

[0217] In some embodiments, as in FIG. 6B , handwriting detected within the margins of an error region that is larger than and surrounds the text entry region is eligible to be converted to font-based text within the text entry region, and handwriting detected outside the margins of the error region is ineligible to be converted to font-based text within the text entry region (732). (E.g., the area in which handwriting is accepted as being directed to a given text entry region is a predetermined size that is larger (e.g., 10%, 20%, 30% larger) than the text entry region.) In some embodiments, if a portion of a user's handwriting extends beyond the predetermined text entry region but remains within the margins of the error region of the text entry region, the entire handwriting input is recognized as being directed to the given text entry region. In some embodiments, if the handwriting input extends beyond the margins of the error region, the handwriting input is not considered to be directed to the given text entry region. In some embodiments, if the handwritten input extends beyond the margin of the error region, the portion of the handwritten input that is within the margin of the error region is processed and optionally converted, while the portion of the handwritten input that is outside the margin of the error is not processed and optionally converted (optionally, some of the handwritten input is maintained on the display).

[0218] The above-described method of accepting handwritten input (e.g., by providing an error area margin around a text input area where the handwritten input is eligible to be converted to font-based text) enables an electronic device to provide users with compatibility with natural handwriting characteristics (e.g., by accepting handwritten text that potentially extends outside of the text input area and is not entirely within the text input area). This simplifies the interaction between the user and the electronic device (e.g., by accepting natural handwritten input that may be large and extend outside of a given text input area without requiring the user to write entirely within the given text input area for the handwritten input to be accepted), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing users to use the electronic device more quickly and efficiently.

[0219] In some embodiments, as in FIG. 6E , the electronic device receives (734) a second user input via the touch-sensitive display (e.g., receives a continuation of the handwriting input) including handwriting input directed to a second text entry area in the user interface. In some embodiments, the second user input is an input within a sequence of one or more handwriting inputs. In some embodiments, the second user input follows the first user input in quick succession. In some embodiments, the second user input is not directed to the first text entry area. In some embodiments, the second user input is directed to the second text entry area, or even a non-text entry area (e.g., a space on the user interface that is not associated with a text entry area, such as a space between two text fields).

[0220] In some embodiments, after receiving the second user input (736), pursuant to a determination that the second user input satisfies one or more second criteria, including criteria that are met when the second user input is detected within a time threshold of the user input, the electronic device displays font-based text corresponding to the second user input in the text input area (738), as in FIG. 6H (e.g., if the second user input is received (e.g., within the time threshold of the previous handwriting input) and the system determines that it is associated with a sequence of handwriting inputs directed at the text input area, converted text is entered into the text input area and not into the second input area, even though the second user input is directed at the second text input area). In some embodiments, the time threshold is 0.5 seconds, 1 second, 2 seconds, 3 seconds, 5 seconds, etc.

[0221] In some embodiments, after receiving the second user input (736), in accordance with a determination that the second user input does not satisfy one or more second criteria, the electronic device displays font-based text corresponding to the second user input in the second text entry area (740), as in FIG. 6L (e.g., if the second user input is received after a threshold amount of delay, the second user input is not considered to be associated with a sequence of handwritten input directed to the text entry area). In some embodiments, the second user input is then interpreted as being directed to the second text entry area, and the converted text is entered into the second text entry area instead of the text entry area.

[0222] The above-described method of converting handwritten input (e.g., by entering subsequent handwritten input into a given text input area even if the subsequent handwritten input is directed to another text input area) enables an electronic device to provide users with a compatibility with natural handwriting characteristics (e.g., by accepting continued handwritten text that is entirely outside of a given text input area and potentially directed to another text input area, as long as the continued handwritten text is within a certain time threshold from the previous handwritten text directed to the given text input area). This simplifies the interaction between the user and the electronic device (e.g., by accepting natural handwritten input without requiring the user to pause the handwritten input and reposition the handwritten input into the desired text input area or to separately move the converted text from the second text input area to the text input area after conversion), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing users to use the electronic device more quickly and efficiently.

[0223] In some embodiments, the one or more second criteria include a criterion that is met when a majority of the second user input is directed toward the text entry area rather than the second text entry area, as in FIG. 6G, and a criterion that is not met when a majority of the second user input is directed toward the second text entry area rather than the text entry area, as in FIG. 6K (742) (e.g., if the second (e.g., continuous) handwriting input is performed more within the text entry area (e.g., with or without a margin of error) than within the second text entry area (e.g., with or without consideration of the space between the text entry area and the second text entry area), the second criterion is met and the converted text of the second user input is entered into the text entry area rather than the second text entry area). In some embodiments, if a majority of the second user input is within the second input area (e.g., with or without a margin of error), the second criterion is not met and the converted text is optionally entered into the second user input.

[0224] The above-described method of converting handwritten input (e.g., by entering subsequent handwritten input into a given text input area when the majority of the subsequent handwritten input is directed toward that text input area rather than another text input area) enables the electronic device to provide users with a compatibility with natural handwriting characteristics (e.g., by accepting continued handwritten text extending outside of a given text input area when the majority of the continued handwritten text is within the given text input area). This simplifies the interaction between the user and the electronic device (e.g., by allowing the user to continue natural handwriting input without requiring the user to pause the handwriting input and reposition the handwritten input into the desired text input area or to separately move the converted text from the second text input area to the text input area after conversion), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing users to use the electronic device more quickly and efficiently.

[0225] In some embodiments, displaying font-based text corresponding to at least a portion of the representation of the handwritten input within the text input area (744), as in Figures 6D-6E, includes: after detecting font-based text corresponding to at least a portion of the representation of the handwritten input but before committing the font-based text to the text input area, displaying the font-based text with a first value for the visual characteristics (746) (e.g., updating one or more visual characteristics of the handwritten input to indicate that the handwritten input has been detected as text that can be interpreted and converted to font-based text), as in Figure 6D; and after committing the font-based text to the text input area, displaying the font-based text with a second value for the visual characteristics different from the first value (748) (e.g., updating one or more visual characteristics of the font-based text to indicate that the font-based text is now committed (e.g., entered) into the text input area), as in Figure 6E. In some embodiments, updating the handwritten input includes changing the color and / or opacity of the handwritten input. In some embodiments, alternatively or additionally, the font-based text is displayed with a particular visual characteristic (e.g., gray) to indicate that the font-based text is tentatively proposed font-based text (e.g., after converting handwritten input) and is committed (e.g., formally entered into the text entry area) after a particular time delay (e.g., 0.5 seconds, 1 second, 2 seconds, 3 seconds, 5 seconds). In some embodiments, the font-based text is updated to black or an otherwise default color and / or size of the text entry area.

[0226] The above-described method of displaying font-based text (e.g., by displaying the font-based text with a first visual characteristic before committing the text to a text input field and by displaying the font-based text with a second visual characteristic after committing the text to the text input field) enables the electronic device to provide feedback to the user regarding the progress of converting the user's handwritten text (e.g., by displaying the font-based text with a first visual characteristic before committing the font-based text to a text input field and with a second visual characteristic after committing the text). This simplifies the interaction between the user and the electronic device (e.g., by providing the user with visual feedback regarding the progress of converting the handwritten input to font-based text), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0227] In some embodiments, displaying font-based text corresponding to at least a portion of the representation of the handwritten input within the text entry area (750), as in Figures 6D and 6H, includes: displaying the font-based text with a first value for each visual characteristic in accordance with a determination that the detection of the font-based text has a first confidence level (752) (e.g., displaying the font-based text in a particular color or opacity based on the level of confidence in the interpretation of the handwritten input), as in Figure 6D; and displaying the font-based text with a second value for each visual characteristic that is different from the first value in accordance with a determination that the detection of the font-based text has a second confidence level that is different from the first confidence level (754), as in Figure 6H (e.g., displaying the font-based text with different visual characteristics if the system does not have high confidence in converting the handwritten input (e.g., if the handwritten input is sloppy or otherwise difficult to interpret) than if the system has high confidence in the interpretation). For example, if the system has high confidence in converting the handwritten input into a given font-based text, the font-based text is displayed in black. For example, if the system has low reliability, font-based text may be displayed in gray or red.

[0228] The above-described method of providing visual feedback (e.g., by displaying font-based text with first visual characteristics when confidence in the interpretation and conversion is at a first level and by displaying font-based text with second visual characteristics when confidence in the interpretation and conversion is at a second level) enables an electronic device to provide a user with visual feedback of the reliability and / or accuracy of the conversion. This simplifies the interaction between the user and the electronic device (e.g., by providing the user with a visual cue of the confidence level of the conversion of the user's handwritten user input and therefore providing the user with an indication of whether to confirm that the conversion is accurate), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently while reducing errors in device use.

[0229] In some embodiments, displaying font-based text corresponding to at least a portion of the representation of the handwritten input within the text entry area (756), as in Figure 6S, includes: displaying the font-based text at a first position within the text entry area (758), as in Figure 6S, in accordance with a determination that the detection of the font-based text has a first confidence level (e.g., the font-based text is displayed at a different position within the text entry area based on the confidence level of the conversion); and displaying the font-based text in the text entry area (760), as in Figure 6S, in a second position different from the first position, in accordance with a determination that the detection of the font-based text has a second confidence level different from the first confidence level (e.g., if the confidence level of the conversion is low, the font-based text is optionally left in the same position as the original handwritten input). For example, if the confidence in the conversion is high, the font-based text is moved to be left-aligned within the text entry area (e.g., if the text entry area is empty) or otherwise aligned with other text within the text entry area. In some embodiments, if the confidence level of the conversion is low, the handwritten input is converted and left in the same position to allow the user to verify whether the conversion is accurate before aligning the text with other text in the text entry area (e.g., or aligning the text to the left if the text entry area is empty). In some embodiments, a separate user input is required to confirm or otherwise accept font-based text with low confidence.

[0230] The above-described method of displaying font-based text (e.g., by displaying the font-based text in a location based on a confidence level of the conversion of the text from handwritten input) enables an electronic device to provide a user with visual feedback of the reliability and / or accuracy of the conversion. This simplifies the interaction between the user and the electronic device (e.g., by not moving the font-based text to its final location, thereby providing the user with a visual cue of the confidence level of the conversion of the user's handwritten user input and thus providing the user with an indication of whether to confirm that the conversion is accurate), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently while reducing errors in device use.

[0231] In some embodiments, as in FIGS. 6A-6RR, the one or more first criteria may include timing characteristics of the handwritten input (e.g., converting text after handwritten input has stopped for a predetermined period of time), a context associated with the handwritten input (e.g., converting a word written by a user to font-based text if no further characters can be added to the word), punctuation within the handwritten input (e.g., if a user writes a punctuation symbol such as a period, converting the text written up to that punctuation symbol), the distance of the stylus from the touch-sensitive display (e.g., converting the handwritten input entered up to that point when the user puts the stylus down or moves the stylus away from the device a threshold distance (e.g., 6 inches, 12 inches, 2 feet, etc.)), input directed to a second text entry area within the user interface (e.g., converting handwritten text entered in a first text entry area when a user begins entering text in another text entry area), or the user interface. The system includes one or more criteria that are satisfied based on scrolling input (e.g., converting previously entered handwritten input when a user interacts with the user interface to scroll or otherwise navigate around the user interface), the angle of the stylus (e.g., converting previously entered handwritten input when a user points the stylus away from the device), the distance of handwritten input from the edge of the text entry area (e.g., converting text faster when a user reaches the end of a text entry area to make room for the user to perform more handwritten input), a gesture detected on the stylus (e.g., converting previously entered handwritten input by detecting user input tapped on the stylus), or input from a finger detected on a touch-sensitive display (e.g., converting handwritten text entered by the stylus before user input from the finger when user input is received from a finger instead of a stylus) (762).

[0232] The above-described method of converting handwritten input (e.g., by converting handwritten text based on several different factors) enables an electronic device to select the most appropriate time to convert handwritten text based on the situation (e.g., by converting text based on the input, context, punctuation, stylus distance and angle, the input interacting with other elements, etc.). This simplifies the interaction between the user and the electronic device (e.g., by converting text at a time that disrupts the user as little as possible while balancing the speed at which the text is converted), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0233] In some embodiments, while receiving the user input, pursuant to a determination that one or more second criteria are met, as in FIG. 6N , the electronic device moves at least a portion of the representation of the handwritten input within the user interface to make room for receiving additional handwritten input within the user interface (764) (e.g., while receiving the handwritten user input, moving the handwritten user input to provide room within the text input area for the user to continue providing further handwritten input). For example, as the handwritten user input is received, the previously provided handwritten input is scrolled to the left. In some embodiments, as a result of the scrolling, the user can continue writing in the same position or the user's writing is simply shifted slightly to the right. In some embodiments, text that is scrolled to the left scrolls beyond the boundaries of the text input area, in which case the text is displayed above the text input area (e.g., scrolls beyond the text input area and is not hidden from view) or behind the text input area (e.g., scrolls beyond the text input area, but any text that exceeds the boundaries of the text input area is displayed as being obscured by the boundaries of the text input area).

[0234] The above-described method of receiving handwritten input (e.g., by moving previous handwritten input as handwritten input is received to provide room for more handwritten input) enables the electronic device to provide a space for the user to provide handwritten input (e.g., by spatially moving previously entered handwritten input to provide room to receive more handwritten input). This simplifies the interaction between the user and the electronic device (e.g., by allowing the user to continue providing handwritten input without having to reset the position of the user's input to ensure that the user's input remains within the text input area), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0235] In some embodiments, pursuant to a determination that one or more third criteria are met while receiving user input, the electronic device expands the boundaries of the text entry area to create space within the text entry area to receive additional handwritten input (766), as in FIG. 6J (e.g., expanding the text entry area horizontally and / or vertically when the user reaches the boundaries of the text entry area to provide space for the user to continue entering handwritten input). In some embodiments, the text entry area expands into the boundaries of another text entry area, where the text entry area covers or is otherwise displayed on top of the other text entry area. In some embodiments, after the user completes the handwritten input and / or the handwritten input is converted to font-based text, the text entry area shrinks back to its original size.

[0236] The above-described method of receiving handwritten input (e.g., by expanding the size of the text input area) allows the electronic device to provide the user with space to provide handwritten input (e.g., by expanding the text input area horizontally and / or vertically to provide room to receive additional handwritten input when the user begins to reach the boundaries of the text input area). This simplifies the interaction between the user and the electronic device (e.g., by allowing the user to continue providing handwritten input within the text input area), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0237] In some embodiments, expanding 768 a boundary of the text entry area, as in FIG. 6J , includes expanding 770 a first boundary of the text entry area, as in FIG. 6J , in accordance with determining that the text entry area is in a first position within the user interface (e.g., expanding the text entry area vertically upward if the text entry area is in a particular predefined position on the touchscreen, such as the bottom third of the touchscreen). In some embodiments, expanding the text entry area vertically upward allows a user to provide handwriting input in a more comfortable or natural handwriting position. For example, writing in the bottom third of a touchscreen may be potentially awkward or uncomfortable, and by expanding the text entry area vertically upward, a user may avoid the awkward or uncomfortable handwriting position.

[0238] In some embodiments, expanding (768) a boundary of the text entry area, as in Figure 6K, includes expanding (772) a second boundary of the text entry area without expanding the first boundary of the text entry area pursuant to a determination that the text entry area is in a second location within the user interface that is different from the first location, as in Figure 6K (e.g., not expanding the text entry area vertically upward if the text entry area is not in a predefined location on the touchscreen, such as the bottom third of the touchscreen). In some embodiments, the text entry area expands vertically downward and / or horizontally to the right to provide a natural expansion of space for handwriting (e.g., because natural handwriting progression is left-to-right and top-to-bottom, the natural expansion of the text entry area is horizontally to the right and vertically downward, as opposed to expanding vertically upward when the text entry area is in the bottom third of the touchscreen).

[0239] The above-described method of receiving handwritten input (e.g., by expanding the boundaries of the text input area based on the position of the text input area on the screen) enables the electronic device to provide a space for the user to provide handwritten input (e.g., by moving the boundaries of each text input area based on the position of the text input area to provide the most natural place to perform handwritten input). This simplifies the interaction between the user and the electronic device (e.g., by providing the user with a space to comfortably and naturally perform handwritten input without requiring the user to write in an awkward position), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0240] In some embodiments, displaying the representation of the handwritten input within the user interface while receiving the user input includes displaying an animation of one or more visual characteristics of the representation of the handwritten input that change as a function of elapsed time after the corresponding handwritten input is received (774), as in FIG. 6D (e.g., displaying an animation of the handwritten input as the handwritten input is received). For example, the handwritten input is displayed similar to ink writing, and the animation appears as if the ink writing is drying over time. In some embodiments, the color and / or opacity of the handwritten input changes to reach a final color and / or opacity level. In some embodiments, the animation of the visual characteristics (e.g., ink drying) is similar to or shares similar characteristics with the conversion of handwritten input to font-based text (e.g., handwritten input changing to gray), described below with respect to method 2000.

[0241] The above-described method of displaying handwritten input (e.g., by changing visual characteristics of the handwritten input over time) enables an electronic device to provide a user with visual cues of how much time has passed since the handwritten input was received and how long the handwritten input is being processed (e.g., by displaying an animation of the handwritten input that changes visual characteristics based on how much time has passed since the handwritten input was received). This simplifies the interaction between the user and the electronic device (e.g., by providing the user with a visual indicator of how much time has passed since the handwritten input was received), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0242] In some embodiments, ceasing to display at least a portion of the representation of the handwriting input and displaying font-based text corresponding to at least a portion of the representation of the handwriting input in the text input area includes displaying an animation of the representation of the handwriting input morphing into the font-based text (776) (e.g., animating the conversion of the handwriting input into font-based text), as in FIG. 6D . In some embodiments, the handwriting input changes shape and size to result in the font-based text. In some embodiments, the animation includes changing the size, shape, color, and / or opacity of the handwriting input. In some embodiments, the handwriting input appears to be broken down and reassembled into font-based text (e.g., broken down and reassembled into large pieces, small pieces, particles, sprays, any combination thereof, etc., as described below with respect to method 2000). In some embodiments, the handwriting input fades out and the font-based text fades in. In some embodiments, during the animation, the font-based text is displayed on the display simultaneously with the handwriting (e.g., the font-based text appears on the display as the handwriting is removed from the display, so that at some point both the font-based text and the handwriting are displayed on the display simultaneously). In some embodiments, the animation of the handwriting morphing into the font-based text is similar to or shares similar characteristics with the conversion of handwriting to font-based text described below with respect to method 2000 (e.g., the handwriting dissolves into a particle and moves toward where the font-based text appears).

[0243] The above-described method of displaying handwritten input (e.g., by displaying an animation of the handwritten input morphing into font-based text) enables an electronic device to provide a visual cue to a user that the handwritten input is being converted into font-based text (e.g., by displaying an animation of the handwritten input morphing into font-based text). This simplifies the interaction between a user and the electronic device (e.g., by providing a visual indication to the user that it is the user's handwritten input that is being processed, interpreted, and converted into font-based text), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing a user to use the electronic device more quickly and efficiently.

[0244] In some embodiments, as in FIG. 6H , at least a portion of the handwritten input corresponds to font-based text that includes typographical errors, and displaying the font-based text corresponding to at least a portion of the representation of the handwritten input in the text input area includes displaying the font-based text with the typographical errors corrected (778). (E.g., in some embodiments, if the handwritten input includes typographical errors from which the system can determine the proper input, the process of converting the handwritten text to font-based text also automatically corrects the typographical errors.) In some embodiments, the automatic correction of the conversion occurs when the confidence in what is the correct input exceeds a certain threshold confidence level (e.g., a high confidence level).

[0245] The above-described method of converting handwritten input (e.g., by removing errors when converting the handwritten input to font-based text) enables an electronic device to automatically provide error-free font-based text to a user (e.g., by automatically removing errors when converting the handwritten input to font-based text). This simplifies the interaction between a user and the electronic device (e.g., by automatically removing errors for the user without requiring the user to separately determine whether errors exist and perform additional input to edit the font-based text to remove the errors), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing a user to use the electronic device more quickly and efficiently.

[0246] In some embodiments, after displaying a representation of the handwritten input within the user interface (780), pursuant to determining that the user input meets one or more first criteria (782), the electronic device transmits font-based text corresponding to at least a portion of the representation of the handwritten input to a second electronic device separate from the electronic device (784) (e.g., if the device controls the second electronic device (e.g., wirelessly or wired) and the second electronic device is requested to input text, the device converts the handwritten input to font-based text and then forwards the text to the second electronic device to fulfill the text input request), as in FIG. 6UU. For example, if the second electronic device is a set-top box and the user requests a search user interface on the second electronic device, the user can use the electronic device to remotely transmit text into a search field on the search user interface of the second electronic device.

[0247] The above-described method for transmitting text to a second electronic device (e.g., by receiving handwritten input on the electronic device, converting it to font-based text, and transmitting the font-based text to the second electronic device) enables the electronic device to provide a user with a handwritten input method for entering text on the second electronic device (e.g., by receiving handwritten input from the user, converting the handwritten input to font-based text, and transmitting the text to the second electronic device). This simplifies the interaction between the user and the electronic device (e.g., by accepting the user's handwritten input and transmitting the font-based text to the second electronic device without requiring the user to use a virtual keyboard or a traditional remote control to enter text on the second electronic device), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0248] In some embodiments, as in FIG. 6SS, the second electronic device displays a user interface including one or more respective text entry areas (786) (e.g., the second electronic device displays one or more text entry areas), with each text entry area corresponding to a text entry area displayed by the electronic device.

[0249] In some embodiments, the electronic device detects (788) one or more respective text entry areas at the electronic device displayed by the second electronic device, as in FIG. 6VV. In some embodiments, in response to detecting the one or more respective text entry areas displayed by the second electronic device, the electronic device displays (790) one or more text entry areas corresponding to the one or more respective text entry areas, including the text entry areas, within its user interface (e.g., extracting the text entry areas from the user interface of the second electronic device and displaying them on the electronic device), as in FIG. 6VV. In some embodiments, the electronic device mirrors the user interface of the second electronic device, including any labels, text, graphics, etc., such that the electronic device displays the same user interface as the second electronic device. In some embodiments, the electronic device does not mirror the user interface of the second electronic device, but rather displays only portions of the elements of the user interface of the second electronic device (e.g., displaying text fields and text field labels from the user interface of the second electronic device and not displaying other elements of the user interface of the second electronic device).

[0250] In some embodiments, transmitting font-based text corresponding to at least a portion of the representation of the handwritten input to the second electronic device includes transmitting the font-based text to a respective text input area on the second electronic device (792), as in FIG. 6YY (e.g., the electronic device receives handwritten input directed to a respective text input area, and after the handwritten input is converted to font-based text, the font-based text is transmitted to the second electronic device and entered into the corresponding text input area on the user interface of the second electronic device).

[0251] The above-described method of sending text to a second electronic device (e.g., by displaying the same text entry area on the electronic device as is displayed on the second electronic device) enables the electronic device to provide a user with an intuitive interface for sending text to the second electronic device (e.g., by mirroring the user interface of the second electronic device on the electronic device and sending text from the electronic device to the appropriate text entry area on the second electronic device). This simplifies the interaction between the user and the electronic device, enhances the usability of the electronic device, and makes the user-device interface more efficient (e.g., by providing the same user interface on the electronic device as is displayed on the first electronic device, allowing the user to easily and intuitively select which text entry area to enter text into, without requiring the user to perform additional input or use a conventional remote control to select which text entry area to enter text into). This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0252] In some embodiments, as in Figure AA, the text entry area is a multi-line text entry area, and font-based text corresponding to at least a portion of the handwritten input representation is displayed in a first line of the multi-line text entry area (794) (e.g., the text entry area supports multi-line text).

[0253] In some embodiments, while displaying font-based text corresponding to at least a portion of a representation of handwritten input in a first line of the multi-line text entry area, as in FIG. 6DD, the electronic device receives (796) via the touch-sensitive display a second user input including handwritten input directed at the first text entry area (e.g., detecting handwritten input directed at the text entry area and then receiving a second input directed at the text entry area). In some embodiments, the second input corresponds to a request to insert a second line below the previous handwritten input. In some embodiments, the request to insert the second line includes a tap below the previous handwritten input. In some embodiments, the request includes receiving additional handwritten input below the previous handwritten input. In some embodiments, the request includes selecting a selectable option to create the second line. In some embodiments, creating the second line includes vertically increasing the size of the text entry area.

[0254] In some embodiments, after receiving the second user input (798), in accordance with determining that one or more second criteria are met, the electronic device displays (798-2) font-based text corresponding to the second user input in a second line different from the first line of the multi-line text entry area (e.g., converting the handwritten input of the second user input and entering the converted text in the second line of the text entry area (e.g., a line below the previous line of handwritten text)), as in FIG. 6LL. In some embodiments, the one or more second criteria are met if the second user input includes a tap in the space below the previous line of handwritten text, includes selection of a selectable option to create a new line, and / or includes handwritten input a threshold distance (e.g., 6 points, 12 points, 18 points, 24 points, etc.) below the previous line of handwritten text.

[0255] In some embodiments, after receiving the second user input (798), pursuant to a determination that one or more second criteria are met, or pursuant to a determination that one or more second criteria are not met, the electronic device displays font-based text corresponding to the second user input within the first line of the multi-line text entry area (798-4) (e.g., if the second user input does not reflect an input that enters text into the second line, enter the font-based text into the same line as the previous line of the previous handwritten text), as in FIG. 6EE. For example, if the user continues handwriting input slightly but not too far below the previous line so that the second user input is input into the previous line (e.g., if it appears as if the user intended to continue writing on the previous line), the converted text continues to be entered into the previous line.

[0256] The above-described method for inputting handwritten text (e.g., by entering text into a second line of a text entry area that supports multi-line text when user input indicates a request to enter text into the second line) enables an electronic device to provide a user with an intuitive way to enter multi-line text (e.g., by entering text into a second line of a text entry area when certain criteria of the handwritten input are met). This simplifies the interaction between the user and the electronic device (e.g., by determining whether a new line should be created and entering text into the new line without requiring the user to manually edit font-based text and perform additional user input to insert a line break at a desired location or wait for the handwritten text to be converted), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0257] 6EE-6FF, the one or more second criteria are met when the second user input is detected more than a threshold distance (e.g., 6 points, 12 points, 18 points, 20 points, 24 points, etc.) below the user input, and the one or more second criteria are not met when the second user input is detected less than a threshold distance below the user input (798-6) (e.g., if the second user input is more than a threshold distance below the previous handwritten text, the second user input indicates a request to insert text on a second line (e.g., below the previous line of handwritten text)). In some embodiments, if the second user input is not more than a threshold distance below the previous handwritten text, the second user input indicates a request to continue inserting text on the previous line of text.

[0258] The above-described method for inputting multi-line handwritten text (e.g., by entering text in a second line of a text entry area when user input is received beyond a threshold distance below the previous line of text, indicating a request to enter text in the second line) enables an electronic device to provide a user with an intuitive way to enter multi-line text (e.g., by accepting handwritten text below the previous line of text and interpreting the input as a request to enter handwritten text in the line below the previous line of text). This simplifies the interaction between the user and the electronic device (e.g., by entering text in a new line when handwritten text is received within a threshold distance below the previous line of text, without requiring the user to manually edit font-based text to insert a line break at a desired location or wait for the handwritten text to be converted), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0259] In some embodiments, the one or more second criteria are met if the second user input includes stylus input detected on a second line within the multi-line text entry area, and as in FIG. 6FF, the one or more second criteria are not met if the second user input does not include stylus input detected on a second line within the multi-line text entry area (798-8) (e.g., if the second user input includes a tap, a long press, or an input above a certain force threshold at a position below the previous line of text, the second user input is interpreted as including a request to insert a second line of text below the previous line of text).

[0260] The above-described method for inputting multi-line handwritten text (e.g., by entering text on a second line and receiving a tap on the second line indicating a request to insert the text on the second line in a text entry area) enables an electronic device to provide a user with an intuitive way to enter multi-line text (e.g., by accepting gesture input below the previous line of text and interpreting the input as a request to enter handwritten text on the line below the previous line of text). This simplifies the interaction between the user and the electronic device (e.g., by entering text on a new line when receiving a tap below the previous line of text, without requiring the user to manually edit font-based text and perform additional user input to insert a line break at a desired location or wait for the handwritten text to be converted), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0261] In some embodiments, as in FIG. 6BB , a selectable option for moving to a second line is displayed concurrently with font-based text corresponding to at least a portion of the representation of the handwritten input, and the one or more second criteria are met when the selectable option is selected and the one or more second criteria are not met when the selectable option is not selected (798-10) (e.g., receiving user input selecting the selectable option for inserting a new line of text). In some embodiments, the selectable option is displayed or otherwise presented in response to receiving a tap input or other indication of a request to insert a new line of text. In some embodiments, in response to receiving user input selecting the selectable option for inserting a new line of text, the font-based text is inserted in the new line of text below the previous line of text.

[0262] The above-described method for inputting multiple lines of handwritten text (e.g., by receiving a selection of a selectable option for inserting a new line of text below the previous line of text) enables an electronic device to provide a user with an easy way to input multiple lines of text (e.g., by providing a selectable option that is selectable for inserting handwritten text on a line below the previous line of text). This simplifies interaction between the user and the electronic device, enhances usability of the electronic device, and makes the user-device interface more efficient by allowing the user to use the electronic device more quickly and efficiently, thereby reducing power usage and improving the battery life of the electronic device.

[0263] In some embodiments, as in Figure 6B, the electronic device receives 798-12 a second user input via the touch-sensitive display. In some embodiments, in response to receiving 798-14 the second user input, and in accordance with determining that the second user input is detected within an area of ​​the user interface corresponding to the respective text entry area, the electronic device performs 798-16 a handwriting input operation within the respective text entry area based on the second user input (e.g., if the user input is directed to a text entry area, interpreting the user input as handwriting input or otherwise a request to enter text into the text entry area), as in Figure 6C. In some embodiments, in response to receiving user input directed to a text entry area, the electronic device accepts the input as handwriting input.

[0264] In some embodiments, in response to receiving a second user input (798-14), and determining that the second user input is detected in a region of the user interface that does not correspond to a text entry area, the electronic device performs a scrolling operation (798-18) within the user interface based on the second user input (e.g., if the user input is not directed to a text entry area, the electronic device does not interpret the user input as a request to insert text), as in FIG. 6Y. For example, if the user interacts with another user element that is not a text entry area, the handwriting conversion process is not performed. In some embodiments, for example, if the user performs a scrolling or other type of navigation gesture, the electronic device performs navigation according to the user input instead of inserting font-based text based on the handwriting input.

[0265] The above-described method of interpreting user input (e.g., by interpreting the input as handwritten text if the input is received within a text entry area and not interpreting the input as handwritten text if the input is not received within a text entry area) enables an electronic device to provide a user with an easy way to input text (e.g., by allowing the user to interact with the device in a non-textual manner if the input does not indicate a request to enter text, but by accepting handwritten input if the input indicates a request to enter text). This simplifies the interaction between the user and the electronic device (e.g., by automatically determining whether the user requests to enter text or otherwise interact with a user interface without requiring the user to perform additional input to switch to text entry mode or to interact with a separate user interface or use a separate device to enter text), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently.

[0266] In some embodiments, the animation of the representation of the handwriting input morphing into font-based text (798-20) includes animating (798-22) the representation of the handwriting input morphing (e.g., directly) into font-based text in accordance with a determination that the text input area does not yet contain font-based text, as in FIG. 6E , at a final position within the text input area and at a final size at which the font-based text will be displayed (e.g., if the text input area does not have any font-based text (or the line at which the handwriting input is directed does not have any text), the animation involves the handwritten text simultaneously resizing and reshaping into the font-based text and moving to the font-based text's final position (e.g., left-aligned within the text input area)). Thus, in some embodiments, the animation is performed in one step. In some embodiments, the animation of the handwriting input morphing into font-based text is similar to or shares similar characteristics with the conversion of handwriting input into font-based text, described below with respect to method 2000. In some embodiments, if the text entry area has font-based text, the animation is that the handwritten text changes shape to the font-based text and then changes size to match the size of the existing font-based text.

[0267] The above-described method of converting handwritten input to text (e.g., by displaying an animation of the handwritten input simultaneously changing to a final size and moving to a final position in the font-based text) enables an electronic device to provide a user with a visual cue that the handwritten input is being converted to font-based text (e.g., by displaying an animation of the handwritten input morphing into font-based text in a single step). This simplifies the interaction between the user and the electronic device (e.g., by providing a visual indication to the user that it is the user's handwritten input that is being processed, interpreted, and converted to font-based text), enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently while reducing errors in device use.

[0268] In some embodiments, the animation of the representation of the handwriting input morphing into font-based text (798-24) includes animating the representation of the handwriting input to morph into font-based text of an intermediate size based on the size of the representation of the handwriting input pursuant to a determination that the text input area does not yet contain font-based text, as in FIG. 6E , and then animating the intermediate-sized font-based text to morph into font-based text (798-26) at a final position within the text input area and at a final size at which the font-based text will appear, different from the intermediate size. (E.g., if the text input area does not have any font-based text (or the line at which the handwriting input is directed does not have any text), the animation may involve the handwriting text first reshaping into font-based text, then resizing to a size between the final size and the original handwriting size (e.g., and optionally remaining in the same position as the original handwriting).) In some embodiments, after reshaping into font-based text, the animation continues to resize the text to its final size and move the text to its final position (e.g., left-aligned within the text input area). Thus, in some embodiments, the animation is performed in two steps. In some embodiments, the animation of morphing handwriting input into font-based text is similar to or shares similar characteristics with the conversion of handwriting input into font-based text described below with respect to method 2000. For example, in some embodiments, a first animation similar to the animation described in method 2000 is performed to convert the handwriting input into font-based text of the same size as the handwriting input, and after the first animation, a second animation (e.g., optionally similar to the animation described in method 2000) is performed to morph the size of the resulting font-based text to the final size of the font-based text (e.g., from font size 36 to font size 12, from font size 24 to font size 12, etc.).

[0269] The above-described method of converting handwritten input to text (e.g., by first converting the handwritten input to font-based text having an intermediate size (between the final size and the size of the handwritten input) and then displaying an animation of the handwritten input being converted from the intermediate size to the final size while moving to the final position) enables an electronic device to provide a user with a visual cue that the handwritten input is being converted to font-based text. This simplifies the interaction between the user and the electronic device, enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing users to use the electronic device more quickly and efficiently while reducing errors in device use.

[0270] In some embodiments, the animation of the representation of the handwriting input morphing into font-based text (798-28) may be based on a size of the representation of the handwriting input in accordance with a determination that the text input area does not contain previously entered font-based text (e.g., font-based text displayed in the text input area before the handwriting input is converted to font-based text (e.g., font-based text corresponding to the handwriting input is added to existing font-based text in the text input area)), as shown in FIG. 6H , and then the representation of the handwriting input morphs into intermediate-sized font-based text after the intermediate-sized font-based text is displayed in the text input area. , and animates the handwriting to morph into font-based text at a final position and at a final size at which the font-based text will be displayed, different from the intermediate size, where the final size of the font-based text corresponding to the handwriting is the same as the size of the previously entered font-based text (798-30). (For example, if the text entry area has existing font-based text (or the line at which the handwriting input is directed has existing text), the animation may involve the handwriting first reshaping into font-based text, then resizing to a size between the size of the existing text and the original handwriting size (e.g., and optionally remaining in the same position as the original handwriting).) In some embodiments, after reshaping into font-based text, the animation continues, resizing the text to its final size (e.g., the same size as the existing text), and moving the text to its final position in the font-based text (e.g., left-aligned with the existing text). Thus, in some embodiments, the animation is performed in two steps, matching the font format of the existing text. In some embodiments, the animation of the handwriting morphing into font-based text is similar to or shares similar characteristics with the conversion of handwriting to font-based text described below with respect to method 2000.For example, in some embodiments, a first animation similar to the animation described in method 2000 is performed to convert the handwritten input into font-based text of an intermediate size, and after the first animation, a second animation (e.g., optionally similar to the animation described in method 2000) is performed to morph the size of the resulting font-based text from the intermediate size to the final size of the font-based text (e.g., from an effective 36 font size of the handwritten input to the font-based text at 24 font size, then to 12 font size).

[0271] The above-described method of converting handwritten input to text (e.g., by first converting the handwritten input to font-based text having an intermediate size (between the final size and the size of the handwritten input), and then displaying an animation of the handwritten input being converted from the intermediate size to the same size as any existing text while being moved to the final position (e.g., aligned with the existing text)) enables the electronic device to provide a user with a visual cue that the handwritten input is being converted to font-based text (e.g., by displaying an animation of the handwritten input morphing into font-based text in two steps to emphasize that the process both converts the handwritten input to font-based text and resizes and moves the font-based text to the appropriate size and position). This simplifies the interaction between the user and the electronic device, enhances the usability of the electronic device, and makes the user-device interface more efficient. This further reduces power usage and improves the battery life of the electronic device by allowing the user to use the electronic device more quickly and efficiently while reducing errors in device use.

[0272] It should be understood that the particular order described for the operations in Figures 7A-7I is merely exemplary, and that the described order is not intended to indicate the only order in which the operations may be performed. Those skilled in the art will recognize various ways to reorder the operations described herein. Additionally, it should be noted that other process details described herein with respect to other methods described herein (e.g., methods 900, 1100, 1300, 1500, 1600, 1800, 2000, and 2200) are also applicable in a similar manner to method 700 described above with respect to Figures 7A-7I. For example, the operation of the electronic device to convert handwritten input to font-based text described above with reference to method 700 optionally has one or more of the following characteristics: selecting and deleting text, inserting handwritten input into existing text, managing the timing of converting handwritten text to font-based text, presenting handwriting menus, controlling characteristics of handwritten input, presenting auto-completion suggestions, converting handwritten input to font-based text, displaying options in a content entry palette, etc., as described herein with reference to other methods described herein (e.g., methods 900, 1100, 1300, 1500, 1600, 1800, 2000, and 2200), the details of which will not be repeated here.

[0273] The operations in the information processing methods described above are optionally performed by executing one or more functional modules in an information processing device, such as a general-purpose processor (e.g., as described with respect to FIGS. 1A-1B, 3, 5A-5I) or an application-specific chip. Additionally, the operations described above with reference to FIGS. 7A-7I are optionally performed by the components shown in FIGS. 1A-1B. For example, displaying operations 702, 706, 710, 712, 714, 716, 718, 738, 740, 744, 746, 748, 750, 752, 754, 756, 758, 760, 774, 776, 778, 790, 798-2, and 798-4 and receiving operations 704, 734, 796, and 798-12 are optionally performed by event sorter 170, event recognizer 180, and event processor 190. When a corresponding predefined event or sub-event is detected, event recognizer 180 activates event handler 190 associated with the detection of that event or sub-event. Event handler 190 optionally utilizes or invokes data updater 176 or object updater 177 to update application internal state 192. In some embodiments, event handler 190 accesses a corresponding GUI updater 178 to update what is displayed by the application. Similarly, it will be apparent to one skilled in the art how other processes can be implemented based on the components shown in FIGS. 1A-1B. Selecting and deleting text using a stylus

[0274] Users interact with electronic devices in many different ways, including entering text into the electronic device. In some embodiments, the electronic device displays text in a text field or text area. The embodiments described below provide a way for the electronic device to select and / or delete text using a handwriting input device (e.g., a stylus). Enhancing interaction with the device reduces the amount of time required by the user to perform an action, thus reducing the device's power usage and increasing battery life for battery-powered devices. It is understood that people use devices. When a person uses a device, that person is optionally referred to as the device's user.

[0275] Figures 8A-8II illustrate exemplary ways in which an electronic device interprets handwritten input to select or delete text. The embodiments in these figures are used to illustrate the processes described below, including the processes described with reference to Figures 9A-9G.

[0276] 8A shows an exemplary device 500 that includes a touchscreen 504. In FIG. 8A, device 500 displays a user interface 800 that corresponds to a notepad application. In some embodiments, user interface 800 includes a text entry area 802 in which a user can enter multiple lines of text. In some embodiments, text entry area 802 includes one or more existing texts 804. In some embodiments, existing text 804 was previously entered as handwritten input and converted to font-based text. In some embodiments, existing text 804 was entered using a soft keyboard (e.g., by the user or another user, on this device or another device).

[0277] In FIG. 8B , user input is received from stylus 203. In some embodiments, as shown in FIG. 8B , the user input is a gesture on touchscreen 504 that passes over a portion of existing text 804. In some embodiments, in response to the user input, a trajectory 806 of handwritten input is displayed on the display. In some embodiments, trajectory 806 is a visual indication on the display corresponding to the handwritten user input at the location of the handwritten input. In other words, trajectory 806 is a representation of the user's handwritten input. In some embodiments, as shown in FIG. 8B , the handwritten input passes horizontally through the letters "ck" in the word "clock." In some embodiments, trajectory 806 provides a visual indication that the user has performed a horizontal gesture through the letters "ck" in the word "clock." In FIG. 8C , user input continues to be received from stylus 203 that crosses out the entire word "clock" (e.g., without lift-off). In some embodiments, a horizontal gesture (eg, or a substantially horizontal gesture) is considered a request to select (eg, highlight) a respective portion of existing text 804 .

[0278] 8D , handwritten user input ends (e.g., stylus 203 lifts off touchscreen 504). In some embodiments, in response to stylus 203 lifting off, existing text 804 corresponding to the word “clock” is selected. In some embodiments, selecting the word includes highlighting the word (e.g., as indicated by highlighting 808), displaying one or two selection adjustment elements 810-1 and 810-2, and / or displaying pop-up menu 812. In some embodiments, selection adjustment elements 810-1 and 810-2 are selectable to move the selection to include more or fewer characters or words (e.g., a user can drag selection adjustment elements 810-1 and 810-2 to encompass more or fewer characters). In some embodiments, pop-up menu 812 includes one or more selectable options for performing actions on the highlighted text. In some embodiments, the pop-up menu 812 includes a selectable option for cutting the selected text (e.g., copying the selected text to the clipboard and simultaneously deleting the selected text), a selectable option for copying the text (e.g., copying the selected text to the clipboard), a selectable option for changing the font of the selected text (e.g., changing the font, size, whether it is bold, underlined, italic, etc.), and / or a selectable option for sharing the selected text (e.g., with another user and / or another electronic device).

[0279] 8E-8H show alternative exemplary embodiments for selecting text based on handwriting input. In FIG. 8E, device 500 displays user interface 800 corresponding to a notepad application. In some embodiments, user interface 800 includes a text entry area 802 in which a user can enter multiple lines of text. In some embodiments, text entry area 802 includes one or more existing texts 804. In some embodiments, existing text 804 was previously entered as handwriting input and converted to font-based text. In some embodiments, existing text 804 was entered using a soft keyboard (e.g., by the user or another user on this device or another device).

[0280] In FIG. 8F, user input is received from stylus 203. In some embodiments, the user input is a gesture on touchscreen 504 that passes over a portion of existing text 804, as shown in FIG. 8F. In some embodiments, in response to the user input, a trajectory 806 of the handwritten input is displayed on the display. In some embodiments, trajectory 806 is a visual indication on the display corresponding to the handwritten user input at the location of the handwritten input. In some embodiments, as shown in FIG. 8F, the handwritten input passes over the letters "ck" in the word "clock." In some embodiments, trajectory 806 provides a visual indication that the user has performed a horizontal gesture through the letters "ck" in the word "clock." In some embodiments, after the handwritten input is recognized as a selection gesture, the previously selected characters are highlighted, and the highlighting is updated "live" (e.g., moves with the handwritten input). Thus, as shown in FIG. 8F, highlighting 808 currently highlights the letters "ck."

[0281] 8G, user input continues to be received from stylus 203 (e.g., without lift-off) crossing out the entire word "clock." In some embodiments, highlighting 808 is updated to highlight additional characters selected by the user input as the user selects the additional characters (e.g., now highlighting the entire word "clock").

[0282] In some embodiments, as shown in FIGS. 8F-8G, handwriting input does not need to be perfectly straight or perfectly horizontal to be interpreted as a request to select a character or word. In some embodiments, handwriting input that is substantially straight and / or substantially horizontal is interpreted as a request to select a character or word. In some embodiments, any handwriting input that passes over at least a portion of a character or word and is not interpreted as a delete command (as discussed in more detail below) is interpreted as a request to select a character or word. In some embodiments, selecting a character or word is a default function that is performed unless the handwriting input is interpreted as another command (e.g., delete). Thus, in some embodiments, any handwriting input with a confidence level of another command below a certain threshold (e.g., less than 80%, 75%, or 50% confidence of another command) is interpreted as a ...

Claims

1. 1. An electronic device in communication with a touch-sensitive display, comprising: displaying a user interface on the touch-sensitive display, the user interface including a first text entry area; receiving user input via the touch-sensitive display while displaying the user interface, the user input including handwritten input directed at the first text entry area; While receiving the user input, displaying a representation of the handwritten input within the user interface at a location corresponding to the text input area; after displaying the representation of the handwritten input within the user interface; ceasing to display at least a portion of the representation of the handwritten input and displaying font-based text corresponding to the at least a portion of the representation of the handwritten input in the text input area in accordance with determining that the user input satisfies one or more first criteria; maintaining display of the representation of the handwritten input without displaying the font-based text within the text entry area in accordance with a determination that the user input does not satisfy the one or more first criteria; The method includes:

2. The method of claim 1 , wherein displaying the font-based text corresponding to the at least a portion of the representation of the handwritten input in the text entry area occurs while continuing to receive the handwritten input.

3. 3. The method of claim 1 or 2, wherein displaying the font-based text in the text entry area corresponding to the at least a portion of the representation of the handwritten input is in response to detecting a pause in the handwritten input that is longer than a time threshold.

4. on the touch-sensitive display after displaying the representation of the handwritten input within the user interface. the at least a portion of the representation of the handwritten input; and a selectable option corresponding to the font-based text that corresponds to the at least a portion of the representation of the handwritten input; and 4. The method of claim 1, wherein ceasing display of the at least a portion of the representation of the handwritten input and displaying the font-based text corresponding to the at least a portion of the representation of the handwritten input in the text input area occurs in response to detecting a selection of the selectable option.

5. The method of claim 1 , wherein the text entry area comprises a text entry field.

6. 6. The method of claim 1, wherein the at least a portion of the handwritten input includes handwritten input detected within a boundary of the text input area and handwritten input detected outside the boundary of the text input area.

7. 7. The method of claim 6, wherein handwritten input detected within a margin of an error region that is larger than and surrounds the text input area is eligible to be converted to font-based text within the text input area, and handwritten input detected outside the margin of the error region is not eligible to be converted to font-based text within the text input area.

8. receiving a second user input via the touch-sensitive display, the second user input including handwritten input directed to a second text entry area within the user interface; after receiving the second user input; displaying font-based text corresponding to the second user input within the text entry area in accordance with a determination that the second user input satisfies one or more second criteria, including a criterion that is satisfied when the second user input is detected within a time threshold of the user input; displaying font-based text corresponding to the second user input in the second text entry area in accordance with a determination that the second user input does not satisfy the one or more second criteria; and The method of claim 1 , further comprising:

9. 9. The method of claim 8, wherein the one or more second criteria include a criterion that is met when a majority of the second user input is directed toward the text entry area rather than the second text entry area and that is not met when the majority of the second user input is directed toward the second text entry area rather than the text entry area.

10. displaying the font-based text corresponding to the at least a portion of the representation of the handwritten input within the text entry area; after detecting the font-based text corresponding to the at least a portion of the representation of the handwritten input but before committing the font-based text to the text input area, displaying the font-based text with first values ​​for visual characteristics; displaying the font-based text with a second value for the visual characteristic, different from the first value, after committing the font-based text to the text entry area; 10. The method of claim 1 , comprising:

11. displaying the font-based text corresponding to the at least a portion of the representation of the handwritten input within the text entry area; displaying the font-based text with first values ​​for respective visual characteristics in accordance with a determination that the detection of the font-based text has a first confidence level; displaying the font-based text with a second value for the visual characteristic that is different from the first value in response to a determination that the detection of the font-based text has a second confidence level that is different from the first confidence level; The method of claim 10, comprising:

12. displaying the font-based text corresponding to the at least a portion of the representation of the handwritten input within the text entry area; displaying the font-based text at a first location within the text entry area in accordance with a determination that the detection of the font-based text has a first confidence level; displaying the font-based text at a second location within the text entry area that is different from the first location in accordance with a determination that the detection of the font-based text has a second confidence level that is different from the first confidence level; The method of claim 10 or 11, comprising:

13. 13. The method of claim 1, wherein the one or more first criteria include one or more criteria that are met based on timing characteristics of the handwritten input, a context associated with the handwritten input, punctuation within the handwritten input, a distance of a stylus from the touch-sensitive display, input directed at a second text entry area in the user interface, input that scrolls the user interface, an angle of a stylus, a distance of the handwritten input from an edge of the text entry area, a gesture detected on a stylus, or input from a finger detected on the touch-sensitive display.

14. 14. The method of claim 1, further comprising: in accordance with a determination that one or more second criteria are met while receiving the user input, moving at least a portion of the representation of the handwritten input within the user interface to make space within the user interface for receiving additional handwritten input.

15. 15. The method of claim 14, further comprising: expanding a boundary of the text input area to create space within the text input area for receiving additional handwritten input pursuant to a determination that one or more third criteria are met while receiving the user input.

16. Expanding the boundary of the text entry area Enlarging a first boundary of the text entry area in accordance with a determination that the text entry area is at a first location within the user interface; enlarging a second boundary of the text entry area without enlarging the first boundary of the text entry area in accordance with a determination that the text entry area is at a second location within the user interface that is different from the first location; 16. The method of claim 15, comprising:

17. 17. The method of claim 1, wherein displaying the representation of the handwritten input within the user interface while the user input is being received comprises displaying an animation of one or more visual characteristics of the representation of the handwritten input that change as a function of elapsed time since the corresponding handwritten input was received.

18. 18. The method of claim 1, wherein ceasing to display the at least a portion of the representation of the handwritten input and displaying in the text input area the font-based text corresponding to the at least a portion of the representation of the handwritten input comprises displaying an animation of the representation of the handwritten input morphing into the font-based text.

19. 151. The method of any one of claims 1-18 and 148-150, wherein the at least a portion of the handwritten input corresponds to font-based text that includes a typographical error, and displaying the font-based text corresponding to the at least a portion of the representation of the handwritten input in the text input area includes displaying the font-based text with the typographical error corrected.

20. after displaying the representation of the handwritten input within the user interface; In response to said determining that the user input satisfies one or more first criteria, 151. The method of any one of claims 1-19 and 148-150, further comprising transmitting the font-based text corresponding to the at least a portion of the representation of the handwritten input to a second electronic device separate from the electronic device.

21. the second electronic device displays a user interface including one or more respective text entry areas, the respective text entry areas corresponding to the text entry areas displayed by the electronic device, the method comprising: detecting, at the electronic device, the one or more respective text entry areas displayed by the second electronic device; displaying, in response to detecting the one or more respective text input areas displayed by the second electronic device, one or more text input areas within the user interface, the one or more text input areas including a text input area corresponding to the one or more respective text input areas; Further comprising:

21. The method of claim 20, wherein transmitting the font-based text corresponding to the at least a portion of the representation of the handwritten input to the second electronic device comprises transmitting the font-based text to the respective text entry area on the second electronic device.

22. the text entry area is a multi-line text entry area, and the font-based text corresponding to the at least the portion of the representation of the handwritten input is displayed in a first line of the multi-line text entry area, the method comprising: receiving, via the touch-sensitive display, a second user input including handwritten input directed at the first text input area while displaying the font-based text corresponding to the at least a portion of the representation of the handwritten input in the first line of the multi-line text input area; after receiving the second user input; displaying font-based text corresponding to the second user input in a second line distinct from the first line of the multi-line text entry area in accordance with a determination that one or more second criteria are satisfied; and displaying the font-based text corresponding to the second user input in the first line of the multi-line text entry area in accordance with a determination that the one or more second criteria are not satisfied; and 151. The method of any one of claims 1 to 21 and 148 to 150, further comprising:

23. 23. The method of claim 22, wherein the one or more second criteria are met when the second user input is detected more than a threshold distance below the user input, and the one or more second criteria are not met when the second user input is detected less than the threshold distance below the user input.

24. 24. The method of claim 22, wherein the one or more second criteria are met when the second user input includes a stylus input detected on the second line in the multi-line text input area, and the one or more second criteria are not met when the second user input does not include a stylus input detected on the second line in the multi-line text input area.

25. 25. The method of claim 22, wherein a selectable option for moving to the second line is displayed simultaneously with the font-based text corresponding to the at least a portion of the representation of the handwritten input, and wherein the one or more second criteria are met when the selectable option is selected and the one or more second criteria are not met when the selectable option is not selected.

26. receiving a second user input via the touch-sensitive display; In response to receiving the second user input, pursuant to a determination that the second user input is detected in a region of the user interface corresponding to a respective text input area, performing a handwriting input operation within the respective text input area based on the second user input; pursuant to a determination that the second user input is detected in a region of the user interface that does not correspond to a text input region, performing a scrolling operation within the user interface based on the second user input; 151. The method of any one of claims 1 to 25 and 148 to 150, further comprising:

27. one or more processors; Memory, One or more programs; the one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first text entry area; receiving user input via the touch-sensitive display while displaying the user interface, the user input including handwritten input directed at the first text entry area; While receiving the user input, displaying a representation of the handwritten input within the user interface at a location corresponding to the text input area; after displaying the representation of the handwritten input within the user interface; cease displaying at least a portion of the representation of the handwritten input in accordance with determining that the user input satisfies one or more first criteria, and display font-based text in the text input area corresponding to the at least a portion of the representation of the handwritten input; maintaining display of the representation of the handwritten input without displaying the font-based text within the text entry area in accordance with a determination that the user input does not satisfy the one or more first criteria. An electronic device that contains instructions.

28. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first text entry area; receiving user input via the touch-sensitive display while displaying the user interface, the user input including handwritten input directed at the first text entry area; While receiving the user input, displaying a representation of the handwritten input within the user interface at a location corresponding to the text input area; after displaying the representation of the handwritten input within the user interface; ceasing to display at least a portion of the representation of the handwritten input and displaying font-based text corresponding to the at least a portion of the representation of the handwritten input in the text input area in accordance with determining that the user input satisfies one or more first criteria; maintaining display of the representation of the handwritten input without displaying the font-based text within the text entry area in accordance with a determination that the user input does not satisfy the one or more first criteria; A non-transitory computer-readable storage medium for causing a method to be performed, comprising:

29. 1. An electronic device comprising: one or more processors; Memory, means for displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first text entry area; means for receiving user input, including handwritten input directed at the first text entry area, via the touch-sensitive display while displaying the user interface; means for displaying a representation of the handwritten input within the user interface at a location corresponding to the text input area while the user input is being received; after displaying the representation of the handwritten input within the user interface; cease displaying at least a portion of the representation of the handwritten input in accordance with determining that the user input satisfies one or more first criteria, and display font-based text in the text input area corresponding to the at least a portion of the representation of the handwritten input; means for maintaining display of the representation of the handwritten input without displaying the font-based text within the text entry area in accordance with a determination that the user input does not satisfy the one or more first criteria; 1. An electronic device comprising:

30. 1. An information processing apparatus for use in an electronic device, comprising: means for displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first text entry area; means for receiving user input, including handwritten input directed at the first text entry area, via the touch-sensitive display while displaying the user interface; means for displaying a representation of the handwritten input within the user interface at a location corresponding to the text input area while the user input is being received; after displaying the representation of the handwritten input within the user interface; cease displaying at least a portion of the representation of the handwritten input in accordance with determining that the user input satisfies one or more first criteria, and display font-based text in the text input area corresponding to the at least a portion of the representation of the handwritten input; means for maintaining display of the representation of the handwritten input without displaying the font-based text within the text entry area in accordance with a determination that the user input does not satisfy the one or more first criteria; An information processing device comprising:

31. one or more processors; Memory, One or more programs; 151. An electronic device comprising: one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 1 to 26 and 148 to 150.

32. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method according to any one of claims 1 to 26 and 148 to 150.

33. one or more processors; Memory, Means for carrying out the method according to any one of claims 1 to 26 and 148 to 150; 1. An electronic device comprising:

34. 1. An information processing apparatus for use in an electronic device, comprising:

151. An information processing device comprising means for carrying out the method of any one of claims 1 to 26 and 148 to 150.

35. 1. An electronic device in communication with a touch-sensitive display, comprising: displaying on the touch-sensitive display a user interface including a first editable text string including one or more text characters; receiving user input via the touch-sensitive display while displaying the user interface, the user input including handwritten input corresponding to a line drawn through a plurality of text characters within the first editable text string; In response to receiving the user input, initiating a process of selecting the plurality of text characters of the first editable text string in accordance with a determination that the handwritten input satisfies one or more first criteria; initiating a process of deleting the plurality of text characters of the first editable text string in accordance with a determination that the handwritten input satisfies one or more second criteria different from the first criteria; The method includes:

36. 36. The method of claim 35, wherein initiating the process of selecting the plurality of text characters of the first editable text string further comprises displaying a representation of the lines corresponding to the handwritten input along with the plurality of text characters in the first editable text string.

37. receiving, via the touch-sensitive display, input corresponding to a selection of the line while displaying the representation of the line corresponding to the handwritten input along with the plurality of text characters in the first editable text string; in response to receiving the input corresponding to the selection of the line, causing the plurality of text characters within the first editable text string to be selected for further action; 37. The method of claim 36, comprising:

38. 38. The method of claim 35, wherein initiating the process of selecting the plurality of text characters of the first editable text string comprises selecting the plurality of text characters in the first editable text string without displaying a representation of the lines corresponding to the handwritten input along with the plurality of text characters.

39. 39. The method of any one of claims 35 to 38, wherein initiating the process of deleting the plurality of text characters of the first editable text string comprises displaying the plurality of text characters with a first value for a visual characteristic and displaying a remainder of the first editable text string with a second value for the visual characteristic that is different from the first value while the user input is being received.

40. detecting a lift-off of the user input while displaying the plurality of text characters with the first values ​​for the visual characteristics and displaying the remainder of the first editable text string with the second values ​​for the visual characteristics; responsive to detecting the lift-off of the user input, ceasing display of the plurality of text characters while maintaining display of the remainder of the first editable text string; 40. The method of claim 39, further comprising:

41. displaying a representation of the lines corresponding to the handwritten input together with the first editable text string prior to detecting the lift-off of the user input; ceasing display of the line corresponding to the handwritten input in response to detecting the lift-off of the user input; 41. The method of claim 40, further comprising:

42. after initiating the process of deleting the plurality of text characters of the first editable text string; 42. The method of claim 35, further comprising: aborting the process of deleting the plurality of text characters of the first editable text string in accordance with a determination that the handwritten input extends more than a threshold distance away from the plurality of text characters of the first editable text string.

43. displaying, while receiving the user input, a representation of the lines corresponding to the handwritten input with first values ​​for visual characteristics along with the first editable text string; In response to receiving the user input, displaying the representation of the line corresponding to the handwritten input with a second value for the visual characteristic that is different from the first value in accordance with the determination that the handwritten input satisfies the one or more second criteria; 43. The method of any one of claims 35 to 42, further comprising:

44. Initiating the process of deleting the plurality of text characters of the first editable text string includes deleting the plurality of text characters of the first editable text string, the method comprising:

44. The method of any one of claims 35 to 43, further comprising, in response to deleting the plurality of text characters of the first editable text string, displaying, within the user interface, a selectable option for undoing the deletion of the plurality of text characters of the first editable text string.

45. Initiating the process of selecting the plurality of text characters of the first editable text string includes selecting the plurality of text characters of the first editable text string, the method comprising:

45. The method of any one of claims 35 to 44, further comprising, in response to selecting the plurality of text characters of the first editable text string, displaying, within the user interface, one or more selectable options for performing respective operations on the plurality of text characters of the first editable text string.

46. the process of selecting the plurality of text characters of the first editable text string includes selecting the plurality of text characters of the first editable text string before detecting lift-off of the user input; 46. ​​The method of any one of claims 35 to 45, wherein the process of deleting the plurality of text characters of the first editable text string comprises deleting the plurality of text characters of the first editable text string after detecting lift-off of the user input.

47. receiving additional handwritten input via the touch-sensitive display after initiating each of the processes of deleting the plurality of text characters and selecting the plurality of text characters and before detecting lift-off of the user input; in response to receiving the additional handwritten input, continuing to perform the respective process based on the additional handwritten input, regardless of whether the additional handwritten input satisfies the one or more first criteria or the one or more second criteria; 47. The method of any one of claims 35 to 46, further comprising:

48. receiving additional handwritten input via the touch-sensitive display after initiating each of the processes of deleting the plurality of text characters and selecting the plurality of text characters and before detecting lift-off of the user input; In response to receiving the additional handwritten input, performing a selection process based on the handwritten input and the additional handwritten input in accordance with a determination that the additional handwritten input satisfies one or more first respective criteria; performing an erasure process based on the handwritten input and the additional handwritten input in accordance with a determination that the additional handwritten input satisfies one or more second respective criteria; 48. The method of any one of claims 35 to 47, further comprising:

49. the one or more first criteria are met when the handwritten input strikes through the plurality of text characters of the first editable text string along a direction of the first editable text string; 49. The method of any one of claims 35 to 48, wherein the one or more second criteria are met when the handwritten input crosses out the plurality of text characters of the first editable text string along a direction perpendicular to the direction of the first editable text string.

50. the one or more first criteria are met when the handwritten input underlines the plurality of text characters of the first editable text string; 50. The method of claim 35, wherein the one or more second criteria are met when the handwritten input crosses out the plurality of text characters of the first editable text string.

51. the handwritten input traverses the plurality of text characters of the first editable text string; the one or more first criteria are satisfied in response to a determination that a probability that the handwritten input corresponds to an input crossing out the plurality of text characters is less than a probability threshold; 51. The method of claim 35, wherein the one or more second criteria are satisfied in accordance with a determination that the probability that the handwritten input corresponds to an input that crosses out the plurality of text characters is greater than the probability threshold.

52. the one or more first criteria are met when the handwriting input includes a double tap on the plurality of text characters of the first editable text string; 52. The method of any one of claims 35 to 51, wherein the one or more second criteria are met when the handwritten input intersects two or more of the plurality of text characters of the first editable text string.

53. the one or more first criteria are met when the handwritten input moves in a closed shape that encloses at least a portion of the plurality of text characters of the first editable text string; 53. The method of any one of claims 35 to 52, wherein the one or more second criteria are met when the handwritten input intersects two or more of the plurality of text characters of the first editable text string.

54. one or more processors; Memory, One or more programs; the one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first editable text string including one or more text characters; receiving user input via the touch-sensitive display while displaying the user interface, the user input including handwritten input corresponding to a line drawn through a plurality of text characters in the first editable text string; In response to receiving the user input, initiating a process of selecting the plurality of text characters of the first editable text string in accordance with a determination that the handwritten input satisfies one or more first criteria; initiating a process of deleting the plurality of text characters of the first editable text string in accordance with a determination that the handwritten input satisfies one or more second criteria different from the first criteria. An electronic device that contains instructions.

55. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first editable text string including one or more text characters; receiving user input via the touch-sensitive display while displaying the user interface, the user input including handwritten input corresponding to a line drawn through a plurality of text characters within the first editable text string; In response to receiving the user input, initiating a process of selecting the plurality of text characters of the first editable text string in accordance with a determination that the handwritten input satisfies one or more first criteria; initiating a process of deleting the plurality of text characters of the first editable text string in accordance with a determination that the handwritten input satisfies one or more second criteria different from the first criteria; A non-transitory computer-readable storage medium for causing a method to be performed, comprising:

56. 1. An electronic device comprising: one or more processors; Memory, means for displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first editable text string including one or more text characters; means for receiving, while displaying the user interface, user input via the touch-sensitive display, the user input including handwritten input corresponding to a line drawn through a plurality of text characters in the first editable text string; In response to receiving the user input, initiating a process of selecting the plurality of text characters of the first editable text string in accordance with a determination that the handwritten input satisfies one or more first criteria; means for initiating a process of deleting the plurality of text characters of the first editable text string in accordance with a determination that the handwritten input satisfies one or more second criteria different from the first criteria; 1. An electronic device comprising:

57. 1. An information processing apparatus for use in an electronic device, comprising: means for displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first editable text string including one or more text characters; means for receiving, while displaying the user interface, user input via the touch-sensitive display, the user input including handwritten input corresponding to a line drawn through a plurality of text characters in the first editable text string; In response to receiving the user input, initiating a process of selecting the plurality of text characters of the first editable text string in accordance with a determination that the handwritten input satisfies one or more first criteria; means for initiating a process of deleting the plurality of text characters of the first editable text string in accordance with a determination that the handwritten input satisfies one or more second criteria different from the first criteria; An information processing device comprising:

58. one or more processors; Memory, One or more programs; 200. An electronic device comprising: one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 35 to 53 and 199.

59. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method according to any one of claims 35 to 53 and 199.

60. one or more processors; Memory, Means for carrying out the method of any one of claims 35 to 53 and 199; 1. An electronic device comprising:

61. 1. An information processing apparatus for use in an electronic device, comprising:

200. An information processing device comprising means for carrying out a method according to any one of claims 35 to 53 and 199.

62. 1. An electronic device in communication with a touch-sensitive display, comprising: displaying on the touch-sensitive display a text input user interface including a first character sequence including a first portion of a first character sequence and a second portion of the first character sequence; receiving, while displaying the text input user interface, a user input in the text input user interface between the first portion of the first character sequence and the second portion of the first character sequence via the touch-sensitive display; In response to receiving the user input, in response to a determination that the user input corresponds to a request to input respective font-based text between the first portion of the first character sequence and the second portion of the first character sequence using handwriting input, updating the text input user interface by creating a space between the first portion of the first character sequence and the second portion of the first character sequence, the space between the first portion and the second portion is configured to receive the handwritten input for inserting the respective font-based text between the first portion and the second portion of the first character sequence.

63. receiving handwritten input via the touch-sensitive display within the space between the first and second portions of the first character sequence after updating the text input user interface by creating the space between the first portion of the first character sequence and the second portion of the first character sequence; after receiving the handwritten input, converting the handwritten input into font-based text between the first portion and the second portion of the first character sequence; 63. The method of claim 62, further comprising:

64. 64. The method of claim 63, wherein the handwriting input is detected after detecting the user input between the first portion and the second portion of the first character sequence without detecting lift-off from the touch-sensitive display.

65. 65. The method of claim 62, wherein when the user input includes a touchdown of a stylus on the touch-sensitive display between the first and second portions of the first character sequence, the user input corresponds to the request to input respective text between the first and second portions of the first character sequence using handwriting input, and updating the text input user interface by creating the space between the first and second portions of the first character sequence is performed in response to detecting the touchdown of the stylus before detecting further input from the stylus.

66. 66. The method of claim 65, wherein the touchdown of the stylus is between two words of the first character sequence.

67. 67. The method of claim 62, wherein when the user input includes a touchdown of a stylus on the touch-sensitive display for longer than a time threshold, the user input corresponds to the request to input respective text between the first and second portions of the first character sequence using handwriting input, and updating the text input user interface by creating the space between the first and second portions of the first character sequence is performed in response to detecting the touchdown of a stylus on the touch-sensitive display for longer than the time threshold.

68. 68. The method of claim 62, wherein when the user input includes a respective gesture, the user input corresponds to the request to input respective text between the first and second portions of the first character sequence using handwriting input, and updating the text input user interface by creating the space between the first and second portions of the first character sequence is performed in response to detecting the respective gesture.

69. The user input comprises a touchdown of a stylus on the touch-sensitive display, the method comprising: displaying, on the touch-sensitive display, a selectable option for creating the space between the first and second portions of the first character sequence in response to detecting a touchdown of the stylus on the touch-sensitive display between the first and second portions of the first character sequence; receiving, via the touch-sensitive display, a selection of the selectable option for creating the space between the first portion and the second portion of the first character sequence while displaying the selectable option; Further comprising:

69. The method of claim 62, wherein updating the text input user interface by creating the space between the first portion of the first sequence of characters and the second portion of the first sequence of characters occurs in response to detecting the selection of the selectable option.

70. receiving handwritten input via the touch-sensitive display within the space between the first and second portions of the first character sequence after updating the text input user interface by creating the space between the first portion of the first character sequence and the second portion of the first character sequence; In response to receiving the handwritten input, displaying a representation of the handwritten input in the space between the first and second portions of the first sequence of characters; expanding the space between the first and second portions of the first sequence of characters in accordance with a determination that the handwritten input satisfies one or more criteria; 70. The method of any one of claims 62 to 69, further comprising:

71. 71. The method of claim 70, wherein the handwritten input satisfies the one or more criteria when the handwritten input includes a first respective gesture and fails to satisfy the one or more criteria when the handwritten input includes a second respective gesture that is different from the first respective gesture.

72. receiving handwritten input via the touch-sensitive display within the space between the first and second portions of the first character sequence after updating the text input user interface by creating the space between the first portion of the first character sequence and the second portion of the first character sequence; In response to receiving the handwritten input, displaying a representation of the handwritten input in the space between the first and second portions of the first sequence of characters; updating the user interface to create a new line configured to receive additional handwritten input for inserting additional respective text within the new line in accordance with a determination that one or more new line criteria are satisfied; 72. The method of any one of claims 62 to 71, further comprising:

73. 73. The method of claim 72, wherein the one or more new line criteria include a criterion that is satisfied when the handwritten input reaches the end of a current line in the user interface.

74. 74. The method of claim 72 or 73, wherein the one or more new line criteria include a criterion that is satisfied when the additional handwritten input is detected below existing font-based text in the user interface.

75. 75. The method of any one of claims 72 to 74, wherein the one or more new line criteria include a criterion that is satisfied when a tap input is detected below existing font-based text in the user interface.

76. In response to receiving the handwritten input, displaying, in response to determining that the handwritten input is within a threshold distance of an end of a current line in the user interface, a selectable option within the user interface for creating a new line within the user interface; 76. The method of any one of claims 72 to 75, wherein the one or more new row criteria comprises a criterion that is satisfied when selection of the selectable option for creating the new row in the user interface is detected.

77. receiving a respective user input via the touch-sensitive display while the new line configured to receive the additional handwritten input is included in the user interface; In response to receiving each of the user inputs, displaying, in response to a determination that the respective user input includes a tap input detected at an end of a last word of a previous line preceding the new line in the user interface or a tap input detected at a beginning of a first word in the new line in the user interface, a selectable option within the user interface to remove the new line from the user interface; 77. The method of any one of claims 72 to 76, further comprising:

78. receiving, via the touch-sensitive display, while the new line configured to receive the additional handwritten input is included in the user interface and the new line includes a respective character sequence, a respective input including a touchdown of a stylus on the respective character sequence and a movement of the stylus to a respective line in the user interface different from the new line; In response to receiving each of said inputs, moving said respective character sequences to said respective lines within said user interface; removing the new line from the user interface; 78. The method of any one of claims 72 to 77, further comprising:

79. receiving handwritten input via the touch-sensitive display within the space between the first and second portions of the first character sequence after updating the text input user interface by creating the space between the first portion of the first character sequence and the second portion of the first character sequence; In response to receiving the handwritten input, displaying, within the user interface, a representation of the handwritten input in the space between the first and second portions of the first character sequence; ceasing to display the representation of the handwritten input after a first elapsed time from receiving the handwritten input in accordance with determining that the handwritten input has not reached an end of a current line in the user interface; and ceasing to display the representation of the handwritten input after a second elapsed time from receiving the handwritten input that is less than the first elapsed time in accordance with determining that the handwritten input has reached the end of the current line in the user interface; and 79. The method of any one of claims 62 to 78, further comprising:

80. receiving handwritten input via the touch-sensitive display within the space between the first and second portions of the first character sequence after updating the text input user interface by creating the space between the first portion of the first character sequence and the second portion of the first character sequence; After receiving the handwritten input, in response to a determination that no additional handwritten input is received within a time threshold after the end of the handwritten input, reducing a size of the space between the first and second portions of the first character sequence to remove space in the user interface not consumed by the handwritten input; 80. The method of any one of claims 62 to 79, further comprising:

81. receiving handwritten input via the touch-sensitive display within the space between the first and second portions of the first character sequence after updating the text input user interface by creating the space between the first portion of the first character sequence and the second portion of the first character sequence; After receiving the handwritten input, converting the handwritten input to font-based text in the space between the first portion and the second portion of the first character sequence in accordance with a determination that no additional handwritten input is received within a time threshold after end of the handwritten input; 81. The method of any one of claims 62 to 80, further comprising:

82. displaying the second character sequence within the text input user interface, the second character sequence including a first portion of a second character sequence and a second portion of the second character sequence; receiving, while displaying the text input user interface, a second user input within the text input user interface via the touch-sensitive display between the first portion of the second character sequence and the second portion of the second character sequence; In response to receiving the second user input, in response to determining that the second user input corresponds to a request to input a second respective font-based text between the first portion of the second character sequence and the second portion of the second character sequence using handwriting input; displaying, within the user interface, a handwriting input user interface element configured to receive handwriting input for inserting the second respective font-based text between the first portion and the second portion of the second character sequence; 82. The method of any one of claims 62 to 81, further comprising:

83. receiving a second handwritten input within the handwriting input user interface element via the touch-sensitive display while displaying the handwriting input user interface element; in response to receiving the second handwritten input within the handwriting input user interface element; inserting font-based text corresponding to the second handwritten input into the text input user interface; and scrolling the text input user interface according to movement of a current text insertion point within the text input user interface while the handwriting input user interface element remains stationary on the touch-sensitive display; 83. The method of claim 82, further comprising:

84. receiving a second handwritten input within the handwriting input user interface element via the touch-sensitive display while displaying the handwriting input user interface element; in response to receiving the second handwritten input within the handwriting input user interface element; displaying a representation of the second handwriting input within the handwriting input user interface element; and ceasing display of the representation of the second handwritten input after a first elapsed time from receiving the second handwritten input in accordance with determining that the second handwritten input has not reached an end of the handwriting input user interface element; and ceasing to display the representation of the second handwritten input after a second elapsed time from receiving the second handwritten input that is less than the first elapsed time in accordance with determining that the second handwritten input has reached the end of the handwriting input user interface element; 84. The method of claim 82 or 83, further comprising:

85. one or more processors; Memory, One or more programs; the one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: displaying, on a touch-sensitive display in communication with the electronic device, a text input user interface including the first character sequence, the first character sequence including a first portion of the first character sequence and a second portion of the first character sequence; receiving, while displaying the text input user interface, a user input within the text input user interface between the first portion of the first character sequence and the second portion of the first character sequence via the touch-sensitive display; In response to receiving the user input, 1. An electronic device comprising: instructions for updating the text input user interface by creating a space between the first portion of the first character sequence and the second portion of the first character sequence in accordance with a determination that the user input corresponds to a request to input respective font-based text between the first portion of the first character sequence and the second portion of the first character sequence using handwriting input, the instructions comprising: the space between the first portion and the second portion is configured to receive the handwritten input for inserting the respective font-based text between the first portion and the second portion of the first character sequence.

86. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: displaying, on a touch-sensitive display in communication with the electronic device, a text input user interface including the first character sequence, the first character sequence including a first portion of the first character sequence and a second portion of the first character sequence; receiving, while displaying the text input user interface, a user input within the text input user interface between the first portion of the first character sequence and the second portion of the first character sequence via the touch-sensitive display; In response to receiving the user input, updating the text input user interface by creating a space between the first portion of the first character sequence and the second portion of the first character sequence in accordance with a determination that the user input corresponds to a request to input respective font-based text between the first portion of the first character sequence and the second portion of the first character sequence using handwriting input, the non-transitory computer-readable storage medium causing the computer to execute a method comprising: the space between the first portion and the second portion is configured to receive the handwritten input for inserting the respective font-based text between the first portion and the second portion of the first character sequence.

87. 1. An electronic device comprising: one or more processors; Memory, means for displaying, on a touch-sensitive display in communication with the electronic device, a text input user interface including the first character sequence, the first character sequence including a first portion of the first character sequence and a second portion of the first character sequence; means for receiving user input within the text input user interface between the first portion of the first character sequence and the second portion of the first character sequence via the touch-sensitive display while displaying the text input user interface; In response to receiving the user input, means for updating the text input user interface by creating a space between the first portion of the first character sequence and the second portion of the first character sequence according to a determination that the user input corresponds to a request to input respective font-based text between the first portion of the first character sequence and the second portion of the first character sequence using handwriting input, the electronic device comprising: the space between the first portion and the second portion is configured to receive the handwritten input for inserting the respective font-based text between the first portion and the second portion of the first character sequence.

88. 1. An information processing apparatus for use in an electronic device, comprising: means for displaying, on a touch-sensitive display in communication with the electronic device, a text input user interface including the first character sequence, the first character sequence including a first portion of the first character sequence and a second portion of the first character sequence; means for receiving user input within the text input user interface between the first portion of the first character sequence and the second portion of the first character sequence via the touch-sensitive display while displaying the text input user interface; In response to receiving the user input, means for updating the text input user interface by creating a space between the first portion of the first character sequence and the second portion of the first character sequence according to a determination that the user input corresponds to a request to input respective font-based text between the first portion of the first character sequence and the second portion of the first character sequence using handwriting input, the information processing device comprising: the space between the first portion and the second portion is configured to receive the handwritten input for inserting the respective font-based text between the first portion and the second portion of the first character sequence.

89. one or more processors; Memory, One or more programs; 201. An electronic device comprising: one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 62 to 84 and 200.

90. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform the method of any one of claims 62 to 84 and 200.

91. one or more processors; Memory, Means for carrying out the method according to any one of claims 62 to 84 and 200; 1. An electronic device comprising:

92. 1. An information processing apparatus for use in an electronic device, comprising:

201. An information processing device comprising means for carrying out the method of any one of claims 62 to 84 and 200.

93. 1. An electronic device in communication with a touch-sensitive display, comprising: displaying a text entry user interface on the touch-sensitive display; receiving, while displaying the text input user interface, a first sequence of one or more handwritten user inputs within the text input user interface via the touch-sensitive display; displaying, on the touch-sensitive display, a visual representation of the first sequence of the one or more handwritten user inputs within the text input user interface while receiving the first sequence of the one or more handwritten user inputs; in response to detecting an end of a first sequence of the one or more handwritten user inputs; pursuant to determining that a context associated with the first sequence of one or more handwritten user inputs satisfies one or more first criteria, replacing the visual representation of the first sequence of one or more handwritten user inputs with text corresponding to the first sequence of one or more handwritten user inputs, regardless of whether a respective timing criterion has been satisfied; pursuant to a determination that the context associated with the first sequence of the one or more handwritten user inputs does not satisfy the one or more first criteria, delaying replacing the visual representation of the first sequence of the one or more handwritten user inputs with the text corresponding to the first sequence of the one or more handwritten user inputs until the respective timing criterion is satisfied; The method includes:

94. 94. The method of claim 93, wherein the one or more first criteria are met when the first sequence of the one or more handwritten user inputs contains more than a threshold number of words followed by spaces.

95. 95. The method of claim 93 or 94, wherein the one or more first criteria are met when a first sequence of the one or more handwritten user inputs is directed to a first text input area within the text input user interface and the end of the first sequence of the one or more handwritten user inputs includes input directed to a second text input area within the text input user interface.

96. 96. The method of any one of claims 93 to 95, wherein the text input user interface includes a selectable option for performing an action, and the one or more first criteria are met when the termination of a first sequence of the one or more handwritten user inputs includes selection of the selectable option.

97. 97. The method of any one of claims 93 to 96, wherein the first sequence of the one or more handwriting user inputs includes a stylus input detected on the touch-sensitive display, and the one or more first criteria are satisfied when input including a finger input is detected on the touch-sensitive display.

98. 98. The method of any one of claims 93 to 97, wherein the one or more first criteria are met when a scroll input is detected on the touch-sensitive display.

99. 99. The method of any one of claims 93 to 98, wherein the first sequence of one or more handwriting user inputs includes a stylus input detected on the touch-sensitive display, and the one or more first criteria are satisfied pursuant to a determination that the stylus is placed on a surface by a user.

100. 100. The method of claim 93, wherein the first sequence of the one or more handwritten user inputs includes a stylus input detected on the touch-sensitive display and the one or more first criteria are satisfied when the stylus is moved more than a threshold distance from the touch-sensitive display.

101. pursuant to determining that one or more second criteria are satisfied, the respective timing criterion is satisfied when a first time threshold has elapsed since the end of a first sequence of the one or more handwritten user inputs; pursuant to determining that one or more third criteria are satisfied, the respective timing criterion is satisfied when a second time threshold has elapsed since the end of the first sequence of the one or more handwritten user inputs, the second time threshold being greater than the first time threshold.

101. The method of any one of claims 93 to 100.

102. 102. The method of claim 101, wherein the one or more second criteria are met when the end of a first sequence of the one or more handwritten user inputs includes a request to add punctuation to the character sequence.

103. 103. The method of claim 101 or 102, wherein the one or more second criteria are met when the one or more handwritten user inputs end in a word to which no characters can be added.

104. 104. The method of any one of claims 101 to 103, wherein the one or more third criteria are met when the end of the first sequence of the one or more handwritten user inputs includes a pause longer than a time threshold.

105. pursuant to a determination that the text input user interface is operating in a first mode in which handwritten user input is converted to font-based text in response to a selection of a selectable option displayed with the handwritten user input, the respective timing criteria are satisfied when one or more first time thresholds have elapsed since the end of a first sequence of the one or more handwritten user inputs; 105. The method of any one of claims 93 to 104, wherein, in accordance with a determination that the text input user interface is operating in a second mode in which handwritten user input is converted to font-based text without displaying or selecting a selectable option for converting handwritten user input to font-based text, the respective timing criterion is met when one or more second time thresholds have elapsed since the end of a first sequence of the one or more handwritten user inputs that are less than the one or more first time thresholds.

106. The first sequence of the one or more handwritten user inputs corresponds to a first sequence of font-based text, and the method further comprises: determining that the respective timing criterion is satisfied after delaying replacing the visual representation of a first sequence of the one or more handwritten user inputs with the first sequence of font-based text; replacing the visual representation of a first sequence of the one or more handwritten user inputs with a first sequence of the font-based text in response to determining that the respective timing criterion is satisfied; and 106. The method of any one of claims 93 to 105, further comprising:

107. The first sequence of the one or more handwritten user inputs corresponds to a first sequence of font-based text, and the method further comprises: determining that the respective timing criterion is satisfied after delaying replacing the visual representation of a first sequence of the one or more handwritten user inputs with the first sequence of font-based text; responsive to determining that the respective timing criterion is satisfied, replacing the visual representation of the first sequence of the one or more handwritten user inputs with a second sequence of font-based text that is different from the first sequence of font-based text; 107. The method of any one of claims 93 to 106, further comprising:

108. The first sequence of the one or more handwritten user inputs corresponds to a first sequence of font-based text, and the method further comprises: detecting, via the touch-sensitive display, a second sequence of one or more handwritten user inputs corresponding to a second sequence of font-based text, after delaying replacing the visual representation of the first sequence of the one or more handwritten user inputs with the first sequence of font-based text; in response to detecting a second sequence of the one or more handwritten user inputs, displaying a visual representation of the second sequence of the one or more handwritten user inputs together with the visual representation of the first sequence of the one or more handwritten user inputs; determining that the respective timing criterion is satisfied after displaying the visual representation of a second sequence of the one or more handwritten user inputs; In response to determining that each of the timing criteria is satisfied, replacing the visual representation of a first sequence of the one or more handwritten user inputs with the first sequence of font-based text; replacing the visual representation of a second sequence of the one or more handwritten user inputs with a second sequence of the font-based text; and 108. The method of any one of claims 93 to 107, further comprising:

109. one or more processors; Memory, One or more programs; the one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: displaying a text entry user interface on a touch-sensitive display in communication with the electronic device; receiving, via the touch-sensitive display, a first sequence of one or more handwritten user inputs within the text input user interface while displaying the text input user interface; displaying, on the touch-sensitive display, a visual representation of the first sequence of the one or more handwritten user inputs within the text input user interface while receiving the first sequence of the one or more handwritten user inputs; in response to detecting an end of a first sequence of the one or more handwritten user inputs; pursuant to determining that a context associated with the first sequence of one or more handwritten user inputs satisfies one or more first criteria, replacing the visual representation of the first sequence of one or more handwritten user inputs with text corresponding to the first sequence of one or more handwritten user inputs, regardless of whether a respective timing criterion has been satisfied; pursuant to determining that the context associated with the first sequence of the one or more handwritten user inputs does not satisfy the one or more first criteria, delaying replacing the visual representation of the first sequence of the one or more handwritten user inputs with the zero text corresponding to the first sequence of the one or more handwritten user inputs until the respective timing criterion is satisfied. An electronic device that contains instructions.

110. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: displaying a text entry user interface on a touch-sensitive display in communication with the electronic device; receiving, while displaying the text input user interface, a first sequence of one or more handwritten user inputs within the text input user interface via the touch-sensitive display; displaying, on the touch-sensitive display, a visual representation of the first sequence of the one or more handwritten user inputs within the text input user interface while receiving the first sequence of the one or more handwritten user inputs; in response to detecting an end of a first sequence of the one or more handwritten user inputs; pursuant to determining that a context associated with the first sequence of one or more handwritten user inputs satisfies one or more first criteria, replacing the visual representation of the first sequence of one or more handwritten user inputs with text corresponding to the first sequence of one or more handwritten user inputs, regardless of whether a respective timing criterion has been satisfied; according to a determination that the context associated with the first sequence of the one or more handwritten user inputs does not satisfy the one or more first criteria, delaying replacing the visual representation of the first sequence of the one or more handwritten user inputs with the text corresponding to the first sequence of the one or more handwritten user inputs until the respective timing criterion is satisfied; A non-transitory computer-readable storage medium for causing a method to be performed, comprising:

111. 1. An electronic device comprising: one or more processors; Memory, means for displaying a text entry user interface on a touch-sensitive display in communication with the electronic device; means for receiving, while displaying the text input user interface, a first sequence of one or more handwritten user inputs within the text input user interface via the touch-sensitive display; means for displaying, on the touch-sensitive display, within the text input user interface a visual representation of the first sequence of the one or more handwritten user inputs while receiving the first sequence of the one or more handwritten user inputs; in response to detecting an end of a first sequence of the one or more handwritten user inputs; pursuant to determining that a context associated with the first sequence of one or more handwritten user inputs satisfies one or more first criteria, replacing the visual representation of the first sequence of one or more handwritten user inputs with text corresponding to the first sequence of one or more handwritten user inputs, regardless of whether a respective timing criterion has been satisfied; means for delaying, in accordance with a determination that the context associated with the first sequence of the one or more handwritten user inputs does not satisfy the one or more first criteria, replacing the visual representation of the first sequence of the one or more handwritten user inputs with the text corresponding to the first sequence of the one or more handwritten user inputs until the respective timing criterion is satisfied; 1. An electronic device comprising:

112. 1. An information processing apparatus for use in an electronic device, comprising: means for displaying a text entry user interface on a touch-sensitive display in communication with the electronic device; means for receiving, while displaying the text input user interface, a first sequence of one or more handwritten user inputs within the text input user interface via the touch-sensitive display; means for displaying, on the touch-sensitive display, within the text input user interface a visual representation of the first sequence of the one or more handwritten user inputs while receiving the first sequence of the one or more handwritten user inputs; in response to detecting an end of a first sequence of the one or more handwritten user inputs; pursuant to determining that a context associated with the first sequence of one or more handwritten user inputs satisfies one or more first criteria, replacing the visual representation of the first sequence of one or more handwritten user inputs with text corresponding to the first sequence of one or more handwritten user inputs, regardless of whether a respective timing criterion has been satisfied; means for delaying, in accordance with a determination that the context associated with the first sequence of the one or more handwritten user inputs does not satisfy the one or more first criteria, replacing the visual representation of the first sequence of the one or more handwritten user inputs with the text corresponding to the first sequence of the one or more handwritten user inputs until the respective timing criterion is satisfied; An information processing device comprising:

113. one or more processors; Memory, One or more programs; 109. An electronic device comprising: one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing a method according to any one of claims 93 to 108.

114. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method according to any one of claims 93 to 108.

115. one or more processors; Memory, Means for carrying out the method according to any one of claims 93 to 108; 1. An electronic device comprising:

116. 1. An information processing apparatus for use in an electronic device, comprising:

109. An information processing device comprising means for carrying out a method according to any one of claims 93 to 108.

117. 1. An electronic device in communication with a touch-sensitive display, comprising: Displaying a user interface on the touch-sensitive display, the user interface including a first content entry area; detecting, while displaying the user interface, a user input corresponding to a request to initiate content entry into the content entry area, including detecting a contact within the content entry area via the touch-sensitive display; In response to detecting the user input, in response to determining that the user input comprises a finger input in a content entry area, displaying, on the touch-sensitive display, a content entry user interface including a soft keyboard for entering text into the content entry area; displaying, in response to determining that the user input includes input with a stylus in the content entry area, the content input user interface for generating content using the stylus, on the touch-sensitive display, without displaying a soft keyboard for entering text into the content entry area; The method includes:

118. detecting a second user input in the content entry area via the touch-sensitive display while displaying the content entry user interface including the soft keyboard for entering text into the content entry area; In response to detecting the second user input, ceasing display of the soft keyboard in response to determining that the second user input includes input with the stylus within the content input area; 118. The method of claim 117, further comprising:

119. detecting a second user input in the content entry area via the touch-sensitive display while displaying the content entry user interface for generating content using the stylus without displaying the soft keyboard for entering text in the content entry area; In response to detecting the second user input, displaying the soft keyboard on the touch-sensitive display in response to determining that the second user input includes a finger input within the content entry area; 119. The method of claim 117 or 118, further comprising:

120. 120. A method according to any one of claims 117 to 119, wherein the content input user interface for generating content using the stylus without displaying the soft keyboard for entering text into the content input area in accordance with a determination that the content input area satisfies one or more criteria includes one or more tools for controlling drawing content input into the content input area using the stylus.

121. 121. The method of claim 120, wherein the content entry area satisfies the one or more criteria when the content entry area is capable of accepting drawing input and does not satisfy the one or more criteria when the content entry area is not capable of accepting drawing input.

122. the content input user interface for generating content using the stylus, one or more tools for controlling drawing content input into the content input area using the stylus; a respective text input tool for inputting font-based text into the content entry area using handwriting input from the stylus; 122. The method of any one of claims 117 to 121, comprising:

123. the content input user interface for generating content using the stylus, a first set of one or more tools including one or more tools for controlling drawing content input into the content input area using the stylus; a second set of one or more tools, including the respective text input tools, for controlling font-based text input into the content entry area; and a selectable option for alternating between displaying the first set of one or more tools and the second set of one or more tools within the content entry user interface; 123. The method of claim 122, comprising:

124. while displaying the content entry user interface including the soft keyboard for entering text into the content entry area, detecting via the touch-sensitive display an input corresponding to a request to stop displaying the soft keyboard, the soft keyboard being displayed with one or more selectable options for modifying text in the content entry area; in response to detecting the input corresponding to the request to stop displaying the soft keyboard, ceasing display of the soft keyboard while maintaining display within the user interface of the one or more selectable options for modifying text within the content entry area; 124. The method of any one of claims 117 to 123, further comprising:

125. while displaying the content entry user interface including the soft keyboard for entering text into the content entry area, the soft keyboard including one or more first keys and one or more second keys, detecting via the touch-sensitive display an input corresponding to a request to stop displaying the soft keyboard; in response to detecting the input corresponding to the request to stop displaying the soft keyboard, Stopping the display of the soft keyboard; displaying, within the user interface, one or more selectable options corresponding to the one or more first keys; 125. The method of any one of claims 117 to 124, further comprising:

126. one or more processors; Memory, One or more programs; the one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first content entry area; detecting, while displaying the user interface, a user input corresponding to a request to initiate content entry into the content entry area, including detecting a contact within the content entry area via the touch-sensitive display; In response to detecting the user input, responsive to determining that the user input comprises a finger input in a content entry area, displaying on the touch-sensitive display a content entry user interface including a soft keyboard for entering text into the content entry area; pursuant to determining that the user input includes input with a stylus in the content entry area, displaying, on the touch-sensitive display, the content input user interface for generating content using the stylus without displaying a soft keyboard for entering text into the content entry area. An electronic device that contains instructions.

127. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first content entry area; detecting, while displaying the user interface, a user input corresponding to a request to initiate content entry into the content entry area, including detecting a contact within the content entry area via the touch-sensitive display; In response to detecting the user input, in response to determining that the user input comprises a finger input in a content entry area, displaying, on the touch-sensitive display, a content entry user interface including a soft keyboard for entering text into the content entry area; displaying, in response to determining that the user input includes input with a stylus in the content entry area, the content input user interface for generating content using the stylus, on the touch-sensitive display, without displaying a soft keyboard for entering text into the content entry area; A non-transitory computer-readable storage medium for causing a method to be performed, comprising:

128. 1. An electronic device comprising: one or more processors; Memory, means for displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first content entry area; means for detecting, while displaying the user interface, a user input corresponding to a request to initiate content entry into the content entry area, the user input including detecting a contact within the content entry area via the touch-sensitive display; In response to detecting the user input, responsive to determining that the user input comprises a finger input in a content entry area, displaying on the touch-sensitive display a content entry user interface including a soft keyboard for entering text into the content entry area; means for displaying, in response to a determination that the user input includes input with a stylus in the content entry area, on the touch-sensitive display, the content input user interface for generating content using the stylus without displaying a soft keyboard for entering text into the content entry area; 1. An electronic device comprising:

129. 1. An information processing apparatus for use in an electronic device, comprising: means for displaying a user interface on a touch-sensitive display in communication with the electronic device, the user interface including a first content entry area; means for detecting, while displaying the user interface, a user input corresponding to a request to initiate content entry into the content entry area, the user input including detecting a contact within the content entry area via the touch-sensitive display; In response to detecting the user input, responsive to determining that the user input comprises a finger input in a content entry area, displaying on the touch-sensitive display a content entry user interface including a soft keyboard for entering text into the content entry area; means for displaying, in response to a determination that the user input includes input with a stylus in the content entry area, on the touch-sensitive display, the content input user interface for generating content using the stylus without displaying a soft keyboard for entering text into the content entry area; An information processing device comprising:

130. one or more processors; Memory, One or more programs; 126. An electronic device comprising: one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing a method according to any one of claims 117 to 125.

131. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method according to any one of claims 117 to 125.

132. one or more processors; Memory, Means for carrying out the method according to any one of claims 117 to 125; 1. An electronic device comprising:

133. 1. An information processing apparatus for use in an electronic device, comprising:

126. An information processing device comprising means for carrying out the method according to any one of claims 117 to 125.

134. 1. An electronic device in communication with a touch-sensitive display, comprising: displaying a content entry user interface on the touch-sensitive display; receiving, while displaying the content entry user interface, handwritten user input corresponding to the content entry user interface via the touch-sensitive display; in response to receiving the handwritten user input, initiating a process of converting the handwritten user input into a first sequence of font-based text characters corresponding to the handwritten user input in the content input user interface in accordance with a determination that a text input drawing tool is selected when the handwritten user input is detected; displaying a visual representation of the handwritten user input within the content input user interface without initiating the process of converting the handwritten user input into the first sequence of font-based text characters in response to a determination that a drawing tool other than the text input drawing tool was selected when the handwritten input was detected; The method includes:

135. 135. The method of claim 134, further comprising displaying, in accordance with a determination that the text input drawing tool is selected, one or more options within the content input user interface for controlling font-based text formatting within the content input user interface.

136. 136. The method of claim 134 or 135, further comprising displaying, in accordance with a determination that a drawing tool other than the text input drawing tool is selected, one or more options within the content input user interface for controlling drawing input within the content input user interface.

137. 137. The method of any one of claims 134 to 136, wherein the content entry user interface includes a selectable option for displaying a keyboard for entering font-based text within the content entry user interface.

138. responsive to receiving the handwritten user input, displaying, within the content input user interface, the visual representation of the handwritten user input; after displaying the visual representation of the handwritten user input within the content entry user interface; ceasing to display the visual representation of the handwritten user input within the content input user interface in accordance with the determination that the text input drawing tool was selected when the handwritten user input was detected and converting the visual representation of the handwritten user input into font-based text; maintaining a display of the visual representation of the handwritten user input in the content input user interface without converting the visual representation of the handwritten user input to font-based text in accordance with the determination that the text input drawing tool was not selected when the handwritten user input was detected; 138. The method of any one of claims 134 to 137, further comprising:

139. the visual representation of the handwritten user input displayed pursuant to the determination that a drawing tool other than the text input drawing tool was selected when the handwritten input was detected includes a line having a respective appearance; pursuant to determining that the drawing tool is a first drawing tool, the respective appearance is a first appearance; 139. The method of any one of claims 134 to 138, wherein, pursuant to a determination that the drawing tool is a second drawing tool different from the first drawing tool, the respective appearance is a second appearance different from the first appearance.

140. one or more processors; Memory, One or more programs; the one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: displaying a content entry user interface on a touch-sensitive display in communication with the electronic device; receiving, via the touch-sensitive display, handwritten user input corresponding to the content entry user interface while displaying the content entry user interface; in response to receiving the handwritten user input, in response to a determination that a text input drawing tool is selected when the handwritten user input is detected, initiate a process for converting the handwritten user input into a first sequence of font-based text characters corresponding to the handwritten user input in the content input user interface; displaying a visual representation of the handwritten user input within the content input user interface in response to a determination that a drawing tool other than the text input drawing tool was selected when the handwritten input was detected, without initiating the process of converting the handwritten user input into the first sequence of font-based text characters. An electronic device that contains instructions.

141. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: displaying a content entry user interface on a touch-sensitive display in communication with the electronic device; receiving, while displaying the content entry user interface, handwritten user input corresponding to the content entry user interface via the touch-sensitive display; in response to receiving the handwritten user input, initiating a process of converting the handwritten user input into a first sequence of font-based text characters corresponding to the handwritten user input in the content input user interface in accordance with a determination that a text input drawing tool is selected when the handwritten user input is detected; displaying a visual representation of the handwritten user input within the content input user interface without initiating the process of converting the handwritten user input into the first sequence of font-based text characters in response to a determination that a drawing tool other than the text input drawing tool was selected when the handwritten input was detected; A non-transitory computer-readable storage medium for causing a method to be performed, comprising:

142. 1. An electronic device comprising: one or more processors; Memory, means for displaying a content entry user interface on a touch-sensitive display in communication with the electronic device; means for receiving, while displaying the content entry user interface, handwritten user input via the touch-sensitive display corresponding to the content entry user interface; in response to receiving the handwritten user input, in response to a determination that a text input drawing tool is selected when the handwritten user input is detected, initiate a process for converting the handwritten user input into a first sequence of font-based text characters corresponding to the handwritten user input in the content input user interface; means for displaying a visual representation of the handwritten user input within the content input user interface in response to a determination that a drawing tool other than the text input drawing tool was selected when the handwritten input was detected, without initiating the process of converting the handwritten user input into the first sequence of font-based text characters; 1. An electronic device comprising:

143. 1. An information processing apparatus for use in an electronic device, comprising: means for displaying a content entry user interface on a touch-sensitive display in communication with the electronic device; means for receiving, while displaying the content entry user interface, handwritten user input via the touch-sensitive display corresponding to the content entry user interface; in response to receiving the handwritten user input, in response to a determination that a text input drawing tool is selected when the handwritten user input is detected, initiate a process for converting the handwritten user input into a first sequence of font-based text characters corresponding to the handwritten user input in the content input user interface; means for displaying a visual representation of the handwritten user input within the content input user interface in response to a determination that a drawing tool other than the text input drawing tool was selected when the handwritten input was detected, without initiating the process of converting the handwritten user input into the first sequence of font-based text characters; An information processing device comprising:

144. one or more processors; Memory, One or more programs; 140. An electronic device comprising: one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing a method according to any one of claims 134 to 139.

145. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method according to any one of claims 134 to 139.

146. one or more processors; Memory, Means for carrying out the method of any one of claims 134 to 139; 1. An electronic device comprising:

147. 1. An information processing apparatus for use in an electronic device, comprising:

140. An information processing device comprising means for carrying out a method according to any one of claims 134 to 139.

148. the animation of the representation of the handwritten input morphing into the font-based text, 20. The method of claim 18, comprising animating the representation of the handwritten input to morph at a final location within the text input area into font-based text at a final size at which the font-based text will be displayed, pursuant to a determination that the text input area does not already contain font-based text.

149. the animation of the representation of the handwritten input morphing into the font-based text, 19. The method of claim 18, comprising animating the representation of the handwritten input to morph into font-based text at an intermediate size based on a size of the representation of the handwritten input pursuant to a determination that the text input area does not already contain font-based text, and then animating the font-based text at the intermediate size to morph into font-based text at a final size at a final location within the text input area at which the font-based text, different from the intermediate size, is displayed.

150. the animation of the representation of the handwritten input morphing into the font-based text, 19. The method of claim 18, further comprising animating the representation of the handwritten input to morph into font-based text at an intermediate size based on a size of the representation of the handwritten input pursuant to a determination that the text input area contains previously entered font-based text, and then animating the intermediate sized font-based text to morph into font-based text at a final size at which the font-based text, different from the intermediate size, is displayed at a final location within the text input area, wherein the final size of the font-based text corresponding to the handwritten input is the same as a size of the previously entered font-based text.

151. In an electronic device having a touch-sensitive display, displaying a user interface on the touch-sensitive display; receiving, while displaying the user interface, a first user input via the touch-sensitive display including a first handwritten input directed at the user interface, the first handwritten input corresponding to a first sequence of characters; in response to receiving the first user input, displaying within the user interface a representation of the first handwritten input and a representation of one or more predicted characters selected based on the first sequence of characters in the first handwritten input, the representation of the one or more predicted characters being displayed after the representation of the first handwritten input in a writing direction; The method includes:

152. receiving a second user input, including a second handwritten input directed at the user interface via the one or more input devices while displaying the representation of the first handwritten input and the representation of the one or more predicted characters; in response to receiving the second user input including the second handwritten input directed to the user interface; accepting the one or more predicted characters for use within the user interface in accordance with a determination that the second handwritten input satisfies one or more first criteria with respect to the representation of the one or more predicted characters; withholding acceptance of the one or more predicted characters for use within the user interface in accordance with a determination that the second handwritten input does not satisfy the one or more first criteria with respect to the representation of the one or more predicted characters; 152. The method of claim 151, further comprising:

153. receiving a second user input, including a second handwritten input directed at the user interface via the one or more input devices while displaying the representation of the first handwritten input and the representation of the one or more predicted characters; in response to receiving the second user input including the second handwritten input directed to the user interface; accepting a subset of the one or more predicted characters corresponding to the first portion of the representation of the one or more predicted characters for use within the user interface in accordance with a determination that the second handwritten input satisfies one or more first criteria with respect to a first portion of the representation of the one or more predicted characters but not with respect to a second portion of the representation of the one or more predicted characters; accepting a portion of the one or more predicted characters corresponding to the first and second portions of the representation of the one or more predicted characters for use within the user interface in accordance with a determination that the second handwritten input satisfies one or more first criteria with respect to the first and second portions of the representation of the one or more predicted characters; 153. The method of any one of claims 151 to 152, further comprising:

154. accepting one or more respective predicted characters for use in the user interface; ceasing to display the representation of the first handwritten input and the representation of the one or more respective predicted characters; and Within the user interface, the first character sequence corresponding to the first handwritten input; and the one or more respective predicted characters; and displaying a representation of 154. The method of any one of claims 152 to 153, comprising:

155. 155. The method of any one of claims 152 to 154, further comprising, while receiving the second user input that satisfies the one or more first criteria for the representation of the one or more predicted characters, modifying a value of a display property of a respective character of the one or more predicted characters when the second user input satisfies the one or more first criteria for the respective character of the one or more predicted characters.

156. receiving a second user input, including a second handwritten input directed at the user interface via the one or more input devices while displaying the representation of the first handwritten input and the representation of the one or more predicted characters; in response to receiving the second user input including the second handwritten input directed to the user interface; ceasing display of the representation of at least a subset of the one or more predicted characters in accordance with a determination that the second handwritten input comprises a continuation of the first handwritten input; 156. The method of any one of claims 151 to 155, further comprising:

157. in response to receiving the second user input including the second handwritten input directed to the user interface; In response to the determination that the second handwritten input includes the continuation of the first handwritten input, displaying in the user interface: a representation of the first handwritten input and the second handwritten input, the second handwritten input corresponding to a second sequence of characters; and a representation of one or more second predicted characters selected based on the first and second character sequences in the first and second handwritten inputs; and and displaying the 157. The method of claim 156, wherein the first sequence of characters, the second sequence of characters, and the combination of the one or more second predicted characters are different from the combination of the first sequence of characters and the one or more predicted characters.

158. in response to receiving the second user input including the second handwritten input directed to the user interface; In response to the determination that the second handwritten input includes the continuation of the first handwritten input, displaying in the user interface: a representation of the first handwritten input and the second handwritten input, the second handwritten input corresponding to a second sequence of characters; and a representation of one or more second predicted characters selected based on the first and second character sequences in the first and second handwritten inputs; and and displaying the 157. The method of claim 156, wherein the first sequence of characters, the second sequence of characters, and the combination of the one or more second predicted characters is the same as the combination of the first sequence of characters and the one or more predicted characters.

159. while displaying the representation of the first handwritten input and the representation of the one or more predicted characters; displaying within the user interface an animation of a representation of the handwritten input accepting the one or more predicted characters for use within the user interface in accordance with a determination that one or more criteria are satisfied; forgoing displaying within the user interface the animation of the representation of the handwritten input accepting the one or more predicted characters for use within the user interface in accordance with a determination that the one or more criteria are not satisfied; 159. The method of any one of claims 151 to 158, further comprising:

160. 160. The method of claim 159, wherein the one or more criteria include a criterion that is met when the electronic device detects the handwritten input accepting predictive characters for use within the user interface less than a threshold number of times and a criterion that is not met when the electronic device has not detected the handwritten input accepting predictive characters for use within the user interface at least the threshold number of times.

161. 160. The method of claim 159, wherein the first handwritten input is directed to a first text input area within the user interface, and the one or more criteria include a criterion that is met when the electronic device displays predictive characters in the first text input area less than a threshold number of times and a criterion that is not met when the electronic device does not display predictive characters in the first text input area at least the threshold number of times.

162. 160. The method of claim 159, wherein the one or more criteria include a criterion that is met when the electronic device displays predictive characters in the user interface less than a threshold number of times and a criterion that is not met when the electronic device has not displayed predictive characters in the user interface at least the threshold number of times.

163. 160. The method of claim 159, wherein the one or more criteria include a criterion that is met when the electronic device displays predictive characters less than a threshold number of times during the day and a criterion that is not met when the electronic device has not displayed predictive characters at least the threshold number of times during the day.

164. responsive to a determination that a size of handwritten characters making up the first handwritten input is a first size, the one or more predicted characters are displayed at a second size; 164. The method of any one of claims 151 to 163, wherein in accordance with a determination that a size of the handwritten characters constituting the first handwritten input is a third size different from the first size, the one or more predicted characters are displayed at a fourth size different from the second size.

165. 165. The method of claim 164, wherein the second size matches the first size and the fourth size matches the third size.

166. receiving, while displaying the user interface, a second user input via the touch-sensitive display including a second handwritten input directed at the user interface, the second handwritten input corresponding to a second sequence of characters; In response to receiving the second user input, displaying, in accordance with a determination that the second sequence of characters satisfies one or more criteria, within the user interface a representation of the second handwritten input and a representation of one or more second predicted characters selected based on the second sequence of characters in the second handwritten input; displaying, within the user interface, the representation of the second handwritten input without displaying the representation of the one or more second predicted characters in accordance with a determination that the second sequence of characters does not satisfy the one or more criteria; and 166. The method of any one of claims 151 to 165, further comprising:

167. receiving, while displaying the user interface, a second user input via the touch-sensitive display including a second handwritten input directed at the user interface, the second handwritten input corresponding to a second sequence of characters; In response to receiving the second user input, displaying within the user interface a representation of the second handwritten input; and displaying, in accordance with determining that more than a predetermined amount of time has elapsed since a termination of the second handwritten input, within the user interface a representation of one or more second predicted characters selected based on the second sequence of characters in the second handwritten input; forgoing displaying the representation of the one or more second predicted characters in response to determining that less than the predetermined amount of time has elapsed since the termination of the second handwriting input; 167. The method of any one of claims 151 to 166, further comprising:

168. 168. The method of any one of claims 151 to 167, wherein a combination of the first character sequence and the one or more predicted characters is displayed within the user interface within a selectable user interface element that is selectable to input the combination of the first character sequence and the one or more predicted characters for use within the user interface.

169. 169. The method of claim 168, wherein the selectable user interface elements include a first representation of the combination of the first character sequence and the one or more predicted characters and a second representation of the first character sequence, the first representation being selectable to input the combination of the first character sequence and the one or more predicted characters for use within the user interface and the second representation being selectable to input the one or more predicted characters without the first character sequence for use within the user interface.

170. one or more processors; Memory, One or more programs; the one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: Displaying a user interface on a touch-sensitive display; while displaying the user interface, receiving a first user input via the touch-sensitive display including a first handwritten input directed to the user interface, the first handwritten input corresponding to a first character sequence; in response to receiving the first user input, displaying within the user interface a representation of the first handwritten input and a representation of one or more predicted characters selected based on the first sequence of characters in the first handwritten input, the representation of the one or more predicted characters being displayed after the representation of the first handwritten input in a writing direction. An electronic device that contains instructions.

171. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: Displaying a user interface on a touch-sensitive display; receiving, while displaying the user interface, a first user input via the touch-sensitive display including a first handwritten input directed at the user interface, the first handwritten input corresponding to a first sequence of characters; in response to receiving the first user input, displaying within the user interface a representation of the first handwritten input and a representation of one or more predicted characters selected based on the first sequence of characters in the first handwritten input, the representation of the one or more predicted characters being displayed after the representation of the first handwritten input in a writing direction; A non-transitory computer-readable storage medium for causing a method to be performed, comprising:

172. one or more processors; Memory, means for displaying a user interface on a touch-sensitive display; means for receiving, while displaying the user interface, a first user input via the touch-sensitive display, the first user input including a first handwritten input directed at the user interface, the first handwritten input corresponding to a first sequence of characters; means for displaying, in response to receiving the first user input, within the user interface, a representation of the first handwritten input and a representation of one or more predicted characters selected based on the first sequence of characters in the first handwritten input, the representation of the one or more predicted characters being displayed after the representation of the first handwritten input in a writing direction; 1. An electronic device comprising:

173. 1. An information processing apparatus for use in an electronic device, comprising: means for displaying a user interface on a touch-sensitive display; means for receiving, while displaying the user interface, a first user input via the touch-sensitive display, the first user input including a first handwritten input directed at the user interface, the first handwritten input corresponding to a first sequence of characters; means for displaying, in response to receiving the first user input, within the user interface, a representation of the first handwritten input and a representation of one or more predicted characters selected based on the first sequence of characters in the first handwritten input, the representation of the one or more predicted characters being displayed after the representation of the first handwritten input in a writing direction; An information processing device comprising:

174. one or more processors; Memory, One or more programs; 170. An electronic device comprising: one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing a method according to any one of claims 151 to 169.

175. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method according to any one of claims 151 to 169.

176. one or more processors; Memory, Means for carrying out the method of any one of claims 151 to 169; 1. An electronic device comprising:

177. 1. An information processing apparatus for use in an electronic device, comprising:

170. An information processing device comprising means for carrying out a method according to any one of claims 151 to 169.

178. 1. An electronic device having a display device and one or more input devices, detecting, while displaying a user interface, an input via the one or more input devices corresponding to a path of travel; While continuing to detect said input, displaying, in response to detecting the input, via the display device a representation of the path having a first appearance at a first location within the user interface; after displaying the representation of the route having the first appearance, changing an appearance of at least a portion of the representation of the route to a second appearance different from the first appearance; after changing the appearance of the portion of the representation of the path to a second appearance different from the first appearance; displaying one or more font-based characters selected based on the path at a second location within the user interface; and displaying an animation of the portion of the path moving from the first location within the user interface to the second location within the user interface; The method includes:

179. 179. The method of claim 178, wherein the first appearance is a first color and the second appearance is a second color different from the first color.

180. 180. A method according to any one of claims 178 to 179, wherein altering the appearance of the portion of the representation of the route comprises gradually animating the change in appearance of the portion of the representation of the route by progressively changing a sub-portion of the representation of the route from the first appearance to the second appearance in a direction determined based on the direction in which the representation of the route was initially displayed.

181. 181. A method according to any one of claims 178 to 180, wherein altering the appearance of the portion of the representation of the route comprises gradually animating the change in appearance of the portion of the representation of the route by progressively changing a sub-portion of the representation of the route from the first appearance to the second appearance at a rate determined based on the rate at which the representation of the route was initially displayed.

182. 182. The method of any one of claims 178 to 181, wherein altering the appearance of the portion of the representation of the path comprises ceasing to animate the change of the appearance of the portion of the representation of the path from the first appearance to the second appearance when the portion of the representation of the path reaches a first threshold distance from the input that caused the path to be generated.

183. detecting continued movement of the input after ceasing to animate the change in appearance of the portion of the representation of the path; by progressively changing a sub-portion of the representation of the path from the first appearance to the second appearance in a direction determined based on the direction in which the representation of the path was initially displayed, in response to detecting the continued movement of the input; resuming gradual animation of the change in appearance of the portion of the representation of the path; and 183. The method of claim 182, comprising:

184. 184. A method according to any one of claims 178 to 183, wherein the animation of the portion of the path moving from the first position in the user interface to the second position in the user interface is displayed in response to detecting an end of the input.

185. 185. The method of any one of claims 178 to 184, wherein the animation of the portion of the path moving from the first location in the user interface to the second location in the user interface is displayed in response to detecting that a character recognition criterion has been met.

186. 186. The method of any one of claims 178 to 185, wherein the animation of the portion of the path moving from the first location in the user interface to the second location in the user interface comprises replacing the portion of the path with a plurality of separate particles that move relative to each other while moving towards the second location.

187. 187. The method of claim 186, wherein the number of the distinct particles in the plurality of distinct particles is determined based at least in part on a length of the portion of the representation of the path to which the plurality of distinct particles correspond.

188. 188. The method of any one of claims 178 to 187, wherein the animation of the portion of the path moving from the first location in the user interface to the second location in the user interface includes ceasing to display the animation before a visual element corresponding to the animation reaches the second location.

189. the one or more font-based characters comprising a sequence of font-based characters; 189. The method of any one of claims 178 to 188, wherein the animation of the portion of the path moving from the first location in the user interface to the second location in the user interface comprises sequentially animating portions of the representation of the path that correspond to different characters by commencing animation of a first portion of the representation of the path that corresponds to a first font-based character in the sequence of characters before commencing animation of a second portion of the representation of the path that corresponds to a second font-based character in the sequence of characters that occurs after a first font-based character in the sequence of characters.

190. the one or more font-based characters comprising a sequence of font-based words; 189. The method of any one of claims 178 to 188, wherein the animation of the portion of the path moving from the first location in the user interface to the second location in the user interface comprises sequentially animating portions of the representation of the path that correspond to different words by commencing animation of a first portion of the representation of the path that corresponds to a first font-based word in the sequence of words before commencing animation of a second portion of the representation of the path that corresponds to a second font-based word in the sequence of words that occurs after a first font-based word in the sequence of words.

191. one or more processors; Memory, One or more programs; the one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: detecting, while displaying the user interface, an input via one or more input devices corresponding to a path of travel; While continuing to detect said input, displaying, in response to detecting the input, via a display device a representation of the path having a first appearance at a first location within the user interface; after displaying the representation of the route having the first appearance, changing an appearance of at least a portion of the representation of the route to a second appearance different from the first appearance; after changing the appearance of the portion of the representation of the path to a second appearance different from the first appearance; Displaying one or more font-based characters selected based on the path at a second location within the user interface; displaying an animation of the portion of the path moving from the first location within the user interface to the second location within the user interface. An electronic device that contains instructions.

192. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: Detecting inputs corresponding to a path of travel via one or more input devices while displaying the user interface; While continuing to detect said input, displaying, in response to detecting the input, via a display device a representation of the path having a first appearance at a first location within the user interface; after displaying the representation of the route having the first appearance, changing an appearance of at least a portion of the representation of the route to a second appearance different from the first appearance; after changing the appearance of the portion of the representation of the path to a second appearance different from the first appearance; displaying one or more font-based characters selected based on the path at a second location within the user interface; and displaying an animation of the portion of the path moving from the first location within the user interface to the second location within the user interface; A non-transitory computer-readable storage medium for causing a method to be performed, comprising:

193. one or more processors; Memory, means for detecting, while displaying the user interface, an input corresponding to a path of travel via one or more input devices; While continuing to detect said input, displaying, in response to detecting the input, via a display device a representation of the path having a first appearance at a first location within the user interface; means for, after displaying the representation of the route having the first appearance, changing the appearance of at least a portion of the representation of the route to a second appearance different from the first appearance; after changing the appearance of the portion of the representation of the path to a second appearance different from the first appearance; Displaying one or more font-based characters selected based on the path at a second location within the user interface; means for displaying an animation of the portion of the path moving from the first location within the user interface to the second location within the user interface; 1. An electronic device comprising:

194. 1. An information processing apparatus for use in an electronic device, comprising: means for detecting, while displaying the user interface, an input corresponding to a path of travel via one or more input devices; While continuing to detect said input, displaying, in response to detecting the input, via a display device a representation of the path having a first appearance at a first location within the user interface; means for, after displaying the representation of the route having the first appearance, changing the appearance of at least a portion of the representation of the route to a second appearance different from the first appearance; after changing the appearance of the portion of the representation of the path to a second appearance different from the first appearance; Displaying one or more font-based characters selected based on the path at a second location within the user interface; means for displaying an animation of the portion of the path moving from the first location within the user interface to the second location within the user interface; An information processing device comprising:

195. one or more processors; Memory, One or more programs; 191. An electronic device comprising: one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 178 to 190.

196. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method according to any one of claims 178 to 190.

197. one or more processors; Memory, Means for carrying out the method according to any one of claims 178 to 190; 1. An electronic device comprising:

198. 1. An information processing apparatus for use in an electronic device, comprising:

191. An information processing device comprising: means for performing a method according to any one of claims 178 to 190.

199. receiving user input, including handwritten input, via the touch-sensitive display while the plurality of text characters in the first editable text string are selected; In response to receiving the user input, replacing the plurality of text characters in the first editable text string with respective editable text corresponding to the handwritten input; 54. The method of any one of claims 35 to 53, further comprising:

200. while displaying the text input user interface including the first sequence of characters, receiving, via the touch-sensitive display, respective user inputs including movements over respective portions of the first sequence of characters while maintaining contact with the touch-sensitive display at a location between a first character and a second character in the first sequence of characters; In response to receiving each of the user inputs, updating the text input user interface by adding a white space character between the first character and the second character in the first character sequence according to a determination that there is no character separating the first character and the second character in the first character sequence; updating the text input user interface by removing the white space characters between the first character and the second character in the first character sequence according to a determination that only white space characters separate the first character and the second character in the first character sequence; 85. The method of any one of claims 62 to 84, further comprising:

201. 1. An electronic device in communication with a display generating component and one or more input devices, comprising: displaying, via the display generation component, a user interface including a first content entry area and a content entry user interface element, while the electronic device is in a first content entry mode in which the electronic device is configured to receive handwritten input and convert the handwritten input into font-based text, the content entry user interface element including a first set of options corresponding to the first content entry mode; receiving, while the electronic device is in the first content input mode and displaying the content input user interface element, a user input corresponding to a request to switch the electronic device from the first content input mode to a second content input mode, in which the electronic device is configured to receive handwritten input without converting the handwritten input to font-based text; In response to receiving the user input, replacing the first set of options corresponding to the first content entry mode in the content entry user interface element with a second set of options different from the first set of options corresponding to the second content entry mode; The method includes:

202. receiving user input, including handwritten input directed at the first content entry area, via the one or more input devices while the electronic device is in the first content entry mode; In response to receiving the user input, displaying a representation of the handwritten input within the user interface at a location corresponding to the first content entry area; after displaying the representation of the handwritten input at the location corresponding to the first content entry area; ceasing to display the representation of the handwritten input; and displaying font-based text corresponding to the handwritten input in the first content entry area; 202. The method of claim 201, further comprising:

203. receiving user input, including handwritten input, directed at the first content entry area via the one or more input devices while the electronic device is in the second content entry mode; In response to receiving the user input, displaying a representation of the handwritten input within the user interface at a location corresponding to the first content entry area without displaying font-based text corresponding to the representation of the handwritten input; 203. The method of any one of claims 201 to 202, further comprising:

204. The first set of options corresponding to the first content entry mode includes: one or more options for selecting one or more font settings for font-based text in the first content entry area; one or more options for displaying a soft keyboard for entering font-based text into the first content entry area; or one or more options for inserting an emoji into the first content entry area; 204. The method of any one of claims 201 to 203, comprising one or more of the following:

205. 205. The method of any one of claims 201 to 204, wherein the second set of options corresponding to the second content entry mode includes one or more options for selecting one or more color settings for a representation of handwritten input in the first content entry area.

206. receiving user input directed to the content entry user interface element while displaying the content entry user interface element; In response to receiving the user input, in response to a determination that the user input includes a selection input directed at a location corresponding to the content input user interface element and movement while maintaining the selection input, moving the content input user interface element within the user interface in accordance with the movement of the user input; 206. The method of any one of claims 201 to 205, further comprising:

207. in response to moving the content entry user interface element in accordance with the movement of the user input; in accordance with a determination that the final position of the content input user interface element satisfies one or more position criteria, displaying the content input user interface element at a first size, the content input user interface element including a representation of the current content input mode without displaying a given set of options corresponding to the current content input mode while the content input user interface element has the first size; displaying the content input user interface element at a second size different from the first size in accordance with a determination that the final position of the content input user interface element does not satisfy the one or more position criteria, the content input user interface element including a representation of the current content input mode and the given set of options corresponding to the current content input mode while the content input user interface element has a second size; 207. The method of claim 206, further comprising:

208. a global setting for configuring the electronic device to accept or ignore respective handwritten input from objects other than the respective device while the electronic device is in the first content input mode and the second content input mode; 208. The method of any one of claims 201 to 207, wherein the content input user interface element includes selectable options to accept or ignore the respective handwriting input from the object other than the stylus while in the first content input mode and the second content input mode regardless of the state of the global setting.

209. The user interface includes a second content entry area, the first content entry area supporting a first set of content options and the second content entry area supporting a second set of content options different from the first set, and the method further comprises: While the electronic device is in the first content input mode, receiving user input directed to each content entry area; in response to receiving the user input directed to the respective content entry area; Within the user interface, the content entry user interface element, pursuant to determining that the respective content entry area is the first content entry area, the content entry user interface element includes a first set of options corresponding to the first set of content options; displaying the content entry user interface element including a third set of options different from the first set of options corresponding to the second set of content options in response to determining that the respective content entry area is the second content entry area; 209. The method of claim 208, further comprising:

210. while displaying the user interface including the first content entry area, the first content entry area supporting content entry in the first content entry mode and the second content entry mode, receiving user input directed to the first content entry area; in response to the user input directed to the first content entry area, within the user interface, a content entry user interface element, displaying a content entry user interface element including a respective set of options corresponding to a most recently used content entry mode in the first content entry area in accordance with a determination that the first content entry area does not include font-based text; 210. The method of any one of claims 201 to 209, further comprising:

211. 211. The method of claim 210, wherein in accordance with a determination that the first content entry area includes font-based text, the content entry user interface element includes the first set of options corresponding to the first content entry mode.

212. displaying the content entry user interface element, including a first option in the first set of options in accordance with determining that the user interface is a user interface of a first application; in accordance with a determination that the user interface is a user interface of a second application that is different from the first application, including a second option in the first set of options without including the first option in the first set of options; 212. The method of any one of claims 201 to 211, comprising:

213. the user interface being a user interface of a first application, the method comprising: while displaying, via the display generation component, the user interface including the first content entry area; displaying, via the display generation component, a second user interface of a second application, the second user interface including a second content entry area; receiving a user input while displaying the user interface and the second user interface; In response to receiving the user input, displaying the content entry user interface element in a first location corresponding to the first application in accordance with determining that the user input is directed to the first content entry area; displaying the content entry user interface element at a second location, different from the first location, corresponding to the second application, in accordance with determining that the user input is directed to the second content entry area; 213. The method of any one of claims 201 to 212, further comprising:

214. one or more processors; Memory, One or more programs; the one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising: displaying, via a display generation component, a user interface including a first content entry area and a content entry user interface element, while the electronic device is in a first content entry mode in which the electronic device is configured to receive handwritten input and convert the handwritten input to font-based text, the content entry user interface element including a first set of options corresponding to the first content entry mode. receiving, while the electronic device is in the first content input mode and displaying the content input user interface element, a user input corresponding to a request to switch the electronic device from the first content input mode to a second content input mode, wherein the electronic device is configured to receive handwritten input without converting the handwritten input to font-based text; In response to receiving the user input, replacing the first set of options corresponding to the first content entry mode in the content entry user interface element with a second set of options different from the first set of options corresponding to the second content entry mode; An electronic device that contains instructions.

215. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to: displaying, via a display generation component, a user interface including a first content entry area and a content entry user interface element, while the electronic device is in a first content entry mode in which the electronic device is configured to receive handwritten input and convert the handwritten input into font-based text, the content entry user interface element including a first set of options corresponding to the first content entry mode; receiving, while the electronic device is in the first content input mode and displaying the content input user interface element, a user input corresponding to a request to switch the electronic device from the first content input mode to a second content input mode, in which the electronic device is configured to receive handwritten input without converting the handwritten input to font-based text; In response to receiving the user input, replacing the first set of options corresponding to the first content entry mode in the content entry user interface element with a second set of options different from the first set of options corresponding to the second content entry mode; A non-transitory computer-readable storage medium for causing a method to be performed, comprising:

216. 1. An electronic device comprising: one or more processors; Memory, means for displaying, via a display generation component, a user interface including a first content entry area and a content entry user interface element, while the electronic device is in a first content entry mode in which the electronic device is configured to receive handwritten input and convert the handwritten input into font-based text, the content entry user interface element including a first set of options corresponding to the first content entry mode; means for receiving, while the electronic device is in the first content input mode and displaying the content input user interface element, a user input corresponding to a request to switch the electronic device from the first content input mode to a second content input mode, wherein the electronic device is configured to receive handwritten input without converting the handwritten input to font-based text; In response to receiving the user input, means for replacing the first set of options corresponding to the first content entry mode in the content entry user interface element with a second set of options different from the first set of options corresponding to the second content entry mode; 1. An electronic device comprising:

217. 1. An information processing apparatus for use in an electronic device, comprising: means for displaying, via a display generation component, a user interface including a first content entry area and a content entry user interface element, while the electronic device is in a first content entry mode in which the electronic device is configured to receive handwritten input and convert the handwritten input into font-based text, the content entry user interface element including a first set of options corresponding to the first content entry mode; means for receiving, while the electronic device is in the first content input mode and displaying the content input user interface element, a user input corresponding to a request to switch the electronic device from the first content input mode to a second content input mode, wherein the electronic device is configured to receive handwritten input without converting the handwritten input to font-based text; In response to receiving the user input, means for replacing the first set of options corresponding to the first content entry mode in the content entry user interface element with a second set of options different from the first set of options corresponding to the second content entry mode; An information processing device comprising:

218. one or more processors; Memory, One or more programs; 214. An electronic device comprising: one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the method of any one of claims 201 to 213.

219. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs including instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method according to any one of claims 201 to 213.

220. one or more processors; Memory, Means for carrying out the method according to any one of claims 201 to 213; 1. An electronic device comprising:

221. 1. An information processing apparatus for use in an electronic device, comprising:

214. An information processing device comprising means for carrying out the method of any one of claims 201 to 213.

Images