A system and method for proactively identifying relevant content and making it visible on a touch-sensitive device.

Abstract

A system and method for proactively identifying relevant content and making it visible on an electronic device having a touch-sensitive display are disclosed. [Solution] An application is executed on an electronic device in response to a command from the user of the electronic device. While the application is running, usage data is collected. The usage data includes at least one or more actions performed by the user within the application. Based on the collected usage data, at least one trigger condition is automatically obtained without human intervention, and at least one trigger condition is associated with a specific action from among the one or more actions performed by the user within the application. When it is determined that at least one trigger condition has been met, the user is provided with an indication that the specific action associated with the trigger condition is available.

Description

Technical Field

[0001] The embodiments disclosed herein generally relate to electronic devices having touch-sensitive displays, and more particularly, to systems and methods for proactively identifying relevant content and surfacing it on an electronic device that communicates with a display and a touch-sensitive surface.

Background Art

[0002] Handheld electronic devices having touch-sensitive displays are widely popular. Users of these widely popular handheld electronic devices are currently installing a large number of applications on their devices and using these applications to perform their daily activities more efficiently. However, in order to access these applications, the user typically unlocks their device, locates the desired application (e.g., by looking around the home screen to find the location of the icon associated with the desired application or by searching for the desired application within a search interface), and then also has to locate the location of the desired function within the desired application. Thus, instead of being able to simply and immediately execute the desired application (e.g., by a single touch input) and / or execute the desired function, the user often spends a significant amount of time locating the desired application and the location of the desired functions within these applications.

[0003] Furthermore, the installation of a large number of applications bombards the user with a continuous stream of information, making it impossible to view everything immediately. For this reason, users often desire to revisit specific information they noticed earlier or use specific information later. However, often the user is unable to locate the location of specific information or remember how to locate the location of specific information.

[0004] Therefore, it is desirable to provide an intuitive and easy-to-use system and method for proactively identifying relevant content (e.g., specific information) and making it visible on an electronic device that communicates with a display and touch-sensitive surface. [Overview of the project]

[0005] Therefore, there is a demand for electronic devices with faster and more efficient methods and interfaces for quick access to applications and desired functions within those applications. Furthermore, there is a demand for electronic devices that assist users in managing the continuous flow of information they receive daily by proactively identifying and providing relevant information (e.g., contacts, nearby locations, applications, news articles, addresses, and other information available on the device) before this information is explicitly requested by the user. Such methods and interfaces optionally complement or replace conventional methods for accessing applications. Such methods and interfaces result in a more efficient human-machine interface by reducing the input required for the user to locate the desired information. In the case of battery-powered devices, such methods and interfaces conserve power and extend the time interval between battery recharges (e.g., by reducing the number of touch inputs required to perform various functions). Furthermore, such methods and interfaces reduce the number of touch inputs required (for example, instead of having to continuously and aimlessly tap the touch-sensitive display to locate the desired information, the methods and interfaces disclosed herein proactively provide this information without requiring user input), thereby extending the lifespan of the touch-sensitive display.

[0006] The above-mentioned defects and other problems relating to user interfaces for electronic devices having touch-sensitive surfaces are addressed by the disclosed device. In some embodiments, the device is a desktop computer. In some embodiments, the device is portable (e.g., a notebook computer, tablet computer, or handheld device). In some embodiments, the device has a touchpad. In some embodiments, the device has a touch-sensitive display (also known as a “touchscreen” or “touchscreen display”). In some embodiments, the device has a graphical user interface (GUI), one or more processors, memory, and one or more modules, programs, or instruction sets stored in memory to perform multiple functions. In some embodiments, the user interacts with the GUI primarily by stylus and / or finger touch and gestures on the touch-sensitive surface. In some embodiments, the functions optionally include image editing, drawing, presenting, word processing, website creation, disk authoring, spreadsheet creation, gameplay, making phone calls, video conferencing, sending emails, instant messaging, fitness support, digital photography, digital videography, web browsing, digital music playback, and / or digital video playback. The executable instructions that perform these functions are optionally included in non-temporary computer-readable storage media or other computer program products configured to be executed by one or more processors.

[0007] (A1) In some embodiments, the method is performed on an electronic device having a touch-sensitive display (touchscreen 112, Figure 1C) (for example, a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes running an application on the electronic device in response to a command from a user of the electronic device. The method further includes collecting usage data while the application is running. The usage data includes at least one or more actions (or types of actions) performed by the user within the application. The method also includes (i) automatically and without human intervention obtaining at least one trigger condition based on the collected usage data, and (ii) associating at least one trigger condition with a specific action from among one or more actions performed by the user within the application. When the method determines that at least one trigger condition has been met, it includes providing the user with an indication that the specific action associated with the trigger condition is available.

[0008] (A2) In some embodiments of the method described in A1, obtaining at least one trigger condition includes transmitting usage data from an electronic device to one or more remotely located servers and receiving at least one trigger condition from one or more servers.

[0009] (A3) In some embodiments of the method described in A1 or A2, providing an indication includes displaying a user interface object on the lock screen of a touch-sensitive display that corresponds to a specific action associated with a trigger condition.

[0010] (A4) In some embodiments of the method described in A3, the user interface object includes a description of a specific action associated with a trigger condition.

[0011] (A5) In some embodiments of the method described in A4, the user interface object further includes an icon associated with the application.

[0012] (A6) In some embodiments of the method described in any one of A3 to A5, the method further includes detecting a first gesture in a user interface object. In response to detecting the first gesture, the method includes (i) displaying an application on a touch-sensitive display, and (ii) performing a specific action associated with a trigger condition while the application is being displayed.

[0013] (A7) In some embodiments of the method described in A6, the first gesture is a swipe gesture on a user interface object.

[0014] (A8) In some embodiments of the method described in any one of A3 to A5, the method further includes detecting a second gesture in a user interface object. In response to the detection of the second gesture, and while the lock screen remains displayed on the touch-sensitive display, a specific action associated with a trigger condition is performed.

[0015] (A9)In some embodiments of the method described in A8, the second gesture is a single tap on a default area of ​​a user interface object.

[0016] (A10) In some embodiments of the method described in any one of A3 to A9, the user interface object is displayed in the default center of the lock screen.

[0017] (A11) In some embodiments of the method described in A1, providing the user with an indication that a specific action associated with a trigger condition is available includes performing the specific action.

[0018] In some embodiments of the method described in (A12)A3, the user interface object is an icon associated with the application, and the user interface object is substantially displayed in the corner of the lock screen of a touch-sensitive display.

[0019] (A13) In some embodiments of the method described in any one of A1 to A12, the method further includes receiving a command from a user to unlock an electronic device. The method includes displaying the home screen of the electronic device on a touch-sensible display in response to receiving the command. The method also includes providing the user with an indication on the home screen that a particular action associated with a trigger condition is available.

[0020] (A14) In some embodiments of the method described in A13, the home screen includes (i) a first part which includes one or more user interface pages for launching a first set of applications available on the electronic device, and (ii) a second part which is displayed adjacent to the first part for launching a second set of applications available on the electronic device. The second part is displayed on all the user interface pages included in the first part, and providing an indication on the home screen includes displaying an indication on the second part.

[0021] (A15) In some embodiments of the method described in A14, the second set of applications is different from and smaller than the first set of applications.

[0022] (A16) In some embodiments of the method according to any one of A1 to A15, determining that at least one trigger condition is met includes determining that an electronic device is coupled with a second device different from the electronic device.

[0023] (A17)In some embodiments of the method according to any one of A1 to A16, determining that at least one trigger condition is satisfied includes determining that the electronic device has arrived at an address corresponding to the home or workplace associated with the user.

[0024] (A18)In some embodiments of the method according to A17, determining that the electronic device has arrived at an address corresponding to the home or workplace associated with the user includes monitoring motion data from an accelerometer of the electronic device and determining, based on the monitored motion data, that the electronic device has not moved for a threshold amount of time.

[0025] (A{19})In some embodiments of the method according to any one of A1 to A18, the usage data further includes verbal instructions provided by the user to the virtual assistant application while the application is actively running. At least one trigger condition is further based on the verbal instructions provided to the virtual assistant application.

[0026] (A20)In some embodiments of the method according to A19, the verbal instructions include a request to create a reminder corresponding to the current state of the application, and the current state corresponds to the state of the application when the verbal instructions are provided.

[0027] (A21)In some embodiments of the method according to A20, the state of the application when the verbal instructions are provided is selected from the group consisting of the page displayed within the application when the verbal instructions are provided, the content being played within the application when the verbal instructions are provided, the notifications displayed within the application when the verbal instructions are provided, and the active portion of the page displayed within the application when the verbal instructions are provided.

[0028] (A22)In some embodiments of the method according to A20, the verbal instructions include the word "this" regarding the current state of the application.

[0029] (A23)In another aspect, the method is executed in one or more electronic devices (e.g., the portable multifunctional device 100 (FIG. 5) and one or more servers 502 (FIG. 5)). The method includes executing an application on a first electronic device among the one or more electronic devices in response to an instruction from a user of the first electronic device. The method includes automatically collecting usage data without human intervention while the application is being executed, the usage data including at least one or more actions (or types of actions) performed by the user within the application. The method further includes automatically providing at least one trigger condition without human intervention based on the collected usage data. The method further includes associating the at least one trigger condition with a specific action among the one or more actions performed by the user within the application. The method includes providing an indication to the user that a specific action associated with the trigger condition is available when it is determined that the at least one trigger condition is met.

[0030] (A24)In another aspect, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensitive display, one or more processors, and a memory storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more programs cause the electronic device to execute the method according to any one of A1 to A22.

[0031] (A25)In yet another aspect, an electronic device is provided, the electronic device including a touch-sensitive display and means for executing the method according to any one of A1 to A22.

[0032] (A26) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensitive display, the executable instruction causes the electronic device to perform the method described in any one of A1 to A22.

[0033] (A27) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive display. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of A1 to A22.

[0034] (A28) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 4201, Figure 42), a touch-sensitive surface unit (e.g., touch-sensitive surface unit 4203, Figure 42), and a processing unit (e.g., processing unit 4205, Figure 42). In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (i.e., computing devices A through D). For ease of explanation, Figure 42 shows the display unit 4201 and the touch-sensitive surface unit 4203 as being integrated into the electronic device 4200, although in some embodiments, one or both of these units communicate with the electronic device even if the unit remains physically separated from the electronic device. The processing unit is coupled with the touch-sensitive surface unit and the display unit. In some embodiments, the touch-sensitive surface unit and the display unit are integrated into a single touch-sensitive display unit (also referred to herein as a touch-sensitive display). The processing unit includes an execution unit (e.g., execution unit 4207, Figure 42), a collection unit (e.g., collection unit 4209, Figure 42), an acquisition unit (e.g., acquisition unit 4211, Figure 42), an association unit (e.g., association unit 4213, Figure 42), a provision unit (e.g., provision unit 4215, Figure 42), a transmission unit (e.g., transmission unit 4217, Figure 42), a reception unit (e.g., reception unit 4219, Figure 42), a display unit (e.g., display unit 4221, Figure 42), a detection unit (e.g., detection unit 4223, Figure 42), an implementation unit (e.g., implementation unit 4225, Figure 42), a determination unit (e.g., determination unit 4227, Figure 42), and a monitoring unit (e.g., monitoring unit 4229, Figure 42).The processing unit (or one or more of its components, such as units 4207 to 4229) is configured to execute an application on an electronic device in response to a command from the user of the electronic device (e.g., by the execution unit 4207), to collect usage data (e.g., by the collection unit 4209) while the application is running, to collect usage data which includes at least one or more actions performed by the user within the application, to automatically and without human intervention acquire at least one trigger condition (e.g., by the acquisition unit 4211) based on the collected usage data, to associate at least one trigger condition with a specific action among the one or more actions performed by the user within the application (e.g., by the association unit 4213), and, when it is determined that at least one trigger condition has been met, to provide the user with an indication that the specific action associated with the trigger condition is available (e.g., by the providing unit 4215).

[0035] (A29) In some embodiments of the electronic device described in A28, obtaining at least one trigger condition includes transmitting usage data from the electronic device to one or more remotely located servers (e.g., by a transmitting unit 4217) and receiving at least one trigger condition from one or more servers (e.g., by a receiving unit 4219).

[0036] (A30) In some embodiments of the electronic devices described in A28 or A29, providing an indication includes displaying a user interface object on the lock screen of a touch-sensitive display unit that corresponds to a specific action associated with a trigger condition (for example, by display unit 4217 and / or display unit 4201).

[0037] In some embodiments of the electronic devices described in (A31)A30, the user interface object includes a description of a specific action associated with a trigger condition.

[0038] (A32) In some embodiments of the electronic devices described in A31, the user interface object further includes an icon associated with the application.

[0039] (A33) In some embodiments of the electronic device described in any one of A30 to A32, the processing unit is further configured to detect a first gesture in a user interface object (e.g., by detection unit 4223 and / or touch-sensing surface unit 4203). In response to the detection of the first gesture, (i) display an application on a touch-sensing display unit (e.g., by display unit 4217 and / or display unit 4201), and (ii) perform a specific action associated with a trigger condition while the application is being displayed (e.g., by execution unit 4225).

[0040] (A34) In some embodiments of the electronic devices described in A33, the first gesture is a swipe gesture on a user interface object.

[0041] (A35) In some embodiments of the electronic device described in any one of A30 to A33, the processing unit is further configured to detect a second gesture in a user interface object (e.g., by detection unit 4223 and / or touch-sensitive surface unit 4203). In response to the detection of the second gesture and while the lock screen continues to be displayed on the touch-sensitive display unit, the processing unit is configured to perform a specific action associated with a trigger condition (e.g., by execution unit 4225).

[0042] (A36) In some embodiments of the electronic devices described in A35, the second gesture is a single tap on a default area of ​​a user interface object.

[0043] (A37) In some embodiments of the electronic device described in any one of A30 to A36, the user interface object is displayed in the default center of the lock screen.

[0044] (A38) In some embodiments of the electronic device described in A28, providing the user with an indication that a specific action associated with a trigger condition is available includes performing the specific action (for example, by the implement unit 4225).

[0045] (A39) In some embodiments of the electronic device described in A30, the user interface object is an icon associated with an application, and the user interface object is substantially displayed in the corner of the lock screen of the touch-sensitive display unit.

[0046] (A40) In some embodiments of the electronic device described in any one of A28 to A39, the processing unit is further configured to receive a command from the user to unlock the electronic device (e.g., by a receiving unit 4219). Upon receiving the command, the processing unit is configured to display the home screen of the electronic device on a touch-sensitive display unit (e.g., by a display unit 4217 and / or a display unit 4201). The processing unit is also configured to provide the user with an indication on the home screen that a particular action associated with a trigger condition is available (e.g., by a providing unit 4215).

[0047] In some embodiments of the electronic device described in (A41)A40, the home screen includes (i) a first part containing one or more user interface pages for launching a first set of applications available on the electronic device, and (ii) a second part displayed adjacent to the first part for launching a second set of applications available on the electronic device. The second part is displayed on all the user interface pages contained in the first part, and providing an indication on the home screen includes displaying the indication on the second part (for example, by display unit 4217 and / or display unit 4201).

[0048] (A42) In some embodiments of the electronic device described in A41, the second set of applications is different from and smaller than the first set of applications.

[0049] (A43) In some embodiments of the electronic devices described in any one of A28 to A42, determining that at least one trigger condition is met includes determining that the electronic device is coupled with a second device different from the electronic device (for example, by determination unit 4227).

[0050] (A44) In some embodiments of the electronic device described in any one of A28 to A43, determining that at least one trigger condition has been met includes determining that the electronic device has arrived at an address corresponding to the user's home or workplace (for example, by determination unit 4227).

[0051] (A45) In some embodiments of the electronic devices described in A44, determining that the electronic device has arrived at an address corresponding to the user's home or workplace includes monitoring motion data from the electronic device's accelerometer (e.g., by monitoring unit 4229) and determining, based on the monitored motion data, that the electronic device has not moved beyond a threshold time period (e.g., by determination unit 4227).

[0052] (A46) In some embodiments of the electronic device described in any one of A28 to A45, the usage data further includes oral instructions provided by the user to the virtual assistant application while the application continues to run. At least one trigger condition is further based on the oral instructions provided to the virtual assistant application.

[0053] (A47) In some embodiments of the electronic device described in A46, the oral command includes a request to create a reminder corresponding to the current state of the application, where the current state corresponds to the state of the application when the oral command was provided.

[0054] (A48) In some embodiments of the electronic device described in A47, the state of the application when an oral command is provided is selected from the group consisting of pages displayed in the application when an oral command is provided, content being played in the application when an oral command is provided, notifications displayed in the application when an oral command is provided, and the active portion of the page displayed in the application when an oral command is provided.

[0055] (A49) In some embodiments of the electronic devices described in A46, the oral instruction includes the word “this” in relation to the current state of the application.

[0056] (B1) In some embodiments, the method is performed on an electronic device having a touch-sensitive display (touchscreen 112, Figure 1C) (for example, a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes obtaining at least one trigger condition based on usage data associated with a user of the electronic device, the usage data including one or more actions (or types of actions) performed by the user within an application while the application is running on the electronic device. The method also includes associating at least one trigger condition with a specific action from among the one or more actions performed by the user within the application. When the method determines that at least one trigger condition has been met, it includes providing the user with an indication that the specific action associated with the trigger condition is available.

[0057] (B2) In some embodiments of the method described in B1, the method further includes the method described in any one of A2 to A22.

[0058] (B3) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensitive display, one or more processors, and a memory for storing one or more programs, wherein when one or more programs are executed by one or more processors, one or more programs cause the electronic device to perform the method described in B1 or B2.

[0059] (B4) In yet another embodiment, an electronic device is provided which includes a touch-sensitive display and means for performing the method described in B1 or B2.

[0060] (B5) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores executable instructions, and when an executable instruction is executed by an electronic device having a touch-sensitive display, the executable instruction causes the electronic device to perform the method described in B1 or B2.

[0061] (B6) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive display. In some embodiments, the graphical user interface includes a user interface displayed according to the method of B1 or B2.

[0062] (B7) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 4201, Figure 42), a touch-sensitive surface unit (e.g., touch-sensitive surface unit 4203, Figure 42), and a processing unit (e.g., processing unit 4205, Figure 42). In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (i.e., computing devices A through D). For ease of explanation, Figure 42 shows the display unit 4201 and the touch-sensitive surface unit 4203 as being integrated into the electronic device 4200, but in some embodiments, one or both of these units communicate with the electronic device even when the units remain physically separated from the electronic device. The processing unit includes an execution unit (e.g., execution unit 4207, Figure 42), a collection unit (e.g., collection unit 4209, Figure 42), an acquisition unit (e.g., acquisition unit 4211, Figure 42), an association unit (e.g., association unit 4213, Figure 42), a provision unit (e.g., provision unit 4215, Figure 42), a transmission unit (e.g., transmission unit 4217, Figure 42), a reception unit (e.g., reception unit 4219, Figure 42), a display unit (e.g., display unit 4221, Figure 42), a detection unit (e.g., detection unit 4223, Figure 42), an implementation unit (e.g., implementation unit 4225, Figure 42), a determination unit (e.g., determination unit 4227, Figure 42), and a monitoring unit (e.g., monitoring unit 4229, Figure 42).The processing unit (or one or more of its components, such as units 4207 to 4229) is configured to obtain (e.g., by acquisition unit 4211) at least one trigger condition based on the usage data, which includes one or more actions performed by the user within the application while the application is running on the electronic device; associate the at least one trigger condition with a specific action among the one or more actions performed by the user within the application (e.g., by association unit 4213); and, when it determines that at least one trigger condition has been met, to provide the user with an indication that the specific action associated with the trigger condition is available (e.g., by providing unit 4215).

[0063] In some embodiments of the electronic device described in (B8)B7, obtaining at least one trigger condition includes transmitting usage data from the electronic device to one or more remotely located servers (e.g., by a transmitting unit 4217) and receiving at least one trigger condition from one or more servers (e.g., by a receiving unit 4219).

[0064] (B9) In some embodiments of the electronic devices described in B7 or B8, providing an indication includes displaying a user interface object on the lock screen of a touch-sensitive display that corresponds to a specific action associated with a trigger condition (for example, by display unit 4217 and / or display unit 4201).

[0065] In some embodiments of the electronic devices described in (B10)B9, the user interface object includes a description of a specific action associated with a trigger condition.

[0066] (B11) In some embodiments of the electronic devices described in B10, the user interface object further includes an icon associated with the application.

[0067] (B12) In some embodiments of the electronic device described in any one of B9 to B11, the processing unit is further configured to detect a first gesture in a user interface object (e.g., by detection unit 4223 and / or touch-sensing surface unit 4203). In response to the detection of the first gesture, (i) display an application on a touch-sensing display (e.g., by display unit 4217 and / or display unit 4201), and (ii) perform a specific action associated with a trigger condition while the application is being displayed (e.g., by execution unit 4225).

[0068] (B13) In some embodiments of the electronic devices described in B12, the first gesture is a swipe gesture on a user interface object.

[0069] (B14) In some embodiments of the electronic device described in any one of B9 to B12, the processing unit is further configured to detect a second gesture in a user interface object (e.g., by detection unit 4223 and / or touch-sensitive surface unit 4203). In response to the detection of the second gesture and while the lock screen continues to be displayed on the touch-sensitive display, the processing unit is configured to perform a specific action associated with a trigger condition (e.g., by execution unit 4225).

[0070] (B15) In some embodiments of the electronic devices described in B14, the second gesture is a single tap on a default area of ​​a user interface object.

[0071] (B16) In some embodiments of the electronic device described in any one of B9 to B15, the user interface object is displayed in the default center of the lock screen.

[0072] (B17) In some embodiments of the electronic devices described in B7, providing the user with an indication that a specific action associated with a trigger condition is available includes performing the specific action (for example, by the implement unit 4225).

[0073] In some embodiments of the electronic devices described in (B18)B9, the user interface object is an icon associated with an application, and the user interface object is substantially displayed in the corner of the lock screen of a touch-sensitive display.

[0074] (B19) In some embodiments of the electronic device described in any one of B7 to B18, the processing unit is further configured to receive a command from the user to unlock the electronic device (e.g., by a receiving unit 4219). Upon receiving the command, the processing unit is configured to display the home screen of the electronic device on a touch-sensitive display (e.g., by a display unit 4217 and / or a display unit 4201). The processing unit is also configured to provide the user with an indication on the home screen that a particular action associated with a trigger condition is available (e.g., by a providing unit 4215).

[0075] In some embodiments of the electronic device described in (B20)B19, the home screen includes (i) a first part containing one or more user interface pages for launching a first set of applications available on the electronic device, and (ii) a second part displayed adjacent to the first part for launching a second set of applications available on the electronic device. The second part is displayed on all the user interface pages contained in the first part, and providing an indication on the home screen includes displaying the indication on the second part (for example, by display unit 4217 and / or display unit 4201).

[0076] (B21) In some embodiments of the electronic devices described in B20, the second set of applications is different from and smaller than the first set of applications.

[0077] (B22) In some embodiments of the electronic devices described in any one of B7 to B21, determining that at least one trigger condition is met includes determining that the electronic device is coupled with a second device different from the electronic device (for example, by determination unit 4227).

[0078] (B23) In some embodiments of the electronic device described in any one of B7 to B22, determining that at least one trigger condition has been met includes determining that the electronic device has arrived at an address corresponding to the user's home or workplace (for example, by determination unit 4227).

[0079] (B24) In some embodiments of the electronic devices described in B23, determining that the electronic device has arrived at an address corresponding to the user's home or workplace includes monitoring motion data from the electronic device's accelerometer (e.g., by monitoring unit 4229) and determining, based on the monitored motion data, that the electronic device has not moved beyond a threshold time period (e.g., by determination unit 4227).

[0080] (B25) In some embodiments of the electronic device described in any one of B7 to B24, the usage data further includes oral instructions provided by the user to the virtual assistant application while the application continues to run. At least one trigger condition is further based on the oral instructions provided to the virtual assistant application.

[0081] (B26) In some embodiments of the electronic devices described in B25, the oral instruction includes a request to create a reminder corresponding to the current state of the application, the current state corresponding to the state of the application when the oral instruction was provided.

[0082] (B27) In some embodiments of the electronic devices described in B26, the state of the application when an oral command is provided is selected from the group consisting of pages displayed in the application when an oral command is provided, content being played in the application when an oral command is provided, notifications displayed in the application when an oral command is provided, and the active portion of pages displayed in the application when an oral command is provided.

[0083] (B28) In some embodiments of the electronic devices described in B26, oral instructions include the word “this” in relation to the current state of the application.

[0084] (C1) In some embodiments, the method is performed in an electronic device having a touch-sensitive display (touchscreen 112, Figure 1C) (for example, a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes detecting a search activation gesture of the user of the electronic device on the touch-sensitive display. The method includes displaying a search interface on the touch-sensitive display in response to the detection of the search activation gesture, the search interface including (i) a search entry portion and (ii) a prediction portion that is displayed before any user input is received in the search entry portion. The prediction portion is populated by one or more of the following: (a) at least one affordance for contacting a person from among several previously contacted persons, the person being automatically selected from among several previously contacted persons, at least in part, based on the current time; and (b) at least one affordance for performing a predicted action within an application from among several applications available on the electronic device, the predicted action being automatically selected, at least in part, based on the application usage history associated with the user of the electronic device.

[0085] (C2) In some embodiments of the method of C1, the person is further selected based at least in part on location data corresponding to an electronic device.

[0086] (C3) In some embodiments of the method described in C1 or C2, application usage history and contact information for individuals are retrieved from the memory of the electronic device.

[0087] (C4) In some embodiments of the method described in C1 or C2, application usage history and contact information for individuals are retrieved from a remotely located server from an electronic device.

[0088] (C5) In some embodiments of the method according to any one of C1 to C4, the prediction portion is further populated with at least one affordance for running a predicted application, the predicted application being automatically selected, at least in part, based on application usage history.

[0089] (C6) In some embodiments of the method according to any one of C1 to C5, the prediction portion is further populated with at least one affordance of a predicted location (or nearby location) category, the predicted location category is automatically selected based at least in part on one or more of the current time and location data corresponding to an electronic device.

[0090] (C7) In some embodiments of the method of any one of C1 to C6, the method further includes detecting user input for scrolling the prediction portion. The method includes scrolling the prediction portion in accordance with the user input in response to detecting user input for scrolling the prediction portion. The method includes making at least one affordance of a predicted news article visible in the prediction portion in response to scrolling (for example, the predicted news article is one that the user is expected to be of interest to).

[0091] (C8) In some embodiments of the method of C7, the predicted news articles are automatically selected based at least in part on location data corresponding to an electronic device.

[0092] (C9) In some embodiments of the method described in any one of C1 to C8, the method further includes detecting a selection of at least one affordance for performing a predicted action within an application. In response to detecting a selection, the method includes displaying the application on a touch-sensitive display and performing the predicted action within the application.

[0093] (C10) In some embodiments of the method described in C3 or C4, the method further includes detecting a selection of at least one affordance for contacting a person. The method, in response to detecting a selection, includes contacting the person using contact information for the person.

[0094] (C11) In some embodiments of the method described in C5, the method further includes detecting a selection of at least one affordance for performing a predicted application. The method includes, in response to detecting a selection, displaying the predicted application on a touch-sensitive display.

[0095] (C12) In some embodiments of the method of C6, the method further includes detecting a selection of at least one affordance of a predicted location category. In response to detecting a selection, the method further includes (i) receiving data corresponding to at least one nearby location, and (ii) displaying the received data corresponding to at least one nearby location on a touch-sensitive display.

[0096] (C13) In some embodiments of the method of C7, the method further includes detecting a selection of at least one affordance of a predicted news article. The method includes, in response to detecting a selection, displaying the predicted news article on a touch-sensitive display.

[0097] (C14) In some embodiments of the method described in any one of C1 to C13, the search activation gesture is available from at least two different user interfaces, the first of which corresponds to displaying a corresponding home screen page from a set of home screen pages on a touch-sensitive display.

[0098] (C15) In some embodiments of the method described in C14, if the corresponding home screen page is the first home screen page in a set of home screen pages, the search activation gesture includes one of the following: (i) a gesture that moves substantially downward to the user of the electronic device, or (ii) a sequence of gestures that moves substantially from left to right and substantially perpendicular to the downward direction to the user.

[0099] (C16) In some embodiments of the method described in C15, if the corresponding home screen page is the second home screen page in a set of home screen pages, the search activation gesture includes a series of gestures that move substantially downwards for the user of the electronic device.

[0100] (C17) In some embodiments of the method described in C14, the second user interface of at least two different user interfaces corresponds to displaying an application switching interface on a touch-sensitive display.

[0101] (C18) In some embodiments of the method described in C17, the search activation gesture includes contact with the default search activation portion of the application switching interface on a touch-sensitive display.

[0102] (C19) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensitive display, one or more processors, and a memory for storing one or more programs, wherein when one or more programs are executed by one or more processors, one or more programs cause the electronic device to perform the method described in any one of C1 to C18.

[0103] (C20) In yet another embodiment, an electronic device is provided which includes a touch-sensitive display and means for performing the method described in any one of C1 to C18.

[0104] (C21) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensitive display, the executable instruction causes the electronic device to perform the method described in any one of C1 to C18.

[0105] (C22) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive display. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of C1 to C18.

[0106] (C23) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 4301, Figure 43), a touch-sensitive surface unit (e.g., touch-sensitive surface unit 4303, Figure 43), and a processing unit (e.g., processing unit 4305, Figure 43). In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (i.e., computing devices A through D). For ease of explanation, Figure 43 shows the display unit 4301 and the touch-sensitive surface unit 4303 as being integrated into the electronic device 4300, but in some embodiments, one or both of these units communicate with the electronic device even when the unit remains physically separated from the electronic device. The processing unit includes a display unit (e.g., display unit 4309, Figure 43), a detection unit (e.g., detection unit 4307, Figure 43), a retrieval unit (e.g., retrieval unit 4311, Figure 43), a populating unit (e.g., populating unit 4313, Figure 43), a scrolling unit (e.g., scrolling unit 4315, Figure 43), an exposure unit (e.g., exposure unit 4317, Figure 43), a selection unit (e.g., selection unit 4319, Figure 43), a communication unit (e.g., communication unit 4321, Figure 43), a receiving unit (e.g., receiving unit 4323, Figure 43), and an execution unit (e.g., execution unit 4325, Figure 43). A processing unit (or one or more of its components, such as units 4307 to 4225) is configured to detect a user search activation gesture of an electronic device on a touch-sensitive display (e.g., by detection unit 4307 and / or touch-sensitive surface unit 4303), and, in response to the detection of a search activation gesture, to display a search interface on the touch-sensitive display (e.g., by display unit 4309 and / or display unit 4301), the search interface including (i) a search entry portion and (ii) a prediction portion that is displayed before any user input is received in the search entry portion.The prediction portion is populated by one or more of the following: (a) at least one affordance for contacting a person from among several previously contacted persons, the person being automatically selected from among several previously contacted persons based on the current time (e.g., by selection unit 4319); and (b) at least one affordance for performing a predicted action within an application from among several applications available on the electronic device, the predicted action being automatically selected at least in part based on the application usage history associated with the user of the electronic device (e.g., by selection unit 4319).

[0107] (C24) In some embodiments of the electronic device described in C23, the person is further selected, at least in part, based on location data corresponding to the electronic device (e.g., by a selection unit 4319).

[0108] (C25) In some embodiments of the electronic device described in C23 or C24, application usage history and contact information for individuals are retrieved from the electronic device's memory (for example, by a retrieval unit 4311).

[0109] (C26) In some embodiments of the electronic device described in C23 or C24, application usage history and contact information for individuals are retrieved from a remotely located server (for example, by a retrieval unit 4311) from the electronic device.

[0110] (C27) In some embodiments of the electronic device described in any one of C23 to C26, the prediction portion is further populated with at least one affordance for executing a predicted application (e.g., by a populating unit 4313), and the predicted application is at least partially automatically selected based on application usage history (e.g., by a selection unit 4319).

[0111] (C28) In some embodiments of the electronic device described in any one of C23 to C27, the prediction portion is further populated with at least one affordance of the predicted location category (e.g., by a populating unit 4313), and the predicted location category is automatically selected based at least in part on one or more of the current time and location data corresponding to the electronic device (e.g., by a selection unit 4319).

[0112] (C29) In some embodiments of the electronic device described in any one of C23 to C28, the processing unit is further configured to detect user input for scrolling the prediction portion (e.g., by detection unit 4307 and / or touch-sensing surface unit 4303). In response to detecting user input for scrolling the prediction portion, the processing unit is configured to scroll the prediction portion according to the user input (e.g., by scrolling unit 4319). In response to scrolling, the processing unit is configured to reveal at least one affordance of the predicted news article in the prediction portion (e.g., by revealing unit 4317) (e.g., the predicted news article is one that the user is expected to be of interest to).

[0113] In some embodiments of the electronic device described in (C30)C7, the predicted news articles are automatically selected, at least in part, based on location data corresponding to the electronic device (e.g., by a selection unit 4319).

[0114] (C31) In some embodiments of the electronic device described in any one of C23 to C30, the processing unit is further configured to detect a selection of at least one affordance for performing a predicted action within the application (e.g., by a detection unit 4307 and / or a touch-sensitive surface unit 4303). In response to detecting a selection, the processing unit is configured to display the application on a touch-sensitive display (e.g., a display unit 4301) (e.g., by a display unit 4309) and to perform the predicted action within the application (e.g., by an execution unit 4325).

[0115] (C32) In some embodiments of the electronic device described in C25 or C26, the processing unit is further configured to detect the selection of at least one affordance for contacting a person (e.g., by detection unit 4307 and / or touch-sensing surface unit 4303). In response to detecting the selection, the processing unit is configured to contact the person using contact information for the person (e.g., by contact unit 4321).

[0116] In some embodiments of the electronic devices described in (C33)C27, the processing unit is further configured to detect a selection of at least one affordance for executing a predicted application (e.g., by detection unit 4307 and / or touch-sensing surface unit 4303). In response to detecting a selection, the processing unit is configured to display the predicted application on a touch-sensing display (e.g., by display unit 4301) (e.g., by display unit 4307).

[0117] In some embodiments of the electronic devices described in (C34)C28, the processing unit is further configured to detect a selection of at least one affordance of a predicted location category (e.g., by a detection unit 4307 and / or a touch-sensitive surface unit 4303). In response to detecting a selection, the processing unit is configured to (i) receive data corresponding to at least one nearby location (e.g., by a receiving unit 4323), and (ii) display the received data corresponding to at least one nearby location on a touch-sensitive display (e.g., a display unit 4301) (e.g., by a display unit 4307).

[0118] In some embodiments of the electronic device described in (C35)C29, the processing unit is further configured to detect a selection of at least one affordance of a predicted news article (e.g., by a detection unit 4307 and / or a touch-sensitive surface unit 4303). In response to detecting a selection, the processing unit is configured to display the predicted news article on a touch-sensitive display (e.g., a display unit 4301) (e.g., by a display unit 4307).

[0119] (C36) In some embodiments of the electronic device described in any one of C23 to C35, the search activation gesture is available from at least two different user interfaces, the first of which corresponds to displaying a corresponding home screen page from a set of home screen pages on a touch-sensitive display.

[0120] In some embodiments of the electronic devices described in (C37)C36, if the corresponding home screen page is the first home screen page in a set of home screen pages, the search activation gesture includes one of the following: (i) a gesture that moves substantially downward to the user of the electronic device, or (ii) a sequence of gestures that moves substantially from left to right and substantially perpendicular to the downward direction to the user.

[0121] In some embodiments of the electronic devices described in (C38)C37, if the corresponding home screen page is the second home screen page in a set of home screen pages, the search activation gesture includes a series of gestures that move substantially downwards for the user of the electronic device.

[0122] (C39) In some embodiments of the electronic devices described in C36, the second of at least two different user interfaces corresponds to displaying an application switching interface on a touch-sensitive display.

[0123] In some embodiments of the electronic devices described in (C40)C39, the search activation gesture includes contact with the default search activation portion of the application switching interface on a touch-sensitive display.

[0124] Therefore, an electronic device having a display, a touch-sensitive surface, and optionally one or more sensors for detecting the intensity of contact with the touch-sensitive surface provides a faster and more efficient method and interface for proactively accessing applications and proactively executing functions within applications, thereby increasing the effectiveness, efficiency, and user satisfaction of such a device. Such a method and interface may complement or replace conventional methods for accessing applications and the functions associated with such methods.

[0125] (D1) In some embodiments, the method is performed on an electronic device having a touch-sensitive surface (e.g., touch-sensitive surface 195, Figure 1D) and a display (e.g., display 194, Figure 1D) (e.g., a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes displaying content on the display associated with an application running on the electronic device. The method further includes detecting a swipe gesture via the touch-sensitive surface, which, when detected, causes the electronic device to transition to a search mode different from the application. The method also includes transitioning to a search mode in response to the detection of a swipe gesture, the search mode including a search interface displayed on the display. In conjunction with transitioning to a search mode, the method includes determining at least one proposed search query based on information associated with the content, at least in part. The method includes populating the displayed search interface with at least one proposed search query before receiving any user input in the search interface. In this way, instead of having to remember information and re-enter it into the search interface, the device provides the user with relevant suggestions based on the application content they are viewing, and the user only needs to select one of the suggestions without having to type anything.

[0126] (D2) In some embodiments of the method described in D1, detecting a swipe gesture includes detecting a swipe gesture on at least a portion of the currently displayed content.

[0127] (D3) In some embodiments of the method described in D1 or D2, the method further includes detecting an input corresponding to a request to view the home screen of an electronic device before detecting a swipe gesture, and, in response to detecting the input, stopping the display of content associated with an application and displaying the corresponding page of the home screen of the electronic device. In some embodiments, the corresponding page is the initial page of a set of home screen pages, and the swipe gesture is detected while the initial page of the home screen is displayed on the display.

[0128] (D4) In some embodiments of the method described in any one of D1 to D3, the search interface is displayed semi-transparently overlaid on the application.

[0129] (D5) In some embodiments of the method described in any one of D1 to D4, the method further includes determining at least one proposed search query based at least in part on the text content, in accordance with the determination that the content includes text content.

[0130] (D6) In some embodiments of the method described in D5, determining at least one proposed search query based on text content includes analyzing the text content to detect one or more predefined keywords used to determine at least one proposed search query.

[0131] (D7) In some embodiments of the method according to any one of D1 to D6, determining at least one proposed search query includes determining multiple proposed search queries, and populating the search interface includes populating the search interface with multiple proposed search queries.

[0132] (D8) In some embodiments of the method described in any one of D1 to D7, the method further includes detecting a new swipe gesture on newly displayed content via a touch-sensitive surface, and, in response to the detection of a new swipe gesture, transitioning to a search mode, the transitioning to a search mode including displaying a search interface on the display, and, in conjunction with transitioning to a search mode and in accordance with the determination that the new content does not contain text content, populating the search interface with a search query proposed by the user of the electronic device based on a selected set of past search queries.

[0133] (D9)In some embodiments of the method described in D8, the search interface is displayed along with the target location based on location information provided by a second application different from the application.

[0134] (D10) In some embodiments of the method described in either D8 or D9, the search interface further includes one or more proposed applications.

[0135] (D11) In some embodiments of the method described in any one of D8 to D10, the set of past search queries is selected based on the frequency of recent search queries, at least in part.

[0136] (D12) In some embodiments of the method described in any one of D1 to D11, the method further includes, in conjunction with transitioning to a search mode, retrieving information associated with the content by using one or more accessibility features available on the electronic device.

[0137] (D13) In some embodiments of the method described in D12, using one or more accessibility features includes generating information associated with the content by (i) applying a natural language processing algorithm to the text content currently displayed in the application, and (ii) using data obtained from the natural language processing algorithm to determine one or more keywords that describe the content, such that at least one proposed search query is determined based on one or more keywords.

[0138] (D14) In some embodiments of the method described in D13, determining one or more keywords that describe the content includes (i) retrieving metadata corresponding to the non-text content currently displayed in the application, and (ii) determining one or more keywords using the retrieved metadata in addition to data obtained from a natural language processing algorithm.

[0139] (D15) In some embodiments of the method described in any one of D1 to D14, the search interface further includes one or more trend queries.

[0140] (D16) In some embodiments of the method described in D15, the search interface further includes one or more applications that are expected to be of interest to the user of the electronic device.

[0141] (D17) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensitive surface, a display, one or more processors, and a memory for storing one or more programs, where one or more programs are executed by one or more processors, and the one or more programs cause the electronic device to perform the method described in any one of D1 to D16.

[0142] (D18) In yet another embodiment, an electronic device is provided which includes a touch-sensing surface, a display, and means for performing the method described in any one of D1 to D16.

[0143] (D19) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensitive surface and a display, the executable instruction causes the electronic device to perform the method described in any one of D1 to D16.

[0144] (D20) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive surface and a display. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of D1 to D16. In a further embodiment, an information processing device is provided for use in an electronic device having a touch-sensitive surface and a display. The information processing device includes means for performing the method described in any one of D1 to D16.

[0145] (D21) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 4401, Figure 44), a touch-sensitive surface unit (e.g., touch-sensitive surface unit 4403, Figure 44), and a processing unit (e.g., processing unit 4405, Figure 44). The processing unit is coupled with the touch-sensitive surface unit and the display unit. In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (i.e., computing devices A through D). For ease of explanation, Figure 44 shows the display unit 4401 and the touch-sensitive surface unit 4403 as integrated into the electronic device 4400, but in some embodiments, one or both of these units communicate with the electronic device even if the unit remains physically separated from the electronic device. In some embodiments, the touch-sensitive surface unit and the display unit are integrated into a single touch-sensitive display unit (also referred to herein as a touch-sensitive display). The processing unit includes a detection unit (e.g., detection unit 4407, Figure 44), a display unit (e.g., display unit 4409, Figure 44), a retrieval unit (e.g., retrieval unit 4411, Figure 44), a search mode transition unit (e.g., search mode transition unit 4412, Figure 44), a populating unit (e.g., populating unit 4413, Figure 44), an acquisition unit (e.g., acquisition unit 4415, Figure 44), a determination unit (e.g., determination unit 4417, Figure 44), and a selection unit (e.g., selection unit 4419, Figure 44).The processing unit (or one or more of its components, such as units 1007 to 1029) is configured to display content associated with an application running on an electronic device on a display unit (e.g., display unit 4407) (e.g., by display unit 4407), to detect a swipe gesture via a touch-sensitive surface unit (e.g., touch-sensitive surface unit 4403) that, when detected, causes the electronic device to transition to a search mode different from the application (e.g., by detection unit 4407), to transition to a search mode (e.g., by search mode transition unit 4412) that includes a search interface displayed on the display unit (e.g., display unit 4407) in response to the detection of the swipe gesture, to determine at least one proposed search query based at least in part on information associated with the content (e.g., by determination unit 4417) in conjunction with transitioning to the search mode, and to populate the displayed search interface with at least one proposed search query (e.g., by populating unit 4413) before receiving any user input in the search interface.

[0146] (D22) In some embodiments of the electronic devices described in D21, detecting a swipe gesture includes detecting a swipe gesture on at least a portion of the currently displayed content (e.g., by a detection unit 4407).

[0147] (D23) In some embodiments of the electronic device described in D21 or D22, the processing unit is further configured to detect an input corresponding to a request to view the electronic device's home screen before detecting a swipe gesture (e.g., by a detection unit 4407), and in response to the detection of the input (e.g., by a detection unit 4407), to stop displaying content associated with an application and display the corresponding page of the electronic device's home screen (e.g., by a display unit 4409), the corresponding page being the initial page of a set of home screen pages, and the swipe gesture is detected while the initial page of the home screen is displayed on the display unit (e.g., by a detection unit 4407).

[0148] (D24) In some embodiments of the electronic devices described in any one of D21 to D23, the search interface is displayed semi-transparently overlaid on the application (e.g., display unit 4409 and / or display unit 4401).

[0149] (D25) In some embodiments of the electronic device described in any one of D21 to D24, the processing unit is further configured to determine at least one proposed search query based at least in part on the text content, according to the determination that the content includes text content (for example, by the determination unit 4417).

[0150] (D26) In some embodiments of the electronic devices described in D25, determining at least one proposed search query based on text content includes analyzing the text content to detect one or more predefined keywords used to determine at least one proposed search query (e.g., by determination unit 4417) (e.g., by detection unit 4407).

[0151] (D27) In some embodiments of the electronic device described in any one of D21 to D26, determining at least one proposed search query includes determining a plurality of proposed search queries (e.g., by determination unit 4417), and populating the search interface includes populating the search interface with a plurality of proposed search queries (e.g., by populating unit 4413).

[0152] (D28) In some embodiments of the electronic device described in any one of D21 to D27, the processing unit is further configured to detect a new swipe gesture on newly displayed content via a touch-sensing surface unit (e.g., by a touch-sensing surface unit 4403) (e.g., by a detection unit 4407), and in response to the detection of a new swipe gesture, to transition to a search mode (e.g., by a search mode transition unit 4412), which includes displaying a search interface on a display unit (e.g., by a display unit 4409), and in conjunction with transitioning to a search mode, and in accordance with the determination that the new content does not contain text content, to populate the search interface with a search query proposed based on a set of past search queries selected by the user of the electronic device (e.g., by a populating unit 4413).

[0153] In some embodiments of the electronic devices described in (D29)D28, the search interface displays a target location based on location information provided by a second application different from the application (e.g., display unit 4409).

[0154] (D30) In some embodiments of the electronic devices described in D28 or D29, the search interface further includes one or more proposed applications.

[0155] (D31) In some embodiments of the electronic device described in any one of D28 to D30, a set of past search queries is selected based on the frequency of recent search queries, at least in part (e.g., by selection unit 4419).

[0156] (D32) In some embodiments of the electronic device described in any one of D21 to D31, the processing unit is further configured to acquire information associated with the content (for example, by the acquisition unit 4415) by using one or more accessibility features available on the electronic device, in conjunction with transitioning to a search mode.

[0157] In some embodiments of the electronic devices described in (D33)D32, using one or more accessibility features includes generating information associated with the content by (i) applying a natural language processing algorithm to the text content currently displayed in the application, and (ii) using data obtained from the natural language processing algorithm (e.g., by acquisition unit 4415) to determine one or more keywords that describe the content (e.g., by determination unit 4417), wherein at least one proposed search query is determined based on one or more keywords (e.g., by determination unit 4417).

[0158] (D34) In some embodiments of the electronic devices described in D33, determining one or more keywords that describe the content also includes (i) retrieving metadata corresponding to the non-text content currently displayed in the application (e.g., by retrieval unit 4411), and (ii) determining one or more keywords using the retrieved metadata in addition to data obtained from a natural language processing algorithm (e.g., by determination unit 4417).

[0159] (D35) In some embodiments of the electronic device described in any one of D21 to D34, the search interface further includes one or more trend queries.

[0160] In some embodiments of the electronic devices described in (D36)D35, the search interface further includes one or more applications that the user of the electronic device is expected to be of interest to.

[0161] (E1) In some embodiments, the method is performed in an electronic device having a touch-sensitive surface (e.g., touch-sensitive surface 195, Figure 1D) and a display (e.g., display 194, Figure 1D) (e.g., a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes detecting a swipe gesture on a user interface via the touch-sensitive surface, the swipe gesture causing the electronic device to enter search mode upon detection of the swipe gesture. The method further includes entering search mode in response to detection of the swipe gesture, the transition to search mode including populating a search interface distinct from the user interface with a first content item before receiving any user input within the search interface. In some embodiments, populating the search interface with a first content item according to the determination that the user interface includes content associated with an application different from the home screen, including a selectable icon for invoking the application, includes populating the search interface with at least one proposed search query based at least in part on the content associated with the application, and populating the search interface with a first content item according to the determination that the user interface is associated with a page of the home screen, includes populating the search interface with an affordance that includes a selectable description of at least one target location within a threshold distance of the electronic device's current location.

[0162] (E2) In some embodiments of the method described in E1, populating a search interface by affordances includes displaying a search entry portion of the search interface on a touch-sensitive surface, the method further includes detecting input in the search entry portion and, in response to detecting input in the search entry portion, stopping the display of affordances and displaying at least one proposed search query within the search interface.

[0163] (E3) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensitive surface, a display, one or more processors, and a memory for storing one or more programs, where one or more programs are executed by one or more processors, and the one or more programs cause the electronic device to perform the method described in E1 or E2.

[0164] (E4) In yet another embodiment, an electronic device is provided which includes a touch-sensing surface, a display, and means for performing the method described in E1 or E2.

[0165] (E5) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores executable instructions, and when an executable instruction is executed by an electronic device having a touch-sensitive surface and a display, the executable instruction causes the electronic device to perform the method described in E1 or E2.

[0166] (E6) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive surface and a display. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in E1 or E2. In a further embodiment, an information processing device is provided for use in an electronic device having a touch-sensitive surface and a display. The information processing device includes means for performing the method described in E1 or E2.

[0167] (E7) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 4501, Figure 45), a touch-sensitive surface unit (e.g., touch-sensitive surface unit 4503, Figure 45), and a processing unit (e.g., processing unit 4505, Figure 45). The processing unit is coupled with the touch-sensitive surface unit and the display unit. In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (i.e., computing devices A through D). For ease of explanation, Figure 45 shows the display unit 4501 and the touch-sensitive surface unit 4503 as being integrated into the electronic device 4500, but in some embodiments, one or both of these units communicate with the electronic device even if the unit remains physically separated from the electronic device. In some embodiments, the touch-sensitive surface unit and the display unit are integrated into a single touch-sensitive display unit (also referred to herein as a touch-sensitive display). The processing unit includes a detection unit (e.g., detection unit 4507, Figure 45), a display unit (e.g., display unit 4509, Figure 45), a populating unit (e.g., populating unit 4511, Figure 45), and a search mode transition unit (e.g., search mode transition unit 4513, Figure 45). The processing unit (or one or more of its components, such as units 4507 to 4513) is configured to detect a swipe gesture on a user interface via a touch-sensing surface unit (e.g., touch-sensing surface unit 4503), the swipe gesture, when detected, causes the electronic device to enter search mode, the swipe gesture is detected (e.g., by detection unit 4507), and in response to the detection of the swipe gesture, the device enters search mode (e.g., by search mode transition unit 4513), the transition to search mode includes populating a search interface distinct from the user interface with a first content item (e.g., by populating unit 4511) before receiving any user input within the search interface.In some embodiments, populating the search interface with a first content item according to the determination that the user interface includes content associated with an application different from the home screen, including a selectable icon for invoking the application, includes populating the search interface with at least one proposed search query based at least in part on the content associated with the application (e.g., by populating unit 4511); and populating the search interface with a first content item according to the determination that the user interface is associated with a page of the home screen, includes populating the search interface with affordances including a selectable description of at least one target location within a threshold distance of the electronic device's current location (e.g., by populating unit 4511).

[0168] (E8) In some embodiments of the electronic device described in E7, populating the search interface by affordances includes displaying the search entry portion of the search interface (e.g., by display unit 4507 and / or display unit 4501), the processing unit is further configured to detect input in the search entry portion (e.g., by detection unit 4507), and in response to detecting input in the search entry portion, to stop displaying affordances (e.g., by display unit 4507 and / or display unit 4501) and to display at least one proposed search query within the search interface (e.g., by display unit 4507 and / or display unit 4501).

[0169] (F1) In some embodiments, the method is performed in an electronic device (e.g., a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)) having a position sensor, a touch-sensing surface (e.g., touch-sensing surface 195, Figure 1D), and a display (e.g., display 194, Figure 1D). The method includes, automatically and without command from the user, determining that the user of the electronic device is in a stationary vehicle at a geographical location, and, if it is determined that the user has left the vehicle at the geographical location, determining whether the position information retrieved from the position sensor to determine the geographical location meets accuracy criteria. If it is determined that the position information does not meet accuracy criteria, the method further includes providing the user with a prompt to input information about the geographical location. The method also includes, in response to providing the prompt, receiving information about the geographical location from the user and storing this information as vehicle location information.

[0170] (F2) In some embodiments of the method of F1, the method further includes automatically and without user command storing the location information as vehicle location information when it is determined that the location information meets accuracy criteria.

[0171] (F3) In some embodiments of the method of claim F2, the method further includes displaying a user interface object containing vehicle location information in accordance with a determination that the user is heading towards a geographical location.

[0172] (F4) In some embodiments of the method of claim F3, the user interface object is a map object that includes an identifier relating to the user's current location and another identifier relating to a geographical location.

[0173] (F5) In some embodiments of the method according to claim F4, a user interface object is displayed on the lock screen of an electronic device.

[0174] (F6) In some embodiments of the method according to claim F4, a user interface object is displayed in response to a swipe gesture that causes the electronic device to enter search mode.

[0175] (F7) In some embodiments of the method of claim F6, determining whether the user is heading towards a geographical location is performed in response to the receipt of a swipe gesture.

[0176] (F8) In some embodiments of the method described in any one of F1 to F7, the prompt is an audio prompt provided by a virtual assistant available via an electronic device, and receiving information from the user includes receiving an oral description from the user that identifies a geographical location, and displaying a user interface object includes displaying selectable affordances that, when selected, cause the device to play the oral description.

[0177] (F9) In some embodiments of the method described in any one of F1 to F7, the prompt is displayed on the display of an electronic device, receiving information from the user includes receiving a textual description from the user that identifies a geographic location, and displaying a user interface object includes displaying a textual description from the user.

[0178] (F10) In some embodiments of the method of any one of F1 to F7, determining whether a user is heading towards a geographic location includes determining that an electronic device is moving towards a geographic location using new location information received from a location sensor.

[0179] (F11) In some embodiments of the method of F10, determining whether a user is heading towards a geographical location includes (i) determining that the electronic device has remained at a different geographical location for longer than a threshold time, and (ii) determining that new location information indicates that the electronic device has moved away from the different geographical location and is heading towards a geographical location.

[0180] (F12) In some embodiments of the method according to any one of F1 to F11, determining that a user is inside a vehicle that has stopped at a geographical location includes: (i) determining that a user is inside a vehicle by determining that an electronic device is moving at a speed exceeding a threshold; and (ii) determining that a vehicle has stopped at a geographical location by determining that (a) an electronic device has remained at the geographical location for longer than a threshold time; (b) determining that a communication link between the electronic device and the vehicle has been disconnected; and (c) determining that the geographical location corresponds to a location within a parking lot.

[0181] (F13) In some embodiments of the method of claim F12, determining that a vehicle has stopped at a geographical location includes determining that an electronic device has remained at the geographical location for longer than a threshold time.

[0182] (F14) In some embodiments of the method described in F12 or F13, determining that the vehicle has stopped at a geographical location includes determining that the communication link between the electronic device and the vehicle has been severed.

[0183] (F15) In some embodiments of the method according to any one of F12 to F14, determining that a vehicle has stopped at a geographical location includes determining that the geographical location corresponds to a location within a parking lot.

[0184] (F16) In some embodiments of the method described in any one of F1 to F15, the accuracy criterion includes a criterion that is met when the accuracy of the GPS reading associated with the location information exceeds an accuracy threshold level.

[0185] (F17) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensing surface, a display, a position sensor, one or more processors, and a memory for storing one or more programs, where one or more programs are executed by one or more processors, and the one or more programs cause the electronic device to perform the method described in any one of F1 to F16.

[0186] (F18) In yet another embodiment, an electronic device is provided which includes a touch-sensing surface, a display, a position sensor, and means for performing the method according to any one of F1 to F16.

[0187] (F19) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensing surface, a display, and a position sensor, the executable instruction causes the electronic device to perform the method according to any one of F1 to F16.

[0188] (F20) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensing surface, a display, and a position sensor. In some embodiments, the graphical user interface includes a user interface displayed according to the method of any one of F1 to F16. In a further embodiment, an information processing device is provided for use in an electronic device having a touch-sensing surface, a display, and a position sensor. The information processing device includes means for performing the method of any one of F1 to F16.

[0189] (F21) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 4601, Figure 46), a touch-sensitive surface unit (e.g., touch-sensitive surface unit 4603, Figure 46), a position sensor unit (e.g., position sensor unit 4607, Figure 46), and a processing unit (e.g., processing unit 4605, Figure 46). The processing unit is coupled with the touch-sensitive surface unit, the display unit, and the position sensor unit. In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (i.e., computing devices A through D). For ease of explanation, Figure 46 shows the display unit 4601 and the touch-sensitive surface unit 4603 as being integrated into the electronic device 4600, but in some embodiments, one or both of these units communicate with the electronic device even if the unit remains physically separated from the electronic device. In some embodiments, the touch-sensitive surface unit and the display unit are integrated into a single touch-sensitive display unit (also referred to herein as a touch-sensitive display). The processing unit includes a display unit (e.g., display unit 4609, Figure 46), a retrieval unit (e.g., retrieval unit 4611, Figure 46), a determination unit (e.g., determination unit 4613, Figure 46), a storage unit (e.g., storage unit 4615, Figure 46), a specific unit (e.g., specific unit 4617, Figure 46), a selection unit (e.g., selection unit 4619, Figure 46), a receiving unit (e.g., receiving unit 4621, Figure 46), a providing unit (e.g., providing unit 4623, Figure 46), and a playback unit (e.g., playback unit 4625, Figure 46).The processing unit (or one or more of its components, such as units 4607 to 4625) is configured to automatically and without user command determine if the user of the electronic device is inside a stationary vehicle at a geographical location (e.g., by the determination unit 4613), and if it determines that the user has left the vehicle at a geographical location, it determines whether the location information retrieved from the location sensor unit (e.g., location sensor unit 4607) (e.g., by the retrieve unit 4611) to identify the geographical location (e.g., by the identification unit 4617) meets accuracy criteria (e.g., by the determination unit 4613), and if it determines that the location information does not meet accuracy criteria (e.g., by the determination unit 4613), it prompts the user to input information about the geographical location (e.g., by the providing unit 4623), and in response to the prompt, it receives information about the geographical location from the user (e.g., by the receiving unit 4621) and stores this information as vehicle location information (e.g., by the storage unit 4615).

[0190] (F22) In some embodiments of the electronic device described in F21, the processing unit is further configured to automatically and without user command store the location information as vehicle location information when it determines that the location information meets accuracy criteria (for example, by the storage unit 4615).

[0191] (F23) In some embodiments of the electronic device described in F22, the processing unit is further configured to display a user interface object containing vehicle location information (for example, by the display unit 4609 in conjunction with the display unit 4601) in accordance with the determination that the user is heading towards a geographical location.

[0192] In some embodiments of the electronic devices described in (F24)F23, the user interface object is a map object that includes an identifier for the user's current location and another identifier for a geographical location.

[0193] In some embodiments of the electronic devices described in (F25)F24, user interface objects are displayed on the lock screen of the electronic device (for example, by display unit 4609 in conjunction with display unit 4601).

[0194] In some embodiments of the electronic devices described in (F26)F24, user interface objects are displayed in response to a swipe gesture that causes the electronic device to enter search mode (for example, by display unit 4609 in conjunction with display unit 4601).

[0195] In some embodiments of the electronic devices described in (F27)F26, determining whether the user is heading towards a geographical location is performed in response to the reception of a swipe gesture.

[0196] (F28) In some embodiments of the electronic device described in any one of F21 to F27, the prompt is an audio prompt provided by a virtual assistant available through the electronic device, and receiving information from the user includes receiving an oral description from the user that identifies a geographic location (e.g., by a receiving unit 4621), and displaying a user interface object includes displaying selectable affordances (e.g., by a display unit 4609 in conjunction with a display unit 4601) that, when selected (e.g., by a selection unit 4619), cause the device to play back the oral description (e.g., by a playback unit 4625).

[0197] (F29) In some embodiments of the electronic device described in any one of F21 to F27, a prompt is displayed on the display of the electronic device (e.g., by display unit 4609 in conjunction with display unit 4601), receiving information from a user includes receiving a textual description from a user that identifies a geographic location (e.g., by receiving unit 4621), and displaying a user interface object includes displaying a textual description from a user.

[0198] (F30) In some embodiments of the electronic device described in any one of F21 to F27, determining whether a user is heading towards a geographical location includes determining (e.g., by a determination unit 4613) that the electronic device is moving towards a geographical location using new location information received (e.g., by a receiving unit 4621) from a location sensor unit (e.g., location sensor unit 4607).

[0199] (F31) In some embodiments of the electronic device described in F30, determining whether a user is heading towards a geographical location includes (i) determining that the electronic device has remained at a different geographical location for more than a threshold time (e.g., by determination unit 4613), and (ii) determining that new location information indicates that the electronic device has moved away from the different geographical location and is heading towards a geographical location (e.g., by determination unit 4613).

[0200] (F32) In some embodiments of the electronic device described in any one of F21 to F31, determining that a user is inside a vehicle that has stopped at a geographical location includes: (i) determining that a user is inside a vehicle by determining that the electronic device is moving at a speed exceeding a threshold (e.g., by determination unit 4613); and (ii) determining that a vehicle has stopped at a geographical location by determining that (a) the electronic device has remained at the geographical location for longer than a threshold time (e.g., by determination unit 4613); (b) determining that the communication link between the electronic device and the vehicle has been disconnected (e.g., by determination unit 4613); and (c) determining that the geographical location corresponds to a location within a parking lot (e.g., by determination unit 4613).

[0201] (F33) In some embodiments of the electronic device described in F32, determining that a vehicle has stopped at a geographical location includes determining that the electronic device has remained at the geographical location for longer than a threshold time (for example, by determination unit 4613).

[0202] (F34) In some embodiments of the electronic device described in F32 or F33, determining that the vehicle has stopped at a geographical location includes determining that the communication link between the electronic device and the vehicle has been disconnected (for example, by the determination unit 4613).

[0203] (F35) In some embodiments of the electronic device described in any one of F32 to F34, determining that a vehicle has stopped at a geographical location includes determining that the geographical location corresponds to a location within a parking lot (for example, by determination unit 4613).

[0204] (F36) In some embodiments of the electronic device described in any one of F21 to F35, the accuracy criterion includes a criterion that is met when the accuracy of the GPS reading associated with the location information exceeds an accuracy threshold level.

[0205] (G1) In some embodiments, the method is performed on an electronic device (e.g., a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)) having a position sensor, a touch-sensing surface (e.g., touch-sensing surface 195, Figure 1D), and a display (e.g., display 194, Figure 1D). The method includes monitoring the geographic location of the electronic device using the position sensor. The method further includes determining, based on the monitored geographic location, that the electronic device is within a threshold distance of a target location of a predetermined type. The method also includes identifying at least one currently popular activity at the target location and retrieving information about the target location, based on the determination that the electronic device is within a threshold distance of a target location. The method further includes detecting a first input via a touch-sensitive surface that, when detected, causes an electronic device to enter a search mode, and entering a search mode in response to the detection of the first input, wherein entering a search mode includes, before receiving any user input in the search interface, presenting an affordance via a display that includes (i) information about at least one activity and (ii) an indication that at least one activity has been identified as currently popular at the target location.

[0206] (G2) In some embodiments of the method of claim G1, the method includes detecting a second input and, in response to detecting the second input, updating an affordance to include available information about current activity at a second target location different from the target location, wherein the target location is within a threshold distance of an electronic device.

[0207] (G3) In some embodiments of the method of G1 or G2, the affordance further includes a selectable category of target locations, the method further includes detecting a selection of a corresponding selectable category, and updating the affordance to include information about additional target locations located within a second threshold distance of the device in response to the detection of the selection.

[0208] (G4) In some embodiments of the method described in any one of G1 to G3, the location is an amusement park, and the information retrieved includes the current waiting times for the amusement park rides.

[0209] (G5) In some embodiments of the method according to claim G4, the retrieved information includes information regarding the waiting time of vehicles located within a predetermined distance range of the electronic device.

[0210] (G6) In some embodiments of the method described in any one of G1 to G3, the location is a restaurant, and the information retrieved includes information about the restaurant's popular menu items.

[0211] (G7) In some embodiments of the method according to claim G6, the retrieved information is retrieved from a social network associated with the user of the electronic device.

[0212] (G8) In some embodiments of the method described in any one of G1 to G3, the target location is a movie theater, and the information retrieved includes information regarding movie theater showtimes.

[0213] (G9) In some embodiments of the method described in claim G8, the retrieved information is retrieved from a social network associated with the user of the electronic device.

[0214] (G10) In some embodiments of the method described in any one of G1 to G9, after the electronic device is unlocked, affordances are available in response to a substantially horizontal swipe on the initial page of the electronic device's home screen.

[0215] (G11) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensing surface, a display, a position sensor, one or more processors, and a memory for storing one or more programs, where one or more programs are executed by one or more processors, and the one or more programs cause the electronic device to perform the method described in any one of G1 to G10.

[0216] (G12) In yet another embodiment, an electronic device is provided which includes a touch-sensing surface, a display, a position sensor, and means for performing the method described in any one of G1 to G10.

[0217] (G13) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensing surface, a display, and a position sensor, the executable instruction causes the electronic device to perform the method according to any one of G1 to G10.

[0218] (G14) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensing surface, a display, and a position sensor. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of G1 to G10. In a further embodiment, an information processing device is provided for use in an electronic device having a touch-sensing surface, a display, and a position sensor. The information processing device includes means for performing the method described in any one of G1 to G10.

[0219] (G15) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 4701, Figure 47), a touch-sensitive surface unit (e.g., touch-sensitive surface unit 4703, Figure 47), a position sensor unit 4707, and a processing unit (e.g., processing unit 4705, Figure 47). The processing unit is coupled with the touch-sensitive surface unit, the display unit, and the position sensor unit. In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (i.e., computing devices A through D). For ease of explanation, Figure 47 shows the display unit 4701 and the touch-sensitive surface unit 4703 as being integrated into the electronic device 4700, although in some embodiments, one or both of these units communicate with the electronic device even if the unit remains physically separated from the electronic device. In some embodiments, the touch-sensitive surface unit and the display unit are integrated into a single touch-sensitive display unit (also referred to herein as a touch-sensitive display). The processing unit includes a detection unit (e.g., detection unit 4709, Figure 47), a display unit (e.g., display unit 4711, Figure 47), a retrieval unit (e.g., retrieval unit 4713, Figure 47), a determination unit (e.g., determination unit 4715, Figure 47), a specific unit (e.g., specific unit 4717, Figure 47), an unlock unit (e.g., unlock unit 4719, Figure 47), and a search mode transition unit (e.g., search mode transition unit 4721, Figure 47).The processing unit (or one or more of its components, such as units 4709 to 4721) monitors the geographic location of the electronic device using a position sensor unit (e.g., position sensor unit 4707) without receiving any command from the user of the electronic device, determines that the electronic device is within a threshold distance of a predetermined type of target location based on the monitored geographic location (e.g., by determination unit 4715), identifies at least one currently popular activity at the target location (e.g., by identification unit 4717) in accordance with the determination that the electronic device is within a threshold distance of the target location, and retrieves information about the target location (e.g., by retrieval unit 4713), including retrieving information about at least one currently popular activity at the target location. The device is configured to detect a first input via a touch-sensitive surface unit (e.g., touch-sensitive surface unit 4703) which, when detected, causes the electronic device to transition to search mode (e.g., by detection unit 4709), and to transition to search mode in response to the detection of the first input (e.g., by search mode transition unit 4721), and transitioning to search mode includes presenting affordances via a display unit (e.g., display unit 4701) which include (i) information about at least one activity and (ii) an indication that at least one activity has been identified as currently popular at the target location (e.g., by display unit 4711) before receiving any user input in the search interface.

[0220] (G16) In some embodiments of the electronic device described in G15, the processing unit is further configured to detect a second input (e.g., by a detection unit 4709) and, in response to the detection of the second input, to update the affordances (e.g., by a display unit 4711) to include available information about the current activity at a second target location different from the target location, where the target location is within a threshold distance range of the electronic device.

[0221] (G17) In some embodiments of the electronic device described in G15 or G16, the affordance further includes selectable categories of target locations, and the processing unit is further configured to detect a selection of a corresponding selectable category (e.g., by a detection unit 4709) and, in response to the detection of the selection, to update the affordance to include information about additional target locations located within a second threshold distance range of the device (e.g., by a display unit 4711).

[0222] (G18) In some embodiments of the electronic device described in any one of G15 to G17, the location is an amusement park, and the information retrieved includes the current waiting times for amusement park rides.

[0223] (G19) In some embodiments of the electronic device described in G18, the retrieved information includes information regarding the waiting time of vehicles located within a predetermined distance range of the electronic device.

[0224] (G20) In some embodiments of the electronic device described in any one of G15 to G17, the location of interest is a restaurant, and the information retrieved includes information about popular menu items at the restaurant.

[0225] (G21) In some embodiments of the electronic devices described in G20, the retrieved information is taken from a social network associated with the user of the electronic device.

[0226] (G22) In some embodiments of the electronic device described in any one of G15 to G17, the location of interest is a movie theater, and the information retrieved includes information regarding movie theater showtimes.

[0227] (G23) In some embodiments of the electronic devices described in G22, the retrieved information is taken from a social network associated with the user of the electronic device.

[0228] (G24) In some embodiments of the electronic devices described in any one of G15 to G23, after the electronic device is unlocked (e.g. by the unlocking unit 4719), affordances are available in response to a substantially horizontal swipe on the initial page of the electronic device's home screen.

[0229] (H1) In some embodiments, the method is performed on an electronic device having a touch-sensitive surface and a display (touchscreen 112, as shown in Figure 1C, in some embodiments the touch-sensitive surface and the display are integrated) (for example, a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes receiving at least a portion of voice communication (for example, a live call or recorded voicemail of 10 seconds or less), the portion of voice communication including speech provided by a remote user of a remote device different from the user of the electronic device. The method also includes extracting content items based at least a portion of the speech provided by the remote user of the remote device. The method further includes determining whether the content items are currently available on the electronic device. In accordance with the determination that the content items are not currently available on the electronic device, the method includes (i) identifying an application associated with the content items and (ii) displaying selectable descriptions of the content items on the display. The method includes detecting the selection of a selectable description and storing the content item for presentation in a specified application (for example, storing the content item so that it is available for presentation by the specified application). In this way, the user can store the content items mentioned or spoken in the voice communication without having to remember all the spoken details and later input these details to create the appropriate content items. Instead, the electronic device can detect and extract content items based on the speech describing various corresponding content items, then provide selectable descriptions of the content items that the user can choose from, and store the corresponding content items in the electronic device.

[0230] In some embodiments of the method described in (H2)H1, the content item is a new event.

[0231] (H3) In some embodiments of the method described in H1, the content item is a new event detail of an event currently associated with a calendar application on an electronic device.

[0232] (H4) In some embodiments of the method described in H1, the content item is a new contact.

[0233] (H5) In some embodiments of the method described in H1, the content item is new contact information for an existing contact associated with a phone application on an electronic device.

[0234] (H6) In some embodiments of the method described in any one of H1 to H5, the voice communication is a live call.

[0235] (H7) In some embodiments of the method described in any one of H1 to H5, the voice communication is a live FaceTime call.

[0236] (H8) In some embodiments of the method described in any one of H1 to H5, the voice communication is a pre-recorded voicemail.

[0237] (H9) In some embodiments of the method described in any one of H1 to H8, displaying selectable descriptions includes displaying selectable descriptions within the user interface, including recent calls made using the telephone application. In this way, the user can easily and conveniently access extracted content items (e.g., extracted during a corresponding voice call) directly from the user interface, including recent calls.

[0238] In some embodiments of the method described in (H10)H9, the selectable description is displayed along with an indication that the content item is associated with voice communication.

[0239] In some embodiments of the method described in (H11)H9, detecting a selection includes receiving a selection while a user interface, including a recent call, is displayed.

[0240] (H12) In some embodiments of the method described in any one of H1 to H11, the method further includes providing feedback to the user of an electronic device that a content item has been detected, in conjunction with displaying a selectable description of the content item (e.g., haptic feedback generated by the electronic device or presentation of a user interface object on a second device, so that the user does not need to take the phone away from their ear during a call). In this way, the user is provided with a brief indication during voice communication that a content item has been detected / extracted, and the user can then decide whether to remember the content item.

[0241] (H13) In some embodiments of the method described in H12, providing feedback includes transmitting information about the detection of content items to different electronic devices in the vicinity of the electronic device (e.g., a laptop computer, a television monitor, a smartwatch, etc.). In this way, the user does not need to interrupt voice communication, and still can view details about the detected / extracted content items on different devices.

[0242] (H14) In some embodiments of the method described in any one of H1 to H13, the method further includes determining that a voice call contains information relating to a first physical location (e.g., an address stated during the call or the name of a restaurant spoken during the call; further details are described below). The method also includes detecting input and, in response to detecting input, opening an application that can accept location data and populating this application with information relating to the first physical location. In this way, in addition to detecting and extracting event and contact information, the electronic device can extract location information spoken in a voice call and provide this location information to the user in an appropriate application (for example, so as to avoid burdening the user with remembering specific location details spoken in the call, especially new details that may be unfamiliar to the user, the device extracts these location details and displays them for the user to use).

[0243] (H15) In some embodiments of the method described in H14, the application is a map application, and populating the map application with information about a first physical location includes populating the map displayed within the map application with a location identifier corresponding to the first physical location. In this way, the user can easily use the newly extracted location details to travel to a new destination, view how far away a particular location is, and easily use other functions provided by the map application.

[0244] (H16) In some embodiments of the method described in any one of H1 to H13, the method further includes determining that a voice communication includes information relating to a first physical location. The method also includes detecting an input (e.g., a search activation gesture such as a swipe gesture, as described in detail below) and, in response to detecting the input, populating a search interface with information relating to the first physical location. In this way, in addition to (or instead of) providing location information to a user for use in a particular application, the electronic device may also provide location information for use in a search interface (e.g., for searching for relevant locations or for searching for additional details relating to the first physical location, such as phone numbers, menus, etc.).

[0245] (H17) In some embodiments of the method described in any one of H1 to H16, extracting content items includes analyzing a portion of a voice communication for the detection of a predetermined type of content, the analysis being performed while the voice communication is being output through an audio system communicating with an electronic device (for example, the voice communication is analyzed in real time while the voice communication is being output to the user of the electronic device).

[0246] (H18) In some embodiments of the method described in H17, analyzing a speech communication includes (i) converting speech provided by a remote user of a remote device into text; (ii) applying a natural language processing algorithm to the text to determine whether the text contains one or more predefined keywords; and (iii) determining, in accordance with the determination that the text contains the corresponding predefined keywords, that the speech communication contains speech describing a content item.

[0247] (H19) In some embodiments of the method described in any one of H1 to H18, receiving at least a portion of a voice communication includes receiving an indication from the user of an electronic device that a portion of the voice communication should be analyzed.

[0248] In some embodiments of the method described in (H20)H19, the indication corresponds to the selection of a hardware button (for example, the user selects a hardware button while an audio communication is being output by the audio system to indicate that a predetermined number of seconds (e.g., the previous 10, 15, or 20 seconds) of the audio communication should be analyzed). In some embodiments, the button may also be a button presented on the display of an electronic device for the user's selection (for example, a button displayed during an audio communication that says, "Tap here to analyze new content of this audio communication").

[0249] In some embodiments of the method described in (H21)H19, the indication corresponds to a command from the user of an electronic device that includes the phrase "hey Siri." Thus, the user can easily instruct the electronic device to begin analyzing a portion of the voice communication and to detect content items spoken in the voice communication, such as events, contact information, and information about physical location.

[0250] (H22) In some embodiments of the method described in any one of H1 to H21, the method further includes receiving a second portion of a voice communication. The second portion includes speech provided by a remote user of a remote device and speech provided by a user of an electronic device (for example, the voice communication is a live call and the second portion includes a conversation between the user and the remote user). The method also includes extracting a second content item based on at least part of the speech provided by the remote user of the remote device and the speech provided by the user of the electronic device. The method includes, in accordance with the determination that the second content item is not currently available on the electronic device, (i) identifying a second application associated with the second content item and (ii) displaying a second selectable description of the second content item on a display. The method includes, in response to detecting a selection of the second selectable description, storing the second content item for presentation in the identified second application.

[0251] In some embodiments of the method described in (H23)H22, a selectable description and a second selectable description, including recent calls made using a telephone application, are displayed within the user interface. In this way, the user is provided with a single interface that conveniently contains content items found in several voice communications (e.g., several calls, voicemails, or calls and voicemails).

[0252] (H24) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensing surface, a display, one or more processors, and a memory for storing one or more programs, where one or more programs are executed by one or more processors, and the one or more programs cause the electronic device to perform the method described in any one of H1 to H23.

[0253] (H25) In yet another embodiment, an electronic device is provided which includes a touch-sensing surface, a display, and means for performing the method described in any one of H1 to H23.

[0254] (H26) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensitive surface and a display, the executable instruction causes the electronic device to perform the method described in any one of H1 to H23.

[0255] (H27) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive surface and a display. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of H1 to H23.

[0256] (H28) In a further embodiment, an information processing device is provided for use in an electronic device including a touch-sensitive surface and a display. The information processing device includes means for performing the method described in any one of H1 to H23.

[0257] (H29) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 4801, Figure 48), a touch-sensing surface unit (e.g., touch-sensing surface unit 4803, Figure 48), and a processing unit (e.g., processing unit 4805, Figure 48). In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (e.g., computing devices A through D). For ease of explanation, Figure 48 shows the display unit 4801 and the touch-sensing surface unit 4803 as being integrated into the electronic device 4800, but in some embodiments, one or both of these units communicate with the electronic device even when the units remain physically separated from the electronic device. The processing unit includes a voice communication receiving unit (e.g., voice communication receiving unit 4807, Figure 48), a content item extraction unit (e.g., content item extraction unit 4809, Figure 48), an availability determination unit (e.g., availability determination unit 4811, Figure 48), an application identification unit (e.g., application identification unit 4813, Figure 48), a display unit (e.g., display unit 4815, Figure 48), a content item storage unit (e.g., content item storage unit 4817, Figure 48), a feedback provision unit (e.g., feedback provision unit 4819, Figure 48), an input detection unit (e.g., input detection unit 4821, Figure 48), an application opening unit (e.g., application opening unit 4823, Figure 48), a populating unit (e.g., populating unit 4825, Figure 48), and a voice communication analysis unit (e.g., voice communication analysis unit 4827, Figure 48). The processing unit (or one or more of its components, such as units 4807 to 4827) is configured to receive at least a portion of voice communications (for example, by voice communication receiving unit 4807), the portion of which includes speech provided by a remote user of a remote device, distinct from the user of the electronic device.The processing unit is further configured to extract content items based at least partially on speech provided by a remote user of a remote device (e.g., by a content item extraction unit 4809) and to determine whether the content item is currently available on the electronic device (e.g., by an availability determination unit 4811). In accordance with the determination that the content item is not currently available on the electronic device, the processing unit is further configured to (i) identify the application associated with the content item (e.g., by an application identification unit 4813) and (ii) display selectable descriptions of the content item on the display (e.g., by a display unit 4815 and / or a display unit 4801). In response to the detection of a selection of selectable descriptions (e.g., by an input detection unit 4821 and / or a touch sensing surface unit 4803), the processing unit is configured to store the content item for presentation in the identified application (e.g., by a content item storage unit 4817).

[0258] In some embodiments of the electronic devices described in (H30)H29, the processing unit (or one or more of its components, such as units 4907 to 4927) is further configured to perform the method described in any one of H2 to H23.

[0259] (I1) In some embodiments, the method is performed on an electronic device having a touch-sensitive surface and a display (in some embodiments, a touchscreen 112, as shown in Figure 1C, where the touch-sensitive surface and the display are integrated) (for example, a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes receiving at least a portion of a voice communication, the portion of which (e.g., a live call, a recorded voicemail) includes speech provided by a remote user of a remote device different from the user of the electronic device. The method also includes determining that the voice communication includes speech that identifies a physical location. In response to determining that the voice communication includes speech that identifies a physical location, the method includes providing an indication that information regarding the physical location has been detected (e.g., providing haptic feedback to the user, displaying a user interface object along with the information regarding the physical location, or transmitting the information regarding the physical location to a nearby device for display on that nearby device). The method further includes detecting input via the touch-sensitive surface. The method includes (i) opening an application that accepts geographic location data, and (ii) populating the application with information about the physical location, in response to the detection of input. In this way, the user can remember information about the physical location mentioned or spoken in voice communication, and does not need to remember all the spoken details and later input these details into the appropriate application. Instead, the electronic device can detect and extract information about the physical location based on speech describing the physical location (e.g., a restaurant, driving directions to a physical location, etc.), and then provide an indication that the corresponding information about the physical location has been detected.

[0260] (I2) In some embodiments of the method described in I1, the voice communication is a live call.

[0261] (I3) In some embodiments of the method described in I1, the voice communication is a live FaceTime call.

[0262] (I4) In some embodiments of the method described in I1, the voice communication is a pre-recorded voicemail.

[0263] (I5) In some embodiments of the method described in any one of I1 to I4, providing an indication includes displaying a selectable description of a physical location, including a recent call made using the telephone application, within the user interface.

[0264] (I6) In some embodiments of the method described in I5, the optional description indicates that the content item is associated with voice communication.

[0265] (I7) In some embodiments of the method described in I5 or I6, detecting input includes detecting input on a selectable description while a user interface, including a recent call, is displayed.

[0266] (I8) In some embodiments of the method described in any one of I1 to I7, providing an indication includes providing haptic feedback to the user of an electronic device.

[0267] (I9) In some embodiments of the method described in any one of I1 to I8, providing an indication includes transmitting information about the physical location of different electronic devices located in the vicinity of an electronic device.

[0268] (I10) In some embodiments of the method described in any one of I1 to I9, determining that a voice communication includes speech describing a physical location includes analyzing a portion of the voice communication to detect information relating to a physical location, the analysis being performed while the voice communication is output through an audio system communicating with an electronic device.

[0269] (I11) In some embodiments of the method described in any one of I1 to I10, receiving at least a portion of a voice communication includes receiving a command from the user of an electronic device that a portion of the voice communication should be analyzed.

[0270] (I12) In some embodiments of the method described in I11, the instruction corresponds to the selection of a hardware button. In some embodiments, the button may also be a button presented on the display of an electronic device for the user's selection (for example, a button displayed during a voice communication that says, "Tap here to analyze new content of this voice communication").

[0271] (I13) In some embodiments of the method described in I11, the instruction corresponds to a command from the user of an electronic device that includes the words "hey Siri".

[0272] (I14) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensitive surface, a display, one or more processors, and a memory for storing one or more programs, where one or more programs are executed by one or more processors, and the one or more programs cause the electronic device to perform the method described in any one of I1 to I13.

[0273] (I15) In yet another embodiment, an electronic device is provided which includes a touch-sensing surface, a display, and means for performing the method described in any one of I1 to I13.

[0274] (I16) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensitive surface and a display, the executable instruction causes the electronic device to perform the method described in any one of I1 to I13.

[0275] (I17) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive surface and a display. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of I1 to I13.

[0276] (I18) In a further embodiment, an information processing device is provided for use in an electronic device including a touch-sensitive surface and a display. The information processing device includes means for performing the method described in any one of I1 to I13.

[0277] (I19) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 4901, Figure 49), a touch-sensing surface unit (e.g., touch-sensing surface unit 4903, Figure 49), and a processing unit (e.g., processing unit 4905, Figure 49). In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (e.g., computing devices A through D). For ease of explanation, Figure 49 shows the display unit 4901 and the touch-sensing surface unit 4903 as being integrated into the electronic device 4900, but in some embodiments, one or both of these units communicate with the electronic device even when the units remain physically separated from the electronic device. The processing unit includes a voice communication receiving unit (e.g., voice communication receiving unit 4907, Figure 49), a content item extraction unit (e.g., content item extraction unit 4909, Figure 49), an indication providing unit (e.g., indication providing unit 4911, Figure 49), an input detection unit (e.g., input detection unit 4913, Figure 49), an application opening unit (e.g., application opening unit 4915, Figure 49), an application populating unit (e.g., application populating unit 4917, Figure 49), a feedback providing unit (e.g., feedback providing unit 4919, Figure 49), and a voice communication analysis unit (e.g., voice communication analysis unit 4921, Figure 49). A processing unit (or one or more of its components, such as units 4907 to 4921) is configured to receive at least a portion of a voice communication, the portion of which includes speech provided by a remote user of a remote device different from the user of the electronic device (e.g., by the voice communication receiving unit 4907). The processing unit is further configured to determine (e.g., by the content item extraction unit 4909) that the voice communication includes speech that identifies a physical location.In response to determining that the voice communication includes speech that identifies a physical location, the processing unit is configured to provide an indication that information regarding the physical location has been detected (e.g., by the content item extraction unit 4909). The processing unit is also configured to detect input via the touch-sensing surface unit (e.g., by the input detection unit 4911). In response to detecting input, the processing unit is configured to (i) open an application that accepts geographic location data (e.g., by the application open unit 4913), and (ii) populate the application with information regarding the physical location (e.g., by the application populating unit 4915).

[0278] In some embodiments of the electronic devices described in (I20)I19, the processing unit (or one or more of its components, such as units 4907 to 4921) is further configured to perform the method described in any one of I2 to I13.

[0279] (J1) In some embodiments, the method is performed on an electronic device having a touch-sensitive surface and a display (in some embodiments, a touchscreen 112, as shown in Figure 1C, where the touch-sensitive surface and the display are integrated) (for example, a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes presenting a text input field and a conversation log in a messaging application on the display. The method also includes determining that the following possible inputs from the user of the electronic device are information relating to a physical location while the messaging application is presented on the display. The method further includes analyzing the content associated with the text input field and the conversation log to determine a proposed physical location based on at least part of the analyzed content. The method further includes presenting a selectable user interface element that identifies the proposed physical location within the messaging application on the display and receiving a selection of the selectable user interface element. The method includes presenting a representation of the proposed physical location within the text input field in response to receiving a selection. In this way, users of electronic devices are conveniently provided with the content they need, without having to type anything or search for content (for example, a user can input their current location simply by selecting a selectable user interface element, without having to access a map application to determine their exact location, return to a messaging application, or make explicit inputs to send location information).

[0280] (J2) In some embodiments of the method described in J1, the messaging application includes a virtual keyboard, and the selectable user interface elements are displayed in a suggestion section adjacent to and above the virtual keyboard.

[0281] (J3) In some embodiments of the method described in J1 or J2, determining that a possible input from a user of an electronic device is information relating to a physical location includes processing a text input field and content associated with the conversation record to detect that the conversational transcription includes a question about the user's current location. In this way, the user is provided with a proposed physical location that is directly related to the description in the conversational transcription (for example, in response to a second user question such as "Where are you?", the user is presented with a user interface object that, if selected, causes the device to send information about the user's current location to the second user).

[0282] (J4) In some embodiments of the method described in J3, processing content includes applying a natural language processing algorithm to detect one or more predefined keywords that form a question (e.g., "Where are you?" or "What is your address?").

[0283] (J5) In some embodiments of the method described in J3 or J4, the question is included in a message received from a second user different from the user.

[0284] (J6) In some embodiments of the method described in any one of J1 to J5, determining that the following possible inputs from a user of an electronic device are information relating to a physical location includes monitoring typing input received from a user in the text input portion of a messaging application.

[0285] (J7) In some embodiments of the method described in any one of J1 to J6, the method further includes stopping the presentation of selectable user interface elements upon determination that the user is typing and has not selected a selectable user interface element. In this way, if it can be determined that the user is not interested in selecting an object, the device does not continue to present selectable user interface objects.

[0286] (J8) In some embodiments of the method described in any one of J1 to J7, the method further includes stopping the presentation of selectable user interface elements in accordance with a determination that the user has provided additional input indicating that the user does not want to select a selectable user interface element. In this way, if it can be determined that the user is not interested in selecting an object, the device does not continue to present selectable user interface objects.

[0287] (J9) In some embodiments of the method described in any one of J1 to J5, the proposed representation of the physical location includes information that identifies the current geographic location of the electronic device.

[0288] (J10) In some embodiments of the method according to any one of J1 to J9, the proposed expression for physical location is an address.

[0289] (J11) In some embodiments of the method according to any one of J1 to J9, the proposed physical location is a map object containing an identifier relating to the proposed physical location.

[0290] (J12) In some embodiments of the method according to any one of J1 to J11, the proposed physical location corresponds to a location recently viewed by the user in an application other than a messaging application.

[0291] (J13) In some embodiments of the method described in any one of J1 to J12, the message application is an email application.

[0292] (J14) In some embodiments of the method described in any one of J1 to J12, the message application is a text message application.

[0293] (J15)In another aspect, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensing surface, a display, one or more processors, and a memory storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more programs cause the electronic device to execute the method described in any one of J1 to J14.

[0294] (J16)In yet another aspect, an electronic device is provided, the electronic device including a touch-sensing surface, a display, and means for executing the method described in any one of J1 to J14.

[0295] (J17)In yet another aspect, a non-transitory computer-readable storage medium is provided. The non-transitory computer-readable storage medium stores executable instructions, and when the executable instructions are executed by an electronic device having a touch-sensing surface and a display, the executable instructions cause the electronic device to execute the method described in any one of J1 to J14.

[0296] (J18)In a further aspect, a graphical user interface on an electronic device having a touch-sensing surface and a display is provided. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of J1 to J14.

[0297] (J19)In a further aspect, an information processing apparatus for use in an electronic device including a touch-sensing surface and a display is provided. The information processing apparatus includes means for executing the method described in any one of J1 to J14.

[0298] (J20) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 5001, Figure 50), a touch-sensing surface unit (e.g., touch-sensing surface unit 5003, Figure 50), and a processing unit (e.g., processing unit 5005, Figure 50). In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (e.g., computing devices A through D). For ease of explanation, Figure 50 shows the display unit 5001 and the touch-sensing surface unit 5003 as being integrated into the electronic device 5000, but in some embodiments, one or both of these units communicate with the electronic device even when the units remain physically separated from the electronic device. The processing unit includes a presentation unit (e.g., presentation unit 5007, Figure 50), a next input determination unit (e.g., next input determination unit 5009, Figure 50), a content analysis unit (e.g., content analysis unit 5011, Figure 50), a selection receiving unit (e.g., selection receiving unit 5013, Figure 50), a typing input monitoring unit (e.g., typing input monitoring unit 5015, Figure 50), and a presentation termination unit (e.g., presentation termination unit 5017, Figure 50). The processing unit (or one or more of its components, such as units 5007 to 5017) is configured to present text input fields and conversation records in a message application on a display (e.g., by presentation unit 5007 and / or display unit 5001). While the message application is presented on the display, the processing unit is also configured to determine that the next possible input from the user of the electronic device is information relating to a physical location (e.g., by next input determination unit 5009).The processing unit analyzes the text input field and the content associated with the conversation record, determines the proposed physical location (e.g., by the content analysis unit 5011) based on at least a part of the analyzed content, presents a selectable user interface element that specifies the proposed physical location within a message application on the display (e.g., by the presentation unit 5007), receives the selection of the selectable user interface element (e.g., by the selection receiving unit 5013 and / or the touch sensing surface unit 5003), and is further configured to present the representation of the proposed physical location within the text input field (e.g., by the presentation unit 5007) in response to receiving the selection.

[0299] (J21) In some embodiments of the electronic device described in J20, the processing unit (or one or more of its components such as units 5007 to 5017) is further configured to execute the method described in any one of J2 to J14.

[0300] (K1) In some embodiments, the method is performed on an electronic device having a touch-sensitive surface and a display (in some embodiments, a touchscreen 112, as shown in Figure 1C, where the touch-sensitive surface and the display are integrated) (for example, a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes, while displaying the first application, obtaining information that identifies a first physical location viewed by the user in the first application (for example, a restaurant searched by the user in an application that enables searching for local businesses). The method also includes closing the first application and, after closing the first application, receiving a request from the user to open a second application different from the first application. In some embodiments, the request is received without receiving any input in the first application (for example, the request does not involve clicking a link or button in the first application). In response to the receipt of a request and in accordance with the determination that the second application can accept geolocation information, the method includes presenting the second application, which includes populating the second application with information based on information identifying the first physical location, at least in part. In this way, the user does not need to manually transfer information between two different applications. Instead, the device intelligently determines that the second application can accept geolocation information and then directly populates the second application with information about the physical location viewed in the first application (for example, populating the second application with a map object that includes an identifier related to the physical location).

[0301] (K2) In some embodiments of the method described in K1, receiving a request to open a second application includes detecting input on the affordances of the second application after the first application has been closed. In other words, the request does not correspond to clicking a link within the first application, but instead explicitly and directly requests the user to open a second application, and the device then decides to populate the second application with information about previously viewed (previously viewed in a different first application) physical locations so that the user can further investigate or examine these previously viewed physical locations in the second application.

[0302] (K3) In some embodiments of the method described in K2, the affordance of the second application is an icon displayed on the home screen of the electronic device. In some embodiments, the home screen is a system-level component of the operating system and includes icons for calling up applications available on the electronic device.

[0303] (K4) In some embodiments of the method described in K2, detecting input includes (i) detecting a double tap on a physical home button, (ii) displaying an application switching user interface in response to the detection of a double tap, and (iii) detecting the selection of an affordance from within the application switching user interface.

[0304] (K5) In some embodiments of the method described in any one of K1 to K4, populating a second application includes, at least in part, displaying a user interface object that includes information based on information that identifies a first physical location.

[0305] (K6) In some embodiments of the method described in K5, the user interface object includes a textual description that informs the user that a first physical location has recently been viewed in the first application.

[0306] (K7) In some embodiments of the method described in K6, the user interface object is a map displayed in a second application, and populating the second application includes populating the map to include an identifier of a first physical location.

[0307] (K8) In some embodiments of the method described in K6 or K7, the second application is presented with a virtual keyboard, and the user interface objects are displayed above the virtual keyboard.

[0308] (K9) In some embodiments of the method described in any one of K6 to K8, obtaining information includes obtaining information about a second physical location, and displaying a user interface object includes displaying a user interface object having information about a second physical location.

[0309] (K10) In some embodiments of the method described in any one of K1 to K9, the determination that a second application can accept geolocation information includes one or more of the following: (i) determining that the second application includes an input receiving field that can accept and process geolocation data; (ii) determining that the second application can display geolocation information on a map; (iii) determining that the second application can use geolocation information to facilitate route guidance; and (iv) determining that the second application can use geolocation information to locate and provide transportation services.

[0310] (K11) In some embodiments of the method described in K10, the determination that a second application can accept geolocation information includes determining that the second application includes an input receiving field that can accept and process geolocation data, the input receiving field being a search box that enables searching within a map displayed in the second application.

[0311] (K12) In some embodiments of the method described in any one of K1 to K11, the method further includes, upon receiving a request, determining, based on the user's application usage history, whether a second application is associated with a first application (for example, whether the first application has been opened a threshold number of times after it was opened).

[0312] (K13) In some embodiments of the method described in K12, the method further includes providing the second application with access to information identifying the first physical location before presenting the second application, the second application having no access to the information identifying the first physical location prior to the access being provided. In this way, the second application can receive information about actions taken by the user in the first application, and the user is then provided with a method for using this information within the second application (for example, to retrieve further information about the first physical location, or to use the first physical location for some service available through the second application, such as a rideshare service).

[0313] (K14) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensitive surface, a display, one or more processors, and a memory for storing one or more programs, where one or more programs are executed by one or more processors, and the one or more programs cause the electronic device to perform the method described in any one of K1 to K13.

[0314] (K15) In yet another embodiment, an electronic device is provided which includes a touch-sensing surface, a display, and means for performing the method described in any one of K1 to K13.

[0315] (K16) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensitive surface and a display, the executable instruction causes the electronic device to perform the method according to any one of K1 to K13.

[0316] (K17) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive surface and a display. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of K1 to K13.

[0317] (K18) In a further embodiment, an information processing device is provided for use in an electronic device including a touch-sensitive surface and a display. The information processing device includes means for performing the method described in any one of K1 to K13.

[0318] (K19) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 5101, Figure 51), a touch-sensing surface unit (e.g., touch-sensing surface unit 5103, Figure 51), and a processing unit (e.g., processing unit 5105, Figure 51). In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (e.g., computing devices A through D). For ease of explanation, Figure 51 shows the display unit 5101 and the touch-sensing surface unit 5103 as being integrated with the electronic device 5100, but in some embodiments, one or both of these units communicate with the electronic device even when the units remain physically separated from the electronic device. The processing unit includes an information acquisition unit (e.g., information acquisition unit 5107, Figure 51), an application termination unit (e.g., application termination unit 5109, Figure 51), a request reception unit (e.g., request reception unit 5111, Figure 51), an application performance determination unit (e.g., application performance determination unit 5113, Figure 51), an application presentation unit (e.g., application presentation unit 5115, Figure 51), an application populating unit (e.g., application populating unit 5117, Figure 51), an input detection unit (e.g., input detection unit 5119, Figure 51), an application switching user interface display unit (e.g., application switching user interface display unit 5121, Figure 51), an application association determination unit (e.g., application association determination unit 5123, Figure 51), and an access provision unit (e.g., access provision unit 5125, Figure 51). The processing unit (or one or more of its components, such as units 5107 to 5125) is configured to acquire information (for example, by the information acquisition unit 5107) that identifies a first physical location viewed by the user in the first application while the first application is being displayed.The processing unit is also configured to terminate the first application (e.g., by the application termination unit 5109), and after the termination of the first application, to receive a request from the user to open a second application different from the first application (e.g., by the request receiving unit 5111). In response to the receipt of the request and in accordance with a determination that the second application can accept geographic location information (e.g., a determination processed or executed by the application performance determination unit 5113), the processing unit presents the second application (e.g., by the application presenting unit 5115), and presenting the second application includes populating the second application with information based on information that identifies the first physical location, at least in part (e.g., by the application populating unit 5117).

[0319] In some embodiments of the electronic devices described in (K20)K19, the processing unit (or one or more of its components, such as units 5107 to 5125) is further configured to perform the method described in any one of K2 to K13.

[0320] (L1)In some embodiments, the method is performed in an electronic device having a touch sensing surface and a display (in some embodiments, the touch screen 112, as shown in FIG. 1C, the touch sensing surface and the display are integrated), such as a portable multifunctional device 100 (FIG. 1A) configured according to any one of computing devices A to D (FIG. 1E). The method includes obtaining information identifying a first physical location viewed by a user in a first application and detecting a first input. The method includes, in response to detecting the first input, (i) identifying a second application capable of receiving geographical location information, and (ii) presenting an affordance having a proposal to open a second application different from the first application and having information regarding the first physical location on at least a portion of the display. The method also includes detecting a second input in the affordance. In response to detecting the second input in the affordance, (i) opening the second application, and (ii) populating the second application to include information based at least in part on information identifying the first physical location.

[0321] In contrast to the operations related to K1 described above, the operations related to L1 do not receive a specific request from the user to open a second application before providing the user with a suggestion to open a second application that has information about a first physical location. By providing operations related to both K1 and L1 (and combinations thereof using several processing steps of each of these methods), the electronic device can provide an efficient user experience that enables the predictive use of location data either before or after the user opens an application that can accept geolocation information. In addition, L1 makes it possible to determine whether the second application can accept geolocation information even before the second application is opened, and in this embodiment of L1 where the input is a request to open an application switching user interface, the application switching user interface simply displays a suggestion to open an application that has information about a first physical location (e.g., the second application) if it is known that the application can accept location data.

[0322] (L2) In some embodiments of the method described in L1, the first input corresponds to a request to open an application switching user interface (for example, the first input is a double tap on the physical home button of an electronic device).

[0323] (L3) In some embodiments of the method described in L2, the affordances are presented within the application switching user interface.

[0324] (L4) In some embodiments of the method described in L3, presenting affordances includes, in conjunction with presenting affordances, presenting a representation of the application running on the electronic device (e.g., a snapshot of the application content of the application) within the application switching user interface, and presenting affordances within a display area located below the representation of the application.

[0325] (L5) In some embodiments of the method described in L1, the first input corresponds to a request to open the home screen of the electronic device (for example, the first input is a single tap on the physical home button of the electronic device).

[0326] (L6) In some embodiments of the method described in L5, the affordance is presented on a portion of the home screen.

[0327] (L7) In some embodiments of the method described in any one of L1 to L6, the proposal includes a textual description specific to the type associated with the second application.

[0328] (L8) In some embodiments of the method described in any one of L1 to L7, populating a second application includes, at least in part, displaying a user interface object that includes information based on information that identifies a first physical location.

[0329] (L9) In some embodiments of the method described in L8, the user interface object includes a textual description that informs the user that a first physical location has recently been viewed in the first application.

[0330] In some embodiments of the method described in (L10)L9, the user interface object is a map displayed in a second application, and populating the second application includes populating the map to include an identifier of a first physical location.

[0331] (L11) In some embodiments of the method described in L9 or L10, the second application is presented together with a virtual keyboard, and user interface objects are displayed above the virtual keyboard.

[0332] (L12) In some embodiments of the method described in any one of L1 to L11, identifying a second application capable of receiving geolocation information includes one or more of the following: (i) determining that the second application includes an input receiving field capable of receiving and processing geolocation data; (ii) determining that the second application can display geolocation information on a map; (iii) determining that the second application can use geolocation information to facilitate route guidance; and (iv) determining that the second application can use geolocation information to locate and provide transportation services.

[0333] (L13) In some embodiments of the method described in L12, identifying that a second application can accept geolocation information includes determining that the second application includes an input receiving field that can accept and process geolocation data, the input receiving field being a search box that enables searching within a map displayed in the second application.

[0334] (L14) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensitive surface, a display, one or more processors, and a memory for storing one or more programs, where one or more programs are executed by one or more processors, and the one or more programs cause the electronic device to perform the method described in any one of L1 to L13.

[0335] (L15) In yet another embodiment, an electronic device is provided which includes a touch-sensing surface, a display, and means for performing the method described in any one of L1 to L13.

[0336] (L16) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensitive surface and a display, the executable instruction causes the electronic device to perform the method described in any one of L1 to L13.

[0337] (L17) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive surface and a display. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of L1 to L13.

[0338] (L18) In a further embodiment, an information processing device is provided for use in an electronic device including a touch-sensitive surface and a display. The information processing device includes means for performing the method described in any one of L1 to L13.

[0339] (L19) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 5201, Figure 52), a touch-sensing surface unit (e.g., touch-sensing surface unit 5203, Figure 52), and a processing unit (e.g., processing unit 5205, Figure 52). In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (e.g., computing devices A through D). For ease of explanation, Figure 52 shows the display unit 5201 and the touch-sensing surface unit 5203 as being integrated into the electronic device 5200, but in some embodiments, one or both of these units communicate with the electronic device even when the units remain physically separated from the electronic device. The processing unit includes an information acquisition unit (e.g., information acquisition unit 5207, Figure 52), an input detection unit (e.g., input detection unit 5209, Figure 52), an application identification unit (e.g., application identification unit 5211, Figure 52), an affordance presentation unit (e.g., affordance presentation unit 5213, Figure 52), an application opening unit (e.g., application opening unit 5215, Figure 52), an application populating unit (e.g., application populating unit 5217, Figure 52), an application switching user interface presentation unit (e.g., application switching user interface presentation unit 5219, Figure 52), and an application performance determination unit (e.g., application performance determination unit 5221, Figure 52). The processing unit (or one or more of its components, such as units 5207 to 5221) is configured to acquire information that identifies a first physical location viewed by a user in a first application (for example, by the information acquisition unit 5207) and to detect a first input (for example, by the input detection unit 5209).In response to detecting a first input, the processing unit is configured to (i) identify a second application that can accept geographic location information (e.g., by the application identification unit 5209), and (ii) present an affordance on at least a portion of the display that proposes opening a second application having information about a first physical location, which is different from the first application (e.g., by the affordance presentation unit 5213). The processing unit is also configured to detect a second input in the affordance (e.g., by the input detection unit 5209). In response to detecting a second input in the affordance, the processing unit is configured to (i) open the second application (e.g., by the application open unit 5215), and (ii) populate the second application (e.g., by the application populating unit 5217) so that at least a portion of it includes information based on information identifying a first physical location.

[0340] In some embodiments of the electronic devices described in (L20)L19, the processing unit (or one or more of its components, such as units 5207 to 5221) is further configured to perform the method described in any one of L2 to L13.

[0341] (M1) In some embodiments, the method is performed on an electronic device having a touch-sensitive surface and a display (in some embodiments, a touchscreen 112, as shown in Figure 1C, where the touch-sensitive surface and the display are integrated) (for example, a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes obtaining information that identifies a first physical location viewed by a user in a first application running on the electronic device. The method also includes determining that the user has entered a vehicle. In response to determining that the user has entered a vehicle, the method provides the user with a prompt to use the first physical location as a destination for route guidance. In response to providing the prompt, the method includes receiving a command from the user to use the first physical location as a destination for route guidance. The method further includes facilitating route guidance to the first physical location. In this way, the user is conveniently provided with route setting suggestions for a destination based on a physical location previously viewed in an application on the electronic device.

[0342] (M2) In some embodiments of the method of M1, the method further includes detecting that an electronic device has received a message, including detecting that the message contains information identifying a second physical location, and, in response to the detection, providing the user with a new prompt to use the second physical location as a new destination for route guidance. In this way, based on the information contained in the message (e.g., text, email, voicemail, etc.), the user can dynamically add intermediate points or new destinations for route guidance.

[0343] (M3) In some embodiments of the method of M2, the method further includes facilitating routing to a second physical location in response to receiving a command from a user to use the second physical location as a new destination.

[0344] (M4) In some embodiments of the method described in M2 or M3, detecting that a message contains information identifying a second physical location includes performing the detection while a virtual assistant available on the electronic device is reading the message to the user via an audio system communicating with the electronic device. Thus, as the user listens to the message being read aloud by the audio system (for example, via a personal assistant available on the electronic device), the electronic device detects information identifying a second physical location and uses this detected information to suggest using the second physical location as a new destination. Thus, the user does not need to take their attention from the road while driving, yet can still dynamically adjust the route guidance settings and destinations.

[0345] (M5) In some embodiments of the method described in any one of M2 to M4, determining that a user has entered the vehicle includes detecting that an electronic device has established a communication link with the vehicle.

[0346] (M6) In some embodiments of the method described in any one of M2 to M5, facilitating route guidance includes providing route guidance via a display of an electronic device.

[0347] (M7) In some embodiments of the method according to any one of M2 to M5, facilitating route guidance includes transmitting information to the vehicle that identifies a first physical location.

[0348] (M8) In some embodiments of the method according to any one of M2 to M7, facilitating route guidance includes providing route guidance by an audio system communicating with an electronic device (e.g., the car's speakers or the device's own built-in speakers).

[0349] (M9) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensitive surface, a display, one or more processors, and a memory for storing one or more programs, where one or more programs are executed by one or more processors, and the one or more programs cause the electronic device to perform the method described in any one of M1 to M8.

[0350] (M10) In yet another embodiment, an electronic device is provided which includes a touch-sensing surface, a display, and means for performing the method according to any one of M1 to M8.

[0351] (M11) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensitive surface and a display, the executable instruction causes the electronic device to perform the method described in any one of M1 to M8.

[0352] (M12) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive surface and a display. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of M1 to M8.

[0353] (M13) In a further embodiment, an information processing device is provided for use in an electronic device including a touch-sensitive surface and a display. The information processing device includes means for performing the method described in any one of M1 to M8.

[0354] (M14) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 5301, Figure 53), a touch-sensing surface unit (e.g., touch-sensing surface unit 5303, Figure 53), and a processing unit (e.g., processing unit 5305, Figure 53). In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (e.g., computing devices A through D). For ease of explanation, Figure 53 shows the display unit 5301 and the touch-sensing surface unit 5303 as being integrated into the electronic device 5300, but in some embodiments, one or both of these units communicate with the electronic device even when the units remain physically separated from the electronic device. The processing unit includes an information acquisition unit (e.g., information acquisition unit 5307, Figure 53), a vehicle entry determination unit (e.g., vehicle entry determination unit 5309, Figure 53), a prompt provision unit (e.g., prompt provision unit 5311, Figure 53), a command receiving unit (e.g., command receiving unit 5313, Figure 53), a route guidance facilitation unit (e.g., route guidance facilitation unit 5315, Figure 53), and a message detection unit (e.g., message detection unit 5317, Figure 53). The processing unit (or one or more of its components, such as units 5307 to 5317) is configured to acquire information (e.g., by information acquisition unit 5307) that identifies a first physical location viewed by a user in a first application running on an electronic device. The processing unit is also configured to determine that a user has entered a vehicle (e.g., by vehicle entry determination unit 5309). Upon determining that the user has entered the vehicle, the processing unit is configured to provide the user with a prompt to use a first physical location as the destination for route guidance (for example, by the prompt providing unit 5311). In response to the provision of the prompt, the processing unit receives a command from the user to use the first physical location as the destination for route guidance (for example, by the command receiving unit 5313).The processing unit is further configured to facilitate path guidance to a first physical location (for example, by a path guidance facilitating unit 5307).

[0355] In some embodiments of the electronic device described in (M15)M14, the processing unit (or one or more of its components, such as units 5307 to 5317) is further configured to perform the method described in any one of M2 to M8.

[0356] (N1) In some embodiments, the method is performed on an electronic device having a touch-sensitive surface and a display (in some embodiments, a touchscreen 112, as shown in Figure 1C, where the touch-sensitive surface and the display are integrated) (for example, a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes presenting content in a first application. The method also includes receiving a request from a user to open a second application different from the first application, the second application including an input receiving field. The method includes presenting the input receiving field to the second application in response to receiving the request. The method includes providing selectable user interface objects to enable the user to paste at least a portion of the content into the input receiving field before receiving any user input in the input receiving field. The method includes pasting a portion of the content into the input receiving field in response to detecting a selection of the selectable user interface object. In this way, the user is provided with a proactive paste action in the second application-based content that was previously viewed in the first action (for example, this allows the user to paste content into the second application without having to explicitly ask them to reopen the first application, perform an explicit copy action, reopen the second application, and then paste the copied content into the second application).

[0357] (N2) According to some embodiments of the method of N1, the method includes identifying an input receiving field as a field that can accept a portion of content before providing a selectable user interface object.

[0358] (N3) According to some embodiments of the method described in N2, identifying an input receiving field as a field that can accept a portion of the content is performed in response to a detection of an input receiving field.

[0359] (N4) According to some embodiments of the method described in any one of N1 to N3, a portion of the content corresponds to an image.

[0360] (N5) According to some embodiments of the method described in any one of N1 to N3, a portion of the content corresponds to text content.

[0361] (N6) According to some embodiments of the method described in any one of N1 to N3, some of the content corresponds to text content and images.

[0362] (N7) According to some embodiments of the method described in any one of N1 to N6, the first application is a web browsing application and the second application is a messaging application.

[0363] (N8) According to some embodiments of the method described in any one of N1 to N6, the first application is a photo browsing application and the second application is a messaging application.

[0364] (N9) According to some embodiments of the method described in any one of N1 to N8, the method includes receiving a request to copy at least a portion of the content before receiving a request to open a second application.

[0365] (N10) According to some embodiments of the method described in any one of N1 to N9, a selectable user interface object is displayed with an indication that a portion of the content has recently been viewed in the first application. In this way, the user is provided with clear indication of why the paste suggestion was made.

[0366] (N11) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensitive surface, a display, one or more processors, and a memory for storing one or more programs, where one or more programs are executed by one or more processors, and the one or more programs cause the electronic device to perform any one of the methods described in N1 to N10.

[0367] (N12) In yet another embodiment, an electronic device is provided which includes a touch-sensing surface, a display, and means for performing the method according to any one of N1 to N10.

[0368] (N13) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensing surface and a display, the executable instruction causes the electronic device to perform the method according to any one of N1 to N10.

[0369] (N14) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive surface and a display. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of N1 to N10.

[0370] (N15) In a further embodiment, an information processing device is provided for use in an electronic device including a touch-sensing surface and a display. The information processing device includes means for performing the method described in any one of N1 to N10.

[0371] (N16) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 5401, Figure 54), a touch-sensing surface unit (e.g., touch-sensing surface unit 5403, Figure 54), and a processing unit (e.g., processing unit 5405, Figure 54). In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (e.g., computing devices A through D). For ease of explanation, Figure 54 shows the display unit 5401 and the touch-sensing surface unit 5403 as being integrated into the electronic device 5400, but in some embodiments, one or both of these units communicate with the electronic device even when the units remain physically separated from the electronic device. The processing unit includes a presentation unit (e.g., presentation unit 5407, Figure 54), a request receiving unit (e.g., request receiving unit 5409, Figure 54), a user interface object providing unit (e.g., user interface object providing unit 5411, Figure 54), a proactive pasting unit (e.g., proactive pasting unit 5413, Figure 54), and a performance determination unit (e.g., performance determination unit 5415, Figure 54).The processing unit (or one or more of its components, such as units 5407 to 5415) is configured to present content in a first application (e.g., by presentation unit 5407 and / or display unit 5401), receive a request from a user to open a second application different from the first application (e.g., by request receiving unit and / or touch sensing surface unit 5403), the second application includes an input receiving field, present the input receiving field to the second application in response to the request (e.g., by presentation unit 5407 and / or display unit 5401), provide selectable user interface objects to enable the user to paste at least a portion of the content into the input receiving field before receiving any user input in the input receiving field (e.g., by user interface object providing unit 5411 and / or display unit 5401), and paste a portion of the content into the input receiving field in response to detecting a selection of the selectable user interface object (e.g., by proactive pasting unit 5413).

[0372] In some embodiments of the electronic devices described in (N17)N16, the processing unit (or one or more of its components, such as units 5407 to 5415) is further configured to perform the method described in any one of N1 to N10.

[0373] (O1) In some embodiments, the method is performed on an electronic device having a touch-sensitive surface and a display (in some embodiments, a touchscreen 112, as shown in Figure 1C, the touch-sensitive surface and the display are integrated) (for example, a portable multifunction device 100 (Figure 1A) configured according to any one of computing devices A to D (Figure 1E)). The method includes presenting text content associated with an application on the display. The method also includes determining that a portion of the text content is related to (i) a location, (ii) a contact, or (iii) an event. If the method determines that a portion of the text content is related to a location, it includes obtaining location information from a location sensor on the electronic device and preparing the obtained location information for display as a predicted content item. If the method determines that a portion of the text content is related to a contact, it includes performing a search on the electronic device for contact information related to the portion of the text content and preparing the information retrieved by the search and associated with at least one contact for display as a predicted content item. The method includes, upon determining that a portion of the text content is related to an event, performing a new search on the electronic device for event information related to the portion of the text content, and preparing at least a portion of the information based on at least one event retrieved by the new search for display as a predicted content item. The method further includes displaying an affordance containing the predicted content item within the application, detecting the selection of the affordance via a touch-sensitive surface, and, in response to the detection of the selection, displaying the information associated with the predicted content item on the display adjacent to the text content. In this way, the user is conveniently provided with a predicted content item that can be used to complete a sentence (or, for example, answer a question posed by another user in a messaging application), without the user having to type anything or search the information available on the electronic device to find the desired information.For example, electronic devices can provide phone numbers, current locations, availability for scheduling new events, and details related to current events—all without requiring any explicit request or extra effort from the user—saving time while still efficiently providing the user with the desired information.

[0374] (O2)According to some embodiments of the method described in O1, a portion of the text content corresponds to the most recently presented text content within the application.

[0375] (O3) According to some embodiments of the method described in O1 or O2, the application is a messaging application, and part of the text content is a question received within the messaging application from a remote user on a remote device different from the electronic device.

[0376] (O4) According to some embodiments of the method described in O1 or O2, part of the text content is input provided by the user of the electronic device in an input receiving field within the application.

[0377] (O5)According to some embodiments of the method described in O1, a portion of the text content is identified in response to user input that selects a user interface object containing the portion of the text content.

[0378] (O6)According to some embodiments of the method described in O5, the application is a messaging application, and the user interface object is a message bubble for a conversation displayed within the messaging application.

[0379] (O7) According to certain embodiments of the method described in O5 or O6, the method further includes detecting a selection of a second user interface object, and in response to the detection of the selection, (i) stopping the display of affordances with predicted content items, determining that the text content associated with the second user interface object is related to a location, contact, or event, and, in accordance with the determination, displaying new predicted content items within the application. In this way, the user can easily return to a message conversation and select a previously received message, and still be provided with appropriately predicted content items.

[0380] (O8) According to some embodiment of the method described in any one of O1 to O7, affordances are displayed in an input receiving field adjacent to a virtual keyboard in the application.

[0381] According to some embodiments of the method described in (O9)O8, the input receiving field is a field that displays typing input received on a virtual keyboard.

[0382] (O10) According to some embodiments of the method described in any one of O1 to O9, determining includes parsing text content when it is received by the application and detecting stored patterns known to be related to contacts, events and / or locations.

[0383] (O11) In another embodiment, an electronic device is provided. In some embodiments, the electronic device includes a touch-sensitive surface, a display, one or more processors, and a memory for storing one or more programs, where one or more programs are executed by one or more processors, and the one or more programs cause the electronic device to perform the method described in any one of O1 to O10.

[0384] (O12) In yet another embodiment, an electronic device is provided which includes a touch-sensing surface, a display, and means for performing the method described in any one of O1 to O10.

[0385] (O13) In yet another embodiment, a non-temporary computer-readable storage medium is provided. The non-temporary computer-readable storage medium stores an executable instruction, and when the executable instruction is executed by an electronic device having a touch-sensitive surface and a display, the executable instruction causes the electronic device to perform the method described in any one of O1 to O10.

[0386] (O14) In a further embodiment, a graphical user interface is provided on an electronic device having a touch-sensitive surface and a display. In some embodiments, the graphical user interface includes a user interface displayed according to the method described in any one of O1 to O10.

[0387] (O15) In a further embodiment, an information processing device is provided for use in an electronic device including a touch-sensitive surface and a display. The information processing device includes means for performing the method described in any one of O1 to O10.

[0388] (O16) In a further embodiment, an electronic device is provided that includes a display unit (e.g., display unit 5501, Figure 55), a touch-sensing surface unit (e.g., touch-sensing surface unit 5503, Figure 55), and a processing unit (e.g., processing unit 5505, Figure 55). In some embodiments, the electronic device is configured according to one of the computing devices shown in Figure 1E (e.g., computing devices A through D). For ease of explanation, Figure 55 shows the display unit 5501 and the touch-sensing surface unit 5503 as being integrated into the electronic device 5500, but in some embodiments, one or both of these units communicate with the electronic device even when the units remain physically separated from the electronic device. The processing unit includes a presentation unit (e.g., presentation unit 5507, Figure 55), a determination unit (e.g., determination unit 5509, Figure 55), an acquisition unit (e.g., acquisition unit 5511, Figure 55), a search execution unit (e.g., search execution unit 5513, Figure 55), an information preparation unit (e.g., information preparation unit 5515, Figure 55), an affordance display unit (e.g., affordance display unit 5517, Figure 55), and a detection unit (e.g., detection unit 5519, Figure 55).The processing unit (or one or more of its components, such as units 5507 to 5519) presents text content associated with the application on the display (for example, by presentation unit 5507 and / or display unit 5501), determines that part of the text content is related to (i) location, (ii) contact, or (iii) event (for example, by determination unit 5509), and if it determines that part of the text content is related to location, it acquires location information from a location sensor on the electronic device (for example, by acquisition unit 5511), prepares the acquired location information for display as a predicted content item (for example, by information preparation unit 5515), and if it determines that part of the text content is related to contact, it searches for contact information related to part of the text content on the electronic device (for example, by search execution unit 5513), and displays the information associated with at least one contact retrieved by the search as a predicted content item. The system is configured to prepare (for example, by the information preparation unit 5515) and, when it is determined that a portion of the text content is related to an event, to perform a new search on the electronic device for event information related to the portion of the text content (for example, by the search execution unit 5513), to prepare at least a portion of the information based on at least one event retrieved by the new search for display as a predicted content item (for example, by the information preparation unit 5515), to display affordances containing the predicted content item within the application (for example, by the affordance display unit 5517 and / or display unit 5501), to detect the selection of the affordance via the touch-sensing surface (for example, by the detection unit 5519), and, in response to the detection of the selection, to display the information associated with the predicted content item on the display adjacent to the text content (for example, by the presentation unit 5507 and / or display unit 5501).

[0389] In some embodiments of the electronic device described in (O17)O16, the processing unit (or one or more of its components, such as units 5507 to 5519) is further configured to perform the method described in any one of O1 to O10.

[0390] As described above (and in more detail below), one aspect of the technology is the collection and use of data available from various sources (e.g., based on speech provided during voice communications) to improve the distribution to users of content that may be of interest to them. In some examples, the disclosure believes that such collected data may include personal data that uniquely identifies a particular person, or that can be used to contact a particular person or locate a particular person. Such personal data may include demographic data, location-based data, telephone numbers, email addresses, home addresses, or any other personally identifiable information.

[0391] This disclosure acknowledges that such personal data may be used in the interest of the user in this technology. For example, personal data may be used to deliver targeted content that is more interesting to the user. Thus, such use of personal data enables intentional control over the content delivered. Furthermore, other purposes for which personal data may be used to benefit the user are conceived by this disclosure.

[0392] This disclosure further assumes that entities responsible for collecting, analyzing, disclosing, transferring, storing, or otherwise using such personal data will comply with appropriately defined privacy policies and / or privacy practices. Specifically, such entities should always implement and use privacy policies and practices that are generally recognized as meeting or exceeding industry or government requirements for keeping personal data strictly confidential. For example, personal information from users should be collected for the entity's lawful and legitimate use and should not be shared or sold for any other purpose. Furthermore, such collection should only be carried out after informing and obtaining the user's consent. Furthermore, such entities may take all necessary steps to protect and secure access to such personal data and to ensure that others who have access to such personal data comply with those privacy policies and procedures. Furthermore, such entities may undergo third-party evaluations to demonstrate their compliance with widely accepted privacy policies and practices.

[0393] Notwithstanding the foregoing, this disclosure also intends embodiments that allow users to selectively prevent the use of or access to personal data. That is, this disclosure conceivably provides hardware and / or software elements to prevent or prevent access to such personal data. For example, in monitoring voice communications or monitoring user actions within an application, the technology could be configured to allow users to choose to “opt in” or “opt out” of participating in the collection of personal data while registering for a service. In another embodiment, a user may choose not to provide location information to a target content delivery service. In yet another embodiment, a user may choose not to provide precise location information but to allow the transmission of location zone information.

[0394] Therefore, while this disclosure broadly covers the use of personal data to perform one or more different disclosed embodiments, it is also intended that these different embodiments may also be performed without requiring access to such personal data. That is, the different embodiments of the technology are not rendered inoperable by the absence of all or part of such personal data. For example, content can be selected and delivered to a user by inferring preferences based on non-personal data or minimal personal information, such as content requested by a device associated with the user, other non-personal information available to the content delivery service, or publicly available information.

[0395] It should be noted that the various embodiments described above can be combined with any other embodiments described herein. The features and advantages described herein are not exhaustive, and many further features and advantages will become apparent to those skilled in the art in view of the drawings, specification and claims. Furthermore, it should be noted that the language used herein has been selected solely for readability and explanatory purposes and not to define or limit the subject matter of the invention. [Brief explanation of the drawing]

[0396] To better understand the various embodiments described, please refer to the following “Modes for Carrying Out the Invention” section in conjunction with the following drawings. Here, similar reference numbers refer to the corresponding parts across those drawings.

[0397] [Figure 1A] This is a high-level block diagram of a computing device equipped with a touch-sensitive display, according to one embodiment.

[0398] [Figure 1B] This is a block diagram of an example of a component for event processing according to one embodiment.

[0399] [Figure 1C] This is an overview of a portable multifunctional device having a touch-sensitive display, according to one embodiment.

[0400] [Figure 1D] This is a schematic used to illustrate a computing device having a touch-sensitive surface separate from the display, according to some embodiments. [Figure 1E]

[0401] [Figure 2] This is an overview of a touchscreen used to show a user interface for an application menu, according to one embodiment.

[0402] [Figure 3A] This is a block diagram showing a data structure for storing application usage data according to one embodiment. [Figure 3B] This is a block diagram showing a data structure for storing application usage data according to one embodiment.

[0403] [Figure 4A] This is a block diagram showing a data structure for storing trigger conditions according to one embodiment. [Figure 4B] This is a block diagram showing a data structure for storing trigger conditions according to one embodiment.

[0404] [Figure 5] A block diagram showing an example of a trigger condition establishment system according to one embodiment.

[0405] [Figure 6A] This flowchart shows a method, according to one embodiment, for proactively identifying and revealing (for example, revealing for user selection) relevant content on an electronic device equipped with a touch-sensitive display. [Figure 6B]This flowchart shows a method, according to one embodiment, for proactively identifying and revealing (for example, revealing for user selection) relevant content on an electronic device equipped with a touch-sensitive display.

[0406] [Figure 7A] This is an overview of a touch-sensitive display used to show a user interface for proactively identifying and revealing relevant content, according to one embodiment. [Figure 7B] This is an overview of a touch-sensitive display used to show a user interface for proactively identifying and revealing relevant content, according to one embodiment.

[0407] [Figure 8A] This flowchart shows a method, according to one embodiment, for proactively identifying and revealing (for example, revealing for user selection) relevant content on an electronic device equipped with a touch-sensitive display. [Figure 8B] This flowchart shows a method, according to one embodiment, for proactively identifying and revealing (for example, revealing for user selection) relevant content on an electronic device equipped with a touch-sensitive display.

[0408] [Figure 9A] This is an overview of a touch-sensitive display used to show a user interface for proactively identifying and revealing relevant content, according to one embodiment. [Figure 9B] This is an overview of a touch-sensitive display used to show a user interface for proactively identifying and revealing relevant content, according to one embodiment. [Figure 9C] This is an overview of a touch-sensitive display used to show a user interface for proactively identifying and revealing relevant content, according to one embodiment. [Figure 9D]This is an overview of a touch-sensitive display used to show a user interface for proactively identifying and revealing relevant content, according to one embodiment.

[0409] [Figure 10A] This flowchart shows a method for proactively suggesting search queries based on content currently displayed on an electronic device equipped with a touch-sensitive display, according to one embodiment. [Figure 10B] This flowchart shows a method for proactively suggesting search queries based on content currently displayed on an electronic device equipped with a touch-sensitive display, according to one embodiment. [Figure 10C] This flowchart shows a method for proactively suggesting search queries based on content currently displayed on an electronic device equipped with a touch-sensitive display, according to one embodiment.

[0410] [Figure 11A] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting search queries based on the content currently displayed on the touch-sensitive display, according to one embodiment. [Figure 11B] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting search queries based on the content currently displayed on the touch-sensitive display, according to one embodiment. [Figure 11C] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting search queries based on the content currently displayed on the touch-sensitive display, according to one embodiment. [Figure 11D] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting search queries based on the content currently displayed on the touch-sensitive display, according to one embodiment. [Figure 11E] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting search queries based on the content currently displayed on the touch-sensitive display, according to one embodiment. [Figure 11F] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting search queries based on the content currently displayed on the touch-sensitive display, according to one embodiment. [Figure 11G] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting search queries based on the content currently displayed on the touch-sensitive display, according to one embodiment. [Figure 11H] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting search queries based on the content currently displayed on the touch-sensitive display, according to one embodiment. [Figure 11I] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting search queries based on the content currently displayed on the touch-sensitive display, according to one embodiment. [Figure 11J] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting search queries based on the content currently displayed on the touch-sensitive display, according to one embodiment.

[0411] [Figure 12] This flowchart shows a method for transitioning to search mode based on heuristics, according to one embodiment.

[0412] [Figure 13A]This is an overview of a touch-sensitive display used to illustrate a user interface for transitioning to search mode based on heuristics, according to one embodiment. [Figure 13B] This is an overview of a touch-sensitive display used to illustrate a user interface for transitioning to search mode based on heuristics, according to one embodiment.

[0413] [Figure 14] This flowchart shows a method for proactively providing vehicle position on an electronic device equipped with a touch-sensitive display, according to one embodiment.

[0414] [Figure 15A] This is an overview of a touch-sensitive display used to show a user interface for proactively providing vehicle position, according to one embodiment. [Figure 15B] This is an overview of a touch-sensitive display used to show a user interface for proactively providing vehicle position, according to one embodiment.

[0415] [Figure 16A] This flowchart shows a method, according to one embodiment, for proactively providing nearby point of interest (POI) information in response to a search query. [Figure 16B] This flowchart shows a method, according to one embodiment, for proactively providing nearby point of interest (POI) information in response to a search query.

[0416] [Figure 17A] This is an overview of a touch-sensitive display used to show a user interface for proactively providing nearby point of interest (POI) information in response to a search query, according to one embodiment. [Figure 17B]This is an overview of a touch-sensitive display used to show a user interface for proactively providing nearby point of interest (POI) information in response to a search query, according to one embodiment. [Figure 17C] This is an overview of a touch-sensitive display used to show a user interface for proactively providing nearby point of interest (POI) information in response to a search query, according to one embodiment. [Figure 17D] This is an overview of a touch-sensitive display used to show a user interface for proactively providing nearby point of interest (POI) information in response to a search query, according to one embodiment. [Figure 17E] This is an overview of a touch-sensitive display used to show a user interface for proactively providing nearby point of interest (POI) information in response to a search query, according to one embodiment.

[0417] [Figure 18A] This flowchart shows a method for extracting content items from voice communication and interacting with the extracted content items, according to one embodiment. [Figure 18B] This flowchart shows a method for extracting content items from voice communication and interacting with the extracted content items, according to one embodiment.

[0418] [Figure 19A] This is an overview of a touch-sensitive display used to show a user interface for displaying and interacting with content items extracted from voice communications, according to one embodiment. [Figure 19B] This is an overview of a touch-sensitive display used to show a user interface for displaying and interacting with content items extracted from voice communications, according to one embodiment. [Figure 19C]This is an overview of a touch-sensitive display used to show a user interface for displaying and interacting with content items extracted from voice communications, according to one embodiment. [Figure 19D] This is an overview of a touch-sensitive display used to show a user interface for displaying and interacting with content items extracted from voice communications, according to one embodiment. [Figure 19E] This is an overview of a touch-sensitive display used to show a user interface for displaying and interacting with content items extracted from voice communications, according to one embodiment. [Figure 19F] This is an overview of a touch-sensitive display used to show a user interface for displaying and interacting with content items extracted from voice communications, according to one embodiment.

[0419] [Figure 20] In one embodiment, this flowchart shows a method for determining that voice communication includes speech that identifies a physical location, and for populating an application with information about that physical location.

[0420] [Figure 21A] In some embodiments, it is determined that voice communication includes speech that identifies a physical location, and this is an overview of a touch-sensitive display used to show a user interface for an application to populate with information about that physical location. [Figure 21B] In some embodiments, it is determined that voice communication includes speech that identifies a physical location, and this is an overview of a touch-sensitive display used to show a user interface for an application to populate with information about that physical location.

[0421] [Figure 22A]This flowchart shows a method for proactively proposing a physical location for use in a messaging application, according to one embodiment. [Figure 22B] This flowchart shows a method for proactively proposing a physical location for use in a messaging application, according to one embodiment.

[0422] [Figure 22C] This flowchart shows a method for proactively suggesting location, event, or contact information according to one embodiment.

[0423] [Figure 23A] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23B] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23C] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23D] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23E]This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23F] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23G] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23H] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23I] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23J] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23K]This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23L] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23M] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23N] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments. [Figure 23O] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting location, event, or contact information (for example, for easy selection by the user and inclusion within a messaging application) according to some embodiments.

[0424] [Figure 24A] This flowchart shows a method, according to one embodiment, for proactively populating an application with information previously viewed by a user within a different application. [Figure 24B] This flowchart shows a method, according to one embodiment, for proactively populating an application with information previously viewed by a user within a different application.

[0425] [Figure 25A] This is an overview of a touch-sensitive display used to show a user interface for proactively populating an application with information previously viewed by a user within a different application (for example, populating a rideshare application with location information viewed by a user within a review application), according to some embodiments. [Figure 25B] This is an overview of a touch-sensitive display used to show a user interface for proactively populating an application with information previously viewed by a user within a different application (for example, populating a rideshare application with location information viewed by a user within a review application), according to some embodiments. [Figure 25C] This is an overview of a touch-sensitive display used to show a user interface for proactively populating an application with information previously viewed by a user within a different application (for example, populating a rideshare application with location information viewed by a user within a review application), according to some embodiments. [Figure 25D] This is an overview of a touch-sensitive display used to show a user interface for proactively populating an application with information previously viewed by a user within a different application (for example, populating a rideshare application with location information viewed by a user within a review application), according to some embodiments. [Figure 25E] This is an overview of a touch-sensitive display used to show a user interface for proactively populating an application with information previously viewed by a user within a different application (for example, populating a rideshare application with location information viewed by a user within a review application), according to some embodiments. [Figure 25F] This is an overview of a touch-sensitive display used to show a user interface for proactively populating an application with information previously viewed by a user within a different application (for example, populating a rideshare application with location information viewed by a user within a review application), according to some embodiments. [Figure 25G] This is an overview of a touch-sensitive display used to show a user interface for proactively populating an application with information previously viewed by a user within a different application (for example, populating a rideshare application with location information viewed by a user within a review application), according to some embodiments. [Figure 25H] This is an overview of a touch-sensitive display used to show a user interface for proactively populating an application with information previously viewed by a user within a different application (for example, populating a rideshare application with location information viewed by a user within a review application), according to some embodiments. [Figure 25I] This is an overview of a touch-sensitive display used to show a user interface for proactively populating an application with information previously viewed by a user within a different application (for example, populating a rideshare application with location information viewed by a user within a review application), according to some embodiments. [Figure 25J] This is an overview of a touch-sensitive display used to show a user interface for proactively populating an application with information previously viewed by a user within a different application (for example, populating a rideshare application with location information viewed by a user within a review application), according to some embodiments.

[0426] [Figure 26A] This flowchart shows a method for proactively suggesting information previously viewed by a user within a first application for use in a second application, according to one embodiment of the invention. [Figure 26B] This flowchart shows a method for proactively suggesting information previously viewed by a user within a first application for use in a second application, according to one embodiment of the invention.

[0427] [Figure 27] This flowchart shows a method for proactively suggesting a physical location to be used as a destination for route guidance in a vehicle, according to one embodiment.

[0428] [Figure 28] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting a physical location to be used as a destination for route guidance in a vehicle, according to one embodiment.

[0429] [Figure 29] This flowchart shows a method for proactively suggesting a paste action according to one embodiment.

[0430] [Figure 30A] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting a paste action, according to one embodiment. [Figure 30B] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting a paste action, according to one embodiment. [Figure 30C] This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting a paste action, according to one embodiment. [Figure 30D]This is an overview of a touch-sensitive display used to show a user interface for proactively suggesting a paste action, according to one embodiment.

[0431] [Figure 31-1] A mobile device configured to perform dynamic adjustments of a mobile device, according to one embodiment, is shown.

[0432] [Figure 31-2] An example process for invoking a heuristic process, according to one embodiment, is shown.

[0433] [Figure 31-3] This describes a process for adjusting the settings of a mobile device using a heuristic process, as described in some embodiments.

[0434] [Figure 31-4] A system example for performing background fetch updates of an application, according to one embodiment, is shown.

[0435] [Figure 31-5] This document presents a peer prediction for determining the likelihood of a user call to an application on a mobile device 100, according to one embodiment.

[0436] [Figure 31-6] This is a flowchart of an example process for predictively launching an application and performing background updates, according to one embodiment of the process.

[0437] [Figure 31-7] This is a flowchart illustrating an example process for determining when to launch an application on a mobile device, according to one embodiment of the present.

[0438] [Figure 31-8]A flowchart illustrating the state transitions for input to a trend table, according to one embodiment.

[0439] [Figure 31-9] This is a block diagram showing a system for providing push notifications to a mobile device according to one embodiment.

[0440] [Figure 31-10] This is a flowchart of an example process for performing non-waking push notifications on a push notification server, according to one embodiment.

[0441] [Figure 31-11] This is a flowchart illustrating an example process for performing background updates of an application in response to a low-priority push notification, according to one embodiment.

[0442] [Figure 31-12] This is a flowchart of an example process for performing background updates of an application in response to a high-priority push notification, according to one embodiment.

[0443] [Figure 31-13] This is a block diagram of an example system for performing background downloading and / or uploading of data on a mobile device, according to one embodiment.

[0444] [Figure 31-14] This is a flowchart illustrating an example process for performing background downloads and uploads, according to one embodiment.

[0445] [Figure 31-15] The following is an example of a graphical user interface (GUI) for enabling and / or disabling background updates for an application on a mobile device, according to one embodiment.

[0446] [Figure 31-16] This document presents an example of a system for sharing data between peer devices, according to one embodiment.

[0447] [Figure 31-17] This document describes an example process for sharing data between peer devices according to one embodiment.

[0448] [Figure 32-1] This is a block diagram of one embodiment of a system that returns search results based on an input query prefix, according to some embodiments.

[0449] [Figure 32-2] This is a flowchart of one embodiment of a process for query completion and determining related results based on an input query prefix, according to one of the embodiments.

[0450] [Figure 32-3] This is a block diagram of one embodiment of an aggregator and multiple search domains, according to some embodiments.

[0451] [Figure 32-4] This is a diagram of one embodiment of a query completion search domain according to some embodiments.

[0452] [Figure 32-5] This is a diagram illustrating one embodiment of a map search domain. [Figure 32-6] This is a flowchart of one embodiment of a process for determining query completion from multiple search domains, according to some embodiments.

[0453] [Figure 32-7] This is a flowchart of one embodiment of a process for determining relevant results across multiple search domains from determined query completion, according to one embodiment.

[0454] [Figure 32-8]This is a block diagram of one embodiment of a system that incorporates user feedback into a feedback search index, according to some embodiments.

[0455] [Figure 32-9] This is a flowchart of one embodiment of the process for incorporating user feedback into a citation search index, according to some embodiments.

[0456] [Figure 32-10] This is a flowchart of one embodiment of a process for collecting user feedback during a user search session, according to some embodiments.

[0457] [Figure 32-11] This is a flowchart of one embodiment of the process for incorporating user feedback into a feedback index, according to some embodiments.

[0458] [Figure 32-12] This is a flowchart of one embodiment of a process for updating the results cache using user feedback, according to some embodiments.

[0459] [Figure 32-13] This is a block diagram of one embodiment of a federator that performs multi-domain searches using characterized query completion, according to some embodiments.

[0460] [Figure 32-14] This is a flowchart of one embodiment of a process for determining relevant results using a vocabulary service, according to some embodiments.

[0461] [Figure 32-15] This is a flowchart of one embodiment of the process characterizing query completion according to some embodiments.

[0462] [Figure 32-16]This is a block diagram of one embodiment of a completion module that determines query completion from multiple search domains, according to some embodiments.

[0463] [Figure 32-17] This is a block diagram of one embodiment of a results module that determines relevant results across multiple search domains from determined query completion, according to one embodiment of the module.

[0464] [Figure 32-18] This is a block diagram of one embodiment of a feedback collection module that collects user feedback during a user search session, according to some embodiments.

[0465] [Figure 32-19] This is a block diagram of one embodiment of a feedback processing module that incorporates user feedback into a feedback index, according to some embodiments.

[0466] [Figure 32-20] This is a block diagram of one embodiment of a query result update module that updates the result cache using user feedback, according to some embodiments.

[0467] [Figure 32-21] This is a block diagram of one embodiment of a feedback processing module that incorporates user feedback into a feedback index, according to some embodiments.

[0468] [Figure 32-22] This is a block diagram of one embodiment of a query result update module that updates the result cache using user feedback, according to some embodiments.

[0469] [Figure 33-1] The local and remote search subsystems on a computing device known from prior art are shown in block diagram form.

[0470] [Figure 33-2] A local search subsystem having a local learning function, which may be used to improve results returned from a remote search application on a computing device according to one embodiment, is shown in block diagram form.

[0471] [Figure 33-3] A method for locally learning query features using a local search query, local results, and local feedback based on the local results, according to one embodiment, is shown in the form of a block diagram.

[0472] [Figure 33-4] A block diagram illustrates a method for locally learning query features, in some embodiments, which uses search results returned from both local and remote search queries, as well as local feedback in both local and remote search query results.

[0473] [Figure 33-5] In one embodiment, a method for learning query features sent by a remote service to a local device in response to a query passed to the remote service is shown in the form of a block diagram.

[0474] [Figure 33-6] In some embodiments, a method for receiving or determining new features, training locally, and using them is shown in the form of a block diagram.

[0475] [Figure 33-7] The following are exemplary embodiments of a software stack usable in some embodiments of the present invention, according to some embodiments.

[0476] [Figure 34-5A] A block diagram of an exemplary data architecture for a proposed contact, according to one embodiment, is shown.

[0477] [Figure 34-5B] A block diagram of an exemplary data architecture for proposed calendar events, according to one embodiment, is shown.

[0478] [Figure 34-6A] An exemplary user interface for providing proposed contacts and calendar events, according to some embodiments, is shown. Figures 1A-1B, 2, and 3 provide a description of an exemplary device for performing the techniques for suggesting contact and event information described in this section. Figure 34-6A shows an exemplary user interface for suggesting contact and event information. The user interfaces in these figures are also used to illustrate the processes described below, including the processes shown in Figures 34-7A to 34-13. [Figure 34-6B] An exemplary user interface for providing proposed contacts and calendar events, according to some embodiments, is shown. Figures 1A-1B, 2, and 3 provide a description of an exemplary device for performing the technique for suggesting contact and event information described in this section. Figure 34-6B shows an exemplary user interface for suggesting contact and event information. The user interfaces in these figures are also used to illustrate the processes described below, including the processes shown in Figures 34-7A to 34-13. [Figure 34-6C] An exemplary user interface for providing proposed contacts and calendar events, according to some embodiments, is shown. Figures 1A-1B, 2, and 3 provide a description of an exemplary device for performing the techniques for suggesting contact and event information described in this section. Figure 34-6C shows an exemplary user interface for suggesting contact and event information. The user interfaces in these figures are also used to illustrate the processes described below, including the processes shown in Figures 34-7A to 34-13. [Figure 34-6D]An exemplary user interface for providing proposed contacts and calendar events, according to some embodiments, is shown. Figures 1A-1B, 2, and 3 provide a description of an exemplary device for performing the techniques for suggesting contact and event information described in this section. Figure 34-6D shows an exemplary user interface for suggesting contact and event information. The user interfaces in these figures are also used to illustrate the processes described below, including the processes shown in Figures 34-7A to 34-13. [Figure 34-6E] An exemplary user interface for providing proposed contacts and calendar events, according to some embodiments, is shown. Figures 1A-1B, 2, and 3 provide a description of an exemplary device for performing the techniques for suggesting contact and event information described in this section. Figure 34-6E shows an exemplary user interface for suggesting contact and event information. The user interfaces in these figures are also used to illustrate the processes described below, including the processes shown in Figures 34-7A to 34-13. [Figure 34-6F] An exemplary user interface for providing proposed contacts and calendar events, according to some embodiments, is shown. Figures 1A-1B, 2, and 3 provide a description of an exemplary device for performing the technique for suggesting contact and event information described in this section. Figure 34-6F shows an exemplary user interface for suggesting contact and event information. The user interfaces in these figures are also used to illustrate the processes described below, including the processes shown in Figures 34-7A to 34-13. [Figure 34-6G]An exemplary user interface for providing proposed contacts and calendar events, according to some embodiments, is shown. Figures 1A-1B, 2, and 3 provide a description of an exemplary device for performing the techniques for suggesting contact and event information described in this section. Figure 34-6G shows an exemplary user interface for suggesting contact and event information. The user interfaces in these figures are also used to illustrate the processes described below, including the processes shown in Figures 34-7A to 34-13.

[0479] [Figure 34-7A] A flowchart illustrating an exemplary process for generating proposed contacts, according to one embodiment, is shown. [Figure 34-7B] A flowchart illustrating an exemplary process for generating proposed contacts, according to one embodiment, is shown.

[0480] [Figure 34-8A] A flowchart illustrating an exemplary process for updating existing contacts with proposed contact information items, according to one embodiment, is shown. [Figure 34-8B] A flowchart illustrating an exemplary process for updating existing contacts with proposed contact information items, according to one embodiment, is shown.

[0481] [Figure 34-9A] A flowchart illustrating an exemplary process for displaying contacts along with proposed contact information, according to one embodiment, is shown. [Figure 34-9B] A flowchart illustrating an exemplary process for displaying contacts along with proposed contact information, according to one embodiment, is shown.

[0482] [Figure 34-10] A flowchart illustrating an exemplary process for displaying proposed contact information along with a message, according to one embodiment, is shown.

[0483] [Figure 34-11A]A flowchart illustrating an exemplary process for generating proposed calendar events, according to one embodiment, is shown. [Figure 34-11B] A flowchart illustrating an exemplary process for generating proposed calendar events, according to one embodiment, is shown.

[0484] [Figure 34-12] A flowchart illustrating an exemplary process for displaying proposed event information along with a message, according to one embodiment, is shown.

[0485] [Figure 34-13] A flowchart illustrating an exemplary process for displaying multiple proposed contact or event information along with a message, according to one embodiment, is shown.

[0486] [Figure 34-14] This is a functional block diagram of an electronic device according to one embodiment.

[0487] [Figure 34-15] This is a functional block diagram of an electronic device according to one embodiment.

[0488] [Figure 35-1] This is a flowchart of method 35_100, which suggests an application based on detected events according to one embodiment.

[0489] [Figure 35-2] A segmentation process 35_200 according to one embodiment is shown.

[0490] [Figure 35-3] A decision tree 35_300 that may be generated by some embodiments is shown.

[0491] [Figure 35-4]This is a flowchart of a method 35_400 that, according to one embodiment, proposes an application to a user of a computing device based on an event.

[0492] [Figure 35-5A] Plots of binomial distributions for various accurate and inaccurate values, according to some embodiments, are shown. [Figure 35-5B] Plots of binomial distributions for various accurate and inaccurate values, according to some embodiments, are shown. [Figure 35-5C] Plots of binomial distributions for various accurate and inaccurate values, according to some embodiments, are shown. [Figure 35-5D] Plots of binomial distributions for various accurate and inaccurate values, according to some embodiments, are shown.

[0493] [Figure 35-6A] The parent and sub-models resulting from segmentation, according to some embodiments, are shown. [Figure 35-6B] The parent and sub-models resulting from segmentation, according to some embodiments, are shown.

[0494] [Figure 35-7] An example architecture 35_700 for providing a user interface to a user for interaction with one or more applications, according to one embodiment, is shown.

[0495] [Figure 36-1] This is a flowchart illustrating a method for identifying an application based on a trigger event, according to one embodiment.

[0496] [Figure 36-2] A block diagram of a system for determining a trigger event, according to one embodiment, is shown.

[0497] [Figure 36-3]A block diagram of a system for identifying an application for a user based on a trigger event, according to one embodiment, is shown.

[0498] [Figure 36-4] A block diagram of a system for identifying applications using multiple predictive models, according to one embodiment, is shown.

[0499] [Figure 36-5] This is a flowchart illustrating a method for identifying an application based on a trigger event on a device, according to one embodiment.

[0500] [Figure 36-6] This is a simplified diagram of a device having a user interface for a music application, according to one embodiment.

[0501] [Figure 36-7A] This is a flowchart of a method for removing a specific application from the user interface, according to one embodiment. [Figure 36-7B] This is a flowchart of a method for removing a specific application from the user interface, according to one embodiment.

[0502] [Figure 37-1] This is a flowchart of a method 100 that suggests a destination based on a detected event, according to one embodiment.

[0503] [Figure 37-2] A block diagram of a system for determining a trigger event, according to one embodiment, is shown.

[0504] [Figure 37-3] A block diagram of a system for identifying a destination based on a trigger event, according to one embodiment, is shown.

[0505] [Figure 37-4] An example of suggesting a recipient within a user interface for an email application, according to one embodiment, is shown.

[0506] [Figure 37-5] One example of a user interface for a search application, according to one embodiment, that suggests a destination is shown.

[0507] [Figure 37-6] This is a flowchart of a method 37-600, according to one embodiment, for suggesting recipients to users of a computing device based on an event.

[0508] [Figure 37-7] An example of a data flow for suggesting a destination, according to one embodiment, is shown.

[0509] [Figure 37-8] A block diagram of an interaction module according to one embodiment is shown.

[0510] [Figure 37-9] An example architecture 37-900 for providing a user interface to a user for suggesting destinations, according to one embodiment, is shown.

[0511] [Figure 38-1] A block diagram of different components of a mobile computing device configured to implement various technologies described herein, according to some embodiments, is shown.

[0512] [Figure 38-2] A method executed by the application prediction engine shown in Figure 38-1, according to one embodiment, is shown.

[0513] [Figure 38-3] A method executed by the search application shown in Figure 1, according to one embodiment, is described below.

[0514] [Figure 38-4] A conceptual diagram of an example user interface for a search application, as shown in Figure 38-1, is provided, according to some embodiments.

[0515] [Figure 39-1] A block diagram of different components of a mobile computing device configured to implement various technologies described herein, according to some embodiments, is shown.

[0516] [Figure 39-2] A more detailed block diagram of a specific component of the mobile computing device shown in Figure 39-1 (or Figure 1A) according to some embodiments is shown.

[0517] [Figure 39-3A] A method for high-level initialization and operation of a prediction engine according to some embodiments is shown.

[0518] [Figure 39-3B] This document describes a method for synchronously providing predictions from a prediction engine, according to one embodiment.

[0519] [Figure 39-3C] This document describes a method for asynchronously providing predictions in a prediction engine according to one embodiment.

[0520] [Figure 39-4A] This describes a method for a consumer application that requests the synchronous reception of predictions, according to one embodiment.

[0521] [Figure 39-4B] This document describes a method for a consumer application to register to receive predictions asynchronously, according to one embodiment.

[0522] [Figure 39-5A]This document describes a method for managing prediction engine registrations at a prediction engine center, according to one embodiment.

[0523] [Figure 39-5B] This document describes a method, according to one embodiment, for synchronously providing predictions to consumer applications from a prediction engine center.

[0524] [Figure 39-5C] This document describes a method for asynchronously providing predictions to consumer applications from a prediction engine center, according to one embodiment.

[0525] [Figure 40-1] This is a block diagram of an example system for monitoring, predicting, and notifying context clients of changes in the current context of a computing device, according to one embodiment.

[0526] [Figure 40-2A] An example of a context item that may constitute the current context according to one embodiment is shown.

[0527] [Figure 40-2B] In some embodiments, an example of a new context item added to the current context is shown.

[0528] [Figure 40-3] An example of a callback predicate database according to one embodiment is shown.

[0529] [Figure 40-4] This is a graph showing an example of a change in state over time associated with a context item, according to one embodiment.

[0530] [Figure 40-5] This graph shows an example of an event stream associated with a context item according to one embodiment.

[0531] [Figure 40-6] An example of a past event stream database according to one embodiment is shown.

[0532] [Figure 40-7] This is a block diagram of an example system for providing context callback notifications to a requesting client, according to one embodiment.

[0533] [Figure 40-8A] This is a block diagram of a system example that shows how to restart a terminated request client, according to one embodiment.

[0534] [Figure 40-8B] This is a block diagram of a system example that shows how to restart a terminated request client, according to one embodiment.

[0535] [Figure 40-9A] This is a block diagram of a system example showing how to restart a terminated context daemon, according to one embodiment.

[0536] [Figure 40-9B] This is a block diagram of a system example showing how to restart a terminated context daemon, according to one embodiment.

[0537] [Figure 40-10A] This is a block diagram of a system example showing how to restart a terminated context daemon and a requesting client, according to one embodiment.

[0538] [Figure 40-10B] This is a block diagram of a system example showing how to restart a terminated context daemon and a requesting client, according to one embodiment.

[0539] [Figure 40-11]This is a block diagram of an example system configured to restart the client and / or context daemon based on device status information received by a startup daemon, according to one embodiment of the system.

[0540] [Figure 40-12A] This is a block diagram of a system example showing how to restart a context daemon using a startup daemon, according to one embodiment.

[0541] [Figure 40-12B] This is a block diagram of a system example showing how to restart a context daemon using a startup daemon, according to one embodiment.

[0542] [Figure 40-13A] This is a block diagram of a system example showing how to restart a requesting client using a startup daemon, according to one embodiment.

[0543] [Figure 40-13B] This is a block diagram of a system example showing how a startup daemon is used to restart a requesting client, according to one embodiment.

[0544] [Figure 40-14] This graph shows an example of slot-wise averaging, which predicts future events, according to one embodiment.

[0545] [Figure 40-15] An example graph showing slot weighting according to one embodiment is shown.

[0546] [Figure 40-16A] This graph shows an example of a method for predicting future context according to one embodiment.

[0547] [Figure 40-16B]This graph shows an example of a method for converting slot-wise probabilities into a probability curve, according to one embodiment of the method.

[0548] [Figure 40-17] An example of an event stream containing predicted future events, according to one embodiment, is shown.

[0549] [Figure 40-18] This is a flowchart of an example process for notifying a client of a context change on a computing device, according to one embodiment.

[0550] [Figure 40-19] This is a flowchart illustrating an example process for restarting a context daemon to serve a callback request, according to one embodiment.

[0551] [Figure 40-20] This is a flowchart illustrating an example process for restarting a callback client and receiving a callback notification, according to one embodiment.

[0552] [Figure 40-21] This is a flowchart of an example process for predicting future events based on past contextual information, according to one embodiment.

[0553] [Figure 40-22] This is a flowchart of an example process for servicing a sleep context callback request, according to one embodiment.

[0554] [Figure 41-1] This is a block diagram of one embodiment of a system for indexing application states for use in a local device search index.

[0555] [Figure 41-2]This is a block diagram of one embodiment of a system for retrieving application status using an on-device application status search index.

[0556] [Figure 41-3] This is a block diagram of an embodiment of a user interface that displays application status query results among other query results.

[0557] [Figure 41-4A] This is a flowchart of one embodiment of a process for indexing application states received from multiple different applications on a device.

[0558] [Figure 41-4B] This is a flowchart illustrating one embodiment of a process that uses an application state index to determine query results for a query.

[0559] [Figure 41-5] This is a flowchart of one embodiment of a process that receives application status and presents it as part of the query results.

[0560] [Figure 41-6] This is a block diagram of one embodiment of a system for indexing application states for use in a remote search index.

[0561] [Figure 41-7] This is a block diagram of one embodiment of a system that searches for application status using a remote application status search index.

[0562] [Figure 41-8] This is a flowchart of one embodiment of the process for adding the application state to the application state index.

[0563] [Figure 41-9]This is a flowchart illustrating one embodiment of the process for exporting application state to an application state indexing service.

[0564] [Figure 41-10] This is a flowchart of one embodiment of the process of performing a query search using an application state index.

[0565] [Figure 41-11] This is a flowchart of one embodiment of a process that receives application status and presents it as part of the query results.

[0566] [Figure 41-12] This is a block diagram of one embodiment of a system for indexing application status views for use in remote search indexes.

[0567] [Figure 41-13] This is a block diagram of one embodiment of the application view.

[0568] [Figure 41-14] This is a flowchart of one embodiment of the process for generating an application state view using the application state.

[0569] [Figure 41-15] This is a flowchart of one embodiment of a process that receives application status, including an application status view, and presents it as part of the query results.

[0570] [Figure 42] This is a functional block diagram of an electronic device according to one embodiment. [Figure 43] This is a functional block diagram of an electronic device according to one embodiment. [Figure 44] This is a functional block diagram of an electronic device according to one embodiment. [Figure 45]This is a functional block diagram of an electronic device according to one embodiment. [Figure 46] This is a functional block diagram of an electronic device according to one embodiment. [Figure 47] This is a functional block diagram of an electronic device according to one embodiment. [Figure 48] This is a functional block diagram of an electronic device according to one embodiment. [Figure 49] This is a functional block diagram of an electronic device according to one embodiment. [Figure 50] This is a functional block diagram of an electronic device according to one embodiment. [Figure 51] This is a functional block diagram of an electronic device according to one embodiment. [Figure 52] This is a functional block diagram of an electronic device according to one embodiment. [Figure 53] This is a functional block diagram of an electronic device according to one embodiment. [Figure 54] This is a functional block diagram of an electronic device according to one embodiment. [Figure 55] This is a functional block diagram of an electronic device according to one embodiment. [Modes for carrying out the invention]

[0571] As described above, and as detailed below, there is a growing demand for electronic devices with faster and more efficient methods and interfaces for quick access to applications and desired functions within those applications. In particular, there is a growing demand for devices that assist users in providing proactive assistance by eliminating repetitive tasks and identifying and providing relevant information before the user explicitly requests it. Furthermore, there is a growing demand for quick access to applications and desired functions within those applications at specific times (e.g., accessing a calendar application after waking up each morning) and at specific locations (e.g., accessing a music application at the gym). Disclosed herein are novel methods and interfaces that address these demands and provide users with a way to quickly access applications and functions within those applications at those specific locations and times. Such methods and interfaces optionally complement or replace existing methods for accessing applications. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. In the case of battery-operated devices, such methods and interfaces conserve power and extend the time between battery charges. Furthermore, such methods and interfaces help extend the lifespan of touch-sensitive displays by reducing the number of inputs required (for example, instead of continuously and aimlessly tapping the touch-sensitive display to identify desired information, the methods and interfaces disclosed herein proactively provide information without requiring user input).

[0572] Figures 1A-1E and 12 below provide a description of device examples. Figures 10 and 11 provide functional block diagrams of electronic device examples. Figures 3A-3B and 4A-4B are block diagrams of example data structures used to proactively identify and reveal relevant content (these data structures are used in the methods described in relation to Figures 6A-6B and 8A-8B). Figure 5 is a block diagram of an example system for establishing trigger conditions used to proactively identify and reveal relevant content (this system example is used in the methods described in relation to Figures 6A-6B and 8A-8B). Figures 6A-6B are flowcharts of methods for proactively identifying and revealing relevant content. Figures 7A-7B are outlines of touch-sensitive displays used to show example user interfaces and gestures for proactively identifying and revealing relevant content. Figures 8A-8B are flowcharts of methods for proactively identifying and revealing relevant content. Figures 9A–9D are outlines of touch-sensitive displays used to show additional user interfaces for proactively identifying and revealing relevant content. Figures 3A–3B, 4A–4B, 5, and 7A–7B are used to illustrate the method and / or process in Figures 6A–6B. Figures 3A–3B, 4A–4B, 5, and 9A–9D are used to illustrate the method and / or process in Figures 8A–8B.

[0573] Figures 10A-10C are flowcharts illustrating a method for proactively suggesting search queries based on content currently displayed on an electronic device equipped with a touch-sensitive display. Figures 11A-11J are overviews of touch-sensitive displays used to illustrate a user interface for proactively suggesting search queries based on content currently displayed on the touch-sensitive display. Figures 11A-11J are used to illustrate the method and / or process of Figures 10A-10C.

[0574] Figure 12 is a flowchart showing how to transition to search mode based on heuristics. Figures 13A-13B are outlines of touch-sensitive displays used to illustrate the user interface for transitioning to search mode based on heuristics. Figures 13A-13B are used to illustrate the method and / or process in Figure 12.

[0575] Figure 14 is a flowchart illustrating a method for proactively providing vehicle position on an electronic device equipped with a touch-sensitive display, according to one embodiment. Figures 15A-15B are schematics of touch-sensitive displays used to illustrate a user interface for proactively providing vehicle position, according to one embodiment. Figures 15A-15B are used to illustrate the method and / or process of Figure 14.

[0576] Figures 16A-16B are flowcharts illustrating a method for proactively providing nearby point of interest (POI) information in response to a search query, according to one embodiment. Figures 17A-17E are schematics of touch-sensitive displays used to illustrate a user interface for proactively providing nearby point of interest (POI) information in response to a search query, according to one embodiment. Figures 16A-16B are used to illustrate the method and / or process of Figures 17A-17E.

[0577] Figures 18A-18B are flowcharts illustrating a method for extracting content items from voice communication and interacting with the extracted content items, according to one embodiment. Figures 19A-19F are schematics of touch-sensitive displays used to show a user interface for displaying and interacting with content items extracted from voice communication, according to one embodiment. Figures 19A-19F are used to illustrate the method and / or process of Figures 18A-18B.

[0578] Figure 20 is a flowchart illustrating a method, according to one embodiment, for determining that a voice communication includes speech that identifies a physical location and for populating an application with information about that physical location. Figures 21A-21B are schematics of touch-sensitive displays used to show a user interface for determining that a voice communication includes speech that identifies a physical location and for populating an application with information about that physical location, according to one embodiment. Figures 19A-19F and 21A-21B are used to illustrate the method and / or process of Figure 20.

[0579] Figures 22A-22B are flowcharts illustrating a method for proactively suggesting physical locations for use in a messaging application, according to one embodiment. Figures 23A-23O are schematics of touch-sensitive displays used to illustrate a user interface for proactively suggesting information about locations, events, or contacts (e.g., for easy selection by the user and inclusion within a messaging application), according to one embodiment. Figures 23A-23O are used to illustrate the method and / or process of Figures 22A-22B.

[0580] Figure 22C is a flowchart illustrating a method for proactively suggesting location, event, or contact information according to one embodiment. Figures 23A–23O are used to illustrate the method and / or process of Figure 22C.

[0581] Figures 24A-24B are flowcharts illustrating a method, according to one embodiment, for proactively populating an application with information previously viewed by a user within a different application. Figures 25A-25J are schematics of touch-sensitive displays used to illustrate a user interface for proactively populating an application with information previously viewed by a user within a different application (for example, populating a rideshare application with location information viewed by a user within a review application). Figures 25A-25J are used to illustrate the method and / or process of Figures 24A-24B.

[0582] Figures 26A to 26B are flowcharts illustrating a method for proactively suggesting information previously viewed by a user within a first application for use in a second application, according to some embodiments. Figures 25A to 25J are used to illustrate the method and / or process of Figures 26A to 26B.

[0583] Figure 27 is a flowchart illustrating a method for proactively suggesting a physical location to be used as a destination for vehicle route guidance, according to one embodiment. Figure 28 is an overview of a touch-sensitive display used to show a user interface for proactively suggesting a physical location to be used as a destination for vehicle route guidance, according to one embodiment. Figure 28 is used to illustrate the method and / or process of Figure 27.

[0584] Figure 29 is a flowchart illustrating a method for proactively suggesting a paste action according to one embodiment. Figures 30A-30D are schematics of touch-sensitive displays used to illustrate a user interface for proactively suggesting a paste action according to one embodiment. Figures 30A-30D are used to illustrate the method and / or process of Figure 29.

[0585] Sections 1-11 within the "Additional Modes for Carrying Out the Invention" section provide additional details that complement the descriptions provided in relation to Figures 1A-30D.

[0586] Here, embodiments shown in the accompanying drawings will be referred to in detail. The following detailed description includes numerous specific details to provide a complete understanding of the various embodiments described. However, it will be apparent to those skilled in the art that the various embodiments described can be practiced without these specific details. In other examples, well-known methods, procedures, components, circuits, and networks are not described in detail so as not to unnecessarily obscure the aspects of the embodiments.

[0587] In this specification, terms such as "first," "second," etc., are used to describe various elements in some embodiments, but it will be understood that these elements should not be limited by those terms. These terms are used solely to distinguish one element from another. For example, without departing from the scope of the various embodiments described, a first contact may be referred to as a second contact, and similarly, a second contact may be referred to as a first contact. Both the first and second contacts are contacts, but they are not the same contact.

[0588] The terms used in the descriptions of the various embodiments described herein are intended solely to describe specific embodiments and are not intended to limit them. When used in the various described embodiments and in the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context otherwise clearly indicates. When used herein, the term "and / or" should also be understood to mean and include any and all possible combinations of one or more of the enumerated items relating to the description. When used herein, the terms "includes," "including," "comprises," and / or "comprising" specify the presence of the described features, integers, steps, actions, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, actions, elements, components, and / or groups thereof.

[0589] As used herein, the term "if" shall be interpreted, at the discretion of the context, to mean "when," "upon," "in response to determining," or "in response to detecting." Similarly, the phrase "if it is determined" or "if (a stated condition or event) is detected" shall be interpreted, at the discretion of the context, to mean "upon determining," "in response to determining," "upon detecting (the stated condition or event)," or "in response to detecting (the stated condition or event)."

[0590] The disclosure herein interchangeably references the detection of touch input on, across, over, or substantially within a particular user interface element or a particular portion of a touch-sensitive display. When used herein, a touch input detected "on" a particular user interface element may, depending on the context, also be a touch input detected "on," "over," "over," or "substantially within" the same user interface element. In some embodiments, and as detailed below, the desired sensitivity level for detecting touch input is configured by the user of the electronic device (for example, the user may decide (and configure and operate the electronic device) that a touch input should only be detected if it is entirely within a user interface element).

[0591] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, which also includes other functions, such as PDA functionality and / or music player functionality. Exemplary embodiments of portable multifunction devices include, but are not limited to, the IPHONE®, iPod TOUCH®, and iPad® devices of Apple Inc., Cupertino, California. Other portable electronic devices, such as laptop or tablet computers with touch-sensitive surfaces (e.g., touch-sensitive displays and / or touchpads), are also used optionally. It should also be understood that in some embodiments, the device is not a portable communication device but a desktop computer with touch-sensitive surfaces (e.g., touch-sensitive displays and / or touchpads).

[0592] The following description refers to an electronic device having a display and a touch-sensitive surface. However, please understand that this electronic device may optionally include one or more other physical user interface devices such as a physical keyboard, mouse, and / or joystick.

[0593] This device generally supports a variety of applications, including drawing applications, presentation applications, word processing applications, website creation applications, disk authoring applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, health / fitness applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications.

[0594] Various applications running on this device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface, as well as the corresponding information displayed on the device, are optionally adjusted and / or modified on an application-by-application basis and / or within the corresponding application. In this way, the device's common physical architecture (such as the touch-sensitive surface) optionally supports a variety of applications that have an intuitive and transparent user interface for the user.

[0595] Next, we turn our attention to embodiments of portable electronic devices comprising a touch-sensitive display. Figure 1A is a block diagram of a portable multifunction device 100 (also referred to herein interchangeably as electronic device 100 or device 100) comprising a touch-sensitive display 112 according to one embodiment. The touch-sensitive display 112 may be referred to for convenience as a “touchscreen,” and may be known or referred to as a touch-sensitive display system. Device 100 comprises memory 102 (optionally including one or more computer-readable storage media), a controller 120, one or more processing units (CPUs) 122, a peripheral interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input or control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more intensity sensors 165 for detecting the intensity of contact on Device 100 (e.g., a touch-sensitive surface such as the touch-sensitive display system 112 of Device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile outputs on Device 100 (e.g., generating tactile outputs on a touch-sensitive surface such as the touch-sensitive display system 112 of Device 100 or the touchpad of Device 100). These components optionally communicate via one or more communication buses or signal lines 103.

[0596] As used herein and in the claims, the term “strength” of contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of contact (e.g., finger contact) on the touch-sensitive surface, or a substitute (substitute) for the force or pressure of contact on the touch-sensitive surface. The strength of contact has a range of values, including at least four distinct values, and more typically hundreds of different values ​​(e.g., at least 256). The strength of contact is determined (or measured) optionally using various methods and various sensors, or combinations of sensors. For example, one or more force sensors placed below or adjacent to the touch-sensitive surface are optionally used to measure forces at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted average) to determine an estimate of the contact force. Similarly, a pressure-sensing tip on a stylus is optionally used to determine the pressure of a stylus on the touch-sensitive surface. Alternatively, the size and / or change in the contact area detected on the touch-sensitive surface, the capacitance and / or change in the touch-sensitive surface adjacent to the contact, and / or the resistance and / or change in the touch-sensitive surface adjacent to the contact may be optionally used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some implementations, the substitute measurement of the force or pressure of the contact is used directly to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some implementations, the substitute measurement of the force or pressure of the contact is converted to an estimated force or pressure, and this estimated force or pressure is used to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure).

[0597] As used herein and in the claims, the term “tactile output” refers to a physical displacement of a device relative to its previous position, a physical displacement of a component of a device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of gravity of a device, which will be detected by the user through touch. For example, in a situation where a device or component of a device is in contact with a touch-sensitive user surface (e.g., the user’s fingers, palm, or other part of their hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical properties of the device or component of the device. For example, the movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) may be optionally interpreted by the user as a “down-click” or “up-click” of a physical actuator button. In some cases, the user may feel a tactile sensation such as a “down-click” or “up-click” even when there is no movement of a physical actuator button associated with a touch-sensitive surface that has been physically pressed (e.g., displaced) by the user’s action. In another embodiment, the movement of a touch-sensitive surface may be optionally interpreted or perceived by the user as the "roughness" of the touch-sensitive surface, even if there is no change in the smoothness of the touch-sensitive surface. While such user interpretations of touch depend on the user's personal sensory perception, there are many touch sensory perceptions common to the majority of users. Therefore, when a tactile output is described as corresponding to a user's specific sensory perception (e.g., "up-click," "down-click," "roughness"), unless otherwise stated, the generated tactile output corresponds to the physical displacement of the device or its components that generate the described sensory perception of a typical (or average) user.

[0598] Device 100 is merely one embodiment of a portable multifunction device, and it should be understood that Device 100 may optionally have more or fewer components than those shown, or may optionally have two or more components in any combination, or may optionally have different configurations or arrangements of components. The various components shown in Figure 1A are implemented as hardware, software, or a combination of hardware and software, including one or more signal processing circuits and / or application-specific integrated circuits.

[0599] Memory 102 optionally includes high-speed random-access memory (e.g., DRAM, SRAM, DDR RAM, or other random-access solid-state memory devices), and optionally includes non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory 102 optionally includes one or more storage devices located remotely from the processor(s) 122. Access to Memory 102 by the CPU 122 and other components of device 100, such as the peripheral interface 118, is optionally controlled by the controller 120.

[0600] The input and output peripherals of this device can be connected to the CPU 122 and memory 102 using the peripheral interface 118. One or more processors 122 operate or execute various software programs and / or instruction sets stored in memory 102 in order to perform various functions for device 100 and to process data.

[0601] In some embodiments, the peripheral interface 118, CPU 122, and controller 120 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0602] The RF (radio frequency) circuit 108 transmits and receives RF signals, also known as electromagnetic signals. The RF circuit 108 converts electrical signals to electromagnetic signals, or electromagnetic signals to electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes, but is not limited to, well-known circuits for performing these functions, including, but not limited to, antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, CODEC chipsets, subscriber identification module (SIM) cards, and memory. The RF circuit 108 optionally communicates wirelessly with the Internet, also known as the World Wide Web (WWW), intranets, and / or wireless networks such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs), and other devices. Wireless communication may optionally use any of several communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM)®, Enhanced Data GSM Environment (EDGE)®, High-Speed ​​Downlink Packet Access (HSDPA), High-Speed ​​Uplink Packet Access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), Long-Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth®, and / or Wireless Fidelity (Wi-Fi)® (e.g., IEEE 802.1 la, IEEE 802.1 lb, IEEE 802.1 lg, and / or IEEE 802.1 ln).

[0603] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral interface 118, converts this audio data into an electrical signal, and transmits this electrical signal to the speaker 111. The speaker 111 converts the electrical signal into human audible sound waves. The audio circuit 110 also receives the electrical signal converted from the sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and transmits this audio data to the peripheral interface 118 for processing. The audio data is optionally retrieved by the peripheral interface 118 from memory 102 and / or RF circuit 108, and / or transmitted to memory 102 and / or RF circuit 108. In some embodiments, the audio circuit 110 further includes a headset jack. The headset jack provides an interface between the audio circuit 110 and a detachable audio input / output peripheral, such as an output-only headphone or a headset having both an output (e.g., headphones for one or both ears) and an input (e.g., a microphone).

[0604] The I / O subsystem 106 connects the input / output peripherals of device 100, such as the touchscreen 112 and other input control devices 116, to the peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, a light sensor controller 158, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. One or more input controllers 160 receive electrical signals from and transmit electrical signals to the other input or control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, the input controller(s) 160 are optionally coupled to (or not coupled to) one or more of the following: a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. One or more buttons optionally include up / down buttons for adjusting the volume of speaker 111 and / or microphone 113. One or more buttons optionally include push buttons.

[0605] The touch-sensitive display 112 provides input and output interfaces between the device and the user. The display controller 156 receives electrical signals from and / or transmits electrical signals to the touchscreen 112. The touchscreen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, images, and any combination thereof (collectively referred to as “graphics”). In some embodiments, some or all of the visual output corresponds to user interface objects.

[0606] The touchscreen 112 has a touch-sensing surface, sensor, or set of sensors that accept user input based on tactile and / or haptic contact. The touchscreen 112 and the display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of contact) on the touchscreen 112 and translate the detected contact into interaction with user interface objects displayed on the touchscreen 112 (e.g., one or more soft keys, icons, web pages, or images). In an exemplary embodiment, the point of contact between the touchscreen 112 and the user corresponds to the area under the user's finger.

[0607] The touchscreen 112 optionally uses LCD (liquid crystal display) technology, LPD (polymer light-emitting display) technology, LED (light-emitting diode) technology, or OLED (organic light-emitting diode) technology, but other display technologies are used in other embodiments. The touchscreen 112 and the display controller 156 optionally detect contact and any movement or interruption of contact using any of several currently known or future-developed touch sensing technologies, including but not limited to capacitive technology, resistive technology, infrared technology, and surface acoustic wave technology, as well as other proximity sensor arrays or other elements for determining one or more contact points with the touchscreen 112. In one embodiment, projected mutual capacitance sensing technology is used, such as that found in iPhone®, iPod Touch®, and iPad® from Apple Inc. of Cupertino, California.

[0608] The touchscreen 112 optionally has a video resolution greater than 400 dpi. In some embodiments, the touchscreen 112 has a video resolution of at least 600 dpi. In other embodiments, the touchscreen 112 has a video resolution of at least 1000 dpi. The user optionally touches the touchscreen 112 using any suitable object such as a stylus or finger. In some embodiments, the user interface is designed to function primarily with finger-based touch and gestures. In some embodiments, the device translates finger-based input into a precise pointer / cursor position or a command to perform an action desired by the user.

[0609] In some embodiments, in addition to the touchscreen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display a visual output. The touchpad is optionally a touch-sensitive surface separate from the touchscreen 112, or an extension of the touch-sensitive surface formed by the touchscreen.

[0610] Device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., a battery, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with generating, managing, and distributing power within the portable device.

[0611] Device 100 also optionally includes one or more optical sensors 164. Figure 1A shows optical sensors coupled to an optical sensor controller 158 in the I / O subsystem 106. Optical sensors 164 optionally include charge-coupled devices (CCDs) or complementary metal-oxide-semiconductor (CMOS) phototransistors. Optical sensors 164 receive light from the environment projected through one or more lenses and convert that light into data that represents an image. Together with an imaging module 143 (also referred to as a camera module), optical sensors 164 optionally capture still images or video. In some embodiments, optical sensors are located on the back of device 100, opposite the touchscreen 112 on the front of the device, to enable the touch-sensitive display as a viewfinder for acquiring still images and / or video. In some embodiments, another optical sensor is located on the front of the device to optionally obtain an image of the user for video conferencing while the user is viewing other video conference participants on the touch-sensitive display.

[0612] Device 100 also optionally includes one or more contact strength sensors 165. Figure 1A shows a contact strength sensor connected to a strength sensor controller 159 in the I / O subsystem 106. The contact strength sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, pressure-power sensors, optical force sensors, capacitive touch-sensing surfaces, or other strength sensors (e.g., sensors used to measure the force (or pressure) of contact on a touch-sensing surface). The contact strength sensor 165 receives contact strength information (e.g., pressure information or a substitute for pressure information) from the environment. In some embodiments, at least one contact strength sensor is located on or near the touch-sensing surface (e.g., touch-sensing display system 112). In some embodiments, at least one contact strength sensor is located on the back of Device 100, opposite the touchscreen 112 located on the front of Device 100.

[0613] Device 100 also optionally includes one or more proximity sensors 166. Figure 1A shows a proximity sensor 166 connected to a peripheral interface 118. Alternatively, the proximity sensor 166 is connected to an input controller 160 in the I / O subsystem 106. In some embodiments, if the multifunction device is positioned near the user's ear (for example, when the user is making a phone call), the proximity sensor is turned off and the touchscreen 112 is disabled.

[0614] Device 100 also optionally includes one or more tactile output generators 167. Figure 1A shows a tactile output generator connected to a haptic feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices, such as a speaker or other audio component, and / or electromechanical devices that convert energy into linear motion, such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component that converts an electrical signal into a tactile output on the device). The contact intensity sensor 165 receives a haptic feedback generation command from the haptic feedback module 133 and generates a tactile output on device 100 that can be sensed by the user of device 100. In some embodiments, at least one tactile output generator is located on or near a touch-sensitive surface (e.g., a touch-sensitive display system 112) and optionally generates a tactile output by moving the touch-sensitive surface vertically (e.g., inward / outward from the surface of device 100) or laterally (e.g., forward / backward in the same plane as the surface of device 100). In some embodiments, at least one tactile output generator sensor is located on the back of device 100, opposite the touch-sensitive display 112 located on the front of device 100.

[0615] Device 100 also optionally includes one or more accelerometers 168. Figure 1A shows an accelerometer 168 connected to a peripheral interface 118. Alternatively, the accelerometer 168 is optionally connected to an input controller 160 in the I / O subsystem 106. In some embodiments, information is displayed on a touch-sensitive display in portrait or landscape orientation based on an analysis of data received from one or more accelerometers. In addition to the accelerometers (one or more) 168, device 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for obtaining information about the location and orientation (e.g., portrait or landscape) of device 100.

[0616] In some embodiments, the software components stored in memory 102 include an operating system 126, a proactive module 163 (optionally including one or more application usage data tables 335, a trigger condition table 402, a trigger establishment module 163-1, and / or usage data collection module 163-2), a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Furthermore, in some embodiments, as shown in Figure 1A, memory 102 stores a device / global internal state 157. The device / global internal state 157 includes one or more of the following: If there is an application currently active, the active application status indicates which application is active; the display status indicates which applications, views, or other information occupy various areas of the touch-sensitive display 112; the sensor status includes information obtained from various sensors and input control devices 116 of the device; and positional information relating to the position and / or orientation of the device (e.g., device orientation).

[0617] An operating system 126 (for example, an embedded operating system such as Darwin®, RTXC®, LINUX®, UNIX®, OS X®, WINDOWS®, or VxWorks®) includes various software components and / or drivers for controlling and managing common system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware components and software components.

[0618] The communication module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing data received by the RF circuit 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire®, etc.) are adapted to connect to other devices directly or indirectly through a network (e.g., the Internet, Wi-Fi, etc.). In some embodiments, the external ports are multi-pin (e.g., 30-pin) connectors identical, similar to, and / or compatible with the 30-pin connector used on some embodiments of iPod devices from Apple Inc. In other embodiments, the external ports are multi-pin (e.g., 8-pin) connectors identical, similar to, and / or compatible with the 8-pin connector used on the Lightning connector from Apple Inc.

[0619] The contact / motion module 130 optionally detects contact with the touchscreen 112 and other touch-sensitive devices (e.g., touchpad or physical click wheel) (in conjunction with the display controller 156). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger being lowered), determining the intensity of contact (e.g., the force or pressure of contact, or a substitute for the force or pressure of contact), determining whether there is movement of contact and tracking movement across the touch-sensitive surface (e.g., detecting one or more events of a finger being dragged), and determining whether contact has stopped (e.g., detecting a finger being lifted or an interruption of contact). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point represented by a series of contact data optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These actions can be optionally applied to a single contact (e.g., a single finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.

[0620] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by the user (e.g., whether the user has selected or "clicked" on an affordance). In some embodiments, at least a subset of the intensity thresholds is determined according to software parameters (e.g., the intensity thresholds are not determined by activation thresholds of a particular physical actuator and can be adjusted without modifying the physical hardware of device 100). For example, the mouse "click" threshold for a trackpad or touch-sensitive display can be set to one of a range of default thresholds without modifying the hardware of the trackpad or touch-sensitive display. Furthermore, in some implementations, the user of the device is provided with software settings to adjust one or more of the set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by adjusting multiple intensity thresholds at once using a system-level click "intensity" parameter).

[0621] The contact / motion module 130 optionally detects gesture input from the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different movements, timings, and / or intensity of contact detected). Thus, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture involves detecting a finger-down event (e.g., at the icon's position) followed by a finger-lift-off event at the same (or substantially the same) location as the finger-down event. In another embodiment, detecting a finger swipe gesture on the touch-sensitive surface involves detecting a finger-down event followed by one or more finger-drag events, and then, in some embodiments, a finger-lift-off event.

[0622] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other display, including components for modifying the visual effects of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). As used herein, the term “graphics” includes, but is not limited to, any objects that can be displayed to a user, such as text, web pages, icons (including user interface objects such as soft keys), digital images, videos, and animations.

[0623] In some embodiments, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from an application or the like, as needed, along with coordinate data and other graphic characteristic data, specifying the graphics to be displayed, and then generates screen image data to be output to the display controller 156.

[0624] The haptic feedback module 133 includes various software components for generating instructions used by a tactile output generator(s) 167 to generate tactile outputs at one or more locations on the device 100 in response to user interaction with the device 100.

[0625] The text input module 134 is optionally a component of the graphics module 132 and provides a soft keyboard for entering text in various applications (e.g., the contact module 137, the email client module 140, the IM module 141, the browser module 147, and any other applications that require text input).

[0626] The GPS module 135 determines the location of the device and provides this information for use in various applications (for example, to the application of the phone 138 for use in location-based dialing, to the application of the camera 143 as image / video metadata, and to applications that provide location-based services such as weather widgets, local yellow pages widgets, and map / navigation widgets).

[0627] Application ("apps") 136 optionally includes the following modules (or sets of instructions), or subsets or supersets thereof: ● Contact module 137 (sometimes called address book or contact list), ●Telephone module 138, ●Video conferencing module 139, ● Email client module 140, ● Instant messaging (IM) module 141, ● Health Module 142, ● Camera module 143 for still images and / or video images, ●Image management module 144, ● Browser module 147, ●Calendar module 148, ● A widget module 149 that optionally includes one or more of the following: weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, other widgets obtained by the user, and user-created widgets 149-6. ● Search module 151, ● A video and music player module 152, which optionally consists of a video player module and a music player module. ●Memo Module 153, ●Map module 154 and / or ● Online video module 155.

[0628] Examples of other applications 136 that can be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, website creation applications, disk authoring applications, spreadsheet applications, JAVA®-compatible applications, encryption, digital rights management, speech recognition, a widget creator module 149-6 for creating user-created widgets, and speech duplication.

[0629] Together with the touchscreen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (stored in the contact module 137 in memory 102 or memory 370), which includes adding names(s) to the address book, deleting names(s) from the address book, associating telephone numbers(s) to names, email addresses(s) to names, addresses(s) to names, or other information, associating images to names, categorizing and sorting names, and providing telephone numbers or email addresses to initiate and / or facilitate communication by the telephone module 138, video conferencing module 139, email module 140, or IM module 141.

[0630] Together with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the telephone module 138 is optionally used to input a telephone number and a corresponding set of characters, access one or more telephone numbers in the address book 137, modify an entered telephone number, dial a corresponding telephone number, conduct a conversation, and disconnect or hang up when the conversation is complete. As described above, wireless communication optionally uses one of several communication standards, protocols, and technologies.

[0631] Together with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touchscreen 112, display controller 156, light sensor 164, light sensor controller 158, contact module 130, graphics module 132, text input module 134, contact list 137, and telephone module 138, the video conferencing module 139 includes executable commands for starting, conducting, and ending video conferences between the user and one or more other participants, according to the user's instructions.

[0632] Together with the RF circuit 108, touchscreen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the email client module 140 includes executable commands for creating, sending, receiving, and managing emails in response to user instructions. Together with the image management module 144, the email client module 140 makes it very easy to create and send emails containing still or video images captured by the camera module 143.

[0633] Together with the RF circuit 108, touchscreen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the instant messaging module 141 includes executable instructions for inputting strings corresponding to instant messages, modifying entered characters, sending corresponding instant messages (e.g., using the Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocol for telephone-based instant messaging, or using XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving instant messages, and displaying the received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments, such as those supported by MMS and / or Enhanced Messaging Service (EMS). As used herein, “instant message” refers to both telephone-based messages (e.g., messages sent using SMS or MMS) and internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0634] Together with the RF circuit 108, touchscreen 112, display controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and video and music player module 146, the health module 142 includes executable commands for creating training (e.g., with respect to time, distance, and / or calorie consumption goals), communicating with training sensors (sports devices such as a portable watch or pedometer), receiving training sensor data, calibrating sensors used to monitor training, selecting and playing music for training, and displaying, storing, and transmitting training data.

[0635] Together with the touchscreen 112, display controller 156, light sensor(s) 164, light sensor controller 158, contact module 130, graphics module 132, and image management module 144, the camera module 143 includes executable instructions for capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.

[0636] Together with the touchscreen 112, display controller 156, contact module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable commands for arranging, modifying (e.g., editing), otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still and / or video images.

[0637] Together with the RF circuit 108, touchscreen 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, the browser module 147 includes executable instructions for browsing the Internet in accordance with user instructions, including searching for, linking, receiving, and displaying web pages or parts thereof, as well as attachments and other files linked to web pages.

[0638] Together with the RF circuit 108, touchscreen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying, and storing calendars and data associated with calendars (e.g., calendar items, to-do lists, etc.) in accordance with user instructions.

[0639] Together with the RF circuit 108, touchscreen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, the widget module 149 is a mini-application that can be optionally downloaded and used by the user (e.g., weather widget 149-1, stock widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5), or a mini-application created by the user (e.g., user-created widget 149-6). In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript® file. In some embodiments, the widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., a Yahoo!® widget).

[0640] Together with the RF circuit 108, touchscreen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, and browser module 147, a widget creator module (not shown) is optionally used by the user to create widgets (for example, to convert a user-specified area of ​​a web page into a widget).

[0641] Together with the touchscreen 112, display system controller 156, contact module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions for searching for text, music, sound, images, videos, and / or other files in memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions. In some embodiments, the search module 151 further includes executable instructions for displaying a search entry portion and a prediction portion (e.g., the search entry portion 920 and prediction portion 930 detailed below in relation to Figures 9B and 6A-9C). In some embodiments, the search module 151 also, together with the proactive module 163, populates the prediction portion with affordances to suggested or predicted people, actions in an application, applications, nearby locations, and / or news articles before receiving user input in the search entry portion (as detailed below in relation to Figures 3A-9C).

[0642] Together with the touchscreen 112, display system controller 156, contact module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, and browser module 147, the video and music player module 152 includes executable instructions that allow the user to download and play recorded music or other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing video (for example, on the touchscreen 112 or on an external display connected via the external port 124). In some embodiments, the device 100 optionally includes the functionality of an MP3 player, such as an iPod® from Apple Inc.

[0643] Together with the touchscreen 112, display controller 156, contact module 130, graphics module 132, and text input module 134, the memo module 153 includes executable commands for creating and managing memos, to-do lists, etc., according to user instructions.

[0644] Together with the RF circuit 108, touchscreen 112, display system controller 156, contact module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, the map module 154 can optionally be used to receive, display, modify, and store maps and map-related data (e.g., driving instructions, data about shops and other points of interest in a particular place or nearby, and other location-based data) in accordance with user instructions.

[0645] Together with the touchscreen 112, display system controller 156, contact module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, the online video module 155 includes instructions that allow the user to access, browse, receive (e.g., by streaming and / or downloading), play (e.g., on the touchscreen or on an external display connected via external port 124), send emails containing links to specific online videos, and manage them in other ways. In some embodiments, an instant messaging module 141 is used instead of the email client module 140 to send links to specific online videos.

[0646] As shown in Figure 1A, the portable multifunction device 100 also includes a proactive module 163 for proactively identifying and surfacing relevant content (for example, surfacing user interface objects corresponding to actions within an application (e.g., UI objects for playing a playlist in a music app) on the lock screen or within the search interface). The proactive module 163 optionally includes the following modules (or sets of instructions), or subsets or supersets: ●Application Usage Table 335 ●Trigger condition table 402 ● Trigger establishment module 163-1 ●Data acquisition module used: 163-2 ● Proactive Proposal Module 163-3 ●(Voice communication) Content extraction module 163-4

[0647] Together with application 136, GPS module 135, operating system 126, I / O subsystem 106, RF circuit 108, external port 124, proximity sensor 166, audio circuit 110, accelerometer 168, speaker 111, microphone 113, and peripheral interface 118, the application usage table 335 and usage data acquisition module 163-2 receive and / or store application usage data (for example, from components of device 100 identified in Figure 1A above). In some embodiments, application usage is re...

Claims

1. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device having a touch-sensitive display, the electronic device is configured to store executable instructions. In response to a command from the user of the electronic device, an application is executed on the electronic device. While the aforementioned application is running, usage data is collected, wherein the usage data includes at least one or more actions performed by the user within the application. Based on the collected usage data, at least one trigger condition is automatically acquired without human intervention. The at least one trigger condition is associated with a specific action among the one or more actions performed by the user within the application. When it is determined that at least one of the trigger conditions is met, the user is provided with an indication that the specific action associated with the trigger condition is available. Non-temporary computer-readable storage medium.

2. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device having a touch-sensitive display, the electronic device is configured to store executable instructions. Usage data associated with the user of the electronic device, wherein the usage data causes at least one trigger condition based on the usage data to be obtained, which includes one or more actions performed by the user within the application while the application is running on the electronic device. The at least one trigger condition is associated with a specific action among the one or more actions performed by the user within the application. When it is determined that at least one of the trigger conditions is met, the user is provided with an indication that the specific action associated with the trigger condition is available. Non-temporary computer-readable storage medium.

3. The non-temporary computer-readable storage medium according to claim 1 or 2, wherein obtaining the at least one trigger condition includes transmitting the usage data from the electronic device to one or more remotely located servers and receiving the at least one trigger condition from the one or more servers.

4. Providing the indication includes displaying a user interface object on the lock screen of the touch-sensitive display that corresponds to the specific action associated with the trigger condition, according to any one of claims 1 to 3.

5. The non-temporary computer-readable storage medium according to claim 4, wherein the user interface object includes a description of the specific action associated with the trigger condition.

6. The non-temporary computer-readable storage medium according to claim 5, wherein the user interface object further includes an icon associated with the application.

7. The aforementioned executable instruction further enables the electronic device to: The user interface object is made to detect the first gesture, In response to the detection of the first gesture, The application is displayed on the touch-sensitive display. While the application is displayed, the specific action associated with the trigger condition is performed. A non-temporary computer-readable storage medium according to any one of claims 4 to 6.

8. The non-temporary computer-readable storage medium according to claim 7, wherein the first gesture is a swipe gesture on the user interface object.

9. The aforementioned executable instruction further enables the electronic device to: The user interface object is made to detect a second gesture, In response to the detection of the second gesture, and while the lock screen continues to be displayed on the touch-sensitive display, the system causes the system to perform the specific action associated with the trigger condition. A non-temporary computer-readable storage medium according to any one of claims 4 to 6.

10. The non-temporary computer-readable storage medium according to claim 9, wherein the second gesture is a single tap in a default area of ​​the user interface object.

11. The non-temporary computer-readable storage medium according to any one of claims 4 to 10, wherein the user interface object is displayed in the default center of the lock screen.

12. Providing the user with the indication that the specific action associated with the trigger condition is available includes performing the specific action, as described in claim 1 or 2.

13. The non-temporary computer-readable storage medium according to claim 4, wherein the user interface object is an icon associated with the application, and further, the user interface object is substantially displayed in the corner of the lock screen of the touch-sensitive display.

14. The aforementioned executable instruction further enables the electronic device to: The user then receives a command to unlock the electronic device. In response to receiving the command, the home screen of the electronic device is displayed on the touch-sensitive display. On the home screen, provide the user with an indication that the specific action associated with the trigger condition is available. A non-temporary computer-readable storage medium according to any one of claims 1 to 13.

15. The non-temporary computer-readable storage medium according to claim 14, wherein the home screen includes (i) a first part comprising one or more user interface pages for launching a first set of applications available on the electronic device, and (ii) a second part, displayed adjacent to the first part, for launching a second set of applications available on the electronic device, the second part being displayed on all the user interface pages comprising the first part, and further providing the indication on the home screen comprises displaying the indication on the second part.

16. The non-temporary computer-readable storage medium according to claim 15, wherein the second set of applications is different from and smaller than the first set of applications.

17. The non-temporary computer-readable storage medium according to any one of claims 1 to 16, wherein determining that at least one trigger condition is met includes determining that the electronic device is coupled with a second device different from the electronic device.

18. Determining that at least one trigger condition has been met includes determining that the electronic device has arrived at an address corresponding to the home or workplace associated with the user, according to any one of claims 1 to 17.

19. The non-temporary computer-readable storage medium according to claim 18, wherein determining that the electronic device has arrived at an address corresponding to the home or workplace associated with the user includes monitoring motion data from the accelerometer of the electronic device and determining, based on the monitored motion data, that the electronic device has not moved for more than a threshold amount of time.

20. The non-temporary computer-readable storage medium according to any one of claims 1 to 19, wherein the usage data further includes oral instructions provided by the user to the virtual assistant application while the application continues to run, and further, the at least one trigger condition is based on the oral instructions provided to the virtual assistant application.

21. The non-temporary computer-readable storage medium according to claim 20, wherein the oral instruction includes a request to create a reminder corresponding to the current state of the application, the current state corresponding to the state of the application when the oral instruction was provided.

22. The non-temporary computer-readable storage medium according to claim 21, wherein the state of the application when the oral command is provided is selected from the group consisting of a page displayed in the application when the oral command is provided, content being played in the application when the oral command is provided, a notification displayed in the application when the oral command is provided, and the active portion of the page displayed in the application when the oral command is provided.

23. The non-temporary computer-readable storage medium according to claim 21, wherein the oral instruction includes the word "this" relating to the current state of the application.

24. In one or more electronic devices, In response to a command from the user of the first electronic device, an application is executed on the first electronic device among the one or more electronic devices, The method involves automatically and without human intervention collecting usage data while the application is running, wherein the usage data includes at least one or more actions performed by the user within the application. Based on the collected usage data, at least one trigger condition is automatically established without human intervention. Associating the aforementioned at least one trigger condition with a specific action among the one or more actions performed by the user within the application, When it is determined that at least one of the trigger conditions is met, an indication is provided to the user that the specific action associated with the trigger condition is available. A method that includes this.

25. It is an electronic device, Touch-sensitive display and One or more processors, Memory for storing one or more programs, The electronic device is provided with such that when one or more programs are executed by the one or more processors, In response to a command from the user of the electronic device, an application is executed on the electronic device. While the aforementioned application is running, usage data is collected, wherein the usage data includes at least one or more actions performed by the user within the application. Based on the collected usage data, at least one trigger condition is automatically acquired without human intervention. The at least one trigger condition is associated with a specific action among the one or more actions performed by the user within the application. When it is determined that at least one of the trigger conditions is met, the user is provided with an indication that the specific action associated with the trigger condition is available. Electronic devices.

26. In an electronic device having a touch-sensitive display, In response to a command from the user of the said electronic device, an application is executed on the said electronic device, The collection of usage data while the aforementioned application is running, wherein the usage data includes at least one or more actions performed by the user within the aforementioned application. Based on the usage data collected, at least one trigger condition is automatically obtained without human intervention. Associating the aforementioned at least one trigger condition with a specific action among the one or more actions performed by the user within the application, When it is determined that at least one of the trigger conditions is met, an indication is provided to the user that the specific action associated with the trigger condition is available. A method that includes this.

27. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device touch-sensitive display, the electronic device... The touch-sensitive display detects the user's search activation gesture for the electronic device. Upon detecting the aforementioned search activation gesture, the search interface is displayed on the touch-sensitive display, and the search interface is: (i) The search entry section, (ii) A prediction section that is displayed in the search entry section before any user input is received, The prediction portion includes, (a) at least one affordance for contacting a person among several previously contacted persons, wherein the person is automatically selected from at least some of the previously contacted persons based on the current time, with respect to at least one affordance. (b) at least one affordance for performing a predicted action within an application among a plurality of applications available on the electronic device, wherein the predicted action is at least in part automatically selected based on the application usage history associated with the user of the electronic device, Popularized by one or more of the following: Non-temporary computer-readable storage medium.

28. The non-temporary computer-readable storage medium according to claim 27, wherein the person is further selected, at least in part, based on location data corresponding to the electronic device.

29. The non-temporary computer-readable storage medium according to claim 27 or 28, wherein the application usage history and contact information for the person are retrieved from the memory of the electronic device.

30. The non-temporary computer-readable storage medium according to claim 27 or 28, wherein the application usage history and contact information for the person are retrieved from a server located remotely from the electronic device.

31. The non-temporary computer-readable storage medium according to any one of claims 27 to 30, wherein the prediction portion is further populated with at least one affordance for executing a predicted application, and the predicted application is automatically selected, at least in part, based on the application usage history.

32. The non-temporary computer-readable storage medium according to any one of claims 27 to 31, wherein the prediction portion is further populated with at least one affordance of a predicted location category, and the predicted location category is automatically selected based at least in part on one or more of the current time and location data corresponding to the electronic device.

33. The aforementioned executable instruction further enables the electronic device to: To detect user input for scrolling the prediction portion, Upon detecting the user input for scrolling the prediction portion, the prediction portion is scrolled according to the input. In response to the scrolling, at least one affordance of the predicted news article is made visible in the predicted portion. A non-temporary computer-readable storage medium according to any one of claims 27 to 32.

34. The non-temporary computer-readable storage medium according to claim 33, wherein at least some of the predicted news articles are automatically selected based on location data corresponding to the electronic device.

35. The aforementioned executable instruction further enables the electronic device to: To detect the selection of at least one affordance for performing the predicted action within the application, Upon detecting the aforementioned selection, the application is displayed on the touch-sensitive display, and the predicted action is executed within the application. A non-temporary computer-readable storage medium according to any one of claims 27 to 34.

36. The aforementioned executable instruction further enables the electronic device to: To detect the selection of at least one affordance for contacting the person, Upon detecting the aforementioned selection, the system will use the aforementioned contact information for the person to contact them. A non-temporary computer-readable storage medium according to claim 29 or 30.

37. The aforementioned executable instruction further enables the electronic device to: To detect the selection of at least one affordance for executing the predicted application, In response to detecting the aforementioned selection, the predicted application is displayed on the touch-sensitive display. The non-temporary computer-readable storage medium according to claim 31.

38. The aforementioned executable instruction further enables the electronic device to: To detect the selection of at least one affordance of the predicted location category, In response to detecting the aforementioned selection, It receives data corresponding to at least one nearby location. The received data corresponding to at least one nearby location is displayed on the touch-sensitive display. The non-temporary computer-readable storage medium according to claim 32.

39. The aforementioned executable instruction further enables the electronic device to: To detect the selection of at least one affordance in the predicted news article, In response to detecting the aforementioned selection, the predicted news article is displayed on the touch-sensitive display. The non-temporary computer-readable storage medium according to claim 33.

40. The non-temporary computer-readable storage medium according to any one of claims 27 to 39, wherein the search activation gesture is available from at least two different user interfaces, and further, the first of the at least two different user interfaces corresponds to displaying a corresponding home screen page from a set of home screen pages on the touch-sensitive display.

41. If the corresponding home screen page is the first home screen page in a series of home screen pages, the search activation gesture includes one of the following: (i) a gesture that moves substantially downward to the user of the electronic device, or (ii) a series of gestures that move substantially from left to right to the user and substantially perpendicular to the downward direction, according to claim 40.

42. If the corresponding home screen page is the second home screen page of the set of home screen pages, the search activation gesture includes the continuous gesture substantially moving downward for the user of the electronic device, according to claim 41, the non-temporary computer-readable storage medium.

43. The non-temporary computer-readable storage medium according to claim 40, wherein the second user interface of the at least two different user interfaces corresponds to displaying an application switching interface on the touch-sensitive display.

44. The non-temporary computer-readable storage medium according to claim 43, wherein the search activation gesture includes contact with the default search activation portion of the application switching interface on the touch-sensitive display.

45. It is an electronic device, Touch-sensitive display and One or more processors, Memory for storing one or more programs, The electronic device is provided with such that when one or more programs are executed by the one or more processors, The touch-sensitive display detects the user's search activation gesture for the electronic device. Upon detecting the aforementioned search activation gesture, the search interface is displayed on the touch-sensitive display, and the search interface is: (i) The search entry section, (ii) A prediction section that is displayed in the search entry section before any user input is received, The prediction portion includes, (a) at least one affordance for contacting a person among several previously contacted persons, wherein the person is automatically selected from at least some of the previously contacted persons based on the current time, with respect to at least one affordance. (b) at least one affordance for performing a predicted action within an application among a plurality of applications available on the electronic device, wherein the predicted action is at least in part automatically selected based on the application usage history associated with the user of the electronic device, Popularized by one or more of the following: Electronic devices.

46. In an electronic device having a touch-sensitive display, To detect the user's search activation gesture on the touch-sensitive display of the electronic device, In response to detecting the aforementioned search activation gesture, the search interface is displayed on the touch-sensitive display. The search interface includes, (i) The search entry section, (ii) A prediction section that is displayed in the search entry section before any user input is received, The prediction portion includes, (a) at least one affordance for contacting a person among several previously contacted persons, wherein the person is automatically selected from at least some of the previously contacted persons based on the current time, with respect to at least one affordance. (b) at least one affordance for performing a predicted action within an application among a plurality of applications available on the electronic device, wherein the predicted action is at least in part automatically selected based on the application usage history associated with the user of the electronic device, A method that is popularized by one or more of the following.

47. It is an electronic device, A touch-sensitive display unit configured to display a user interface and receive user contact, A processing unit coupled to the aforementioned touch-sensitive display unit, The processing unit is equipped with, In response to a command from the user of the electronic device, an application is executed on the electronic device. While the application is running, usage data is collected, the usage data includes at least one or more actions performed by the user within the application. Based on the collected usage data, at least one trigger condition is automatically obtained without human intervention. Associate the aforementioned at least one trigger condition with a specific action among the one or more actions performed by the user within the application, When it is determined that at least one of the trigger conditions is met, the user is provided with an indication that the specific action associated with the trigger condition is available. An electronic device configured in such a way.

48. The electronic device according to claim 47, wherein obtaining the at least one trigger condition includes transmitting the usage data to one or more servers located remotely from the electronic device, and receiving the at least one trigger condition from the one or more servers.

49. The electronic device according to claim 47 or 48, wherein providing the indication includes displaying a user interface object on the lock screen of the touch-sensitive display unit that corresponds to the specific action associated with the trigger condition.

50. The electronic device according to claim 49, wherein the user interface object includes a description of the specific action associated with the trigger condition.

51. The electronic device according to claim 50, wherein the user interface object further includes an icon associated with the application.

52. The aforementioned processing unit is The first gesture is detected in the user interface object, In response to the detection of the first gesture, (i) Display the application on the touch-sensitive display unit, (ii) While the application is displayed, perform the specific action associated with the trigger condition, The electronic device according to any one of claims 49 to 51, further configured as follows.

53. The electronic device according to claim 52, wherein the first gesture is a swipe gesture on the user interface object.

54. The aforementioned processing unit is A second gesture is detected in the user interface object. In response to detecting the second gesture, and while the lock screen continues to be displayed on the touch-sensitive display unit, the specific action associated with the trigger condition is performed. The electronic device according to any one of claims 49 to 52, further configured as follows.

55. The electronic device according to claim 54, wherein the second gesture is a single tap in a default area of ​​the user interface object.

56. The electronic device according to any one of claims 49 to 55, wherein the user interface object is displayed in the default center of the lock screen.

57. The electronic device according to claim 47, wherein providing the user with the indication that the specific action associated with the trigger condition is available includes performing the specific action.

58. The electronic device according to claim 49, wherein the user interface object is an icon associated with the application, and the user interface object is substantially displayed in the corner of the lock screen of the touch-sensitive display unit.

59. The aforementioned processing unit is Upon receiving a command from the user to unlock the electronic device, In response to receiving the command, the home screen of the electronic device is displayed on the touch-sensitive display unit. On the home screen, provide the user with an indication that the specific action associated with the trigger condition is available. The electronic device according to any one of claims 47 to 58, further configured as follows.

60. The electronic device according to claim 59, wherein the home screen includes (i) a first part comprising one or more user interface pages for launching a first set of applications available on the electronic device, and (ii) a second part, displayed adjacent to the first part, for launching a second set of applications available on the electronic device, the second part being displayed on all the user interface pages included in the first part, and providing the indication on the home screen comprises displaying the indication on the second part.

61. The electronic device according to claim 60, wherein the second set of applications is different from and smaller than the first set of applications.

62. The electronic device according to any one of claims 47 to 61, wherein determining that at least one trigger condition is met includes determining that the electronic device is coupled with a second device different from the electronic device.

63. The electronic device according to any one of claims 47 to 62, wherein determining that at least one trigger condition has been met includes determining that the electronic device has arrived at an address corresponding to the home or workplace associated with the user.

64. The electronic device according to claim 63, wherein determining that the electronic device has arrived at an address corresponding to the home or workplace associated with the user includes monitoring motion data from the accelerometer of the electronic device and determining, based on the monitored motion data, that the electronic device has not moved for more than a threshold amount of time.

65. The electronic device according to any one of claims 47 to 64, wherein the usage data further includes oral commands provided by the user to the virtual assistant application while the application continues to run, and further, the at least one trigger condition is based on the oral commands provided to the virtual assistant application.

66. The electronic device according to claim 65, wherein the oral command includes a request to create a reminder corresponding to the current state of the application, the current state corresponding to the state of the application when the oral command was provided.

67. The electronic device according to claim 66, wherein the state of the application when the verbal command is provided is selected from the group consisting of a page displayed in the application when the verbal command is provided, content being played in the application when the verbal command is provided, a notification displayed in the application when the verbal command is provided, and the active portion of the page displayed in the application when the verbal command is provided.

68. The electronic device according to claim 66, wherein the oral instruction includes the word "this" relating to the current state of the application.

69. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device having a touch-sensing surface and a display, the electronic device... At least a portion of a voice communication, the portion of which includes speech provided by a remote user of a remote device different from the user of the electronic device, Content items are extracted, at least partially, based on the speech provided by the remote user of the remote device. Determine whether the content item is currently available on the electronic device. In accordance with the determination that the content item is not currently available on the electronic device, Identify the application associated with the aforementioned content item, The selectable descriptions for the content items are displayed on the display. In response to detecting the selection of the selectable description, the content item is stored for presentation in the identified application. Non-temporary computer-readable storage medium.

70. The non-temporary computer-readable storage medium according to claim 69, wherein the content item is a new event.

71. The non-temporary computer-readable storage medium according to claim 69, wherein the content item is a new event detail of an event currently associated with a calendar application on the electronic device.

72. The non-temporary computer-readable storage medium according to claim 69, wherein the content item is a new contact.

73. The non-temporary computer-readable storage medium according to claim 69, wherein the content item is new contact information for an existing contact associated with a telephone application on the electronic device.

74. The non-temporary computer-readable storage medium according to any one of claims 69 to 73, wherein the voice communication is a live call.

75. The non-temporary computer-readable storage medium according to any one of claims 69 to 73, wherein the voice communication is a live FaceTime call.

76. The non-temporary computer-readable storage medium according to any one of claims 69 to 73, wherein the voice communication is a pre-recorded voicemail.

77. The non-temporary computer-readable storage medium according to any one of claims 69 to 76, wherein displaying the selectable descriptions includes displaying the selectable descriptions within the user interface, including recent calls made using a telephone application.

78. The non-temporary computer-readable storage medium according to claim 77, wherein the selectable description is displayed together with an indication that the content item is associated with the voice communication.

79. The non-temporary computer-readable storage medium according to claim 77, wherein detecting the selection includes receiving the selection while the user interface, including recent calls, is displayed.

80. When the aforementioned executable instruction is executed by the electronic device, the electronic device further: In addition to displaying the selectable description of the content item, the user of the electronic device is provided with feedback that the content item has been detected. A non-temporary computer-readable storage medium according to any one of claims 69 to 79.

81. The non-temporary computer-readable storage medium according to claim 80, wherein providing feedback includes transmitting information regarding the detection of the content item to a different electronic device located near the electronic device.

82. When the aforementioned executable instruction is executed by the electronic device, the electronic device further: It is determined that the aforementioned voice communication includes information regarding a first physical location. To detect input, Upon detecting the aforementioned input, an application capable of receiving location data is opened, and the application is populated with information regarding the first physical location. A non-temporary computer-readable storage medium according to any one of claims 69 to 81.

83. The non-temporary computer-readable storage medium according to claim 82, wherein the application is a map application, and populating the map application with information relating to a first physical location includes populating the map displayed within the map application with a location identifier corresponding to the first physical location.

84. When the aforementioned executable instruction is executed by the electronic device, the electronic device further: It is determined that the aforementioned voice communication includes information regarding a first physical location. To detect input, In response to detecting the aforementioned input, the search interface is populated with information regarding the first physical location. A non-temporary computer-readable storage medium according to any one of claims 69 to 81.

85. The non-temporary computer-readable storage medium according to any one of claims 69 to 84, wherein the extraction of the content items includes analyzing the portion of the audio communication for the detection of a predetermined type of content, the analysis being performed while the audio communication is output through an audio system communicating with the electronic device.

86. Analyzing the aforementioned voice communication means Converting the speech provided by the remote user of the remote device into text, To determine whether the text contains one or more predefined keywords, a natural language processing algorithm is applied to the text. In accordance with the determination that the text contains corresponding predefined keywords, it is determined that the voice communication contains speech describing the content item, A non-temporary computer-readable storage medium according to claim 85, including the following:

87. The non-temporary computer-readable storage medium according to any one of claims 69 to 86, wherein receiving at least the portion of the voice communication includes receiving an indication from the user of the electronic device that the portion of the voice communication should be analyzed.

88. The non-temporary computer-readable storage medium according to claim 87, wherein the indication corresponds to the selection of a hardware button.

89. The non-temporary computer-readable storage medium according to claim 87, wherein the indication corresponds to a command from the user of the electronic device, including the words "hey Siri".

90. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: A second part of the voice communication, the second part comprising speech provided by the remote user of the remote device and speech provided by the user of the electronic device, the second part being received A second content item is extracted, at least in part, based on the speech provided by the remote user of the remote device and the speech provided by the user of the electronic device. In accordance with the determination that the second content item is not currently available on the electronic device, Identify the second application associated with the second content item, The second selectable description of the second content item is displayed on the display. In response to detecting the selection of the second selectable description, the second content item is stored for presentation in the identified second application. A non-temporary computer-readable storage medium according to any one of claims 69 to 89.

91. A non-temporary computer-readable storage medium according to claim 90, wherein the selectable description and the second selectable description, including recent calls made using a telephone application, are displayed within the user interface.

92. In an electronic device having one or more processors, memory, a touch-sensing surface, and a display, Receiving at least a portion of a voice communication, wherein the portion of the voice communication includes speech provided by a remote user of a remote device different from the user of the electronic device. Extracting content items based on the speech provided by the remote user of the remote device, Determining whether the content item is currently available on the electronic device, In accordance with the determination that the content item is not currently available on the electronic device, Identifying the application associated with the aforementioned content item, Displaying selectable descriptions of the content items on the display, In response to detecting the selection of the selectable description, the content item is stored for presentation in the identified application. A method that includes this.

93. The method according to claim 92, wherein the content item is a new event.

94. The method according to claim 92, wherein the content item is a new event detail of an event currently associated with a calendar application on the electronic device.

95. The method according to claim 92, wherein the content item is a new contact.

96. The method according to claim 92, wherein the content item is new contact information for an existing contact associated with a telephone application on the electronic device.

97. The method according to any one of claims 92 to 96, wherein the voice communication is a live call.

98. The method according to any one of claims 92 to 96, wherein the voice communication is a live FaceTime call.

99. The method according to any one of claims 92 to 96, wherein the voice communication is a pre-recorded voicemail.

100. The method according to any one of claims 92 to 99, wherein displaying the selectable descriptions includes displaying the selectable descriptions within the user interface, including recent calls made using the telephone application.

101. The method according to claim 100, wherein the selectable description is displayed together with an indication that the content item is associated with the voice communication.

102. The method according to claim 100, wherein detecting the selection includes receiving the selection while the user interface, including recent calls, is displayed.

103. The method according to any one of claims 92 to 102, further comprising providing feedback to the user of the electronic device that the content item has been detected, in conjunction with displaying the selectable description of the content item.

104. The method according to claim 103, wherein providing feedback includes transmitting information regarding the detection of the content item to a different electronic device located near the electronic device.

105. Determining that the aforementioned voice communication includes information relating to a first physical location, Detecting input and Upon detecting the aforementioned input, an application capable of receiving location data is opened, and the application is populated with the information regarding the first physical location. The method according to any one of claims 92 to 104, further comprising:

106. The method according to claim 105, wherein the application is a map application, and populating the map application with information relating to a first physical location includes populating the map displayed within the map application with a location identifier corresponding to the first physical location.

107. Determining that the aforementioned voice communication includes information relating to a first physical location, Detecting input and In response to detecting the aforementioned input, the search interface is populated with information regarding the first physical location, The method according to any one of claims 92 to 104, further comprising:

108. The method according to any one of claims 92 to 107, wherein the extraction of the content items includes analyzing the portion of the audio communication for the detection of a predetermined type of content, the analysis being performed while the audio communication is being output through an audio system communicating with the electronic device.

109. Analyzing the aforementioned voice communication means Converting the speech provided by the remote user of the remote device into text, To determine whether the text contains one or more predefined keywords, a natural language processing algorithm is applied to the text. In accordance with the determination that the text contains corresponding predefined keywords, it is determined that the voice communication contains speech describing the content item, The method according to claim 108, including the method described in claim 108.

110. The method according to any one of claims 92 to 109, wherein receiving at least the portion of the voice communication includes receiving an indication from the user of the electronic device that the portion of the voice communication should be analyzed.

111. The method according to claim 110, wherein the indication corresponds to the selection of a hardware button.

112. The method according to claim 110, wherein the indication corresponds to a command from the user of the electronic device that includes the words "hey Siri".

113. Receiving a second portion of the aforementioned voice communication, wherein the second portion includes speech provided by the remote user of the remote device and speech provided by the user of the electronic device. Extracting a second content item based at least in part on the speech provided by the remote user of the remote device and the speech provided by the user of the electronic device, In accordance with the determination that the second content item is not currently available on the electronic device, Identifying the second application associated with the second content item, Displaying a second selectable description of the second content item on the display, In response to detecting the selection of the second selectable description, the second content item is stored for presentation in the identified second application, The method according to any one of claims 92 to 112, further comprising:

114. The method according to claim 113, wherein the selectable description and the second selectable description, including recent calls made using a telephone application, are displayed within the user interface.

115. Touch-sensitive surface and The display and One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more instructions for performing the method described in any one of claims 92 to 114, Electronic devices.

116. A graphical user interface on an electronic device having memory, a touch-sensitive surface, a display, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method of any one of claims 92 to 114.

117. An electronic device having a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 92 to 114.

118. An information processing apparatus for use in an electronic device including a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 92 to 114.

119. Touch-sensitive surface and The display and One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more instructions for performing the method described in any one of claims 92 to 114, Electronic devices.

120. A graphical user interface on an electronic device having memory, a touch-sensitive surface, a display, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method of any one of claims 92 to 114.

121. An electronic device having a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 92 to 114.

122. An information processing apparatus for use in an electronic device including a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 92 to 114.

123. It is an electronic device, A touch-sensitive surface unit configured to receive user contact, A display unit configured to display a user interface, The system comprises a processing unit coupled with the touch sensing surface unit and the display unit, The aforementioned processing unit is At least a portion of a voice communication, the portion of which includes speech provided by a remote user of a remote device different from the user of the electronic device, is received. Content items are extracted, at least partially, based on the speech provided by the remote user of the remote device. Determine whether the content item is currently available on the electronic device. In accordance with the determination that the content item is not currently available on the electronic device, Identify the application associated with the aforementioned content item, The selectable descriptions for the content items are displayed on the display unit. In response to detecting the selection of the available description, the content item is stored for presentation in the identified application. Non-temporary computer-readable storage medium.

124. The electronic device according to claim 123, wherein the content item is a new event.

125. The electronic device according to claim 123, wherein the content item is a new event detail of an event currently associated with a calendar application on the electronic device.

126. The electronic device according to claim 123, wherein the aforementioned content item is a new contact.

127. The electronic device according to claim 123, wherein the content item is new contact information for an existing contact associated with a telephone application on the electronic device.

128. The electronic device according to any one of claims 123 to 127, wherein the voice communication is a live call.

129. The electronic device according to any one of claims 123 to 127, wherein the voice communication is a live FaceTime call.

130. The electronic device according to any one of claims 123 to 127, wherein the voice communication is a pre-recorded voicemail.

131. The electronic device according to any one of claims 123 to 130, wherein displaying the selectable descriptions includes displaying the selectable descriptions within the user interface, including recent calls made using a telephone application.

132. The electronic device according to claim 131, wherein the selectable description is displayed together with an indication that the content item is associated with the voice communication.

133. The electronic device according to claim 131, wherein detecting the selection includes receiving the selection while the user interface, including recent calls, is displayed.

134. The aforementioned processing unit is The electronic device according to any one of claims 123 to 133, further configured to provide feedback to the user of the electronic device that the content item has been detected, in conjunction with displaying the selectable description of the content item.

135. The electronic device according to claim 134, wherein providing feedback includes transmitting information regarding the detection of the content item to a different electronic device located near the electronic device.

136. The aforementioned processing unit is It is determined that the voice communication includes information relating to a first physical location, Detects input, Upon detecting the aforementioned input, an application capable of receiving location data is opened, and the application is populated with information regarding the first physical location. The electronic device according to any one of claims 123 to 135, further configured as follows.

137. The electronic device according to claim 136, wherein the application is a map application, and populating the map application with information relating to the first physical location includes populating the map displayed in the map application with a location identifier corresponding to the first physical location.

138. The aforementioned processing unit is It is determined that the voice communication includes information relating to a first physical location, Detects input, In response to detecting the aforementioned input, the search interface is populated with information regarding the first physical location. The electronic device according to any one of claims 123 to 135, further configured as follows.

139. The electronic device according to any one of claims 123 to 138, wherein the extraction of the content items includes analyzing the portion of the audio communication for the detection of a predetermined type of content, the analysis being performed while the audio communication is output through an audio system communicating with the electronic device.

140. Analyzing the aforementioned voice communication means Converting the speech provided by the remote user of the remote device into text, To determine whether the text contains one or more predefined keywords, a natural language processing algorithm is applied to the text. In accordance with the determination that the text contains corresponding predefined keywords, it is determined that the voice communication contains speech describing the content item, The electronic device according to claim 139, including the electronic device according to claim 139.

141. The electronic device according to any one of claims 123 to 140, wherein receiving at least the portion of the voice communication includes receiving an indication from the user of the electronic device that the portion of the voice communication should be analyzed.

142. The electronic device according to claim 141, wherein the indication corresponds to the selection of a hardware button.

143. The electronic device according to claim 141, wherein the indication corresponds to a command from the user of the electronic device that includes the words "hey Siri".

144. The aforementioned processing unit is A second part of the voice communication, the second part receiving a speech provided by the remote user of the remote device and a speech provided by the user of the electronic device, A second content item is extracted, at least in part, based on the speech provided by the remote user of the remote device and the speech provided by the user of the electronic device. In accordance with the determination that the second content item is not currently available on the electronic device, Identify the second application associated with the second content item, The second selectable description of the second content item is displayed on the display unit. In response to detecting the selection of the second selectable description, the second content item is stored for presentation in the identified second application. The electronic device according to any one of claims 123 to 143, further configured as follows.

145. The electronic device according to claim 144, wherein the selectable description and the second selectable description, including recent calls made using a telephone application, are displayed within the user interface.

146. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device having a touch-sensing surface and a display, the electronic device... At least a portion of a voice communication, the portion of which includes speech provided by a remote user of a remote device different from the user of the electronic device, The voice communication is determined to include speech that identifies a physical location. In response to determining that the voice communication includes speech that identifies the physical location, an indication is provided that information regarding the physical location has been detected. Input is detected via the touch sensing surface. In response to detecting the aforementioned input, Open an application that accepts geographic location data, The aforementioned application is populated with information about the physical location. Non-temporary computer-readable storage medium.

147. The non-temporary computer-readable storage medium according to claim 146, wherein the voice communication is a live call.

148. The non-temporary computer-readable storage medium according to claim 146, wherein the voice communication is a live FaceTime call.

149. The non-temporary computer-readable storage medium according to claim 146, wherein the voice communication is a pre-recorded voicemail.

150. Providing the indication includes displaying a selectable description of the physical location, including a recent call made using a telephone application, within the user interface, according to any one of claims 146 to 149.

151. The non-temporary computer-readable storage medium according to claim 150, wherein the selectable description indicates that the content item is associated with the voice communication.

152. The non-temporary computer-readable storage medium according to claim 150 or 151, wherein detecting the input includes detecting the input on the selectable description while the user interface, including recent calls, is displayed.

153. A non-temporary computer-readable storage medium according to any one of claims 146 to 152, wherein providing the indication includes providing haptic feedback to the user of the electronic device.

154. A non-temporary computer-readable storage medium according to any one of claims 146 to 153, wherein providing the indication includes transmitting information relating to the physical location to a different electronic device located in the vicinity of the electronic device.

155. Determining that the voice communication includes speech describing the physical location comprises analyzing the portion of the voice communication to detect information relating to the physical location, the analysis being performed while the voice communication is being output via an audio system communicating with the electronic device, according to any one of claims 146 to 154.

156. A non-temporary computer-readable storage medium according to any one of claims 146 to 155, wherein receiving at least the portion of the voice communication includes receiving a command from the user of the electronic device that the portion of the voice communication should be analyzed.

157. The instruction corresponds to the selection of a hardware button in the non-temporary computer-readable storage medium according to claim 156.

158. The non-temporary computer-readable storage medium according to claim 156, wherein the instruction corresponds to a command from the user of the electronic device, which includes the words "hey Siri".

159. In an electronic device having one or more processors, memory, a touch-sensing surface, and a display, Receiving at least a portion of a voice communication, wherein the portion of the voice communication includes speech provided by a remote user of a remote device different from the user of the electronic device. Determining that the aforementioned voice communication includes speech that identifies a physical location, In response to determining that the voice communication includes speech that identifies the physical location, an indication is provided that information regarding the physical location has been detected. To detect input via the aforementioned touch sensing surface, In response to detecting the aforementioned input, Opening an application that accepts geographic location data, The application is made popular with information about the physical location, A method that includes this.

160. The method according to claim 159, wherein the voice communication is a live call.

161. The method according to claim 159, wherein the voice communication is a live FaceTime call.

162. The method according to claim 159, wherein the voice communication is a pre-recorded voicemail.

163. The method according to any one of claims 159 to 162, wherein providing the indication includes displaying a selectable description of the physical location, including a recent call made using a telephone application, within the user interface.

164. The method according to claim 163, wherein the selectable description indicates that the content item is associated with the voice communication.

165. The method according to any one of claims 163 to 164, wherein detecting the input includes detecting the input in the selectable description while the user interface, including recent calls, is displayed.

166. The method according to any one of claims 159 to 165, wherein providing the indication includes providing haptic feedback to the user of the electronic device.

167. The method according to any one of claims 159 to 166, wherein providing the indication includes transmitting information relating to the physical location to a different electronic device located near the electronic device.

168. The method according to any one of claims 159 to 167, wherein determining that the voice communication includes speech describing the physical location includes analyzing the portion of the voice communication to detect information relating to the physical location, the analysis is performed while the voice communication is output through an audio system communicating with the electronic device.

169. The method according to any one of claims 159 to 168, wherein receiving at least the portion of the voice communication includes receiving a command from the user of the electronic device that the portion of the voice communication should be analyzed.

170. The method according to claim 169, wherein the instruction corresponds to the selection of a hardware button.

171. The method according to claim 169, wherein the instruction corresponds to a command from the user of the electronic device that includes the words "hey Siri".

172. Touch-sensitive surface and The display and One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises, wherein one or more programs include instructions for performing the method according to any one of claims 159 to 171, Electronic devices.

173. A graphical user interface on an electronic device having memory, a touch-sensitive surface, a display, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method described in any one of claims 159 to 171.

174. An electronic device having a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 159 to 171.

175. An information processing apparatus for use in an electronic device including a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 159 to 171.

176. It is an electronic device, A touch-sensitive surface unit configured to receive user contact, A display unit configured to display a user interface, The system comprises a processing unit coupled with the touch sensing surface unit and the display unit, The aforementioned processing unit is At least a portion of a voice communication, the portion of which includes speech provided by a remote user of a remote device different from the user of the electronic device, is received. It is determined that the aforementioned voice communication includes speech that identifies a physical location, In response to determining that the voice communication includes speech that identifies the physical location, an indication is provided that information regarding the physical location has been detected. The input is detected via the touch sensing surface unit, In response to detecting the aforementioned input, Open an application that accepts geographic location data, The aforementioned application is populated with information about the physical location. An electronic device configured in such a way.

177. The electronic device according to claim 176, wherein the voice communication is a live call.

178. The electronic device according to claim 176, wherein the voice communication is a live FaceTime call.

179. The electronic device according to claim 176, wherein the voice communication is a pre-recorded voicemail.

180. The electronic device according to any one of claims 176 to 179, wherein providing the indication includes displaying a selectable description of the physical location, including a recent call made using a telephone application, within the user interface.

181. The electronic device according to claim 180, wherein the selectable description indicates that the content item is associated with the voice communication.

182. The electronic device according to claim 180 or 181, wherein detecting the input includes detecting the input in the selectable description while the user interface, including recent calls, is displayed.

183. The electronic device according to any one of claims 176 to 182, wherein providing the indication includes providing haptic feedback to the user of the electronic device.

184. The electronic device according to any one of claims 176 to 183, wherein providing the indication includes transmitting information relating to the physical location to a different electronic device located in the vicinity of the electronic device.

185. The electronic device according to any one of claims 176 to 184, wherein determining that the voice communication includes speech describing the physical location includes analyzing the portion of the voice communication to detect information relating to the physical location, the analysis being performed while the voice communication is output through an audio system communicating with the electronic device.

186. The electronic device according to any one of claims 176 to 185, wherein receiving at least the portion of the voice communication includes receiving a command from the user of the electronic device that the portion of the voice communication should be analyzed.

187. The instruction corresponds to the selection of a hardware button, as described in claim 186.

188. The electronic device according to claim 186, wherein the instruction corresponds to a command from the user of the electronic device that includes the words "hey Siri".

189. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device having a display and a touch-sensing surface, the electronic device... In the messaging application on the aforementioned display, a text input field and a conversation record are presented. While the messaging application is displayed on the display, the electronic device determines that the following possible inputs from the user are information relating to a physical location. The text input field and the content associated with the conversation record are analyzed, and a proposed physical location is determined based on at least a portion of the analyzed content. Within the messaging application on the display, a selectable user interface element for identifying the proposed physical location is presented. The selection of the aforementioned selectable user interface element is received, Upon receiving the aforementioned selection, the proposed representation of the physical location is presented in the text input field. Non-temporary computer-readable storage medium.

190. The non-temporary computer-readable storage medium according to claim 189, wherein the messaging application includes a virtual keyboard, and the selectable user interface elements are displayed in a suggested portion adjacent to and above the virtual keyboard.

191. Determining that the following possible inputs from the user of the electronic device are information relating to a physical location includes processing the text input field and the content associated with the conversation record to detect that the conversation transcript includes a question relating to the user's current location, according to claim 189 or 190.

192. The non-temporary computer-readable storage medium according to claim 191, wherein processing the content includes applying a natural language processing algorithm to detect one or more predefined keywords that form the question.

193. The non-temporary computer-readable storage medium according to claim 191 or 192, wherein the aforementioned question is contained in a message received from a second user different from the aforementioned user.

194. Determining that the following possible inputs from the user of the electronic device are information relating to a physical location includes monitoring typing input received from the user in the text input portion of the messaging application, according to any one of claims 189 to 193.

195. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: A non-temporary computer-readable storage medium according to any one of claims 189 to 194, wherein the presentation of the selectable user interface element is stopped in accordance with the determination that the user is typing and has not selected the selectable user interface element.

196. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: A non-temporary computer-readable storage medium according to any one of claims 189 to 194, wherein the presentation of the selectable user interface element is stopped in accordance with the determination that the user has provided additional input indicating that the user does not select the selectable user interface element.

197. The non-temporary computer-readable storage medium according to any one of claims 189 to 196, wherein the proposed representation of the physical location includes information that identifies the current geographic location of the electronic device.

198. The non-temporary computer-readable storage medium according to any one of claims 189 to 197, wherein the expression for the proposed physical location is an address.

199. The non-temporary computer-readable storage medium according to any one of claims 189 to 197, wherein the representation of the proposed physical location is a map object including an identifier relating to the proposed physical location.

200. The non-temporary computer-readable storage medium according to any one of claims 189 to 199, wherein the proposed physical location corresponds to a location recently viewed by the user in an application other than the messaging application.

201. The non-temporary computer-readable storage medium according to any one of claims 189 to 200, wherein the messaging application is an email application.

202. The non-temporary computer-readable storage medium according to any one of claims 189 to 200, wherein the messaging application is a text messaging application.

203. In an electronic device having one or more processors, memory, a touch-sensing surface, and a display, In the messaging application on the aforementioned display, a text input field and a conversation log are presented, While the messaging application is displayed on the display, the electronic device determines that the following possible inputs from the user are information relating to a physical location, The text input field and the content associated with the conversation record are analyzed to determine a proposed physical location based on at least a portion of the analyzed content. The message application on the display presents a selectable user interface element that identifies the proposed physical location. Receiving the selection of the aforementioned selectable user interface element, Upon receiving the aforementioned selection, the proposed representation of the physical location will be displayed in the text input field. A method that includes this.

204. The method according to claim 203, wherein the messaging application includes a virtual keyboard, and the selectable user interface elements are displayed in a suggestion portion adjacent to and above the virtual keyboard.

205. The method according to claim 203 or 204, wherein determining that the following possible input from the user of the electronic device is information relating to a physical location includes processing the text input field and the content associated with the conversation record in order to detect that the conversation transcript includes a question relating to the user's current location.

206. The method according to claim 205, wherein processing the content includes applying a natural language processing algorithm to detect one or more predefined keywords that form the question.

207. The method according to claim 205 or 206, wherein the aforementioned question is included in a message received from a second user different from the aforementioned user.

208. The method according to any one of claims 203 to 207, wherein determining that the following possible inputs from the user of the electronic device are information relating to a physical location includes monitoring typing input received from the user in the text input portion of the messaging application.

209. The method according to any one of claims 203 to 208, further comprising stopping the presentation of the selectable user interface element in accordance with the determination that the user is typing and has not selected the selectable user interface element.

210. The method according to any one of claims 203 to 209, further comprising stopping the presentation of the selectable user interface element in accordance with the determination that the user has provided additional input indicating that the user does not select the selectable user interface element.

211. The method according to any one of claims 203 to 210, wherein the proposed representation of the physical location includes information that identifies the current geographic location of the electronic device.

212. The method according to any one of claims 203 to 210, wherein the expression for the proposed physical location is an address.

213. The method according to any one of claims 203 to 210, wherein the representation of the proposed physical location is a map object including an identifier relating to the proposed physical location.

214. The method according to any one of claims 203 to 213, wherein the proposed physical location corresponds to a location recently viewed by the user in an application other than the messaging application.

215. The method according to any one of claims 203 to 214, wherein the messaging application is an email application.

216. The method according to any one of claims 203 to 214, wherein the messaging application is a text messaging application.

217. Touch-sensitive surface and The display and One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises, and the one or more programs include instructions for performing the method according to any one of claims 203 to 216, Electronic devices.

218. A graphical user interface on an electronic device having memory, a touch-sensitive surface, a display, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method described in any one of claims 203 to 216.

219. An electronic device having a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 203 to 216.

220. An information processing apparatus for use in an electronic device including a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 203 to 216.

221. It is an electronic device, A touch-sensitive surface unit configured to receive user contact, A display unit configured to display a user interface, The system comprises a processing unit coupled with the touch sensing surface unit and the display unit, The aforementioned processing unit is In the messaging application on the aforementioned display, a text input field and a conversation record are presented. While the messaging application is displayed on the display, the system determines that the following possible inputs from the user of the electronic device are information relating to a physical location. The text input field and the content associated with the conversation record are analyzed, and a proposed physical location is determined based on at least a portion of the analyzed content. Within the messaging application on the display, selectable user interface elements for identifying the proposed physical location are presented. Upon receiving the selection of the aforementioned selectable user interface element, Upon receiving the aforementioned selection, the proposed representation of the physical location is presented in the text input field. An electronic device configured in such a way.

222. The electronic device according to claim 221, wherein the messaging application includes a virtual keyboard, and the selectable user interface elements are displayed in a suggestion portion adjacent to and above the virtual keyboard.

223. The electronic device according to claim 221 or 222, wherein determining that the following possible input from the user of the electronic device is information relating to a physical location includes processing the text input field and the content associated with the conversation record in order to detect that the conversation transcript includes a question relating to the user's current location.

224. The electronic device according to claim 223, wherein processing the content includes applying a natural language processing algorithm to detect one or more predefined keywords that form the question.

225. The electronic device according to claim 223 or 224, wherein the aforementioned question is included in a message received from a second user different from the aforementioned user.

226. The electronic device according to any one of claims 221 to 225, wherein determining that the following possible inputs from the user of the electronic device are information relating to a physical location includes monitoring typing input received from the user in the text input portion of the messaging application.

227. The aforementioned processing unit is The electronic device according to any one of claims 221 to 226, further configured to stop presenting the selectable user interface element in accordance with the determination that the user is typing and has not selected the selectable user interface element.

228. The aforementioned processing unit is The electronic device according to any one of claims 221 to 226, further configured to stop presenting the selectable user interface element in accordance with a determination that the user has provided additional input indicating that the user does not select the selectable user interface element.

229. The electronic device according to any one of claims 221 to 228, wherein the proposed representation of the physical location includes information that identifies the current geographic location of the electronic device.

230. The electronic device according to any one of claims 221 to 229, wherein the expression for the proposed physical location is an address.

231. The electronic device according to any one of claims 221 to 229, wherein the representation of the proposed physical location is a map object including an identifier relating to the proposed physical location.

232. The electronic device according to any one of claims 221 to 231, wherein the proposed physical location corresponds to a location recently viewed by the user in an application other than the messaging application.

233. The electronic device according to any one of claims 221 to 232, wherein the messaging application is an email application.

234. The electronic device according to any one of claims 221 to 232, wherein the messaging application is a text messaging application.

235. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device communicating with a display, the electronic device receives the following information: While the first application is displayed, the first application obtains information that identifies the first physical location viewed by the user. Terminate the first application, After the first application is terminated, the system receives a request from the user to open a second application different from the first application. A non-temporary computer-readable storage medium that, in response to the receipt of the aforementioned request and in accordance with the determination that the second application is capable of accepting geographic location information, causes the second application to be presented, and presenting the second application includes populating the second application with information based on the information that identifies the first physical location, at least in part.

236. The non-temporary computer-readable storage medium according to claim 235, wherein receiving the request to open the second application includes detecting input on the affordance of the second application after the termination of the first application.

237. The non-temporary computer-readable storage medium according to claim 236, wherein the affordance of the second application is an icon displayed on the home screen of the electronic device.

238. The detection of the aforementioned input means that Detecting a double tap on the physical home button, In response to detecting the aforementioned double tap, the application switching user interface is displayed, To detect the selection of the affordance from within the application switching user interface, A non-temporary computer-readable storage medium according to claim 236, including the following:

239. The non-temporary computer-readable storage medium according to any one of claims 235 to 238, wherein populating the second application includes, at least in part, displaying a user interface object containing information based on the information identifying the first physical location.

240. The non-temporary computer-readable storage medium according to claim 239, wherein the user interface object includes a textual description informing the user that the first physical location has recently been viewed in the first application.

241. The user interface object is a map displayed within the second application. Populating the second application includes populating the map to include the identifier of the first physical location. A non-temporary computer-readable storage medium according to claim 240.

242. The non-temporary computer-readable storage medium according to claim 240 or 241, wherein the second application is presented together with a virtual keyboard, and the user interface objects are displayed above the virtual keyboard.

243. The non-temporary computer-readable storage medium according to any one of claims 240 to 242, wherein obtaining the aforementioned information includes obtaining information relating to a second physical location, and displaying the user interface object includes displaying the user interface object having the aforementioned information relating to the second physical location.

244. The non-temporary computer-readable storage medium according to any one of claims 235 to 243, wherein the determination that the second application can receive geolocation information includes one or more of the following: (i) determining that the second application includes an input receiving field on which it can receive and process geolocation data; (ii) determining that the second application can display geolocation information on a map; (iii) determining that the second application can use geolocation information to facilitate route guidance; and (iv) determining that the second application can use geolocation information to locate and provide transportation services.

245. The determination that the second application can accept geographic location information includes determining that the second application includes an input receiving field that can accept and process geographic location data. The non-temporary computer-readable storage medium according to claim 244, wherein the input receiving field is a search box that enables searching within a map displayed in the second application.

246. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: A non-temporary computer-readable storage medium according to any one of claims 235 to 245, which, upon receiving the aforementioned request, determines whether the second application is associated with the first application based on the user's application usage history.

247. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: The non-temporary computer-readable storage medium according to claim 246, wherein, before presenting the second application, the second application is provided with access to the information that identifies the first physical location, and prior to such access being provided, the second application does not have access to the information that identifies the first physical location.

248. In an electronic device having one or more processors, memory, a touch-sensing surface, and a display, While the first application is displayed, information is obtained that identifies the first physical location viewed by the user in the first application. Terminating the first application, After the termination of the first application, the system receives a request from the user to open a second application different from the first application. In response to the receipt of the aforementioned request and in accordance with the determination that the second application is capable of accepting geographic location information, the second application is presented. A method for presenting the second application, which includes populating the second application with information based on the information identifying the first physical location, at least in part.

249. The method according to claim 248, wherein receiving the request to open the second application includes detecting input on the affordance of the second application after the termination of the first application.

250. The method according to claim 249, wherein the affordance of the second application is an icon displayed on the home screen of the electronic device.

251. The detection of the aforementioned input means that Detecting a double tap on the physical home button, In response to detecting the aforementioned double tap, the application switching user interface is displayed, To detect the selection of the affordance from within the application switching user interface, The method according to claim 249, including the method described in claim 249.

252. The method according to any one of claims 248 to 251, wherein populating the second application includes, at least in part, displaying a user interface object that includes information based on the information identifying the first physical location.

253. The method according to claim 252, wherein the user interface object includes a textual description informing the user that the first physical location has recently been viewed in the first application.

254. The user interface object is a map displayed within the second application. The method according to claim 253, wherein populating the second application includes populating the map to include the identifier of the first physical location.

255. The method according to claim 253 or 254, wherein the second application is presented together with a virtual keyboard, and the user interface objects are displayed above the virtual keyboard.

256. The method according to any one of claims 253 to 255, wherein obtaining the aforementioned information includes obtaining information relating to a second physical location, and displaying the user interface object includes displaying the user interface object having the aforementioned information relating to the second physical location.

257. The method according to any one of claims 248 to 256, wherein the determination that the second application can receive geolocation information includes one or more of the following: (i) determining that the second application includes an input receiving field on which it can receive and process geolocation data; (ii) determining that the second application can display geolocation information on a map; (iii) determining that the second application can use geolocation information to facilitate route guidance; and (iv) determining that the second application can use geolocation information to locate and provide transportation services.

258. The determination that the second application can accept geographic location information includes determining that the second application includes an input receiving field that can accept and process geographic location data. The method according to claim 257, wherein the input receiving field is a search box that enables searching within a map displayed in the second application.

259. The method according to any one of claims 248 to 258, further comprising determining, in response to the receipt of the request, whether the second application is associated with the first application based on the user's application usage history.

260. The method of claim 259, further comprising providing the second application with access to the information identifying the first physical location before presenting the second application, wherein the second application does not have access to the information identifying the first physical location before such access is provided.

261. Touch-sensitive surface and The display and One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, An electronic device comprising, wherein one or more programs include instructions for performing the method according to any one of claims 248 to 260.

262. A graphical user interface on an electronic device having memory, a touch-sensitive surface, a display, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method described in any one of claims 248 to 260.

263. An electronic device having a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 248 to 260.

264. An information processing apparatus for use in an electronic device including a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 248 to 260.

265. A touch-sensitive surface unit configured to receive user contact, A display unit configured to display a user interface, A processing unit coupled with the touch sensing surface unit and the display unit, The processing unit is equipped with, While the first application is displayed, information is obtained that identifies the first physical location viewed by the user in the first application. After closing the first application, After the first application is terminated, the user requests to open a second application different from the first application. In response to the receipt of the aforementioned request and in accordance with the determination that the second application can accept geographic location information, the second application is presented, and presenting the second application includes populating the second application with information based on the information that identifies the first physical location, at least in part. An electronic device configured in such a way.

266. The electronic device according to claim 265, wherein receiving the request to open the second application includes detecting an input on the affordance of the second application after the termination of the first application.

267. The electronic device according to claim 266, wherein the affordance of the second application is an icon displayed on the home screen of the electronic device.

268. The detection of the aforementioned input means that Detecting a double tap on the physical home button, In response to detecting the aforementioned double tap, the application switching user interface is displayed, To detect the selection of the affordance from within the application switching user interface, The electronic device according to claim 266, including the electronic device described in claim 266.

269. The electronic device according to any one of claims 265 to 268, wherein populating the second application includes, at least in part, displaying a user interface object that includes information based on the information identifying the first physical location.

270. The electronic device according to claim 269, wherein the user interface object includes a textual description that informs the user that the first physical location has been recently viewed in the first application.

271. The user interface object is a map displayed within the second application. Populating the second application includes populating the map to include the identifier of the first physical location. The electronic device according to claim 270.

272. The electronic device according to claim 270 or 271, wherein the second application is presented together with a virtual keyboard, and the user interface objects are displayed above the virtual keyboard.

273. The electronic device according to any one of claims 270 to 272, wherein obtaining the aforementioned information includes obtaining information relating to a second physical location, and displaying the user interface object includes displaying the user interface object having the aforementioned information relating to the second physical location.

274. The electronic device according to any one of claims 265 to 273, wherein the determination that the second application can receive geolocation information includes one or more of the following: (i) determining that the second application includes an input receiving field on which it can receive and process geolocation data; (ii) determining that the second application can display geolocation information on a map; (iii) determining that the second application can use geolocation information to facilitate route guidance; and (iv) determining that the second application can use geolocation information to locate and provide transportation services.

275. The determination that the second application can accept geographic location information includes determining that the second application includes an input receiving field that can accept and process geographic location data. The electronic device according to claim 274, wherein the input receiving field is a search box that enables searching within a map displayed in the second application.

276. The aforementioned processing unit is The electronic device according to any one of claims 265 to 275, further configured to determine, in response to the receipt of the aforementioned request, whether the second application is associated with the first application based on the user's application usage history.

277. The aforementioned processing unit is The electronic device according to claim 276, wherein, before presenting the second application, the second application is provided with access to the information that identifies the first physical location, and before such access is provided, the second application is further configured not to have access to the information that identifies the first physical location.

278. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device communicating with a display, the electronic device receives the following information: The first application obtains information that identifies the first physical location viewed by the user. To detect the first input, In response to detecting the first input, Identify a second application that can accept geographic location information, On at least a portion of the display, an affordance is presented which proposes opening the second application having information about the first physical location, which is different from the first application. In the aforementioned affordance, a second input is detected. In response to detecting the second input in the aforementioned affordance, Open the second application, The second application is populated to include, at least in part, information based on the information that identifies the first physical location. Non-temporary computer-readable storage medium.

279. The non-temporary computer-readable storage medium according to claim 278, wherein the first input corresponds to a request to open an application switching user interface.

280. The non-temporary computer-readable storage medium according to claim 279, wherein the affordances are presented within the application switching user interface.

281. Presenting the aforementioned affordances means In addition to presenting the aforementioned affordances, the application switching user interface also presents a representation of the application running on the electronic device. Presenting the affordance within the area of ​​the display located below the representation of the application, A non-temporary computer-readable storage medium according to claim 280, including the following:

282. The non-temporary computer-readable storage medium according to claim 278, wherein the first input corresponds to a request to open the home screen of the electronic device.

283. The non-temporary computer-readable storage medium according to claim 282, wherein the affordances are presented on a portion of the home screen.

284. The proposal includes a textual description specific to the type associated with the second application, as described in any one of claims 278 to 283.

285. The non-temporary computer-readable storage medium according to any one of claims 278 to 284, wherein populating the second application includes, at least in part, displaying a user interface object containing information based on the information identifying the first physical location.

286. The non-temporary computer-readable storage medium according to claim 285, wherein the user interface object includes a textual description informing the user that the first physical location has recently been viewed in the first application.

287. The user interface object is a map displayed within the second application. Populating the second application includes populating the map to include the identifier of the first physical location. A non-temporary computer-readable storage medium according to claim 286.

288. The non-temporary computer-readable storage medium according to claim 286 or 287, wherein the second application is presented together with a virtual keyboard, and the user interface objects are displayed above the virtual keyboard.

289. Identifying the second application capable of receiving geolocation information comprises one or more of the following: (i) determining that the second application includes an input receiving field capable of receiving and processing geolocation data; (ii) determining that the second application can display geolocation information on a map; (iii) determining that the second application can use geolocation information to facilitate route guidance; and (iv) determining that the second application can use geolocation information to locate and provide transportation services, the non-temporary computer-readable storage medium according to any one of claims 278 to 288.

290. Identifying that the second application can accept geographic location information includes determining that the second application includes an input receiving field that can accept and process geographic location data. The aforementioned input receiving field is a search box that enables searching within the map displayed in the second application. A non-temporary computer-readable storage medium according to claim 289.

291. In an electronic device having one or more processors, memory, a touch-sensing surface, and a display, In the first application, information is obtained to identify the first physical location viewed by the user, To detect the first input, In response to detecting the first input, Identifying a second application that can accept geographic location information, Presenting an affordance on at least a portion of the display that proposes opening the second application, which has information about the first physical location and is different from the first application, In the aforementioned affordance, a second input is detected, In response to detecting the second input in the aforementioned affordance, Opening the second application mentioned above, Populating the second application to include, at least in part, information based on the information that identifies the first physical location, A method that includes this.

292. The method according to claim 291, wherein the first input corresponds to a request to open an application switching user interface.

293. The method according to claim 292, wherein the affordance is presented within the application switching user interface.

294. Presenting the aforementioned affordances means In addition to presenting the aforementioned affordances, the application switching user interface also presents a representation of the application running on the electronic device. Presenting the affordance within the area of ​​the display located below the representation of the application, The method according to claim 293, including the method described in claim 293.

295. The method according to claim 291, wherein the first input corresponds to a request to open the home screen of the electronic device.

296. The method according to claim 295, wherein the affordance is presented on a portion of the home screen.

297. The proposal is the method according to any one of claims 291 to 296, comprising a textual description specific to the type associated with the second application.

298. The method according to any one of claims 291 to 297, wherein populating the second application includes, at least in part, displaying a user interface object that includes information based on the information identifying the first physical location.

299. The method of claim 298, wherein the user interface object includes a textual description informing the user that the first physical location has recently been viewed in the first application.

300. The user interface object is a map displayed within the second application. Populating the second application includes populating the map to include the identifier of the first physical location. The method according to claim 299.

301. The method according to claim 299 or 300, wherein the second application is presented together with a virtual keyboard, and the user interface objects are displayed above the virtual keyboard.

302. Identifying a second application capable of receiving geolocation information includes one or more of the following: (i) determining that the second application includes an input receiving field capable of receiving and processing geolocation data; (ii) determining that the second application can display geolocation information on a map; (iii) determining that the second application can use geolocation information to facilitate route guidance; and (iv) determining that the second application can use geolocation information to locate and provide transportation services. The method according to any one of claims 291 to 301.

303. Identifying that the second application can accept geographic location information includes determining that the second application includes an input receiving field that can accept and process geographic location data. The aforementioned input receiving field is a search box that enables searching within the map displayed in the second application. The method according to claim 302.

304. Touch-sensitive surface and The display and One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more instructions for performing the method described in any one of claims 291 to 303, Electronic devices.

305. A graphical user interface on an electronic device having memory, a touch-sensitive surface, a display, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method described in any one of claims 291 to 303.

306. An electronic device having a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 291 to 303.

307. An information processing apparatus for use in an electronic device including a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 291 to 303.

308. A touch-sensitive surface unit configured to receive user contact, A display unit configured to display a user interface, A processing unit coupled with the touch sensing surface unit and the display unit, The processing unit is equipped with, In the first application, information is obtained that identifies the first physical location viewed by the user. The first input is detected, In response to detecting the first input, Identify a second application that can accept geographic location information, An affordance is presented on at least a portion of the display unit, which has a proposal to open the second application having information about the first physical location, different from the first application. In the aforementioned affordance, a second input is detected, In response to detecting the second input in the aforementioned affordance, Open the second application mentioned above, The second application is popularized to include, at least in part, information based on the information that identifies the first physical location. An electronic device configured in such a way.

309. The electronic device according to claim 308, wherein the first input corresponds to a request to open an application switching user interface.

310. The electronic device according to claim 309, wherein the affordance is presented within the application switching user interface.

311. Presenting the aforementioned affordances means In addition to presenting the aforementioned affordances, the application switching user interface also presents a representation of the application running on the electronic device. Presenting the affordance within the area of ​​the display unit located below the representation of the application, The electronic device according to claim 310, including the electronic device according to claim 310.

312. The electronic device according to claim 308, wherein the first input corresponds to a request to open the home screen of the electronic device.

313. The electronic device according to claim 312, wherein the affordance is presented on a portion of the home screen.

314. The proposal includes a textual description specific to the type associated with the second application, according to any one of claims 308 to 313.

315. The electronic device according to any one of claims 308 to 314, wherein populating the second application includes, at least in part, displaying a user interface object that includes information based on the information identifying the first physical location.

316. The electronic device according to claim 315, wherein the user interface object includes a textual description that informs the user that the first physical location has been recently viewed in the first application.

317. The user interface object is a map displayed within the second application. Populating the second application includes populating the map to include the identifier of the first physical location. The electronic device according to claim 316.

318. The electronic device according to claim 316 or 317, wherein the second application is presented together with a virtual keyboard, and the user interface objects are displayed above the virtual keyboard.

319. Identifying the second application capable of receiving geolocation information comprises one or more of the following: (i) determining that the second application includes an input receiving field capable of receiving and processing geolocation data; (ii) determining that the second application can display geolocation information on a map; (iii) determining that the second application can use geolocation information to facilitate route guidance; and (iv) determining that the second application can use geolocation information to locate and provide transportation services, the electronic device according to any one of claims 308 to 318.

320. Identifying that the second application can accept geographic location information includes determining that the second application includes an input receiving field that can accept and process geographic location data. The aforementioned input receiving field is a search box that enables searching within the map displayed in the second application. The electronic device according to claim 319.

321. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device communicating with a display, the electronic device receives the following information: The first application running on the aforementioned electronic device obtains information that identifies the first physical location viewed by the user. The system determines that the user has entered the vehicle. In response to determining that the user has entered the vehicle, the system prompts the user to use the first physical location as the destination for route guidance. In response to the provision of the prompt, the system receives a command from the user to use the first physical location as the destination for route guidance. To facilitate route guidance to the first physical location, Non-temporary computer-readable storage medium.

322. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: The electronic device is made to detect that a message has been received, including detecting that the message is a message and that the message includes information that identifies a second physical location. In response to the detection, the user is given a new prompt to use the second physical location as a new destination for route guidance. A non-temporary computer-readable storage medium according to claim 321.

323. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: The non-temporary computer-readable storage medium according to claim 322, which facilitates route guidance to the second physical location in response to receiving a command from the user to use the second physical location as the new destination.

324. The non-temporary computer-readable storage medium according to any one of claims 322 to 323, wherein detecting that the message contains information identifying the second physical location includes performing the detection while a virtual assistant available on the electronic device is reading the message aloud to the user via an audio system communicating with the electronic device.

325. The non-temporary computer-readable storage medium according to any one of claims 322 to 324, wherein determining that the user has entered the vehicle includes detecting that the electronic device has established a communication link with the vehicle.

326. A non-temporary computer-readable storage medium according to any one of claims 322 to 325, wherein facilitating the aforementioned route guidance includes providing the route guidance via the display of the electronic device.

327. The non-temporary computer-readable storage medium according to any one of claims 322 to 325, wherein facilitating the aforementioned route guidance includes transmitting the information identifying the first physical location to the vehicle.

328. A non-temporary computer-readable storage medium according to any one of claims 322 to 327, wherein facilitating the aforementioned route guidance includes providing the route guidance via an audio system communicating with the electronic device.

329. In an electronic device having one or more processors, memory, a touch-sensing surface, and a display, To obtain information that identifies a first physical location viewed by a user in a first application running on the aforementioned electronic device, The determination that the aforementioned user has entered the vehicle, In response to determining that the user has entered the vehicle, the system provides the user with a prompt to use the first physical location as the destination for route guidance. In response to the provision of the prompt, the system receives a command from the user to use the first physical location as the destination for route guidance, To facilitate route guidance to the first physical location, A method that includes this.

330. The electronic device detects that it has received a message, and includes detecting that the message contains information that identifies a second physical location. In response to the detection, a new prompt is provided to the user to use the second physical location as a new destination for route guidance. The method according to claim 329, further comprising:

331. The method according to claim 330, further comprising facilitating route guidance to the second physical location in response to receiving a command from the user to use the second physical location as the new destination.

332. The method according to any one of claims 330 to 331, wherein detecting that the message contains information identifying the second physical location includes performing the detection while a virtual assistant available on the electronic device is reading the message aloud to the user via an audio system communicating with the electronic device.

333. The method according to any one of claims 330 to 332, wherein determining that the user has entered the vehicle includes detecting that the electronic device has established a communication link with the vehicle.

334. The method according to any one of claims 330 to 333, wherein facilitating the aforementioned route guidance includes providing the route guidance via the display of the electronic device.

335. The method according to any one of claims 330 to 333, wherein facilitating the aforementioned route guidance includes transmitting the information identifying the first physical location to the vehicle.

336. The method according to any one of claims 330 to 335, wherein facilitating the aforementioned route guidance includes providing the route guidance via an audio system communicating with the electronic device.

337. Touch-sensitive surface and The display and One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises, and the one or more programs include instructions for performing the method described in any one of claims 329 to 336, Electronic devices.

338. A graphical user interface on an electronic device having memory, a touch-sensitive surface, a display, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method described in any one of claims 329 to 336.

339. An electronic device having a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 329 to 336.

340. An information processing apparatus for use in an electronic device including a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 329 to 336.

341. It is an electronic device, A touch-sensitive surface unit configured to receive user contact, A display unit configured to display a user interface, A processing unit coupled with the touch sensing surface unit and the display unit, The processing unit is equipped with, In the first application running on the aforementioned electronic device, information is obtained that identifies a first physical location viewed by the user. The system determines that the user has entered the vehicle. In response to determining that the user has entered the vehicle, the system provides the user with a prompt to use the first physical location as the destination for route guidance. In response to the provision of the prompt, the user gives a command to use the first physical location as the destination for route guidance. To facilitate route guidance to the first physical location, An electronic device configured in such a way.

342. The aforementioned processing unit is The electronic device detects that it has received a message, and detects that the message contains information that identifies a second physical location, In response to the detection, the user is given a new prompt to use the second physical location as a new destination for route guidance. The electronic device according to claim 341, further configured as follows.

343. The aforementioned processing unit is The electronic device according to claim 342, further configured to facilitate route guidance to the second physical location in response to receiving a command from the user to use the second physical location as the new destination.

344. The electronic device according to claim 342 or 343, wherein detecting that the message contains information identifying the second physical location includes performing the detection while a virtual assistant available on the electronic device is reading the message aloud to the user via an audio system communicating with the electronic device.

345. The electronic device according to any one of claims 342 to 344, wherein determining that the user has entered the vehicle includes detecting that the electronic device has established a communication link with the vehicle.

346. The electronic device according to any one of claims 342 to 345, wherein facilitating the aforementioned route guidance includes providing the route guidance via the display of the electronic device.

347. The electronic device according to any one of claims 342 to 345, wherein facilitating the aforementioned route guidance includes transmitting the information identifying the first physical location to the vehicle.

348. The electronic device according to any one of claims 342 to 347, wherein facilitating the aforementioned route guidance includes providing the route guidance via an audio system communicating with the electronic device.

349. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device communicating with a display, the electronic device receives the following information: In the first application, the content is presented. The user has requested to open a second application, which is different from the first application, and which includes an input receiving field. Upon receiving the aforementioned request, the second application is instructed to present the input receiving field. Before receiving any user input in the input receiving field, a selectable user interface object is provided to allow the user to paste at least a portion of the content into the input receiving field. Upon detecting the selection of the selectable user interface object, the portion of the content is pasted into the input receiving field. Non-temporary computer-readable storage medium.

350. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: The non-temporary computer-readable storage medium according to claim 349, wherein, before providing the selectable user interface object, the input receiving field is identified as a field capable of receiving the portion of the content.

351. Identifying the input receiving field as a field capable of receiving the portion of the content is performed in response to the detection of the selection of the input receiving field, the non-temporary computer-readable storage medium according to claim 350.

352. A non-temporary computer-readable storage medium according to any one of claims 349 to 351, wherein the portion of the content corresponds to an image.

353. A non-temporary computer-readable storage medium according to any one of claims 349 to 351, wherein the portion of the content corresponds to text content.

354. A non-temporary computer-readable storage medium according to any one of claims 349 to 351, wherein the portion of the content corresponds to text content and images.

355. A non-temporary computer-readable storage medium according to any one of claims 349 to 354, wherein the first application is a web browsing application and the second application is a messaging application.

356. A non-temporary computer-readable storage medium according to any one of claims 349 to 354, wherein the first application is a photo browsing application and the second application is a messaging application.

357. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: Before receiving the request to open the second application, the system will receive a request to copy at least a portion of the content. A non-temporary computer-readable storage medium according to any one of claims 349 to 356.

358. The non-temporary computer-readable storage medium according to any one of claims 349 to 357, wherein the selectable user interface object is displayed along with an indication that the portion of the content has recently been viewed in the first application.

359. In an electronic device having one or more processors, memory, a touch-sensing surface, and a display, To present content in the first application, Receiving a request from the user to open a second application different from the first application, wherein the second application includes an input receiving field, In response to receiving the aforementioned request, the second application is presented with the input receiving field, To provide a selectable user interface object that allows the user to paste at least a portion of the content into the input receiving field before receiving any user input in the input receiving field, Upon detecting the selection of the selectable user interface object, the portion of the content is pasted into the input receiving field. A method that includes this.

360. The method according to claim 359, further comprising identifying the input receiving field as a field capable of receiving the portion of the content before providing the selectable user interface object.

361. The method according to claim 360, wherein identifying the input receiving field as a field capable of receiving the portion of the content is performed in response to the detection of the selection of the input receiving field.

362. The method according to any one of claims 359 to 361, wherein the portion of the content corresponds to an image.

363. The method according to any one of claims 359 to 361, wherein the portion of the content corresponds to text content.

364. The method according to any one of claims 359 to 361, wherein the portion of the content corresponds to text content and images.

365. The method according to any one of claims 359 to 364, wherein the first application is a web browsing application and the second application is a messaging application.

366. The method according to any one of claims 359 to 364, wherein the first application is a photo browsing application and the second application is a messaging application.

367. The method according to any one of claims 359 to 366, further comprising receiving a request to copy at least the portion of the content before receiving the request to open the second application.

368. The method according to any one of claims 359 to 367, wherein the selectable user interface object is displayed with an indication that the portion of the content has recently been viewed in the first application.

369. Touch-sensitive surface and The display and One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, An electronic device comprising, wherein one or more programs include instructions for performing the method according to any one of claims 359 to 368.

370. A graphical user interface on an electronic device having memory, a touch-sensitive surface, a display, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method described in any one of claims 359 to 368.

371. An electronic device having a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 359 to 368.

372. An information processing apparatus for use in an electronic device including a touch-sensing surface and a display, comprising means for performing the method described in any one of claims 359 to 368.

373. A touch-sensitive surface unit configured to receive user contact, A display unit configured to display a user interface, A processing unit coupled with the touch sensing surface unit and the display unit, The processing unit is equipped with, In the first application, content is presented, The user requests to open a second application different from the first application, and the second application includes an input receiving field. Upon receiving the aforementioned request, the second application is presented with the input receiving field. Before receiving any user input in the input receiving field, a selectable user interface object is provided to enable the user to paste at least a portion of the content into the input receiving field. Upon detecting the selection of the selectable user interface object, the portion of the content is pasted into the input receiving field. An electronic device configured in such a way.

374. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: The electronic device according to claim 373, wherein, before providing the selectable user interface object, the input receiving field is identified as a field capable of receiving the portion of the content.

375. The electronic device according to claim 374, wherein identifying the input receiving field as a field capable of receiving the portion of the content is performed in response to the detection of the selection of the input receiving field.

376. The electronic device according to any one of claims 373 to 375, wherein the portion of the content corresponds to an image.

377. The electronic device according to any one of claims 373 to 375, wherein the portion of the content corresponds to text content.

378. The electronic device according to any one of claims 373 to 375, wherein the portion of the content corresponds to text content and images.

379. The electronic device according to any one of claims 373 to 378, wherein the first application is a web browsing application and the second application is a messaging application.

380. The electronic device according to any one of claims 373 to 378, wherein the first application is a photo browsing application and the second application is a messaging application.

381. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: Before receiving the request to open the second application, the system will receive a request to copy at least a portion of the content. The electronic device according to any one of claims 373 to 380.

382. The electronic device according to any one of claims 373 to 381, wherein the selectable user interface object is displayed along with an indication that the portion of the content has recently been viewed in the first application.

383. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device having a display and a touch-sensing surface, the electronic device... On the aforementioned display, text content associated with the application is displayed. Determine that a portion of the aforementioned text content is related to (i) location, (ii) contact, or (iii) event. If it is determined that the part of the text content is related to location, the device will be made to acquire location information from a location sensor on the electronic device, and the acquired location information will be made to be prepared for display as a predicted content item. If it is determined that the part of the text content is related to a contact, the electronic device is instructed to perform a search for contact information related to the part of the text content, and the information associated with at least one contact retrieved by the search is prepared to be displayed as the predicted content item. If it is determined that the part of the text content is related to an event, the electronic device is instructed to perform a new search for event information related to the part of the text content, and at least a portion of the information based on at least one event retrieved by the new search is prepared to be displayed as the predicted content item. The application displays affordances including the predicted content items. The selection of the affordance is detected via the touch sensing surface. In response to detecting the aforementioned selection, the information associated with the predicted content item is displayed on the display adjacent to the text content. Non-temporary computer-readable storage medium.

384. The non-temporary computer-readable storage medium according to claim 383, wherein the portion of the text content corresponds to the most recently presented text content within the application.

385. The non-temporary computer-readable storage medium according to claim 383 or 384, wherein the application is a messaging application, and the portion of the text content is a question received within the messaging application from a remote user on a remote device different from the electronic device.

386. The non-temporary computer-readable storage medium according to claim 383 or 384, wherein the portion of the text content is an input provided by the user of the electronic device in an input receiving field within the application.

387. The non-temporary computer-readable storage medium according to claim 383, wherein the portion of the text content is identified in response to user input selecting a user interface object containing the portion of the text content.

388. The non-temporary computer-readable storage medium according to claim 387, wherein the application is a messaging application, and the user interface object is a message bubble for a conversation displayed within the messaging application.

389. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: To detect the selection of a second user interface object, In response to detecting the aforementioned selection, Stop displaying the aforementioned affordance together with the predicted content item. The text content associated with the second user interface object is determined to be related to a location, contact, or event. In accordance with the above determination, a new predicted content item is displayed within the application. A non-temporary computer-readable storage medium according to claim 387 or 388.

390. The non-temporary computer-readable storage medium according to any one of claims 383 to 389, wherein the affordance is adjacent to the virtual keyboard in the application.

391. The non-temporary computer-readable storage medium according to claim 390, wherein the information associated with the predicted content item is displayed in an input receiving field, the input receiving field being a field that displays typing input received on the virtual keyboard.

392. The non-temporary computer-readable storage medium according to any one of claims 383 to 391, wherein the determination includes parsing the text content when it is received by the application and detecting stored patterns known to be related to contacts, events and / or locations.

393. In an electronic device having one or more processors, memory, a touch-sensing surface, and a display, To display text content associated with the application on the aforementioned display, Determining that a portion of the aforementioned text content is related to (i) location, (ii) contact, or (iii) event, If it is determined that the part of the text content is location-related, location information is acquired from the location sensor on the electronic device, and the acquired location information is prepared to be displayed as a predicted content item. If it is determined that the portion of the text content is related to a contact, the electronic device will perform a search for contact information related to the portion of the text content, and prepare to display at least one piece of information associated with a contact, retrieved by the search, as the predicted content item. If it is determined that a portion of the text content is related to an event, the electronic device performs a new search for event information related to that portion of the text content, and prepares at least a portion of the information based on at least one event retrieved by the new search to be displayed as the predicted content item. Displaying affordances including the predicted content items within the aforementioned application, The selection of the affordance is detected via the touch-sensing surface, In response to detecting the aforementioned selection, the information associated with the predicted content item is displayed on the display adjacent to the text content. A method that includes this.

394. The method according to claim 393, wherein the portion of the text content corresponds to the most recently presented text content within the application.

395. The method according to claim 393 or 394, wherein the application is a messaging application, and the portion of the text content is a question received within the messaging application from a remote user on a remote device different from the electronic device.

396. The method according to claim 393 or 394, wherein the portion of the text content is an input provided by the user of the electronic device in an input receiving field within the application.

397. The method according to claim 393, wherein the portion of the text content is identified in response to user input selecting a user interface object containing the portion of the text content.

398. The method according to claim 397, wherein the application is a messaging application, and the user interface object is a message bubble for a conversation displayed within the messaging application.

399. Detecting the selection of a second user interface object, In response to detecting the aforementioned selection, To stop displaying the aforementioned affordance together with the predicted content item, Determining that the text content associated with the second user interface object is related to a location, contact, or event, In accordance with the above determination, a new predicted content item is displayed within the application, The method according to claim 397 or 398, further comprising:

400. The method according to any one of claims 393 to 399, wherein the affordance is displayed adjacent to a virtual keyboard within the application.

401. The method according to claim 400, wherein the information associated with the predicted content item is displayed in an input receiving field, and the input receiving field is a field that displays typing input received on the virtual keyboard.

402. The method according to any one of claims 393 to 401, wherein the determination includes parsing the text content when it is received by the application and detecting a stored pattern known to be related to contacts, events and / or locations.

403. Touch-sensitive surface and The display and One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more instructions for performing the method described in any one of claims 393 to 402, Electronic devices.

404. A graphical user interface on an electronic device having memory, a touch-sensitive surface, a display, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method described in any one of claims 393 to 402.

405. An electronic device having a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 393 to 402.

406. An information processing apparatus for use in an electronic device including a touch-sensing surface and a display, comprising means for performing the method according to any one of claims 393 to 402.

407. It is an electronic device, A touch-sensitive surface unit configured to receive user contact, A display unit configured to display a user interface, A processing unit coupled with the touch sensing surface unit and the display unit, The processing unit is equipped with, On the aforementioned display, text content associated with the application is presented, If it is determined that a portion of the aforementioned text content is related to (i) a location, (ii) a contact, or (iii) an event, If it is determined that the part of the text content is location-related, location information is obtained from the location sensor on the electronic device, and the obtained location information is prepared to be displayed as a predicted content item. If it is determined that the portion of the text content is related to a contact, the electronic device searches for contact information related to the portion of the text content, and prepares the information associated with at least one contact retrieved by the search to be displayed as the predicted content item. If it is determined that the part of the text content is related to an event, a new search is performed on the electronic device for event information related to the part of the text content, and at least a portion of the information based on at least one event retrieved by the new search is prepared to be displayed as the predicted content item. Within the aforementioned application, affordances including the predicted content items are displayed. The selection of the affordance is detected via the touch sensing surface. In response to detecting the aforementioned selection, the information associated with the predicted content item is displayed on the display adjacent to the text content. An electronic device configured in such a way.

408. The electronic device according to claim 407, wherein the portion of the text content corresponds to the most recently presented text content within the application.

409. The electronic device according to claim 407 or 408, wherein the application is a messaging application, and the portion of the text content is a question received within the messaging application from a remote user on a remote device different from the electronic device.

410. The electronic device according to claim 407 or 408, wherein the portion of the text content is an input provided by the user of the electronic device in an input receiving field within the application.

411. The electronic device according to claim 407, wherein the portion of the text content is identified in response to user input selecting a user interface object containing the portion of the text content.

412. The electronic device according to claim 411, wherein the application is a messaging application, and the user interface object is a message bubble for a conversation displayed within the messaging application.

413. The aforementioned processing unit is Detect the selection of the second user interface object, In response to detecting the aforementioned selection, Stop displaying the aforementioned affordance together with the predicted content item. It is determined that the text content associated with the second user interface object is related to a location, contact, or event. In accordance with the above determination, display a new predicted content item within the application. The electronic device according to claim 411 or 412, further configured as follows.

414. The electronic device according to any one of claims 407 to 413, wherein the affordance is displayed adjacent to a virtual keyboard within the application.

415. The electronic device according to claim 414, wherein the information associated with the predicted content item is displayed in an input receiving field, and the input receiving field is a field that displays typing input received on the virtual keyboard.

416. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device having a touch-sensing surface and a display, the electronic device... The display shows content associated with the application running on the electronic device. The touch-sensing surface, when detected, causes the electronic device to detect a swipe gesture that switches it to a search mode different from the application. In response to detecting the swipe gesture, the system transitions to the search mode, which includes a search interface displayed on the display. In conjunction with transitioning to the aforementioned search mode, the system determines at least one proposed search query based on information associated with the aforementioned content, at least in part. Before receiving any user input in the search interface, the displayed search interface is populated with the at least one proposed search query. Non-temporary computer-readable storage medium.

417. The non-temporary computer-readable storage medium according to claim 416, wherein detecting the swipe gesture includes detecting the swipe gesture on at least a portion of the currently displayed content.

418. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: Before detecting the swipe gesture, the system detects an input corresponding to a request to view the home screen of the electronic device. Upon detecting the aforementioned input, the display of the content associated with the application is stopped, and the corresponding page of the home screen of the electronic device is displayed. The aforementioned corresponding page is the initial page in a series of home screen pages. The swipe gesture is detected while the initial page of the home screen is displayed on the display. A non-temporary computer-readable storage medium according to claim 416 or 417.

419. The non-temporary computer-readable storage medium according to any one of claims 416 to 418, wherein the search interface is displayed semi-transparently overlaid on the application.

420. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: In accordance with the determination that the content includes text content, at least part of the text content is used to determine the at least one proposed search query. A non-temporary computer-readable storage medium according to any one of claims 416 to 419.

421. The non-temporary computer-readable storage medium according to claim 420, wherein determining the at least one proposed search query based on the text content in at least part includes analyzing the text content to detect one or more predefined keywords used to determine the at least one proposed search query.

422. Determining at least one proposed search query includes determining multiple proposed search queries. Populating the search interface includes populating the search interface with the multiple proposed search queries. A non-temporary computer-readable storage medium according to any one of claims 416 to 421.

423. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: The touch-sensing surface is used to detect a new swipe gesture on the currently displayed new content. In response to the detection of the new swipe gesture, transitioning to the search mode includes displaying the search interface on the display, In conjunction with transitioning to the aforementioned search mode, and in accordance with the determination that the new content does not contain text content, the search interface is populated with search queries proposed based on a set of past search queries selected by the user of the electronic device. A non-temporary computer-readable storage medium according to any one of claims 416 to 422.

424. The non-temporary computer-readable storage medium according to claim 423, wherein the search interface is displayed along with the target location based on location information provided by a second application different from the aforementioned application.

425. The non-temporary computer-readable storage medium according to claim 423 or 424, wherein the search interface further comprises one or more proposed applications.

426. The set of past search queries is selected, at least in part, based on the frequency of recent search queries, in a non-temporary computer-readable storage medium according to any one of claims 423 to 425.

427. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: A non-temporary computer-readable storage medium according to any one of claims 416 to 426, wherein, in conjunction with transitioning to the search mode, the information associated with the content is retrieved by using one or more accessibility functions available on the electronic device.

428. Using one or more of the aforementioned accessibility features means (i) Applying a natural language processing algorithm to the text content currently displayed within the application, (ii) Determining one or more keywords that describe the content using data obtained from the natural language processing algorithm, wherein the at least one proposed search query is determined based on the one or more keywords, This includes generating the information associated with the content using one or more of the accessibility features, A non-temporary computer-readable storage medium according to claim 427.

429. Determining one or more keywords that describe the aforementioned content means that (i) Retrieving metadata corresponding to the non-text content currently displayed within the application, (ii) In addition to the data obtained from the natural language processing algorithm, the extracted metadata is used to determine one or more keywords, A non-temporary computer-readable storage medium according to claim 428, including the above.

430. The non-temporary computer-readable storage medium according to any one of claims 416 to 429, wherein the search interface further comprises one or more trend queries.

431. The non-temporary computer-readable storage medium according to claim 430, further comprising one or more applications that the user of the electronic device is expected to be of interest to.

432. In an electronic device including one or more processors, memory, a touch-sensing surface, and a display, Displaying content associated with an application running on the electronic device on the aforementioned display, The system detects a swipe gesture via the touch-sensing surface, which, when detected, causes the electronic device to switch to a search mode different from the application. The process involves transitioning to the search mode in response to the detection of the swipe gesture, wherein the search mode includes a search interface displayed on the display. In conjunction with transitioning to the aforementioned search mode, at least one proposed search query is determined based on information associated with the aforementioned content, Before receiving any user input in the search interface, the displayed search interface is populated with the at least one proposed search query, A method that includes this.

433. The method according to claim 432, wherein detecting the swipe gesture includes detecting the swipe gesture on at least a portion of the currently displayed content.

434. Before detecting the swipe gesture, the system detects an input corresponding to a request to view the home screen of the electronic device. In response to detecting the aforementioned input, the display of the content associated with the application is stopped, and the home screen of the electronic device is stopped. To display the corresponding page, This includes the corresponding page, which is the initial page of a series of home screen pages. The swipe gesture is detected while the initial page of the home screen is displayed on the display. The method according to claim 432 or 433.

435. The method according to any one of claims 432 to 434, wherein the search interface is displayed semi-transparently overlaid on the application.

436. The method according to any one of claims 432 to 435, comprising determining the at least one proposed search query based at least in part on the text content, in accordance with the determination that the content includes text content.

437. The method according to claim 436, wherein determining the at least one proposed search query based on the text content in at least part includes analyzing the text content to detect one or more predefined keywords used to determine the at least one proposed search query.

438. Determining at least one proposed search query includes determining multiple proposed search queries. Populating the search interface includes populating the search interface with the multiple proposed search queries. The method according to any one of claims 432 to 437.

439. The touch-sensing surface detects a new swipe gesture on the currently displayed new content, In response to detecting the aforementioned new swipe gesture, the system transitions to the search mode, and this transition to the search mode includes displaying the search interface on the display. In conjunction with transitioning to the aforementioned search mode, and in accordance with the determination that the new content does not contain text content, the search interface is populated with search queries proposed based on a set of past search queries selected by the user of the electronic device. The method according to any one of claims 432 to 438, including the method described in any one of claims 432 to 438.

440. The method according to claim 439, wherein the search interface is displayed along with the target location based on location information provided by a second application different from the aforementioned application.

441. The method according to claim 439 or 440, wherein the search interface further comprises one or more proposed applications.

442. The method according to any one of claims 439 to 441, wherein the set of past search queries is selected based on the frequency of recent search queries, at least in part.

443. The method according to any one of claims 432 to 442, comprising, in conjunction with transitioning to the search mode, obtaining the information associated with the content by using one or more accessibility features available on the electronic device.

444. Using one or more of the aforementioned accessibility features means (i) Applying a natural language processing algorithm to the text content currently displayed within the application, (ii) Determining one or more keywords that describe the content using data obtained from the natural language processing algorithm, wherein the at least one proposed search query is determined based on the one or more keywords, The method according to claim 443, comprising generating the information associated with the content using one or more of the accessibility features.

445. Determining one or more keywords that describe the aforementioned content means that (i) Retrieving metadata corresponding to the non-text content currently displayed within the application, (ii) In addition to the data obtained from the natural language processing algorithm, the extracted metadata is used to determine one or more keywords, The method according to claim 444, including the method described in claim 444.

446. The method according to any one of claims 432 to 445, wherein the search interface further includes one or more trend queries.

447. The method according to claim 446, wherein the search interface further includes one or more applications that are expected to be of interest to the user of the electronic device.

448. Touch-sensitive surface and The display and One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more instructions for performing the method described in any one of claims 432 to 447, Electronic devices.

449. A graphical user interface on an electronic device having a touch-sensitive surface, a display, memory, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method described in any one of claims 432 to 447.

450. Touch-sensitive surface and The display and Means for carrying out the method described in any one of claims 432 to 447, An electronic device equipped with the following features.

451. An information processing device for use in an electronic device including a touch-sensing surface and a display, An information processing apparatus comprising means for performing the method described in any one of claims 432 to 447.

452. It is an electronic device, A display unit configured to display a user interface, A touch sensing unit configured to detect user contact via the touch sensing surface of the touch sensing display unit, A processing unit coupled with the touch sensing surface unit and the display unit, The processing unit is equipped with, The display unit displays content associated with the application running on the electronic device. The touch sensing surface unit detects a swipe gesture, which, when detected, causes the electronic device to switch to a search mode different from the application. Upon detection of the swipe gesture, the system transitions to the search mode, which includes a search interface displayed on the display unit. In conjunction with transitioning to the aforementioned search mode, at least one proposed search query is determined based on information associated with the aforementioned content, Before receiving any user input in the search interface, the displayed search interface is populated with the at least one proposed search query. An electronic device configured in such a way.

453. The electronic device according to claim 452, wherein detecting the swipe gesture includes detecting the swipe gesture on at least a portion of the currently displayed content.

454. The aforementioned processing unit is Before detecting the swipe gesture, the system detects input corresponding to a request to browse the home screen of the electronic device. Upon detecting the aforementioned input, the system stops displaying the content associated with the application and displays the corresponding page on the home screen of the electronic device. It is further structured in the following way: The aforementioned corresponding page is the initial page in a series of home screen pages. The swipe gesture is detected while the initial page of the home screen is displayed on the display unit. The electronic device according to claim 452 or 453.

455. The electronic device according to any one of claims 452 to 454, wherein the search interface is displayed semi-transparently overlaid on the application.

456. The aforementioned processing unit is The electronic device according to any one of claims 452 to 455, further configured to determine, at least in part, the at least one proposed search query based on the text content, in accordance with the determination that the content includes text content.

457. The electronic device according to claim 456, wherein determining the at least one proposed search query based on the text content in at least part includes analyzing the text content to detect one or more predefined keywords used to determine the at least one proposed search query.

458. Determining at least one proposed search query includes determining multiple proposed search queries. The electronic device according to any one of claims 452 to 457, wherein populating the search interface includes populating the search interface with the plurality of proposed search queries.

459. The aforementioned processing unit is The touch sensing surface unit detects a new swipe gesture on the currently displayed new content, In response to the detection of the new swipe gesture, transitioning to the search mode includes displaying the search interface on the display unit. In conjunction with transitioning to the aforementioned search mode, and in accordance with the determination that the new content does not contain text content, the search interface is populated with search queries proposed by the user of the electronic device based on a set of past search queries selected by the user. The electronic device according to any one of claims 452 to 458, further configured as follows.

460. The electronic device according to claim 459, wherein the search interface is displayed along with the target location based on location information provided by a second application different from the aforementioned application.

461. The electronic device according to claim 459 or 460, wherein the search interface further comprises one or more proposed applications.

462. The electronic device according to any one of claims 459 to 461, wherein the set of past search queries is selected based on the frequency of recent search queries, at least in part.

463. The aforementioned processing unit is The electronic device according to any one of claims 452 to 462, further configured to retrieve the information associated with the content by using one or more accessibility features available on the electronic device, in conjunction with transitioning to the search mode.

464. Using one or more of the aforementioned accessibility features means (i) Applying a natural language processing algorithm to the text content currently displayed within the application, (ii) Determining one or more keywords that describe the content using data obtained from the natural language processing algorithm, wherein the at least one proposed search query is determined based on the one or more keywords, The electronic device according to claim 463, comprising generating the information associated with the content using one or more of the accessibility features.

465. Determining one or more keywords that describe the aforementioned content means that (i) Retrieving metadata corresponding to the non-text content currently displayed within the application, (ii) In addition to the data obtained from the natural language processing algorithm, the extracted metadata is used to determine one or more keywords, The electronic device according to claim 464, including the electronic device according to claim 464.

466. The electronic device according to any one of claims 452 to 465, wherein the search interface further includes one or more trend queries.

467. The electronic device according to claim 466, wherein the search interface further includes one or more applications that the user of the electronic device is expected to be of interest to.

468. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device having a touch-sensing surface and a display, the electronic device... A swipe gesture on the user interface via the touch-sensing surface, wherein when the swipe gesture is detected, the electronic device is prompted to switch to search mode. Transitioning to the search mode in response to the detection of the swipe gesture includes populating a search interface different from the user interface with the first content item before receiving any user input within the search interface, Populating the search interface with the first content item, in accordance with the determination that the user interface includes content associated with an application different from the home screen, which includes a selectable icon for invoking the application, includes populating the search interface with at least one proposed search query based on the content associated with the application, at least in part. Populating the search interface with the first content item in accordance with the determination that the user interface is associated with the home screen page includes populating the search interface with affordances that include a selectable description of at least one target location within a threshold distance of the electronic device's current location. Non-temporary computer-readable storage medium.

469. Populating the search interface by affordance includes displaying the search entry portion of the search interface on the touch-sensitive surface. When the aforementioned instruction is executed by the electronic device, the electronic device further: To detect input in the aforementioned search entry section, Upon detecting the input in the search entry portion, the display of the affordance is stopped, and the at least one proposed search query is displayed within the search interface. A non-temporary computer-readable storage medium according to claim 468.

470. In an electronic device including one or more processors, memory, a touch-sensing surface, and a display, The method involves detecting a swipe gesture on the user interface via the touch-sensing surface, and when the swipe gesture is detected, the electronic device is prompted to switch to search mode. In response to detecting the swipe gesture, the system transitions to the search mode, and this transition to the search mode includes populating a search interface different from the user interface with the first content item before receiving any user input within the search interface. Includes, Populating the search interface with the first content item, in accordance with the determination that the user interface includes content associated with an application different from the home screen, which includes a selectable icon for invoking the application, includes populating the search interface with at least one proposed search query based on the content associated with the application, at least in part. A method for populating the search interface with the first content item, in accordance with the determination that the user interface is associated with the home screen page, comprising populating the search interface with affordances that include a selectable description of at least one target location within a threshold distance of the current location of the electronic device.

471. Populating the search interface by affordance includes displaying the search entry portion of the search interface on the touch-sensitive surface. The aforementioned method, To detect the input in the aforementioned search entry portion, In response to detecting the input in the search entry portion, the display of the affordances is stopped, and the at least one proposed search query is displayed within the search interface. The method according to claim 470, further comprising:

472. Touch-sensitive surface and The display and One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, An electronic device comprising, wherein one or more programs include instructions for performing the method according to claim 470 or 471.

473. A graphical user interface on an electronic device having a touch-sensitive surface, a display, memory, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method described in claim 470 or 471.

474. Touch-sensitive surface and The display and Means for carrying out the method described in claim 470 or 471, An electronic device equipped with the following features.

475. An information processing device for use in an electronic device including a touch-sensing surface and a display, An information processing apparatus comprising means for performing the method described in any one of claims 470 to 471.

476. It is an electronic device, A display unit configured to display a user interface, A touch-sensitive surface unit configured to receive user contact, A processing unit coupled with the touch sensing surface unit and the display unit, The processing unit is equipped with, The touch sensing surface unit detects a swipe gesture on the user interface, and when the swipe gesture is detected, it causes the electronic device to switch to search mode. Transitioning to the search mode in response to the detection of the swipe gesture includes populating a search interface different from the user interface with the first content item before receiving any user input within the search interface. The user interface is configured such that, in accordance with the determination that the user interface includes content associated with an application different from the home screen, which includes a selectable icon for invoking the application, populating the search interface with the first content item includes populating the search interface with at least one proposed search query based on the content associated with the application, at least in part. Populating the search interface with the first content item, in accordance with the determination that the user interface is associated with the home screen page, includes populating the search interface with affordances that include a selectable description of at least one target location within a threshold distance of the electronic device's current location.

477. Populating the search interface by affordance includes displaying the search entry portion of the search interface. The aforementioned processing unit is The input in the aforementioned search entry section is detected, Upon detecting the input in the search entry portion, the display of the affordances is stopped, and the at least one proposed search query is displayed within the search interface. The electronic device according to claim 476, further configured as follows.

478. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device having a touch-sensing surface, a display, and a position sensor, the electronic device is configured to store executable instructions. Automatically and without user command, The electronic device determines that the user is inside a stationary vehicle at a given geographical location. When it is determined that the user has moved away from the vehicle at the aforementioned geographical location, the system determines whether the location information extracted from the location sensor to identify the geographical location meets the accuracy criteria. If it is determined that the location information does not meet the accuracy criteria, the user is prompted to input information regarding the geographic location. In response to the provision of the aforementioned prompt, the system receives information about the geographical location from the user and stores the information as vehicle location information. Non-temporary computer-readable storage medium.

479. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: A non-temporary computer-readable storage medium according to claim 478, which automatically stores the location information as the vehicle location information without any command from the user when it is determined that the location information satisfies the accuracy criteria.

480. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: In accordance with the determination that the user is heading towards the geographical location, a user interface object including the vehicle location information is displayed. A non-temporary computer-readable storage medium according to claim 479.

481. The non-temporary computer-readable storage medium according to claim 480, wherein the user interface object is a map object including an identifier relating to the user's current location and another identifier relating to the geographical location.

482. The non-temporary computer-readable storage medium according to claim 481, wherein the user interface object is displayed on the lock screen of the electronic device.

483. The non-temporary computer-readable storage medium according to claim 481, wherein the user interface object is displayed in response to a swipe gesture that causes the electronic device to enter search mode.

484. The non-temporary computer-readable storage medium according to claim 483, wherein determining whether the user is heading towards the geographic location is performed in response to the reception of the swipe gesture.

485. The prompt is an audio prompt provided by a virtual assistant available via the electronic device, Receiving the information from the user includes receiving an oral description from the user that identifies the geographical location. Displaying the user interface object includes, when selected, displaying selectable affordances that cause the device to play the verbal explanation. A non-temporary computer-readable storage medium according to any one of claims 478 to 484.

486. The prompt is displayed on the display of the electronic device. Receiving the information from the user includes receiving a textual description from the user that identifies the geographical location. Displaying the user interface object includes displaying the textual description from the user. A non-temporary computer-readable storage medium according to any one of claims 478 to 484.

487. Determining whether the user is heading toward the geographical location includes determining, using new location information received from the location sensor, that the electronic device is moving toward the geographical location, according to any one of claims 478 to 484.

488. Determining whether the user is heading towards the geographical location means (i) Determining that the electronic device remains in a different geographical location for longer than a threshold time, (ii) Determining that the new location information indicates that the electronic device is moving away from the different geographical location and heading towards the geographical location, A non-temporary computer-readable storage medium according to claim 487, including the following:

489. A non-temporary computer-readable storage medium according to any one of claims 478 to 488, wherein determining that the user is inside the vehicle stopped at the aforementioned geographical location includes: (i) determining that the user is inside the vehicle by determining that the electronic device is moving at a speed exceeding a threshold; and (ii) determining that the vehicle has stopped at the aforementioned geographical location by determining that (a) the electronic device has remained at the aforementioned geographical location for longer than a threshold time; (b) determining that the communication link between the electronic device and the vehicle has been disconnected; and (c) determining that the geographical location corresponds to a location within a parking lot.

490. The non-temporary computer-readable storage medium according to claim 489, wherein determining that the vehicle has stopped at the geographical location includes determining that the electronic device has remained at the geographical location for a threshold time.

491. The non-temporary computer-readable storage medium according to claim 489 or 490, wherein determining that the vehicle has stopped at the geographical location includes determining that the communication link between the electronic device and the vehicle has been severed.

492. A non-temporary computer-readable storage medium according to any one of claims 489 to 491, wherein determining that the vehicle has stopped at the geographical location includes determining that the geographical location corresponds to a location within a parking lot.

493. The non-temporary computer-readable storage medium according to any one of claims 478 to 492, wherein the accuracy criterion includes a criterion that is satisfied when the accuracy of the GPS reading associated with the location information exceeds an accuracy threshold level.

494. In an electronic device including one or more processors, memory, touch-sensitive surfaces, displays, and position sensors, Automatically and without user command, The determination that the user of the aforementioned electronic device is inside a stationary vehicle at a geographical location, When it is determined that the user has moved away from the vehicle at the aforementioned geographical location, it is determined whether the location information extracted from the location sensor to identify the geographical location meets the accuracy criteria, If it is determined that the location information does not meet the accuracy criteria, the user is prompted to input information regarding the geographic location. In response to the provision of the aforementioned prompt, the system receives information about the geographical location from the user and stores the information as vehicle location information. A method that includes this.

495. When it is determined that the location information satisfies the accuracy criteria, the system automatically stores the location information as the vehicle location information without any command from the user. The method according to claim 494.

496. The method according to claim 495, comprising displaying a user interface object containing the vehicle location information in accordance with the determination that the user is heading towards the geographical location.

497. The method according to claim 496, wherein the user interface object is a map object that includes an identifier relating to the user's current location and another identifier relating to the geographical location.

498. The method according to claim 497, wherein the user interface object is displayed on the lock screen of the electronic device.

499. The method according to claim 497, wherein the user interface object is displayed in response to a swipe gesture that causes the electronic device to enter search mode.

500. The method according to claim 499, wherein determining whether the user is heading towards the geographic location is performed in response to the receipt of the swipe gesture.

501. The prompt is an audio prompt provided by a virtual assistant available via the electronic device, Receiving the information from the user includes receiving an oral description from the user that identifies the geographical location. Displaying the user interface object includes, when selected, displaying selectable affordances that cause the device to play the verbal explanation. The method according to any one of claims 494 to 500.

502. The prompt is displayed on the display of the electronic device. Receiving the information from the user includes receiving a textual description from the user that identifies the geographical location. Displaying the user interface object includes displaying the textual description from the user. The method according to any one of claims 494 to 500.

503. The method according to any one of claims 494 to 500, wherein determining whether the user is heading toward the geographical location includes determining that the electronic device is moving toward the geographical location using new location information received from the location sensor.

504. Determining whether the user is heading towards the geographical location means (i) Determining that the electronic device remains in a different geographical location for longer than a threshold time, (ii) Determining that the new location information indicates that the electronic device is moving away from the different geographical location and heading towards the geographical location, The method according to claim 503, including the method described in claim 503.

505. The method according to any one of claims 494 to 504, wherein determining that the user is inside the vehicle stopped at the geographical location includes (i) determining that the user is inside the vehicle by determining that the electronic device is moving at a threshold speed, and (ii) determining that the vehicle has stopped at the geographical location by determining that (a) the electronic device has remained at the geographical location for longer than a threshold time, (b) that the communication link between the electronic device and the vehicle has been disconnected, and (c) that the geographical location corresponds to a location within a parking lot.

506. The method of claim 505, wherein determining that the vehicle has stopped at the geographical location includes determining that the electronic device has remained at the geographical location for a threshold time.

507. The method according to claim 505 or 506, wherein determining that the vehicle has stopped at the geographical location includes determining that the communication link between the electronic device and the vehicle has been disconnected.

508. The method according to any one of claims 505 to 507, wherein determining that the vehicle has stopped at the geographical location includes determining that the geographical location corresponds to a location within a parking lot.

509. The method according to any one of claims 494 to 508, wherein the accuracy criterion includes a criterion that is satisfied when the accuracy of the GPS reading associated with the location information exceeds an accuracy threshold level.

510. Touch-sensitive surface and The display and Position sensor and, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more instructions for performing the method described in any one of claims 494 to 509, Electronic devices.

511. A graphical user interface on an electronic device having a touch-sensing surface, a display, a position sensor, a memory, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method described in any one of claims 494 to 509.

512. Touch-sensitive surface and Position sensor and, The display and Means for carrying out the method described in any one of claims 494 to 509, An electronic device equipped with the following features.

513. An information processing device for use in an electronic device including a touch-sensing surface, a display, and a position sensor, The means for carrying out the method described in any one of claims 494 to 509, Information processing device.

514. It is an electronic device, A display unit configured to display a user interface, A touch-sensitive surface unit configured to receive user contact, A position sensor unit configured to obtain position information of the aforementioned electronic device, A processing unit coupled with the touch sensing surface unit, the display unit, and the position sensor unit, The processing unit is equipped with, Automatically and without user command, The electronic device determines that the user is inside a stationary vehicle at a given geographical location. When it is determined that the user has moved away from the vehicle at the aforementioned geographical location, it is determined whether the location information extracted from the location sensor unit to identify the geographical location meets the accuracy criteria. If it is determined that the location information does not meet the accuracy criteria, the user is prompted to input information regarding the geographic location. In response to the provision of the aforementioned prompt, the system receives information about the geographical location from the user and stores the information as vehicle location information. An electronic device configured in such a way.

515. The aforementioned processing unit is The electronic device according to claim 514, further configured to automatically and without user command store the location information as vehicle location information when it is determined that the location information satisfies the accuracy criteria.

516. The aforementioned processing unit is The electronic device according to claim 515, further configured to display a user interface object including the vehicle location information in accordance with a determination that the user is heading toward the geographical location.

517. The electronic device according to claim 516, wherein the user interface object is a map object including an identifier relating to the user's current location and another identifier relating to the geographical location.

518. The electronic device according to claim 517, wherein the user interface object is displayed on the lock screen of the electronic device.

519. The electronic device according to claim 517, wherein the user interface object is displayed in response to a swipe gesture that causes the electronic device to switch to search mode.

520. The electronic device according to claim 519, wherein determining whether the user is heading towards the geographical location is performed in response to the reception of the swipe gesture.

521. The prompt is an audio prompt provided by a virtual assistant available via the electronic device, Receiving the information from the user includes receiving an oral description from the user that identifies the geographical location. Displaying the user interface object includes, when selected, displaying selectable affordances that cause the device to play the verbal explanation. The electronic device according to any one of claims 514 to 520.

522. The prompt is displayed on the display of the electronic device. Receiving the information from the user includes receiving a textual description from the user that identifies the geographical location. Displaying the user interface object includes displaying the textual description from the user. The electronic device according to any one of claims 514 to 520.

523. Determining whether the user is heading towards the geographic location includes determining that the electronic device is moving towards the geographic location using new location information received from the location sensor unit. The electronic device according to any one of claims 514 to 520.

524. Determining whether the user is heading towards the geographical location means (i) Determining that the electronic device remains in a different geographical location for longer than a threshold time, (ii) Determining that the new location information indicates that the electronic device is moving away from the different geographical location and heading towards the geographical location, The electronic device according to claim 523, including the electronic device according to claim 523.

525. The electronic device according to any one of claims 514 to 524, wherein determining that the user is inside the vehicle stopped at the aforementioned geographical location includes: (i) determining that the user is inside the vehicle by determining that the electronic device is moving at a threshold speed; and (ii) determining that the vehicle has stopped at the aforementioned geographical location by determining that (a) the electronic device has remained at the aforementioned geographical location for longer than a threshold time, determining that the communication link between the electronic device and the vehicle has been disconnected, and (c) determining that the geographical location corresponds to a location within a parking lot.

526. The electronic device according to claim 525, wherein determining that the vehicle has stopped at the geographical location includes determining that the electronic device has remained at the geographical location for a threshold time.

527. The electronic device according to claim 525 or 526, wherein determining that the vehicle has stopped at the geographical location includes determining that the communication link between the electronic device and the vehicle has been disconnected.

528. The electronic device according to any one of claims 525 to 527, wherein determining that the vehicle has stopped at the geographical location includes determining that the geographical location corresponds to a location within a parking lot.

529. The electronic device according to any one of claims 514 to 528, wherein the accuracy criterion includes a criterion that is satisfied when the accuracy of the GPS reading associated with the location information exceeds an accuracy threshold level.

530. A non-temporary computer-readable storage medium for storing executable instructions, wherein when the executable instructions are executed by an electronic device having a touch-sensing surface, a display, and a position sensor, the electronic device is configured to store executable instructions. Without receiving any commands from the user of the aforementioned electronic device, The position sensor is used to monitor the geographical location of the electronic device. Based on the monitored geographical location, the electronic device is determined to be within a threshold distance of a predetermined type of target location. In accordance with the determination that the electronic device is within the threshold distance of the target point, Identify at least one currently popular activity at the aforementioned target location. To retrieve information about the target location, including retrieving information about at least one activity that is currently popular at the target location, A first input is detected via the touch-sensing surface, which, when detected, causes the electronic device to switch to search mode. Transitioning to the search mode in response to the detection of the first input includes, before receiving any user input in the search interface, presenting via the display affordances including (i) information relating to the at least one activity and (ii) an indication that the at least one activity has been identified as currently popular at the target location. Non-temporary computer-readable storage medium.

531. When the aforementioned executable instruction is executed by the electronic device, the electronic device will: To detect a second input, In response to detecting the second input, the affordance is updated to include available information regarding the current activity at a second target location different from the target location, wherein the target location is within the threshold distance range of the electronic device. A non-temporary computer-readable storage medium according to claim 530.

532. The affordance further includes a selectable category of target location, and when the executable instruction is executed by the electronic device, the electronic device, Detect the selection of the corresponding selectable category, In response to detecting the aforementioned selection, the affordance is updated to include information about additional target locations located within a second threshold distance range of the device. A non-temporary computer-readable storage medium according to claim 530 or 531.

533. The non-temporary computer-readable storage medium according to any one of claims 530 to 532, wherein the target location is an amusement park, and the retrieved information includes the current waiting times for the rides at the amusement park.

534. The non-temporary computer-readable storage medium according to claim 533, wherein the retrieved information includes information regarding the waiting time of vehicles located within a predetermined distance range of the electronic device.

535. The non-temporary computer-readable storage medium according to any one of claims 530 to 532, wherein the target location is a restaurant, and the retrieved information includes information relating to popular menu items of the restaurant.

536. The non-temporary computer-readable storage medium according to claim 535, wherein the retrieved information is retrieved from a social network associated with the user of the electronic device.

537. The non-temporary computer-readable storage medium according to any one of claims 530 to 532, wherein the target location is a movie theater, and the retrieved information includes information regarding the showtimes of the movie theater.

538. The non-temporary computer-readable storage medium according to claim 537, wherein the retrieved information is retrieved from a social network associated with the user of the electronic device.

539. A non-temporary computer-readable storage medium according to any one of claims 530 to 538, wherein, after the electronic device is unlocked, the affordances are available in response to a substantially horizontal swipe on the initial page of the home screen of the electronic device.

540. An electronic device comprising one or more processors, memory, touch-sensitive surfaces, displays, and position sensors, wherein the electronic device does not receive any commands from the user of the electronic device. The geographical location of the electronic device is monitored using the aforementioned position sensor, Based on the monitored geographical location, it is determined that the electronic device is within a threshold distance of a predetermined type of target location. In accordance with the determination that the electronic device is within the threshold distance of the target point, Identifying at least one currently popular activity at the aforementioned target location, The process of retrieving information about the aforementioned target location includes retrieving information about at least one activity that is currently popular at the aforementioned target location. The first input, when detected via the touch-sensing surface, causes the electronic device to switch to search mode. Upon detecting the first input, the system transitions to the search mode, Transitioning to the search mode includes, before receiving any user input in the search interface, presenting an affordance via the display that includes (i) the information relating to the at least one activity and (ii) an indication that the at least one activity has been identified as currently popular at the target location. A method that includes this.

541. To detect a second input, In response to detecting the second input, the affordance is updated to include available information regarding the current activity at a second target location different from the target location. The target point is within the range of the threshold distance of the electronic device, The method according to claim 540.

542. The affordance further includes selectable categories for the target location, and the method is Detect the selection of the corresponding selectable category, In response to detecting the aforementioned selection, the affordance is updated to include information about additional target locations located within a second threshold distance range of the device, The method according to claim 540 or 541, further comprising:

543. The method according to any one of claims 540 to 542, wherein the target location is an amusement park, and the retrieved information includes the current waiting time for the rides in the amusement park.

544. The method according to claim 543, wherein the retrieved information includes information regarding the waiting time of vehicles located within a predetermined distance range of the electronic device.

545. The method according to any one of claims 540 to 542, wherein the target location is a restaurant, and the retrieved information includes information relating to popular menu items of the restaurant.

546. The method according to claim 545, wherein the retrieved information is retrieved from a social network associated with the user of the electronic device.

547. The method according to any one of claims 540 to 542, wherein the target location is a movie theater, and the retrieved information includes information regarding the showtimes of the movie theater.

548. The method according to claim 547, wherein the retrieved information is retrieved from a social network associated with the user of the electronic device.

549. The method according to any one of claims 540 to 548, wherein, after the electronic device is unlocked, the affordance is available in response to a substantially horizontal swipe on the initial page of the home screen of the electronic device.

550. Touch-sensitive surface and The display and Position sensor and, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, The program comprises one or more instructions for performing the method described in any one of claims 540 to 549, Electronic devices.

551. A graphical user interface on an electronic device having a touch-sensing surface, a display, a position sensor, a memory, and one or more processors for executing one or more programs stored in the memory, wherein the graphical user interface comprises a user interface displayed according to the method described in any one of claims 540 to 549.

552. Touch-sensitive surface and Position sensor and, The display and Means for carrying out the method described in any one of claims 540 to 549, An electronic device equipped with the following features.

553. An information processing device for use in an electronic device including a touch-sensing surface, a display, and a position sensor, An information processing apparatus comprising means for performing the method described in any one of claims 540 to 549.

554. It is an electronic device, A display unit configured to display a user interface, A touch-sensitive surface unit configured to receive user contact, A position sensor unit configured to obtain geographical location, A processing unit coupled to the touch-sensitive display unit, wherein the processing unit comprises Without receiving any commands from the user of the aforementioned electronic device, Using the position sensor unit, the geographical location of the electronic device is monitored. Based on the monitored geographical location, it is determined that the electronic device is within a threshold distance of a predetermined type of target location. In accordance with the determination that the electronic device is within the threshold distance of the target point, Identify at least one currently popular activity at the aforementioned target location, To retrieve information about the target location, including retrieving information about at least one activity that is currently popular at the target location, The touch sensing surface unit detects a first input that, when detected, causes the electronic device to switch to search mode. Transitioning to the search mode in response to the detection of the first input includes, before receiving any user input in the search interface, presenting via the display unit an affordance including (i) the information relating to the at least one activity and (ii) an indication that the at least one activity has been identified as currently popular at the target location. An electronic device configured in such a way.

555. The aforementioned processing unit is A second input is detected, The electronic device according to claim 554, further configured to update the affordance to include available information regarding current activity at a second target location different from the target location, in response to the detection of the second input, wherein the target location is within the threshold distance range of the electronic device.

556. The affordance further includes selectable categories for the target location, and the processing unit, Detect the selection of the corresponding selectable category, In response to detecting the aforementioned selection, the affordance is updated to include information about additional target locations located within a second threshold distance range of the device. The electronic device according to claim 554 or 555, further configured as follows.

557. The electronic device according to any one of claims 554 to 556, wherein the target location is an amusement park, and the retrieved information includes the current waiting time for the rides in the amusement park.

558. The electronic device according to claim 557, wherein the retrieved information includes information regarding the waiting time of vehicles located within a predetermined distance range of the electronic device.

559. The electronic device according to any one of claims 554 to 556, wherein the target location is a restaurant, and the retrieved information includes information relating to popular menu items of the restaurant.

560. The electronic device according to claim 559, wherein the retrieved information is retrieved from a social network associated with the user of the electronic device.

561. The electronic device according to any one of claims 554 to 556, wherein the target location is a movie theater, and the retrieved information includes information regarding the showtimes of the movie theater.

562. The electronic device according to claim 561, wherein the retrieved information is retrieved from a social network associated with the user of the electronic device.

563. The electronic device according to any one of claims 554 to 562, wherein, after the electronic device is unlocked, the affordance is available in response to a substantially horizontal swipe on the initial page of the home screen of the electronic device.

Images