User interface for navigating to location of shared device
By using location-based navigation and an intuitive user interface, the system solves the problems of cognitive burden and resource waste when users navigate to other electronic devices, achieving an efficient and privacy-preserving navigation experience.
Patent Information
- Application Number
- CN202480036965.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-09-11
- Filing Date
- 2024-05-29
- Publication Date
- 2025-12-30
AI Technical Summary
In existing technologies, users face cognitive burden and processor battery power waste when navigating to the location of other electronic devices, especially under privacy protection requirements, making it difficult to effectively manage personally identifiable information.
By providing navigation to destinations based on location information shared with electronic devices, redundant user input is reduced, and intuitive user interfaces are generated using contact strength sensors and haptic outputs, while ensuring privacy protection.
It reduces the cognitive burden on users, minimizes the waste of processor and battery power, meets privacy protection requirements, and improves navigation efficiency.
Smart Images

Figure CN121241246A_ABST
Abstract
Description
Cross-reference to related applications
[0001] This application claims the benefits of U.S. Provisional Application No. 63 / 505,910, filed June 2, 2023, and U.S. Provisional Application No. 63 / 581,955, filed September 11, 2023, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field
[0002] This disclosure relates in its entirety to user interfaces that enable users to navigate to the location of findable items (e.g., other electronic devices) on an electronic device. Background Technology
[0003] In recent years, user interaction with electronic devices has increased significantly. These devices can include computers, tablets, televisions, multimedia devices, mobile devices, and so on.
[0004] In some situations, users may want to use such devices to navigate to the location of other electronic devices (e.g., trackable items). Enhancing user interaction with the device improves the user experience and reduces user interaction time, which is especially important when the input device is battery powered. Summary of the Invention
[0005] Some embodiments described in this disclosure involve one or more electronic devices that provide navigation to a destination (including the location of other electronic devices) based on location information shared with the electronic devices.
[0006] As is widely recognized, the use of personally identifiable information should comply with privacy policies and practices that are generally accepted to meet or exceed industry or governmental requirements for protecting user privacy. Specifically, personally identifiable information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use, and the nature of authorized use should be clearly explained to users.
[0007] The accompanying drawings and detailed descriptions provide a full description of the embodiments. It should be understood that the above-described invention does not limit the scope of this disclosure in any way. Attached Figure Description
[0008] To better understand the various described embodiments, reference should be made to the following detailed description in conjunction with the accompanying drawings, in which similar reference numerals indicate corresponding parts throughout the drawings.
[0009] Figure 1A This is a block diagram illustrating a portable multi-functional device with a touch-sensitive display according to some implementation schemes.
[0010] Figure 1B This is a block diagram illustrating exemplary components for event handling according to some implementation schemes.
[0011] Figure 2 Examples of portable multi-functional devices with touchscreens according to some implementation schemes are shown.
[0012] Figure 3 This is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to some implementation schemes.
[0013] Figure 4A An exemplary user interface for applying menus on a portable multifunction device according to some implementations is shown.
[0014] Figure 4B An exemplary user interface of a multifunctional device having a touch-sensitive surface separate from the display is illustrated according to some embodiments.
[0015] Figure 5A Examples of personal electronic devices according to some implementation schemes are shown.
[0016] Figure 5B This is a block diagram illustrating a personal electronic device according to some implementation schemes.
[0017] Figures 5C to 5D Exemplary components of a personal electronic device having a touch-sensitive display and an intensity sensor according to some embodiments are illustrated.
[0018] Figures 5E to 5H Exemplary components and user interfaces of a personal electronic device according to some implementation schemes are illustrated.
[0019] Figures 6A to 6KK Exemplary methods according to some embodiments of the present disclosure are illustrated, wherein an electronic device facilitates navigation to the location of one or more second electronic devices based on location information of one or more second electronic devices.
[0020] Figure 7 This is a flowchart illustrating a method for facilitating navigation to the location of one or more second electronic devices based on location information of one or more second electronic devices, according to some embodiments of the present disclosure. Detailed Implementation
[0021] The following description illustrates exemplary methods, parameters, etc. However, it should be understood that such description is not intended to limit the scope of this disclosure, but is provided as a description of exemplary embodiments.
[0022] Some embodiments described in this disclosure involve one or more electronic devices that provide navigation to a destination (including the location of other electronic devices) based on location information shared with the electronic devices.
[0023] Electronic devices need to see the locations of other electronic devices and use location tracking to facilitate navigation to such locations. This technology can reduce the cognitive burden on users of such devices and / or those who wish to control their use of them. Additionally, this technology can reduce processor and battery power that would otherwise be wasted on redundant user input.
[0024] Although the following description uses the terms "first," "second," etc., to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first touch may be named a second touch and similarly, a second touch may be named a first touch, without departing from the scope of the various described embodiments. Both the first touch and the second touch are touches, but they are not the same touch.
[0025] The terminology used in the description of the various described embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and the appended claims, the singular forms “a” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and covers any and all possible combinations of one or more of the associated listed items. It will also be understood that the terms “comprising” and / or “including” as used in this specification specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0026] Depending on the context, the term "if" may optionally be interpreted as meaning "when," "in response to," or "in response to detection." Similarly, depending on the context, the phrases "if it is determined..." or "if [the stated condition or event] is detected" may optionally be interpreted as meaning "in response to determining..." or "in response to detecting [the stated condition or event]."
[0027] This document describes implementations of electronic devices, user interfaces for such devices, and associated processes for using such devices. In some implementations, the device is a portable communication device, such as a mobile phone, that also includes other functionalities such as PDA and / or music player functionality. Exemplary implementations of portable multi-functional devices include, but are not limited to, the iPhone from Apple Inc. (Cupertino, California). ® Devices, iPod Touch ® Devices and / or iPads ® Device. Optionally, other portable electronic devices may be used, such as laptops or tablets with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads).
[0028] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device may optionally include one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick.
[0029] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications.
[0030] Various applications running on this device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or within the respective applications. In this way, the common physical architecture of the device (such as the touch-sensitive surface) optionally utilizes a user interface that is intuitive and clear to the user to support various applications.
[0031] Now let’s turn our attention to implementation schemes for portable devices with touch-sensitive displays. Figure 1AThis is a block diagram illustrating a portable multi-functional device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a “touchscreen” for convenience, and is sometimes referred to as or called a “touch-sensitive display system.” Device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more haptic output generators 167 for generating haptic outputs on device 100 (e.g., generating haptic outputs on a touch-sensitive surface such as the touch-sensitive display system 112 of device 100 or the touchpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.
[0032] As used in this specification and claims, the term "intensity" of contact on a tactile surface refers to the force or pressure (force per unit area) of a contact (e.g., finger contact) on a tactile surface, or to a substitute (alternative) for the force or pressure of a contact on a tactile surface. The intensity of contact has a range of values that includes at least four different values and more typically hundreds of different values (e.g., at least 256). The intensity of contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the tactile surface are optionally used to measure the force at different points on the tactile surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the tactile surface. Alternatively, the size and / or change of the contact area detected on the touch-sensitive surface, the capacitance and / or change of the touch-sensitive surface adjacent to the contact, and / or the resistance and / or change of the touch-sensitive surface adjacent to the contact are optionally used as substitutes for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some embodiments, the substitute measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of user input allows users to access additional device functionality that would otherwise be inaccessible to the user on a space-constrained, scaled-down device used (e.g., on a touch-sensitive display) to display an indication and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).
[0033] As used in this specification and claims, the term "haptic output" refers to a physical displacement of the device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., the housing), or a displacement of a component relative to the center of mass of the device, which is detected by the user using the user's tactile sense. For example, when the device or a component of the device comes into contact with a touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical characteristics of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or touchpad) may optionally be interpreted by the user as a "press-click" or "release-click" on a physically actuated button. In some cases, the user will feel a tactile sensation, such as a "press-click" or "release-click," even when a physically actuated button associated with the touch-sensitive surface, which has been physically pressed (e.g., displaced) by the user's movement, does not move. As another example, even when the smoothness of the tactile surface remains unchanged, the movement of the tactile surface can optionally be interpreted or perceived by the user as the "roughness" of the tactile surface. While such interpretations of touch by users will be limited by the individualized sensory perceptions of the user, many sensory perceptions of touch are common to most users. Therefore, when a tactile output is described as corresponding to a specific sensory perception of the user (e.g., "release click", "press click", "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or its components that will generate the sensory perception described by a typical (or common) user.
[0034] It should be understood that device 100 is merely an example of a portable multifunctional device, and device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of these components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both, including one or more signal processing and / or application-specific integrated circuits.
[0035] Memory 102 optionally includes high-speed random access memory, and also optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.
[0036] Peripheral interface 118 can be used to couple the device's input and output peripherals to CPU 120 and memory 102. One or more processors 120 run or execute various software programs and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.
[0037] RF (Radio Frequency) circuit 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuit 108 converts electrical signals into electromagnetic signals / converts electromagnetic signals into electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. RF circuit 108 optionally includes well-known circuitry for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, subscriber identity module (SIM) cards, memory, etc. RF circuit 108 optionally communicates wirelessly with networks (such as the Internet (also known as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs))) and other devices. RF circuit 108 optionally includes well-known circuitry for detecting near-field communication (NFC) fields, such as via short-range communication radio components. Wireless communication may optionally employ any of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed Downlink Packet Access (HSDPA), High-Speed Uplink Packet Access (HSUPA), Evolution, Pure Data (EV-DO), HSPA, HSPA+, Dual-Unit HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), and Wi-Fi (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Messaging Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence with Extended Utility (SIMPLE), Instant Messaging and Presence Service (IMPS)) and / or Short Message Service (SMS), or any other suitable communication protocol that has not been developed as of the date of this document submission.
[0038] Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between the user and device 100. Audio circuitry 110 receives audio data from peripheral interface 118, converts the audio data into electrical signals, and sends the electrical signals to speaker 111. Speaker 111 converts the electrical signals into sound waves that are audible to humans. Audio circuitry 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuitry 110 converts the electrical signals into audio data and sends the audio data to peripheral interface 118 for processing. Audio data is optionally retrieved from memory 102 and / or sent to RF circuitry 108 by peripheral interface 118. In some embodiments, audio circuitry 110 also includes a headset jack (e.g., ...). Figure 2 (212 in the text). The headset jack provides an interface between the audio circuitry 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset with both outputs (e.g., a single-ear or dual-ear headset) and inputs (e.g., a microphone).
[0039] I / O subsystem 106 couples input / output peripherals (such as touchscreen 112 and other input control devices 116) on device 100 to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, optical sensor controller 158, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive electrical signals from / transmit electrical signals to the other input control device 116. Other input control devices 116 optionally include physical buttons (e.g., push-buttons, rocker buttons, etc.), dial pads, slide switches, joysticks, click dials, etc. In some alternative embodiments, input controllers 160 are optionally coupled to (or not coupled to) any of the following: keyboard, infrared port, USB port, and pointing device such as mouse. One or more buttons (e.g., ... Figure 2 Optionally, 208) includes an increase / decrease button for volume control of speaker 111 and / or microphone 113. The one or more buttons optionally include a push-button (e.g., Figure 2 (206 in the middle).
[0040] A quick press of a push button optionally disengages the touchscreen 112 from its lock or optionally initiates a process of unlocking the device using gestures on the touchscreen, as described in U.S. Patent Application 11 / 322,549 (i.e., U.S. Patent No. 7,657,849), filed December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," the entire contents of which are incorporated herein by reference. A long press of a push button (e.g., 206) optionally powers the device 100 on or off. The functionality of one or more of these buttons is optionally user-customizable. The touchscreen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.
[0041] The touch-sensitive display 112 provides input and output interfaces between the device and the user. The display controller 156 receives electrical signals from and / or transmits electrical signals to the touchscreen 112. The touchscreen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively, "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.
[0042] Touchscreen 112 has a touch-sensitive surface, sensor, or sensor array that accepts input from a user based on tactile and / or haptic contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction set in memory 102) detect contact on touchscreen 112 (and any movement or interruption of that contact) and translate the detected contact into interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on touchscreen 112. In an exemplary embodiment, the contact point between touchscreen 112 and the user corresponds to the user's finger.
[0043] Touchscreen 112 optionally employs LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, but other display technologies are used in other embodiments. Touchscreen 112 and display controller 156 optionally employ any of a variety of touch sensing technologies now known or to be developed thereafter, along with other proximity sensor arrays or other elements for determining one or more points of contact with touchscreen 112, to detect contact and any movement or interruption thereof. These various touch sensing technologies include, but are not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in the iPhone from Apple Inc. (Cupertino, California). ®and iPod Touch ® The technology used.
[0044] In some embodiments of the touchscreen 112, the touch-sensitive display optionally resembles a multi-touch-sensitive touchpad described in the following U.S. patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman) and / or U.S. Patent Publication 2002 / 0015024A1, each of which is incorporated herein by reference in its entirety. However, the touchscreen 112 displays visual output from the device 100, while the touch-sensitive touchpad does not provide visual output.
[0045] The touch-sensitive display in some embodiments of the touchscreen 112 is described in the following applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, “Multipoint Touch Surface Controller”; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, “Multipoint Touchscreen”; (3) U.S. Patent Application No. 10 / 903,964, filed July 30, 2004, “Gestures For Touch Sensitive Input Devices”; (4) U.S. Patent Application No. 11 / 048,264, filed January 31, 2005, “Gestures For Touch Sensitive Input Devices”; and (5) U.S. Patent Application No. 11 / 038,590, filed January 18, 2005, “Mode-Based Graphical User Interfaces For Touch Sensitive Input”. (6) U.S. Patent Application No. 11 / 228,758, filed September 16, 2005, “Virtual Input Device Placement On A Touch Screen User Interface”; (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, “Operation Of A Computer With A Touch Screen Interface”; (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, “Activating Virtual Keys Of ATouch-Screen Virtual Keyboard”; and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, “Multi-Functional Hand-Held Device”. The full text of all these applications is incorporated herein by reference.
[0046] Touchscreen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. Users optionally use any suitable object or accessory such as a stylus, finger, etc., to interact with touchscreen 112. In some embodiments, the user interface is designed to operate primarily through finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of a finger on the touchscreen. In some embodiments, the device translates coarse finger-based input into precise pointer / cursor positioning or commands for performing the user-desired actions.
[0047] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of the device that, unlike the touchscreen, does not display visual output. The touchpad is optionally a touch-sensitive surface separate from the touchscreen 112, or an extension of the touch-sensitive surface formed by the touchscreen.
[0048] The device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., a battery, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in the portable device.
[0049] The device 100 may optionally also include one or more optical sensors 164. Figure 1AAn optical sensor 164 is shown coupled to an optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with an imaging module 143 (also referred to as a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, facing away from a touchscreen display 112 on the front of the device, allowing the touchscreen display to be used as a viewfinder for still image and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, allowing images of the user to be optionally acquired for video conferencing while the user views other video conferencing participants on the touchscreen display. In some embodiments, the positioning of the optical sensor 164 can be changed by the user (e.g., by rotating the lenses and sensors within the device housing), allowing a single optical sensor 164 to be used in conjunction with the touchscreen display for both video conferencing and still image and / or video image acquisition.
[0050] The device 100 may optionally also include one or more contact strength sensors 165. Figure 1A A contact strength sensor is shown coupled to a strength sensor controller 159 in I / O subsystem 106. The contact strength sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electro-force sensors, piezoelectric sensors, optical force sensors, capacitive touch-sensitive surfaces, or other strength sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). The contact strength sensor 165 receives contact strength information (e.g., pressure information or a substitute for pressure information) from the environment. In some embodiments, at least one contact strength sensor is arranged juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact strength sensor is located on the rear of device 100, opposite to the touchscreen display 112 located on the front of device 100.
[0051] The device 100 optionally also includes one or more proximity sensors 166. Figure 1AA proximity sensor 166 coupled to a peripheral device interface 118 is shown. Alternatively, the proximity sensor 166 may optionally be coupled to an input controller 160 in an I / O subsystem 106. The proximity sensor 166 may optionally be configured as described in the following U.S. patent applications: 11 / 241,839, entitled "Proximity Detector In Handheld Device"; 11 / 240,788, entitled "Proximity Detector In Handheld Device"; 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; 11 / 586,862, entitled "Automated Response To And Sensing Of User Activity In Portable Devices"; and 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", the entire contents of which are incorporated herein by reference. In some implementations, when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call), the proximity sensor is turned off and the touchscreen 112 is disabled.
[0052] The device 100 may optionally also include one or more tactile output generators 167. Figure 1A A haptic output generator coupled to a haptic feedback controller 161 in I / O subsystem 106 is shown. The haptic output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components; and / or electromechanical devices for converting energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components for converting electrical signals into haptic outputs on the device). A contact intensity sensor 165 receives haptic feedback generation instructions from a haptic feedback module 133 and generates a haptic output on device 100 that can be felt by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed or adjacent to a haptic surface (e.g., haptic display system 112) and optionally generates the haptic output by moving the haptic surface vertically (e.g., in / outward from the surface of device 100) or laterally (e.g., back and forth in the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is located on the rear of the device 100, opposite to the touch screen display 112 located on the front of the device 100.
[0053] The device 100 may optionally also include one or more accelerometers 168. Figure 1A An accelerometer 168 coupled to a peripheral device interface 118 is shown. Alternatively, the accelerometer 168 may be coupled to an input controller 160 in an I / O subsystem 106. The accelerometer 168 may optionally be configured as described in the following U.S. Patent Publications: 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and 20060017692, entitled "Methods And Apparatuses For Operating A Portable DeviceBased On An Accelerometer," both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed on a touchscreen display in portrait or landscape view based on analysis of data received from one or more accelerometers. Device 100 may optionally include, in addition to the accelerometer 168, a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) for acquiring information about the position and orientation (e.g., portrait or landscape) of device 100.
[0054] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Furthermore, in some embodiments, memory 102 ( Figure 1A ) or 370 ( Figure 3 Storage device / global internal state 157, such as Figure 1A and Figure 3 As shown. Device / global internal state 157 includes one or more of the following: active application state, which indicates which applications (if any) are currently active; display state, indicating what applications, views or other information occupy various areas of the touch screen display 112; sensor state, including information obtained from various sensors and input control devices 116 of the device; and position information relating to the device's position and / or orientation.
[0055] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or embedded operating systems such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.
[0056] The communication module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are adapted to be directly coupled to other devices or indirectly coupled via a network (e.g., the Internet, Wireless LAN, etc.). In some embodiments, the external port is for use with an iPod. ® (Trademark of Apple Inc.) The same or similar and / or compatible multi-pin (e.g., 30-pin) connectors used in Apple Inc. devices.
[0057] The contact / motion module 130 optionally detects contact with the touchscreen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., touchpads or physical click-based rotary dials). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether a contact has occurred (e.g., detecting a finger press event), determining the contact intensity (e.g., the force or pressure of the contact, or an alternative to force or pressure), determining whether there is movement of the contact and tracking movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or a contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to single-point contact (e.g., single-finger contact) or multi-point simultaneous contact (e.g., "multi-touch" / multiple-finger contact). In some implementations, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.
[0058] In some implementations, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by the user (e.g., determining whether the user has “clicked” an icon). In some implementations, at least a subset of the intensity thresholds is determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a specific physical actuator and can be adjusted without changing the physical hardware of device 100). For example, the mouse “click” threshold of a touchpad or touchscreen display can be set to any threshold in a wide range of predefined thresholds without changing the touchpad or touchscreen display hardware. Additionally, in some specific implementations, the user of the device is provided with software settings for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting the individual intensity thresholds and / or by adjusting multiple intensity thresholds at once using system-level clicks on the “intensity” parameter).
[0059] The touch / motion module 130 optionally detects gesture input performed by the user. Different gestures on a touch-sensitive surface have different contact patterns (e.g., different movements, timings, and / or intensities of the detected contact). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes: detecting a finger press event, and then detecting a finger lift-off (lift-away) event at the same (or substantially the same) location as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on a touch-sensitive surface includes: detecting a finger press event, then detecting one or more finger drag events, and subsequently detecting a finger lift-off (lift-away) event.
[0060] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other displays, including components for altering the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.
[0061] In some implementations, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from applications, etc., to specify the graphics to be displayed, and also receives coordinate data and other graphic attribute data if necessary, and then generates screen image data to output to the display controller 156.
[0062] The haptic feedback module 133 includes various software components for generating instructions which are used by the haptic output generator 167 to generate haptic output at one or more locations on the device 100 in response to user interaction with the device 100.
[0063] The text input module 134, optionally a component of the graphics module 132, provides a soft keyboard for entering text in various applications, such as contacts 137, email 140, IM 141, browser 147, and any other application that requires text input.
[0064] GPS module 135 determines the location of the device and provides that information for use in various applications (e.g., to telephone 138 for use in location-based dialing; to camera 143 as image / video metadata; and to applications that provide location-based services, such as weather widgets, local yellow pages widgets, and map / navigation widgets).
[0065] Application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof: Contacts module 137 (sometimes called address book or contact list); Telephone module 138; Video conferencing module 139; Email client module 140; Instant Messaging (IM) module 141; Fitness support module 142; Camera module 143 for still images and / or video images; Image management module 144; Video player module; Music player module; Browser module 147; Calendar module 148; Widget module 149 may optionally include one or more of the following: weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5 and other widgets acquired by the user, as well as user-created widgets 149-6. Module 150 is used to create user-created widgets 149-6; Search module 151; Video and music player module 152, which combines a video player module and a music player module; Memo module 153; Map module 154; and / or Online video module 155.
[0066] Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, Java-enabled applications, encryption, digital rights management, speech recognition, and speech duplication.
[0067] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., in application internal state 192 of the contact module 137 stored in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140, or IM 141; and so on.
[0068] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, telephone module 138 is optionally used to input character sequences corresponding to telephone numbers, access one or more telephone numbers in contact module 137, modify input telephone numbers, dial corresponding telephone numbers, initiate conversations, and disconnect or hang up when a conversation is completed. As noted above, wireless communication optionally employs any of a variety of communication standards, protocols, and technologies.
[0069] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138, video conferencing module 139 includes executable instructions to initiate, conduct, and / or terminate video conferences between the user and one or more other participants based on user instructions.
[0070] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user commands. Combined with image management module 144, email client module 140 makes it very easy to create and send emails containing still images or video images captured by camera module 143.
[0071] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for performing the following operations: entering a character sequence corresponding to an instant message, modifying previously entered characters, sending a corresponding instant message (e.g., using Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocols for telephone-based instant messaging or using XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving an instant message, and viewing received instant messages. In some embodiments, the sent and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Services (EMS). As used herein, "instant message" refers to both telephone-based messages (e.g., messages delivered using SMS or MMS) and internet-based messages (e.g., messages delivered using XMPP, SIMPLE, or IMPS).
[0072] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, fitness support module 142 includes executable instructions for performing the following operations: creating fitness activities (e.g., with time, distance, and / or calorie burning goals); communicating with fitness sensors (exercise equipment); receiving fitness sensor data; calibrating sensors used to monitor fitness; selecting and playing music for fitness activities; and displaying, storing, and transmitting fitness data.
[0073] In conjunction with the touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, camera module 143 includes executable instructions for: capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, and / or deleting still images or videos from memory 102.
[0074] Incorporating the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable instructions for performing operations such as arranging, modifying (e.g., editing) or otherwise manipulating, marking, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.
[0075] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, browser module 147 includes executable instructions for performing the following operations: browsing the Internet according to user instructions, including searching, linking to, receiving, and displaying web pages or portions thereof, as well as links to attachments and other files on web pages.
[0076] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions to create, display, modify, and store calendars and associated data (e.g., calendar entries, to-dos, etc.) according to user instructions.
[0077] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is optionally a micro-application downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or a user-created micro-application (e.g., user-created widget 149-6). In some embodiments, the widget includes HTML (Hypertext Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, the widget includes XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! widgets).
[0078] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget creator module 150 is optionally used by the user to create widgets (e.g., turning user-specified portions of a webpage into widgets).
[0079] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions for performing the following operations: searching the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.
[0080] Combining touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions allowing users to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).
[0081] Combining the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the memo module 153 includes executable instructions for creating and managing memos, to-do items, etc., according to user instructions.
[0082] Combining RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135 and browser module 147, map module 154 is optionally used to receive, display, modify and store maps and data associated with the maps (e.g., driving directions, data related to shops and other points of interest at or near a specific location, and other location-based data) according to user instructions.
[0083] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, the online video module 155 includes instructions for performing the following operations: allowing users to access, browse, receive (e.g., via streaming and / or downloading), play back (e.g., on the touchscreen or on an external display connected via external port 124), send emails with links to specific online videos, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, an instant messaging module 141 is used instead of the email client module 140 to send links to specific online videos. Additional descriptions of the online video application can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are incorporated herein by reference in their entirety.
[0084] Each of the modules and applications described above corresponds to an executable set of instructions for performing one or more functions described above and the methods described in this patent application (e.g., computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) need not be implemented as separate software programs, processes, or modules; therefore, various subsets of these modules may optionally be combined or otherwise rearranged in various embodiments. For example, a video player module may optionally be combined with a music player module into a single module (e.g., Figure 1A (e.g., video and music player module 152). In some embodiments, memory 102 optionally stores a subset of the above-described modules and data structures. Additionally, memory 102 optionally stores additional modules and data structures not described above.
[0085] In some implementations, device 100 is a device on which the operation of a predefined set of functions is performed solely via a touchscreen and / or touchpad. By using a touchscreen and / or touchpad as the primary input control device for operating device 100, the number of physical input control devices (such as push-buttons and dial pads) on device 100 is optionally reduced.
[0086] A predefined set of functions, uniquely performed via a touchscreen and / or touchpad, optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 from any user interface displayed on device 100 to the main menu, main desktop menu, or root menu. In such embodiments, a "menu button" is implemented using the touchpad. In some other embodiments, the menu button is a physical push-button or other physical input control device, rather than a touchpad.
[0087] Figure 1B This is a block diagram illustrating exemplary components for event handling according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3 This includes an event classifier 170 (e.g., in operating system 126) and a corresponding application 136-1 (e.g., any of the aforementioned applications 137 to 151, 155, 380 to 390).
[0088] Event classifier 170 receives event information and determines the application 136-1 and application view 191 of application 136-1 to which the event information should be delivered. Event classifier 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or running. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information should be delivered.
[0089] In some implementations, the application internal state 192 includes additional information such as one or more of the following: recovery information to be used when the application 136-1 resumes execution, user interface state information indicating that information is being displayed or ready to be displayed by the application 136-1, a state queue for enabling the user to return to the previous state or view of the application 136-1, and a repeat / undo queue for the user's previous actions.
[0090] Event monitor 171 receives event information from peripheral interface 118. The event information includes information about sub-events, such as a user touch on touch-sensitive display 112 as part of a multi-touch gesture. Peripheral interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuitry 110). The information received by peripheral interface 118 from I / O subsystem 106 includes information from touch-sensitive display 112 or touch-sensitive surfaces.
[0091] In some implementations, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 sends event information. In other implementations, peripheral device interface 118 sends event information only when a significant event occurs (e.g., receiving input above a predetermined noise threshold and / or receiving input for a predetermined duration).
[0092] In some implementations, the event classifier 170 also includes a hit view determination module 172 and / or an activity event recognizer determination module 173.
[0093] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides a software process for determining where a sub-event has occurred within one or more views. A view consists of controls and other elements that the user can see on the display.
[0094] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the corresponding application) in which a touch is detected optionally corresponds to a procedural level within the application's procedural or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as the hit view, and the set of events identified as correct input is optionally determined, at least in part, based on the hit view of the initial touch that initiates the touch-based gesture.
[0095] The hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchical structure, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchical structure from which the sub-events should be processed. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events forming an event or potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source to which it was identified as the hit view.
[0096] The activity event recognizer determination module 173 determines which views(s) within the view hierarchy should receive a specific sub-event sequence. In some embodiments, the activity event recognizer determination module 173 determines that only the hit view should receive the specific sub-event sequence. In other embodiments, the activity event recognizer determination module 173 determines that all views including the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive the specific sub-event sequence. In other embodiments, even if the touch sub-event is entirely confined to the area associated with a particular view, higher views in the hierarchy will still remain actively participating views.
[0097] Event assigner module 174 assigns event information to event identifiers (e.g., event identifier 180). In embodiments that include active event identifier determination module 173, event assigner module 174 delivers event information to the event identifier determined by active event identifier determination module 173. In some embodiments, event assigner module 174 stores event information in an event queue, which is retrieved by the corresponding event receiver 182.
[0098] In some implementations, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another implementation, event classifier 170 is a separate module or part of another module (such as contact / motion module 130) stored in memory 102.
[0099] In some implementations, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes a plurality of event recognizers 180. In other implementations, one or more of the event recognizers 180 are part of a separate module, such as a user interface toolkit (not shown) or a higher-level object from which application 136-1 inherits methods and other properties. In some implementations, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handlers 190 optionally utilize or invoke the data updater 176, the object updater 177, or the GUI updater 178 to update the application's internal state 192. Alternatively, one or more application views in application view 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.
[0100] The corresponding event identifier 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event identifier 180 also includes at least one subset of metadata 183 and event delivery instructions 188 (which optionally include sub-event delivery instructions).
[0101] Event receiver 182 receives event information from event classifier 170. The event information includes information about sub-events, such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves touch movement, the event information optionally also includes the speed and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a portrait orientation to a lateral orientation, or vice versa), and the event information includes corresponding information about the device's current orientation (also referred to as device orientation).
[0102] Event comparator 184 compares event information with predefined event or sub-event definitions and determines the event or sub-event based on the comparison, or determines or updates the state of the event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 contains definitions of events (e.g., predefined sequences of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, event 1 (187-1) is defined as a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift-off of a predetermined duration (touch end), a second touch (touch start) of a predetermined duration on the displayed object, and a second lift-off of a predetermined duration (touch end). In another example, event 2 (187-2) is defined as a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on the displayed object, movement of the touch on the touch-sensitive display 112, and lifting the touch (end of touch). In some embodiments, the event also includes information for one or more associated event handlers 190.
[0103] In some implementations, event definition 187 includes definitions of events for corresponding user interface objects. In some implementations, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects the event handler associated with the sub-event and the object that triggered the hit test.
[0104] In some implementations, the definition of the corresponding event (187) also includes a delay action that delays the delivery of event information until it has been determined whether the sub-event sequence actually corresponds to or does not correspond to the event type of the event recognizer.
[0105] When the corresponding event recognizer 180 determines that the sub-event sequence does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events based on touch gestures are ignored. In this case, other event recognizers (if any) that remain active in the hit view continue to track and process the ongoing sub-events based on touch gestures.
[0106] In some embodiments, the corresponding event recognizer 180 includes metadata 183 having configurable attributes, flags, and / or lists instructing how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing how or how event recognizers can interact with each other. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing whether sub-events are delivered to different levels in a view or programmatic hierarchy.
[0107] In some implementations, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates the event handler 190 associated with the event. In some implementations, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from delivering (and deferred delivering) the sub-events to the corresponding hit view. In some implementations, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with the flag acquires the flag and performs a predefined process.
[0108] In some implementations, event delivery instruction 188 includes a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with the sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or the actively participating view receives the event information and performs a predetermined process.
[0109] In some implementations, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some implementations, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the positioning of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and transmits that display information to graphics module 132 for display on a touch-sensitive display.
[0110] In some implementations, event handler 190 includes, or has access to, a data updater 176, an object updater 177, and a GUI updater 178. In some implementations, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other implementations, they are included in two or more software modules.
[0111] It should be understood that the above discussion regarding event handling for user touch on a touch-sensitive display also applies to other forms of user input used to operate the multifunction device 100 using an input device, and not all user input is initiated on the touchscreen. For example, mouse movement and mouse button presses optionally in conjunction with single or multiple keyboard presses or holds; touch movements on the touchpad, such as taps, drags, scrolls, etc.; stylus input; device movement; verbal commands; detected eye movements; biometric input; and / or any combination thereof may optionally be used as input corresponding to sub-events that define the event to be identified.
[0112] Figure 2A portable multifunction device 100 with a touchscreen 112 is illustrated according to some embodiments. The touchscreen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more graphics by gesturing over the graphics, for example, using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of one or more graphics occurs when the user breaks contact with one or more graphics. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or scrolling (from right to left, from left to right, up and / or down) of a finger already in contact with the device 100. In some specific embodiments or in some cases, unintentional contact with a graphic does not select the graphic. For example, a swipe gesture over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.
[0113] Device 100 optionally also includes one or more physical buttons, such as a "main desktop" or menu button 204. As previously described, menu button 204 is optionally used to navigate to any application 136 of a set of applications optionally executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on touchscreen 112.
[0114] In some embodiments, device 100 includes a touchscreen 112, a menu button 204, a push-button 206 for powering on / off and locking the device, one or more volume control buttons 208, a subscriber identity module (SIM) card slot 210, a headset jack 212, and a docking / charging external port 124. The push-button 206 is optionally used to: power on / off the device by pressing the button and holding it in the pressed state for a predefined time interval; lock the device by pressing the button and releasing it before the predefined time interval has elapsed; and / or unlock the device or initiate an unlocking process. In another embodiment, device 100 also accepts voice input via microphone 113 for activating or deactivating certain functions. Device 100 also optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on the touchscreen 112, and / or one or more haptic output generators 167 for generating haptic outputs for the user of device 100.
[0115] Figure 3This is a block diagram of an exemplary multi-functional device with a display and a touch-sensitive surface according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a children's learning toy), gaming system, or control device (e.g., a home controller or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuitry (sometimes referred to as a chipset) that interconnects system components and controls communication between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touchscreen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, and a haptic output generator 357 for generating haptic output on device 300 (e.g., similar to the reference above). Figure 1A The described tactile output generator 167), sensor 359 (e.g., optical sensor, accelerometer, proximity sensor, touch sensor and / or contact intensity sensor (similar to the one described above)) Figure 1A The described contact strength sensor 165). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU 310. In some embodiments, memory 370 stores information related to portable multifunction device 100. Figure 1A The memory 370 stores programs, modules, and data structures similar to those in the memory 102 of the portable multifunction device 100, or subsets thereof. Additionally, the memory 370 optionally stores additional programs, modules, and data structures not present in the memory 102 of the portable multifunction device 100. For example, the memory 370 of the device 300 optionally stores a drawing module 380, a rendering module 382, a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while the portable multifunction device 100 (… Figure 1A The memory 102 may optionally not store these modules.
[0116] Figure 3Each of the elements described above is optionally stored in one or more memory devices of the previously mentioned memory devices. Each of the modules described above corresponds to a set of instructions for performing the functions described above. The modules or programs (e.g., instruction sets) described above need not be implemented as separate software programs, processes, or modules, and therefore various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores a subset of the modules and data structures described above. In addition, memory 370 optionally stores additional modules and data structures not described above.
[0117] Now let’s turn our attention to the implementation of the user interface, which is optionally implemented on, for example, a portable multifunction device 100.
[0118] Figure 4A An exemplary user interface for an application menu on a portable multifunction device 100 according to some embodiments is illustrated. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes elements or a subset or superset thereof: Signal strength indicator 402 for wireless communications such as cellular signals and Wi-Fi signals; Time 404; Bluetooth indicator 405; Battery status indicator 406; Tray 408 features icons for frequently used applications, such as: ○ The telephone module 138 has an icon 416 labeled "telephone", which optionally includes an indicator 414 indicating the number of missed calls or voicemail messages; ○ An icon 418 labeled "Mail" in the email client module 140, which optionally includes an indicator 410 for the number of unread emails; ○ The icon 420 labeled "Browser" in browser module 147; and ○ The video and music player module 152 (also known as the iPod (Apple Inc. trademark) module 152) is marked with an icon 422 labeled "iPod"; and Icons of other applications, such as: ○The icon 424 of the IM module 141 marked as "Message"; ○The calendar module 148 has an icon 426 labeled "Calendar"; ○ The icon 428 of the image management module 144 is labeled "Photo". ○ The icon 430 of camera module 143, which is labeled "camera"; ○ The icon 432 of the online video module 155, which is labeled "Online Video"; ○ The icon 434 labeled "Stock Market" in the Stock Market widget 149-2; ○The icon 436 of the map module 154 that is labeled "map"; ○The weather widget 149-1 has icon 438 labeled "weather"; ○ The alarm clock widget 149-4 has an icon 440 labeled "clock"; ○ The icon 442 of the fitness support module 142 is labeled "fitness support"; ○ The icon 444 labeled "Memo" in the Memo module 153; and ○ Set an icon 446 labeled "Settings" for an application or module, which provides access to settings for device 100 and its various applications 136.
[0119] It should be pointed out that, Figure 4A The illustrated icon labels are merely exemplary. For example, icon 422 of video and music player module 152 is labeled "Music" or "Music Player". Other labels may be optionally used for various application icons. In some embodiments, the label of a particular application icon includes the name of the application corresponding to that particular application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to that particular application icon.
[0120] Figure 4B An example is illustrated having a touch-sensitive surface 451 (e.g., separate from the display 450 (e.g., touchscreen display 112)). Figure 3 A tablet device or touchpad 355) device (e.g., Figure 3 An exemplary user interface on the device 300. The device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of the sensors 359) for detecting the intensity of contact on the tactile surface 451 and / or one or more tactile output generators 357 for generating tactile outputs for the user of the device 300.
[0121] While some examples of input on a touchscreen display 112 (which combines a touch-sensitive surface and a display) are given below, in some implementations the device detects input on a touch-sensitive surface separate from the display, such as... Figure 4B As shown. In some implementations, the touch-sensitive surface (e.g., Figure 4B451) has a spindle (e.g., on the display (e.g., 450) corresponding to the main axis on the display (e.g., Figure 4B The main shaft of 453 in the middle (e.g., Figure 4B (452 in the example). According to these embodiments, the device detects the position corresponding to a specific location on the display (e.g., in...). Figure 4B In the diagram, 460 corresponds to 468 and 462 corresponds to 470) is in contact with the touch-sensitive surface 451 (e.g., Figure 4B (460 and 462 in the text). Thus, when the touch-sensitive surface (e.g., ...) Figure 4B 451 in the middle) and the display of a multi-functional device (e.g., Figure 4B When 450 is separated from the touch-sensitive surface, user input detected by the device on that touch-sensitive surface (e.g., touches 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods may be optionally used for other user interfaces described herein.
[0122] Additionally, while the examples below are given primarily with reference to finger input (e.g., finger touch, finger tap, finger swipe), it should be understood that in some implementations, one or more of these finger inputs may be replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may optionally be replaced by a mouse click (e.g., instead of a touch), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the touch). As another example, a tap gesture may optionally be replaced by a mouse click while the cursor is over the location of the tap gesture (e.g., instead of detection of touch, followed by cessation of touch detection). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may optionally be used simultaneously, or mouse and finger touch may optionally be used simultaneously.
[0123] Figure 5A An exemplary personal electronic device 500 is illustrated. Device 500 includes a body 502. In some embodiments, device 500 may include components relative to devices 100 and 300 (e.g., Figures 1A to 4BThe device 500 may include some or all of the features described herein. In some embodiments, the device 500 has a touch-sensitive display 504, referred to below as a touchscreen 504. Alternatively, or in addition to the touchscreen 504, the device 500 may also have a display and a touch-sensitive surface. Similar to the cases of devices 100 and 300, in some embodiments, the touchscreen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of an applied contact (e.g., a touch). The one or more intensity sensors of the touchscreen 504 (or touch-sensitive surface) may provide output data representing the intensity of the touch. The user interface of the device 500 may respond to touches based on the intensity of the touch, meaning that touches of different intensities may invoke different user interface operations on the device 500.
[0124] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related applications: International Patent Application Serial No. PCT / US2013 / 040061, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Displaying UserInterface Objects Corresponding to an Application,” published as WIPO Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, filed November 11, 2013, entitled “Device, Method, and Graphical User Interface for Transitioning Between TouchInput to Display Output Relationships,” published as WIPO Publication No. WO / 2014 / 105276, each of which is incorporated herein by reference in its entirety.
[0125] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508, if included, can be physical. Examples of physical input mechanisms include push-buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, allow device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watch straps, bangles, trousers, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow a user to wear device 500.
[0126] Figure 5BAn exemplary personal electronic device 500 is depicted. In some embodiments, device 500 may include, relative to... Figure 1A , Figure 1B and Figure 3 Some or all of the components described. Device 500 has a bus 512 that operatively couples I / O portion 514 to memory 518 and one or more computer processors 516. I / O portion 514 may be connected to display 504, which may have touch-sensitive component 522 and optionally have intensity sensor 524 (e.g., contact intensity sensor). Furthermore, I / O portion 514 may be connected to communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 may optionally be a rotatable input device or a pressable and rotatable input device. In some examples, input mechanism 508 may optionally be a button.
[0127] In some examples, the input mechanism 508 is optionally a microphone. The personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which are operatively connected to the I / O section 514.
[0128] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions, which, when executed by one or more computer processors 516, may cause the computer processors to perform, for example, the techniques described below, including process 700. Figure 7 A computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, or device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media can include, but is not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on CD, DVD, or Blu-ray technology, and persistent solid-state storage such as flash memory, solid-state drives, etc. Personal electronic devices are not limited to... Figure 5B It can be the components and configurations, or it can include other components or additional components in a variety of configurations.
[0129] Furthermore, in a method described herein where one or more steps depend on the satisfaction of one or more conditions, it should be understood that the method may be repeated in multiple repetitions such that, during the repetitions, all conditions determining the steps in the method are satisfied in different repetitions of the method. For example, if the method requires performing a first step (if the conditions are satisfied) and a second step (if the conditions are not satisfied), those skilled in the art will know that the stated steps are repeated until both conditions are satisfied and not satisfied (in no particular order). Thus, a method described as having one or more steps depending on the satisfaction of one or more conditions can be rewritten as a method that repeats until each condition described in the method is satisfied. However, this does not require the system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing discretionary operations based on the satisfaction of the corresponding one or more conditions, and thus to determine whether possible conditions have been satisfied without explicitly repeating the steps of the method until all conditions determining the steps in the method are satisfied. Those skilled in the art will also understand that, similar to a method having discretionary steps, a system or computer-readable storage medium may repeat the steps of the method multiple times as needed to ensure that all discretionary steps have been performed.
[0130] As used herein, the term "power indication" refers optionally to the power indication in devices 100, 300, and / or 500 ( Figure 1A , Figure 3 and Figures 5A to 5B A user-interactive graphical user interface object displayed on a screen. For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) optionally each constitute a functional representation.
[0131] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some specific implementations that include a cursor or other positional marker, the cursor acts as a "focus selector," such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), the cursor is positioned on a touch-sensitive surface (e.g., a...). Figure 3 The touchpad 355 or Figure 4B When an input (e.g., a press input) is detected on the touch-sensitive surface 451 of the display, the specific user interface element is adjusted according to the detected input. This applies to touchscreen displays (e.g., those capable of direct interaction with user interface elements on a touchscreen display) that enable direct interaction with user interface elements on the touchscreen display. Figure 1A The touch-sensitive display system 112 or Figure 4AIn some embodiments of the touchscreen 112, a touch detected on the touchscreen acts as a "focus selector," such that when input (e.g., a press input by touch) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, that particular user interface element is adjusted according to the detected input. In some embodiments, focus moves from one area of the user interface to another without corresponding movement of the cursor or movement of a touch on the touchscreen display (e.g., moving focus from one button to another using tab keys or arrow keys); in these embodiments, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user-controlled user interface element (or a touch on the touchscreen display) that conveys the user's expected interaction with the user interface (e.g., by indicating to the device the elements of the user interface that the user expects to interact with). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of the focus selector (e.g., a cursor, touch, or selection box) above the corresponding button will indicate to the user that they expect to activate the corresponding button (rather than other user interface elements shown on the device's display).
[0132] As used in the specification and claims, the term "characteristic strength" of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic strength is based on multiple intensity samples. The characteristic strength is optionally based on a predefined number of intensity samples or a set of intensity samples collected over a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted off, before or after contact begins to move, before contact ends, before or after contact intensity is detected to increase, and / or before or after contact intensity decreases). The characteristic strength of the contact is optionally based on one or more of the following: the maximum value of the contact intensity, the mean value of the contact intensity, the average value of the contact intensity, the value at the top 10% of the contact intensity, the half maximum value of the contact intensity, or the 90% maximum value of the contact intensity, etc. In some embodiments, the duration of the contact is used when determining the characteristic strength (e.g., when the characteristic strength is the average value of the contact intensity over time). In some implementations, the characteristic intensity is compared to a set of one or more intensity thresholds to determine whether a user has performed an action. For example, the set of one or more intensity thresholds may optionally include a first intensity threshold and a second intensity threshold. In this example, contact with a characteristic intensity not exceeding the first threshold results in a first action, contact with a characteristic intensity exceeding the first intensity threshold but not exceeding the second intensity threshold results in a second action, and contact with a characteristic intensity exceeding the second threshold results in a third action. In some implementations, a comparison between the characteristic intensity and one or more thresholds is used to determine whether one or more actions should be performed (e.g., whether to perform the corresponding action or abandon performing the corresponding action) rather than to determine whether to perform the first action or the second action.
[0133] Figure 5C An example is shown using multiple intensity sensors 524A-524D to detect multiple contacts 552A-552E on a touch-sensitive display 504. Figure 5C It also includes an intensity graph, which shows the current intensity measurements of intensity sensors 524A-524D relative to intensity units. In this example, the intensity measurements of intensity sensors 524A and 524D are both 9 intensity units, and the intensity measurements of intensity sensors 524B and 524C are both 7 intensity units. In some embodiments, the cumulative intensity is the sum of the intensity measurements of the multiple intensity sensors 524A-524D, which is 32 intensity units in this example. In some implementations, each contact is assigned a corresponding intensity, i.e., a portion of the cumulative intensity. Figure 5DAn example is given of assigning cumulative intensity to contacts 552A-552E based on their distance from the center of force 554. In this example, each of contacts 552A, 552B, and 552E is assigned a contact intensity of 8 intensity units of the cumulative intensity, and each of contacts 552C and 552D is assigned a contact intensity of 4 intensity units of the cumulative intensity. More generally, in some specific implementations, each contact j is assigned a corresponding intensity Ij according to a predefined mathematical function Ij = A·(Dj / ΣDi), which is a portion of the cumulative intensity A, where Dj is the distance of the corresponding contact j from the center of force, and ΣDi is the sum of the distances of all corresponding contacts (e.g., i=1 to the last) from the center of force. Reference can be performed using electronic devices similar to or equivalent to devices 100, 300, or 500. Figures 5C to 5D The described operation. In some embodiments, the characteristic intensity of the contact is based on one or more intensities of the contact. In some embodiments, an intensity sensor is used to determine the intensity of a single characteristic (e.g., the single characteristic intensity of a single contact). It should be noted that the intensity map is not part of the displayed user interface, but is included within... Figures 5C to 5D This is intended to assist readers.
[0134] In some implementations, a portion of the gesture is identified for determining the characteristic intensity. For example, the touch-sensitive surface optionally receives a series of swipe contacts that transition from a starting position to an ending position, where the contact intensity increases. In this example, the characteristic intensity of the contact at the ending position is optionally based only on a portion of the series of swipe contacts, rather than the entire swipe contact (e.g., only the portion of the swipe contact at the ending position). In some implementations, a smoothing algorithm is optionally applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of the following: unweighted moving average smoothing algorithm, triangular smoothing algorithm, median filter smoothing algorithm, and / or exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow spikes or dips in the intensity of the swipe contact to achieve the purpose of determining the characteristic intensity.
[0135] Optionally, the contact intensity on a touch-sensitive surface is characterized relative to one or more intensity thresholds, such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device performs an operation typically associated with clicking a button on a physical mouse or touchpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device performs an operation different from the operation typically associated with clicking a button on a physical mouse or touchpad. In some embodiments, when a contact with a characteristic intensity lower than the light press intensity threshold (e.g., and higher than the nominal contact detection intensity threshold, where contacts lower than the nominal contact detection intensity threshold are no longer detected) is detected, the device will move the focus selector based on the movement of the contact on the touch-sensitive surface without performing the operation associated with the light press intensity threshold or the deep press intensity threshold. Generally, unless otherwise stated, these intensity thresholds are consistent across different groups of user interface figures.
[0136] The intensity of a contact increasing from below a light press intensity threshold to between a light press intensity threshold and a deep press intensity threshold is sometimes referred to as a "light press" input. The intensity of a contact increasing from below a deep press intensity threshold to above a deep press intensity threshold is sometimes referred to as a "deep press" input. The intensity of a contact increasing from below a contact detection intensity threshold to between a contact detection intensity threshold and a light press intensity threshold is sometimes referred to as detecting a contact on the touch surface. The intensity of a contact decreasing from above a contact detection intensity threshold to below a contact detection intensity threshold is sometimes referred to as detecting a contact being lifted off the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.
[0137] In some embodiments described herein, one or more operations are performed in response to detecting a gesture including a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting that the intensity of the contact (or multiple contacts) increases to above a press input intensity threshold. In some embodiments, the corresponding operation is performed in response to detecting that the intensity of the corresponding contact increases to above a press input intensity threshold (e.g., a "downward stroke" of the corresponding press input). In some embodiments, the press input includes the intensity of the corresponding contact increasing to above a press input intensity threshold and the intensity of the contact subsequently decreasing to below the press input intensity threshold, and the corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the press input threshold (e.g., an "upward stroke" of the corresponding press input).
[0138] Figures 5E to 5H An example of gesture detection is given, where the gesture includes the intensity of contact 562 ranging from less than... Figure 5E The light press intensity threshold (e.g., "IT") L The intensity of ) increases to higher than Figure 5H The deep press intensity threshold (e.g., "IT") D The intensity of the press input corresponds to the strength of the press. On the user interface 570, which includes application icons 572A-572D displayed in the predefined area 574, when a cursor 576 is displayed above the application icon 572B corresponding to application 2, a gesture performed using contact 562 is detected on the touch-sensitive surface 560. In some embodiments, the gesture is detected on the touch-sensitive display 504. The intensity sensor detects the intensity of the contact on the touch-sensitive surface 560. The device determines the intensity of the contact 562 within a deep press intensity threshold (e.g., "IT"). D The intensity reaches its peak at 562. Contact 562 is maintained on the touch-sensitive surface 560. In response to a detected gesture, and based on the intensity increasing to a deep press intensity threshold during the gesture (e.g., "IT"), the intensity is increased to a peak value. D The above contact 562 displays the scale representation 578A-578C (e.g., thumbnails) of the document recently opened for application 2, such as... Figures 5F to 5H As shown. In some embodiments, the intensity is the characteristic intensity of the contact compared to one or more intensity thresholds. It should be noted that the intensity map for contact 562 is not part of the displayed user interface, but is included in... Figures 5E to 5H This is intended to assist readers.
[0139] In some implementations, the display of icons 578A-578C includes animation. For example, icon 578A might initially appear near application icon 572B, such as... Figure 5F As shown, as the animation progresses, icon 578A moves upwards, and icon 578B appears near application icon 572B, as shown. Figure 5G As shown. Then, representation 578A moves upward, 578B moves upward toward representation 578A, and representation 578C is displayed near application icon 572B, as shown. Figure 5H As shown. This indicates that 578A-578C form an array above icon 572B. In some implementations, the animation progresses according to the intensity of contact 562, such as... Figures 5F to 5G As shown, this indicates that 578A-578C appear and increase with the intensity of contact 562 to the depth of the pressure threshold (e.g., "IT"). D The animation progresses upwards as it increases in size. In some implementations, the intensity upon which the animation progresses is based is the strength of the contact characteristics. Reference can be performed using electronic devices similar to or equivalent to devices 100, 300, or 500. Figures 5E to 5H The described operation.
[0140] In some implementations, the device employs intensity hysteresis to avoid unintended inputs sometimes referred to as "jitter," wherein the device defines or selects a hysteresis intensity threshold that has a predefined relationship with a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the press input intensity threshold). Therefore, in some implementations, a press input includes an increase in the intensity of the corresponding contact above the press input intensity threshold and a subsequent decrease in the intensity of that contact below the hysteresis intensity threshold corresponding to the press input intensity threshold, and an operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases below the hysteresis intensity threshold (e.g., the "upstroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the intensity of the contact increases from an intensity equal to or below a hysteresis intensity threshold to an intensity equal to or above a press input intensity threshold and optionally the intensity of the contact subsequently decreases to an intensity equal to or below the hysteresis intensity, and corresponding operations are performed in response to the detection of a press input (e.g., depending on the environment, the intensity of the contact increases or decreases).
[0141] For ease of explanation, optionally, the description of an operation triggered in response to a press input associated with a press input strength threshold or in response to a gesture including a press input is provided in response to detecting any of the following conditions: the contact strength increases to above the press input strength threshold, the contact strength increases from below a hysteresis strength threshold to above the press input strength threshold, the contact strength decreases to below the press input strength threshold, and / or the contact strength decreases to below the hysteresis strength threshold corresponding to the press input strength threshold. Additionally, in the example where the operation is described as being performed in response to detecting a decrease in contact strength to below the press input strength threshold, the operation is optionally performed in response to detecting a decrease in contact strength to below a hysteresis strength threshold corresponding to and less than the press input strength threshold.
[0142] In some embodiments, electronic device 500 includes one or more tactile output generators, wherein the one or more tactile output generators generate different types of tactile output sequences, as described in Table 1 below. In some embodiments, a particular type of tactile output sequence generated by the one or more tactile output generators of the device corresponds to a particular tactile output pattern. For example, a tactile output pattern specifies characteristics of the tactile output, such as the amplitude of the tactile output, the shape of the moving waveform of the tactile output, the frequency of the tactile output, and / or the duration of the tactile output. When a device (e.g., one or more tactile output generators that generate tactile output via a movable mass) generates tactile outputs with different tactile output patterns, the tactile outputs can produce different tactile sensations in a user holding or touching the device. Although the user's senses are based on the user's perception of the tactile output, most users will be able to identify variations in the waveform, frequency, and amplitude of the tactile output generated by the device.
[0143] More specifically, Figures 5I through 5K provide a set of sample haptic output patterns that can be used individually or in combination, as is or through one or more transformations (e.g., modulation, amplification, truncation, etc.) to form suitable haptic feedback in various scenarios and for various purposes (such as those mentioned above and those described in relation to the user interfaces and methods discussed herein). This example of a haptic output control panel shows how an array of three waveforms and eight frequencies can be used to generate haptic output patterns. In addition to the haptic output patterns shown in these figures, each of these haptic output patterns can optionally be adjusted in amplitude by changing the gain value of the haptic output patterns, as shown, for example, for FullTap 80Hz, FullTap 200Hz, MiniTap 80Hz, MiniTap 200Hz, MicroTap 80Hz, and MicroTap 200Hz in Figures 5L through 5N, which are each shown as variants with gains of 1.0, 0.75, 0.5, and 0.25. As shown in Figures 5L to 5N, changing the gain of the haptic output mode alters the amplitude of the mode without changing the frequency of the mode or the shape of the waveform. In some implementations, changing the frequency of the haptic output mode also results in a lower amplitude because some haptic output generators are limited by how much force can be applied to the movable mass. Therefore, higher frequency movements of the mass are constrained to lower amplitudes to ensure that the acceleration required to form the waveform does not require forces outside the operating force range of the haptic output generator (e.g., the peak amplitudes of FullTap at 230Hz, 270Hz, and 300Hz are lower than those of FullTap at 80Hz, 100Hz, 125Hz, and 200Hz).
[0144] As used herein, "installed application" refers to a software application that has been downloaded to an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched on the device (e.g., become open). In some implementations, the downloaded application becomes an installed application using an installer that extracts program portions from the downloaded software package and integrates the extracted portions with the computer system's operating system.
[0145] As used herein, the terms "open application" or "running application" refer to a software application that maintains state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or running application is optionally any of the following types of applications: The active application, which is currently displayed on the screen of the device that is using the application; Background applications (or background processes) that are not currently displayed but whose one or more processes are being handled by one or more processors; and A paused or hibernating application that is not currently running but has state information stored in memory (either volatile or non-volatile) that can be used to resume the application's execution.
[0146] As used herein, the term "closed application" refers to a software application that does not retain state information (e.g., the state information of a closed application is not stored in the device's memory). Therefore, closing an application includes: stopping and / or removing the application's process and removing the application's state information from the device's memory. Generally, opening a second application while the first application is running does not close the first application. When the second application is displayed and the first application stops displaying, the first application becomes a background application.
[0147] Now let’s turn our attention to the implementation of user interfaces (“UIs”) on electronic devices, such as portable multifunction devices 100, 300 or 500, and the associated processes.
[0148] User interface and related processes Location sharing and navigation integration Users interact with electronic devices in a variety of different ways. In some implementations, the electronic device is able to see the location of objects such as a second electronic device. In some implementations, access to the location of such an electronic device can be shared between the owner of the electronic device and another user (e.g., a user of another electronic device). In some implementations, the electronic device is able to navigate to the location of an object, optionally when the electronic device has access to the location of the object. The implementations described below provide ways for electronic devices to facilitate navigation to the location of one or more objects (e.g., other electronic devices), optionally when the electronic device has access to the location information of one or more objects, thereby enhancing user interaction with the electronic device. Enhanced interaction with the device reduces the amount of time required for the user to perform operations, thereby reducing the power consumption of the device and extending the battery life of battery-powered devices. It should be understood that people use devices. When a person uses a device, that person is optionally referred to as a user of the device.
[0149] Figures 6A to 6KK Exemplary methods according to some embodiments of this disclosure are illustrated, wherein an electronic device facilitates navigation to the location of one or more second electronic devices based on location information of one or more second electronic devices. The embodiments in these figures are used to illustrate the process described below, including references to... Figure 7 The process described.
[0150] Figures 6A to 6KK An example is an electronic device 500 associated with a user, including a touchscreen 504 that displays one or more aspects of navigation to one or more destinations. Figure 6A In this context, "electronic device 500" refers to a mobile electronic device belonging to John, as described in more detail later. Furthermore, and as... Figure 6A As shown, the electronic device 500 displays a user interface 602 for a map application, which facilitates navigation to one or more destinations.
[0151] exist Figure 6A In the example, the user of electronic device 500 (e.g., John) can access the location of one or more second electronic devices. For example, in Figure 6AAs discussed in more detail below, the user of electronic device 500 has the right to access the location of the electronic device associated with the second user (e.g., Sam) and the location of the electronic device associated with the third user (e.g., Jane). It should be understood that, as described below, the location of the electronic device associated with the second user (e.g., Sam) and the location of the second user are referred to interchangeably herein, and similarly, the location of the electronic device associated with the third user (e.g., Jane) and the location of the third user are referred to interchangeably herein. In some embodiments, as discussed later herein, the user of electronic device 500 can access information about the locations of the second and third users accessed by the user via an item location application.
[0152] In some implementation schemes, such as Figure 6A As shown, the user interface 602 of the map application includes a representation of a map 623 surrounding and / or including the location of a user (e.g., John) and / or electronic device 500. It should be understood that, as described below, the location of electronic device 500 and the location of the user (e.g., John) of electronic device 500 are used interchangeably herein. In some embodiments, map 623 indicates the location of the user and / or electronic device 500 as a circle / icon 608, which is optionally centered within map 623 (e.g., the physical area represented by map 623 is centered on the location of the user (e.g., John)). Additionally, in some embodiments, such as Figure 6A As shown, map 623 includes indications of the locations of other users (e.g., the locations of other electronic devices associated with other users) that a user (e.g., John) has the right to access. For example, in Figure 6AIn the map, there are representations 612-1 (e.g., icons) of the location of the second user (e.g., Sam) discussed above, and representations 612-2 (e.g., icons) of the location of the third user (e.g., Jane) discussed above. In some embodiments, representation 612-1 is shown on map 623 at a location corresponding to the location of the second user (e.g., Sam) in the physical area, and representation 612-2 is shown on map 623 at a location corresponding to the location of the third user (e.g., Jane) in the physical area. In some embodiments, map 623 shows representations 612-1 and 612-2 of the locations of the second user (e.g., Sam) and the third user (e.g., Jane), respectively, because the distances from the location of a user (e.g., John) to the locations of the second and third users are within bounded distances defined by the physical area surrounding the location of the electronic device 500. For example, if the physical area surrounding the location of electronic device 500 is bounded by distances of 15 miles in each of the directions of north, east, south, and west, then the locations of the second user (e.g., Sam) and the third user (e.g., Jane) are less than 15 miles from the location of electronic device 500. Figure 6A As further shown, and as noted above, designations 612-1 and 612-2 indicate corresponding user / electronic devices (e.g., via graphics or images corresponding to users Sam and Jane, such as the letter "S" for user Sam and the letter "J" for user Jane), so that a user (e.g., John) can visually identify other users on map 623 of user interface 602. In some embodiments, and as... Figure 6A As shown, the representation of other users on map 623 in user interface 602 includes bubbles and / or circles containing the graphics discussed above. However, it should be understood that the representation may optionally be of any shape and / or size.
[0153] Additionally, in some implementations, such as Figure 6A As shown, the user interface 602 of the map application includes a search bar 610 (e.g., a text input field) that can be selected to enter text for searching a specific destination, as described below. In some embodiments, such as Figure 6A As shown, the user interface 602 includes a collection area 606, which includes one or more destinations for saving / collecting. For example, as Figure 6AAs shown, the Favorites area 606 includes a first instruction 607-1 for a first saved destination (e.g., a home destination), a second instruction 607-2 for a second saved destination (e.g., a business destination), and a third instruction 607-3 that can be selected to add additional destinations to the Favorites area 606. In some embodiments, the first instruction 607-1 can be selected to initiate navigation to the first saved destination in the user interface 602, and the second instruction 607-2 can be selected to initiate navigation to the second saved destination.
[0154] In some implementations, representations 612-1 and 612-2 on map 623 of user interface 602 can be selected to display information corresponding to the user associated with the selected representation. Figure 6B In this context, when the user interface 602 of a map application is displayed via touchscreen 504, electronic device 500 detects selection of representation 612-1 of a second user's (e.g., Sam) location on map 623 in user interface 602 via touch 603. For example, electronic device 500 detects click, tap, swipe, and / or hover input on touchscreen 504 above the location corresponding to representation 612-1.
[0155] In some implementation schemes, such as Figure 6C As shown, in response to detecting a selection of representation 612-1 on map 623, electronic device 500 displays a zone 614 (e.g., a virtual card or page) including information corresponding to a second user (e.g., Sam). Additionally, as Figure 6C As shown, the electronic device 500 optionally expands and / or enlarges the size of representation 612-1 to indicate a selection of representation 612-1, as discussed above. In some embodiments, such as Figure 6A As shown, section 614 includes an indication identifying the second user (e.g., section 614 includes the text "Sam" as the title of section 614). Additionally, as... Figure 6A As shown, because the user of electronic device 500 has access to the location of the second user, area 614 includes an indication of the second user's current location. For example, electronic device 500 (e.g., based on location information shared by electronic devices associated with the second user) displays the address where the second user is currently located (e.g., 2425 South Oliver Street). In some implementations, such as Figure 6A As shown, area 614 includes a first option 613-1, which can be selected to initiate navigation to the second user's current location in user interface 602. In some embodiments, the first option 613-1 includes an indication of the travel time (e.g., 30 minutes) to the second user based on a specific travel mode (e.g., driving, walking, public transport, etc.). Additionally, as... Figure 6AAs shown, area 614 includes a second option 613-2 that can be selected to display the user interface of the item location application previously discussed above, a third option 613-3 that can be selected to display the user interface of a phone call application that enables the user to contact the second user (e.g., via telephone call, text, email, etc.), and a fourth option 613-4 that can be selected to display additional options in user interface 602, such as the option to add the second user's location to the collection area 606 discussed above and / or (e.g., via the phone call application discussed above) the option to call the second user.
[0156] exist Figure 6C In the display of zone 614 corresponding to the second user (e.g., Sam), the electronic device detects movement of contact 603 targeting zone 614. For example, as... Figure 6C As shown, electronic device 500 detects an upward swipe of touch 603 on a portion of area 614 in user interface 602. In some embodiments, such as Figure 6D As shown, in response to detecting movement of contact 603 toward area 614, electronic device 500 shifts area 614 upwards in user interface 602 according to the movement of contact 603, so that area 614 occupies a larger portion of map 623, and displays additional information corresponding to a second user (e.g., Sam). For example, as Figure 6D As shown, area 614 includes one or more indications of the location / address associated with the second user. In some embodiments, area 614 includes a first indication 615-1 of the second user's current location as previously discussed above, a second indication 615-2 of the second user's home address (e.g., saved to the second user's contacts in the telephone calling application discussed above), a third indication 615-3 of the second user's phone number (e.g., saved to the second user's contacts in the telephone calling application discussed above), and a fourth indication 615-4 of the second user's company address (e.g., saved to the second user's contacts in the telephone calling application discussed above).
[0157] Therefore, when Figure 6D When the display area 614 is shown in the user interface 602, selecting one of the first option 613-1 and / or indications 615-1, 615-2, and 614-4 will cause the electronic device to initiate navigation to a location associated with the second user, such as the second user's current location or one of the addresses discussed above. For example, in Figure 6DIf electronic device 500 detects (e.g., via contact 603 discussed above) a selection for the first option 613-1 in area 614, electronic device 500 updates user interface 602 to include navigation area 634, which enables the user to initiate navigation to a second user's location, such as... Figure 6K As shown and discussed in more detail below.
[0158] Alternatively, in some implementations, the user of electronic device 500 can initiate navigation to the location of a second user (e.g., Sam) via the search bar 610 previously discussed above, including cases where the user of electronic device 500 does not have permission to access the second user's location. Figure 6E In the context of displaying user interface 602 and when the user of electronic device 500 does not have access to the location of the second user (e.g., this causes map 623 to no longer include the representation 612-1 of the second user as discussed above (e.g., an icon)), electronic device 500 detects a selection made via touch 603 to the search bar 610 in user interface 602. In some embodiments, the selection to search bar 610 has one or more characteristics of the selection input discussed above.
[0159] In some implementation schemes, such as Figure 6F As shown, in response to detecting a selection of search bar 610, electronic device 500 displays search area 618 overlaid on map 623 in user interface 602. In some embodiments, such as Figure 6F As shown, search area 618 includes the search bar 610 discussed above, which now includes a text cursor 621 that indicates text can be entered into search bar 610 to search for one or more navigation destinations. Additionally, in some embodiments, such as Figure 6F As shown, the search area 618 includes a list 611 of the most recent locations / destinations that the user of the electronic device 500 has navigated to (e.g., in the past hour, day, week, month, etc.), such as a first most recent destination 609-1 (e.g., corresponding to the location of user Alice), a second most recent destination 609-2 (e.g., corresponding to the location of the user's mother), and a third most recent destination 609-3 (e.g., corresponding to the location of the business Café Dulce). In some implementations, such as Figure 6F As shown, the search area 618 also includes a keyboard 620 (e.g., a numeric keypad of an electronic device 500), which includes multiple keys that can be selected to input text into the search bar 610.
[0160] exist Figure 6FIn this context, when the search area 618 is displayed in the user interface 602, the electronic device 500 detects a sequence of selections of one or more keys on the keyboard 620 in the user interface 602 via touch 603. For example, the electronic device 500 detects a sequence of taps of touch 603 on the touchscreen 504 at positions corresponding to one or more keys on the keyboard 620. In some embodiments, such as Figure 6G As shown, in response to detecting a sequence of one or more selections on keyboard 620, electronic device 500 updates search bar 610 to include text corresponding to the selected one or more keys on keyboard 620. For example, as Figure 6G As shown, electronic device 500 is in search bar 610. Figure 6F The text "Sam" is displayed at the position of the text cursor 621. In some implementations, such as... Figure 6G As shown, when the electronic device 500 enters the text "Sam" into the search bar 610, the electronic device 500 displays multiple search results corresponding to the text "Sam" in the search area 618. For example, as Figure 6G As shown, electronic device 500 displays search results organized by type, such as contacts, as indicated by instruction 616-1, and others, as indicated by instruction 616-2. In some embodiments, such as Figure 6G As shown, the search results include a second user (e.g., Sam) as indicated by result 617-1, the business "Sam's Bakery" as indicated by result 617-2, and the business "Sam's Car Shop" as indicated by result 617-3.
[0161] exist Figure 6G In the process of displaying multiple search results in search area 618, electronic device 500 detects a selection of result 617-1 corresponding to a second user (e.g., Sam) via a tap of contact 603. In some embodiments, the selection of result 617-1 has one or more characteristics of the selection input previously discussed above. In some embodiments, such as... Figure 6H As shown, in response to detecting a selection of result 617-1 corresponding to the second user, electronic device 500 displays in user interface 602 the same as previously mentioned above. Figure 6C The second user corresponds to area 614 (e.g., a contact card or page). However, as... Figure 6H As shown, because the user of electronic device 500 does not have permission to access... Figure 6H In the example, the location of the second user is not specified, so section 614 does not include an indication of the second user's current location. Instead, as... Figure 6H As shown, section 614 includes an indication of the distance (e.g., 12 miles) to a known / saved address associated with the second user, as referenced above. Figure 6DThe discussed home or business address, but not necessarily the second user's current location. Additionally, such as... Figure 6H As shown, area 614 does not include any optional location. Figure 6C The second option, 613-2, is because the user of the electronic device does not have permission to access the location of the second user. In some implementations, such as Figure 6H As shown, region 614 includes the corresponding Figure 6C The third option 619-3 is the first option 613-1, and the second option 619-2 can be selected to initiate a process for requesting access to the location of a second user.
[0162] exist Figure 6H When area 614 is displayed in user interface 602, electronic device 500 detects a selection of second option 619-2 via touch 603. In some embodiments, the selection of second option 619-2 has one or more characteristics of the selection input previously discussed above.
[0163] In some implementations, in response to detecting an attack Figure 6H In the selection of the second option 619-2, the electronic device 500 initiates a process for (e.g., to the second user) requesting access to the location of the second user. In some implementations, such as Figure 6I As shown, the process of initiating a request to access the location of a second user includes displaying the user interface 622 of a messaging application via touchscreen 504. For example, as... Figure 6I As shown, user interface 622 corresponds to a text messaging session between a user of electronic device 500 and a second user (e.g., Sam). In some embodiments, such as Figure 6I As shown, the user interface 622 includes multiple message bubbles corresponding to text messages sent between the user and the second user, such as message bubbles 626-1 and 626-2 sent by the electronic device 500 to a second electronic device associated with the second user, and message bubble 626-3 received by the electronic device 500 and sent by the second electronic device. Additionally, in some embodiments, the user interface 622 includes a message input field 625, which includes a text cursor 621 for inputting text for a text message transmission dialogue between the user and the second user. In some embodiments, when in response to detecting an access to... Figure 6H When the second option 619-2 is selected and the user interface 622 is displayed, such as Figure 6I As shown, the electronic device 500 displays a location-sharing desktop widget 624 in the user interface 622, which can be sent as text messages within a session. For example, as Figure 6IAs shown, the location sharing desktop widget 624 includes a first option 627-1 that can be selected to request access to the location of a second user and a second option 627-2 that can be selected to share access to the location of the user of the electronic device 500 with the second user.
[0164] exist Figure 6I In this embodiment, when the location sharing widget 624 is displayed in the user interface 622, the electronic device 500 detects a selection of the first option 627-1 via a tap of the touch 603. In some embodiments, the selection of the first option 627-1 has one or more characteristics of the selection input previously discussed herein. In some embodiments, in response to detecting a selection of the first option 627-1, the electronic device 500 sends a request to a second user via a text messaging session in the user interface 622 to obtain access to the second user's location (e.g., via a second electronic device associated with the second user).
[0165] In some implementation schemes, such as Figure 6J As shown, based on the determination that the second user grants access to the location of the second user to the user of the electronic device 500, when the user interface 602 of the map application is reopened (e.g., redisplayed) on the touchscreen 504, the user interface 602 includes a suggestion element 629. For example, as Figure 6J As shown, the user interface 602 includes a suggestion area 628, which includes a suggestion element 629. In some embodiments, the suggestion element 629 suggests navigation to the location of the second user (e.g., Sam) based on recent user activity such as obtaining access to the second user's location as described above. In some embodiments, the suggestion element 629 can be selected to initiate navigation to the second user's location.
[0166] exist Figure 6J In the context of displaying a user interface 602 including suggestion element 629, electronic device 500 detects a selection of suggestion element 629 via a tap of contact 603, as discussed similarly above. In some embodiments, in response to detecting a selection of suggestion element 629, electronic device 500 initiates navigation to a second user's location. In some embodiments, such as Figure 6K As shown, initiating navigation to the second user's location includes updating the display of user interface 602 to include the navigation area 634 previously mentioned above. In some implementations, such as Figure 6KAs shown, navigation area 634 includes an indication 633-1 of the starting point in the navigation route, which optionally corresponds to the current location of the user of electronic device 500; an indication 633-2 of the ending point (e.g., destination) in the navigation route, which corresponds to the location of a second user (e.g., Sam's location); and an option 633-3 that can be selected to add stops (e.g., intermediate destinations) to the navigation route, as discussed in more detail below. In some embodiments, such as Figure 6K As shown, navigation area 634 includes a first option 637-1 for specifying the travel mode for navigation, such as driving, walking, public transport, cycling, etc. Figure 6K As shown in the example, the specified travel mode for navigation is driving (e.g., driving a car). Additionally, as... Figure 6K As shown, navigation area 634 includes a second option 637-2 for limiting the start time of navigation (e.g., starting now or starting at a later user-defined time), where the start time is limited to starting now (e.g., at this moment). In some embodiments, navigation area 634 also includes a third option 637-3 for assigning driving conditions to navigation, such as avoiding highways, avoiding toll roads, etc. Finally, as Figure 6K As shown, navigation area 634 optionally includes navigation options 635 that can be selected to begin navigation to a second user's location. Figure 6K As shown, navigation option 635 is optionally displayed together with an indication of estimated travel time 636 (e.g., 30 minutes) and an indication of the distance (e.g., 12 miles) between the user's current location and the destination (e.g., the location of a second user).
[0167] Additionally, in some implementations, when the electronic device 500 displays the navigation area 634 in the user interface 602, such as Figure 6K As shown, electronic device 500 updates map 623 to visually indicate the navigation route 631 from the user's current location (e.g., represented by icon 608) to the destination (e.g., represented by the location of a second user, denoted by 612-1). Additionally, as... Figure 6K As shown, map 623 optionally includes indications of the estimated travel time discussed above, indicated by label 632.
[0168] exist Figure 6K In this context, when navigation area 634 is displayed in user interface 602, electronic device 500 detects a selection of navigation option 635 via a tap of contact 603. In some embodiments, the selection of navigation option 635 has one or more characteristics of the selection input previously described above. In some embodiments, such as... Figure 6LAs shown, in response to detecting navigation option 635, electronic device 500 initiates navigation to a destination (e.g., the location of a second user). In some implementations, such as Figure 6L As shown, initiating navigation to a destination includes (for example, via touchscreen 504) displaying a navigation user interface 640. Figure 6L As shown, the navigation user interface 640 optionally includes visual navigation instructions. For example, the navigation user interface 640 includes text guidance 645 optionally displayed at the top portion of the navigation user interface 640, which instructs the user of the electronic device 500 on how to proceed to their destination based on the current traffic mode (e.g., driving guidance). Additionally, as... Figure 6L As shown, electronic device 500 displays visual indications on map 623 of the current portion of route 631 to the destination, and visual indications 638 of the user's current location on the route to the destination. In some embodiments, as described below, a portion of map 623, a portion of route 631, and visual indications 638 are updated as the location of electronic device 500 changes during navigation to the destination (e.g., as the distance between the current location of electronic device 500 and the location of a second user increases or decreases).
[0169] Additionally, in some implementations, such as Figure 6L As shown, the navigation user interface 640 includes a navigation control area 642. (As...) Figure 6L As shown, navigation control area 642 includes an indication of the current estimated time of arrival (ETA) at the destination (e.g., 3:24), an indication of the current travel time (e.g., 30 minutes), and an indication of the current distance between electronic device 500 and the destination (e.g., 12 miles). In some embodiments, as described below, the indications shown in navigation control area 642 are updated as the location of electronic device 500 changes during navigation to the destination (e.g., as the distance between the current location of electronic device 500 and the location of a second user increases or decreases). Additionally, as... Figure 6L As shown, the navigation control area 642 includes a sharing option 643, which can be selected to initiate a process of sharing the current ETA (e.g., 3:24) with another user. In some embodiments, the sharing option 643 can be selected to initiate a process of sharing the current ETA with that user based on determining that the next destination on the route corresponds to the user's location. For example, in Figure 6L Since the destination is the location of the second user (e.g., Sam), the sharing option 643 can be selected to initiate the process of sharing the current ETA with the second user, as indicated.
[0170] exist Figure 6LIn the process of displaying the navigation user interface 640, the electronic device 500 detects (e.g., upward) movement of a touch 603 on the navigation control area 642 within the navigation user interface 640. In some embodiments, the movement of the touch 603 (e.g., a swipe of the touch 603) has one or more characteristics of the movement of the touch 603 discussed above. In some embodiments, such as... Figure 6M As shown, in response to detecting movement of contact 603 toward navigation control area 642, electronic device 500 shifts navigation control area 642 upwards in navigation user interface 640 according to the movement of contact 603, such that navigation control area 642 covers a portion of map 623 in navigation user interface 640. In some embodiments, such as Figure 6M As shown, when the navigation control area 642 shifts upwards in the navigation user interface 640, the information included in the navigation control area 642 will change. For example, the navigation control area 642 will include an indication of the current ETA (e.g., 3:24 PM), but will no longer include indications of travel time or distance as discussed above. Additionally, as... Figure 6M As shown, the navigation control area 642 is updated to include a first option 644-1, a second option 644-2, and a third option 644-3. The first option can be selected to initiate the process of adding a stop point (e.g., intermediate destination) to the navigation; the second option can be selected to share the current ETA with another user, as discussed similarly above; and the third option can be selected to report traffic incidents within the map application (e.g., collisions, road hazards, immobile vehicles, etc.). Furthermore, in some embodiments, the navigation control area 642 includes an end option 644-4 that can be selected to terminate the current navigation to the destination.
[0171] exist Figure 6M In the navigation control area 642, when displayed in the navigation user interface 640, the electronic device 500 detects a selection of a first option 644-1 in the navigation control area 642 via a tap of contact 603. In some embodiments, the selection of the first option 644-1 has one or more characteristics of the selection input discussed above. In some embodiments, in response to detecting a selection of the first option 644-1, the electronic device initiates a process of adding a docking point to the current navigation. For example, as... Figure 6N As shown, electronic device 500 updates navigation user interface 640 to include adding docking point areas 644. In some implementations, such as Figure 6N As shown, the add stop area 644 includes a search bar 610 with a text cursor 621, through which a specific stop (e.g., intermediate destination) can be searched via text query, as discussed similarly above. Additionally, as... Figure 6NAs shown, the added stop area 644 includes destination categories, from which users can select stops that are close to the user or close to the route to the destination. For example, as... Figure 6N As shown, the added stop area 644 includes a first category 646-1 corresponding to fast food restaurants (e.g., fast food), a second category 646-2 corresponding to gas stations (e.g., gas stations), a third category 646-3 corresponding to cafes (e.g., coffee shops), and a fourth category 646-4 corresponding to parking areas (e.g., parking lots). In some implementations, such as Figure 6N As shown, when the electronic device 500 displays the Add Dock Area 644 in the navigation user interface 640, the electronic device 500 displays the numeric keypad 620 previously discussed above for entering text into the search field 610.
[0172] exist Figure 6N In this context, when the added docking point area 644 and keyboard 620 are displayed in the navigation user interface 640, the electronic device 500 detects a sequence of one or more inputs to one or more keys on the keyboard 620 via a sequence of one or more taps on contact 603, as discussed similarly above. In some implementations, such as Figure 6O As shown, in response to detecting a sequence of inputs to one or more keys on keyboard 620, electronic device 500 updates search field 610 to include text corresponding to the selected one or more keys (e.g., “Jane”). In some implementations, such as Figure 6O As shown, when electronic device 500 inputs the text "Jane" into search bar 610 in response to detecting one or more sequences of input discussed above, electronic device 500 displays multiple search results based on the text "Jane" in search bar 610. For example, as Figure 6O As shown, electronic device 500 is displaying a first result 647-1 corresponding to the previously discussed third user Jane, a second result 647-2 corresponding to a restaurant (e.g., Jane Q), a third result 647-3 corresponding to a café (e.g., Jane's Café), and a fourth result 647-4 corresponding to a school (e.g., Jane Addams Secondary School). In some implementations, multiple search results can be selected to add the selected destination as the next stop for the current navigation.
[0173] exist Figure 6O In the process of displaying multiple search results in the add docking point area 644, the electronic device 500 detects the selection of the first result 647-1 via a tap on the contact 603, as discussed similarly above. In some implementations, such as Figure 6PAs shown, in response to detecting a selection of the first result 647-1, the electronic device 500 updates the route 631 to the destination (e.g., the location of the second user) to include the location of the third user (e.g., Jane) as an intermediate destination. For example, as Figure 6P As shown, electronic device 500 initiates navigation to the location of the third user and updates the indication in navigation control area 642 based on the distance between the current location of electronic device 500 and the location of the third user. Figure 6P As shown, the ETA indication has been updated to 3:04, the travel time indication has been updated to 20 minutes, and the distance to the next stop indication has been updated to 6 miles.
[0174] exist Figure 6P In the process of displaying a navigation user interface 640 for navigating to a third user's location, the electronic device 500 detects movement (e.g., a swipe) of a touch 603 on the navigation control area 642, as discussed similarly above. In some embodiments, as discussed similarly above, in response to detecting movement of the touch 603 on the navigation control area 642, the electronic device 500 shifts the navigation control area 642 upwards within the navigation user interface 640 and updates the information included in the navigation control area 642. For example, as... Figure 6Q As shown, navigation control area 642 is updated to include indications for the next stop 639-1 on the route (e.g., Jane's location) and the last stop 639-2 on the route (e.g., Sam's location). In some embodiments, indications 639-1 and 639-2 can be selected to initiate a rearrangement of the corresponding stops on the route (e.g., swapping stops so that Jane's location is the final destination and Sam's location is an intermediate destination).
[0175] exist Figure 6Q In the navigation user interface 640, when the navigation control area 642 is displayed, the electronic device 500 detects a selection of the second option 644-2 discussed above via a tap of the contact 603. In some embodiments, such as Figure 6R As shown, in response to detecting a selection of the second option 644-2, the electronic device 500 initiates a process of sharing the current ETA at the next docking point (e.g., the location of a third user) with one or more users. For example, as Figure 6R As shown, electronic device 500 displays a shared ETA area 648, which includes a list of users who can share the current ETA at the next stop. Figure 6RAs shown, the list includes third user 649-1 (e.g., Jane), second user 649-2 (e.g., Sam), fourth user 649-3 (e.g., Megan), and fourth user 646-4 (e.g., Jason). In some implementations, the user list is selectable to share the current ETA with one or more selected users in the user list. For example, selecting third user 649-1 in the list causes electronic device 500 to send location information corresponding to electronic device 500 to a third electronic device associated with the third user (e.g., Jane), which allows the third user to follow the location of electronic device 500 (e.g., the location of the third user) along the route to the next stop. Additionally, as Figure 6R As shown, the shared ETA area 648 includes option 649-5, which can be selected to choose an additional user from the list of all contacts previously discussed in the phone call application above (e.g., not included in...). Figure 6R (as shown in the list).
[0176] In some implementations, navigating to a destination via the map application discussed above involves identifying (e.g., establishing) one or more areas relative to the destination. For example, the one or more areas include a parking area centered on the destination and an arrival area centered on the destination. In some implementations, the parking area is defined by a first radius corresponding to a first threshold distance relative to the destination, example values of which are provided in reference method 700 below, and the arrival area is defined by a second radius smaller than the first radius, corresponding to a second threshold distance relative to the destination, example values of which are also provided in reference method 700 below. In some implementations, as described below, when navigating to a destination, if the location of the electronic device 500 is within one or more of the areas discussed above, the electronic device 500 automatically changes the display of the user interface associated with the map application, further enhancing the user's ability to move to and locate the destination.
[0177] like Figure 6S As shown in Figure 690, the parking area and arrival area are determined relative to the destination 691 (e.g., the location of the second user) (e.g., centered on the destination). As shown in Figure 690, in Figure 6S In the example, the current location 692 of electronic device 500 is outside the parking area, and therefore outside the arrival area. Therefore, in some implementations, such as... Figure 6S As shown, while navigating to a destination (e.g., the location of a second user), the electronic device 500 continues to display a navigation user interface 640 that includes the visual navigation instructions discussed above. Figure 6SAs shown in the example, electronic device 500 is currently 0.4 miles from the second user's location, a distance corresponding to a current travel time of 2 minutes, as indicated in navigation control area 642.
[0178] exist Figure 6T In this process, when navigating to a destination, electronic device 500 detects that its location is within the parking area, as illustrated in Figure 690. For example, electronic device 500 detects that its location is within a first threshold distance of the destination, but outside a second threshold distance (e.g., outside the arrival area shown in Figure 690). In some implementations, such as Figure 6T As shown, in response to detecting that the location 692 of the electronic device 500 is within the parking lot, as illustrated in Figure 690, the electronic device 500 displays a parking user interface 650 via the touchscreen 504. For example, as Figure 6T As shown, electronic device 500 will Figure 6S The navigation user interface 640 is replaced by a parking user interface 650 associated with the map application. In some implementations, such as Figure 6T As shown, the parking user interface 650 includes the map 623 discussed above, which includes a representation 612-1 of the second user's location (e.g., destination) and a visual indication 638 of the current location of the electronic device 500. Additionally, the parking user interface 650 optionally includes a status indication 651 for navigation to the destination (e.g., parking lot). In some embodiments, such as Figure 6T As shown, the parking user interface 650 includes a first option 652-1 and a second option 652-2. In some embodiments, the first option 652-1 can be selected to initiate navigation to the destination based on a second traffic mode. For example, as discussed similarly above, when the parking user interface 650 is displayed, the user is navigating to the destination by driving. In some embodiments, selection of the first option 652-1 initiates navigation to the destination based on walking directions. In some embodiments, such as Figure 6T As shown, the first option 652-1 includes an indication of the estimated travel time (e.g., 2 minutes) to the destination by walking. In some embodiments, the second option 652-2 can be selected to end navigation to the destination (e.g., stop displaying the parking user interface 650).
[0179] exist Figure 6UIn this embodiment, electronic device 500 detects that its location 692 is within the arrival area, as shown in Figure 690. For example, electronic device 500 detects that its location 692 is within a second threshold distance of the destination 691, as shown in Figure 690. In some implementations, in response to detecting that its location is within the arrival area, electronic device 500 displays an arrival user interface 660 via touchscreen 504. For example, as... Figure 6U As shown, electronic device 500 will Figure 6T The display of the parking user interface 650 is replaced with an arrival user interface 660 associated with the map application. In some implementations, such as Figure 6U As shown, the arrival user interface 660 includes a map 623 and a representation 612-1 of the second user's location, as discussed similarly above. Additionally, the arrival user interface 660 optionally includes a navigation status indication 661 to the destination (e.g., arrived). In some embodiments, such as Figure 6U As shown, based on the determination that the user has permission to access the location of the second user (e.g., as discussed above), reaching the user interface 660 includes a first option 662-1. In some embodiments, the first option 662-1 can be selected to display the user interface of the item location application discussed above, to initiate a process of locating a destination using proximity lookup features, as discussed in more detail below. Additionally, in some embodiments, such as Figure 6U As shown, the user interface 660 includes a second option 662-2, which can be selected to end navigation to the destination, as discussed similarly above.
[0180] exist Figure 6V In this scenario, electronic device 500 detects that its position 692 is no longer within the arrival area but is once again within the parking area, as shown in Figure 690. For example, electronic device 500 detects that its position 692 is no longer within the second threshold distance of destination 691, but is still within the first threshold distance of destination 691, as shown in Figure 690. Therefore, as... Figure 6V As shown, the electronic device 500 redisplays the parking user interface 650 discussed above. Figure 6V As shown, in some embodiments, when the electronic device 500 redisplays the parking user interface 650, the electronic device 500 updates the visual indication 638 of its current position on the map 623 based on the change in the electronic device 500's position.
[0181] exist Figure 6WIn this embodiment, when the location 692 of the electronic device 500 is within the parking area shown in Figure 690, the electronic device 500 detects that the user has parked their vehicle (or is no longer in the vehicle). For example, the electronic device 500 detects that the user is no longer driving / riding the vehicle via a wired or wireless communication component (e.g., USB, USB-C, Bluetooth, Wi-Fi, etc.) between the electronic device 500 and the vehicle the user is riding in / driving. In some embodiments, in response to detecting that the user has parked their vehicle, because the location 692 of the electronic device 500 is within the parking area shown in Figure 690, the electronic device 500 maintains the display of the parking user interface 650 discussed above. Additionally, in some embodiments, such as Figure 6W As shown, the electronic device 500 updates the parking user interface 650 to include a status indication 653 indicating that the user has parked their vehicle (e.g., parked).
[0182] exist Figure 6W In the display of the parking user interface 650, the electronic device 500 detects a selection of a first option 662-1 in the parking user interface 650 via a tap of contact 603. In some embodiments, the selection of the first option 662-1 has one or more characteristics of the selection input previously discussed herein. In some embodiments, in response to the detection of a selection of the first option 662-1, the electronic device 500 initiates navigation to the destination based on a walking access mode. For example, as... Figure 6X As shown, the electronic device 500 re-displays the navigation user interface 640 discussed above, which includes visual navigation instructions for walking to the destination. Figure 6X As shown, the indication in the navigation control area 642 is displayed according to the walking traffic pattern (e.g., the current ETA is determined based on the average walking speed of the user of electronic device 500 (e.g., 3:32)).
[0183] exist Figure 6Y In the process of navigating to a destination based on a pedestrian access pattern, electronic device 500 detects that its position is within the arrival area 692, as shown in Figure 690. Therefore, in some implementations, as discussed similarly above, electronic device 500 displays the arrival user interface 660. Figure 6Y When the display reaches the user interface 660, the electronic device 500 detects the selection of the first option 662-1 discussed above via a tap on the contact 603.
[0184] In some implementations, when electronic device 500 detects a selection of the first option 660-1 in the arrival user interface 662, electronic device 500 determines that its location is no longer within the arrival area relative to the destination (e.g., the location of a second user). For example, when electronic device 500 detects a selection of the first option 660-1 in the arrival user interface 662, electronic device 500 determines that its location is no longer within the arrival area relative to the destination (e.g., the location of a second user). Figure 6Y Before the selection of the first option 662-1, the location of the second user changes (e.g., the second user and therefore the second electronic device moves from Sadel Road to 8th Street, as...). Figure 6Z (As indicated on map 623). Therefore, as... Figure 6Z As shown, the location 692 of the electronic device 500 is updated to be within the parking area relative to the destination 691, rather than within the arrival area, as illustrated in Figure 690. In some implementations, such as Figure 6Z As shown, because the location of electronic device 500 is no longer within the reach area relative to the updated location of the second user, electronic device 500 redisplays the map application's user interface 602 so that the user of electronic device 500 can initiate navigation to the updated location of the second user. For example, as Figure 6Z As shown, electronic device 500 displays the navigation area 634 previously discussed above. In some embodiments, because electronic device 500 is located within the parking area shown in Figure 690, navigation to the destination will be based on a pedestrian access mode, as indicated by option 637-1.
[0185] exist Figure 6Z In the process of displaying user interface 602, electronic device 500 detects a selection of navigation option 635 via a tap of touch 603. In some embodiments, as discussed similarly above, in response to the detection of a selection of navigation option 635, electronic device 500 initiates navigation to the destination based on a walking access mode. For example, electronic device 500 displays navigation user interface 640, as described above. Figure 6X As shown similarly in the middle.
[0186] exist Figure 6AA In the process of navigating to a destination according to a pedestrian access mode, electronic device 500 detects its position 692 within the arrival area relative to the updated destination 691, as shown in Figure 690. In some embodiments, as previously discussed above, in response to detecting that the position of electronic device 500 is within the arrival area, electronic device 500 displays the arrival user interface 660 discussed above. Figure 6AA When the display reaches the user interface 660, the electronic device 500 detects the selection of the first option 662-1 in the user interface 660 via a tap on the contact 603.
[0187] In some implementation schemes, such as Figure 6BB As shown, in response to detecting a selection of the first option 662-1, the electronic device 500 displays the user interface 670 of the item location application previously discussed above. Figure 6BB As shown, in some embodiments, the user interface 670 includes a representation of a map 623 surrounding and / or including the location of the user (e.g., John) and / or the electronic device 500. In some embodiments, as similarly discussed above, the map 623 includes visual indications 638 of the location of the user and / or the electronic device 500, and a representation 612-1 of a second user (e.g., because the user has access to the second user's location). Additionally, in some embodiments, when the user interface 670 is displayed, the electronic device 500 (e.g., automatically) selects the representation 612-1 of the second user because the destination is the second user's location, as discussed above. Figure 6BB As shown, because representation 612-1 is selected, user interface 670 also includes a region 671 (e.g., user interface) associated with a second user (e.g., Sam). In some embodiments, such as Figure 6BB As shown, zone 671 includes an indication of the second user's current location (e.g., 2590 8th Street), a first option 672-1, and a second option 672-2. In some embodiments, the first option 672-1 can be selected to display the second user's contact information in the user interface of a telephone calling application, as discussed similarly above. In some embodiments, the second option 672-2 can be selected to activate proximity lookup features for locating the second user.
[0188] exist Figure 6BB In the context of displaying the user interface 670 of the item location application, the electronic device 500 detects a selection of the second option 672-2 via a tap on the contact 603. In some embodiments, in response to detecting a selection of the second option 672-2, the electronic device 500 activates proximity lookup features for locating a second user (e.g., Sam). Figure 6CC As shown, the electronic device 500 displays a search user interface 675 via a touchscreen 504. In some embodiments, such as Figure 6CC As shown, the user interface 675 includes an indication of the current location of the second user (e.g., Sam), a forward direction indicator 676, an arrow indicator 673, and a text indicator 674, as discussed similarly above. In some embodiments, the forward direction indicator 676, the arrow indicator 673, and the text indicator 674 help guide the user of the electronic device 500 to locate the second user. For example, as... Figure 6CCAs shown, the forward direction indicator 676 indicates the direction of the second electronic device associated with the second user (e.g., Sam) relative to the electronic device 500, and the arrow indicator 673 indicates the direction in which the user of the electronic device 500 should proceed (e.g., walk) to reach the second user. In some embodiments, the text indicator 674 indicates the distance and / or direction of the second user's position relative to the electronic device 500 (e.g., "30 feet to the right").
[0189] Additionally or alternatively, in some embodiments, text indication 674 provides the user of electronic device 500 with an indication of whether a second user (e.g., Sam) is located on a different floor or level relative to the user of electronic device 500. For example, in Figure 6CC If the user of electronic device 500 is located on the first floor (e.g., ground floor or ground floor) of a building (e.g., office building, apartment building, house, etc.), and the second user is currently located on the second floor (e.g., second floor, basement, garage, etc.) above or below electronic device 500, then text indication 674 includes an indication about the second user being on a different floor / level of the building (e.g., "The person you are looking for may be on a different floor"). In some embodiments, electronic device 500 determines that the second user is on a different floor or level relative to the user of electronic device 500 based on the orientation (e.g., vertical direction) of the second user's position relative to electronic device 500.
[0190] Additionally or alternatively, in some embodiments, text indication 674 provides the user of electronic device 500 with an indication of whether the second user (e.g., Sam) is currently moving relative to the user of electronic device 500. For example, as discussed similarly above, if electronic device 500 detects a change in distance between electronic device 500 and the location of the second user (e.g., the device 500 does not move or does not move sufficiently to account for the change in distance due to an optional increase or decrease in distance) and / or detects a change in orientation of the second user relative to the location of electronic device 500 (e.g., the device 500 does not move or does not move sufficiently to account for the change in orientation or orientation due to an optional change in orientation or orientation), then electronic device 500 determines that the second user is moving relative to electronic device 500 (e.g., regardless of whether the current location of electronic device 500 is changing, such as due to the movement of the user of electronic device 500). In this case, electronic device 500 optionally updates text indication 674 to include an indication that the location of the second user relative to the current location of electronic device 500 is changing (optionally regardless of any movement of electronic device 500) (e.g., "The person you are looking for is moving around").
[0191] In some implementations, as the distance between the second user's location and the electronic device 500 changes and / or the orientation of the second user's location relative to the electronic device 500 changes, the electronic device 500 updates the lookup user interface 675 accordingly. For example, in Figure 6DD In this configuration, the second user is now positioned directly in front of the electronic device 500, and the distance between the electronic device 500 and the second electronic device associated with the second user has been reduced. Therefore, in some embodiments, such as... Figure 6DD As shown, the electronic device 500 updates the display of the forward direction indicator 676 and moves the forward direction indicator 676 in the lookup user interface 675 to indicate the direction of the second user's position in front of (e.g., the front of) the electronic device 500. Similarly, as Figure 6DD As shown, the electronic device 500 optionally changes the orientation of the arrow indicator 673 to upward in the search user interface 675, indicating that the user should go straight ahead to reach the location of the second user, and updates the text indicator 674 based on the updated distance and / or direction of the second user's position relative to the electronic device 500 (e.g., "10 feet ahead").
[0192] In some implementations, when the proximity lookup feature is activated at electronic device 500, the display of the lookup user interface 675 on touchscreen 504 can be minimized without ending (e.g., disabling) the proximity lookup (e.g., to allow the user to interact with and / or view other user interfaces associated with other applications on electronic device 500 without ending the proximity lookup). For example, in Figure 6DD In this process, electronic device 500 detects movement of touch 603 on touchscreen 504 (e.g., an upward swipe of touch 603) when displaying the search user interface 675. In some embodiments, such as Figure 6FF As shown, in response to detecting movement of contact 603, electronic device 500 minimizes the display of search user interface 675. In some embodiments, minimizing the display of search user interface 675 includes stopping the display of search user interface 675, such as... Figure 6FF As shown, one or more user interface elements for finding the user interface 675 are displayed in a predetermined area of the touchscreen 504. For example, as... Figure 6FF As shown, the electronic device 500 stops displaying the search user interface 675 and displays the main screen user interface 685 (e.g., corresponding to...). Figure 4A The user interface 400 in the middle, and displays a user interface object 678 that includes arrow indicators and text indicators for the search user interface 675 discussed above. In some implementations, such as Figure 6FF As shown, the predetermined area of the touch screen 504 is the top center portion of the touch screen 504, but other areas are also possible.
[0193] In some implementation schemes, such as Figure 6EE As shown, based on the determination that the location 692 of electronic device 500 corresponds to the location of the second user as shown in Figure 690 (e.g., the user of electronic device 500 has arrived at destination 691), electronic device 500 updates the search user interface 675 to replace the arrow indicator 673 with a confirmation indicator (e.g., a check mark) and updates the text indicator to indicate that the user (e.g., John) has arrived at the destination (e.g., "here"). In some embodiments, electronic device 500 determines that the user of electronic device 500 has arrived at the location of the second user based on the determination that electronic device 500 is within a corresponding threshold distance (e.g., 1 foot, 2 feet, 3 feet, 4 feet, etc.) of the second electronic device 500b associated with the second user. In some embodiments, the corresponding threshold for determining whether electronic device 500 has arrived at a particular destination varies based on the destination type. For example, the corresponding threshold differs when the destination corresponds to the location of another user (e.g., such as a second user) or a business or residence compared to when the destination corresponds to the location of an accessory device of electronic device 500, such as a remote locator object (e.g., a dedicated tracker or location transmitting device), or another electronic device associated with the user of electronic device 500 (e.g., the electronic device and electronic device 500 are associated with the same user account). In some embodiments, the corresponding threshold for determining whether electronic device 500 has reached a particular destination is larger when the destination corresponds to the location of another user (e.g., such as a second user) or a business or residence than when the destination corresponds to the location of an accessory device of electronic device 500 (e.g., a remote locator object (e.g., a dedicated tracker or location transmitting device) or another electronic device associated with the user of electronic device 500). In some embodiments, when the proximity lookup feature discussed above is activated, electronic device 500 sends data to a second electronic device 500b associated with the second user (e.g., Sam) showing that electronic device 500 is looking for (e.g., tracking) the location of the second electronic device 500b. For example, as Figure 6EE As shown, when the second electronic device 500b receives data, it generates one or more notifications informing the user (e.g., John) that it is attempting to locate a second user (e.g., Sam). In some implementations, such as Figure 6EE As shown, the second electronic device 500b displays a first notification 679-1 and / or a second notification 679-2 on the lock screen user interface 680 of the second electronic device 500b via a touch screen 504b. The first notification and / or the second notification inform the second user (e.g., Sam) that the user (e.g., John) is being located and / or facilitates locating the user via the item location application discussed above on the second electronic device 500b.
[0194] exist Figure 6GG In this implementation, after the user of electronic device 500 reaches the destination (e.g., locating a second user), electronic device 500 deactivates the proximity search features discussed above. For example, electronic device 500 stops displaying search user interface 675 in response to detecting input corresponding to a request to end the proximity search, and / or automatically stops displaying search user interface 675 (e.g., after detecting that the location of electronic device 500 corresponds to the location of the second user). In some implementations, such as Figure 6GG As shown, when the electronic device 500 disables the proximity lookup feature, the electronic device 500 redisplays the user interface 670 of the item location application discussed above. In some implementations, such as Figure 6GG As shown, because the location of electronic device 500 corresponds to the location of second electronic device 500b associated with the second user, the visual indication 638 of the current location of electronic device 500 is at least partially overlaid on the representation 612-1 of the second user on map 623. Additionally, as... Figure 6GG As shown, the user interface 670 includes an indication 677 of the current location of the electronic device 500 (e.g., 2590 8th Street), which optionally corresponds to the location of the second user as discussed above.
[0195] It should be understood that, in some implementations, the methods described above for navigating to the location of a second user are similarly applied to destinations corresponding to the locations of other users (e.g., the location of a third user such as Jane, as discussed above) and / or businesses or other points of interest (e.g., restaurants, shopping malls, cafes, landmarks, starting points of hiking trails, cinemas, etc.).
[0196] In some implementations, a destination is associated with an arrival zone. In some implementations, the arrival zone encompasses a portion of the route to the destination, which requires the user of the electronic device 500 to change the navigation mode to reach the destination. For example, in Figure 6HH In this context, electronic device 500 navigates to the beach destination (e.g., Venice Beach) based on the driving mode. Therefore, as... Figure 6HH As shown, the electronic device 500 is displaying the navigation user interface 640 previously discussed above, which includes visual navigation instructions (e.g., text guidance 645 and representations of route 631) for navigating to a destination represented by representations 612-3 (e.g., icons including graphics or images) corresponding to Venice Beach on map 623. In some embodiments, in Figure 6HHIn this context, the destination is associated with the arrival area, such as the beachfront, pier, or walking trail associated with Venice Beach. In some implementations where the destination and arrival area are associated, the parking and arrival areas discussed above are determined relative to the arrival area rather than the destination. For example, as... Figure 6HH As shown in Figure 690, the parking area and arrival area are centered on the arrival area entrance 693 (e.g., corresponding to the entrance / starting point of the beachfront, pier, or walking trail associated with Venice Beach) rather than the destination 691. Figure 6HH As shown, the electronic device 500 is optionally located outside the parking area, as illustrated in Figure 690, and therefore the electronic device 500 is displaying the navigation user interface 640, as discussed above.
[0197] exist Figure 6II In the process, electronic device 500 detects that its position is within the parking area. For example, as Figure 6II As shown in Figure 690, the electronic device 500 has arrived at the parking area at position 692 relative to the arrival area entrance 693. In some embodiments, as discussed similarly above, in response to detecting that the electronic device 500 is within the parking area, the electronic device 500 displays the parking user interface 650 previously discussed above via touchscreen 504. Specifically, as... Figure 6II As shown, the electronic device 500 optionally displays a first option 652-1, which can be selected to initiate navigation to an arrival area associated with the destination based on a pedestrian access mode, as discussed similarly above.
[0198] In some implementations, the destination is associated with a pre-arrival zone. In some implementations, the pre-arrival zone corresponds to a known and / or designated parking area at the destination. For example, in Figure 6JJ In this context, electronic device 500 navigates to the store destination (e.g., store A) based on the driving traffic pattern. Therefore, as... Figure 6JJ As shown, the electronic device 500 is displaying the navigation user interface 640 previously discussed above, which includes visual navigation instructions (e.g., text guidance 645 and representations of route 631) for navigating to a destination represented by representations 612-4 (e.g., icons including graphics or images) corresponding to store A on map 623. In some embodiments, in Figure 6JJ In this context, the destination is associated with a pre-arrival area, such as a parking area (e.g., a parking lot, parking structure, valet parking, etc.), represented by parking area 694 on map 623. In some implementations where the destination is associated with the pre-arrival area, the parking area previously discussed above is determined relative to the pre-arrival area rather than the destination, and the arrival area is not determined / established. For example, as... Figure 6JJAs shown in Figure 690, the parking area is centered on the entrance / start point of the parking lot (e.g., the entrance / start point corresponding to parking area 694 associated with store A) rather than destination 691. Additionally, as... Figure 6JJ As shown in Figure 690, electronic device 500 abandons the determination of the destination area based on the association between the determined destination and the pre-arrival area. Figure 6JJ As shown, the electronic device 500 is optionally located outside the parking area, as illustrated in Figure 690, and therefore the electronic device 500 is displaying the navigation user interface 640, as discussed above.
[0199] exist Figure 6KK In the process, electronic device 500 detects that its location is within parking area 694 of store A. For example, as... Figure 6KK As shown in Figure 690, the location 692 of the electronic device 500 has arrived at the parking lot associated with the destination 691. In some implementations, such as... Figure 6KK As shown, in response to detecting that the location of the electronic device 500 is within the parking lot, the electronic device 500 displays the arrival user interface 660 previously discussed above via the touchscreen 504. Specifically, as Figure 6KK As shown, the electronic device 500 optionally displays an indication of an address associated with the destination (e.g., the address of store A) and an option 662 that can be selected to end navigation to the destination, as discussed similarly above.
[0200] Figure 7 Examples of embodiments according to this disclosure include, for instance, Figures 6A to 6KK The flowchart illustrates a method for facilitating navigation to the location of one or more second electronic devices based on location information of those devices. Method 700 is optionally performed at electronic devices such as device 100, device 300, and device 500, as referenced above. Figures 1A to 1B , Figures 2 to 3 , Figures 4A to 4B and Figures 5A to 5H As described. Some operations in method 700 are optionally combined, and / or the order of some operations is optionally changed.
[0201] As described below, method 700 provides a method for facilitating navigation to the location of a second electronic device based on location information of the second electronic device shared with the user of the electronic device. This method reduces the cognitive burden on the user when interacting with the device user interface of this disclosure, thereby creating a more efficient human-machine interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charging cycles.
[0202] In some embodiments, method 700 is performed at an electronic device (e.g., electronic device 500) that communicates with a display generating component and one or more input devices (e.g., touchscreen 504). For example, the electronic device is a mobile device (e.g., tablet device, smartphone, media player, or wearable device) that includes wireless communication circuitry or automotive equipment and optionally communicates with one or more of the following: a mouse (e.g., external), a touchpad (optionally integrated or external), a remote control device (e.g., external), another mobile device (e.g., separate from the electronic device), a handheld device (e.g., external), and / or a controller (e.g., external). In some embodiments, the display generating component is a display integrated with the electronic device (optionally a touchscreen display), an external display such as a monitor, projector, television, or a hardware component (optionally integrated or external) for projecting a user interface or making the user interface visible to one or more users. In some implementations, method 700 is performed at or by a vehicle (e.g., at the infotainment system of a vehicle having or communicating with one or more display generation components and / or input devices).
[0203] In some implementations, when navigating to a first destination via a map application (e.g., running on an electronic device), a user interface associated with the map application is displayed via a display generation component (e.g., ...). Figure 6S When the user interface 640 is in the first destination (e.g., the parking area in Figure 690), the electronic device detects (702) that the location of the electronic device is within a first threshold distance (e.g., 0.15 miles, 0.25 miles, 0.3 miles, 0.4 miles, 0.5 miles, 0.75 miles, 1 mile, 1.5 miles, 2 miles, or 5 miles) of the first destination, wherein navigation to the first destination is based on a first travel mode (e.g., driving in a vehicle communicating with the electronic device), such as detecting that the location 692 of the electronic device 500 is within the parking area. Figure 6TAs shown in Figure 692. In some embodiments, the first destination corresponds to the location of a physical place or business (e.g., a restaurant, grocery store, shopping mall, clothing store, theater, cafe, barbershop, hair salon, etc.). In some embodiments, the first destination corresponds to the location of a second user different from the user of the electronic device. For example, the first destination corresponds to the current location of a second electronic device associated with (e.g., owned and / or operated by) the second user. In some embodiments, the current location of the second user is shared with the user of the electronic device (e.g., the second electronic device sends its location data (e.g., directly or indirectly via a server (e.g., a wireless communication terminal) communicating with the second electronic device) to the electronic device, making the second user's location accessible to the user of the electronic device). In some embodiments, the first destination corresponds to a location associated with the second user, such as a home address, company address, or another address where the second user is currently located. In some embodiments, as discussed in more detail below, the electronic device navigates to the first destination in response to user input detected by the electronic device (e.g., via one or more input devices) in a map application (e.g., in the user interface of the map application). In some implementations, navigating to a first destination includes displaying visual instructions in the user interface of a map application to guide the user to the first destination based on a first traffic pattern. For example, when navigating to the first destination, the map application's user interface includes text instructions (e.g., "turn left" or "turn right after 500 feet") overlaid on a visual representation of a portion of the current route from the electronic device's current location to the first destination (e.g., the user interface includes a map corresponding to a portion of the physical environment surrounding the electronic device's current location and a heading user interface element (e.g., an arrow) corresponding to the electronic device's current location on the route), and optionally, audio corresponding to the navigation instructions (e.g., audio using the voice output of a virtual assistant associated with the electronic device's operating system). In some implementations, the visual navigation instructions and the visual representation of the portion of the current route to the first destination are dynamically updated in response to changes in the distance between the electronic device's current location and the first destination during navigation. Additionally, in some implementations, if the selected passage mode (e.g., in response to receiving user input that changes the current navigation passage mode) changes, the visual navigation instructions change based on the updated passage mode (e.g., by changing the appearance and / or including alternative information), as will be discussed similarly later herein.In some embodiments, the user interface of the map application includes one or more indications of the estimated time of arrival (ETA) from the electronic device's current location to a first destination, the remaining time to reach the first destination (e.g., 5 minutes, 20 minutes, 1 hour, etc.), and / or the distance between the electronic device's current location and the first destination (e.g., 0.5 miles, 1.2 miles, etc.). In some embodiments, the display generation component is integrated with the electronic device (e.g., a touchscreen or other integrated display of the electronic device). In some embodiments, the display generation component is integrated with the vehicle the user of the electronic device is riding in (e.g., driving or riding as a passenger). In some embodiments, the first travel mode includes public travel, such as bus travel or train travel. In some embodiments, the first travel mode includes cycling or scooter-based travel.
[0204] In some implementations, when the location of the electronic device is within a first threshold distance of the first destination, the electronic device detects (704) an indication that the user of the electronic device is no longer using a first access mode to the first destination, such as an indication that the user of the electronic device 500 has parked the user's vehicle, as referenced. Figure 6WAs described. For example, if the first travel mode corresponds to driving and / or riding in a vehicle, detecting an indication that the user of the electronic device is no longer using the first travel mode to the first destination includes detecting that the vehicle is parked and / or detecting that the electronic device has left the vehicle. In some embodiments, the electronic device detects that the vehicle the user is riding in (e.g., driving or riding as a passenger) is parked by detecting a disconnection between the vehicle and the electronic device. For example, as mentioned above, when navigating to the first destination, the electronic device communicates with the vehicle (e.g., wirelessly, such as via Bluetooth or Wi-Fi, or wired). Therefore, detecting that the user of the electronic device is no longer using the first travel mode to the first destination includes detecting that the electronic device is no longer communicating with the vehicle. In some embodiments, the electronic device detects an indication that the user of the electronic device is no longer using the first travel mode to the first destination based on the movement speed / speed of movement of the electronic device. For example, in response to detecting that the electronic device is no longer moving and / or is moving at a speed below a speed threshold (e.g., 0.1 mph, 0.5 mph, 1 mph, 3 mph, or 10 mph) optionally for a threshold amount of time (e.g., 1 second, 2 seconds, 5 seconds, 10 seconds, 15 seconds, 30 seconds, 60 seconds, 120 seconds, 180 seconds, 240 seconds, etc.), the electronic device determines that the user has parked the vehicle and / or the user is no longer using the vehicle (e.g., a bus, train, or bicycle). In some implementations, the indication that the user is no longer using the first mode of transportation to the first destination is based on the current location of the electronic device. For example, the electronic device determines that the user has (e.g., partially) parked the vehicle by determining that the current location of the electronic device corresponds to a parking lot, parking structure, parking garage, or other dedicated parking area and optionally the electronic device is moving at a speed below the aforementioned speed threshold. As another example, the electronic device determines that the user is no longer using transportation (or a bus or train) by determining that the current location of the electronic device corresponds to a sidewalk, bus stop, train platform, etc. In some implementations, the detection indication includes detecting input provided by the user of the electronic device, indicating that the user should no longer navigate to the first destination according to the first travel mode. For example, the user interface associated with a map application includes one or more optional options for (e.g., manually) indicating the end of navigation to the first destination by vehicle (or bus, train, bicycle, etc.) (e.g., a change from navigation to the first destination by vehicle).
[0205] In some implementations, in response to the detection of an indication (706), based on determining that the electronic device's location is outside a second threshold distance (e.g., 50 feet, 75 feet, 100 feet, 125 feet, 150 feet, 200 feet, 250 feet, 275 feet, 300 feet, 400 feet, etc.) less than a first threshold distance (e.g., but still within the first threshold distance) from the first destination (e.g., automatically (e.g., without user input)), the electronic device displays (708) a first option (e.g., such as...) in the user interface via a display generation component. Figure 6W The first option 662-1 in the parking user interface 650 shown can be selected to initiate navigation to a first destination via a map application according to a second traffic mode (e.g., a walking traffic mode) different from the first traffic mode. For example, when the current location of the electronic device is within a first threshold distance from the first destination, if the electronic device detects an indication discussed above (e.g., the user has parked their vehicle or is no longer using the vehicle), and the electronic device is also outside a second threshold distance from the first destination, the electronic device displays a user interface for switching to navigation to the first destination via the second traffic mode (e.g., instead of or as an update to the user interface of the map application discussed above). In some embodiments, the user interface includes the first option discussed above. In some embodiments, in response to detecting the selection of the first option, the electronic device updates the user interface of the map application such that visual navigation instructions are specific to the second traffic mode (e.g., the electronic device provides the user with walking instructions guiding the user along sidewalks and crosswalks to the first destination), as discussed in more detail below. In some implementations, the user interface for switching to navigation to the first destination via a second access mode includes a second option that can be selected to end (e.g., exit) navigation to the first destination. For example, in response to detecting a selection of the second option, the electronic device stops displaying visual instructions for guiding the user to the first destination and a visual representation of the current route to the first destination in the user interface of a map application.
[0206] In some implementations, based on the detection of an indication when the location of the electronic device is within a second threshold distance from the first destination, the electronic device displays (710) an arrival user interface associated with the map application for the first destination via a display generation component (e.g., and does not display a first option that can be selected to initiate navigation to the first destination via the map application according to a second travel mode), such as Figure 6YThe arrival user interface 660 is shown. For example, if the electronic device detects that the user has parked their vehicle and / or the user is no longer in the vehicle (e.g., on a bus or train), and the current location of the electronic device is within the second threshold distance discussed above from the first destination, the electronic device displays the arrival user interface in a map application. In some embodiments, the arrival user interface includes an optional option that can be selected to end (e.g., exit) navigation to the first destination, as similarly discussed above. In some embodiments, the arrival user interface includes an indication of the distance between the current location of the electronic device and the first destination and / or an indication of where the first destination is located relative to the current location of the electronic device (e.g., on a map in a map application and / or in a visual representation of the current route to the first destination). In response to detecting that the electronic device is no longer using the first travel mode to the destination when its current location is within the threshold distance from the destination, displaying an option that can be selected to switch to navigation to the destination according to the second travel mode reduces the amount of input required to navigate to the destination using the second travel mode and / or allows the travel mode to change automatically, thereby improving user-device interaction.
[0207] In some implementations, in response to (and / or optionally) detecting that the location of the electronic device is within a first threshold distance (e.g., 0.15 miles, 0.25 miles, 0.3 miles, 0.4 miles, 0.5 miles, 0.75 miles, 1 mile, 1.5 miles, 2 miles, or 5 miles) of the first destination, the electronic device displays a user interface via a display generation component for changing the navigation mode to the first destination, such as... Figure 6WThe electronic device displays a parking user interface 650. For example, as discussed similarly above, the electronic device displays a "parked" or "parked" user interface that allows the user of the electronic device to switch from navigating to a first destination via a first travel mode (e.g., driving, carpooling, train, cycling, etc.) to navigating via a second travel mode (e.g., walking). In some embodiments, as described below, the user interface includes an optional option that can be selected to change the travel mode from the first mode to the second mode. In some embodiments, the user interface also includes an option to terminate / stop navigation to the first destination (e.g., regardless of the current travel mode). For example, if the electronic device detects a selection of the option to terminate navigation, the electronic device stops displaying the user interface for changing the travel mode to the first destination and redisplays the user interface associated with the map application discussed above. In some such embodiments, because navigation has ended, the user interface associated with the map application no longer includes the user interface elements for guiding the user to the first destination previously discussed above. In some implementations, when the electronic device's location remains within a first threshold distance to the first destination and outside a second threshold distance to the first destination as discussed above, the electronic device maintains the display of the user interface for changing the travel mode. For example, as discussed similarly above, if the electronic device detects that the user has parked (e.g., or is no longer driving or traveling as a passenger), but the electronic device's location is outside the second threshold distance to the first destination, the electronic device maintains the display of the user interface to change the travel mode for navigating to the first destination (e.g., but updates the heading within the user interface from "Parked" to "Parked"). Displaying the user interface for switching to navigation to the destination according to the second travel mode in response to detecting that the electronic device is within the first threshold distance to the destination reduces the amount of input required to navigate to the destination using the second travel mode and / or allows the travel mode to change automatically, thereby improving user-device interaction.
[0208] In some implementations, the user interface for changing the transit mode for navigation to a first destination includes optional options (e.g., as discussed similarly above) that can be selected to change the transit mode from a first transit mode to a second transit mode, such as... Figure 6WThe first option 662-1 in the parking user interface 650 shown. In some embodiments, selecting an optional option causes the electronic device to navigate to a first destination via a second traffic mode (e.g., walking). In some embodiments, navigating to a first destination via the second traffic mode includes displaying visual instructions in the user interface of a map application to guide the user to the first destination according to the second traffic mode. For example, when navigating to the first destination, the user interface of the map application includes text instructions (e.g., “turn left” or “turn right in 25 feet”) overlaid on a visual representation of a portion of the current route from the electronic device’s current location to the first destination (e.g., the user interface includes a map corresponding to a portion of the physical environment around the electronic device’s current location and a heading user interface element (e.g., an arrow) corresponding to the electronic device’s current location on the route), and optionally presents audio corresponding to the navigation instructions (e.g., audio using the voice output of a virtual assistant associated with the electronic device’s operating system). In some embodiments, the visual navigation instructions and the visual representation of the portion of the current route to the first destination are dynamically updated in response to changes in the distance between the electronic device’s current location and the first destination during navigation, as discussed similarly above. In some implementations, the map application's user interface includes one or more indications of the estimated time of arrival (ETA) from the electronic device's current location to the first destination, based on a second travel mode (e.g., how fast the user walks and / or based on the average walking speed of the user and / or other users), the remaining time to reach the first destination (e.g., 1 minute, 2 minutes, 5 minutes, etc.), and / or the distance between the electronic device's current location and the first destination (e.g., 100 feet, 0.2 miles, 0.5 miles, etc.). In some implementations, the electronic device initiates navigation to the first destination via a second travel mode (e.g., walking) based on determining that the distance between the first destination and the electronic device's current location is at least a minimum distance (e.g., 10 feet, 15 feet, 30 feet, 50 feet, 100 feet). In some implementations, the electronic device initiates navigation to the first destination via a second travel mode based on determining that the location of the first destination is a known / identifiable location and / or that it can be reached via the second travel mode (e.g., above a threshold confidence level, such as 80%, 85%, 90%, etc.). In some implementations, the electronic device displays optional options in the user interface of a map application based on determining that its current location is outside a second threshold distance from a first destination. In response to detecting that the electronic device is within the first threshold distance from the destination while navigating according to a first traffic mode, displaying an option in the user interface that can be selected to switch to navigation to the destination according to a second traffic mode reduces the amount of input required to navigate to the destination using the second traffic mode and / or allows the traffic mode to change automatically, thereby improving user-device interaction.
[0209] In some implementations, before navigating to a first destination via a map application (e.g., running on an electronic device), and while displaying a user interface associated with the map application, the electronic device receives a sequence of one or more inputs corresponding to a request for navigation to the first destination via one or more input devices, such as selection via touch 603 on a representation 612-1 on a map 623 for the user interface 602. Figure 6B As shown below, for example, as described below, an electronic device receives a sequence of one or more inputs to a user interface for a map application, the sequence of one or more inputs causing the electronic device to navigate to a first destination via a first access mode. For example, the sequence of one or more inputs includes input provided by a user specifying the first destination as the destination for navigation, such as (e.g., via text entered into a search field in the user interface) searching for an address associated with the first destination, a name associated with the first destination, the type of the first destination (e.g., location type, such as restaurant, shopping mall, cinema, cafe, etc.), etc. In some embodiments, the sequence of one or more inputs includes input selecting an option for initiating navigation to the first destination (e.g., after the first destination has been specified as the destination for navigation). For example, as described below, the options are displayed in a page or virtual card associated with the first destination. In some embodiments, the sequence of one or more inputs includes input specifying a first access mode as the access mode for navigation to the first destination. For example, the first access mode is selected from a list of access modes within a page or virtual card associated with the first destination.
[0210] In some implementations, in response to receiving a sequence of one or more inputs, the electronic device initiates a process of navigating to a first destination via a map application (e.g., as discussed similarly above), such as displaying... Figure 6L The navigation user interface 640 shown. Navigation to a destination is initiated via the user interface of a map application running on an electronic device according to a first traffic mode, wherein during navigation, the electronic device displays an option that can be selected to switch to navigation to the destination according to a second traffic mode in response to detecting that the electronic device is within a first threshold distance of the destination. This reduces the total amount of input required to navigate to the destination via different traffic modes and / or allows the traffic mode to change automatically after navigation has started, thereby improving user-device interaction.
[0211] In some implementations, the first destination corresponds to a second user (such as...) Figure 6CThe location of a second electronic device associated with the second user (Sam) indicated in the user interface 602 shown, wherein the second electronic device is different from the user of the second electronic device, and the second user is different from the user of the second electronic device (e.g., as discussed similarly above). In some embodiments, the first destination is not necessarily the location of the second electronic device if the electronic device does not have permission to access the location of the second electronic device (e.g., because the second user has not yet granted the user of the electronic device access to the location of the second electronic device). For example, the first destination is a home address or business address (or other address) associated with the second user, and the second electronic device may or may not be located at such an address. Navigation to another user's location is initiated via the user interface of a map application running on the electronic device according to a first access mode, wherein during navigation, the electronic device displays an option that can be selected to switch to navigation to another user's location according to a second access mode in response to detecting that the electronic device is within a first threshold distance of that location, thereby reducing the total amount of input required to navigate to another user's location via different access modes and / or enabling the access mode to change automatically after navigation has begun, thereby improving user-device interaction.
[0212] In some implementations, the sequence of one or more inputs to the user interface associated with the map application includes corresponding inputs to the user interface of a second user (e.g., a virtual contact card of the second user as the user interface of the map application), such as the area 614 associated with the second user Sam. Figure 6DAs shown. In some embodiments, as discussed similarly above, the second user's user interface includes options to be selected to navigate to a location associated with the second user (e.g., the second user's current location (e.g., the current location of the second electronic device), an address associated with the second user (e.g., a home address saved to / stored by the electronic device, a company address, etc.)). In some embodiments, the second user's user interface includes information corresponding to the second user, as discussed in more detail below. For example, the second user's user interface includes an indication of the second user's current location (e.g., the current location of the second electronic device), the second user's name, one or more addresses associated with the second user (e.g., a home or company address), the second user's contact information (e.g., one or more phone numbers of the second user, such as a cellular or home phone number, the second user's email address, etc.). In some embodiments, the second user's user interface is displayed in response to detecting a selection of a representation of the second user's location (e.g., the location of a second electronic device owned by the second user), and this user interface is displayed as an overlay on a map in the user interface of a map application. For example, the representation of the second user's location is displayed on the map at a location corresponding to the second user's (e.g., the second electronic device's) current location in the physical environment represented by the map. In some implementations, as discussed similarly above, the second user's user interface is displayed in response to receiving a query in a search field of the map application's user interface. For example, the electronic device detects selection of one or more keys on a keyboard (e.g., a virtual keyboard displayed as an overlay on the map application's user interface is the electronic device's system keyboard, or a physical keyboard communicating with the electronic device) to enter text in the search field, including the second user's address, the second user's name, the second user's number (e.g., a phone number), etc. In some implementations, the second user's user interface is displayed in response to detecting selection of a suggested element associated with the second user displayed in the map application's user interface. For example, an electronic device may display suggested elements associated with a second user based on recent user activity, such as the user of the electronic device recently communicating with the second user (e.g., within a threshold time frame, such as 15 minutes, 30 minutes, 1 hour, 2 hours, 6 hours, 1 day, 3 days, etc.) (e.g., via text messaging, email, telephone call, etc.), the second user recently sharing their location with the user of the electronic device (e.g., location information corresponding to the second electronic device) (e.g., via a location-based app, discussed in more detail below), generating calendar events that include the second user, and other possibilities.Initiating navigation to another user's location via a user's user interface according to a first access mode, wherein during navigation, the electronic device displays an option to switch to navigation to the other user's location according to a second access mode in response to detecting that the electronic device is within a first threshold distance of that location, thereby reducing the total amount of input required to navigate to the other user's location via different access modes and / or enabling the access mode to change automatically after navigation has started, thereby improving user-device interaction.
[0213] In some implementations, based on the determination that the user of the electronic device has the right to access the location of the second electronic device associated with the second user, the second user's user interface includes a second option that can be selected to display the user interface of the item location application, such as... Figure 6C The second option 613-2 is shown. For example, a second user owning the second electronic device has previously (e.g., before the second user's user interface is displayed on the electronic device) granted the user of the electronic device access to the location of the second electronic device. Therefore, in some embodiments, the location of the second electronic device can be viewed by the electronic device (e.g., via an item location application running on the electronic device, as discussed in more detail later). In some embodiments, the second electronic device wirelessly transmits its location data to the electronic device via Bluetooth, RF, IR, NFC, or Wi-Fi (e.g., directly or indirectly using a server communicating with both the electronic device and the second electronic device). In some embodiments, selecting the second option causes the electronic device to automatically start and display the user interface of the item location application (e.g., and stop displaying the user interface of a map application). In some embodiments, the item location application is an application that displays one or more representations of one or more searchable items and / or users (e.g., including the second user) and indications of the location of one or more searchable items and / or users. In some embodiments, a user opens the item location application to view the location of one or more users (e.g., a second user whose access has been granted by the user through invitation and / or request). In some implementations, a user selects one or more items or users for location, and in response, the item location application optionally (e.g., on a map) displays an indication of the location of the selected one or more items or users to the user. In some implementations, in response to detecting a selection of a second option, the electronic device initiates a process for locating / finding the location of a second electronic device. For example, the electronic device selects / highlights a representation of a second user on a map and displays an indication of the current location of the second electronic device, as described below.
[0214] In some implementations, the electronic device displays an indication of the current location of a second electronic device associated with a second user, such as... Figure 6CThe location of the second user, Sam, is indicated in area 614. For example, the second user's user interface includes a textual indication of the current location of the second electronic device, such as the current address of the second electronic device. In some embodiments, the indication of the current location of the second electronic device includes a distance indication (100 feet, 1 mile, 5 miles, 20 miles, etc.) indicating the distance between the second electronic device and the electronic device. This distance indication is optionally accompanied by a time indication indicating when the distance indication was last updated (e.g., now, 2 seconds ago, 1 minute ago, 1 hour ago, or 5 hours ago). For example, the second user's user interface optionally indicates the distance of the second locatable item from the electronic device and / or the user, and a time indication indicating how much time has passed since the distance was updated. If the electronic device has access to another user's location, an option to display the user interface of the item location application within the other user's user interface provides the user with a visual cue that the user has access to the other user's location and / or reduces the amount of input required to locate the user via the item location application, thereby improving user-device interaction.
[0215] In some implementations, based on the determination that the user of the electronic device does not have permission to access the location of the second electronic device associated with the second user, the second user's user interface includes a third option that can be selected to initiate a process of requesting access to the location of the second electronic device from the second user, such as... Figure 6HOption 619-2 is shown. For example, the second user, who owns the second electronic device, has not previously (e.g., before the second user's user interface is displayed at the electronic device) granted the user of the electronic device access to the location of the second electronic device. Therefore, in some embodiments, the location of the second electronic device cannot be viewed by the electronic device (e.g., via an item location application running on the electronic device, as discussed in more detail later). In some embodiments, if the electronic device detects a selection of the third option, the electronic device initiates a process of sending a request to the second user. In some embodiments, the electronic device sends the request via a messaging application running on the electronic device (e.g., in the form of a text message, email, or other message) (e.g., different from a map application). For example, the request is sent as a message bubble in a text message session with the second user at the electronic device. Additionally, in some embodiments, because the user of the electronic device does not have access to the location of the second electronic device associated with the user, the second user's user interface does not include the indication of the current location of the second electronic device associated with the second user, as discussed above. In some implementations, if a user grants a request for access to the location of a second electronic device, the location of the second electronic device becomes viewable by the device, such that when the second user's user interface is redisplayed, the user interface is updated to include the second option discussed above and an indication of the current location of the second electronic device. If the electronic device does not have permission to access another user's location, displaying an option to request access to the location of another user at the electronic device provides the user with a visual indication that the user does not have access to the location of another user, and / or reduces the amount of input required to request access to another user's location when locating the user via an item location application, thereby improving user-device interaction.
[0216] In some implementations, the second user's user interface includes an indication of the current location of a second electronic device associated with the second user (e.g., as discussed similarly above), such as... Figure 6D The location of the second user Sam is indicated by indicator 615-1, and information indicating one or more addresses associated with the second user is provided, such as... Figure 6DThe information in optional instructions 615-2 and 615-4, indicating the home and business addresses of the second user Sam, is shown. For example, one or more addresses may (optionally) differ from the current location of the second electronic device associated with the second user. In some embodiments, the one or more addresses include the second user's home address, the second user's business address, and other possibilities. In some embodiments, when input for initiating navigation to the second user's location is detected, the second user is located at one of the one or more addresses (e.g., as indicated by the instructions discussed above). In some embodiments, information indicating one or more addresses associated with the second user is provided in the second user's user interface using information collected from a contact list of a telephone calling application running on the electronic device. For example, the second user's contact card associated with the telephone calling application's contact list includes one or more addresses associated with the second user (e.g., because the user of the electronic device enters these addresses into the second user's contact card).
[0217] In some implementations, the second user's user interface includes one or more options associated with one or more addresses, such as... Figure 6D The optional instructions 615-2 and 615-4 are shown, wherein one or more options can be selected to initiate a process of navigation to a selected address among one or more addresses. For example, each address listed in the information discussed above displays an option (e.g., a "Start" option or other navigation option) that can be selected to initiate a process of navigation to the associated address. In some embodiments, the input discussed above for initiating navigation to a first destination (e.g., the location of a second user) corresponds to the selection of one of the options associated with one or more addresses in the user interface of the second user. For example, selecting the option associated with the second user's home address makes the home address the location of a second electronic device associated with the second user (as used herein), and the electronic device initiates navigation to the second user's home address (e.g., as the first destination). In response to the detection of a selection associated with one of one or more addresses, navigation to another user's location is initiated via another user's user interface, which includes information identifying one or more addresses associated with that user. This reduces the total amount of input required to navigate to another user's location via a map application and / or facilitates the discovery that the other user's current location does or does not correspond to one of one or more addresses. This helps inform the user's navigation decision and thus improves user-device interaction.
[0218] In some implementations, the first destination corresponds to the merchant's location (e.g., or any point of interest as discussed similarly above), such as... Figure 6JJ The navigation user interface 640 shows store A. For example, the first destination is a restaurant, shop or shopping mall, cafe, landmark, starting point of a hiking trail, etc. In some embodiments, the merchant's location is a known location that can be identified and accessed via a map application in one or more of the ways discussed above. In some embodiments, the first destination corresponds to a location defined by a user-defined pin placed on a map on the user interface of the map application. Navigation to the merchant's location is initiated via the user interface of the map application running on the electronic device according to a first access mode, wherein during navigation, the electronic device displays an option that can be selected to switch to navigation to another user's location according to a second access mode in response to detecting that the electronic device is within a first threshold distance of the location. This reduces the total amount of input required to navigate to another user's location via different access modes and / or allows the access mode to change automatically after navigation has started, thereby improving user-device interaction.
[0219] In some implementations, when navigating along a route that includes a first destination, the system determines the first destination in relation to a second user (such as...). Figure 6K The location of the second electronic device (as indicated by instruction 633-3) of the second user Sam is associated with the location of the second electronic device, wherein the second electronic device is different from the electronic device and the second user is different from the user of the electronic device. The user interface associated with the map application includes optional instructions for sharing the estimated time of arrival (ETA) at the first destination with the second user, such as... Figure 6L The optional indication 643 is shown. For example, if the first destination corresponds to the location of another user (e.g., the first destination is the second user's current location or an address associated with the second user (e.g., a home address or a business address)), then when visual navigation guidance is displayed in the user interface of the map application, the electronic device displays optional indications (e.g., optional suggestions) in the user interface. In some embodiments, in response to receiving a selection of optional indications, the electronic device shares the ETA at the first destination with the first user. For example, the electronic device sends its location information to a second electronic device, which causes the second electronic device to display a visual indication (e.g., a notification) indicating the ETA at the first destination to the user. Additionally, in some embodiments, sharing the ETA with the second user at the second electronic device allows the second user to travel along the route from the user to the first destination (e.g., the second electronic device is able to locate itself while sharing the ETA with the second user).
[0220] In some implementations, the first destination is an intermediate destination among one or more intermediate destinations between the current location of the electronic device and the final destination (e.g., a second destination different from the first destination). For example, when navigating to the second destination via (e.g., a map application running on the electronic device) according to a first travel mode, and while displaying a user interface associated with the map application, the electronic device receives a sequence of one or more inputs via one or more input devices corresponding to a request to navigate to the first destination (e.g., a request to add a stop to the current navigation), where the first destination is an intermediate destination to the final destination. In some implementations, the sequence of one or more inputs includes the selection of an option in the user interface of the map application, which can be selected to initiate the process of adding a stop to the current navigation. For example, the selection of an option causes the electronic device to display a user interface associated with the map application for adding a stop (e.g., while navigation to the first destination is still in progress). In some implementations, the user interface for adding a stop includes a search field (e.g., a text input field), one or more suggested destinations (e.g., suggested based on user activity, such as recent destinations / locations discussed herein), user-favorited locations (e.g., the user's home or work location), etc. In some implementations, a sequence of one or more inputs includes input that designates the first destination as a stop during navigation to the second destination. For example, the electronic device detects a selection for a search field that enables the user to (e.g., via input detected through a virtual or physical keyboard, as previously discussed) enter text to search for a second destination and subsequently add the first destination as a stop for navigation to the second destination. As another example, the electronic device detects a selection of suggested destinations in the user interface or destinations favorited by the user for adding a stop.
[0221] In some implementations, in response to receiving a sequence of one or more inputs, the electronic device initiates navigation to a second destination via a map application according to a first traffic pattern. For example, the electronic device updates the map application's user interface based on the navigation to the second destination. In some implementations, the visual navigation guidance previously discussed above is updated to now provide visual instructions to guide the user to the second destination instead of the first destination. However, it should be understood that because the second destination is the current navigation stop, the electronic device optionally (e.g., automatically) resumes navigation to the first destination when the user of the electronic device reaches the second destination. Additionally, in some implementations, the map application's user interface is updated to include one or more indications of: the ETA from the electronic device's current location to the second destination, the remaining time to reach the second destination (e.g., 3 minutes, 10 minutes, 30 minutes, 1 hour, etc.), and / or the distance between the electronic device's current location and the second destination (e.g., 0.5 miles, 1 mile, 2 miles, etc.).
[0222] In some implementations, the electronic device waives the option to display optional instructions if it is determined that the first destination is not relevant to the location of the second electronic device associated with the second user (e.g., the first destination corresponds to a merchant's location and not to another user's location). In some implementations, the map application's user interface alternatively includes an optional option that can be selected to share the ETA at the first destination with one or more users other than the user of the electronic device, rather than specifically with the second user of the second electronic device. For example, if a user provides input to select an optional option, the electronic device displays a list of users who can share the ETA, as well as a search field through which the user of the electronic device can search for a specific user, such as the second user discussed above. When navigating to a stop during navigation to a destination, displaying the option to share the ETA at the stop with another user if the stop corresponds to a location associated with another user reduces the amount of input required to share the ETA at the stop and / or facilitates the discovery of ETAs that can be shared with another user, thereby improving user-device interaction.
[0223] In some implementations, the first destination corresponds to the final destination of the route (e.g., as discussed similarly above), such as Figure 6Q As indicated in instruction 639-2. When navigating to a stop during navigation to the destination, displaying the option to share the ETA at the stop with another user if the stop corresponds to another user's location reduces the amount of input required to share the ETA at the stop with another user and / or facilitates the discovery that an ETA can be shared with another user, thereby improving user-device interaction.
[0224] In some implementations, the first destination corresponds to the location of a third electronic device associated with a third user, wherein the third electronic device is different from the electronic device and the second electronic device, and the third user is different from the user of the electronic device and the second user, such as... Figure 6Q The location of the third user Jane is indicated by instruction 639-1. For example, when the electronic device receives a sequence of one or more inputs discussed above for adding a docking point to the current navigation, the electronic device is navigating to the location of the third user (e.g., the third user's current location or a location associated with the third user, such as a home address or business address), as discussed similarly herein.
[0225] In some implementations, depending on whether the determined route includes a second destination associated with the location of a second electronic device associated with a second user (e.g., as described above), an optional instruction can be selected to initiate a process for sharing an ETA at the second destination with one or more users, including the second user and a third user, such as sharing an ETA with one or more users 649-1 to 649-4. Figure 6R As shown. For example, because multiple users (e.g., a second user and a third user) are involved in the current navigation (e.g., as a destination during navigation), optional indications enable a user to share the ETA at a second destination with one or more of the multiple users, including the second user and the third user. In some embodiments, if the electronic device detects a selection of the optional indication, the electronic device displays a list of multiple users who can be selected to share the ETA at the second destination. For example, the list of multiple users includes the second user and the third user, and a selection of either or both of the second user and the third user causes the electronic device to send location information (including the ETA) corresponding to the electronic device to the second electronic device and / or the third electronic device based on that selection. In some embodiments, the second user is displayed at the top of the list of multiple users because the second user's location was recently added as a stop point for the current navigation. When navigating to the second user's location during navigation to the first user's location, displaying the option to be selected to initiate a process of sharing the ETA at the second user's location with one or more users, including the second user and the first user, reduces the amount of input required to share the ETA with one or more users and / or facilitates the discovery that an ETA can be shared with one or more users, thereby improving user-device interaction.
[0226] In some implementations, upon detecting an indication that the location of the electronic device is outside a second threshold distance from the first destination (e.g., 50 feet, 75 feet, 100 feet, 125 feet, 150 feet, 200 feet, 250 feet, 275 feet, 300 feet, 400 feet, etc.), the electronic device receives a selection of the first option via one or more input devices, such as selection of the first option 662-1 via contact 603, when a first option is displayed in the user interface in response to the detected indication. Figure 6W As shown. For example, after the user of the electronic device has parked their vehicle and / or is no longer traveling in the vehicle (or bus, train, etc.), the electronic device detects a selection of a first option, which can be selected to initiate navigation to a first destination via a map application according to a second travel mode (e.g., a walking travel mode). In some embodiments, the selection of the first option corresponds to a tap or touch provided by a contact detected on the touch-sensitive surface of the electronic device (e.g., the fingertip of the user's hand or the tip of a stylus). For example, the electronic device detects a tap of a fingertip on the touchscreen of the electronic device at a location corresponding to the location of the first option in the user interface. In some embodiments, the selection of the first option corresponds to the selection of a physical button on a hardware input device (e.g., a remote controller) that communicates with the electronic device. In some embodiments, the selection of the first option corresponds to an air gesture detected via one or more cameras of the electronic device (e.g., an air pinch gesture provided by the user's hand, where the index finger and thumb of the hand are brought together for contact).
[0227] In some implementations, in response to detecting a selection of a first option, the electronic device initiates navigation to a first destination via a map application according to a second travel mode, including updating the display of the user interface associated with the map application based on the navigation, such as displaying... Figure 6XA navigation user interface 640 showing the walking direction. For example, as discussed similarly above, the electronic device displays visual instructions in the user interface of a map application to guide the user to a first destination according to a second traffic pattern. In some embodiments, when navigating to the first destination, the user interface of the map application includes text instructions (e.g., “turn left” or “turn right in 25 feet”) over a visual representation of a portion of the current route from the electronic device’s current location to the first destination (e.g., the user interface includes a map corresponding to a portion of the physical environment around the electronic device’s current location and a heading user interface element (e.g., an arrow) corresponding to the electronic device’s current location on the route), and optionally presents audio corresponding to the navigation instructions (e.g., audio using the voice output of a virtual assistant associated with the electronic device’s operating system). In some implementations, the map application's user interface includes one or more indications of the estimated time of arrival (ETA) from the electronic device's current location to the first destination, based on a second travel mode (e.g., how fast the user walks and / or based on the average walking speed of the user and / or other users), the remaining time to reach the first destination (e.g., 1 minute, 2 minutes, 5 minutes, etc.), and / or the distance between the electronic device's current location and the first destination (e.g., 100 feet, 0.2 miles, 0.5 miles, etc.). Switching to navigation to the destination based on the second travel mode in response to detecting a selection of options in the user interface when the electronic device is within a first threshold distance from the destination while navigating according to the first travel mode reduces the amount of input required to navigate to the destination using the second travel mode and / or enables the travel mode to change automatically, thereby improving user-device interaction.
[0228] In some implementations, when navigating to a first destination via a map application according to a second travel mode, the electronic device detects its position within a second threshold distance (e.g., 50 feet, 75 feet, 100 feet, 125 feet, 150 feet, 200 feet, 250 feet, 275 feet, 300 feet, 400 feet, etc.) of the first destination, such as detecting that the position 692 of electronic device 500 is within the arrival area. Figure 6Y As shown in Figure 690. For example, when a user walks to a first destination by following visual navigation instructions provided by the electronic device, the electronic device detects that its position is within a second threshold distance of the first destination.
[0229] In some implementations, in response to detecting that the location of the electronic device is within a second threshold distance of the first destination, the electronic device displays an arrival user interface associated with a map application for the first destination (e.g., as shown in the image) via a display generation component. Figure 6YThe arrival user interface 660 shown (e.g., as discussed similarly above). In response to detecting that the electronic device is within a second threshold distance of the destination, displaying the arrival user interface of the destination while navigating to the destination according to a second traffic mode helps to detect that the user of the electronic device is approaching the destination and / or enables the arrival user interface, which allows navigation to end automatically, thereby improving user-device interaction.
[0230] In some implementations, the first destination corresponds to a second user (such as...) Figure 6K The location of the second electronic device associated with the second user Sam indicated in Instruction 633-2 (e.g., as discussed similarly above), wherein the second electronic device is different from the electronic device and the second user is different from the user of the electronic device, and the arrival user interface associated with the map application for the first destination includes optional options that can be selected to display the user interface of the item location application (e.g., the user interface of the item location application discussed above) (e.g., such as...). Figure 6AA The first option 662-1 is shown. In some embodiments, upon detecting an indication that the location of the electronic device is within a second threshold distance (e.g., 50 feet, 75 feet, 100 feet, 125 feet, 150 feet, 200 feet, 250 feet, 275 feet, 300 feet, 400 feet, etc.) from the first destination, and upon displaying an arrival user interface including optional options in response to detecting the indication, the electronic device receives a selection of an optional option in the arrival user interface via one or more input devices, such as selection of the first option 662-1 via contact 603. Figure 6AA As shown. For example, an electronic device receives an input that is similar to or corresponds to one of the selection inputs discussed above.
[0231] In some implementations, in response to receiving a selection of an optional option, the electronic device displays a user interface of the item positioning application (e.g., as shown in the image) via a display generation component. Figure 6BB The user interface 670 shown includes information corresponding to the second user, such as the current location of the second user Sam. Figure 6BBThe area indicated by zone 671 in the document. In some embodiments, as similarly discussed above, the user interface of the item location application includes one or more representations of one or more searchable items and / or users (e.g., including a second user) on a map overlaid on the user interface, and an indication of the location of one or more searchable items and / or users. In some embodiments, the map corresponds to a physical area surrounding the location of the second user. In some embodiments, since the user of the electronic device is within a second threshold distance of the second user's location, the user interface of the item location application includes a visual indication of the current location of the electronic device (e.g., corresponding to the location of the user of the electronic device). In some embodiments, the information corresponding to the second user includes an indication of the current location of the second user, and a time indication corresponding to the time when the indication of the current location of the second user was last updated, as similarly discussed above with reference to item location applications. For example, as similarly discussed herein, the time indication indicates "now, 1 minute ago, 5 minutes ago, 1 hour ago, etc." In some embodiments, as previously discussed above, the user interface of the item location application includes a representation of the second user and an indication of the current location of the second user because the user of the electronic device has been granted access to the location of the second user (e.g., the location of the second electronic device). In some implementations, information corresponding to the user is displayed in a second user's user interface (e.g., a virtual card or page) associated with the item location application. Displaying the item location application's user interface in response to detecting a selection of an option to display the item location application's user interface while navigating to another user's location according to a second access mode facilitates the discovery that the user of the electronic device has access to the other user's current location and / or reduces the amount of input required to locate the other user via the item location application. This helps improve the accuracy of locating the other user, thereby improving user-device interaction.
[0232] In some implementations, the information corresponding to the user includes optional options that can be selected to display a user interface for locating the first destination (e.g., a user interface associated with proximity lookup features (e.g., because the user of the electronic device has access to the location of the second electronic device associated with the second user) enabled for the second electronic device), such as Figure 6BB The second option 672-2 is shown. In some embodiments, when displaying the user interface of an item location application that includes optional options, the electronic device receives a selection of the optional options via one or more input devices, such as a selection of the second option 672-2 via contact 603. Figure 6BB As shown. For example, an electronic device receives an input that is similar to or corresponds to one of the selection inputs discussed above.
[0233] In some implementations, in response to receiving a selection of an optional option, and based on determining that the location of the electronic device is still within a second threshold distance of the first destination (e.g., the location of a second electronic device associated with a second user, as previously discussed above), the electronic device displays a user interface for locating the first destination via a display generation component, such as... Figure 6CC The user interface 675 is used for locating the first destination. For example, the electronic device replaces the display of the item location application's user interface with a user interface associated with proximity search features for locating a first destination (e.g., when the user's location is within a second threshold distance of the location of a second electronic device associated with a second user). Additional details regarding the user interface for locating the first destination are provided below. Displaying a user interface associated with the proximity search features of the electronic device in response to detecting a selection of an option for displaying the user interface when navigating to the location of the electronic device allows the user to effectively locate the user's location on the electronic device, thereby improving user-device interaction.
[0234] In some implementations, displaying a user interface for locating a first destination includes displaying a first visual indicator, such as a direction indicating the location of the first destination relative to the electronic device, via a display generation component. Figure 6CCThe arrow indicator 673 is shown. For example, a user interface associated with a proximity lookup feature for locating a first destination (e.g., the location of a second user) includes a first visual indicator (e.g., an arrow) that indicates (e.g., associated with the second user) the direction in which the second electronic device is positioned relative to the electronic device (e.g., the electronic device displays an arrow pointing to the direction in which the second user is positioned relative to the electronic device, determined based on location information provided by the second electronic device and / or a server communicating with the second electronic device). In some embodiments, a second indicator (e.g., a dot) is displayed corresponding to a forward direction (e.g., relative to the front of the second electronic device). In some embodiments, a first indicator (e.g., an arrow) is displayed corresponding to the direction of the first destination (e.g., relative to the center of the display). In some embodiments, the arrow points from the center of the display to the second indicator (e.g., thus to the first destination). In some embodiments, an arc is displayed between the first and second indicators to indicate to the user of the electronic device the direction in which to rotate the electronic device to align the second electronic device with the front of the electronic device (e.g., rotating the electronic device along the direction of the arc to align the first indicator with the second indicator). In some implementations, when displaying the first visual indicator, if the electronic device (e.g., using one or more sensors, such as an accelerometer, gyroscope, or GPS sensor) detects a change in the orientation of the electronic device (e.g., detecting rotation of the device toward or away from the second electronic device), the electronic device changes the appearance of the first visual indicator (e.g., rotating an arrow) to indicate the orientation of the second electronic device relative to the electronic device (e.g., updating the display to reflect the change in orientation of the second electronic device relative to the electronic device as the electronic device rotates toward or away from the second electronic device). For example, when the device rotates toward the second electronic device (e.g., the front of the electronic device rotates toward the second electronic device), the arrow rotates to point to the top of the electronic device (e.g., according to the second user's positioning) and / or the first indicator moves toward the first indicator (e.g., according to the second user's positioning). Thus, the first indicator (e.g., the arrow) is updated "in real time" to point to the position corresponding to the second user. Displaying a user interface associated with the proximity lookup feature of the electronic device, including the first visual indicator, in response to detecting a selection of an option for displaying a user interface when navigating to the location of the electronic device, allows the user to effectively locate the user's position on the electronic device for user positioning, thereby improving user-device interaction.
[0235] In some implementations, the user interface for locating the first destination includes displaying an indication of the distance relative to the electronic device to the first destination via a display generation component, such as... Figure 6CCThe text indication 674 is shown. For example, the electronic device displays an indication of the distance (e.g., 1 foot, 5 feet, 20 feet, 50 feet, 100 feet, etc.) between the electronic device and a location corresponding to a second user (e.g., the location of the second electronic device) below or above the first visual indicator discussed above. In some embodiments, the indication of the distance relative to the electronic device to the first destination is updated based on changes in the distance between the electronic device and the first destination. For example, when a user interface associated with proximity lookup features for locating the second electronic device is displayed, the distance indication decreases as the user of the electronic device moves closer to the location corresponding to the second user, because the distance between the electronic device and the second electronic device decreases according to the user's movement. As another example, the indication of the distance relative to the electronic device to the first destination may optionally change based on the movement of the second user (e.g., this causes a change in the location of the second electronic device). For example, when the user of the electronic device is moving toward the location corresponding to the second user, if the location of the second electronic device changes based on the movement of the second user, the indication of the distance relative to the location of the electronic device increases or decreases based on the net (e.g., sum or difference) change in the distance between the electronic device and the second electronic device. In response to detecting the selection of an option for displaying a user interface when navigating to the location of an electronic device, a user interface associated with a proximity lookup feature of the electronic device, including an indication of the distance to the location of the electronic device, is displayed, enabling the user to effectively locate the user's position on the electronic device for user positioning, thereby improving user-device interaction.
[0236] In some implementations, in response to receiving a selection of an optional option, the electronic device initiates a process of sending an instruction to a second electronic device associated with the second user (e.g., directly or indirectly via a server (e.g., a wireless communication terminal) communicating with the electronic device and the second electronic device), the instruction informing the second user that the user of the electronic device is attempting to locate the second electronic device associated with the second user, as referenced. Figure 6EESimilarly, as described above, when an electronic device displays a user interface associated with proximity lookup features for locating a second electronic device, the electronic device sends an instruction to the second electronic device that causes the second electronic device to generate a notification (or other visual, tactile, or audio alarm) that informs the second user of the second electronic device that the user of the electronic device is currently looking for and / or locating the second user (e.g., the second electronic device). In some embodiments, when a notification (or other alarm) is presented at the second electronic device (e.g., displayed on the lock screen or home screen user interface of the second electronic device), if the second user provides input for the notification (e.g., selection input for the notification), the second electronic device launches an item location application at the second electronic device and displays the item location application user interface previously discussed above. In some embodiments, the item location application user interface at the second electronic device includes location information corresponding to the user of the electronic device, such as the current location of the user of the electronic device, which indicates to the second user the relative distance between the second electronic device and the electronic device, and informs the second user that the user of the electronic device will arrive at the second user's location soon (e.g., within the next 30 seconds, 1 minute, 3 minutes, etc.). When a user interface associated with proximity lookup features for locating a second electronic device is displayed, sending an instruction to the second electronic device to generate a notification corresponding to the location of the second electronic device helps the second user to discover that the user of the first electronic device is approaching and / or further helps the user of the first electronic device to locate the location of the second user of the second electronic device, thereby improving user-device interaction.
[0237] In some implementations, when displaying the user interface for locating a first destination, the electronic device receives input via one or more input devices corresponding to a request to minimize the display of the user interface for locating the first destination, such as an up swipe on touch 603 to locate the user interface 675. Figure 6DD As shown. For example, an electronic device receives input corresponding to a swipe or cancel gesture. In some embodiments, the input includes a touch (e.g., a finger of a user's hand or the tip of a stylus) swiping along a corresponding direction (e.g., up or down on the touch-sensitive surface) on a touch-sensitive surface of the electronic device (such as a touchscreen of the electronic device or a touchpad communicating with the electronic device). In some embodiments, the input includes selection of a button on the electronic device (such as a home button (e.g., a soft button or a physical button)) or selection of a button on a hardware input device (e.g., a remote controller) communicating with the electronic device.
[0238] In some embodiments, in response to receiving input, the electronic device minimizes the display of the user interface via a display generation component, including displaying at least a subset of information associated with locating a first destination in a predetermined area of the display generation component, such as displaying a user interface object 678 including arrow indicators and text indicators for a search user interface 675, such as... Figure 6FF As shown. For example, the electronic device stops displaying the user interface associated with proximity lookup features for locating the second electronic device, and displays one or more user interface elements corresponding to the user interface in a predetermined area of the display generating component (e.g., the touchscreen of the electronic device). In some embodiments, at least a subset of the information associated with locating the first destination includes a first visual indication previously discussed above (e.g., an arrow configured to point in a direction relative to the second electronic device). In some embodiments, at least a subset of the information includes an indication of the distance relative to the location of the second electronic device, previously discussed above. For example, locating the first destination continues even if the user interface has been minimized by the electronic device. In some embodiments, when the display of the user interface is minimized, the electronic device displays the main screen user interface of the electronic device (e.g., a user interface including multiple optional user interface objects (e.g., icons) associated with a corresponding application). In some embodiments, while displaying the main screen user interface (or other user interface), the electronic device continues to update at least a subset of the information associated with locating the first destination in a predetermined area of the display generating component. For example, as discussed similarly above, the electronic device updates the first visual indication and / or the indication of the distance relative to the position of the electronic device to the second electronic device in a predetermined area of the touchscreen based on the detected distance relative to the position of the electronic device to the second electronic device and / or (e.g., when the electronic device moves) the change in the orientation of the second electronic device relative to the electronic device. In some embodiments, the predetermined area of the display generating component corresponds to the top (e.g., center) area of the display generating component. In some embodiments, the predetermined area of the display generating component corresponds to the bottom or side area of the display generating component, or any other suitable area of the display generating component. When the display of the user interface at the first electronic device is minimized when navigating to the position of the second electronic device, one or more user interface elements corresponding to the user interface associated with proximity lookup features for locating the second electronic device are displayed, allowing the user to view and / or interact with other user interface objects of the first electronic device, while still enabling the user to effectively locate the user's position on the second electronic device, thereby improving user-device interaction.
[0239] In some implementations, in response to receiving a selection of an optional option, based on determining that the location of the electronic device is no longer within a second threshold distance of the first destination (e.g., outside the second threshold distance of the first destination but still within the first threshold distance of the first destination), such as when in Figure 6Y When the selection of the first option 662-1 is detected, position 692 is as follows: Figure 6Z Within the parking area shown in Figure 690, the electronic device displays a user interface associated with a map application via a display generation component, including initiating navigation to a first destination via a second travel mode, such as displaying... Figure 6Z The user interface 602 is shown. For example, the location of the electronic device is no longer within a second threshold distance of the first destination (e.g., the location of the second user) because the second user's location has changed to a new location. For example, while the user of the electronic device is navigating to the first destination, the second user physically changes location, causing the location of the second electronic device associated with the second user to also change. In some embodiments, when the electronic device receives a selection of optional options as discussed above, the electronic device (e.g., based on location information provided by the second electronic device (or a server communicating with the second electronic device)) scans / detects the location of the second electronic device and determines that the location of the second electronic device has changed to a new location. Therefore, based on the determination that the change in the location of the second electronic device makes the distance between the electronic device's current location and the new location of the second electronic device greater than the second threshold distance, the electronic device initiates navigation to the new location of the second electronic device via a map application. For example, the electronic device displays visual navigation instructions for walking to the new location of the second electronic device associated with the second user. In some implementations, in response to receiving a selection of an optional option, based on determining that the location of the electronic device is no longer within a first threshold distance of the first destination, the electronic device displays a user interface associated with a map application, including initiating navigation to the first destination via a first traffic mode (e.g., the electronic device displays visual navigation instructions for driving to a new location of a second electronic device associated with a second user). In some implementations, in response to receiving a selection of an optional option, based on determining that the location of the electronic device is still within a second threshold distance of the first destination, the electronic device displays a user interface for an item-finding application, as previously discussed above. In response to detecting a selection of an option for displaying the user interface for an item-finding application, based on determining that the location of the electronic device is no longer within a second threshold distance of the user's location, initiating navigation to another user's location via a corresponding traffic mode is beneficial for discovering that the user of the electronic device is no longer within a second threshold distance of another user's location, and / or reduces the amount of input required to re-display navigation instructions for navigating to another user's new location via the corresponding traffic mode, thereby improving user-device interaction.
[0240] In some implementations, when navigating to a first destination according to a first access mode, the first destination is determined and navigation via a second access mode is required to reach the first destination (e.g., as shown in the image). Figure 6HH The destination (e.g., Venice Beach as indicated in the navigation user interface 640) Figure 6HH The arrival point 693 in the diagram 690 is associated with (e.g., the first destination includes the required / necessary walking route from the arrival point to the first destination or requires some other traffic mode different from the current traffic mode (e.g., the first traffic mode)). The first threshold distance and the second threshold distance are determined relative to the arrival point (e.g., based on the direction of travel of the electronic device and / or the user relative to the first destination, rather than the direction of travel relative to the first destination). Areas such as arrival areas and parking areas are centered on arrival point 693. Figure 6HH As shown in Figure 690. For example, the first destination is the starting point of a hiking trail, the edge of a beach, a pier, a monument, etc., or the first destination is the location of another user located at the starting point of a hiking trail, the edge of a beach, a pier, a monument, etc., where the user of the electronic device needs to walk the remaining distance from the arrival point to the first destination (e.g., because there is no existing road directly leading to the first destination). In some embodiments, the second threshold distance corresponds to the distance (e.g., radius) of the arrival area centered on the arrival point. Therefore, in some embodiments, when the electronic device is within the arrival area centered on the arrival point, the electronic device displays the arrival user interface discussed above. Alternatively, in some embodiments, the first threshold distance is determined relative to the arrival point, and the electronic device abandons determining the second threshold distance relative to the arrival point. For example, the minimum of the first threshold distance discussed above is the arrival point when navigating to the first destination according to a first traffic mode. For example, the arrival area corresponds to a parking area (e.g., a parking lot or garage) associated with the first destination and / or is close to the first destination (e.g., within 50 feet, 100 feet, 150 feet, 200 feet, 300 feet, etc.), and the arrival point is the entrance to the parking area. When the location of the electronic device is within a threshold distance of the arrival point associated with the destination, the arrival user interface of the destination is displayed when navigating to the destination according to the first access mode. This helps to discover the association between the destination and the arrival point and helps to visually facilitate the user's understanding that the first destination cannot be reached by navigating beyond the arrival point according to the first access mode, thereby improving user-device interaction.
[0241] In some implementations, in response to a detection indication, based on determining the first destination and the pre-arrival area, such as... Figure 6JJThe parking area 694 indicated in the navigation user interface 640 shown (e.g., the first destination includes designated parking, valet parking, or other parking / drop-off areas at a fixed (and known) distance from the first destination (e.g., outside the first destination, surrounding the first destination, and / or adjacent to the first destination)) is associated with the indication (e.g., automatically (e.g., without user input)) when the location of the electronic device is within a first threshold distance (e.g., not relative to the location of the first destination) of the pre-arrival area (e.g., the entrance or starting point of the pre-arrival area). Figure 6KK Within the parking area shown in Figure 690, the electronic device displays a first option in the user interface via a display generation component (e.g., as shown in Figure 690). Figure 6T The first option 652-1 shown can be selected to initiate navigation to a first destination via a map application based on a second traffic mode (e.g., a walking traffic mode). For example, if the first destination is a shopping mall / center associated with (e.g., attached to) a parking garage, the first threshold distance is determined relative to the entrance of the parking garage. In some embodiments, if the pre-arrival area has more than one entrance, the first threshold distance is determined relative to the entrance closest to the location of the electronic device (e.g., based on the direction of travel of the electronic device and / or the user relative to the first destination). Additionally, in some embodiments, the first threshold distance is determined relative to the pre-arrival area if the second threshold distance previously described above is not determined. For example, if the first destination is associated with the pre-arrival area, the electronic device waives the determination / establishment of the second threshold distance. Therefore, in some embodiments, when the location of the electronic device is outside the pre-arrival area and within the first threshold distance of the pre-arrival area, the electronic device displays the parked or already parked user interface previously described herein. In some implementations, when the electronic device is located within the pre-arrival area, it displays the arrival user interface previously discussed above, even if the user will remain in the pre-arrival area and eventually walk the remainder of the route to the first destination (e.g., the entrance to the shopping mall / center). Displaying the destination's arrival user interface while navigating to the destination when the user arrives at the pre-arrival area associated with it helps to identify the destination's association with the pre-arrival area and / or avoids unnecessarily displaying navigational instructions while the user is in the pre-arrival area. This helps reduce the power consumption of the electronic device, thereby improving user-device interaction.
[0242] In some implementations, when navigating to a first destination via (e.g., a map application running on an electronic device) according to a first travel mode and while displaying a user interface associated with the map application, the electronic device detects its location within a second threshold distance (e.g., 50 feet, 75 feet, 100 feet, 125 feet, 150 feet, 200 feet, 250 feet, 275 feet, 300 feet, 400 feet, etc.) of the first destination, such as detecting that the location 692 of electronic device 500 is within the arrival area. Figure 6U As shown in Figure 690. For example, before parking a vehicle or otherwise changing the traffic mode to a different first traffic mode and / or in the absence of parking a vehicle or otherwise changing the traffic mode to a different first traffic mode, the electronic device detects that its position has moved to within a second threshold distance of the first destination. In some embodiments, the electronic device detects that its position corresponds to the position of the first destination (e.g., overlaps with the position of the first destination).
[0243] In some implementations, in response to detecting that the location of the electronic device is within a second threshold distance of the first destination, the electronic device displays an arrival user interface associated with a map application for the first destination (e.g., as shown in the image) via a display generation component. Figure 6U The arrival user interface 660 shown (e.g., as previously described above). In some embodiments, the electronic device maintains the display of the arrival user interface while the location of the electronic device remains within a second threshold distance of the first destination. In some embodiments, when displaying the arrival user interface associated with the map application for the first destination, if no input for navigation terminating to the first destination is received, the electronic device detects that its location is outside the second threshold distance of the first destination (e.g., and within or no longer within the first threshold distance discussed above for the first destination), such as detecting that the location 692 of the electronic device 500 is within the parking area, as... Figure 6V As shown in Figure 690. In some implementations, while still navigating to the first destination according to the first traffic mode, the electronic device detects that the position of the electronic device has moved back to a second threshold distance from the first destination (e.g., no parked vehicle or vehicle left).
[0244] In some implementations, in response to detecting that the electronic device's location is outside a second threshold distance from the first destination, the electronic device, via a display generation component, replaces the display of the arrival user interface associated with the map application for the first destination with a user interface for changing the navigation mode to the first destination (e.g., regardless of whether the electronic device's location is no longer within the first threshold distance discussed above for the first destination), such as re-displaying... Figure 6V The parking user interface 650 is shown. For example, the electronic device displays a parked or parking user interface, as previously described above. In some embodiments, the electronic device maintains the display of the user interface for changing the access mode until input for changing the access mode (e.g., changing to a second access mode) or input for ending navigation to the first destination is detected, as discussed herein. In other embodiments, if the location of the electronic device is detected to be outside a first threshold distance from the first destination, the electronic device updates a first option in the parking user interface to a second option that can be selected to re-display visual navigation instructions based on the first access mode in the user interface of a map application (e.g., and stop displaying the parking user interface). Switching between displaying the user interface for changing the access mode for navigation to the destination and displaying the arrival user interface for the destination based on changes in the distance between the location of the electronic device and the destination reduces the amount of input required to navigate to the destination using different access modes based on distance changes and / or enables the access mode to change automatically based on distance changes, thereby improving user-device interaction.
[0245] In some implementations, the user interface for changing the transit mode for navigation to the first destination includes optional options that can be selected to change the transit mode from a first transit mode to a second transit mode (e.g., as previously discussed above). Figure 6V The first option 652-1 shown is included, and this optional option includes a first estimated travel time to the first destination via the second travel mode relative to the location of the electronic device (e.g., as shown). Figure 6V The first option 652-1 indicates 3 minutes (e.g., the indication indicates the estimated amount of time remaining in navigation to the first destination based on walking (e.g., the user's currently detected walking speed, the user's average walking speed, a known average walking pace, etc.) (e.g., in minutes, seconds, etc.)). In some embodiments, in response to detecting a selection of an optional option, the electronic device displays visual navigation guidance to guide the user to the first destination according to a second travel mode (e.g., walking).
[0246] In some implementations, when navigating to a first destination via a map application and when displaying a user interface including optional options for changing the navigation mode to the first destination, the electronic device detects a change in the electronic device's position, such as electronic device 500 from... Figures 6V to 6WFurther movement away from the first destination. For example, when the parking user interface is displayed (e.g., and before the user has parked or left the vehicle or other means of transport), the electronic device detects that the electronic device's position is closer to or further away from the first destination (e.g., caused by the user's further movement / continued movement and therefore the further movement / continued movement of the electronic device).
[0247] In some implementations, in response to detecting a change in the location of the electronic device, and based on determining that the change in the location of the electronic device causes the estimated travel time to the first destination via the second travel mode to be a second estimated travel time different from the first estimated travel time, the electronic device updates the optional options with an indication of the second estimated travel time, such as updating the first option 662-1 with a travel time of 2 minutes. Figure 6W As shown. For example, the electronic device detects that its position has moved / changed by a certain amount relative to a first destination, causing the estimated travel time to the first destination via walking to change (e.g., increase or decrease). In some embodiments, as the electronic device's position continues (or does not continue) to change relative to the first destination (e.g., while the user interface for changing the travel mode remains displayed via a display generation component), the electronic device dynamically (e.g., in real time) updates the indication of the optional options. In some embodiments, as similarly discussed above, when the optional options for changing the travel mode are displayed in the user interface, the indication of the second estimated travel time is updated independently of the electronic device's position relative to a first threshold distance and a second threshold distance. In response to detecting a change in the distance between the electronic device's position and the destination, updating the estimated travel time relative to the destination when navigating to the destination according to the corresponding travel mode helps the user understand the estimated travel time from their current position, which helps inform the user about the decision regarding traveling to the destination via the corresponding travel mode, thereby improving user-device interaction.
[0248] In some implementations, when navigating to a first destination via (e.g., running on an electronic device) a map application based on a first travel mode (e.g., driving, riding as a passenger via carpooling, cycling, train, bus, etc.) or a second travel mode (e.g., walking), the electronic device detects an event corresponding to a request to terminate navigation to the first destination via the map application, such as a request to... Figure 6YThe selection of option 662-2. For example, the electronic device detects input to a user interface associated with a map application. In some embodiments, the input includes a selection of an end option that can be selected to terminate navigation to a first destination. In some embodiments, the end option is displayed in the user interface (e.g., a navigation user interface) of the map application as the electronic device navigates to the first destination according to a first travel mode. In some embodiments, the end option is displayed in a previously discussed parked or stopped user interface when the electronic device's location is within a first threshold distance of the first destination (e.g., but outside a second threshold distance of the first destination). In some embodiments, the end option is displayed in a previously discussed arrived user interface when the electronic device's location is within a second threshold distance of the first destination (e.g., when the electronic device navigates according to a first travel mode or a second travel mode). In some embodiments, the event includes detecting that the location of the electronic device corresponds to the location of the first destination. For example, the electronic device determines that the user of the electronic device has arrived at the first destination based on the overlap between the locations of the electronic device and the first destination.
[0249] In some implementations, in response to the detection of an event, the electronic device stops navigating to the first destination according to a first travel mode or a second travel mode, such as stopping the display of the navigation user interface 640. Figure 6GG As shown. For example, the electronic device stops displaying visual navigation instructions used to guide the user to a first destination according to a first or second travel mode as previously discussed above. In some embodiments, the electronic device re-displays the user interface of the map application (e.g., instead of the previously discussed parked or stopped user interface or arrived user interface).
[0250] In some embodiments, the electronic device displays a map (e.g., map 623) of a physical area including the location of the electronic device and a first destination in a user interface associated with a map application. For example, as previously discussed above, the user interface of the map application includes a display of a map of a physical area surrounding the user's location on the electronic device. In some embodiments, the map area includes the user's location on the electronic device. In some embodiments, the map area includes the location of the first destination because the distance between the user's location and the first destination is less than the total distance / area included in the physical area on the map.
[0251] In some embodiments, the electronic device concurrently displays on the map a visual indication of its location at a location on the map corresponding to its own location (e.g., visual indication 638), and a representation of the first destination at a location on the map corresponding to its own location (e.g., representation 612-1). In some embodiments, the visual indication of the electronic device's location and the representation of the first destination are represented on the map as bubbles and / or circles. However, it should be understood that these representations are optionally of any shape and / or size. In some embodiments, the zoom level (e.g., zoom in and / or zoom amount) of the map displayed in the user interface of the map application is selected based on the distance between the electronic device's location and the location of the first destination, such that when an event is detected, the visual indication of the electronic device's location can be displayed concurrently with the representation of the first destination on the map. For example, if the electronic device detects an event when the distance between the first destination and the electronic device's location is a first distance, the electronic device concurrently displays the visual indication of the electronic device's location and the representation of the first destination on the map when the map has a first zoom level. In some implementations, if the electronic device detects an event when the distance between the first destination and the electronic device's location is a second distance less than a first distance, the electronic device concurrently displays a visual indication of its location and a representation of the first destination on the map when the map has a second zoom level greater than a first zoom level. Additionally, in some implementations, the map application's user interface includes a page or virtual card for the first destination (e.g., displayed below a portion of the map area and / or overlaid on a portion of the map area). In some implementations, the first destination page or virtual card includes information corresponding to the first destination, such as a name associated with the first destination, an address associated with the first destination, contact information associated with the first destination, etc., as discussed similarly above. Displaying the current location of the electronic device and the location of the destination on the map area of the map application's user interface after navigation to the destination has ended allows the first user to know their location relative to the destination within the map area after navigation has ended, which visually aids the user's understanding of the destination's location relative to the user's current location.
[0252] It should be understood that, Figure 7 The specific order in which the operations described herein are presented is merely exemplary and not intended to indicate that the described order is the only possible order in which these operations can be performed. Those skilled in the art will conceive of various ways to reorder the operations described herein. Additionally, it should be noted that details of other processes described herein with reference to other methods described herein also apply in a similar manner to the above references. Figure 7 Method 700 is described.
[0253] The operations in the information processing method described above are optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (e.g., as opposed to...). Figures 1A to 1B , Figure 3 , Figures 5A to 5H (As described) or a dedicated chip. Additionally, see the above references. Figure 7 The described operation is optionally provided by Figures 1A to 1B The components depicted are used to implement this. For example, display operations 702, 708, and 710 are optionally implemented by an event classifier 170, an event recognizer 180, and an event handler 190. An event monitor 171 in the event classifier 170 detects a touch on the touchscreen 504, and an event dispatcher module 174 transmits the event information to application 136-1. The corresponding event recognizer 180 in application 136-1 compares the event information with a corresponding event definition 186 and determines whether a first touch at a first location on the touchscreen corresponds to a predefined event or sub-event, such as a selection of an object on the user interface. When a corresponding predefined event or sub-event is detected, the event recognizer 180 activates the event handler 190 associated with the detection of that event or sub-event. The event handler 190 optionally utilizes or invokes a data updater 176 or an object updater 177 to update the application's internal state 192. In some embodiments, the event handler 190 accesses a corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly understand how it can be based on Figures 1A to 1B The components described herein are used to implement other processes.
[0254] As described above, one aspect of the present invention involves collecting and using data from specific and lawful sources to improve a user's ability to find and locate items of potential interest. This disclosure contemplates that, in some instances, the collected data may include personal information data that uniquely identifies or can be used to identify a specific person. Such personal information data may include demographic data, location-based data, online identifiers, telephone numbers, email addresses, home addresses, data or records related to a user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other personal information.
[0255] This disclosure recognizes that the use of such personal information data in the techniques of this invention can benefit users. For example, personal information data can be used to identify the location of a remote locator object and / or the location of a user. Therefore, the use of such personal information data enables users to identify, locate, and otherwise interact with the remote locator object. Furthermore, this disclosure also contemplates other uses of personal information data that benefit users. For example, health and fitness data can be used according to user preferences to provide insights into their overall health status, or can be used as positive feedback to individuals using the technology to pursue health goals.
[0256] This disclosure anticipates that entities responsible for collecting, analyzing, disclosing, transmitting, storing, or otherwise using such personal information data will comply with established privacy policies and / or privacy practices. Specifically, it is expected that such entities will implement and consistently apply privacy practices generally recognized as meeting or exceeding industry or governmental requirements for protecting user privacy. Such information regarding the use of personal data should be highlighted and easily accessible to users, and should be updated as data collection and / or use change. Users' personal information should be collected only for lawful use. Furthermore, such collection / sharing should only occur after receiving user consent or other lawful grounds provided for in applicable law. Additionally, such entities should consider taking any necessary steps to protect and safeguard the right to access such personal information data and to ensure that other entities with access to personal information data comply with their privacy policies and procedures. Furthermore, such entities may be subject to third-party assessments to demonstrate their compliance with widely accepted privacy policies and practices. Moreover, policies and practices should be tailored to the specific types of personal information data collected and / or accessed, and made applicable to applicable laws and standards, including jurisdiction-specific considerations that may allow for the application of higher standards. For example, in the United States, the collection or access to certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while health data in other countries may be subject to other regulations and policies and should be handled accordingly.
[0257] Regardless of the foregoing, this disclosure also contemplates implementation schemes for users to selectively block the use or access to personal information data. That is, this disclosure contemplates providing hardware and / or software components to prevent or block access to such personal information data. For example, in the case of advertising delivery services, the inventive technology can be configured to allow users to opt-in or opt-out at any time during or after service registration to participate in the collection of personal information data. In another example, users can choose not to provide emotion-related data for a targeted content delivery service. Furthermore, users can choose to limit the duration for which emotion-related data is retained, or completely prevent the development of underlying emotional states. In addition to providing opt-in and opt-out options, this disclosure also contemplates providing notifications related to access to or use of personal information. For example, users can be notified when downloading an application that their personal information data will be accessed, and then reminded again before the application accesses the personal information data.
[0258] Furthermore, the intent of this disclosure is that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once data is no longer needed, this risk can be minimized by restricting data collection and deleting data. Additionally, and where applicable, including in certain health-related applications, data deidentification can be used to protect user privacy. Deidentification can be facilitated, where appropriate, by removing identifiers, controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than the address level), controlling how data is stored (e.g., aggregating data among users), and / or other methods (such as differentiated privacy).
[0259] Therefore, while this disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, it is also contemplated that various embodiments can be implemented without access to such personal information data. That is, various embodiments of the present invention will not become inoperable due to the absence of all or part of such personal information data. For example, location data and notifications can be delivered to users based on aggregated non-personal information data or an absolute minimum amount of personal information.
[0260] As is widely recognized, the use of personally identifiable information should comply with privacy policies and practices that are generally accepted to meet or exceed industry or governmental requirements for protecting user privacy. Specifically, personally identifiable information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use, and the nature of authorized use should be clearly explained to users.
[0261] For purposes of explanation, the foregoing description has been given by reference to specific embodiments. However, the illustrative discussion above is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible based on the teachings above. The embodiments were chosen and described to best elucidate the principles of the invention and its practical application, thereby enabling others skilled in the art to best utilize the invention with various modifications suitable for the contemplated particular purpose, as well as the various described embodiments.
Claims
1. A method comprising: at an electronic device in communication with a display generation component and one or more input devices: while navigating to a first destination via a map application, detecting that a location of the electronic device is within a first threshold distance of the first destination, navigating to the first destination via a map application including displaying, via the display generation component, a user interface associated with the map application, wherein the navigation to the first destination is in accordance with a first mode of transit; while the location of the electronic device is within the first threshold distance of the first destination, detecting an indication that a user of the electronic device is no longer utilizing the first mode of transit to the first destination; and in response to detecting the indication: in accordance with a determination that the indication was detected while the location of the electronic device is outside a second threshold distance from the first destination that is less than the first threshold distance, displaying, via the display generation component, a first option in the user interface that is selectable to initiate navigation to the first destination via the map application in accordance with a second mode of transit that is different from the first mode of transit; and in accordance with a determination that the indication was detected while the location of the electronic device is within the second threshold distance from the first destination, displaying, via the display generation component, an arrival user interface associated with the map application for the first destination.
2. The method of claim 1, the method further comprising: in response to detecting that the location of the electronic device is within the first threshold distance of the first destination: displaying, via the display generation component, a user interface for changing a mode of transit for navigation to the first destination.
3. The method of claim 2, wherein the user interface for changing the mode of transit for navigation to the first destination includes a selectable option that is selectable to change the mode of transit from the first mode of transit to the second mode of transit.
4. The method of any of claims 1-3, the method further comprising: prior to navigating to the first destination via the map application, and while displaying the user interface associated with the map application, receiving, via the one or more input devices, a sequence of one or more inputs to the user interface associated with the map application that corresponds to a request to navigate to the first destination; and in response to receiving the sequence of one or more inputs, initiating a process of navigating to the first destination via the map application.
5. The method of claim 4, wherein the first destination corresponds to a location of a second electronic device that is different from the electronic device, the second electronic device being associated with a second user that is different from a user of the electronic device.
6. The method of claim 5, wherein the sequence of one or more inputs to the user interface associated with the map application includes a respective input to a user interface for the second user.
7. The method of claim 6, wherein the user interface for the second user includes: in accordance with a determination that the user of the electronic device has access to the location of the second electronic device associated with the second user: a second option that is selectable to display a user interface of an item location application; and an indication of a current location of the second electronic device associated with the second user.
8. The method of claim 7, wherein the user interface of the second user includes: in accordance with a determination that the user of the electronic device does not have access to the location of the second electronic device associated with the second user: a third option that is selectable to initiate a process to request access to the location of the second electronic device from the second user.
9. The method of any of claims 6-8, wherein the user interface of the second user includes: an indication of a current location of the second electronic device associated with the second user; information indicating one or more addresses associated with the second user; and one or more options associated with the one or more addresses, wherein the one or more options are selectable to initiate a process to navigate to a selected address of the one or more addresses.
10. The method of any of claims 4-9, wherein the first destination corresponds to a location of a business.
11. The method of any of claims 1-10, wherein: while navigating along a route that includes the first destination, in accordance with a determination that the first destination is associated with a location of a second electronic device that is different from the electronic device, the user interface associated with the map application includes a selectable indication to share an estimated time of arrival (ETA) at the first destination with a second user that is different from the user of the electronic device.
12. The method of claim 11, wherein the first destination corresponds to a final destination of the route.
13. The method of any of claims 11-12, wherein: the first destination corresponds to a location of a third electronic device that is different from the electronic device and the second electronic device, and that is associated with a third user that is different from the user of the electronic device and the second user; and in accordance with a determination that the route includes a second destination that is associated with the location of the second electronic device associated with the second user; the selectable indication is selectable to initiate a process to share the ETA at the second destination with one or more users of a plurality of users that includes the second user and the third user.
14. The method of any of claims 1-13, the method further comprising: while displaying the first option in the user interface in accordance with a determination that the indication is detected while the location of the electronic device is outside the second threshold distance from the first destination in response to detecting the indication; and in response to detecting the selection of the first option: initiating navigation to the first destination via the map application according to the second mode of transit includes updating a display of the user interface associated with the map application according to the navigation.
15. The method of claim 14, the method further comprising: while navigating to the first destination via the map application according to the second mode of transit, detecting that the location of the electronic device is within the second threshold distance of the first destination; and in response to detecting that the location of the electronic device is within the second threshold distance of the first destination: displaying, via the display generation component, the arrival user interface associated with the map application for the first destination.
16. The method of any of claims 1-15, wherein the first destination corresponds to a location of a second electronic device different from the electronic device, the second electronic device being associated with a second user different from a user of the electronic device, and the arrival user interface associated with the map application for the first destination includes a selectable option that is selectable to display a user interface of an item locator application, the method further comprising: while displaying the arrival user interface including the selectable option in response to detecting the indication according to determining that the location of the electronic device is within the second threshold distance from the first destination, receiving, via the one or more input devices, a selection of the selectable option in the arrival user interface; and in response to receiving the selection of the selectable option: displaying, via the display generation component, the user interface of the item locator application, wherein the user interface includes information corresponding to the second user.
17. The method of claim 16, wherein the information corresponding to the user includes a selectable option that is selectable to display a user interface for locating the first destination, the method further comprising: while displaying the user interface of the item locator application including the selectable option, receiving, via the one or more input devices, a selection of the selectable option; and in response to receiving the selection of the selectable option: in accordance with a determination that the location of the electronic device is still within the second threshold distance of the first destination, displaying, via the display generation component, the user interface for locating the first destination.
18. The method of claim 17, wherein displaying the user interface for locating the first destination includes displaying, via the display generation component, a first visual indicator that indicates a direction in which the first destination is located relative to the electronic device.
19. The method of any of claims 17-18, wherein displaying the user interface for locating the first destination includes displaying, via the display generation component, an indication of a distance to the first destination relative to the electronic device.
20. The method of any of claims 17-19, the method further comprising: In response to receiving the selection of the selectable option: initiating a process to transmit an indication to the second electronic device associated with the second user, the indication notifying the second user that the user of the electronic device is attempting to locate the second electronic device associated with the second user.
21. The method of any of claims 17-20, further comprising: while displaying the user interface for locating the first destination, receiving, via the one or more input devices, an input corresponding to a request to minimize display of the user interface for locating the first destination; and in response to receiving the input: minimizing, via the display generation component, the display of the user interface, including displaying at least a subset of information associated with locating the first destination in a predetermined region of the display generation component.
22. The method of any of claims 17-21, further comprising: in response to receiving the selection of the selectable option: in accordance with a determination that the location of the electronic device is no longer within the second threshold distance of the first destination, displaying, via the display generation component, the user interface associated with the map application, including initiating navigation to the first destination via the second mode of transit.
23. The method of any of claims 1-22, wherein: while navigating to the first destination in accordance with the first mode of transit, in accordance with a determination that the first destination is associated with a point of arrival that needs to be navigated to via the second mode of transit to reach the first destination, determining the first threshold distance and the second threshold distance relative to the point of arrival.
24. The method of any of claims 1-12, further comprising: in response to detecting the indication, in accordance with a determination that the first destination is associated with a pre-arrival area, and in accordance with a determination that the indication was detected while the location of the electronic device was within the first threshold distance of the pre-arrival area, displaying, via the display generation component, the first option in the user interface, the first option being selectable to initiate navigation to the first destination via the map application in accordance with the second mode of transit.
25. The method of any of claims 1-24, further comprising: while navigating to the first destination via the map application in accordance with the first mode of transit and while displaying the user interface associated with the map application, detecting that the location of the electronic device is within the second threshold distance of the first destination; in response to detecting that the location of the electronic device is within the second threshold distance of the first destination, displaying, via the display generation component, the arrival user interface associated with the map application for the first destination; while displaying the arrival user interface for the first destination associated with the map application, without receiving input to terminate the navigation to the first destination, detecting that the location of the electronic device is outside the second threshold distance of the first destination; and in response to detecting that the location of the electronic device is outside the second threshold distance of the first destination: via the display generation component, replacing display of the arrival user interface for the first destination associated with the map application with a user interface for changing a mode of transit for the navigation to the first destination.
26. The method of claim 25, wherein the user interface for changing the mode of transit for the navigation to the first destination includes a selectable option that is selectable to change the mode of transit from the first mode of transit to the second mode of transit, and the selectable option includes an indication of a first estimated travel time to the first destination via the second mode of transit relative to the location of the electronic device, the method further comprising: while navigating to the first destination via the map application and while displaying the user interface for changing the mode of transit for the navigation to the first destination that includes the selectable option, detecting a change in the location of the electronic device; and in response to detecting the change in the location of the electronic device: in accordance with a determination that the change in the location of the electronic device causes an estimated travel time to the first destination via the second mode of transit to be a second estimated travel time that is different from the first estimated travel time, updating the selectable option with an indication of the second estimated travel time.
27. The method of any of claims 1-26, the method further comprising: while navigating to the first destination via the map application in accordance with the first mode of travel or the second mode of travel, detecting an event corresponding to a request to terminate navigation to the first destination via the map application; and in response to detecting the event: stopping navigation to the first destination in accordance with the first mode of travel or the second mode of travel; displaying, in the user interface associated with the map application, a map that includes the location of the electronic device and a physical region of the first destination; and simultaneously displaying, on the map: a visual indication of the location of the electronic device at a location on the map that corresponds to the location of the electronic device; and a representation of the first destination at a location on the map that corresponds to a location of the first destination.
28. An electronic device, the electronic device comprising: one or more processors; memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for: while navigating to a first destination via a map application, detecting that a location of the electronic device is within a first threshold distance of the first destination, navigating to a first destination via a map application includes displaying, via a display generation component, a user interface associated with the map application, wherein the navigation to the first destination is in accordance with a first mode of transit; while the location of the electronic device is within the first threshold distance of the first destination, detecting an indication that a user of the electronic device is no longer utilizing the first mode of transit to the first destination; and in response to detecting the indication: in accordance with a determination that the indication was detected while the location of the electronic device is outside a second threshold distance that is less than the first threshold distance from the first destination, displaying, via the display generation component, a first option in the user interface, the first option being selectable to initiate navigation to the first destination via the map application in accordance with a second mode of transit that is different from the first mode of transit; and in accordance with a determination that the indication was detected while the location of the electronic device is within the second threshold distance from the first destination, displaying, via the display generation component, a arrival user interface associated with the map application for the first destination.
29. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising: while navigating to a first destination via a map application, detecting that a location of the electronic device is within a first threshold distance of the first destination, navigating to a first destination via a map application includes displaying, via a display generation component, a user interface associated with the map application, wherein the navigation to the first destination is in accordance with a first mode of transit; while the location of the electronic device is within the first threshold distance of the first destination, detecting an indication that a user of the electronic device is no longer utilizing the first mode of transit to the first destination; and in response to detecting the indication: in accordance with a determination that the indication was detected while the location of the electronic device is outside a second threshold distance that is less than the first threshold distance from the first destination, displaying, via the display generation component, a first option in the user interface, the first option being selectable to initiate navigation to the first destination via the map application in accordance with a second mode of transit that is different from the first mode of transit; and in accordance with a determination that the indication was detected while the location of the electronic device is within the second threshold distance from the first destination, displaying, via the display generation component, a arrival user interface associated with the map application for the first destination.
30. An electronic device, the electronic device comprising: one or more processors; memory; means for detecting, while navigating to a first destination via a map application, that a location of the electronic device is within a first threshold distance of the first destination, navigating to a first destination via a map application including displaying, via a display generation component, a user interface associated with the map application, wherein the navigation to the first destination is in accordance with a first mode of transit; means for detecting, while the location of the electronic device is within the first threshold distance of the first destination, an indication that a user of the electronic device is no longer utilizing the first mode of transit to the first destination; and means for performing the following operations in response to detecting the indication: in accordance with a determination that the indication was detected while the location of the electronic device is outside a second threshold distance that is less than the first threshold distance from the first destination, displaying, via the display generation component, a first option in the user interface, the first option being selectable to initiate navigation to the first destination via the map application in accordance with a second mode of transit that is different from the first mode of transit; and in accordance with a determination that the indication was detected while the location of the electronic device is within the second threshold distance from the first destination, displaying, via the display generation component, a arrival user interface associated with the map application for the first destination.
31. An information processing apparatus for use in an electronic device, the information processing apparatus comprising: means for detecting, while navigating to a first destination via a map application, that a location of the electronic device is within a first threshold distance of the first destination, navigating to a first destination via a map application including displaying, via a display generation component, a user interface associated with the map application, wherein the navigation to the first destination is in accordance with a first mode of transit; means for detecting, while the location of the electronic device is within the first threshold distance of the first destination, an indication that a user of the electronic device is no longer utilizing the first mode of transit to the first destination; and means for performing the following operations in response to detecting the indication: in accordance with a determination that the indication was detected while the location of the electronic device is outside a second threshold distance that is less than the first threshold distance from the first destination, displaying, via the display generation component, a first option in the user interface, the first option being selectable to initiate navigation to the first destination via the map application in accordance with a second mode of transit that is different from the first mode of transit; and in accordance with a determination that the indication was detected while the location of the electronic device is within the second threshold distance from the first destination, displaying, via the display generation component, a arrival user interface associated with the map application for the first destination.
32. An electronic device, the electronic device comprising: one or more processors; memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1-27.
33. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform the method of any one of claims 1-27.
34. An electronic device, the electronic device comprising: one or more processors; memory; and means for performing the method of any one of claims 1-27.
35. An information processing apparatus for use in an electronic device, the information processing apparatus comprising: means for performing the method of any one of claims 1-27.
Citation Information
Patent Citations
Method and apparatus for integrating manual input
US20020015024A1
Gestures for touch sensitive input devices
US20060026521A1
Gestures for touch sensitive input devices
US20060026536A1
Virtual input device placement on a touch screen user interface
US20060033724A1
Multipoint touchscreen
US20060097991A1