Traffic mode specific navigation user interface
By detecting context information and user input, dynamically adjusting traffic mode and navigation direction, the problems of navigation complexity and resource consumption in the prior art are solved, and a more efficient user interface and navigation experience is achieved.
Patent Information
- Application Number
- CN202380067849.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-09-24
- Filing Date
- 2023-09-22
- Publication Date
- 2025-04-29
AI Technical Summary
The prior art is difficult to achieve multiple traffic modes between seamless conversion and navigation, resulting in frequent inputs from users when navigating, increasing operational complexity and resource consumption.
By detecting context information and user input, dynamically adjusting traffic patterns and navigation directions, providing a user interface that can configure routes of multiple destinations and multiple traffic patterns.
Reduces the amount of user input when traffic mode changes, improves navigation efficiency and user interface response speed, and reduces the consumption of processor and battery power.
Smart Images

Figure CN119907903A_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims the benefit of U.S. Provisional Application No. 63 / 377,014, filed on September 24, 2022, the contents of which are incorporated herein by reference in their entirety for all purposes. Technical Field
[0003] The present invention generally relates to user interfaces associated with providing navigation directions using multiple modes of transportation that vary based on detected contextual information and user interfaces for configuring routes having multiple destinations and multiple modes of transportation. Background Art
[0004] In recent years, the interaction between users and electronic devices has increased significantly. These devices can be devices such as computers, tablet computers, televisions, multimedia devices, mobile devices, etc. In some cases, users want to navigate to a seamless transition between destinations using multiple modes of transportation. Summary of the invention
[0005] Some embodiments described in the present disclosure relate to one or more electronic devices that detect a change in context information, the change in context information indicating a change to a traffic mode and a change to navigation directions. Some embodiments described in the present disclosure relate to one or more electronic devices that detect user input corresponding to a request to add a destination and a traffic mode for each segment of a multi-destination route. A comprehensive description of the embodiments is provided in the drawings and detailed description, and it should be understood that the invention content provided above does not limit the scope of the present disclosure in any way.
[0006] It is understood that the use of personally identifiable information should be subject to privacy policies and practices that are generally recognized to meet or exceed industry or government requirements for maintaining user privacy. Specifically, personally identifiable information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use, and the nature of the authorized use should be clearly stated to users. BRIEF DESCRIPTION OF THE DRAWINGS
[0007] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, in which like reference numerals designate corresponding parts throughout the several views.
[0008] Figure 1A is a block diagram illustrating a portable multifunction device with a touch-sensitive display according to some embodiments.
[0009] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments.
[0010] Figure 2 A portable multifunction device with a touch screen according to some embodiments is illustrated.
[0011] Figure 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments.
[0012] Figure 4A An exemplary user interface for an application menu on a portable multifunction device according to some embodiments is illustrated.
[0013] Figure 4B An exemplary user interface for a multifunction device having a touch-sensitive surface separate from the display according to some embodiments is illustrated.
[0014] Figure 5A Personal electronic devices according to some embodiments are illustrated.
[0015] Figure 5B is a block diagram illustrating a personal electronic device according to some embodiments.
[0016] FIG. 5C to FIG. 5D Exemplary components of a personal electronic device with a touch-sensitive display and an intensity sensor according to some embodiments are illustrated.
[0017] FIG. 5E to FIG. 5H Illustrated are exemplary components and user interfaces of a personal electronic device according to some embodiments.
[0018] FIG. 5I to FIG. 5N A set of sample tactile output patterns are provided that can be used, alone or in combination, as is or through one or more transformations (e.g., modulation, amplification, truncation, etc.) to form suitable tactile feedback in a variety of scenarios and for a variety of purposes (such as those described above and those described with respect to the user interfaces and methods discussed herein).
[0019] 6A to 6H Exemplary ways of facilitating display of and interaction with navigation directions that include multiple modes of transportation in accordance with some embodiments of the present disclosure are illustrated.
[0020] Figure 7 is a flow chart illustrating a method of facilitating display of and interaction with navigation directions including multiple modes of transportation according to some embodiments of the present disclosure.
[0021] FIG. 8A to FIG. 8I Exemplary ways of configuring a route with multiple destinations and multiple modes of transportation according to some embodiments of the present disclosure are illustrated.
[0022] Fig. 9is a flow chart illustrating a method of configuring a route with multiple destinations and multiple modes of transportation according to some embodiments of the present disclosure. DETAILED DESCRIPTION
[0023] The following description sets forth exemplary methods, parameters, etc. However, it should be appreciated that such description is not intended to limit the scope of the present disclosure, but is provided as a description of exemplary embodiments.
[0024] There is a need for an electronic device for presenting navigation directions using multiple modes of transportation, including changing the mode of transportation based on detected contextual information. There is also a need for an electronic device for adding a destination and specifying a mode of transportation for navigating to the added destination among multiple destination routes for navigation directions. Such techniques enhance user interaction with an electronic device by reducing the input required to continue navigation when the mode of transportation changes, and provide an efficient way to present information related to the mode of transportation, which reduces the amount of time required for the user to perform the operation. In addition, such techniques can reduce processor power and battery power that would otherwise be wasted on redundant user input.
[0025] Although the following description uses the terms "first", "second", etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another element. For example, a first touch can be named a second touch and similarly a second touch can be named a first touch without departing from the scope of the various described embodiments. Both the first touch and the second touch are touches, but they are not the same touch.
[0026] The terms used in the description of various described embodiments herein are only for the purpose of describing specific embodiments, and are not intended to be limiting. As used in the description of various described embodiments and in the appended claims, the singular forms "one" and "the" are intended to also include plural forms, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" used herein refers to and encompasses any and all possible combinations of one or more items in the associated listed items. It will also be understood that the terms "including" and / or "comprising" when used in this specification specify the presence of stated features, integers, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or their grouping.
[0027] The term "if" is optionally interpreted to mean "when," "upon," or "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that ..." or "if [a stated condition or event] is detected" are optionally interpreted to mean "upon determining that ..." or "in response to determining that ..." or "upon detecting [a stated condition or event]," or "in response to detecting [a stated condition or event]," depending on the context.
[0028] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or a music player function. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple Watch from Apple Inc. (Cupertino, California). Devices, iPod Equipment and Device. Other portable electronic devices are optionally used, such as laptop computers or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and / or touch pads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or touch pads).
[0029] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse and / or joystick.
[0030] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.
[0031] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (such as a touch-sensitive surface) optionally supports various applications with a user interface that is intuitive and clear to the user.
[0032] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1A 1 is a block diagram illustrating a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes referred to as or referred to as a "touch-sensitive display system." The device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more contact force sensors 165 for detecting the intensity of contact on the device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of the device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.
[0033] As used in this specification and claims, the term "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a surrogate (surrogate) of the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values that includes at least four different values and more typically includes hundreds of different values (e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted average) to determine an estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or its change, the capacitance of the touch-sensitive surface near the contact and / or its change, and / or the resistance of the touch-sensitive surface near the contact and / or its change are optionally used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether the intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some embodiments, the substitute measurement of the contact force or pressure is converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether the intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of the user input allows the user to access additional device functionality that would otherwise be inaccessible to the user on a smaller device with limited real estate, which is used to display an enable indication (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).
[0034] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, which will be detected by a user using the user's sense of touch. For example, in the case where a device or a component of the device is in contact with a user's touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical properties of the device or component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" to a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click", even when the physical actuation button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movement does not move. As another example, movement of a touch-sensitive surface may optionally be interpreted or sensed by a user as "roughness" of the touch-sensitive surface even when there is no change in the smoothness of the touch-sensitive surface. While such a user's interpretation of touch will be limited by the user's individualized sensory perceptions, many sensory perceptions of touch are common to most users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "press click," "release click," "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or a component thereof that would generate that sensory perception for a typical (or average) user.
[0035] It should be understood that device 100 is merely one example of a portable multifunction device, and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0036] The memory 102 optionally includes high-speed random access memory, and optionally also includes non-volatile memory, such as one or more disk storage devices, flash memory devices or other non-volatile solid-state memory devices. The memory controller 122 optionally controls the access rights of other components of the device 100 to the memory 102.
[0037] The peripheral device interface 118 can be used to couple the input peripheral devices and output peripheral devices of the device to the CPU 120 and the memory 102. The one or more processors 120 run or execute various software programs and / or instruction sets stored in the memory 102 to perform various functions of the device 100 and process data. In some embodiments, the peripheral device interface 118, the CPU 120, and the memory controller 122 are optionally implemented on a single chip such as the chip 104. In some other embodiments, they are optionally implemented on separate chips.
[0038] RF (radio frequency) circuit 108 receives and sends RF signals, also referred to as electromagnetic signals. RF circuit 108 converts electrical signals into / converts electromagnetic signals into electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. RF circuit 108 optionally includes well-known circuits for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, user identity modules (SIM) cards, memories, and the like. RF circuit 108 optionally communicates with networks and other devices via wireless communications, such as the Internet (also referred to as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuit 108 optionally includes well-known circuits for detecting near field communications (NFC) fields, such as through short-range communications radio components. Wireless communication optionally uses any of a variety of communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11d), IEEE 802.11e, IEEE 802.11f, IEEE 802.11g, IEEE 802.11g). 11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Utilizing Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)) and / or Short Message Service (SMS), or any other suitable communication protocol including communication protocols that have not been developed as of the filing date of this document.
[0039] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset having both output (e.g., a single or dual-ear headset) and input (e.g., a microphone).
[0040] The I / O subsystem 106 couples input / output peripherals on the device 100, such as a touch screen 112 and other input control devices 116, to a peripheral device interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, etc. In some alternative embodiments, the input controller 160 is optionally coupled to any of the following (or none of the following): a keyboard, an infrared port, a USB port, and a pointing device such as a mouse. One or more buttons (e.g., Figure 2 208) optionally includes an increase / decrease button for volume control of the speaker 111 and / or the microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2 206).
[0041] A quick press of the push button optionally disengages the lock of the touch screen 112 or optionally begins the process of unlocking the device using gestures on the touch screen, as described in U.S. Patent Application 11 / 322,549, filed on December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image" (i.e., U.S. Patent No. 7,657,849), which is hereby incorporated by reference in its entirety. A long press of the push button (e.g., 206) optionally turns the device 100 on or off. The functionality of one or more buttons is optionally user-customizable. The touch screen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.
[0042] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or sends electrical signals to the touch screen. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.
[0043] The touch screen 112 has a touch-sensitive surface, sensor, or sensor group that accepts input from a user based on tactile and / or haptic contact. The touch screen 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of the contact) on the touch screen 112 and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to the user's finger.
[0044] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch screen 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112 to detect contact and any movement or interruption thereof. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in the Apple ® from Apple Inc. (Cupertino, California). and iPod The technology used in.
[0045] The touch-sensitive display in some embodiments of touch screen 112 is optionally similar to the multi-touch-sensitive touchpad described in the following U.S. Patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.), and / or U.S. Patent Publication 2002 / 0015024A1, each of which is hereby incorporated by reference in its entirety. However, touch screen 112 displays visual output from device 100, while a touch-sensitive touchpad does not provide visual output.
[0046] The touch-sensitive display in some embodiments of the touch screen 112 is described in the following applications: (1) U.S. patent application No. 11 / 381,313, filed on May 2, 2006, "Multipoint Touch Surface Controller"; (2) U.S. patent application No. 10 / 840,862, filed on May 6, 2004, "Multipoint Touchscreen"; (3) U.S. patent application No. 10 / 903,964, filed on July 30, 2004, "Gestures For Touch Sensitive Input Devices"; (4) U.S. patent application No. 11 / 048,264, filed on January 31, 2005, "Gestures For Touch Sensitive Input Devices"; (5) U.S. patent application No. 11 / 038,590, filed on January 18, 2005, "Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices”; (6) U.S. patent application Ser. No. 11 / 228,758, filed on September 16, 2005, “Virtual Input Device Placement On A Touch Screen User Interface”; (7) U.S. patent application Ser. No. 11 / 228,700, filed on September 16, 2005, “Operation Of A Computer With A Touch Screen Interface”; (8) U.S. patent application Ser. No. 11 / 228,737, filed on September 16, 2005, “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”; and (9) U.S. patent application Ser. No. 11 / 367,749, filed on March 3, 2006, “Multi-Functional Hand-Held Device”. All of these applications are incorporated herein by reference in their entirety.
[0047] The touch screen 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally uses any suitable object or attachment such as a stylus, finger, etc. to contact the touch screen 112. In some embodiments, the user interface is designed to work primarily through finger-based contacts and gestures, which may not be as accurate as stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, the device converts rough finger-based input into precise pointer / cursor positioning or commands for performing the actions desired by the user.
[0048] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface that is separate from the touch screen 112 or is an extension of the touch-sensitive surface formed by the touch screen.
[0049] Device 100 also includes a power system 162 for powering the various components. Power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, power fault detection circuits, power converters or inverters, power status indicators (e.g., light emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of power in a portable device.
[0050] Device 100 optionally also includes one or more optical sensors 164 . Figure 1AAn optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106 is shown. The optical sensor 164 optionally includes a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with the imaging module 143 (also called a camera module), the optical sensor 164 optionally captures a static image or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite to the touch screen display 112 on the front of the device, so that the touch screen display can be used as a viewfinder for static images and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device so that when the user views other video conference participants on the touch screen display, the image of the user is optionally obtained for video conferencing. In some embodiments, the positioning of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor in the device housing) so that a single optical sensor 164 is used with the touch screen display for both video conferencing and static image and / or video image acquisition.
[0051] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1A A contact force sensor is shown coupled to a force sensor controller 159 in the I / O subsystem 106. Contact force sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). Contact force sensor 165 receives contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the back of device 100, opposite to touch screen display 112 located on the front of device 100.
[0052] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1AA proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is optionally coupled to the input controller 160 in the I / O subsystem 106. The proximity sensor 166 optionally implements as described in the following U.S. patent application numbers: 11 / 241,839, entitled "Proximity Detector In Handheld Device"; 11 / 240,788, entitled "Proximity Detector In Handheld Device"; 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; 11 / 586,862, entitled "Automated Response To And Sensing Of User Activity In Portable Devices"; and 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", which are hereby incorporated by reference in their entirety. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables the touch screen 112.
[0053] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1A A tactile output generator is shown coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices such as a speaker or other audio component; and / or an electromechanical device for converting energy into linear motion such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component for converting an electrical signal into a tactile output on the device). The contact force sensor 165 receives tactile feedback generation instructions from the tactile feedback module 133 and generates a tactile output on the device 100 that can be felt by a user of the device 100. In some embodiments, at least one tactile output generator is arranged in parallel or adjacent to a touch-sensitive surface (e.g., a touch-sensitive display system 112) and optionally generates a tactile output by moving the touch-sensitive surface vertically (e.g., inward / outward of the surface of the device 100) or laterally (e.g., backward and forward in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.
[0054] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 coupled to the peripheral device interface 118 is shown. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. The accelerometer 168 is optionally performed as described in the following U.S. Patent Publication Nos.: 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and 20060017692, entitled "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer", both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed in a portrait view or a landscape view on the touch screen display based on analysis of data received from one or more accelerometers. The device 100 optionally includes a magnetometer (not shown) and a GPS (or GLONASS or other global navigation system) receiver (not shown) in addition to the accelerometer 168 for obtaining information about the position and orientation (e.g., portrait or landscape) of the device 100.
[0055] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 ( Figure 1A ) or 370( Figure 3 ) storage device / global internal state 157, such as Figure 1A and Figure 3 . The device / global internal state 157 includes one or more of the following: active application state, which indicates which applications (if any) are currently active; display state, which indicates what applications, views, or other information occupy various areas of the touch screen display 112; sensor state, which includes information obtained from the device's various sensors and input control devices 116; and position information related to the device's position and / or posture.
[0056] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.), and facilitating communication between various hardware components and software components.
[0057] The communication module 128 facilitates communication with other devices through one or more external ports 124, and also includes various software components for processing data received by the RF circuit 108 and / or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) is suitable for coupling directly to other devices, or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is connected to (trademark of Apple Inc.) devices.
[0058] The contact / motion module 130 optionally detects contact with the touch screen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger press event), determining the contact strength (e.g., the force or pressure of the contact, or a substitute for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or contact disconnection). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of the contact point being represented by a series of contact data. These operations are optionally applied to a single point of contact (e.g., a single finger contact) or multiple points of simultaneous contact (e.g., "multi-touch" / multiple finger contacts). In some embodiments, the contact / motion module 130 and display controller 156 detect contact on the touch pad.
[0059] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an action has been performed by a user (e.g., to determine whether a user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds are determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a particular physical actuator and can be adjusted without changing the physical hardware of the device 100). For example, without changing the touchpad or touchscreen display hardware, the mouse "click" threshold of a touchpad or touchscreen can be set to any one of a large range of predefined thresholds. Additionally, in some specific implementations, a software setting is provided to the user of the device for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by utilizing a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).
[0060] The contact / motion module 130 optionally detects gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event, and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event.
[0061] The graphics module 132 includes various known software components for rendering and displaying graphics on the touch screen 112 or other display, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.
[0062] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes for specifying the graphics to be displayed from an application program or the like, along with coordinate data and other graphics attribute data if necessary, and then generates screen image data to be output to the display controller 156.
[0063] Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator 167 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .
[0064] Text input module 134, optionally as a component of graphics module 132, provides a soft keyboard for entering text in various applications (eg, contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).
[0065] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing; to the camera 143 as picture / video metadata; and to applications that provide location-based services, such as a weather widget, a local yellow pages widget, and a map / navigation widget).
[0066] The application 136 optionally includes the following modules (or instruction sets) or a subset or superset thereof:
[0067] ● Contacts module 137 (sometimes called address book or contact list);
[0068] ● Telephone module 138;
[0069] Video conferencing module 139;
[0070] ● Email client module 140;
[0071] ●Instant messaging (IM) module 141;
[0072] ●Fitness support module 142;
[0073] ● Camera module 143 for still images and / or video images;
[0074] ●Image management module 144;
[0075] ●Video player module;
[0076] ●Music player module;
[0077] ●Browser module 147;
[0078] ●Calendar module 148;
[0079] A widget module 149, which optionally includes one or more of the following: a weather widget 149-1, a stock market widget 149-2, a calculator widget 149-3, an alarm widget 149-4, a dictionary widget 149-5, and other widgets acquired by the user, and a user-created widget 149-6;
[0080] A widget creator module 150 for forming a user-created widget 149-6;
[0081] ●Search module 151;
[0082] ● Video and music player module 152, which merges the video player module and the music player module;
[0083] ●Notepad module 153;
[0084] ● Map module 154; and / or
[0085] ●Online video module 155.
[0086] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.
[0087] In conjunction with the touch screen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., stored in the application internal state 192 of the contact module 137 in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140, or IM 141; and the like.
[0088] In conjunction with RF circuit 108, audio circuit 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, phone module 138 is optionally used to enter a character sequence corresponding to a phone number, access one or more phone numbers in contact module 137, modify an entered phone number, dial a corresponding phone number, conduct a conversation, and disconnect or hang up when the conversation is completed. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.
[0089] In combination with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact / motion module 130, the graphics module 132, the text input module 134, the contact module 137 and the telephone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting and terminating a video conference between a user and one or more other participants in accordance with user instructions.
[0090] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.
[0091] In conjunction with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, and the text input module 134, the instant messaging module 141 includes executable instructions for the following operations: entering a character sequence corresponding to an instant message, modifying previously entered characters, transmitting a corresponding instant message (e.g., using a short message service (SMS) or multimedia message service (MMS) protocol for telephone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or enhanced messaging services (EMS). As used herein, "instant messaging" refers to both telephone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).
[0092] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154 and the music player module, the fitness support module 142 includes executable instructions for creating a fitness (e.g., with time, distance and / or calorie burn goals); communicating with fitness sensors (sports equipment); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for fitness; and displaying, storing and transmitting fitness data.
[0093] In conjunction with the touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132 and image management module 144, the camera module 143 includes executable instructions for the following operations: capturing still images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of the still images or videos, or deleting the still images or videos from the memory 102.
[0094] In conjunction with touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, marking, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.
[0095] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet in accordance with user instructions, including searching, linking to, receiving and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.
[0096] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying and storing calendars and data associated with the calendar (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.
[0097] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is a mini-application that is optionally downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm widget 149-4, and dictionary widget 149-5) or a mini-application created by a user (e.g., user-created widget 149-6). In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! widget).
[0098] In combination with the RF circuit 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134 and browser module 147, the widget creator module 150 is optionally used by a user to create widgets (e.g., converting a user-specified portion of a web page into a widget).
[0099] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.
[0100] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, and executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch screen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).
[0101] In conjunction with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the notepad module 153 includes executable instructions for creating and managing notes, to-do lists, etc. according to user instructions.
[0102] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the GPS module 135 and the browser module 147, the map module 154 is optionally used to receive, display, modify and store maps and data associated with the maps (e.g., driving directions, data related to stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.
[0103] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes instructions for the following operations: allowing a user to access, browse, receive (e.g., by streaming and / or downloading), playback (e.g., on the touch screen or on an external display connected via external port 124), send an email with a link to a specific online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send a link to a specific online video. Additional description of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed on June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed on December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are hereby incorporated by reference in their entirety.
[0104] Each of the modules and applications described above corresponds to an executable instruction set for performing one or more of the functions described above and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not have to be implemented as independent software programs, processes, or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, a video player module is optionally combined with a music player module into a single module (e.g., Figure 1A In some embodiments, the memory 102 optionally stores a subset of the above modules and data structures. In addition, the memory 102 optionally stores additional modules and data structures not described above.
[0105] In some embodiments, the device 100 is a device where the operation of a predefined set of functions on the device is performed exclusively through a touch screen and / or a touch pad. By using a touch screen and / or a touch pad as the primary input control device for operating the device 100, the number of physical input control devices (such as push buttons, dials, etc.) on the device 100 is optionally reduced.
[0106] A predefined set of functions performed exclusively through the touch screen and / or touchpad optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to a main menu, a home menu, or a root menu. In such embodiments, a "menu button" is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a touchpad.
[0107] Figure 1B is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).
[0108] Event classifier 170 receives event information and determines the application 136-1 and the application view 191 of application 136-1 to which the event information is to be delivered. Event classifier 170 includes event monitor 171 and event distributor module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information is to be delivered.
[0109] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when the application 136-1 resumes execution, user interface state information indicating that information is being displayed or is ready to be displayed by the application 136-1, a state queue for enabling a user to return to a previous state or view of the application 136-1, and a repeat / undo queue of previous actions taken by the user.
[0110] Event monitor 171 receives event information from peripherals interface 118. Event information includes information about sub-events (e.g., user touches on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (through audio circuit 110). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.
[0111] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).
[0112] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.
[0113] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.
[0114] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected is optionally referred to as a hit view, and the set of events that are recognized as correct input is optionally determined at least in part based on the hit view of the initial touch that started the touch-based gesture.
[0115] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy that should handle the sub-events. In most cases, the hit view is the lowest level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source for which it is identified as the hit view.
[0116] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, higher views in the hierarchy will still remain as actively participating views.
[0117] Event distributor module 174 distributes event information to event recognizers (e.g., event recognizers 180). In embodiments including active event recognizer determination module 173, event distributor module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event distributor module 174 stores the event information in an event queue, which is retrieved by corresponding event receivers 182.
[0118] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or is part of another module stored in memory 102, such as contact / motion module 130.
[0119] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the user interface of the application. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, the corresponding application view 191 includes multiple event recognizers 180. In other embodiments, one or more event recognizers in event recognizers 180 are part of an independent module, which is a higher-level object such as a user interface toolkit (not shown) or application 136-1 from which methods and other properties are inherited. In some embodiments, the corresponding event handler 190 includes one or more of the following: data updater 176, object updater 177, GUI updater 178 and / or event data 179 received from event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177 or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views in application view 191 include one or more corresponding event handlers 190. In addition, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.
[0120] The corresponding event identifier 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally includes sub-event delivery instructions).
[0121] Event receiver 182 receives event information from event classifier 170. Event information includes information about sub-events such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of the touch, the event information optionally also includes the speed and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another orientation (e.g., from a longitudinal orientation to a transverse orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).
[0122] Event comparator 184 compares event information with predefined event or sub-event definitions, and determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 includes the definition of an event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on a displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on a displayed object, and a second lift-off (touch end) of a predetermined duration. In another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.
[0123] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with the sub-event and the object that triggered the hit test.
[0124] In some embodiments, the definition of the corresponding event (187) also includes a delay action that delays the delivery of the event information until it has been determined that the sub-event sequence does or does not correspond to the event type of the event identifier.
[0125] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.
[0126] In some embodiments, the corresponding event identifier 180 includes metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should conduct sub-event delivery to actively participating event identifiers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event identifiers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.
[0127] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferred sending) the sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with the flag obtains the flag and performs a predefined process.
[0128] In some embodiments, event delivery instructions 188 include sub-event delivery instructions that deliver event information about a sub-event without activating an event handler. Instead, the sub-event delivery instructions deliver the event information to an event handler associated with a sub-event sequence or to an actively participating view. An event handler associated with a sub-event sequence or with an actively participating view receives the event information and performs a predetermined process.
[0129] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the positioning of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on a touch-sensitive display.
[0130] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.
[0131] It should be understood that the above discussion of event processing of user touches on a touch-sensitive display also applies to other forms of user input that utilize input devices to operate the multifunction device 100, and not all user input is initiated on the touch screen. For example, mouse movement and mouse button presses, optionally in conjunction with single or multiple keyboard presses or holddowns; contact movement on a touch pad, such as tapping, dragging, scrolling, etc.; stylus input; movement of the device; verbal commands; detected eye movement; biometric input; and / or any combination thereof are optionally used as input corresponding to sub-events that define the event to be distinguished.
[0132] Figure 2A portable multifunction device 100 with a touch screen 112 according to some embodiments is illustrated. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more of these graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, when the user interrupts contact with one or more graphics, selection of one or more graphics will occur. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down) and / or rolling of fingers that have been in contact with the device 100 (from right to left, from left to right, up and / or down). In some specific implementations or in some cases, inadvertent contact with a graphic will not select the graphic. For example, when the gesture corresponding to the selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.
[0133] The device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications that are optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.
[0134] In some embodiments, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on / off and for locking the device, one or more volume adjustment buttons 208, a user identity module (SIM) card slot 210, an earphone jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing the button and keeping the button in a pressed state for a predefined time interval; lock the device by pressing the button and releasing the button before the predefined time interval passes; and / or unlock the device or initiate an unlocking process. In an alternative embodiment, the device 100 also accepts voice input for activating or deactivating certain functions through a microphone 113. The device 100 also optionally includes one or more contact strength sensors 165 for detecting the strength of contact on the touch screen 112, and / or one or more tactile output generators 167 for generating tactile output for a user of the device 100.
[0135] Figure 3300 is a block diagram of an exemplary multi-function device with a display and a touch-sensitive surface according to some embodiments. Device 300 does not have to be portable. In some embodiments, device 300 is a laptop computer, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a game system, or a control device (e.g., a home controller or an industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as a chipset) that interconnect system components and control communications between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or a mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above reference Figure 1A The tactile output generator 167 described above), the sensor 359 (e.g., an optical sensor, an acceleration sensor, a proximity sensor, a touch sensitive sensor, and / or a contact intensity sensor (similar to the above reference Figure 1A Memory 370 optionally includes one or more storage devices located away from CPU 310. In some embodiments, memory 370 stores data related to portable multifunction device 100 ( Figure 1A ) or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100 ( Figure 1A )'s memory 102 optionally does not store these modules.
[0136] Figure 3Each element in the above-mentioned elements in is optionally stored in one or more memory devices of the previously mentioned memory device. Each module in the above-mentioned modules corresponds to the instruction set for performing the function described above. The above-mentioned modules or programs (e.g., instruction sets) do not have to be implemented as separate software programs, processes or modules, and therefore the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores the subset of the above-mentioned modules and data structures. In addition, memory 370 optionally stores additional modules and data structures not described above.
[0137] Attention is now turned to an embodiment of a user interface that is optionally implemented on, for example, portable multifunction device 100.
[0138] Figure 4A An exemplary user interface for an application menu on portable multifunction device 100 according to some embodiments is illustrated. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:
[0139] ● Signal strength indicators 402 for wireless communications such as cellular signals and Wi-Fi signals;
[0140] ●Time 404;
[0141] ●Bluetooth indicator 405;
[0142] ●Battery status indicator 406;
[0143] A tray 408 with icons for commonly used applications, such as:
[0144] o An icon 416 of the phone module 138 labeled “Phone”, which optionally includes an indicator 414 of the number of missed calls or voicemails;
[0145] o an icon 418 of the email client module 140 labeled “Mail”, which optionally includes an indicator 410 of the number of unread emails;
[0146] o an icon 420 labeled "Browser" of the browser module 147; and
[0147] o an icon 422 labeled “iPod” of the video and music player module 152 (also referred to as the iPod (trademark of Apple Inc.) module 152); and
[0148] ● Icons for other applications, such as:
[0149] o Icon 424 labeled “Messages” of IM module 141;
[0150] o Icon 426 labeled “Calendar” of calendar module 148;
[0151] o Icon 428 labeled “Photos” of the image management module 144;
[0152] o Icon 430 labeled “Camera” of camera module 143;
[0153] o Icon 432 labeled “Online Video” of the online video module 155;
[0154] o Icon 434 labeled “Stock Market” of the stock market widget 149 - 2 ;
[0155] o an icon 436 labeled “MAP” of the map module 154;
[0156] o Icon 438 labeled “Weather” of the weather widget 149 - 1 ;
[0157] o Icon 440 labeled “Clock” of the alarm clock widget 149 - 4 ;
[0158] o an icon 442 labeled “Fitness Support” of the fitness support module 142;
[0159] o Icon 444 labeled "Notepad" of the Notepad module 153; and
[0160] o An icon 446 of a settings application or module labeled “Settings” that provides access to settings for the device 100 and its various applications 136 .
[0161] It should be noted that Figure 4A The illustrated icon labels are exemplary only. For example, icon 422 of video and music player module 152 is labeled "Music" or "Music Player". Other labels are optionally used for various application icons. In some embodiments, the label of a corresponding application icon includes the name of the application corresponding to the corresponding application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.
[0162] Figure 4B The example embodiment has a touch-sensitive surface 451 (eg, touch screen display 112) that is separate from a display 450 (eg, touch screen display 112). Figure 3 A device (e.g., a tablet computer or touch pad 355) Figure 3Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting intensity of contacts on touch-sensitive surface 451 and / or one or more tactile output generators 357 for generating tactile output for a user of device 300.
[0163] Although some of the examples below are given with reference to input on a touch screen display 112 (where a touch-sensitive surface and a display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a main axis (e.g., Figure 4B 453) corresponding to the principal axis (for example, Figure 4B According to these embodiments, the device detects a position corresponding to a corresponding position on the display (e.g., Figure 4B 460 corresponds to 468 and 462 corresponds to 470) in contact with touch-sensitive surface 451 (e.g., Figure 4B Thus, when the touch-sensitive surface (e.g., Figure 4B 451) and a display of a multi-function device (e.g., Figure 4B When the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is separated, the device is used to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.
[0164] Additionally, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting contact, followed by ceasing to detect contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or mice and finger contacts are optionally used simultaneously.
[0165] Figure 5AAn exemplary personal electronic device 500 is illustrated. Device 500 includes a body 502. In some embodiments, device 500 may include a body 502 relative to devices 100 and 300 (e.g., Figures 1A to 4B ) some or all of the features described in the foregoing. In some embodiments, device 500 has a touch-sensitive display screen 504, referred to hereinafter as touch screen 504. Alternatively, or in addition to touch screen 504, device 500 also has a display and a touch-sensitive surface. As with devices 100 and 300, in some embodiments, touch screen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of contact (e.g., touch) applied. One or more intensity sensors of touch screen 504 (or touch-sensitive surface) can provide output data representing the intensity of touch. The user interface of device 500 can respond to touch based on the intensity of the touch, which means that touches of different intensities can invoke different user interface operations on device 500.
[0166] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related applications: International patent application serial number PCT / US2013 / 040061, entitled “Device, Method, and Graphical User Interface for Displaying UserInterface Objects Corresponding to an Application,” filed on May 8, 2013, published as WIPO publication number WO / 2013 / 169849; and International patent application serial number PCT / US2013 / 069483, entitled “Device, Method, and Graphical User Interface for Transitioning Between TouchInput to Display Output Relationships,” filed on November 11, 2013, published as WIPO publication number WO / 2014 / 105276, each of which is hereby incorporated by reference in its entirety.
[0167] In some embodiments, the device 500 has one or more input mechanisms 506 and 508. The input mechanisms 506 and 508, if included, can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, the device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, can allow the device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watchbands, bracelets, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow the user to wear the device 500.
[0168] Figure 5B An exemplary personal electronic device 500 is depicted. In some embodiments, the device 500 may include a Figure 1A , Figure 1B and Figure 3 Some or all of the components described. Device 500 has a bus 512 that operatively couples an I / O portion 514 to one or more computer processors 516 and a memory 518. I / O portion 514 may be connected to a display 504, which may have a touch-sensitive component 522 and optionally a strength sensor 524 (e.g., a contact strength sensor). In addition, I / O portion 514 may be connected to a communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 is optionally a rotatable input device or a depressible input device and a rotatable input device. In some examples, input mechanism 508 is optionally a button.
[0169] In some examples, input mechanism 508 is optionally a microphone. Personal electronic device 500 optionally includes various sensors, such as GPS sensor 532, accelerometer 534, orientation sensor 540 (e.g., compass), gyroscope 536, motion sensor 538, and / or combinations thereof, all of which are operably connected to I / O portion 514.
[0170] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may cause the computer processors to perform the techniques described below, including processes 700 and 900 ( Figure 7 and Fig. 9). Computer-readable storage media can be any medium that can tangibly contain or store computer-executable instructions for use by or in conjunction with an instruction execution system, apparatus, or device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memories such as flash memory, solid-state drives, and the like. Personal electronic device 500 is not limited to Figure 5B components and configurations, but may include other components or additional components in a variety of configurations.
[0171] In addition, in the method described herein where one or more steps depend on one or more conditions being met, it should be understood that the method can be repeated in multiple repetitions so that in the process of repetition, all conditions for determining the steps in the method have been met in different repetitions of the method. For example, if the method requires performing the first step (if the condition is met), and performing the second step (if the condition is not met), then the skilled person will know that the steps stated are repeated until both the condition is met and the condition is not met (in no particular order). Therefore, the method described as having one or more steps depending on one or more conditions being met can be rewritten as a method of repeating until each condition described in the method is met. However, this does not require the system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing a contingent operation based on the satisfaction of the corresponding one or more conditions, and is therefore able to determine whether a possible situation has been met without explicitly repeating the steps of the method until all conditions for determining the steps in the method have been met. It will also be understood by those of ordinary skill in the art that, similar to the method with the contingent steps, the system or computer-readable storage medium can repeat the steps of the method as many times as needed to ensure that all the contingent steps have been performed.
[0172] As used herein, the term "indicative representation" refers to an optional feature of the apparatus 100, 300, and / or 500 ( Figure 1A , Figure 3 and FIG. 5A to FIG. 5B ) is a user-interactive graphical user interface object displayed on a display screen of a computer. For example, an image (e.g., an icon), a button, and text (e.g., a hyperlink) optionally each constitute an affordance.
[0173] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface that a user is interacting with. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), a focus selector is displayed on a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4B In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in the display, the particular user interface element is adjusted according to the detected input. In the case that a touch-screen display (e.g., Figure 1A A touch-sensitive display system 112 or Figure 4A In some implementations of the touch screen 112 in FIG. 1 , a contact detected on the touch screen acts as a “focus selector” such that when an input (e.g., a press input by the contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted in accordance with the detected input. In some implementations, the focus moves from one area of the user interface to another area of the user interface without corresponding movement of a cursor or movement of a contact on the touch screen display (e.g., by using a tab key or arrow keys to move the focus from one button to another); in these implementations, the focus selector moves in accordance with the movement of the focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user interface element (or contact on the touch screen display) that is controlled by the user to deliver the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface with which the user desires to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).
[0174] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of a contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted off, before or after contact starts to move, before contact ends, before or after contact is detected to increase in intensity, and / or before or after contact is detected to decrease in intensity). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of the intensity of the contact, the mean value of the intensity of the contact, the average value of the intensity of the contact, the value at the top 10% of the intensity of the contact, the half-maximum value of the intensity of the contact, the 90% maximum value of the intensity of the contact, etc. In some embodiments, the duration of the contact is used when determining the characteristic strength (e.g., when the characteristic strength is the average of the strength of the contact over time). In some embodiments, the characteristic strength is compared to a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact whose characteristic strength does not exceed the first threshold results in a first operation, a contact whose characteristic strength exceeds the first strength threshold but does not exceed the second strength threshold results in a second operation, and a contact whose characteristic strength exceeds the second threshold results in a third operation. In some embodiments, a comparison between the characteristic strength and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding operation or give up performing the corresponding operation) rather than to determine whether to perform the first operation or the second operation.
[0175] Figure 5C Detecting multiple contacts 552A-552E on touch-sensitive display screen 504 using multiple intensity sensors 524A-524D is illustrated. Figure 5C Additionally included is an intensity graph that shows the current intensity measurements of intensity sensors 524A-524D relative to intensity units. In this example, the intensity measurements of intensity sensors 524A and 524D are each 9 intensity units, and the intensity measurements of intensity sensors 524B and 524C are each 7 intensity units. In some implementations, the cumulative intensity is the sum of the intensity measurements of multiple intensity sensors 524A-524D, which is 32 intensity units in this example. In some embodiments, each contact is assigned a corresponding intensity, which is a portion of the cumulative intensity. Figure 5DThe assignment of cumulative strengths to contacts 552A-552E based on their distances from the center of force 554 is illustrated. In this example, each of contacts 552A, 552B, and 552E is assigned a contact strength of 8 strength units of the cumulative strength, and each of contacts 552C and 552D is assigned a contact strength of 4 strength units of the cumulative strength. More generally, in some implementations, each contact j is assigned a corresponding strength Ij, which is a portion of the cumulative strength A, according to a predefined mathematical function Ij=A·(Dj / ΣDi), where Dj is the distance of the corresponding contact j from the center of force, and ΣDi is the sum of the distances of all corresponding contacts (e.g., i=1 to the last) from the center of force. The reference may be performed using an electronic device similar to or equivalent to device 100, 300, or 500. FIG. 5C to FIG. 5D In some embodiments, the characteristic intensity of the contact is based on one or more intensities of the contact. In some embodiments, the intensity sensor is used to determine a single characteristic intensity (e.g., a single characteristic intensity of a single contact). It should be noted that the intensity map is not part of the displayed user interface, but is included in the FIG. 5C to FIG. 5D To assist the readers.
[0176] In some embodiments, a portion of a gesture is identified for determining characteristic intensity. For example, the touch-sensitive surface optionally receives a continuous swipe contact that transitions from a starting position and reaches an end position, where the contact intensity increases. In this example, the characteristic intensity of the contact at the end position is optionally based only on a portion of the continuous swipe contact, rather than the entire swipe contact (e.g., only the portion of the swipe contact at the end position). In some embodiments, a smoothing algorithm is optionally applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, a smoothing algorithm optionally includes one or more of the following: an unweighted sliding average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow peaks or depressions in the intensity of the swipe contact to achieve the purpose of determining the characteristic intensity.
[0177] The intensity of contact on the touch-sensitive surface is optionally characterized relative to one or more intensity thresholds such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform an operation typically associated with clicking a button of a physical mouse or touchpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform an operation different from the operation typically associated with clicking a button of a physical mouse or touchpad. In some embodiments, when a contact having a characteristic intensity lower than the light press intensity threshold (e.g., and higher than a nominal contact detection intensity threshold, contacts lower than the nominal contact detection intensity threshold are no longer detected) is detected, the device will move the focus selector according to the movement of the contact on the touch-sensitive surface without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally speaking, unless otherwise stated, these intensity thresholds are consistent between different groups of user interface illustrations.
[0178] An increase in contact characteristic intensity from an intensity below a light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a "light press" input. An increase in contact characteristic intensity from an intensity below a deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a "deep press" input. An increase in contact characteristic intensity from an intensity below a contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting contact on the touch surface. A decrease in contact characteristic intensity from an intensity above the contact detection intensity threshold to an intensity below the contact detection intensity threshold is sometimes referred to as detecting contact lifted from the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.
[0179] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting that the strength of the contact (or multiple contacts) increases to above a press input strength threshold. In some embodiments, the corresponding operation is performed in response to detecting that the strength of the corresponding contact increases to above the press input strength threshold (e.g., a "down stroke" of the corresponding press input). In some embodiments, the press input includes an increase in the strength of the corresponding contact to above the press input strength threshold and the strength of the contact subsequently decreases to below the press input strength threshold, and the corresponding operation is performed in response to detecting that the strength of the corresponding contact subsequently decreases to below the press input threshold (e.g., an "up stroke" of the corresponding press input).
[0180] FIG. 5E to FIG. 5HDetection of a gesture is illustrated, the gesture comprising contact 562 with an intensity ranging from less than Figure 5E The light press intensity threshold in L ”) increases to a strength higher than Figure 5H The deep compression intensity threshold in D ”). On the displayed user interface 570 including application icons 572A-572D displayed in the predefined area 574, when the cursor 576 is displayed above the application icon 572B corresponding to application 2, a gesture performed using contact 562 is detected on the touch-sensitive surface 560. In some embodiments, the gesture is detected on the touch-sensitive display 504. The intensity sensor detects the intensity of the contact on the touch-sensitive surface 560. The device determines whether the intensity of the contact 562 is within the deep press intensity threshold (for example, “IT D ”) reaches a peak above. Contact 562 is maintained on touch-sensitive surface 560. In response to detecting the gesture, and according to the intensity increasing to a deep press intensity threshold (e.g., “IT D ”) above contact 562, displays scaled representations 578A-578C (e.g., thumbnails) of documents recently opened for application 2, such as FIG. 5F to FIG. 5H In some embodiments, the intensity is a characteristic intensity of the contact compared to one or more intensity thresholds. It should be noted that the intensity map for contact 562 is not part of the displayed user interface, but is included in the FIG. 5E to FIG. 5H To assist the readers.
[0181] In some embodiments, the display of representations 578A-578C includes animation. For example, representation 578A is initially displayed near application icon 572B, such as Fig. 5F As the animation progresses, representation 578A moves upward and representation 578B is displayed near application icon 572B, as shown in FIG. Figure 5G Then, representation 578A moves upward, 578B moves upward toward representation 578A, and representation 578C is displayed near application icon 572B, as shown in FIG. Figure 5H 578A-578C form an array above icon 572B. In some embodiments, the animation progresses according to the intensity of contact 562, such as Figure 5F to Figure 5G , where representations 578A-578C appear and increase as the strength of contact 562 approaches a deep press strength threshold (eg, “IT D ”) increases and moves upward. In some embodiments, the intensity according to which the animation progresses is the characteristic intensity of the contact. The reference may be performed using an electronic device similar to or equivalent to device 100, 300, or 500. FIG. 5E to FIG. 5H The operation described.
[0182] In some embodiments, the device employs intensity hysteresis to avoid unexpected inputs sometimes referred to as "jitter," where the device defines or selects a hysteresis intensity threshold that has a predefined relationship to a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below the hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the hysteresis intensity threshold (e.g., an "upward stroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the contact intensity increases from an intensity equal to or below the hysteresis intensity threshold to an intensity equal to or above the press input intensity threshold and, optionally, that the contact intensity subsequently decreases to an intensity equal to or below the hysteresis intensity, and a corresponding operation is performed in response to detecting the press input (e.g., an increase in contact intensity or a decrease in contact intensity, depending on the circumstances).
[0183] For ease of explanation, a description of an operation performed in response to a press input associated with a press input intensity threshold or in response to a gesture including a press input is optionally triggered in response to detecting any of the following: contact intensity increasing to above the press input intensity threshold, contact intensity increasing from an intensity below a hysteresis intensity threshold to an intensity above the press input intensity threshold, contact intensity decreasing to below the press input intensity threshold, and / or contact intensity decreasing to below a hysteresis intensity threshold corresponding to the press input intensity threshold. Additionally, in examples where an operation is described as being performed in response to detecting that the intensity of the contact decreases below the press input intensity threshold, the operation is optionally performed in response to detecting that the intensity of the contact decreases below a hysteresis intensity threshold that corresponds to and is less than the press input intensity threshold.
[0184] In some embodiments, the electronic device 500 includes one or more tactile output generators, wherein the one or more tactile output generators generate different types of tactile output sequences, as described in Table 1 below. In some embodiments, a particular type of tactile output sequence generated by one or more tactile output generators of the device corresponds to a specific tactile output pattern. For example, the tactile output pattern specifies the characteristics of the tactile output, such as the amplitude of the tactile output, the shape of the moving waveform of the tactile output, the frequency of the tactile output, and / or the duration of the tactile output. When a device (e.g., one or more tactile output generators that generate tactile output via a movable mass) generates tactile outputs with different tactile output patterns, the tactile output can produce different tactile sensations in a user holding or touching the device. Although the user's senses are based on the user's perception of the tactile output, most users will be able to identify changes in the waveform, frequency, and amplitude of the tactile output generated by the device.
[0185] More specifically, FIG. 5I to FIG. 5K A set of sample tactile output patterns are provided that can be used, individually or in combination, as is or through one or more transformations (e.g., modulation, amplification, truncation, etc.) to form suitable tactile feedback in various scenarios and for various purposes (such as those described above and those described with respect to the user interfaces and methods discussed herein). This example of a control panel for tactile output shows how a set of three waveforms and eight frequencies can be used to generate an array of tactile output patterns. In addition to the tactile output patterns shown in these figures, each of these tactile output patterns is optionally adjusted in amplitude by changing the gain value of the tactile output pattern, as shown, for example, for Figure 5L to Figure 5N 80Hz, FullTap 200Hz, MiniTap80Hz, MiniTap 200Hz, MicroTap 80Hz, and MicroTap 200Hz, each of which is shown as a variant with a gain of 1.0, 0.75, 0.5, and 0.25. Figure 5L to Figure 5N As shown, changing the gain of a tactile output pattern changes the amplitude of the pattern without changing the frequency of the pattern or changing the shape of the waveform. In some embodiments, changing the frequency of the tactile output pattern also results in a lower amplitude because some tactile output generators are limited by how much force can be applied to the movable mass, so the higher frequency movement of the mass is constrained to a lower amplitude to ensure that the acceleration required to form the waveform does not require forces outside the operating force range of the tactile output generator (e.g., the peak amplitude of FullTap at 230 Hz, 270 Hz, and 300 Hz is lower than the amplitude of FullTap at 80 Hz, 100 Hz, 125 Hz, and 200 Hz).
[0186] FIG. 5I to FIG. 5NA tactile output pattern having a particular waveform is shown. The waveform of the tactile output pattern represents a pattern of physical displacements and time relative to a neutral position (e.g., Xzero) through which the movable mass passes to generate a tactile output having the tactile output pattern. For example, Fig.5I The first set of tactile output patterns shown (eg, the “FullTap” tactile output pattern) each have a waveform that includes oscillations having two complete cycles (eg, oscillations that begin and end at a neutral position and pass through the neutral position three times). Figure 5J The second set of tactile output patterns shown (eg, “MiniTap” tactile output patterns) each have a waveform that includes oscillations having one complete cycle (eg, oscillations that begin and end at a neutral position and pass through the neutral position once). Figure 5K The third set of tactile output patterns shown (e.g., the "MicroTap" tactile output patterns) each have a waveform that includes an oscillation that includes half a complete cycle (e.g., an oscillation that begins and ends at a neutral position and does not pass through the neutral position). The waveforms of the tactile output patterns also include a start buffer and an end buffer that represent the gradual acceleration and deceleration of the movable mass at the beginning and end of the tactile output. FIG. 5I to FIG. 5N The example waveform shown includes Xmin and Xmax values representing the maximum and minimum extents of movement of the movable mass. For larger electronic devices with larger movable masses, the minimum and maximum extents of movement of the mass may be larger or smaller. FIG. 5I to FIG. 5N The examples shown describe movement of a mass in one dimension, but similar principles can also be applied to movement of a movable mass in two or three dimensions.
[0187] like FIG. 5I to FIG. 5K As shown, each tactile output pattern also has a corresponding characteristic frequency, which affects the "pitch" of the tactile sensation felt by the user from the tactile output having the characteristic frequency. For continuous tactile output, the characteristic frequency represents the number of cycles (e.g., cycles per second) that the movable mass of the tactile output generator completes in a given time period. For discrete tactile output, a discrete output signal is generated (e.g., having 0.5, 1, or 2 cycles), and the characteristic frequency value specifies how fast the movable mass needs to move to generate a tactile output having the characteristic frequency. FIG. 5I to FIG. 5N As shown, for each type of tactile output (e.g., defined by a corresponding waveform, such as FullTap, MiniTap, or MicroTap), a higher frequency value corresponds to faster movement of the movable mass and, therefore, generally speaking, to a shorter tactile output completion time (e.g., including the time required to complete the number of cycles of the discrete tactile output plus the start and end buffer times). For example, a FullTap with a characteristic frequency of 80 Hz takes longer to complete (e.g., in 100 Hz) than a FullTap with a characteristic frequency of 100 Hz. Fig.5I, 35.4ms vs. 28.3ms). In addition, for a given frequency, a tactile output having more cycles in its waveform at the corresponding frequency takes longer to complete than a tactile output having fewer cycles in its waveform at the same corresponding frequency. For example, a FullTap at 150Hz takes longer to complete than a MiniTap at 150Hz (e.g., 19.4ms vs. 12.8ms), and a MiniTap at 150Hz takes longer to complete than a MicroTap at 150Hz (e.g., 12.8ms vs. 9.4ms). However, for tactile output modes with different frequencies, this rule may not apply (e.g., a tactile output with more cycles but a higher frequency may take a shorter amount of time to complete than a tactile output with fewer cycles but a lower frequency, and vice versa). For example, at 300Hz, FullTap takes the same amount of time as MiniTap (e.g., 9.9ms).
[0188] like FIG. 5I to FIG. 5K As shown, the tactile output pattern also has a characteristic amplitude, which affects the amount of energy contained in the tactile signal, or the "intensity" of the tactile sensation that the user can feel through the tactile output having the characteristic amplitude. In some embodiments, the characteristic amplitude of the tactile output pattern refers to the absolute value or normalized value representing the maximum displacement of the movable mass relative to the neutral position when generating the tactile output. In some embodiments, the characteristic amplitude of the tactile output pattern can be adjusted according to various conditions (e.g., customized based on user interface context and behavior) and / or preconfigured metrics (e.g., input-based metrics, and / or user interface-based metrics), such as by a fixed or dynamically determined gain factor (e.g., a value between 0 and 1). In some embodiments, an input-based metric (e.g., an intensity change metric or an input speed metric) measures the characteristics of the input during the input that triggers the generation of the tactile output (e.g., the rate of change of the characteristic intensity of the contact in the press input or the rate of movement of the contact on the touch-sensitive surface). In some embodiments, a user interface-based metric (e.g., a cross-border speed metric) measures a characteristic of a user interface element (e.g., how fast the element moves across a hidden or visible boundary in the user interface) during a user interface change that triggers generation of a tactile output. In some embodiments, a characteristic amplitude of a tactile output pattern may be "envelope" modulated, and the peaks of adjacent cycles may have different amplitudes, wherein one of the waveforms shown above is further modified by multiplying an envelope parameter that changes over time (e.g., from 0 to 1) to gradually adjust the amplitude of a portion of the tactile output over time when generating the tactile output.
[0189] Although for illustrative purposes FIG. 5I to FIG. 5KSpecific frequencies, amplitudes, and waveforms are shown in the sample tactile output patterns in , but tactile output patterns with other frequencies, amplitudes, and waveforms can also be used for similar purposes. For example, a waveform with between 0.5 and 4 cycles can be used. Other frequencies in the range of 60 Hz to 400 Hz can also be used. Table 1 below provides representative examples of tactile output / tactile feedback behaviors and configurations, as well as examples of their use relative to a user interface for managing content-based tactile output illustrated and described herein.
[0190]
[0191] Table 1
[0192] As used herein, an "installed application" refers to a software application that has been downloaded to an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched (e.g., become open) on the device. In some embodiments, a downloaded application becomes an installed application using an installer that extracts program portions from a downloaded software package and integrates the extracted portions with the operating system of a computer system.
[0193] As used herein, the term "open application" or "executing application" refers to a software application that has maintained state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or executing application is optionally any of the following types of applications:
[0194] ● the active application currently displayed on the display of the device on which the application is being used;
[0195] ● Background applications (or background processes) that are not currently displayed but whose processes or processes are being processed by one or more processors; and
[0196] ●Not running but has data stored in memory (volatile and non-volatile respectively)
[0197] A suspended or dormant application is retrieved and can be used to retrieve status information about the application's execution.
[0198] As used herein, the term "closed application" refers to a software application that does not have retained state information (e.g., the state information of a closed application is not stored in the memory of a device). Thus, closing an application includes stopping and / or removing the application's application process and removing the application's state information from the memory of a device. Generally speaking, while in a first application, opening a second application does not close the first application. When the second application is displayed and the first application stops being displayed, the first application becomes a background application.
[0199] Attention is now turned to embodiments of a user interface ("UI") and associated processes implemented on an electronic device, such as portable multifunction device 100, device 300, or device 500.
[0200] User interface and associated processes
[0201] Traffic patterns that change navigation directions
[0202] The user interacts with the electronic device in a variety of different ways. In some embodiments, the electronic device presents navigation directions from a first physical location to a second physical location. In some embodiments, when navigating to the second physical location, the electronic device detects that the user's traffic mode has changed based on context information. The embodiments described below provide a way for an electronic device to present navigation directions using multiple traffic modes (including changing the traffic mode based on detected context information). Enhanced interaction with the electronic device reduces the amount of time required for the user to perform an operation, thereby reducing the power consumption of the electronic device and extending the battery life of battery-powered electronic devices. The ability of the electronic device to change the traffic mode of the navigation direction enhances the user's interaction with the electronic device by reducing the input required to continue navigation when the traffic mode changes. When a person uses an electronic device, this person is optionally referred to as a user of the electronic device.
[0203] 6A to 6H Illustrated are exemplary ways to facilitate display of navigation directions including multiple modes of transportation and interaction with the navigation directions according to some embodiments of the present disclosure. The embodiments in these figures are used to illustrate the process described below, including reference to Figure 7 The process described.
[0204] Fig. 6Ais an example method for transitioning from a first mode of transportation to a second mode of transportation while presenting navigation directions according to some embodiments. The method generally begins at box 602, where a first electronic device (e.g., a mobile device) operates according to a first mode of transportation, such as driving a motor vehicle. For example, the first electronic device presents navigation directions for driving. Reference method 700 describes other modes of transportation. In some embodiments, operating according to the first mode of transportation includes displaying a navigation user interface of a mapping application with navigation directions according to the first mode of transportation. Reference will be made to FIG. 6C to FIG. 6H The navigation user interface is described in more detail with reference to method 700 .
[0205] After frame 602, the processing flow proceeds to frame 604, wherein in some embodiments, the first electronic device detects a change in context information. For example, the change in context information indicates that the user of the first electronic device no longer uses the first traffic mode or is no longer associated with the first traffic mode (for example, the user no longer drives a motor vehicle). As will be described in more detail with reference to method 700, in some embodiments, the first electronic device detects a change in context information based on one or more motion signal measurements of the first electronic device and / or other sensor data that is optionally used to determine that the user of the first electronic device no longer uses the first traffic mode. For example, the first electronic device detects that the moving speed of the first electronic device has been reduced from a speed associated with driving to a speed associated with walking or riding a bicycle. As another example, the first electronic device detects movement of the first electronic device corresponding to walking, running or riding a bicycle, such as repeated movement at a rhythm associated with one of these traffic modes.
[0206] After box 604, the processing flow proceeds to box 606, where in some embodiments, the first electronic device determines whether the change in context information satisfies one or more criteria. If, for example, the first electronic device determines that no, the change in context information does not satisfy one or more criteria, the processing flow proceeds to box 602, where the first electronic device continues to operate according to the first traffic mode (e.g., driving a motor vehicle). For example, the sensed context information is consistent with the first traffic mode. In some embodiments, the one or more criteria include criteria that are satisfied when the change in context information indicates the beginning of a second traffic mode, as will be described in more detail below with reference to method 700. In some embodiments, continuing to operate according to the first traffic mode includes continuing to display a navigation user interface of a mapping application with navigation directions according to the first traffic mode.
[0207] Returning to box 606, where the first electronic device determines whether the change in context information satisfies one or more criteria, in some embodiments, if the first electronic device determines that the change in context information does satisfy one or more criteria, the processing flow proceeds to box 608, where the first electronic device operates according to the second traffic mode. In some embodiments, the second traffic mode is different from the first traffic mode. For example, the second traffic mode includes riding or another traffic mode other than driving a motor vehicle. In some embodiments, the first electronic device 500a selects the second traffic mode from a predetermined list of traffic modes, which is selected by the user as the traffic mode for which the user wants to see navigation directions. In some embodiments, operating according to the second traffic mode includes displaying a navigation user interface of a mapping application with navigation directions according to the second traffic mode. In some embodiments, box 606 includes evaluating the context information to determine the traffic mode corresponding to the second traffic mode. For example, the first electronic device can determine which traffic mode the user is currently using from a plurality of possible traffic modes based on the context information.
[0208] In some embodiments, the first transportation mode is not limited to driving, and the second transportation mode is not limited to riding. For example, the first electronic device can be switched between driving, riding, public transportation, carpooling and / or walking.
[0209] In some embodiments, reference Figure 6B, the first electronic device 500a may be configured to analyze context information received and / or captured from one or more modules and / or devices to determine whether the context information indicates the start of the second traffic mode. One or more modules and / or devices may include a pedometer device 612, a map server 614, a sensor device 616, a second electronic device 618, and a third-party application 620 (e.g., one or more applications designed to be executed on a mobile device operating system), all of which may communicate with the first electronic device 500a. In some embodiments, the first electronic device 500a detects changes in context information including one or more environmental and / or user context data, and may determine whether the change in context information indicates the start of the second traffic mode. For example, the map server 614 provides map data to a mapping application in response to a request made by the first electronic device 500a for more information. In some embodiments, the map data includes different map areas and information describing streets, roads, highways, and / or points of interest in the map area. In some embodiments, the first electronic device 500a may determine that the context information indicates the start of the second traffic mode (e.g., riding). For example, a determination is made that the traffic mode has changed based on data sensed by the pedometer device 612. In some embodiments, the pedometer device 612 communicates with the first electronic device 500a. In some embodiments, the first electronic device 500a includes a pedometer device (e.g., a built-in pedometer device). In some embodiments, the first electronic device 500a compares the number of steps detected by the pedometer device 612 with a predefined threshold number of steps associated with walking, riding, riding a motor vehicle, or riding public transportation, respectively, to determine the traffic mode.
[0210] In some embodiments, determining the change of context information is based on map data. In some embodiments, the first electronic device 500a requests new surrounding map data to confirm the start of the second traffic mode when the context changes. For example, the new surrounding map data when the context changes may include multiple bicycle paths, and therefore confirm the start of the second traffic mode. In some embodiments, the first electronic device 500a requests new map data after sensing the change of the pedometer data from the pedometer device 612. In some embodiments, the first electronic device 500a requests new map data without the change of the pedometer data from the pedometer device 612. In some embodiments, the first electronic device 500a requests new map data regardless of the change of the pedometer data, such as requesting new map data based on different conditions (e.g., data from the sensor device 616 and / or a predetermined amount of time).
[0211] In some embodiments, the first electronic device 500a may request location and / or orientation information from one or more other sensor devices 616 (e.g., an accelerometer and / or gyroscope having the first electronic device) to determine or confirm the start of the second transportation mode. Other sensor devices are described in more detail with reference to method 700. In some embodiments, the first electronic device 500a may determine whether the first electronic device 500a is communicating with the second electronic device 618 (e.g., a watch, a tablet computer, or a motor vehicle display device). For example, if the electronic device 618 determines that the first electronic device 500a is communicating with the motor vehicle display, the first electronic device 500a may determine or confirm the start of the second transportation mode corresponding to driving the motor vehicle. In some embodiments, the first electronic device 500a may determine the user's participation in a third-party application 620 (such as a carpooling application or a bicycle rental application) to determine or confirm the start of the second transportation mode. For example, if the electronic device 618 determines that the first electronic device 500a is communicating with a bicycle rental application, the first electronic device 500a may determine or confirm the start of the second transportation mode corresponding to riding. Other modules and / or devices for determining whether context information indicates the onset of the second transportation mode are described with reference to method 700 .
[0212] FIG. 6C to FIG. 6H An example transition from operating according to a first traffic mode to operating according to a second traffic mode is illustrated. In some embodiments, the first electronic device 500a is configured to stream or share navigation data for presentation on a display of the second electronic device 622 while operating according to a traffic mode corresponding to driving a motor vehicle. For example, Figure 6C As indicated by legend 634 in FIG. , the first electronic device 500a communicates with the second electronic device 500b (e.g., a motor vehicle display device) to present a map application user interface that provides navigation directions along a route according to a first mode of transportation (e.g., driving a motor vehicle). For example, Figure 6C As indicated by legend 626 , the electronic device 610 operates according to a first traffic mode (eg, driving). Figure 6C An example of a second electronic device 500b providing navigation directions based on driving a motor vehicle is also shown. In some embodiments, if the first electronic device 500a presents navigation directions for a different mode of transportation before presenting driving directions, the first electronic device 500a changes to driving directions in response to detecting that the user of the first electronic device 500a enters a vehicle (such as detecting the second electronic device 500b near the first electronic device 500a).
[0213] In some embodiments, the map application user interface includes a map 628 that includes a representation of the current location 624 of the first electronic device 500a and / or the second electronic device 500b and an indication of a route 630 for driving navigation directions. Figure 6C As shown, the map application user interface includes an indication 632 of the next maneuver to be performed in the navigation direction according to the first transportation mode. In some embodiments, the indication includes an indication of the distance between the current location of the first electronic device 500a and / or the second electronic device 5002 and the location of the maneuver, an image representing the maneuver to be performed, and text describing the maneuver to be performed.
[0214] As will be FIG. 6D to FIG. 6H As described and illustrated in , in some embodiments, in response to a change in context information, the transition from operating according to a first transportation mode to operating according to a second transportation mode is automatic, without requiring user input to initiate the change in transportation mode. For example, when the first electronic device 500a is operating according to a first transportation mode (e.g., driving), the first electronic device 500a detects a change in context information indicating the start of a second transportation mode corresponding to walking, without detecting user input corresponding to a request to change from the first transportation mode to the second transportation mode. For example, a user equipped with the first electronic device 500a has left the car and has started walking. In some embodiments, the first electronic device 500a, based on the above reference Figure 6B The pedometer data, other sensor data, and / or map data described detect that the user has begun walking. In some embodiments, the first electronic device 500a changes from providing driving directions to providing walking directions based on determining that the user of the first electronic device 500a has left the vehicle (such as detecting that the second electronic device 500b is no longer near the first electronic device 500a). In some embodiments, the first electronic device 500a presents an indication recommending a change from driving to another mode of transportation based on detecting the state of the driver of the vehicle (for example, in a situation where the driver is tired or irritated). In response, in some embodiments, the first electronic device 500a changes from not displaying driving navigation directions when operating in a first mode of transportation (for example, driving) (for example, because the second electronic device 500b displays driving directions) to displaying walking navigation directions when operating in a second mode of transportation (for example, walking), such as Fig.6D In some embodiments, the first electronic device 500a displays a driving navigation user interface (which includes Figure 6C One or more elements of the illustrated driving user interface) are transformed into a display Fig.6D An illustrated walking navigation user interface.
[0215] Fig.6DAn example of the first electronic device 500a displaying a walking navigation user interface is illustrated. Fig.6D As indicated in the legend 626, the electronic device 610 is performing the operation in accordance with the previous Figure 6C In some embodiments, in response to detecting a change in context data corresponding to a change from driving to walking, the first electronic device 500a displays an indication 638c that the first electronic device 500a has stopped operating according to the first transportation mode (e.g., driving) and has switched to operating according to the second transportation mode (e.g., walking). In some embodiments, as Fig.6D As shown, the first electronic device 500a displays an indication 638a that the first electronic device 500a has stopped operating according to the first transportation mode and has switched to the second transportation mode overlaid on the map 640. In some embodiments, the indication 638a includes information related to operating according to the second transportation mode, such as content 638b, which optionally includes the location of the first electronic device 500a when the change in context information is detected (e.g., "My Location") and the destination (e.g., "Kensington Gardens, entrance a"). In some embodiments, the location where the navigation direction starts is different for the first transportation mode than for the second transportation mode. For example, the first electronic device 500a starts navigating in the first transportation mode at the starting location of the route, and starts navigating in the second transportation mode at the location where the context information indicates a change from the first transportation mode to the second transportation mode. In some embodiments, the indication 638a also includes content 638c notifying the user of the operation according to the second transportation mode and an option 638d to cancel the operation according to the second transportation mode. In some embodiments, as Fig.6D As shown, content 638c includes text content. Additionally or alternatively, in some embodiments, content 638c includes one or more static images, animated images, and / or video images.
[0216] In some embodiments, when operating according to the second transportation mode, the first electronic device 500a presents a user interface element to enhance the operation according to the second transportation mode. Fig. 6E As shown, the first electronic device 500a presents the immersive augmented reality 644 concurrently with an indication 646 of a maneuver to be performed as part of navigation directions according to the first transportation mode. Reference method 700 describes other user interface elements presented by the first electronic device 106 to enhance operations according to the transportation mode.
[0217] In some embodiments, such as Fig. 6EAs indicated by legend 626 in , while operating according to a second transportation mode corresponding to walking, the first electronic device 500a detects a change in contextual information, such as the first electronic device 500a communicating with a bike-sharing application. For example, the bike-sharing application is associated with a bicycle 648 near the first electronic device 500a shown in the immersive augmented reality 644. In some embodiments, the change in contextual information also includes an indication of a speed change while operating according to a third transportation mode corresponding to riding. In response, the first electronic device 500a displays an indication that the first electronic device 500a has transitioned from ceasing to operate according to the second transportation mode (e.g., walking) to operating according to the third transportation mode (e.g., riding), such as Fig. 6F shown.
[0218] For example, Fig. 6F As shown, the map application user interface includes an indication 656a of a change in the traffic mode overlaid on the map 652. In some embodiments, the indication 656a includes information related to operating according to the third traffic mode, such as content 656b, which optionally includes the location of the first electronic device 500a when the change in contextual information is detected (e.g., "My Location") and the destination (e.g., "Kensington Gardens, Blue Bicycle Park"). In some embodiments, the first electronic device 500a presents different destinations based on the changed traffic mode. For example, when operating according to the third traffic mode corresponding to cycling, the navigation directions include navigating to a destination related to cycling (such as "Blue Bicycle Park"), while when the first electronic device 500a is operating according to walking, the navigation directions include navigating to a destination related to cycling (such as "Blue Bicycle Park"), while when the first electronic device 500a is operating according to walking, the navigation directions include navigating to a destination related to cycling (such as "Blue Bicycle Park"), and ... Fig.6D The destination in the navigation direction is "Kensington Gardens, entrance a". In some embodiments, the first electronic device 500a changes the traffic mode without changing the destination of the navigation direction. Fig. 6F In some embodiments, the instruction 656a also includes content 656c notifying the user to operate according to the third transportation mode and an option 656d to cancel the operation according to the second transportation mode.
[0219] Figure 6G An example of a first electronic device 500a presenting navigation directions for riding is illustrated. In some embodiments, when the navigation directions are displayed according to the example Figure 6G When navigating to a destination using the third transportation mode corresponding to cycling as shown and indicated in legend 626, the first electronic device 106 presents a map 660 including a representation of the current location 664 of the first electronic device 500a and an indication of a route 662. For example, Figure 6GAlso shown is content 658 representing the next maneuver of the navigation direction to be performed according to the third transportation mode, which includes an indication of the distance between the current location of the first electronic device 500a and the location of the maneuver, an image representing the maneuver to be performed, and text describing the maneuver to be performed. In some embodiments, when the first electronic device 500a changes from operating according to the first transportation mode to operating according to the second transportation mode, the first electronic device 500a changes the route used to navigate to the destination. For example, if Figure 6G As shown, when navigating using cycling directions, the first electronic device 500a presents navigation directions for using bicycle lanes that are not used for walking and / or driving. When navigating according to the third transportation mode, the first electronic device 106 includes information 666 related to the route, such as an estimated arrival time, an estimated remaining elapsed time, and a remaining distance in the route, such as Figure 6G shown.
[0220] In some embodiments, after transitioning from the first transportation mode to the second transportation mode, the first electronic device 500a continues to navigate according to the second transportation mode for the remainder of the route of the navigation direction. In some embodiments, based on determining that the context information does not correspond to another change in the transportation mode, the first electronic device 500a uses the second transportation mode for navigation until the navigation route ends. In some embodiments, in response to detecting context information corresponding to a change in the transportation mode while navigating using the second transportation mode, the first electronic device 500a changes to a third transportation mode that is different from the second transportation mode selected based on the context information. Therefore, in some embodiments, the first electronic device 500a does not navigate to the end of the route using the second transportation mode.
[0221] In some embodiments, the first electronic device 500a presents an option to switch from the current traffic mode to a suggested traffic mode that is different from the current traffic mode in operation. For example, in some embodiments, the first electronic device 106 may be configured to periodically or continuously track information provided by the pedometer device 612, the sensor device 616, the map server 614, the second electronic device 618, and / or the third-party application 620. In some embodiments, in response to the new information, the first electronic device 500a may suggest a traffic mode.
[0222] For example, Figure 6HAs shown, when the first electronic device 106 is displaying navigation directions according to a third mode of transportation corresponding to biking as indicated by legend 626, the navigation instructions include content 668 indicating an upcoming maneuver to be performed for the navigation directions. In some embodiments, the first electronic device 106 determines that the maneuver (e.g., "take the stairs") is not recommended for the third mode of transportation, as described in more detail with reference to method 700. In response and as Figure 6H As shown, the first electronic device 500a includes an indication 674a of the recommended change of the traffic mode overlaid on the map 670 in the map application user interface. In some embodiments, the indication 674a includes information related to operating according to the third traffic mode, such as content 674b, which optionally includes the location of the first electronic device 500a when the change in contextual information is detected (e.g., "My location") and the destination (e.g., "Kensington Gardens, Blue Cycle Parking"). The user interface element 674a also includes content 674c notifying the user that it is not recommended to operate according to the third traffic mode and an option 674d to change the traffic mode to walking 656d.
[0223] Therefore, according to the above, the first electronic device 500a transitions between transportation modes while presenting navigation directions according to changes in context information.
[0224] Figure 7 is an example according to some embodiments (such as in 6A to 6H Flowchart of method 700 for facilitating display of navigation directions including multiple modes of transportation and an exemplary manner of interacting with the navigation directions. Method 700 is optionally performed on an electronic device (such as device 100, device 300, or device 500), as described above with reference to Figure 1A to Figure 1B , Figures 2 to 3 , FIG. 4A to FIG. 4B and FIG. 5A to FIG. 5H Some operations in method 700 are optionally combined, and / or the order of some operations is optionally changed.
[0225] As described below, method 700 provides a way to facilitate the display of navigation directions including multiple modes of transportation and interaction with the navigation directions. The method reduces the cognitive burden on the user when interacting with the device user interface of the present disclosure, thereby creating a more efficient human-computer interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charges.
[0226] In some embodiments, method 700 is performed at a first electronic device (e.g., 500a) that communicates with a display generation component (e.g., 504) and one or more sensors. For example, the first electronic device is a mobile device (e.g., a tablet computer, a smart phone, a media player, or a wearable device), a computer (e.g., a desktop computer, a laptop computer), or a wearable device (e.g., a watch, a head-mounted device), which optionally communicates with one or more of a mouse (e.g., external), a touchpad (optionally integrated or external), a remote control device (e.g., external), another mobile device (e.g., separate from the first electronic device), a handheld device (e.g., external), and / or a controller (e.g., external), or a set-top box that communicates with one or more input devices (e.g., a remote control). In some embodiments, the display generation component is a display (optionally a touch screen display) integrated with the first electronic device, an external display such as a monitor, a projector, a television, or a hardware component (optionally integrated or external) for projecting a user interface or making a user interface visible to one or more users. In some embodiments, the first electronic device is configured with one or more sensors. The one or more sensors optionally include a reference Figure 5B The one or more motion sensors (e.g., a pedometer, accelerometer, or gyroscope) that can measure the motion of the first electronic device. The one or more motion sensors optionally generate motion signal measurements. In some embodiments, the first electronic device analyzes the magnitude and / or frequency changes of the motion signal measurements to determine activities corresponding to the traffic pattern. In some embodiments, the one or more sensors include sensors that are different from the one or more motion sensors described in reference method 700.
[0227] In some embodiments, when the first electronic device is operating according to the first traffic mode (702a) (such as Figure 6C When the driving traffic mode indicated by the legend 626 in FIG. 1 is operated, the first electronic device displays (702b) a first navigation user interface (such as including Figure 6C In some embodiments, the first electronic device detects (702c) a change in context information via one or more sensors, such as in Figure 6C, the first electronic device 500a is disconnected from the second electronic device 500b. As used herein, the first navigation user interface optionally refers to the user interface of the mapping application. In some embodiments, the mapping application is installed on the first electronic device and runs on the first electronic device, and generates a first navigation user interface for display on the first electronic device. In some embodiments, the first navigation user interface is presented to be displayed on the touch screen of the motor vehicle to which the first electronic device is connected (e.g., via a wired connection or a wireless connection). In some embodiments, the first navigation user interface is simultaneously displayed on both the touch screens of the first electronic device and the motor vehicle. In some embodiments, the first option for initiating navigation according to the first traffic mode is an option in a plurality of options for initiating navigation according to a plurality of corresponding traffic modes. As used herein, the first navigation presentation optionally provides a set of navigation directions from a first position (e.g., the position of the first electronic device when requesting navigation directions or a specified position entered by the user via the first navigation user interface) to a second position (e.g., a specified destination entered by the user via the first navigation user interface). As used herein, the first traffic mode optionally refers to a motor vehicle, such as a car (e.g., driving directions). In some embodiments, the first navigation user interface includes a first option for initiating navigation according to another transportation mode different from the first transportation mode (e.g., bicycle, walking, public transportation, or transportation other than motor vehicles). In some embodiments, the first option for initiating navigation according to the first transportation mode includes navigation instructions, user interface elements, visual appearance, and / or layout based on the first transportation mode. For example, when the first transportation mode corresponds to a motor vehicle, the first navigation user interface includes a first navigation presentation with first navigation instructions, first mapping information, first navigation information, and / or a first set of features. For example, the first navigation instructions optionally include major roads, such as highways. In some embodiments, the first electronic device prioritizes adding highways to the route to reduce travel time. In some embodiments, the first electronic device prioritizes adding roads with bicycle paths and / or turns to the route to avoid interaction with motor vehicles when using a cycling transportation mode, otherwise the cycling transportation mode will not be prioritized when using a motor vehicle transportation mode. In some embodiments, the first mapping information optionally includes major roads such as highways, traffic information, charging stations, and / or rest stops. In some embodiments, the first navigation information includes speed limits, specific driving directions, and / or estimated time to reach a specified destination. In some embodiments, the first set of features includes initiating payment (for fuel / electricity), presenting a three-dimensional map, presenting travel information (e.g., trip duration, fuel economy, and / or weather), and / or manipulating vehicle settings (e.g., air conditioning, heated seats, and / or radio).For example, the first electronic device detects a change in motion signal measurement from a first speed to a second speed, wherein the first speed is greater than the second speed. In some embodiments, the first speed is less than the second speed. In some embodiments, the change in context information relates to the activity of a user equipped with the first electronic device. For example, the first electronic device detects that the user's participation in the first electronic device changes from a first level of participation (e.g., browsing content, texting, scrolling, listening to audio and / or speaking) to a second level of participation (e.g., there is no user participation and the first electronic device is sleeping). In another example, the first electronic device detects changes in the physiological characteristics (e.g., heart rate and / or breathing rate) of the user captured by the first electronic device. In some embodiments, an increase in heart rate indicates that the user is walking, riding or jogging. In some embodiments, the change in context information indicates that the user no longer uses the first traffic mode or is no longer associated with the first traffic mode (e.g., the user no longer drives a motor vehicle or is no longer a passenger in a motor vehicle). As described with reference to method 700, motion signal measurements and / or other sensor data are optionally used to determine the current traffic mode. In some embodiments, the first electronic device detects changes in context information when displaying the first navigation user interface. In some embodiments, the first electronic device detects changes in context information when not displaying the first navigation user interface.
[0228] In some embodiments, in response to detecting a change in context information, determining that one or more criteria are satisfied, the one or more criteria including when the change in context information indicates a second transportation mode (702d) (such as, Fig.6D 626 in the figure), wherein the change in context information is optionally a change in speed of the first electronic device 500a indicating that the user is walking. For example, if the amount of change between the first speed and the second speed is greater than a first threshold amount (e.g., 15km / h, 20km / h, 25km / h, 30km / h, 35km / h, 40km / h, 45km / h, 50km / h, 60km / h, 70km / h, 80km / h, 90km / h, or 100km / h), the amount of change optionally indicates the start of the second traffic mode. Other indications of starting the second traffic mode (or initiating the start of the second traffic mode) will be described with reference to method 700. In some embodiments, the first electronic device detects a change in context information without detecting user input. For example, detecting user input is not part of determining that one or more criteria are satisfied, including criteria that are satisfied when the change in context information indicates a change from operating according to the first traffic mode to operating according to the second traffic mode. In some embodiments, the first electronic device detects a change in context information without detecting user input corresponding to a request to change from a first transportation mode to a second transportation mode.
[0229] In some embodiments, the first electronic device stops (702e) operating according to the first traffic mode and operates (702f) according to the second traffic mode, such as from displaying Figure 6C The driving directions shown change to display Fig.6D In some embodiments, when operating according to the second transportation mode, the first electronic device displays (702g) a first navigation user interface (such as Figure 6C The user interface shown in the figure) is different from the second navigation user interface (such as Fig.6DIn some embodiments, the first electronic device is changed from displaying the first navigation user interface to displaying the second navigation user interface. In some embodiments, the change from operating according to the first traffic mode to operating according to the second traffic mode causes the first electronic device to change from not displaying the first navigation presentation (e.g., the first navigation instruction) when operating in the first traffic mode to not displaying the first navigation presentation when operating in the second traffic mode. In some embodiments, the change from operating according to the first traffic mode to operating according to the second traffic mode causes the first electronic device to change from not displaying the first navigation presentation when operating in the first traffic mode to not displaying the first navigation presentation when operating in the second traffic mode. In some embodiments, the change from operating according to the first traffic mode to operating according to the second traffic mode causes the first electronic device to change from not displaying the first navigation user interface when operating in the first traffic mode to displaying the first navigation user interface in the second traffic mode. As used herein, the second navigation user interface optionally refers to the user interface of a mapping application. In some embodiments, the mapping application is installed on and runs on the first electronic device, and generates a second navigation user interface for display on the first electronic device. In some embodiments, the second navigation user interface is presented for display on a touch screen of a second electronic device, such as a wearable device (e.g., a watch). In some embodiments, the first navigation user interface is displayed on both the first electronic device and the second electronic device simultaneously. As used herein, the second navigation presentation optionally provides a set of navigation directions from a location of the first electronic device that is different from the first location when a change in context information occurs to a second location or another location associated with a specified destination (e.g., an end location specified before a change in context information is detected). In some embodiments, the other location is accessible by a second transportation mode, rather than by the first transportation mode. As used herein, the second transportation mode optionally refers to walking. In some embodiments, the second option for initiating navigation according to the second transportation mode includes user interface elements, visual appearance, and / or layout based on the second transportation mode. For example, when the second transportation mode corresponds to a user walking, the second navigation user interface includes a second navigation presentation with second mapping information, second navigation information, and / or a second set of features. For example, the second mapping information optionally includes paved paths such as sidewalks, block details, building information, and / or bicycle or scooter rental information. In some embodiments, the second navigation information includes step-by-step walking guidance based on the second transportation mode and / or an updated (e.g., different) estimated time to reach the specified destination. In some embodiments, the second set of features includes presenting immersive (e.g., augmented reality) walking directions, presenting personalized walking guides, and / or presenting indoor maps or trail / park maps.
[0230] In some embodiments, based on determining that one or more criteria are not satisfied, the first electronic device continues (702h) to operate according to the first traffic mode (such as Figure 6C 626 in the legend 626). In some embodiments, continuing to operate in the first traffic mode includes continuing to display the first navigation user interface via the display generation component, the first navigation user interface including a first option for initiating navigation according to the first traffic mode. For example, if the amount of change between the first speed and the second speed is less than the first threshold amount, the amount of change optionally does not indicate the start of the second traffic mode or any other traffic mode different from the first traffic mode. In some embodiments, one or more second criteria are met, rather than one or more criteria, as will be described in more detail with reference to method 700. Automatically displaying a second navigation user interface with a second option for initiating navigation according to the second traffic mode in response to a change in contextual information indicating the start of the second traffic mode avoids additional interactions between the user and the first electronic device associated with changes in the input traffic mode when a seamless transition between traffic modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0231] In some embodiments, the first option for initiating navigation according to the first transportation mode includes a first navigation instruction from a first location to a second location, such as using a walking transportation mode to initiate navigation from the location of the first electronic device 500a when a change in contextual information is detected to a location such as Fig.6D and the second option for initiating navigation according to the second transportation mode includes a second navigation instruction from a third location to the second location, such as using a cycling transportation mode to initiate navigation from the location of the first electronic device 500a when a change in contextual information is detected to the location of the first electronic device 500a. Fig.6D , for example, the destination is the same destination. In some embodiments, the first navigation instruction corresponds to a set of navigation directions from the first location to the second location as described above. In some embodiments, the second navigation instruction corresponds to a set of navigation directions starting from the location of the first electronic device when the change of context information occurs as described above. In some embodiments, before the change of context information occurs, the second location included in the second navigation instruction is the same as the second location included in the first navigation instruction. Automatically displaying the second navigation instruction of the second transportation mode to the same location avoids additional interactions between the user and the first electronic device associated with the change of the input transportation mode when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0232] In some embodiments, the first option for initiating navigation according to the first transportation mode includes first navigation instructions from the first location to the second location, such as initiating navigation from the first location using the driving transportation mode. Figure 6C The current location 624 of the first electronic device 500a in Fig.6D , and the second option for initiating navigation according to the second transportation mode includes a second navigation instruction from a third location to a fourth location, the third location being different from the first location, such as initiating navigation from the location of the first electronic device 500a when the change in contextual information is detected to the location of the first electronic device 500a when the change in contextual information is detected using a walking transportation mode. Fig.6D . As used herein, the second navigation presentation optionally provides a second navigation direction from a third position (e.g., a position of the first electronic device different from the first position when a change in context information occurs) to a fourth position associated with a specified destination (e.g., an end position specified before a change in context information is detected). In some embodiments, the first position is a starting position using a first traffic mode, and the second position is an end position using the first traffic mode. In some embodiments, when the first electronic device detects a change in context information, the first electronic device calculates a route using the second traffic mode. In some embodiments, the calculated route using the second traffic mode includes a second navigation instruction that guides a user using the second traffic mode from another starting position (e.g., a third position) different from the starting position (e.g., the first position) using the first traffic mode. In some embodiments, the third position is the current position of the first electronic device when the context changes. In some embodiments, the fourth position is the same as the second position. In some embodiments, the fourth position is different from the second position. In some embodiments, the first electronic device identifies one or more changes based on the traffic mode (e.g., recommendations that make navigating along a route or navigating to a specified destination easier, more efficient, or viewing attractions or locations of interest). For example, when the second traffic mode corresponds to a motor vehicle, the fourth location proposed or recommended by the first electronic device is optionally a parking garage with an electronic vehicle charging station near the specified destination, rather than the second location corresponding to the street address of the specified destination. Automatically displaying the second navigation instructions for the second traffic mode from the location of the first electronic device when a change in contextual information is detected avoids additional interactions between the user and the first electronic device associated with inputting changes in traffic modes when a seamless transition between traffic modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0233] In some embodiments, in response to a request from a first location (such as from Figure 6CIn some embodiments, the first navigation instruction includes a first user input corresponding to a request to navigate to the current location 624 of the first electronic device 500a in the context information, the first navigation instruction including the first location. In some embodiments, the first location is the current location of the first electronic device. In some embodiments, the first location is a user-specified location other than the current location of the first electronic device. In some embodiments, the second navigation instruction includes a third location without receiving a request to navigate from the third location (such as the location of the first electronic device 500a when a change in context information is detected, such as Fig.6D In some embodiments, the first electronic device displays the first navigation instruction in response to the first user input (for example, in response to the interaction with the navigation user interface). In some embodiments, the first electronic device presents the second navigation instruction independently of or not in response to the interaction with the navigation user interface. As described above, in some embodiments, according to one or more criteria satisfied, the first electronic device operates according to the second traffic mode. In some embodiments, the one or more criteria satisfied are independent of receiving the input corresponding to the request to operate according to the second traffic mode. In some embodiments, the first electronic device changes from operating according to the first traffic mode to operating according to the second traffic mode without receiving the user input corresponding to the request to operate according to the second traffic mode. In some embodiments, the third position is the position of the first electronic device when one or more criteria are met. Automatically displaying the second navigation instruction of the second traffic mode from the position of the first electronic device when a change in contextual information is detected without receiving user input avoids additional interaction between the user and the first electronic device associated with the change in the input traffic mode when a seamless transition between desired traffic modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0234] In some embodiments, before operating according to the first transportation mode or the second transportation mode (and / or when navigation along the route does not occur), the first electronic device (e.g., 500a) receives input corresponding to a request to navigate to the first location via one or more sensors, such as causing the first electronic device (e.g., 500a) to initiate a process for providing navigation instructions according to the first transportation mode or the second transportation mode. In some embodiments, one or more sensors generate sensor input data related to the movement or acceleration of the first electronic device, and the sensor input data indicates an activity in which the user is engaged, such as driving or riding a motor vehicle, riding, walking, or running. In some embodiments, the sensor input data represents an environmental or usage change of the first electronic device. The sensor input data optionally includes other types of data as described below. In some embodiments, the input received via one or more sensors causes the first electronic device to initiate a process for providing navigation instructions from the current location of the first electronic device to the first location according to the first transportation mode. In some embodiments, input corresponding to a request to navigate to a first location is received by a first electronic device via one or more input devices (e.g., a mobile device (e.g., a tablet computer, smart phone, media player, or wearable device), a computer (e.g., a desktop computer, a laptop computer), or a wearable device (e.g., a watch, a head-mounted device), which optionally communicates with one or more of a mouse (e.g., external), a trackpad (optionally integrated or external), a remote control device (e.g., external), another mobile device (e.g., separate from the first electronic device), a handheld device (e.g., external), and / or a controller (e.g., external, etc.)) or a set-top box that communicates with one or more input devices (e.g., a remote control device. For example, the first electronic device detects input pointing to a navigation user interface corresponding to a request to navigate to a first location via one or more input devices.
[0235] In some embodiments, in response to input corresponding to a request to navigate to the first location, the first electronic device operates according to the first transportation mode, wherein operating according to the second transportation mode includes operating according to the second transportation mode for the remainder of the route to the first location, such as before navigating from the first location according to the second transportation mode. Figure 6C The driving traffic mode in the Fig.6DThe first electronic device operates as shown in the walking transportation mode shown without receiving user input for converting the remaining portion of the route to the first location to the walking transportation mode. For example, navigating along the route for the remaining portion of the route to the first location includes recalculating the remaining portion of the route that has not yet been traveled from the location of the first electronic device when a change in context information occurs for the first location using the second transportation mode. In some embodiments, the first electronic device continues to monitor the context information and / or route information (e.g., traffic conditions and / or road conditions) for the remaining portion of the route and presents recommendations for the remaining portion of the route or automatically changes the remaining portion of the route and / or operates according to another transportation mode different from the second transportation mode. Automatically displaying the second navigation instructions for the remaining portion of the route according to the second transportation mode from the location of the first electronic device when the change in context information is detected without receiving user input avoids additional interactions between the user and the first electronic device associated with the change in the input transportation mode when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0236] In some embodiments, before operating according to the first transportation mode or the second transportation mode (and / or when navigation along the route does not occur), the first electronic device receives input corresponding to a request to navigate to the first location via one or more sensors. In some embodiments, the one or more sensors generate sensor input data as described below. In some embodiments, the input received via the one or more sensors causes the first electronic device to initiate a process for providing navigation instructions from the current location of the first electronic device to the first location according to the first transportation mode. In some embodiments, the first electronic device detects input pointing to a navigation user interface corresponding to the request to navigate to the first location via one or more input devices.
[0237] In some embodiments, in response to input corresponding to a request to navigate to a first location, the first electronic device operates according to the first transportation mode, wherein one or more second criteria are satisfied based on a determination that the one or more second criteria include a criterion that is satisfied when operating according to the second transportation mode is for a remainder of the route that is less than the first location. In some embodiments, the first electronic device ceases to operate according to the second transportation mode and operates according to a third transportation mode that is different from the second transportation mode, such as Figure 6H As shown, it is not recommended to operate according to the cycling traffic mode for the remaining portion of the route, and in response, the first electronic device 500a stops operating according to the second traffic mode and instead operates according to Fig. 6EIn some embodiments, the first electronic device is operated according to the pedestrian traffic mode shown. In some embodiments, the third traffic mode is the same as the first traffic mode. In some embodiments, the third traffic mode is different from the first traffic mode. In some embodiments, the one or more second criteria satisfied are independent of receiving an input corresponding to a request to operate according to the third traffic mode. In some embodiments, the first electronic device changes from operating according to the second traffic mode to operating according to the third traffic mode without receiving a user input corresponding to a request to operate according to the third traffic mode. In some embodiments, the first electronic device determines that operating according to the second traffic mode is for the remainder of the route less than the first location by analyzing the route to determine the interruption of using the second traffic mode. For example, when the second traffic mode corresponds to a bicycle, the first electronic device determines that when there is no bicycle lane, when bicycles are prohibited from entering (e.g., pedestrian-only area) or when there is a steep slope, some bicycles stop riding. Therefore, in some embodiments, the first electronic device calculates the interruption of using the second traffic mode and presents operating according to the third traffic mode. In some embodiments, one or more second criteria include criteria satisfied when the change of context information indicates the start of the third traffic mode as described above. Determining that when operation according to the second transportation mode is for less than the remainder of the route, automatically operating according to the third transportation mode from the location of the first electronic device without receiving user input avoids additional interaction between the user and the first electronic device associated with a change in the input transportation mode when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0238] In some embodiments, the first electronic device (e.g., 500a) operates according to the third traffic mode without receiving a first user input corresponding to a request to operate according to the third traffic mode, such as when receiving a request from a user to operate according to the third traffic mode. Fig. 6E The pedestrian traffic mode in Fig. 6F In some embodiments, the first electronic device initiates operation according to the third transportation mode independently of or in response to interaction with the navigation user interface. In some embodiments, the first electronic device operates according to the third transportation mode based on one or more second criteria being satisfied, as described above. Automatically operating according to the third transportation mode without receiving user input avoids additional interactions between the user and the first electronic device associated with changes in the input transportation mode when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0239] In some embodiments, before operating according to the second transportation mode, the first electronic device includes a request for the remaining portion of the route (such as Figure 6H ), operating according to a fourth traffic mode different from the third traffic mode, wherein the first electronic device 500a is operating according to the cycling traffic as initially set, until an upcoming context change (e.g., an environmental change) is detected, as shown in content 668, which indicates taking stairs. In response, the first electronic device 500a initiates navigation instructions for a walking traffic mode that is different from the cycling traffic mode initially set. In some embodiments, the fourth traffic mode is the same as the first traffic mode. In some embodiments, the fourth traffic mode is different from the first traffic mode. In some embodiments, the fourth traffic mode is the same as the second traffic mode. In some embodiments, the fourth traffic mode is different from the second traffic mode. In some embodiments, the first electronic device initially specifies the fourth traffic mode for the route before stopping operating according to the second traffic mode. In some embodiments, the fourth traffic mode is automatically selected by the first electronic device based on determining that one or more criteria are satisfied as described above. For example, the first electronic device optionally does not receive a user input corresponding to a request to operate according to the fourth traffic mode. In some embodiments, as will be described below, the first electronic device is configured to prompt the user to accept the third traffic mode for the remainder of the route when navigation according to the fourth traffic mode has already begun. Automatically canceling plans to operate according to the fourth transportation mode and instead initiating operation according to the third transportation mode without receiving user input avoids additional interactions between the user and the first electronic device associated with a change in input transportation mode when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0240] In some embodiments, the contextual information includes a number of steps taken by a user associated with the first electronic device within a predefined time period, such as in the example pedometer device 612. Figure 6BIn some embodiments, the first electronic device uses a built-in pedometer or step counter to determine the traffic mode. For example, the pedometer counts the number of steps taken by the user in a predefined time duration (e.g., 3 seconds, 5 seconds, 10 seconds, 15 seconds, 20 seconds, 30 seconds, 40 seconds, 60 seconds, or 2 minutes), and then the first electronic device compares the number of steps with a specified threshold and determines the user's movement as walking, riding, riding a motor vehicle, or riding public transportation. In some embodiments, the movement of the user is detected with a pedometer, but other types of sensors as described below can also be used. For example, based on determining that the user's pace rate increases from a rate corresponding to not walking to a rate corresponding to walking, the first electronic device is converted to provide walking navigation directions. Using an ultra-low power consumption device (such as a pedometer) to determine the traffic mode without receiving user input avoids additional interactions between the user and the first electronic device associated with changes in the input traffic mode when seamless transitions between desired traffic modes are desired, thereby reducing errors in the interaction between the user and the first electronic device, reducing the input required to correct such errors, and shortening the battery life required to interact with various user interfaces.
[0241] In some embodiments, the first electronic device detects a change in context information based on determining that the number of steps taken within a predefined time period satisfies one or more second criteria, such as in example block 606. Fig. 6A For example, the one or more second criteria include a criterion that is satisfied when the number of steps taken within a predefined time duration increases or decreases by more than a predetermined amount (e.g., 15 steps, 30 steps, 50 steps, 75 steps, 100 steps, 125 steps, 150 steps, 200 steps, 250 steps, 300 steps, or 500 steps). In some embodiments, the first electronic device calculates the correlation between the number of steps and the second context information, such as in example block 604. Fig. 6A In some embodiments, the first electronic device compares the correlation between the number of steps and the second context information with a predefined threshold, such as in example block 606. Fig. 6AIn some embodiments, the second context information includes GPS data, motion data, altitude information, positioning information, rotation rate, acceleration data measured by a motion sensor (e.g., an accelerometer and / or a gyroscope), information related to whether the first electronic device is connected to or disconnected from Bluetooth (e.g., for use with an in-vehicle user interface display or a wearable device such as a watch), and location information from a third-party application (e.g., ride-sharing, bicycle / scooter rental, or social media). In some embodiments, the first electronic device considers the correlation between the number of steps and the second context information, and when the correlation is above a predefined threshold (e.g., a confidence predefined threshold: 70%, 73%, 75%, 77%, 80%, 83%, 85%, 87%, 90%, 93%, 95%, 97%, or 100%), the determined traffic mode is accepted and / or assigned a first confidence value. When the correlation is below a predefined threshold, the determined traffic mode is optionally rejected and / or assigned a second confidence value that is lower than the first confidence value. In some embodiments, the determined traffic mode with the first confidence value is presented by the first electronic device. Utilizing one or more other data points from one or more other sensors to determine the traffic mode without receiving user input avoids additional interactions between the user and the first electronic device associated with changes in the input traffic mode when seamless transitions between traffic modes are desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0242] In some embodiments, the first option for initiating navigation according to the first transportation mode includes enabling interaction to access one or more first functions of the first electronic device (such as Fig. 6E For example, in some embodiments, the second option for initiating navigation according to the second transportation mode does not include one or more first user interface elements that are not available for the driving transportation mode, such as Fig. 6EImmersive augmented reality 644 functions shown. In some embodiments, the second navigation presentation includes one or more second user interface elements that are not included in the first navigation presentation. In some embodiments, when the first traffic mode corresponds to a motor vehicle, one or more first functions include an in-vehicle user interface display, zoom in and out map views, turn-by-turn navigation directions, traffic conditions, and / or estimated travel time. In some embodiments, the second traffic mode corresponding to walking does not include one or more first functions associated with the first traffic mode. For example, the second traffic mode includes one or more second functions different from one or more first functions, such as immersive walking directions, three-dimensional map views, and / or step-by-step walking directions shown in augmented reality. In some embodiments, when the traffic mode corresponds to cycling, one or more functions include ride height, information about whether a segment of the route includes a bicycle lane, information about how busy the street is, information about whether there are stairs, steep slopes, or bicycle racks along the route, and / or voice-guided cycling directions. In some embodiments, when the traffic mode corresponds to public transportation, one or more functions include the location of bus stops, entry and exit information, and / or real-time bus information, including bus schedules, departure and arrival times, connection information, and outages. Automatically displaying a first option for initiating navigation according to a first transportation mode having one or more first functions that are different from functions associated with a transportation mode that is different from the first transportation mode (e.g., a second transportation mode) in response to a change in contextual information indicating start of the first transportation mode avoids additional interactions between the user and the first electronic device associated with changes in input transportation modes when a seamless transition between transportation modes is desired, thereby reducing errors in the interactions between the user and the first electronic device and reducing input required to correct such errors.
[0243] In some embodiments, the second option for initiating navigation according to the second traffic mode includes a second navigation instruction from the first location to the second location. In some embodiments, the first electronic device displays a representation of the layout of the space and one or more routes to the second location in the space via a display generation component. For example, the representation of the layout of the space includes a special indoor map that is edited to provide content specific to the space (e.g., a shopping mall, museum, conference hall, entertainment venue, park, amphitheater, or festival), including elements within the space (e.g., restrooms, parking spots, vehicle charging stations, canteens, dining areas, information desks or trailheads, entrances and exits, bicycle trails, or scenic spots of interest). In some embodiments, the first electronic device identifies one or more changes based on content specific to the space and / or traffic mode (e.g., recommendations that make it easier, more efficient, or to view attractions or locations of interest along the way) . For example, when the second transportation mode corresponds to walking, the second location within the space proposed or recommended by the first electronic device is optionally "shopping center entrance C" closer to the specified destination (e.g., a specific store in a shopping center), rather than a location corresponding to the street address of the specific store. In another example, when the second transportation mode corresponds to cycling, the second location within the space proposed or recommended by the first electronic device is optionally "blue bike trail start", which is one of several bike trails at the specified destination (e.g., a national park), rather than a location corresponding to the street address of the national park. In some embodiments, the first option for initiating navigation according to the first transportation mode does not include a representation of the layout of the display space. In some embodiments, the first navigation presentation includes a representation of the display space, which includes less detail than the representation of the layout of the space displayed as part of the second navigation presentation. Utilizing a representation of the layout of the space to determine a more accurate second location according to the transportation mode without receiving user input avoids additional interactions between the user and the first electronic device associated with changes in the input transportation mode when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0244] In some embodiments, the first option for initiating navigation according to the first transportation mode includes a first navigation instruction from the first location to the second location. In some embodiments, when navigating along the route from the first location to the second location, the first electronic device displays an instruction to change the first electronic device from ceasing to operate according to the first transportation mode to operating according to the second transportation mode, such as Fig. 6FContent 656c shown. In some embodiments, an indication of the change is presented before the first electronic device operates according to the second traffic mode. In some embodiments, the indication includes a graphic image and / or a text description describing the second traffic mode. In some embodiments, the indication includes prompting the user to accept or refuse to stop operating according to the first traffic mode and instead operate according to the second traffic mode. In some embodiments, the first electronic device automatically changes to operate according to the second traffic mode after a period of time (e.g., 5 seconds, 10 seconds, 15 seconds, 20 seconds, 25 seconds, 30 seconds, 35 seconds, or 40 seconds). Automatically displaying an indication that the first electronic device will change to operate according to the second traffic mode from the position of the first electronic device when a change in contextual information is detected without receiving user input avoids additional interactions between the user and the first electronic device associated with the change in the input traffic mode when a seamless transition between traffic modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors by providing improved visual feedback to the user.
[0245] In some embodiments, when operating according to the first transportation mode, the upcoming route characteristics are determined to satisfy one or more second criteria (such as including Figure 6HThe first electronic device operates according to the first transportation mode without displaying multiple options for initiating navigation according to multiple corresponding transportation modes different from the second transportation mode, such as when operating according to the walking transportation mode, the first electronic device does not present transportation modes other than walking because the user can navigate the stairs using the walking transportation mode. For example, the one or more second criteria include criteria that are satisfied when the upcoming route characteristics involve traffic that indicates stopping to operate according to the first transportation mode, bus times, bicycle or scooter rental availability, path accessibility, user preferences (e.g., avoiding hills, avoiding tolls, etc.). In some embodiments, when operating according to the first transportation mode, multiple options for initiating navigation according to multiple corresponding transportation modes different from the first transportation mode (e.g., including the second transportation mode) are displayed via the display generation component. In some embodiments, the first electronic device optionally presents an option for initiating navigation from a location within a predetermined distance (e.g., 3 miles, 5 miles, 7 miles, 10 miles, 13 miles, 15 miles, 17 miles, 20 miles, or 25 miles) from the first electronic device to an upcoming route characteristic that satisfies one or more second criteria according to a plurality of corresponding transportation modes for display. As used herein, the first transportation mode optionally refers to cycling. In some embodiments, the first electronic device presents a walking transportation mode along the route while operating according to a bicycle transportation mode in response to determining that the upcoming route characteristic (e.g., a steep slope). In some embodiments, continuing to operate in the first transportation mode includes continuing to display a first navigation user interface via a display generation component, the first navigation user interface including a first option for initiating navigation according to the first transportation mode. For example, if the upcoming route characteristic involves a medium hill, the upcoming route characteristic does not indicate the presentation of an alternative transportation mode different from the first transportation mode (e.g., multiple options for initiating navigation according to a plurality of corresponding transportation modes). Automatically displaying multiple options for initiating navigation according to multiple respective transportation modes in response to an upcoming route feature that indicates stopping operation according to a first transportation mode avoids additional interactions between the user and the first electronic device associated with inputting a change in transportation mode when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0246] In some embodiments, when operating according to the first transportation mode, the upcoming route characteristics are determined to satisfy one or more second criteria (such as including Figure 6HThe first electronic device detects a second change in the context information via one or more sensors when operating according to the first transportation mode, such as in addition to Figure 6C In addition to detecting that the first electronic device has been disconnected from the second electronic device, the first electronic device also detects an increase in the user's heart rate, which may indicate an activity such as walking. For example, the first electronic device detects a change in contextual information as described above. In some embodiments, the second change in contextual information corresponds to a change in a physiological characteristic (e.g., heart rate, temperature, and / or breathing rate) of the user captured or detected by the first electronic device and / or the second electronic device (such as a wearable device (e.g., a watch). In some embodiments, in response to detecting a second change in contextual information (e.g., 604), such as in Fig. 6A In the embodiment of the present invention, based on determining that one or more criteria are satisfied, the one or more criteria include a second criterion that is satisfied when the second change in the context information indicates the beginning of a transportation mode different from the first transportation mode, such as movement of the first electronic device indicating walking, when operating according to the first transportation mode, the first electronic device (e.g., 500a) displays, via a display generation component, a plurality of options for initiating navigation according to a plurality of corresponding transportation modes different from the second transportation mode, such as Fig.6D . For example, if the change in the physiological characteristic corresponds to a high cardiovascular fatigue, the change in the physiological characteristic optionally indicates to stop operating according to the second traffic mode (e.g., riding), and instead present or recommend one or more traffic modes different from the second traffic mode to the user (e.g., walking or taking public transportation). In some embodiments, the first electronic device automatically changes from operating according to the first traffic mode to operating according to a traffic mode different from the first traffic mode in response to satisfying one or more criteria. For example, as a result of the user not experiencing high cardiovascular fatigue, the user changes from riding public transportation to riding, for which the first electronic device optionally stops operating according to the public transportation mode to the riding traffic mode. In some embodiments, when a second change in contextual information occurs, the first electronic device optionally presents an option from the location of the first electronic device for display. As used herein, the first traffic mode optionally refers to riding. In some embodiments, when operating according to the bicycle traffic mode, the first electronic device presents a walking traffic mode in response to determining that the second change in contextual information indicates the start of a traffic mode different from the first traffic mode.
[0247] In some embodiments, based on determining (e.g., 606) that one or more criteria are not satisfied, such as in Fig. 6AIn the embodiment of the present invention, the first electronic device (e.g., 500a) continues to operate according to the second transportation mode without displaying multiple options for initiating navigation according to multiple corresponding transportation modes different from the second transportation mode, such as continuing to present the options when the movement of the first electronic device (e.g., 500a) is determined to be minimal and insufficient to indicate initiating navigation according to a transportation mode different from driving. Figure 6C Navigation instructions for the driving traffic mode shown. In some embodiments, continuing to operate in the first traffic mode includes continuing to display, via a display generation component, a first navigation user interface that includes a first option for initiating navigation according to the first traffic mode. For example, if the second change in contextual information corresponds to the absence of cardiovascular fatigue, the first electronic device optionally does not present or suggest an alternative traffic mode that is different from the second traffic mode (e.g., multiple options for initiating navigation according to multiple corresponding traffic modes) or operates according to the alternative traffic mode. Automatically displaying multiple options for initiating navigation according to multiple corresponding traffic modes in response to a second change in contextual information that indicates stopping operating according to the first traffic mode avoids additional interactions between the user and the first electronic device associated with changes in the input traffic mode when a seamless transition between traffic modes is desired, thereby reducing errors in the interaction between the user and the first electronic device, reducing the input required to correct such errors, and reducing avoidable user injuries.
[0248] In some embodiments, the plurality of options for initiating navigation according to the plurality of respective modes of transportation include respective estimated times for reaching the second location, such as Figure 6G 666. For example, the first electronic device optionally displays a navigation user interface element, which includes an estimated arrival time for reaching the second location using a corresponding traffic mode in a plurality of corresponding traffic modes. In some embodiments, the corresponding traffic modes are listed in order based on the earliest time to reach the second location. In some embodiments, the recommended traffic mode is listed first in the list. In some embodiments, the recommended traffic mode is based on one or more characteristics related to traffic, bus time, bicycle or scooter rental availability, path accessibility, user preferences (e.g., avoiding hills, avoiding tolls, etc.). For example, the mode with the fastest estimated arrival time is listed first in the user interface. In response to the upcoming route characteristics indicating that the operation according to the first traffic mode is stopped, the corresponding estimated time for reaching the second location is automatically displayed according to a plurality of options for initiating navigation according to a plurality of corresponding traffic modes. When a seamless transition between desired traffic modes is avoided, additional interactions between the user and the first electronic device associated with the change of the input traffic mode are avoided, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0249] In some embodiments, before operating according to the first transportation mode or the second transportation mode (and / or when navigation along the route does not occur), the first electronic device (e.g., 500a) receives an input sequence corresponding to a request to navigate to the first location using the first transportation mode and the second transportation mode (such as using public transportation and riding) via one or more input devices. In some embodiments, in response to the input sequence corresponding to the request to navigate to the first location using the first transportation mode and the second transportation mode, the first electronic device (e.g., 500a) operates according to the first transportation mode for the first segment of the route to the first location, wherein the operation according to the second transportation mode includes operating according to the second transportation mode for the second segment of the route to the first location, such as using public transportation for the first segment of the route and riding for the second segment of the route. In some embodiments, the user provides the input sequence using the navigation user interface of the mapping application. In some embodiments, the user provides the input sequence using the system user interface of the first electronic device (e.g., a voice assistant). In some embodiments, before starting to navigate along the route from the starting location of the route to the first location or during navigation, a sequence of one or more inputs is received. In some embodiments, the first segment of the route corresponds to the first one or more directions to the first location using the first transportation mode. In some embodiments, the second segment of the route corresponds to the second one or more directions to the first location using the second traffic mode. In some embodiments, the change from operating according to the first traffic mode to operating according to the second traffic mode causes the first electronic device to change the navigation user interface as described above. In some embodiments, when operating according to the second traffic mode for the second segment of the route to the first location, the first electronic device receives a user input indicating the location of the first electronic device. In some embodiments, the first electronic device presents one or more recommended second segments of the route to the first location using the second traffic mode. In some embodiments, the one or more recommended second segments of the route to the first location using the second traffic mode include a set of corresponding navigation directions from the corresponding location of the first electronic device when it is predicted that the operation according to the second traffic mode will occur. For example, the location optionally corresponds to a carpool or taxi area, a bicycle rental pick-up area, a ferry or a public transportation station at an airport. Providing a component for operating the first electronic device according to more than one traffic mode to the same location avoids additional interactions between the user and the first electronic device associated with the change of the input traffic mode when a seamless transition between the desired traffic modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0250] In some embodiments, the first option for initiating navigation according to the first transportation mode includes a first route from the first location to the second location. In some embodiments, the first navigation presentation also includes another route from a third location (e.g., the starting location of the navigation) to the first location. In some embodiments, the first location is the location where the first electronic device detects a change in contextual information. In some embodiments, the second option for initiating navigation according to the second transportation mode includes a second route from the first location to the second location that is different from the first route, such as a walking navigation direction including a first route from the current location of the first electronic device to a specific entrance that is within walking distance, such as Fig.6D In contrast, Fig. 6F The riding navigation directions shown include a second route from the current location of the first electronic device to the bicycle parking lot where the user's bicycle is parked. In some embodiments, the first electronic device optionally presents multiple options for initiating navigation for display, the multiple options including a first option and a second option using a corresponding route from the first location to the second location. In some embodiments, the second route using the second traffic mode includes an estimated time to reach the second location faster than the first route using the first traffic mode. In some embodiments, the second route using the second traffic mode includes an estimated time to reach the second location later than the first route using the first traffic mode. In some embodiments, the first electronic device presents different route characteristics and / or display elements based on the traffic mode as described above. Automatically displaying multiple options for initiating navigation according to a plurality of corresponding traffic modes in response to changes in contextual information avoids additional interactions between the user and the first electronic device associated with changes in the input traffic mode when seamless transitions between desired traffic modes are desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0251] In some embodiments, such as Figure 6BIn some embodiments, the context information includes detecting that the user leaves a motor vehicle (e.g., 618) that communicates with the first electronic device (e.g., 500a). In some embodiments, the context information corresponds to a motion activity, and the first electronic device determines when the first electronic device enters and leaves the car. For example, the first electronic device optionally determines that the first electronic device has left the motor vehicle based on determining that the first electronic device has changed from a stationary state (e.g., placed in a device holder in a motor vehicle or on the device holder) to an active state (e.g., a change in positioning and / or movement caused by leaving the motor vehicle). In some embodiments, the context information is based on one or more inputs other than the motion activity (e.g., a first electronic device connection to a motor vehicle computer). For example, the absence of a Bluetooth connection to a motor vehicle computer is optionally used as context information for leaving the determination. In some embodiments, the first electronic device is configured to present different navigation user interfaces based on the traffic mode as described above. Detecting leaving the motor vehicle to determine the traffic mode without receiving user input avoids additional interactions between the user and the first electronic device associated with changes in the input traffic mode when a seamless transition between traffic modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0252] In some embodiments, such as Figure 6B In the context information, the context information includes detecting that the user enters a motor vehicle (e.g., 618) that communicates with the first electronic device (e.g., 500a). For example, the first electronic device optionally determines that the first electronic device has entered the motor vehicle based on determining that the first electronic device has changed from an active state (e.g., a change in positioning and / or movement caused by walking) to a stationary state (e.g., placed in a device holder in the motor vehicle or on the device holder). In some embodiments, the context information is based on one or more inputs other than the motion activity as described above. For example, a Bluetooth connection to a motor vehicle computer is optionally used as context information for entering the determination. In some embodiments, the first electronic device is configured to present different navigation user interfaces based on the traffic mode as described above. Detecting entry into a motor vehicle to determine the traffic mode without receiving user input avoids additional interactions between the user and the first electronic device associated with changes in the input traffic mode when a seamless transition between traffic modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0253] In some embodiments, such as Figure 6BIn some embodiments, the context information includes detecting one or more aspects of the external environment of a motor vehicle communicating with the first electronic device (e.g., 500a) (e.g., using sensor device 616). In some embodiments, the context information corresponds to a scenic environment, landmark, point of interest, traffic, or weather captured by one or more motor vehicle sensors (such as a camera device that captures the external environment). For example, the first electronic device optionally determines context information including sunrise or sunset, and in response, the first electronic device optionally uses a pedestrian traffic mode to present a navigation user interface including one or more routes to view the external environment. In some embodiments, the first electronic device is configured to present different navigation user interfaces based on the traffic mode as described above. Detecting one or more aspects of the external environment that the user may be interested in to determine the traffic mode without receiving user input avoids additional interactions between the user and the first electronic device associated with changes in the input traffic mode when a seamless transition between traffic modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0254] In some embodiments, such as Figure 6B In the context information, the context information includes detecting one or more characteristics of the user (e.g., using the sensor device 616 and / or the pedometer device (e.g., 612) of the first electronic device (e.g., 500a)). For example, the one or more characteristics of the user include one or more physiological characteristics described above. In some embodiments, the first electronic device detects a potential state of attention (e.g., drowsiness, distraction, or tension) of the user while using a transportation mode (e.g., walking, bicycling, or driving). For example, when the first electronic device detects whether the user is driving in a potential state of attention based on information from one or more sensors of the first electronic device, the second electronic device (such as a wearable device (e.g., a watch)), and / or a motor vehicle, the first electronic device is configured in response to the detection to stop operating according to the operating mode when one or more characteristics indicating the user's potential state of attention are detected, and alternatively, optionally operate according to another transportation mode different from the transportation mode (e.g., walking). In some embodiments, the first electronic device is configured to present different navigation user interfaces based on the transportation mode as described above. Detecting one or more characteristics of a user of the first electronic device to determine a traffic mode without receiving user input avoids additional interactions between the user and the first electronic device associated with changes in input traffic modes when a seamless transition between traffic modes is desired, thereby reducing errors in the interaction between the user and the first electronic device, reducing the input required to correct such errors, and reducing avoidable user injuries.
[0255] In some embodiments, when operating according to the first transportation mode, the first electronic device transmits one or more instructions to a second electronic device different from the first electronic device so that the second electronic device displays a first navigation interface, the first navigation interface including a first option for initiating navigation according to the first transportation mode, such as the first electronic device 500a is configured to stream or share navigation instructions for presentation on the second electronic device 500b, such as Figure 6C As shown. In some embodiments, the first electronic device is configured to provide navigation data (e.g., route data and / or navigation directions) to one or more external devices (e.g., a second electronic device) or displays for presentation on the one or more external devices or displays. The one or more external devices or displays include a watch device, a head-mounted device, or a motor vehicle display. In some embodiments, the first electronic device and the one or more external devices or displays are configured to present different navigation user interfaces based on the traffic mode as described above. Automatically displaying a first option for initiating navigation to the second electronic device in response to a change in contextual information avoids additional interactions between the user and the first electronic device associated with changes in the input traffic mode when a seamless transition between traffic modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0256] In some embodiments, such as Fig. 6A In some embodiments, when the first navigation user interface is displayed, the first electronic device (e.g., 500a) detects a second change in the context information (e.g., 604) via one or more sensors. For example, the first electronic device detects the second change in the context information. In some embodiments, in response to detecting the second change in the context information (e.g., 604), such as in Fig. 6A In the embodiment, according to determining that one or more criteria are satisfied, the one or more criteria include when the first electronic device is not communicating with the second electronic device (such as Figure 6C The first electronic device (e.g., 500a) stops operating according to the first traffic mode and operates according to a third traffic mode (e.g., 608) (such as in Fig. 6A In, such as Fig. 6A626 in the figure. For example, if the first electronic device changes from not communicating with the second electronic device (e.g., a watch, a head-mounted device, or a motor vehicle display device) to communicating with the second electronic device, the change optionally indicates that the operation according to the first traffic mode is stopped, and instead, the operation according to a third traffic mode different from the first traffic mode is performed. In some embodiments, the third traffic mode is associated with the second electronic device that communicates with the first electronic device. For example, when the electronic device communicates with the motor vehicle display device, the third traffic mode optionally corresponds to driving. In some embodiments, the second electronic device corresponds to a carpooling system, a bicycle or scooter rental system, or a public transportation information system. For example, when the electronic device communicates with the public transportation information system, the third traffic mode optionally corresponds to using public transportation. In some embodiments, detecting that the first electronic device communicates with the second electronic device is used as a confirmation of operating according to the third traffic mode. Detecting whether the first electronic device communicates with the second electronic device to determine the traffic mode without receiving user input avoids additional interactions between the user and the first electronic device associated with changes in the input traffic mode when seamless transitions between desired traffic modes are desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0257] In some embodiments, according to determining that the first group of traffic modes is selected as available by the user of the first electronic device, the second traffic mode is a traffic mode in the first group of traffic modes. For example, the traffic modes that the user wants or prefers to use constitute the first group of traffic modes selected by the user. In some embodiments, each traffic mode in the first group corresponds to a different traffic mode and is optionally characterized by one or more parameters set by the user. For example, the one or more parameters include avoiding tolls, highways, riding on a path without a bicycle lane, and / or walking in the direction against the traffic. In some embodiments, according to determining that the second group of traffic modes different from the first group of traffic modes is selected as available by the user of the first electronic device, the second traffic mode is a traffic mode in the second group of traffic modes. For example, the traffic mode that the user does not want to use constitutes the second group of traffic modes selected by the user. In some embodiments, the electronic device is not configured to operate according to the traffic mode in the second group of traffic modes. In some embodiments, the electronic device does not detect context information related to the traffic mode in the second group of traffic modes. Detecting whether the second transportation mode is listed in the first set of transportation modes or the second set of transportation modes to determine the transportation mode without receiving user input avoids additional interactions between the user and the first electronic device associated with changes in the input transportation mode when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0258] In some embodiments, when operating according to the first transportation mode, the first electronic device detects second context information (e.g., 604) via one or more sensors, such as in Fig. 6A For example, the second context information is described above. In some embodiments, in response to detecting the second context information (e.g., 604), such as in Fig. 6AIn the embodiment, according to determining that one or more criteria are satisfied, the one or more criteria include a second criterion satisfied when the second context information indicates the start of a third traffic mode different from the first traffic mode, the first electronic device stops operating according to the first traffic mode and operates according to the third traffic mode (e.g., 608). For example, if the amount of change between the second speed and the third speed of the electronic device using the first traffic mode is greater than the above-mentioned first threshold amount, the amount of change optionally indicates the start of the third traffic mode. Other indications of starting another traffic mode (e.g., the third traffic mode) as described above (or initiating the start of the other traffic mode). In some embodiments, the first electronic device detects changes in context information without detecting user input. For example, detecting user input is not part of determining that one or more criteria are satisfied, including when the change in context information indicates a change from operating according to the first traffic mode to operating according to the third traffic mode. In some embodiments, the first electronic device detects changes in context information without detecting user input corresponding to a request to change from the first traffic mode to the third traffic mode. In some embodiments, the first electronic device continues to monitor context information to automatically operate according to a third traffic mode different from the first traffic mode. In some embodiments, the third traffic mode corresponds to the second traffic mode. In some embodiments, the third transportation mode is different from the second transportation mode. Automatically operating according to the third transportation mode in response to a change in context information indicating the start of the third transportation mode avoids additional interactions between the user and the first electronic device associated with inputting a change in the transportation mode when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing input required to correct such errors.
[0259] It should be understood that Figure 7 The specific order in which the operations in the description are described is merely exemplary and is not intended to indicate that the described order is the only order in which the operations may be performed. A person of ordinary skill in the art will recognize many ways to reorder the operations described herein. Additionally, it should be noted that the details of other processes described herein with respect to other methods described herein (e.g., method 900) also apply in a similar manner to the details of the above description of Figure 7 For example, the operation of the electronic device to change the transportation mode according to the change of the context information described above with reference to method 700 optionally has one or more of the characteristics of the presentation of a route planning user interface for planning a route in two or more transportation modes as described herein with reference to other methods described herein (e.g., method 900). For the sake of brevity, these details are not repeated here.
[0260] The operations in the above information processing method are optionally implemented by running one or more functional modules in an information processing device, such as a general-purpose processor (for example, in combination with Figure 1A to Figure 1B , Figure 3 , FIG. 5A to FIG. 5H In addition, the above reference Figure 7 The operation is optionally performed by Figure 1A to Figure 1B . For example, the detection operation 702a, the addition operation 702b, the detection operation 702c and the initiation operation 702e are optionally implemented by the event classifier 170, the event identifier 180 and the event handler 190. The event monitor 171 in the event classifier 170 detects the contact on the touch screen 504, and the event distributor module 174 transmits the event information to the application 136-1. The corresponding event identifier 180 of the application 136-1 compares the event information with the corresponding event definition 186, and determines whether the first contact at the first position on the touch screen corresponds to a predefined event or sub-event, such as the selection of an object on the user interface. When the corresponding predefined event or sub-event is detected, the event identifier 180 activates the event handler 190 associated with the detection of the event or sub-event. The event handler 190 optionally utilizes or calls the data updater 176 or the object updater 177 to update the application internal state 192. In some embodiments, the event handler 190 accesses the corresponding GUI updater 178 to update the content displayed by the application. Similarly, those skilled in the art will clearly know how to update the content displayed by the application based on the GUI updater 178. Figure 1A to Figure 1B The components depicted in the implementation of other processes.
[0261] Adding destinations that use specific modes of transportation to a multi-destination route
[0262] Users interact with electronic devices in a variety of different ways. The embodiments described below provide ways in which an electronic device facilitates adding a destination and specifying a transportation mode for navigating to the added destination in a multi-destination route for navigation directions. Enhanced interaction with the device reduces the amount of time required for a user to perform an operation, thereby reducing the power usage of the device and extending the battery life of a battery-powered device. The ability of an electronic device to add a destination that uses a specific transportation mode to a route provides an efficient way to present information related to the transportation mode, which reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and more efficiently. When a person uses a device, the person is optionally referred to as a user of the device.
[0263] FIG. 8A to FIG. 8Iillustrative manners of configuring a route with multiple destinations and multiple modes of transportation according to some embodiments of the present disclosure. The embodiments in these figures are used to illustrate the process described below, including reference to Fig. 9 The process described.
[0264] Fig. 8A An example of a first electronic device 500a including a touch screen 504a displaying a route configuration user interface of a mapping application is illustrated. In some embodiments, the user interface is used to configure a route from a starting location through multiple intermediate destinations and / or waypoints to a destination location using one or more modes of transportation (e.g., driving, walking, taking public transportation, biking, and / or using a carpool). Fig. 8A For example, the route configuration user interface includes a map 804 that includes a representation of a current location 806 of the first electronic device 500a and a representation of a first destination 808. Fig. 8A Also shown, in some embodiments, the first electronic device 500a includes a user interface element 810a overlaid on the map 804. In some embodiments, the user interface element 810a includes information related to navigating to the first destination according to a first transportation mode (e.g., driving), such as content 810b identifying the destination (e.g., "Fort Funston Beach") and an image 810c of the destination. For example, the user interface element also includes a selectable user interface element 810c that indicates the transportation mode (e.g., driving) and the length of time to reach the first destination (e.g., 22 minutes). In some embodiments, in response to detecting selection of the selectable user interface element 810c, the first electronic device 500a initiates navigation instructions for traversing a route from the current location 806 of the first electronic device 500a to the first destination 808. Fig. 8A In FIG. 8 , electronic device 500a detects selection of selectable user interface element 810c (eg, using contact 812). In response, electronic device 500a updates the Figure 8B The route configuration user interface is shown to include an indication of a route 854 from the current location 806 of the first electronic device 500a and a representation of the first destination 808 on the map 804.
[0265] Figure 8B The electronic device 500 is shown in response to Fig. 8AAn example of updating a user interface based on the input illustrated. For example, the electronic device 500a updates the route configuration user interface to include a user interface element 814a overlaid on the map 804. In some embodiments, the user interface element 814a includes a user interface element 814j, a selectable user interface element 814e, a selectable user interface element 814f, a selectable user interface element 814g, and a user interface element 814h. The user interface element 814j optionally presents route information organized in a list, such as a starting location content item 814b corresponding to the current location 806 of the electronic device and a first destination content item 814c corresponding to the first destination 808. In some embodiments, the listed content items including the starting location content item 814b and the first destination content item include corresponding selectable elements (e.g., 814b' and 814c'), which, when selected, cause the electronic device 500a to move its corresponding content item to rearrange or reorder the route. In some embodiments, the user interface element 814j also includes a selectable user interface element 814d, which, when selected, causes the first electronic device 500a to add a stop or destination to the route. In some embodiments, in response to detecting the selectable user interface element 814e, the first electronic device 500a changes the transportation mode of the navigation direction, as described below. Figure 8B As shown, for example, the user interface element 814e of the traffic mode is set to driving, so that when navigating to the first destination 808 in response to detecting the selection of the selectable user interface element 814h, the driving direction will be presented. In some embodiments, in response to detecting the selection of the selectable user interface element 814f, the first electronic device 500a sets the time to depart from the starting position. In some embodiments, in response to detecting the selection of the selectable user interface element 814g, the first electronic device 500a sets the user's preference for the route, such as avoiding tolls or highways when presenting driving directions, or avoiding hills or busy roads when presenting cycling directions. In some embodiments, the user interface element 814h includes the time length (e.g., 22 minutes) indicating the first destination, the distance to the first destination, and the content indicating the fastest route. For example, the user interface element 814h also includes a selectable user interface element, which, when selected, causes the first electronic device 500a to initiate a navigation instruction for traversing the route.
[0266] In some embodiments, the electronic device 500a adds the second destination to the route. Figure 8B As shown, the user selects (e.g., using contact 816) selectable user interface element 814d, which can be selected to add a destination to the route. In response, the first electronic device 500a updates the Figure 8CThe route configuration user interface is shown to include a user interface element 818a, which includes a user interface element 818b that can be interacted with to enter a destination to be added to the route. Figure 8C As shown, the user inputs (e.g., via a keyboard or voice input) "View Platform" to user interface element 818b, which corresponds to a request to search for locations of destinations to be added that are related to "View Platform". User interface element 818a also includes one or more results of the search request (e.g., 818c, 818d, and 818e), such as Figure 8C In some embodiments, Figure 8C As shown, electronic device 500a updates map 804 to include indications of one or more results of the search request (e.g., 816a, 816b, and 816c). Figure 8C Also shown is the first electronic device 500a detecting a selection of the search result element 818c ("View Platform A") (eg, using contact 820). In response, in some embodiments, the electronic device 500a updates the Fig.8D The route configuration user interface is shown to include a user interface element 814a, which is similar to Figure 8B However, as shown in the route configuration user interface Fig.8D The route configuration user interface shown includes a selected result element 818c, which is shown as the second destination added in, for example, content item 814i. Content item 814i also includes a selectable element 814i', which when selected causes the first electronic device 500a to move content item 814i to rearrange or reorder the route (e.g., content item 814i is set to the first destination, rather than the second destination). In some embodiments, when a destination is added to a route, the first electronic device 500a receives a request to add a segment to the route using a selected traffic mode, without the user specifying a destination to be added to the route. In some embodiments, the first electronic device 500a searches based on the route and the selected traffic mode, and adds the destination to the route according to the search results. In some embodiments, when a user is editing a route, the first electronic device 500a presents an option for providing a reservation and / or payment for the traffic mode used in the route, such as booking a bicycle rental, purchasing a public transportation pass or ticket, and / or making an appointment for a carpooling service or calling a personal vehicle. In some implementations, the user can request to add a segment to a route, and the first electronic device 500a can suggest an alternative mode for navigating to the route.
[0267] For example, Fig.8D Also shown is a user selecting (e.g., using contact 822) selectable user interface element 814e, which can be selected to change the traffic mode. In response, in some embodiments, electronic device 500a updates the Fig. 8E The user interface shown includes a user interface element 824a corresponding to a first transportation mode (e.g., driving), a user interface element 824b corresponding to a second transportation mode (e.g., walking), a user interface element 824c corresponding to a third transportation mode (e.g., taking public transportation), a user interface element 824d corresponding to a fourth transportation mode (e.g., riding a bicycle), and a user interface element 824e corresponding to a fifth transportation mode (e.g., using a carpool). Fig. 8E As indicated in , for example, a first transportation mode (eg, driving) is currently selected for the navigation route.
[0268] In some embodiments, as described with reference to method 700, the user may select two or more modes of transportation for the navigation route. Fig. 8E In response to the user selecting (eg, using contact 826) user interface element 824b corresponding to the second mode of transportation (eg, walking). Fig. 8E In some embodiments, the first electronic device 500a updates the route configuration user interface, such as Fig.8F shown.
[0269] Fig.8F The first electronic device 500a responds to receiving Fig. 8E The illustrated input is updated to include an example of a user interface element 814a, which is similar to Fig. 8E However, in some embodiments, such as Fig.8F The illustrated route configuration user interface includes an indication of the second mode of transportation in content item 814i. In some embodiments, the first electronic device 500a also updates the map 804 to indicate the second destination 814k. In some embodiments, if the first electronic device 500a were to receive a selection of option 814d, the first electronic device 500a would display a menu item corresponding to the second mode of transportation. Figure 8C , for adding additional destinations to a route. In some embodiments, when an additional destination is added after a second destination, the first electronic device 500a searches for the additional destination based on the location of the second destination. In some embodiments, when an additional destination is added after a first destination, the first electronic device 500a searches for the additional destination based on the location of the first destination. In some embodiments, the first electronic device 500a is able to search for transportation-related facilities and locations, such as bicycle racks, electric vehicle charging stations, and / or parking lots. For example, Fig.8FAs shown, the electronic device 500a also updates the user interface element 814h to include two different route options, each of which includes the content indicating the time length to reach the second destination using the second traffic mode, the distance to the second destination, and a route identifier (e.g., the fastest route, a scenic route, or an environmentally friendly route). In some embodiments, the route option uses the traffic mode selected by the user. In some embodiments, the route option includes one or more options for using a traffic mode other than the traffic mode selected by the user. In some embodiments, the route is based on the setting selected by the user, such as for driving, avoiding tolls or highways, or for riding a bike, avoiding hills or roads without bicycle lanes. In some embodiments, the route option of the user interface element 814h also includes a corresponding selectable user interface element, which can be selected to initiate a navigation instruction for traversing the corresponding route.
[0270] For example, Fig.8F As shown, the user selects (e.g., using contact 822) one of the route options listed in user interface element 814h. Fig.8F The illustrated input, electronic device 500a initiates navigation instructions for traversing the route, such as Figure 8G In some embodiments, Figure 8G As shown, electronic device 500a is in communication with motor vehicle display 500b and is configured by electronic device 500a to display a map application user interface that includes navigation instructions for traversing a route to a first destination using a first mode of transportation (e.g., driving), as also indicated by legend 836.
[0271] like Figure 8G As shown, the map application user interface includes a map 834 that includes a representation of the current location 850 of the first electronic device 500a and instructions for a route 852. Figure 8G As shown, in some embodiments, the map application user interface includes content 832 representing the next maneuver of the navigation direction to be performed according to the first transportation mode, the content including an indication of the distance between the current location of the first electronic device 500a and the location of the maneuver, an image representing the maneuver to be performed, and text describing the maneuver to be performed. In some embodiments, the first electronic device 500a displays the navigation direction in the navigation user interface.
[0272] In some embodiments, the first electronic device 500a continues to navigate along the route configured in the previous figures. In some embodiments, the first electronic device 500a arrives at the first destination in the multi-destination route. In some embodiments, the route continues with different transportation modes.
[0273] like Figure 8H As shown, for example, electronic device 500a displays a map application user interface for navigating from a first destination to a second destination using a second mode of transportation (e.g., walking), as also indicated by legend 836. Figure 8H Also shown is content 838 representing the next maneuver to be performed in the navigation direction according to the second transportation mode in some embodiments. In some embodiments, the content 838 includes an indication of the distance between the current location of the first electronic device 500a and the location of the upcoming maneuver, an image representing the maneuver to be performed, and text describing the maneuver to be performed. For example, when navigating according to the second transportation mode, the first electronic device 500a includes a text message such as Figure 8H Information related to the estimated arrival time 844 is shown. In some embodiments, upon arrival at the first destination, the first electronic device 500a displays a notification of a change of transportation method from a first transportation method (eg, driving) to a second transportation method (eg, walking).
[0274] In some embodiments, the map application user interface also includes a selectable user interface element 848, which, when selected, causes the first electronic device 500a to configure a route or share a route, such as Figure 8H In some embodiments, electronic device 500a detects selection of selectable user interface element 848 (eg, using contact 846), such as Figure 8H In response to Figure 8H The input in Fig.8I As shown, electronic device 500a updates the map application user interface to include user interface element 850a. User interface element 850a optionally includes a selectable user interface element 850b, which, when selected, causes electronic device 500a to add a stop to the route. In some embodiments, user interface element 850a also includes a selectable user interface element 850c, which, when selected, causes first electronic device 500a to share the route with a second electronic device other than first electronic device 500. Reference method 900 describes an example of sharing a route with a second electronic device in more detail. Fig.8I As shown, the user selects (e.g., using contact 856) selectable user interface element 850b. Fig.8I The electronic device 500a displays the input Fig.8F A route configuration user interface similar to the route configuration user interface shown.
[0275] Fig. 9 is an example of configuring a route with multiple destinations and multiple modes of transportation (such as in FIG. 8A to FIG. 8I The method 900 is optionally performed on an electronic device (such as device 100, device 300, or device 500), as described above with reference to Figure 1A-1B , Figure 2-Figure 3 , Figure 4A-4B as well as Figure 5A-5H In some embodiments, method 900 is performed at or by a vehicle (e.g., at an infotainment system of a vehicle having or communicating with one or more display generation components and / or input devices). Some operations in method 900 are optionally combined, and / or the order of some operations is optionally changed.
[0276] As described below, method 900 provides a way to configure a route with multiple destinations and multiple modes of transportation. The method reduces the cognitive burden on a user when interacting with a device user interface of the present disclosure, thereby creating a more efficient human-machine interface. For battery-powered electronic devices, improving the efficiency of user interaction with the user interface saves power and increases the time between battery charges.
[0277] In some embodiments, method 900 is performed at a first electronic device (e.g., 500a) that communicates with a display generation component (e.g., 504) and one or more sensors. For example, the first electronic device includes a device as described with reference to method 700. In some embodiments, the display generation component includes a display as described with reference to method 700. In some embodiments, one or more input devices include an input device as described with reference to method 800.
[0278] In some embodiments, when a route configuration user interface (such as Figure 8B When the user interface element 814a in FIG. 8 is displayed, the computer system detects, via one or more input devices, a first user input corresponding to a request to add a first destination to a route using a first mode of transportation (902a), such as a user selecting the user interface element 814a in FIG. 820 . Fig.8F. In some embodiments, the route configuration user interface is a user interface of the mapping application described in reference method 700. In some embodiments, the route configuration user interface can be interactive to initiate the process of configuring a route from a first location (e.g., the location of the first electronic device when the user requests navigation directions or enters a specified location via a first navigation user interface) to a first destination. In some embodiments, the electronic device presents one or more routes to the first destination using a first transportation mode. The one or more routes optionally include corresponding turn-by-turn navigation directions to the first destination. In some embodiments, the electronic device changes one or more routes to a second one or more routes that are different from the one or more routes to the first destination based on the transportation mode. In some embodiments, the route configuration user interface includes options for selecting a time to depart from the first location and / or a time to arrive at the first destination, options to avoid traffic, options for selecting public transportation components (e.g., buses, subways, light rail, ferries, or trams), and / or other route options as described in reference methods 700 and / or 900. In some embodiments, the electronic device presents a first mode of transportation and / or one or more other modes of transportation via a route configuration user interface for user selection for providing navigation directions from a first location to a first destination. The first mode of transportation optionally corresponds to driving, riding, walking, using public transportation, using carpooling, or using a motor vehicle for rent (e.g., a taxi service). In some embodiments, the transportation modes are presented as an ordered list, as described with reference to methods 700 and / or 900. In some embodiments, the electronic device automatically selects a transportation mode via a route configuration user interface based on the fastest route, user preferences, and / or contextual information for presentation to the user, as described with reference to method 700.
[0279] In some embodiments, in response to detecting the first user input, the first electronic device adds the first destination using the first mode of transportation to the route (902b), such as by Figure 8G 814i in . In some embodiments, the first destination using the first mode of transportation is optionally added to the route by the user searching within the route configuration user interface (e.g., searching for a destination using the first mode of transportation and selecting a selectable option associated with the destination displayed in response to the search to generate a navigation route from the first location to the first destination using the first mode of transportation and / or displaying the navigation route). In some embodiments, the first destination using the first mode of transportation is optionally manually entered by the user.
[0280] In some embodiments, the first electronic device (e.g., 500a) detects (902c) via one or more input devices a second user input corresponding to a request to add a second destination to the route using a second transportation mode different from the first transportation mode, such as a user selecting with contact 856 Fig.8I . In some embodiments, and before the electronic device finalizes the route and / or initiates navigation instructions for traversing the route, the route configuration user interface receives a second user input corresponding to a request to search for a second destination to be added to the route using a second transportation mode. For example, the user optionally provides input to add a point of interest (e.g., a coffee break, a public restroom, a scenic view, or a landmark) to the route after the first destination on the route. Thus, the electronic device optionally receives input corresponding to a request to search for a point of interest. In some embodiments, the first transportation mode corresponds to driving, and the second transportation mode corresponds to a transportation mode other than driving (e.g., riding, walking, using public transportation, using carpooling, or using a motorized vehicle for rent (e.g., a taxi service)).
[0281] In some embodiments, in response to detecting the second user input, the first electronic device adds a second destination using the second transportation mode to the route (902d), such as adding a content item 814c corresponding to the destination using the driving transportation mode that is consistent with the route. Figure 8G In some embodiments, the route includes navigation directions from a first location to a first destination using a first mode of transportation and navigation directions from the first destination to a second destination using a second mode of transportation. In some embodiments, the second destination using the second mode of transportation is added after the first destination in the route. In some embodiments, the second destination using the second mode of transportation is added before the first destination in the route. Adding a destination using a particular mode of transportation to a route provides an efficient way to present information related to the transportation mode, which reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and more efficiently.
[0282] In some embodiments, when a corresponding destination using a corresponding transportation mode is included in the route, the first electronic device displays a plurality of selectable options via a display generation component for selecting a plurality of suggested routes using other transportation modes different from the corresponding transportation mode to navigate to the corresponding destination, such as Fig.8FIn some embodiments, and before the electronic device finally determines the route and / or initiates a navigation instruction for traversing the route, the first electronic device displays a route configuration user interface, which includes multiple selectable options for selecting multiple suggested routes using other traffic modes different from the corresponding traffic mode to navigate to the corresponding destination. In some embodiments, the multiple suggested routes using other traffic modes different from the corresponding traffic mode are based on the contextual information described in reference method 700. In some embodiments, the multiple suggested routes using other traffic modes different from the corresponding traffic mode are based on the traffic preferences described below. In some embodiments, the multiple suggested routes using other traffic modes different from the corresponding traffic mode are based on whether the corresponding traffic mode has been used recently (e.g., by suggesting a traffic mode used by the first electronic device recently (e.g., in the past 5 minutes, 10 minutes, 15 minutes, 20 minutes, 30 minutes, 40 minutes, 50 minutes, or 60 minutes)). In some embodiments, the multiple suggested routes using other traffic modes different from the corresponding traffic mode are based on the frequency of the user using other traffic modes (e.g., by suggesting a traffic mode frequently used and / or requested by the user). In some embodiments, the first electronic device displays a route configuration user interface, which includes multiple selectable options for selecting multiple suggested routes using the same traffic mode as the corresponding traffic mode. In some embodiments, the first electronic device displays a route configuration user interface, which includes multiple selectable options for selecting multiple suggested routes using multiple (e.g., at least two) different traffic modes (e.g., walking and riding; or driving and walking; or walking and using public transportation) by route. In some embodiments, multiple selectable options include options corresponding to a single other traffic mode. In some embodiments, multiple suggested routes use route information (e.g., trip length, estimated arrival time information, slope information, fee amount, and / or public transportation connection information) including a specific traffic mode. Providing multiple selectable options for selecting multiple suggested routes using other traffic modes enhances interaction with the first electronic device (e.g., by reducing the amount of time required for the user of the electronic device to perform route configuration operations), which reduces power consumption and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and more efficiently.
[0283] In some embodiments, based on determining that a user of the first electronic device has selected a first set of transportation preferences (such as those available via Fig. 8EIn some embodiments, the first electronic device presents a plurality of suggested routes that conform to the first set of traffic preferences (based on preferences set by selectable user interface element 814g in the first electronic device). In some embodiments, based on determining that the user of the first electronic device has selected a second set of traffic preferences that is different from the first set of traffic preferences, the plurality of suggested routes conform to the second set of traffic preferences. In some embodiments, the first set of traffic preferences and the second set of traffic preferences correspond to the same traffic mode. For example, if the "avoid hills" option is selected for cycling, the electronic device presents a plurality of suggested cycling routes that avoid hills, but if the "avoid hills" option is selected for cycling, the electronic device presents a plurality of suggested cycling routes that include hills. In some embodiments, traffic preferences change depending on the traffic mode. For example, a first set of traffic preferences is set for a first traffic mode (e.g., driving), and a second set of traffic preferences is set for a second traffic mode (e.g., cycling). Therefore, for the driving traffic mode, the first electronic device optionally presents a plurality of suggested routes that conform to the traffic preferences set for the driving traffic mode (e.g., avoiding tolls and / or avoiding highways). In another example, for a cycling transportation mode, the first electronic device optionally presents a plurality of suggested routes that conform to the transportation preferences set for the cycling transportation mode (e.g., avoiding hills and / or avoiding busy roads). In some embodiments, if the first electronic device determines a set of transportation preferences corresponding to another transportation mode (e.g., walking), the plurality of suggested routes presented in the route configuration user interface conform to a set of transportation preferences corresponding to the walking transportation mode. For example, a set of transportation preferences corresponding to the walking transportation mode includes calling one or more corresponding user interface elements that can interact to access one or more corresponding functions of the first electronic device (e.g., as described in more detail below and / or in method 700). For example, one or more corresponding functions include presenting immersive (e.g., augmented reality) walking directions, presenting personalized walking guidance, and / or presenting indoor maps or trail / park maps. In some embodiments, the first set of transportation preferences and / or the second set of transportation preferences have been previously set by the user in a route configuration user interface or another user interface different from the route configuration user interface (such as a settings user interface of a mapping application) (e.g., before finalizing the route and / or initiating navigation instructions for traversing the route). In some embodiments, the first set of transportation preferences and / or the second set of transportation preferences are learned from previous interactions with one or more corresponding user interface elements capable of interacting to access one or more corresponding functions as described herein (and, optionally, automatically set by the first electronic device) and / or from one or more operational changes (e.g., transitioning from operating according to a first transportation mode to operating according to a second transportation mode as described in method 700).Providing multiple suggested routes that conform to transportation preferences set by a user enhances interaction with the first electronic device (e.g., by reducing the amount of time required for a user of the electronic device to set transportation preferences), which reduces power usage and extends the battery life of the electronic device by enabling the user to use the electronic device more quickly and efficiently.
[0284] In some embodiments, when operating in a corresponding traffic mode, according to determining that one or more criteria are satisfied, the one or more criteria include criteria satisfied when a change in context information indicates the end of a corresponding traffic mode (e.g., as described in more detail with reference to method 700), the first electronic device displays multiple selectable options for selecting multiple suggested routes using other traffic modes via a display generation component. In some embodiments, other traffic modes correspond to changes in one or more criteria and / or context information. For example, when presenting public transportation navigation directions, in response to detecting that a user is walking (e.g., based on motion and / or pedometer data), the electronic device displays a suggested route for walking. In some embodiments, other traffic modes are optionally the same or different from the corresponding traffic modes. In some embodiments and as described above, when a corresponding destination using a corresponding traffic mode is included in a route, multiple selectable options for selecting multiple suggested routes using other traffic modes are displayed. In some embodiments, displaying multiple suggested routes is consistent, but is not limited to the description described herein and / or with reference to method 700. Automatically displaying multiple suggested routes using other transportation modes in response to a change in context information indicating the end of the corresponding transportation mode avoids additional interactions between the user and the first electronic device associated with the change in input transportation mode when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0285] In some embodiments, a first electronic device (e.g., 500a) communicates with a second electronic device (e.g., 500b), such as in Figure 6G In some embodiments, the second electronic device is different from the first electronic device. In some embodiments, the second electronic device is used by a user different from the user of the first electronic device. In some embodiments, the second electronic device includes the device described with reference to method 700. In some embodiments, the first device and the second device communicate using text messaging, instant messaging, phone calls, and / or video conferencing using the Internet or other network connection. In some embodiments, when a first destination using a first mode of transportation and a second destination using a second mode of transportation are included in the route, the first electronic device detects a third user input corresponding to a request to share the route via one or more input devices, such as selecting Fig.8IIn some embodiments, the route configuration user interface includes a share option, and detecting the input includes detecting a selection of the share option. In some embodiments, in response to detecting a third input, such as a Fig.8I , the first electronic device (e.g., 500a) initiates a process for sharing a route with a second electronic device. In some embodiments, initiating a process for sharing a route with a second electronic device includes displaying a user interface for selecting one or more electronic devices (e.g., contacts from a contact list) including a second electronic device to share a route with. In some embodiments, initiating a process for sharing a route with a second electronic device includes displaying an option for sharing an entire route or one or more segments of a shared route. For example, when a first electronic device receives a series of destinations, each segment is optionally treated separately (e.g., from a first location to a first destination as the first segment of a route, followed by a first destination to a second destination as the second segment of a route). In some embodiments, initiating a process for sharing a route with a second electronic device includes sharing a route with the second electronic device without the need for additional user input. In some embodiments, sharing a route with a second electronic device includes sharing an estimated arrival time, turn-by-turn updates, changes in traffic patterns, and / or real-time progress along route navigation. When a first destination using a first mode of transportation and a second destination using a second mode of transportation are included in the route, initiating a process for sharing the route with a second electronic device simplifies interaction between the user and the first electronic device and enhances operability of the first electronic device (e.g., by providing a sharing option without having to navigate to another application and / or user interface).
[0286] In some embodiments, the first electronic device (e.g., 500a) detects, via one or more input devices, a third user input for adding to the route, wherein the third user input specifies a third mode of transportation without specifying a third destination, such as selecting Figure 8G Selectable user interface element 814e in Fig.8F In some embodiments, in response to detecting a third user input, the first electronic device initiates a search for a third destination based on the third transportation mode, such as Figure 8CIn some embodiments, the third input for adding to the route is detected when the first destination using the first traffic mode is included in the route. In some embodiments, the third user input for adding to the route is detected when the second destination using the second traffic mode is included in the route. In some embodiments, the third user input for adding to the route is detected when the navigation instruction for traversing the route is initiated without including the first destination in the route. In some embodiments, the search for the third destination based on the third traffic mode is initiated including displaying one or more user interface objects for selecting a destination category, such as restaurants, gas stations, fast food, dinner, parking spots, convenience stores, coffee shops, etc. In some embodiments, the categories presented are related to the third traffic mode. For example, if the third traffic mode is riding, the first electronic device optionally presents, but is not limited to presenting the following categories of destinations: bicycle trails, bicycle shops, bicycle parking spots, bicycle sharing stations, restaurants, fast food and / or dinner. In another example, if the third mode of transportation is driving, the first electronic device optionally presents, but is not limited to presenting the following categories of destinations: gas stations, parking spots, auto repair shops, car washes, electric vehicle charging, restaurants, fast food and / or dinner. In some embodiments, and before the user finally determines the route and / or initiates a navigation instruction for traversing the route, the first electronic device detects a third input for adding the third mode of transportation to the route without specifying a third destination. For example, the user optionally provides input to select a destination category (e.g., a coffee break) for the route. Therefore, the first electronic device optionally focuses the search for the third destination (e.g., a coffee shop) based on the third mode of transportation around the current location of the electronic device when the third user input is detected. In some embodiments, the results of the search include results corresponding to the search (e.g., matching the destination category) located within the geographic area, rather than results corresponding to the search located outside the geographic area. In some embodiments, the geographic area is a region centered on the current location of the electronic device when the third user input is detected and radially extending from the current location based on the amount of the third mode of transportation. For example, if the third mode of transportation is walking, the amount (e.g., 0.1 miles, 0.3 miles, 0.5 miles, 1 mile, 1.5 miles, 2 miles, 2.5 miles, 3 miles, 3.5 miles, 4 miles, 4.5 miles, or 5 miles) is optionally shorter than if the third mode of transportation is driving. In another example, if the third mode of transportation is driving, the geographic area is an area accessible by driving. Thus, traveling to Angel Island State Park in San Francisco Bay by driving is not available and is optionally not included as a result of the search for a third destination using the third mode of transportation.In some embodiments, the geographic area includes the current location of the electronic device when the third user input is detected, the starting location of the route, and / or the destinations included in the route, if these destinations are within the above-mentioned radial extension range from the current location of the electronic device when the third user input is detected. Searching for destinations based solely on receiving the traffic mode enhances interaction with the first electronic device (for example, by automatically focusing the search on destinations related to the traffic mode), which reduces the need for additional input for specifying the destination when faster interaction is desired.
[0287] In some embodiments, when navigating along a route to a first destination using a first mode of transportation, the first electronic device displays a first navigation user interface (such as a navigation interface) via a display generation component. Figure 8G In some embodiments, when navigating along the route to a second destination using a second transportation mode, the first electronic device displays a second navigation user interface (such as a navigation interface displayed by the device 500b in FIG. 1 ), the first navigation user interface including one or more first user interface elements that can be interacted with to access one or more first functions of the first electronic device. Figure 8HIn some embodiments, the second navigation user interface includes one or more second user interface elements that can interact to access one or more second functions of the first electronic device, and the one or more second user interface elements are different from the one or more first user interface elements. In some embodiments, the second navigation user interface includes one or more second user interface elements that are not included in the first navigation user interface. In some embodiments, the first navigation user interface includes one or more first user interface elements that are not included in the second navigation user interface. In some embodiments, when the first traffic mode corresponds to driving, one or more first functions of the first electronic device include an in-vehicle user interface display, zoomed in and out map views, turn-by-turn navigation directions, traffic conditions, and / or estimated travel time, and do not include one or more user interface elements of the user interface elements of walking, cycling, and / or public transportation user interfaces described below. In some embodiments, the second traffic mode does not include one or more first functions associated with the first traffic mode. For example, if the second traffic mode is walking, the second traffic mode includes one or more second functions that are different from the one or more first functions, such as immersive walking directions, three-dimensional map views, and / or step-by-step walking directions shown in augmented reality, and does not include one or more user interface elements of the in-vehicle user interface described above and / or the user interface elements of the cycling and / or public transportation user interfaces described below. In some embodiments, when the transportation mode corresponds to biking, one or more functions include ride height, information about whether a segment of the route includes a bicycle path, information about how busy the street is, information about whether there are stairs, steep slopes, or bicycle racks along the route, and / or voice-guided biking directions, and do not include one or more user interface elements of the walking and / or in-car user interfaces described above and / or the user interface elements of the public transportation function described below. In some embodiments, when the transportation mode corresponds to public transportation, one or more functions include the location of the bus stop, entry and exit information, and / or real-time public transportation information, including bus schedules, departure and arrival times, connection information, and suspensions, and do not include one or more elements of the walking, driving, and / or biking user interfaces described above. Automatically displaying different user interfaces (which include corresponding user interface elements for performing corresponding functions corresponding to the transportation mode) avoids additional interactions between the user and the first electronic device associated with changes in the input transportation mode when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0288] In some embodiments, while navigating along the route using the first transportation mode, based on determining that one or more criteria are satisfied, the one or more criteria are associated with the second transportation mode, the first electronic device stops navigating along the route using the first transportation mode, such as from Figure 8G The user interface in Figure 8H In some embodiments, one or more criteria include a criterion indicating the completion of navigation along the route using the first traffic mode and / or the start of navigation along the route using the second traffic mode. In some embodiments, one or more criteria include the criteria described above and / or with reference to method 700. In some embodiments, the electronic device continues to display the navigation user interface and stops presenting navigation directions using the first traffic mode. For example, the electronic device continues to display a representation of the current location of the electronic device on a map, and stops displaying an indication of the next maneuver to be performed in the navigation direction using the first traffic mode. In some embodiments, the first electronic device (e.g., 500a) initiates a process of continuing to navigate along the route using the second traffic mode. In some embodiments, initiating a process of continuing to navigate along the route using the second traffic mode includes navigating along the route using the second traffic mode without requiring additional user input. Therefore, the first electronic device optionally does not suspend navigation along the route using the second traffic mode (rather than the first traffic mode). In some embodiments, pausing navigation along the route includes stopping displaying or otherwise providing navigation instructions for performing the next maneuver on the route. In some embodiments, continuing to navigate along the route using the second traffic mode includes displaying an indication of the upcoming maneuver included in the navigation direction using the second traffic mode. In some embodiments, the route using the second mode of transportation is different than the route using the first mode of transportation.
[0289] In some embodiments, the first electronic device presents an indication of the change from the first transportation mode to the second transportation mode via one or more output devices in communication with the first electronic device, such as Fig.8F, where the user chooses to change the mode of transportation from driving 824a to walking 824b. In some embodiments, the process of initiating the continuation of navigating along the route using the second mode of transportation includes displaying an indication of changing from the first mode of transportation to the second mode of transportation. In some embodiments, the indication includes a graphic image and / or a text description describing the second mode of transportation. In some embodiments, the indication includes prompting the user to accept or refuse to stop navigating along the route using the first mode of transportation, and continue to navigate along the route using the second mode of transportation. In some embodiments, the first electronic device automatically changes to navigating along the route using the second mode of transportation after a period of time (e.g., 5 seconds, 10 seconds, 15 seconds, 20 seconds, 25 seconds, 30 seconds, 35 seconds, or 40 seconds). In some embodiments, an indication of changing from the first mode of transportation to the second mode of transportation is presented before the first electronic device navigates along the route using the second mode of transportation. In some embodiments, the process of initiating the continuation of navigating along the route using the second mode of transportation includes pausing the navigation along the route using the first mode of transportation and resuming the navigation along the route using the second mode of transportation. In some embodiments, initiating the process of continuing to navigate along the route using the second mode of transportation is conditional upon the computer system receiving an acceptance to cease navigating along the route using the first mode of transportation and to use the second mode of transportation instead. In some embodiments, the acceptance is indicated by detecting appropriate movement of the first electronic device along the route (e.g., indicating movement using the second mode of transportation as described in reference method 700). Automatically displaying an indication that the first electronic device will transition to operate according to the second mode of transportation without receiving user input avoids additional interactions between the user and the first electronic device associated with inputting a change in the mode of transportation when a seamless transition between modes of transportation is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors by providing improved visual feedback to the user.
[0290] In some embodiments, the first electronic device (e.g., 500a) is included in a plurality of electronic devices associated with a user account of the first electronic device (e.g., 500a). In some embodiments, the plurality of electronic devices associated with the user account are logged into the user account and are able to access account settings, purchases, and / or communication sessions associated with the user account. In some embodiments, when navigating a route alone using a first transportation mode, the first electronic device (e.g., 500a) uses a second electronic device (e.g., 500b) among the plurality of electronic devices associated with the user account to present a navigation user interface, such as in Figure 8GIn some embodiments, the second electronic device is the same as the first electronic device described herein. In some embodiments, the second electronic device is different from the first electronic device. In some embodiments, when navigating along the route using the second traffic mode, the first electronic device uses a third electronic device in multiple electronic devices associated with the user account to present a navigation user interface. In some embodiments, the third electronic device is the same as the first electronic device described herein. In some embodiments, the third electronic device is different from the first electronic device. For example, the second electronic device and / or the third electronic device are optionally wearable devices (e.g., watches) and / or motor vehicles. In some embodiments, the first electronic device is configured to stream or share navigation data (e.g., route data and / or navigation directions) to one or more external devices (e.g., the second electronic device and / or the third electronic device) or mirror the navigation data for presentation on one or more external devices or displays. One or more external devices or displays include a watch device, a head-mounted device, or a motor vehicle display. In some embodiments, the first electronic device and one or more external devices or displays are configured to present different navigation user interfaces based on the traffic mode as described above. In some embodiments, as described herein, the first electronic device is configured to share navigation data to another electronic device that is not part of the plurality of electronic devices associated with the user (e.g., the other electronic device is associated with another user different from the user). In some embodiments, the third electronic device automatically begins presenting navigation directions based on the portion of the route where the second mode of transportation is started, without receiving user input requesting to stop presenting navigation instructions using the second electronic device and / or user input requesting to present navigation instructions using the third electronic device. Allowing navigation data to be shared and / or displayed to multiple electronic devices different from the first electronic device avoids additional interactions between the user and the multiple electronic devices (e.g., the user does not need to execute the same navigation request in multiple electronic devices already configured in the first electronic device), which reduces power usage of the multiple electronic devices.
[0291] In some embodiments, such as FIG. 8A to FIG. 8FThe route configuration user interface in includes one or more user interface elements that can be interacted with to allow the reservation or payment of goods or services associated with the first transportation mode or the second transportation mode. In some embodiments, the electronic device displays a user interface element for allowing the reservation or payment of goods or services associated with the first transportation mode in response to the first transportation mode being added to the route. In some embodiments, the electronic device displays a user interface element for allowing the reservation or payment of goods or services associated with the second transportation mode in response to the second transportation mode being added to the route. In some embodiments, one or more user interface elements include an application extension (e.g., a parking reservation system, a toll payment system, a public transportation payment system, or a shared bicycle rental system), which provides application-specific information (e.g., parking availability, public transportation schedules, or shared bicycle availability) and / or performs application-specific functions (e.g., purchasing public transportation tickets, purchasing reservations, or booking bicycle rentals). In some embodiments, the application extension is part of a mapping application. In some embodiments, the application extension is separate from the mapping application (e.g., an independent executable software including software executed in the background of the mapping application). In some embodiments, the application extension provides an API accessible to the mapping application to provide application-specific information and / or perform application-specific functions. Providing a way to perform a specific traffic-based service via the mapping application avoids switching to the specific application to perform the specific traffic-based service when a seamless transition therebetween is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0292] In some embodiments, in response to detecting a second user input, adding a second destination using a second mode of transportation to the route includes the first electronic device (e.g., 500a) detecting, via one or more input devices, a corresponding user input corresponding to a request to add the second destination to the route without specifying a mode of transportation, such as in Figure 8C, and inputting a destination into user interface element 818b in . In some embodiments, detecting a corresponding user input corresponding to a request to add a second destination to a route is performed when the first destination is included in the route using the first mode of transportation. In some embodiments, detecting a corresponding user input corresponding to a request to add a second destination to a route is performed when the second destination is included in the route using the second mode of transportation. In some embodiments, detecting a corresponding user input corresponding to a request to add a second destination to a route is performed when a navigation instruction is initiated to traverse the route without including the second destination in the route. In some embodiments, in response to the corresponding user input, the first electronic device (e.g., 500a) displays, via a display generating component (e.g., 504a), an option to navigate to the second destination using the second mode of transportation and an option to navigate to the second destination using a third mode of transportation different from the second mode of transportation, wherein detecting the second user input includes detecting a selection of the option to navigate to the second destination using the second mode of transportation, such as Figure 8G The user interface element 814h of shows two different route options. In some embodiments, the first electronic device presents the option of navigating to the second destination using at least two different modes of transportation. In some embodiments, the first electronic device presents the option of navigating to the second destination using the first mode of transportation. In some embodiments, the second user input corresponding to the request to add the second destination to the route includes the selection of the option of navigating to the second destination using the second mode of transportation. In some embodiments, when navigating along the route using the second mode of transportation, and according to determining that one or more of the above criteria are met, the first electronic device stops navigating along the route using the second mode of transportation, and continues to use the option of using the third mode of transportation to navigate along the route. For example, the user optionally provides input to add the second destination (e.g., a hotel in Los Angeles) to the route. Therefore, the first electronic device optionally includes two different modes of transportation to navigate to the destination, such as flying and using a carpool to go to the second destination. Automatically adding the second mode of transportation to reach the destination enhances the interaction with the first electronic device, which reduces the need for additional input for specifying the destination when faster interaction is desired.
[0293] In some embodiments, when a second destination using a second mode of transportation is included in the route, such as in Fig.8F In some embodiments, the first electronic device (e.g., 500a) detects, via one or more input devices, a third user input corresponding to a request to search for a third destination to be added to the route. In some embodiments, in response to detecting the third user input, the first electronic device (e.g., 500a) initiates a search for a third destination in a geographic area that includes the second destination using the second transportation mode, such as in Figure 8CIn some embodiments, the first electronic device focuses the search for the third destination on a second geographic area corresponding to the second destination using the second transportation mode described above, so that the results of the search include results corresponding to searches within the second geographic area (e.g., matching searches for a specified destination and / or matching destination categories based on the transportation mode described above), rather than results corresponding to searches outside the second geographic area. In some embodiments, in response to detecting a third input when the first destination is included in the route and the second destination is not included in the route, the electronic device initiates a search for the third destination in the geographic area including the first destination using the first transportation mode. Focusing the search for the third destination around the second geographic area based on the third user input focuses the search on a user desired location, and provides the user with the closest option to the second geographic area using the second transportation mode, thereby reducing the need for subsequent input to correct searches in areas that the user did not expect.
[0294] In some embodiments, when a first destination using a first mode of transportation is included in a route (and a second destination using a second mode of transportation is included in the route), such as in Figure 8B In some embodiments, the first electronic device (e.g., 500a) detects, via one or more input devices, a third user input corresponding to a request to search for a third destination (between the first destination and the second destination) to be added to the route. In some embodiments, in response to detecting the third user input and based on determining that the third destination is added to the route after the first destination (and before the second destination), the first electronic device (e.g., 500a) initiates a search for the third destination in a geographic area that includes the first destination using the first transportation mode, such as in Figure 8C In some embodiments, the first electronic device focuses the search for the third destination on the first geographic area corresponding to the first destination using the first transportation mode described above, so that the results of the search include results corresponding to searches within the first geographic area (e.g., matching searches for the specified destination and / or matching destination categories based on the transportation mode described above), rather than results corresponding to searches outside the first geographic area. Focusing the search for the third destination around the first geographic area based on a third user input focuses the search on a user desired location and provides the user with the closest option to the first geographic area using the first transportation mode, thereby reducing the need for subsequent input to correct searches in areas not desired by the user.
[0295] In some embodiments, the first electronic device (e.g., 500a) displays one or more search results corresponding to a location for serving the first transportation mode via a display generation component, such as in a manner similar to Figure 8C In some embodiments, and as described herein, one or more search results include points of interest and / or categories related to the traffic mode. In some embodiments, based on determining that the first traffic mode is the first corresponding traffic mode, the electronic device displays a first corresponding plurality of search results for serving the first corresponding traffic mode. In some embodiments, based on determining that the first traffic mode is the second corresponding traffic mode, the electronic device displays a second corresponding plurality of search results for serving the second corresponding traffic mode. For example, if the first traffic mode is riding, the first electronic device optionally presents but is not limited to the following categories of destinations: bicycle shops, bicycle racks, and / or bicycle rentals. As another example, if the first traffic mode is driving, the first electronic device optionally presents but is not limited to the following categories of destinations: gas stations, electric vehicle charging stations, and / or car construction. Including points of interest related to the traffic mode used in the search destination enhances the interaction with the first electronic device, which reduces the need for additional search inputs for searching for points of interest related to the traffic mode when faster interaction is desired.
[0296] In some embodiments, based on determining that the second traffic mode is the first corresponding traffic mode, the second destination is the first corresponding destination. In some embodiments, the first corresponding destination corresponds to the first corresponding traffic mode. In some embodiments, based on determining that the second traffic mode is a second corresponding traffic mode different from the first corresponding traffic mode, the second destination is a second corresponding destination different from the first corresponding destination. In some embodiments, the second corresponding destination corresponds to the second corresponding traffic mode. In some embodiments, the first electronic device identifies one or more changes (e.g., making it easier, more efficient, or recommendations for viewing interesting attractions or locations along the way) based on content specific to the space and / or traffic mode, as described with reference to method 700. For example, when the second traffic mode corresponds to walking, the first corresponding destination within the space proposed or recommended by the first electronic device is optionally the "entrance 100" of the place. In some embodiments, when the second traffic mode corresponds to riding, the second corresponding destination within the space proposed or recommended by the first electronic device is optionally different from the "entrance 100" and is instead the "bicycle parking spot A" of the place. Determining a more precise destination based on the transportation mode without receiving user input avoids additional interactions between the user and the first electronic device associated with changes in the input destination when a seamless transition between transportation modes is desired, thereby reducing errors in the interaction between the user and the first electronic device and reducing the input required to correct such errors.
[0297] In some embodiments, in response to detecting a second user input, adding a second destination using a second mode of transportation to the route includes the first electronic device (e.g., 500a) detecting, via one or more input devices, a corresponding user input corresponding to a request to add the second destination to the route and the mode of transportation, such as in FIG. 8A to FIG. 8C In some embodiments, detecting a corresponding user input corresponding to a request to add a second destination to a route is performed when the first destination is included in the route using the first mode of transportation. In some embodiments, detecting a corresponding user input corresponding to a request to add a second destination to a route is performed when the second destination is included in the route using the second mode of transportation. In some embodiments, detecting a corresponding user input corresponding to a request to add a second destination to a route is performed when initiating a navigation instruction for traversing the route without including the second destination in the route.
[0298] In some embodiments, such as Fig. 8EIn some embodiments, in response to corresponding user input, the first electronic device displays via a display generation component an option for navigating a first segment of a route to a second destination using a second mode of transportation (e.g., 824b) and an option for navigating a second segment of a route to the second destination using a third mode of transportation (e.g., 824c), wherein detecting the second user input includes detecting a selection (e.g., using contact 826) of the option for navigating to the second destination using the second mode of transportation (e.g., 824b). In some embodiments, the first electronic device presents an option for navigating to the second destination using at least two modes of transportation. In some embodiments, presenting an option for navigating to the second destination using at least two modes of transportation includes a first segment of a route corresponding to a first or more directions to the second destination using the second mode of transportation. In some embodiments, the second segment of the route corresponds to a second or more directions to the second destination using the third mode of transportation. In some embodiments, the second user input corresponding to a request to add a second destination to a route includes a selection of an option for navigating the first segment of a route to the second destination using the second mode of transportation. In some embodiments, while navigating along the route for the first segment using the second mode of transportation, and bas...
Claims
1. A method, comprising: At a first electronic device in communication with a display generating component and one or more sensors: When the first electronic device is operating according to the first traffic mode: displaying, via the display generation component, a first navigation user interface, wherein the first navigation user interface includes a first option for initiating navigation according to the first transportation mode; as well as detecting, via the one or more sensors, a change in contextual information; as well as In response to detecting the change in context information: Based on determining that one or more criteria are satisfied, the one or more criteria including a criterion satisfied when the change in contextual information indicates the onset of a second transportation mode: ceasing to operate according to said first traffic mode; as well as operating according to the second traffic mode; as well as while operating according to the second transportation mode, displaying, via the display generation component, a second navigation user interface that is different from the first navigation user interface, wherein the second navigation interface includes a second option for initiating navigation according to the second transportation mode, the second option being different from the first option for initiating navigation according to the first transportation mode; as well as Based on determining that the one or more criteria are not satisfied, continuing to operate according to the first traffic mode.
2. The method according to claim 1, wherein: The first option for initiating navigation according to the first transportation mode includes first navigation instructions from a first location to a second location, and the second option for initiating navigation according to the second transportation mode includes second navigation instructions from a third location to the second location.
3. The method according to any one of claims 1 to 2, wherein: The first option for initiating navigation according to the first transportation mode includes first navigation instructions from a first location to a second location, and The second option for initiating navigation according to the second transportation mode includes second navigation instructions from a third location to a fourth location, the third location being different from the first location.
4. The method according to claim 3, wherein: In response to a first user input corresponding to a request to navigate from the first location, the first navigation instruction includes the first location; and The second navigation instructions include the third location without receiving a second user input corresponding to a request to navigate from the third location.
5. The method according to any one of claims 1 to 4, further comprising: Prior to operating according to the first transportation mode or the second transportation mode, the first electronic device receives, via the one or more sensors, input corresponding to a request to navigate to a first location; as well as In response to the input corresponding to the request to navigate to the first location, the first electronic device operates according to the first transportation mode, wherein operating according to the second transportation mode includes operating according to the second transportation mode for a remaining portion of the route to the first location.
6. The method according to any one of claims 1 to 5, further comprising: Prior to operating according to the first transportation mode or the second transportation mode, the first electronic device receives, via the one or more sensors, input corresponding to a request to navigate to a first location; as well as In response to the input corresponding to the request to navigate to the first location, the first electronic device operates according to the first transportation mode, wherein according to determining that one or more second criteria are satisfied, the one or more second criteria include that the criteria satisfied when operating according to the second transportation mode are for a remainder of the route that is less than the first location: ceasing to operate according to the second traffic mode; and Operating according to a third transportation mode different from the second transportation mode. 7 . The method of claim 6 , wherein the first electronic device operates according to the third transportation mode without receiving a first user input corresponding to a request to operate according to the third transportation mode.
8. The method according to any one of claims 6 to 7, wherein: Prior to operating according to the second transportation mode, the first electronic device includes operating according to a fourth transportation mode different from the third transportation mode for the remaining portion of the route.
9. The method of any one of claims 1 to 8, wherein the contextual information comprises a number of steps taken by a user associated with the first electronic device within a predefined duration of time.
10. The method of claim 9, wherein detecting the change in context information comprises: Based on determining that the number of steps taken within the predefined duration of time satisfies one or more second criteria: Calculating the correlation between the number of steps and the second context information; as well as The correlation between the number of steps and the second context information is compared with a predefined threshold.
11. The method according to any one of claims 1 to 10, wherein: the first option for initiating navigation according to the first transportation mode includes one or more first user interface elements that are interactive to access one or more first functions of the first electronic device; as well as The second option for initiating navigation according to the second transportation mode does not include the one or more first user interface elements.
12. The method of any one of claims 1 to 11, wherein the second option for initiating navigation according to the second transportation mode comprises second navigation instructions from a first location to a second location, the method further comprising: A representation of the layout of a space and one or more routes to the second location within the space are displayed via the display generation component.
13. The method of any one of claims 1 to 12, wherein the first option for initiating navigation according to the first transportation mode comprises a first navigation instruction from a first location to a second location, the method further comprising: While navigating along a route from the first location to the second location, an indication is displayed that the first electronic device has ceased operating according to the first transportation mode to transition to operating according to the second transportation mode.
14. The method according to any one of claims 1 to 13, further comprising: When operating according to the first traffic mode, based on determining that characteristics of an upcoming route satisfy one or more second criteria: while operating according to the first transportation mode, displaying, via the display generation component, a plurality of options for initiating navigation according to a plurality of corresponding transportation modes different from the first transportation mode; as well as Based on determining that the upcoming route characteristics do not satisfy the one or more second criteria, continuing to operate according to the first transportation mode without displaying the plurality of options for initiating navigation according to the plurality of respective transportation modes different from the second transportation mode.
15. The method according to any one of claims 1 to 14, further comprising: while operating according to the first traffic mode, detecting, via the one or more sensors, a second change in contextual information; In response to detecting the second change in context information: Based on determining that the one or more criteria are satisfied, the one or more criteria include a second criterion that is satisfied when the second change in context information indicates the beginning of a traffic mode different from the first traffic mode: while operating according to the first transportation mode, displaying, via the display generation component, a plurality of options for initiating navigation according to a plurality of corresponding transportation modes different from the second transportation mode; as well as Based on determining that the one or more criteria are not satisfied, continuing to operate according to the second mode of transportation without displaying the plurality of options for initiating navigation according to the plurality of respective modes of transportation different from the second mode of transportation.
16. The method of any one of claims 14 to 15, wherein the plurality of options for initiating navigation according to the plurality of respective transportation modes include respective estimated times for reaching the second location.
17. The method according to any one of claims 1 to 16, further comprising: Prior to operating according to the first transportation mode or the second transportation mode, the first electronic device receives, via one or more input devices, a sequence of inputs corresponding to a request to navigate to a first location using the first transportation mode and the second transportation mode; as well as In response to the input sequence corresponding to the request to navigate to the first location using the first transportation mode and the second transportation mode, the first electronic device operates according to the first transportation mode for a first segment of the route to the first location, wherein operating according to the second transportation mode includes operating according to the second transportation mode for a second segment of the route to the first location.
18. The method according to any one of claims 1 to 17, wherein: The first option for initiating navigation according to the first transportation mode includes a first route from a first location to a second location, and the second option for initiating navigation according to the second transportation mode includes a second route from the first location to the second location that is different from the first route.
19. The method of any one of claims 1 to 18, wherein the contextual information comprises detecting a user exiting a motor vehicle in communication with the first electronic device.
20. The method of any one of claims 1 to 19, wherein the contextual information comprises detecting a user entering a motor vehicle in communication with the first electronic device.
21. The method of any one of claims 1 to 20, wherein the context information includes detecting one or more aspects of an external environment of a motor vehicle in communication with the first electronic device.
22. The method of any one of claims 1 to 21, wherein the context information comprises detecting one or more characteristics of a user of the first electronic device.
23. The method according to any one of claims 1 to 22, further comprising: When operating according to the first transportation mode, one or more instructions are transmitted to a second electronic device different from the first electronic device to cause the second electronic device to display the first navigation interface, wherein the first navigation interface includes the first option for initiating navigation according to the first transportation mode.
24. The method according to any one of claims 1 to 23, further comprising: detecting, via the one or more sensors, a second change in contextual information while displaying the first navigation user interface; In response to detecting the second change in context information: Based on determining that the one or more criteria are satisfied, the one or more criteria include a second criterion that is satisfied when the first electronic device is communicating with a second electronic device that was not in communication prior to the change in context information: ceasing to operate according to said first traffic mode; as well as Operate according to the third traffic mode.
25. The method according to any one of claims 1 to 24, wherein: Based on determining that a first set of transportation modes is selected as available by a user of the first electronic device, the second transportation mode is a transportation mode in the first set of transportation modes; as well as Based on determining that a second group of traffic modes different from the first group of traffic modes is selected as available by the user of the first electronic device, the second traffic mode is one of the second group of traffic modes.
26. The method according to any one of claims 1 to 25, further comprising: detecting second context information via the one or more sensors while operating according to the first transportation mode; In response to detecting the second context information: Based on determining that the one or more criteria are satisfied, the one or more criteria include a second criterion that is satisfied when the second context information indicates the start of a third transportation mode different from the first transportation mode: ceasing to operate according to said first traffic mode; as well as Operating according to the third transportation mode.
27. A first electronic device, comprising: one or more processors; Memory; as well as One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for: When the first electronic device is operating according to the first traffic mode: displaying, via a display generation component, a first navigation user interface, wherein the first navigation user interface includes a first option for initiating navigation according to the first transportation mode; as well as detecting a change in context information via one or more sensors; as well as In response to detecting the change in context information: Based on determining that one or more criteria are satisfied, the one or more criteria including a criterion satisfied when the change in contextual information indicates the onset of a second transportation mode: ceasing to operate according to said first traffic mode; as well as operating according to the second traffic mode; as well as while operating according to the second transportation mode, displaying, via the display generation component, a second navigation user interface that is different from the first navigation user interface, wherein the second navigation interface includes a second option for initiating navigation according to the second transportation mode, the second option being different from the first option for initiating navigation according to the first transportation mode; as well as Based on determining that the one or more criteria are not satisfied, continuing to operate according to the first traffic mode.
28. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of a first electronic device, cause the first electronic device to perform a method comprising: When the first electronic device is operating according to the first traffic mode: displaying, via a display generation component, a first navigation user interface, wherein the first navigation user interface includes a first option for initiating navigation according to the first transportation mode; as well as detecting a change in context information via one or more sensors; as well as In response to detecting the change in context information: Based on determining that one or more criteria are satisfied, the one or more criteria including a criterion satisfied when the change in contextual information indicates the onset of a second transportation mode: ceasing to operate according to said first traffic mode; as well as operating according to the second traffic mode; as well as while operating according to the second transportation mode, displaying, via the display generation component, a second navigation user interface that is different from the first navigation user interface, wherein the second navigation interface includes a second option for initiating navigation according to the second transportation mode, the second option being different from the first option for initiating navigation according to the first transportation mode; as well as Based on determining that the one or more criteria are not satisfied, continuing to operate according to the first traffic mode.
29. A first electronic device, comprising: one or more processors; Memory; When the first electronic device is operating according to the first traffic mode: means for displaying, via a display generation component, a first navigation user interface, wherein the first navigation user interface includes a first option for initiating navigation according to the first transportation mode; as well as means for detecting changes in contextual information via one or more sensors; as well as In response to detecting the change in context information: Based on determining that one or more criteria are satisfied, the one or more criteria including a criterion satisfied when the change in contextual information indicates the onset of a second transportation mode: means for stopping operation according to said first traffic mode; as well as means for operating according to said second mode of transportation; as well as means for displaying, via the display generation component, a second navigation user interface different from the first navigation user interface when operating according to the second transportation mode, wherein the second navigation interface includes a second option for initiating navigation according to the second transportation mode, the second option being different from the first option for initiating navigation according to the first transportation mode; as well as Based on determining that the one or more criteria are not satisfied, means for continuing to operate according to the first traffic mode.
30. An information processing device for use in a first electronic device, the information processing device comprising: When the first electronic device is operating according to the first traffic mode: means for displaying, via a display generation component, a first navigation user interface, wherein the first navigation user interface includes a first option for initiating navigation according to the first transportation mode; as well as means for detecting changes in contextual information via one or more sensors; and In response to detecting the change in context information: Based on determining that one or more criteria are satisfied, the one or more criteria including a criterion satisfied when the change in contextual information indicates the onset of a second transportation mode: means for stopping operation according to said first traffic mode; as well as means for operating according to said second mode of transportation; as well as means for displaying, via the display generation component, a second navigation user interface different from the first navigation user interface when operating according to the second transportation mode, wherein the second navigation interface includes a second option for initiating navigation according to the second transportation mode, the second option being different from the first option for initiating navigation according to the first transportation mode; as well as Based on determining that the one or more criteria are not satisfied, means for continuing to operate according to the first traffic mode.
31. An electronic device, comprising: one or more processors; Memory; as well as One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for executing any one of the methods according to claims 1 to 26.
32. A non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions, which when executed by one or more processors of an electronic device, cause the electronic device to perform any one of the methods according to claims 1 to 26.
33. An electronic device, comprising: one or more processors; Memory; as well as Means for carrying out any of the methods according to claims 1 to 26.
34. An information processing device for use in an electronic device, the information processing device comprising: Means for carrying out any of the methods according to claims 1 to 26.
35. A method comprising: At a first electronic device in communication with a display generation component and one or input devices: while displaying a route configuration user interface via the display generation component, detecting, via the one or more input devices, a first user input corresponding to a request to add a first destination to a route using a first mode of transportation; in response to detecting the first user input, adding the first destination using the first mode of transportation to the route; detecting, via the one or more input devices, a second user input corresponding to a request to add a second destination to the route using a second mode of transportation different from the first mode of transportation; as well as In response to detecting the second user input, the second destination using the second mode of transportation is added to the route.
36. The method of claim 35, further comprising: When a corresponding destination using a corresponding transportation mode is included in the route, a plurality of selectable options are displayed via the display generation component for selecting a plurality of suggested routes using other transportation modes different from the corresponding transportation mode to navigate to the corresponding destination.
37. The method of claim 35, wherein: Based on determining that the user of the first electronic device has selected a first set of transportation preferences, the plurality of suggested routes conform to the first set of transportation preferences; as well as Based on determining that the user of the first electronic device has selected a second set of transportation preferences that is different from the first set of transportation preferences, the plurality of suggested routes conform to the second set of transportation preferences.
38. The method according to any one of claims 36 to 37, further comprising: When operating in the corresponding transportation mode, based on determining that one or more criteria are satisfied, displaying via the display generation component the plurality of selectable options for selecting the plurality of suggested routes using the other transportation mode, wherein the one or more criteria include a criterion that is satisfied when a change in contextual information indicates an end of the corresponding transportation mode.
39. The method according to any one of claims 35 to 38, wherein the first electronic device communicates with a second electronic device, the method further comprising: detecting, via the one or more input devices, a third user input corresponding to a request to share the route when the first destination using the first mode of transportation and the second destination using the second mode of transportation are included in the route; as well as In response to detecting the third input, a process for sharing the route with the second electronic device is initiated.
40. The method according to any one of claims 35 to 39, further comprising: detecting, via the one or more input devices, a third user input for adding to the route, wherein the third user input specifies a third mode of transportation without specifying a third destination; and In response to detecting the third user input, a search for the third destination based on the third transportation mode is initiated.
41. The method according to any one of claims 35 to 40, further comprising: while navigating along the route to the first destination using the first mode of transportation, displaying, via the display generation component, a first navigation user interface including one or more first user interface elements that are interactive enough to access one or more first functions of the first electronic device; as well as When navigating along the route to the second destination using the second transportation mode, a second navigation user interface is displayed via the display generation component, the second navigation user interface including one or more second user interface elements that can be interacted with to access one or more second functions of the first electronic device, the one or more second user interface elements being different from the one or more first user interface elements.
42. The method according to any one of claims 35 to 41, further comprising: While navigating along the route using the first mode of transportation, based on determining that one or more criteria are satisfied, the one or more criteria being associated with the second mode of transportation: ceasing to navigate along the route using the first mode of transportation; initiating a process of continuing navigation along the route using the second mode of transportation; as well as An indication of changing from the first transportation mode to the second transportation mode is presented via one or more output devices in communication with the first electronic device.
43. The method according to any one of claims 35 to 42, wherein the first electronic device is included in a plurality of electronic devices associated with a user account of the first electronic device, and the method further comprises: while navigating along the route using the first mode of transportation, presenting a navigation user interface using a second electronic device among the plurality of electronic devices associated with the user account; as well as The navigation user interface is presented using a third electronic device among the plurality of electronic devices associated with the user account while navigating along the route using the second mode of transportation.
44. A method according to any one of claims 35 to 43, wherein the route configuration user interface includes one or more user interface elements that are interactive to permit booking or payment of goods or services associated with the first mode of transportation or the second mode of transportation.
45. The method of any one of claims 35 to 44, wherein in response to detecting the second user input, adding the second destination using the second mode of transportation to the route comprises: detecting, via the one or more input devices, a corresponding user input corresponding to a request to add the second destination to the route without specifying a mode of transportation; as well as In response to the respective user input, displaying, via the display generation component, an option to navigate to the second destination using the second mode of transportation and an option to navigate to the second destination using a third mode of transportation different from the second mode of transportation, wherein detecting the second user input comprises detecting a selection of the option to navigate to the second destination using the second mode of transportation.
46. The method according to any one of claims 35 to 45, further comprising: detecting, via the one or more input devices, a third user input corresponding to a request to search for a third destination to be added to the route when the second destination using the second mode of transportation is included in the route; as well as In response to detecting the third user input, a search for the third destination is initiated in a geographic area that includes the second destination using the second mode of transportation.
47. The method according to any one of claims 35 to 45, further comprising: detecting, via the one or more input devices, a third user input corresponding to a request to search for a third destination to be added to the route when the first destination using the first mode of transportation is included in the route; as well as In response to detecting the third user input and based on determining that the third destination is added to the route after the first destination, a search for the third destination is initiated in a geographic area that includes the first destination using the first mode of transportation.
48. The method of claim 47, wherein the search for the third destination comprises: One or more search results corresponding to locations for servicing the first transportation mode are displayed via the display generation component.
49. A method according to any one of claims 35 to 48, wherein: Based on determining that the second transportation mode is the first corresponding transportation mode, the second destination is the first corresponding destination; and Based on determining that the second transportation mode is a second corresponding transportation mode different from the first corresponding transportation mode, the second destination is a second corresponding destination different from the first corresponding destination.
50. The method of any one of claims 35 to 49, wherein in response to detecting the second user input, adding the second destination using the second mode of transportation to the route comprises: detecting, via the one or more input devices, a corresponding user input corresponding to a request to add the second destination to the route and a transportation mode; as well as In response to the respective user input, displaying, via the display generation component, an option to navigate a first leg of the route to the second destination using the second mode of transportation and an option to navigate a second leg of the route to the second destination using a third mode of transportation, wherein detecting the second user input comprises detecting a selection of the option to navigate to the second destination using the second mode of transportation.
51. The method according to any one of claims 35 to 50, further comprising: When the route configuration UI is displayed: displaying, via the display generating component, one or more first route segments using the second mode of transportation to the second destination when the second destination using the second mode of transportation is included in the route; detecting, via the one or more input devices, a third user input corresponding to a request to navigate to the second destination using a first route segment of the one or more first route segments using the second mode of transportation while displaying the one or more first route segments; as well as In response to detecting the third user input, the first route segment using the second mode of transportation is added to the route.
52. An electronic device, comprising: one or more processors; Memory; as well as One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for: while displaying the route configuration user interface via the display generation component, detecting, via the one or more input devices, a first user input corresponding to a request to add a first destination to the route using the first mode of transportation; in response to detecting the first user input, adding the first destination using the first mode of transportation to the route; detecting, via the one or more input devices, a second user input corresponding to a request to add a second destination to the route using a second mode of transportation different from the first mode of transportation; as well as In response to detecting the second user input, the second destination using the second mode of transportation is added to the route.
53. A non-transitory computer-readable storage medium storing one or more programs, the one or more programs comprising instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform a method comprising: while displaying the route configuration user interface via the display generation component, detecting, via the one or more input devices, a first user input corresponding to a request to add a first destination to the route using the first mode of transportation; in response to detecting the first user input, adding the first destination using the first mode of transportation to the route; detecting, via the one or more input devices, a second user input corresponding to a request to add a second destination to the route using a second mode of transportation different from the first mode of transportation; as well as In response to detecting the second user input, the second destination using the second mode of transportation is added to the route.
54. An electronic device, comprising: one or more processors; Memory; means for detecting, via one or more input devices, a first user input corresponding to a request to add a first destination to a route using a first mode of transportation while displaying the route configuration user interface via the display generation component; means for adding the first destination using the first mode of transportation to the route in response to detecting the first user input; means for detecting, via the one or more input devices, a second user input corresponding to a request to add a second destination to the route using a second mode of transportation different from the first mode of transportation; as well as In response to detecting the second user input, means for adding the second destination using the second mode of transportation to the route.
55. An information processing device for use in an electronic device, the information processing device comprising: means for detecting, via one or more input devices, a first user input corresponding to a request to add a first destination to a route using a first mode of transportation while displaying the route configuration user interface via the display generation component; means for adding the first destination using the first mode of transportation to the route in response to detecting the first user input; means for detecting, via the one or more input devices, a second user input corresponding to a request to add a second destination to the route using a second mode of transportation different from the first mode of transportation; as well as In response to detecting the second user input, means for adding the second destination using the second mode of transportation to the route.
56. An electronic device, comprising: one or more processors; Memory; as well as One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for performing any of the methods according to claims 35 to 51.
57. A non-transitory computer-readable storage medium storing one or more programs, wherein the one or more programs include instructions that, when executed by one or more processors of an electronic device, cause the electronic device to perform any of the methods according to claims 35 to 51.
58. An electronic device, comprising: one or more processors; Memory; as well as Means for performing any of the methods according to claims 35 to 51.
59. An information processing device for use in an electronic device, the information processing device comprising: Means for performing any of the methods according to claims 35 to 51.
Citation Information
Patent Citations
Method and apparatus for integrating manual input
US20020015024A1
Gestures for touch sensitive input devices
US20060026521A1
Gestures for touch sensitive input devices
US20060026536A1
Virtual input device placement on a touch screen user interface
US20060033724A1
Multipoint touchscreen
US20060097991A1