Cruise control user interface

Abstract

The present disclosure generally relates to managing a cruise control setting. A cruise control indicator is displayed at a location corresponding to a cruise control speed concurrently with a textual indication of the cruise control speed. In response to receiving an input, the textual indication ceases to be displayed after a non-zero duration while the cruise control indicator continues to be displayed.

Description

[0001] Cross-reference to related applications

[0002] This patent application claims priority to U.S. Patent Application No. 18 / 103,376, entitled "CRUISE CONTROL USER INTERFACES," filed January 30, 2023, and U.S. Provisional Patent Application No. 63 / 397,869, entitled "CRUISE CONTROL USER INTERFACES," filed August 14, 2022. The entire contents of each of these patent applications are incorporated herein by reference. Technical Field

[0003] This disclosure relates generally to computer user interfaces, and more specifically to techniques for managing cruise control settings. Background Technology

[0004] Cruise control is a feature used to control things like a vehicle's speed. There are several types of cruise control, including conventional cruise control and adaptive cruise control. Conventional cruise control typically maintains a fixed speed. Adaptive cruise control typically adjusts the speed automatically based on traffic conditions, such as the speed of vehicles ahead. Summary of the Invention

[0005] However, some technologies used to manage cruise control settings with electronic devices are often cumbersome and inefficient. For example, some existing technologies use complex and time-consuming user interfaces that may involve multiple keystrokes or button presses. These technologies require more time than necessary, resulting in wasted user time and device power. This latter consideration is particularly important in battery-powered devices.

[0006] Therefore, this technology provides electronic devices with a faster and more efficient method and interface for managing cruise control settings. Such methods and interfaces can optionally supplement or replace other methods for managing cruise control settings. These methods and interfaces reduce the cognitive burden on the user and result in a more efficient human-machine interface. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charging cycles.

[0007] According to some embodiments, a method is described. The method includes: at a computer system, wherein the computer system communicates with one or more display generating components and one or more input devices: simultaneously, via the one or more display generating components and as part of an instrument cluster, displaying a cruise control indicator at a location corresponding to a cruise control speed, and displaying a text indication of that cruise control speed; receiving a first input via the one or more input devices while simultaneously displaying the cruise control indicator and the text indication of that cruise control speed; and in response to receiving the first input, ceasing the display of the text indication of that cruise control speed via the one or more display generating components after a non-zero duration, while continuing to display the cruise control indicator at the location corresponding to the cruise control speed via the one or more display generating components.

[0008] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components and one or more input devices. The one or more programs include instructions for simultaneously: displaying a cruise control indicator at a location corresponding to a cruise control speed, and displaying a text indication of that cruise control speed, via the one or more display generation components and the text indication of that cruise control speed; receiving a first input via the one or more input devices while simultaneously displaying the cruise control indicator and the text indication of that cruise control speed; and, in response to receiving the first input, ceasing the display of the text indication of that cruise control speed via the one or more display generation components after a non-zero duration, while continuing to display the cruise control indicator at the location corresponding to the cruise control speed via the one or more display generation components.

[0009] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components and one or more input devices. The one or more programs include instructions for simultaneously: displaying a cruise control indicator at a location corresponding to a cruise control speed, and displaying a text indication of that cruise control speed, via the one or more display generation components and as part of an instrument cluster; receiving a first input via the one or more input devices while simultaneously displaying the cruise control indicator and the text indication of that cruise control speed; and, in response to receiving the first input, ceasing the display of the text indication of that cruise control speed via the one or more display generation components after a non-zero duration, while continuing to display the cruise control indicator at the location corresponding to the cruise control speed via the one or more display generation components.

[0010] According to some embodiments, a computer system is described. The computer system is configured to communicate with one or more display generation components and one or more input devices and includes: one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for simultaneously: displaying a cruise control indicator at a location corresponding to a cruise control speed, and displaying a text indication of the cruise control speed, via the one or more display generation components and as part of an instrument cluster; receiving a first input via the one or more input devices while simultaneously displaying the cruise control indicator and the text indication of the cruise control speed; and, in response to receiving the first input, ceasing the display of the text indication of the cruise control speed via the one or more display generation components after a non-zero duration, while continuing to display the cruise control indicator at the location corresponding to the cruise control speed via the one or more display generation components.

[0011] According to some embodiments, a computer system configured to communicate with one or more display generating components and one or more input devices is described. The computer system includes: components for simultaneously displaying a cruise control indicator at a location corresponding to a cruise control speed, and displaying a textual indication of the cruise control speed, via the one or more display generating components and as part of an instrument cluster; components for receiving a first input via the one or more input devices while simultaneously displaying the cruise control indicator and the textual indication of the cruise control speed; and components for stopping the display of the textual indication of the cruise control speed via the one or more display generating components after a non-zero duration in response to receiving the first input, while continuing to display the cruise control indicator at the location corresponding to the cruise control speed via the one or more display generating components.

[0012] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with one or more display generation components and one or more input devices. The one or more programs include instructions for simultaneously: displaying a cruise control indicator and a text indication of the cruise control speed at a location corresponding to the cruise control speed via the one or more display generation components and as part of an instrument cluster; receiving a first input via the one or more input devices while simultaneously displaying the cruise control indicator and the text indication of the cruise control speed; and, in response to receiving the first input, ceasing the display of the text indication of the cruise control speed via the one or more display generation components after a non-zero duration, while continuing to display the cruise control indicator at the location corresponding to the cruise control speed via the one or more display generation components.

[0013] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.

[0014] Therefore, faster and more efficient methods and interfaces are provided for managing cruise control settings, thereby improving the effectiveness, efficiency, and user satisfaction of such devices. These methods and interfaces can complement or replace other methods used to manage cruise control settings. Attached Figure Description

[0015] To better understand the various embodiments described, reference should be made to the following detailed description in conjunction with the accompanying drawings, wherein similar reference numerals indicate corresponding parts in all the drawings.

[0016] Figure 1A This is a block diagram illustrating a portable multi-functional device with a touch-sensitive display according to some implementation schemes.

[0017] Figure 1B This is a block diagram illustrating exemplary components for event handling according to some implementation schemes.

[0018] Figure 2 Examples of portable multi-functional devices with touchscreens according to some implementation schemes are shown.

[0019] Figure 3 This is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to some implementation schemes.

[0020] Figure 4A An exemplary user interface for a menu applied to a portable multi-functional device, according to some implementation schemes, is illustrated.

[0021] Figure 4B An exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display is illustrated according to some embodiments.

[0022] Figure 5A Examples of personal electronic devices according to some implementation schemes are shown.

[0023] Figure 5B This is a block diagram illustrating a personal electronic device according to some implementation schemes.

[0024] Figures 6A to 6L Exemplary techniques for managing cruise control settings according to some implementation schemes are illustrated.

[0025] Figure 7 This is a flowchart illustrating a method for setting up cruise control according to some implementation schemes. Detailed Implementation

[0026] The following description illustrates exemplary methods, parameters, etc. However, it should be understood that such description is not intended to limit the scope of this disclosure, but is provided as a description of exemplary embodiments.

[0027] There is a need for electronic devices that provide efficient methods and interfaces for managing cruise control settings. Such technologies can reduce the cognitive burden on users of cruise control, thereby increasing productivity and safety. Furthermore, these technologies can reduce processor and battery power that would otherwise be wasted on redundant user input.

[0028] under Figures 1A to 1B , Figure 2 , Figure 3 , Figures 4A to 4B and Figures 5A to 5B A description of an exemplary device for managing event notifications is provided. Figures 6A to 6L Exemplary techniques for managing cruise control settings according to some implementation schemes are illustrated. Figure 7 This is a flowchart illustrating a method for setting up cruise control according to some implementation schemes. Figures 6A to 6L The user interface in the document is used to illustrate the processes described below, including... Figure 7 The process in.

[0029] The processes described below enhance device operability and make the user-device interface more efficient through various technologies (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), including providing users with improved visual feedback, reducing the amount of input required to perform operations, providing additional control options without cluttering the user interface with additional displayed controls, and performing operations when a set of conditions are met without further user input and / or additional technologies. These technologies also reduce power consumption and extend device battery life by enabling users to use the device faster and more efficiently.

[0030] Furthermore, in methods described herein where one or more steps depend on the satisfaction of one or more conditions, it should be understood that the method may be repeated in multiple repetitions such that, during the repetitions, all conditions determining the steps in the method are satisfied in different repetitions of the method. For example, if the method requires performing a first step (if the condition is satisfied) and a second step (if the condition is not satisfied), those skilled in the art will know that the stated steps are repeated until both the conditions are satisfied and not satisfied (in no particular order). Thus, a method described as having one or more steps depending on the satisfaction of one or more conditions can be rewritten as a method that repeats until each condition described in the method is satisfied. However, this does not require the system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing discretionary operations based on the satisfaction of the corresponding one or more conditions, and thus to determine whether possible conditions have been satisfied without explicitly repeating the steps of the method until all conditions determining the steps in the method are satisfied. Those skilled in the art will also understand that, similar to methods having discretionary steps, a system or computer-readable storage medium may repeat the steps of the method multiple times as needed to ensure that all discretionary steps have been performed.

[0031] Although the following description uses the terms "first," "second," etc., to describe various elements, these elements should not be limited by the terms. In some embodiments, these terms are used to distinguish one element from another. For example, a first touch may be referred to as a second touch, and similarly, a second touch may be referred to as a first touch, without departing from the scope of the various described embodiments. In some embodiments, a first touch and a second touch are two separate references to the same touch. In some embodiments, both a first touch and a second touch are touches, but they are not the same touch.

[0032] The terminology used in the description of the various described embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and in the appended claims, the singular forms “a” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and covers any and all possible combinations of one or more of the associated listed items. It will also be understood that the terms “comprising” and / or “including” as used in this specification specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0033] Depending on the context, the term "if" may optionally be interpreted as meaning "when," "in response to," or "in response to detection." Similarly, depending on the context, the phrases "if it is determined..." or "if [the stated condition or event] is detected" may optionally be interpreted as meaning "in response to determining..." or "in response to detecting [the stated condition or event]."

[0034] Implementations of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some implementations, the device is a portable communication device, such as a mobile phone, that also includes other functions such as PDA and / or music player functionality. Exemplary implementations of portable multi-functional devices include, but are not limited to, those from Apple Inc. (Cupertino, California). Devices, iPod Equipment and Device. Optionally, other portable electronic devices may be used, such as laptop computers or tablet computers with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). In some embodiments, the electronic device is a computer system that communicates with a display generating component (e.g., via wireless communication, via wired communication). The display generating component is configured to provide visual output, such as a display via a CRT monitor, a display via an LED monitor, or a display via image projection. In some embodiments, the display generating component is integrated with the computer system. In some embodiments, the display generating component is separate from the computer system. As used herein, “display” content includes displaying content (e.g., video data rendered or decoded by display controller 156) by sending data (e.g., image data or video data) to an integrated or external display generating component via a wired or wireless connection to visually generate content.

[0035] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device may optionally include one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick.

[0036] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications.

[0037] Various applications running on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the respective applications. In this way, the device's common physical architecture (such as the touch-sensitive surface) optionally utilizes a user interface that is intuitive and clear to the user to support various applications.

[0038] Now let’s turn our attention to implementation schemes for portable devices with touch-sensitive displays. Figure 1AThis is a block diagram illustrating a portable multi-functional device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a “touchscreen” for convenience, and is sometimes referred to as or called a “touch-sensitive display system.” Device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more haptic output generators 167 for generating haptic output on device 100 (e.g., generating haptic output on a touch-sensitive surface such as the touch-sensitive display system 112 of device 100 or the touchpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.

[0039] As used in this specification and claims, the term "intensity" of contact on a tactile surface refers to the force or pressure (force per unit area) of a contact (e.g., finger contact) on a tactile surface, or to a substitute (alternative) for the force or pressure of a contact on a tactile surface. The intensity of contact has a range of values ​​that includes at least four different values ​​and more typically hundreds of different values ​​(e.g., at least 256). The intensity of contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the tactile surface are optionally used to measure the force at different points on the tactile surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the tactile surface. Alternatively, the size and / or variation of the contact area detected on the touch-sensitive surface, the capacitance and / or variation of the touch-sensitive surface near the contact, and / or the resistance and / or variation of the touch-sensitive surface near the contact may optionally be used as substitutes for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether an intensity threshold (e.g., the intensity threshold is described in units corresponding to the substitute measurement) has been exceeded. In some embodiments, the substitute measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold (e.g., the intensity threshold is a pressure threshold measured in units of pressure) has been exceeded. Using the intensity of the contact as an attribute of user input allows the user to access additional device functions that would otherwise be inaccessible to the user on a smaller device with limited physical space, which is used (e.g., on a touch-sensitive display) to display an indication and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).

[0040] As used in this specification and claims, the term "haptic output" refers to a physical displacement of the device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., the housing), or a displacement of a component relative to the center of mass of the device, which is detected by the user using the user's tactile sense. For example, when the device or a component of the device comes into contact with a touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical characteristics of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or touchpad) may optionally be interpreted by the user as a "press-click" or "release-click" on a physically actuated button. In some cases, the user will feel a tactile sensation, such as a "press-click" or "release-click," even when a physically actuated button associated with the touch-sensitive surface, which has been physically pressed (e.g., displaced) by the user's movement, does not move. As another example, even when the smoothness of the tactile surface remains unchanged, movement of the tactile surface can optionally be interpreted or perceived by the user as the “roughness” of the tactile surface. While such interpretations of touch by users will be limited by the individualized sensory perceptions of the user, many sensory perceptions of touch are common to most users. Therefore, when a tactile output is described as corresponding to a specific sensory perception of the user (e.g., “press click,” “release click,” “roughness”), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or its components that will generate the sensory perception of a typical (or common) user.

[0041] It should be understood that device 100 is merely an example of a portable multifunctional device, and device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of these components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both, including one or more signal processing and / or application-specific integrated circuits.

[0042] Memory 102 optionally includes high-speed random access memory, and also optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.

[0043] Peripheral interface 118 can be used to couple the device's input and output peripherals to CPU 120 and memory 102. The one or more processors 120 run or execute various software programs (such as computer programs (e.g., including instructions)) and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.

[0044] RF (Radio Frequency) circuit 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuit 108 converts electrical signals into electromagnetic signals and vice versa, and communicates with communication networks and other communication devices via these electromagnetic signals. RF circuit 108 optionally includes well-known circuitry for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, Subscriber Identity Module (SIM) cards, memory, etc. RF circuit 108 optionally communicates wirelessly with networks and other devices, such as the Internet (also known as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular phone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuit 108 optionally includes well-known circuitry for detecting near-field communication (NFC) fields, such as via short-range communication radio components. Wireless communication may optionally employ any of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed ​​Downlink Packet Access (HSDPA), High-Speed ​​Uplink Packet Access (HSUPA), Evolution, Pure Data (EV-DO), HSPA, HSPA+, Dual-Unit HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), and Wi-Fi (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE...). 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Messaging Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence with Extended Utility (SIMPLE), Instant Messaging and Presence Service (IMPS)) and / or Short Message Service (SMS), or any other suitable communication protocol that has not been developed as of the date of this document submission.

[0045] Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between the user and device 100. Audio circuitry 110 receives audio data from peripheral interface 118, converts the audio data into electrical signals, and transmits the electrical signals to speaker 111. Speaker 111 converts the electrical signals into sound waves that are audible to humans. Audio circuitry 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuitry 110 converts the electrical signals into audio data and transmits the audio data to peripheral interface 118 for processing. Audio data is optionally retrieved by peripheral interface 118 from and / or transmitted to memory 102 and / or RF circuitry 108. In some embodiments, audio circuitry 110 also includes a headset jack (e.g., ...). Figure 2 (212 in the text). The headset jack provides an interface between the audio circuitry 110 and a removable audio input / output peripheral device, such as an output-only headphone or a headset with both output (e.g., a single-ear or dual-ear headphone) and input (e.g., a microphone).

[0046] I / O subsystem 106 couples input / output peripherals on device 100, such as touchscreen 112 and other input control devices 116, to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, optical sensor controller 158, depth camera controller 169, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive electrical signals from / send electrical signals to the other input control device 116. The other input control device 116 optionally includes physical buttons (e.g., push-buttons, rocker buttons, etc.), dial pads, slide switches, joysticks, click dials, etc. In some embodiments, input controller 160 is optionally coupled to (or not coupled to) any of the following: keyboard, infrared port, USB port, and pointing device such as mouse. One or more buttons (e.g., Figure 2 Optionally, 208) includes an increase / decrease button for volume control of speaker 111 and / or microphone 113. The one or more buttons optionally include a push-button (e.g., Figure 2(Ref. 206 in the original text). In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wireless communication or via wired communication). In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a touchpad, as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking user gestures (e.g., hand gestures and / or air gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system. In some implementations, air gestures are gestures detected without the user touching an input element that is part of the device (or independently of an input element that is part of the device) and based on the detected movement of a part of the user's body through the air (including movement of the user's body relative to an absolute reference (e.g., the angle of the user's arm relative to the ground or the distance of the user's hand relative to the ground), movement relative to another part of the user's body (e.g., movement of the user's hand relative to the user's shoulder, movement of one of the user's hands relative to the user's other hand, and / or movement of the user's fingers relative to another finger or part of the user's hand), and / or absolute movement of a part of the user's body (e.g., a tapping gesture that includes the hand moving a predetermined amount and / or speed in a predetermined pose, or a shaking gesture that includes a predetermined speed or amount of rotation of a part of the user's body)).

[0047] A quick press of the push button optionally disengages the touchscreen 112 from its lock or optionally initiates a process of unlocking the device using gestures on the touchscreen, as described in U.S. Patent Application 11 / 322,549 (i.e., U.S. Patent No. 7,657,849), filed December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," the entire contents of which are incorporated herein by reference. A long press of the push button (e.g., 206) optionally powers the device 100 on or off. The function of one or more buttons is optionally user-customizable. The touchscreen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.

[0048] The touch-sensitive display 112 provides input and output interfaces between the device and the user. The display controller 156 receives electrical signals from and / or sends electrical signals to the touchscreen 112. The touchscreen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively, "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.

[0049] Touchscreen 112 has a touch-sensitive surface, sensor, or sensor array that accepts input from a user based on tactile and / or haptic contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction set in memory 102) detect contact on touchscreen 112 (and any movement or interruption of that contact) and translate the detected contact into interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on touchscreen 112. In an exemplary embodiment, the contact point between touchscreen 112 and the user corresponds to the user's finger.

[0050] Touchscreen 112 optionally employs LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, but other display technologies are used in other embodiments. Touchscreen 112 and display controller 156 optionally employ any of a variety of touch sensing technologies now known or to be developed hereafter, along with other proximity sensor arrays or other elements for determining one or more points of contact with touchscreen 112, to detect contact and any movement or interruption thereof. These various touch sensing technologies include, but are not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as that from Apple Inc. (Cupertino, California). and iPod The technology used.

[0051] In some embodiments of the touchscreen 112, the touch-sensitive display optionally resembles a multi-touch touchpad described in the following U.S. patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.) and / or U.S. Patent Publication 2002 / 0015024A1, each of which is incorporated herein by reference in its entirety. However, the touchscreen 112 displays visual output from the device 100, while the touch-sensitive touchpad does not provide visual output.

[0052] The touch-sensitive display in some embodiments of the touchscreen 112 is described in the following applications: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, “Multipoint Touch Surface Controller”; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, “Multipoint Touchscreen”; (3) U.S. Patent Application No. 10 / 903,964, filed July 30, 2004, “Gestures For Touch Sensitive Input Devices”; (4) U.S. Patent Application No. 11 / 048,264, filed January 31, 2005, “Gestures For Touch Sensitive Input Devices”; and (5) U.S. Patent Application No. 11 / 038,590, filed January 18, 2005, “Mode-Based Graphical User Interfaces For Touch Sensitive Input”. (6) U.S. Patent Application No. 11 / 228,758, filed September 16, 2005, “Virtual Input Device Placement On A Touch Screen User Interface”; (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, “Operation Of A Computer With A Touch Screen Interface”; (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”; and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, “Multi-Functional Hand-Held Device”. The full text of all these applications is incorporated herein by reference.

[0053] Touchscreen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. Users optionally use any suitable object or accessory such as a stylus, finger, etc., to interact with touchscreen 112. In some embodiments, the user interface is designed to operate primarily through finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of ​​a finger on the touchscreen. In some embodiments, the device translates coarse finger-based input into precise pointer / cursor positioning or commands for performing the user-desired actions.

[0054] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of ​​the device that, unlike the touchscreen, does not display visual output. Optionally, the touchpad is a touch-sensitive surface separate from the touchscreen 112, or an extension of the touch-sensitive surface formed by the touchscreen.

[0055] The device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., light-emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of power in the portable device.

[0056] The device 100 may optionally also include one or more optical sensors 164. Figure 1AAn optical sensor 164 coupled to an optical sensor controller 158 in the I / O subsystem 106 is shown. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with an imaging module 143 (also called a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, facing away from a touchscreen display 112 on the front of the device, allowing the touchscreen display to be used as a viewfinder for still image and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, allowing images of the user to be optionally acquired for video conferencing while the user views other video conferencing participants on the touchscreen display. In some embodiments, the positioning of the optical sensor 164 can be changed by the user (e.g., by rotating the lenses and sensors within the device housing), allowing a single optical sensor 164 to be used in conjunction with the touchscreen display for both video conferencing and still image and / or video image acquisition.

[0057] The device 100 optionally also includes one or more depth camera sensors 175. Figure 1A A depth camera sensor is shown coupled to a depth camera controller 169 in I / O subsystem 106. Depth camera sensor 175 receives data from the environment to create a 3D model of an object (e.g., a face) within the scene from a viewpoint (e.g., the depth camera sensor). In some embodiments, in conjunction with imaging module 143 (also referred to as a camera module), depth camera sensor 175 is optionally used to determine depth maps of different portions of an image captured by imaging module 143. In some embodiments, the depth camera sensor is located at the front of device 100, such that user images with depth information are optionally acquired for video conferencing while a user views other video conferencing participants on a touchscreen display, and selfies with depth map data are captured. In some embodiments, depth camera sensor 175 is located at the rear of the device, or both the rear and front of device 100. In some embodiments, the positioning of depth camera sensor 175 can be changed by the user (e.g., by rotating a lens and sensor within the device housing), such that depth camera sensor 175 is used in conjunction with a touchscreen display for both video conferencing and still image and / or video image acquisition.

[0058] The device 100 may optionally also include one or more contact strength sensors 165. Figure 1AA contact strength sensor is shown coupled to a strength sensor controller 159 in I / O subsystem 106. The contact strength sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electro-force sensors, piezoelectric sensors, optical force sensors, capacitive touch-sensitive surfaces, or other strength sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). The contact strength sensor 165 receives contact strength information (e.g., pressure information or a substitute for pressure information) from the environment. In some embodiments, at least one contact strength sensor is arranged juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact strength sensor is located on the rear of device 100, opposite to the touchscreen display 112 located on the front of device 100.

[0059] The device 100 optionally also includes one or more proximity sensors 166. Figure 1A A proximity sensor 166 coupled to a peripheral device interface 118 is shown. Alternatively, the proximity sensor 166 may optionally be coupled to an input controller 160 in an I / O subsystem 106. The proximity sensor 166 may optionally be configured as described in the following U.S. patent applications: 11 / 241,839, entitled "Proximity Detector In Handheld Device"; 11 / 240,788, entitled "Proximity Detector In Handheld Device"; 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; 11 / 586,862, entitled "Automated Response To And Sensing Of User Activity In Portable Devices"; and 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", the entire contents of which are incorporated herein by reference. In some implementations, the proximity sensor is turned off and the touchscreen 112 is disabled when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call).

[0060] The device 100 may optionally also include one or more tactile output generators 167. Figure 1AA haptic output generator coupled to a haptic feedback controller 161 in I / O subsystem 106 is shown. The haptic output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components; and / or electromechanical devices for converting energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components for converting electrical signals into haptic outputs on the device). A contact intensity sensor 165 receives haptic feedback generation instructions from a haptic feedback module 133 and generates a haptic output on device 100 that can be felt by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed or adjacent to a haptic surface (e.g., haptic display system 112) and optionally generates the haptic output by moving the haptic surface vertically (e.g., in / outward from the surface of device 100) or laterally (e.g., backward and forward in the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is located on the rear of the device 100, opposite to the touch screen display 112 located on the front of the device 100.

[0061] The device 100 may optionally also include one or more accelerometers 168. Figure 1A An accelerometer 168 coupled to a peripheral device interface 118 is shown. Alternatively, the accelerometer 168 may be coupled to an input controller 160 in an I / O subsystem 106. The accelerometer 168 may optionally be configured as described in the following U.S. Patent Publications: 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and 20060017692, entitled "Methods And Apparatuses For Operating A Portable DeviceBased On An Accelerometer," both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed on a touchscreen display in portrait or landscape view based on analysis of data received from one or more accelerometers. Device 100 may optionally include, in addition to the accelerometer 168, a magnetometer and a GPS (or GLONASS or other global navigation system) receiver for acquiring information about the location and orientation (e.g., portrait or landscape) of device 100.

[0062] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Furthermore, in some embodiments, memory 102 ( Figure 1A ) or 370 ( Figure 3 Storage device / global internal state 157, such as Figure 1A and Figure 3 As shown in the figure. Device / global internal state 157 includes one or more of the following: active application state, which indicates which applications (if any) are currently active; display state, indicating what applications, views or other information occupy various areas of the touch screen display 112; sensor state, including information obtained from various sensors and input control devices 116 of the device; and position information relating to the device's position and / or orientation.

[0063] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or embedded operating systems such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.

[0064] The communication module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are adapted to be directly coupled to other devices or indirectly coupled via a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is connected to… (Trademark of Apple Inc.) The same or similar and / or compatible multi-pin (e.g., 30-pin) connectors used in Apple Inc. devices.

[0065] The contact / motion module 130 optionally detects contact with the touchscreen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., touchpads or physical click-based rotary dials). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether a contact has occurred (e.g., detecting a finger press event), determining the contact intensity (e.g., the force or pressure of the contact, or an alternative to force or pressure), determining whether there is movement of the contact and tracking movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or contact disconnection). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to single-point contact (e.g., single-finger contact) or multi-point simultaneous contact (e.g., "multi-touch" / multiple-finger contact). In some implementations, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.

[0066] In some implementations, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by the user (e.g., determining whether the user has “clicked” an icon). In some implementations, at least a subset of the intensity thresholds is determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a specific physical actuator and can be adjusted without changing the physical hardware of device 100). For example, the mouse “click” threshold of a touchpad or touchscreen can be set to any of a wide range of predefined thresholds without changing the touchpad or touchscreen display hardware. Additionally, in some specific implementations, the user of the device is provided with software settings for adjusting one or more intensity thresholds in a set (e.g., by adjusting the individual intensity thresholds and / or by adjusting multiple intensity thresholds at once using system-level clicks on the “intensity” parameter).

[0067] The touch / motion module 130 optionally detects gesture input performed by the user. Different gestures on a touch-sensitive surface have different contact patterns (e.g., different movements, timings, and / or intensities of the detected contact). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event, and then detecting a finger lift-off (lift-away) event at the same (or substantially the same) location as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on a touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and subsequently detecting a finger lift-off (lift-away) event.

[0068] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other displays, including components for altering the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.

[0069] In some implementations, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from applications, etc., specifying the graphics to be displayed, and also receives coordinate data and other graphic attribute data if necessary, and then generates screen image data for output to the display controller 156.

[0070] The haptic feedback module 133 includes various software components for generating instructions which are used by the haptic output generator 167 to generate haptic output at one or more locations on the device 100 in response to user interaction with the device 100.

[0071] Optionally, the text input module 134, a component of the graphics module 132, provides a soft keyboard for entering text in various applications (e.g., the contact module 137, the email client module 140, the IM module 141, the browser module 147, and any other application that requires text input).

[0072] GPS module 135 determines the device's location and provides this information for use in various applications (e.g., to telephone module 138 for use in location-based dialing; to camera module 143 as image / video metadata; and to applications providing location-based services such as weather widgets, local yellow pages widgets, and map / navigation widgets). Application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof:

[0073] ●Contacts module 137 (sometimes called address book or contact list);

[0074] ● Telephone module 138;

[0075] ●Video conferencing module 139;

[0076] ●Email client module 140;

[0077] ●Instant Messaging (IM) module 141;

[0078] ● Fitness support module 142;

[0079] ● Camera module 143 for still images and / or video images;

[0080] ●Image Management Module 144;

[0081] ●Video player module;

[0082] ●Music player module;

[0083] ● Browser module 147;

[0084] ● Calendar module 148;

[0085] ● Widget module 149, which optionally includes one or more of the following: weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5 and other widgets acquired by the user, as well as user-created widgets 149-6;

[0086] ● Wrapper module 150 for creating user-created widgets 149-6;

[0087] ●Search module 151;

[0088] ● Video and music player module 152, which combines a video player module and a music player module;

[0089] ●Notepad module 153;

[0090] ●Map module 154; and / or

[0091] ● Online video module 155.

[0092] Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, Java-enabled applications, encryption, digital rights management, speech recognition, and speech duplication.

[0093] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., in the application internal state 192 of the contact module 137 stored in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via the telephone module 138, video conferencing module 139, email client module 140, or IM module 141; and so on.

[0094] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, telephone module 138 is optionally used to input character sequences corresponding to telephone numbers, access one or more telephone numbers in contact module 137, modify input telephone numbers, dial corresponding telephone numbers, initiate conversations, and disconnect or hang up when a conversation is completed. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.

[0095] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138, video conferencing module 139 includes executable instructions to initiate, conduct, and terminate video conferences between the user and one or more other participants based on user instructions.

[0096] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user commands. Incorporating image management module 144, email client module 140 makes it very easy to create and send emails containing still images or video images captured by camera module 143. Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for: entering a character sequence corresponding to an instant message, modifying previously entered characters, transmitting a corresponding instant message (e.g., using Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocols for telephone-based instant messaging or using XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving an instant message, and viewing received instant messages. In some implementations, the transmitted and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Services (EMS). As used herein, “instant message” means both telephone-based messages (e.g., messages sent using SMS or MMS) and internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).

[0097] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, fitness support module 142 includes executable instructions for creating fitness activities (e.g., with time, distance, and / or calorie burning goals); communicating with fitness sensors (executive devices); receiving fitness sensor data; calibrating sensors used to monitor fitness; selecting and playing music for fitness activities; and displaying, storing, and transmitting fitness data.

[0098] In conjunction with the touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, camera module 143 includes executable instructions for: capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.

[0099] Incorporating the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable instructions for arranging, modifying (e.g., editing) or otherwise manipulating, marking, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.

[0100] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, browser module 147 includes executable instructions for browsing the Internet according to user instructions, including searching, linking to, receiving, and displaying web pages or portions thereof, as well as links to attachments and other files on web pages.

[0101] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions to create, display, modify, and store calendars and associated data (e.g., calendar entries, to-dos, etc.) according to user instructions.

[0102] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is optionally a micro-application downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or a user-created micro-application (e.g., user-created widget 149-6). In some embodiments, the widget includes HTML (Hypertext Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, the widget includes XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! widgets).

[0103] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget creator module 150 can optionally be used by the user to create widgets (e.g., to convert user-specified portions of a webpage into widgets).

[0104] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.

[0105] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions allowing users to download and play back recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).

[0106] Combining the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the notepad module 153 includes executable instructions for creating and managing notes, to-do items, etc., according to user instructions.

[0107] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 is optionally used to receive, display, modify, and store maps and map-related data (e.g., driving directions, data related to shops and other points of interest at or near a specific location, and other location-based data) according to user instructions.

[0108] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, the online video module 155 includes instructions for allowing users to access, browse, receive (e.g., via streaming and / or downloading), play back (e.g., on the touchscreen or on an external display connected via external port 124), send emails with links to specific online videos, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, an instant messaging module 141 is used instead of the email client module 140 to send links to specific online videos. Additional descriptions of the online video application can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are incorporated herein by reference in their entirety.

[0109] Each of the modules and applications described above corresponds to an executable set of instructions for performing one or more functions described above and the methods described in this patent application (e.g., computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), processes, or modules; therefore, various subsets of these modules may optionally be combined or otherwise rearranged in various embodiments. For example, a video player module may optionally be combined with a music player module into a single module (e.g., Figure 1A (e.g., video and music player module 152). In some embodiments, memory 102 optionally stores subgroups of the aforementioned modules and data structures. Additionally, memory 102 optionally stores other modules and data structures not described above.

[0110] In some implementations, device 100 is a device on which the operation of a predefined set of functions is solely performed via a touchscreen and / or touchpad. By using a touchscreen and / or touchpad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push-buttons, dials, etc.) on device 100 is optionally reduced.

[0111] A predefined set of functions, uniquely performed via a touchscreen and / or touchpad, optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 from any user interface displayed on device 100 to the main menu, home menu, or root menu. In such embodiments, a "menu button" is implemented using a touchpad. In some other embodiments, the menu button is a physical push-button or other physical input control device, rather than a touchpad.

[0112] Figure 1B This is a block diagram illustrating exemplary components for event handling according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3 This includes an event classifier 170 (e.g., in operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).

[0113] Event classifier 170 receives event information and determines the application 136-1 and application view 191 of application 136-1 to which the event information should be delivered. Event classifier 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or running. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information should be delivered.

[0114] In some implementations, the application internal state 192 includes additional information such as one or more of the following: recovery information to be used when the application 136-1 resumes execution, user interface state information indicating that information is being displayed or ready to be displayed by the application 136-1, a state queue for enabling the user to return to the previous state or view of the application 136-1, and a repeat / undo queue for the user's previous actions.

[0115] Event monitor 171 receives event information from peripheral device interface 118. The event information includes information about sub-events (e.g., user touches on touch-sensitive display 112 as part of a multi-touch gesture). Peripheral device interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuitry 110). The information received by peripheral device interface 118 from I / O subsystem 106 includes information from touch-sensitive display 112 or touch-sensitive surfaces.

[0116] In some implementations, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other implementations, peripheral device interface 118 transmits event information only when a significant event occurs (e.g., receiving input above a predetermined noise threshold and / or receiving input for a predetermined duration).

[0117] In some implementations, the event classifier 170 also includes a hit view determination module 172 and / or an activity event recognizer determination module 173.

[0118] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides a software process for determining where a sub-event has occurred within one or more views. A view consists of controls and other elements that the user can see on the display.

[0119] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the corresponding application) in which a touch is detected optionally corresponds to a procedural level within the application's procedural or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as the hit view, and the set of events identified as correct input is optionally determined at least in part based on the hit view of the initial touch that initiates a touch-based gesture.

[0120] The hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchical structure, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchical structure from which the sub-events should be processed. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events forming an event or potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source to which it was identified as the hit view.

[0121] The activity event recognizer determination module 173 determines which views(s) within the view hierarchy should receive a specific sub-event sequence. In some embodiments, the activity event recognizer determination module 173 determines that only the hit view should receive the specific sub-event sequence. In other embodiments, the activity event recognizer determination module 173 determines that all views including the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive the specific sub-event sequence. In other embodiments, even if the touch sub-event is entirely confined to the area associated with a particular view, higher views in the hierarchy will still remain actively participating views.

[0122] Event assigner module 174 assigns event information to event identifiers (e.g., event identifier 180). In embodiments that include active event identifier determination module 173, event assigner module 174 delivers event information to the event identifier determined by active event identifier determination module 173. In some embodiments, event assigner module 174 stores event information in an event queue, which is retrieved by the corresponding event receiver 182.

[0123] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or part of another module (such as contact / motion module 130) stored in memory 102.

[0124] In some implementations, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes a plurality of event recognizers 180. In other implementations, one or more of the event recognizers 180 are part of a separate module, which is a higher-level object such as a user interface toolkit or from which application 136-1 inherits methods and other properties. In some implementations, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handlers 190 optionally utilize or invoke the data updater 176, the object updater 177, or the GUI updater 178 to update the application's internal state 192. Alternatively, one or more application views in application view 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.

[0125] The corresponding event identifier 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event identifier 180 also includes at least one subset of metadata 183 and event delivery instructions 188 (which optionally include sub-event delivery instructions).

[0126] Event receiver 182 receives event information from event classifier 170. The event information includes information about sub-events, such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves touch movement, the event information optionally also includes the speed and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a longitudinal orientation to a lateral orientation, or vice versa), and the event information includes corresponding information about the device's current orientation (also referred to as device orientation).

[0127] Event comparator 184 compares event information with predefined event or sub-event definitions and determines the event or sub-event based on the comparison, or determines or updates the state of the event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 contains the definition of the event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in the event (e.g., 187-1 and / or 187-2) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, event 1 (187-1) is defined as a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift-off of a predetermined duration (touch end), a second touch (touch start) of a predetermined duration on the displayed object, and a second lift-off of a predetermined duration (touch end). In another example, event 2 (187-2) is defined as a drag on a displayed object. For example, dragging includes a touch (or contact) on the displayed object for a predetermined duration, movement of the touch on the touch-sensitive display 112, and lifting off the touch (end of touch). In some embodiments, the event also includes information for one or more associated event handlers 190.

[0128] In some implementations, event definition 186 includes definitions of events for corresponding user interface objects. In some implementations, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects the event handler associated with the sub-event and the object that triggered the hit test.

[0129] In some implementations, the definition of the corresponding event (187) also includes a delay action that delays the delivery of event information until it has been determined whether the sub-event sequence actually corresponds to or does not correspond to the event type of the event recognizer.

[0130] When the corresponding event recognizer 180 determines that the sub-event sequence does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events based on touch gestures are ignored. In this case, other event recognizers (if any) that remain active in the hit view continue to track and process the ongoing sub-events based on touch gestures.

[0131] In some embodiments, the corresponding event recognizer 180 includes metadata 183 having configurable attributes, flags, and / or lists instructing how the event delivery system should deliver sub-events to actively participating event recognizers. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing how or how event recognizers can interact with each other. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing whether sub-events are delivered to different levels in a view or programmatic hierarchy.

[0132] In some implementations, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates the event handler 190 associated with the event. In some implementations, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and delaying) the sub-events to the corresponding hit view. In some implementations, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with the flag acquires the flag and performs a predefined process.

[0133] In some implementations, event delivery instruction 188 includes a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with the sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or the actively participating view receives the event information and performs a predetermined process.

[0134] In some implementations, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some implementations, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the positioning of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on touch-sensitive display.

[0135] In some implementations, event handler 190 includes, or has access to, a data updater 176, an object updater 177, and a GUI updater 178. In some implementations, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other implementations, they are included in two or more software modules.

[0136] It should be understood that the above discussion regarding event handling for user touch on a touch-sensitive display also applies to other forms of user input used to operate the multifunction device 100 using an input device, and not all user input is initiated on the touchscreen. For example, mouse movement and mouse button presses optionally in conjunction with single or multiple keyboard presses or holds; touch movements on the touchpad, such as taps, drags, scrolls, etc.; stylus input; device movement; verbal commands; detected eye movements; biometric input; and / or any combination thereof may optionally be used as input corresponding to sub-events that define the event to be identified.

[0137] Figure 2A portable multifunction device 100 with a touchscreen 112 is illustrated according to some embodiments. The touchscreen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more graphics by gesturing over the graphics, for example, using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of one or more graphics occurs when the user breaks contact with one or more graphics. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or scrolling (from right to left, from left to right, up and / or down) of a finger already in contact with the device 100. In some specific embodiments or in some cases, unintentional contact with a graphic does not select the graphic. For example, a swipe gesture over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.

[0138] Device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, menu button 204 is optionally used to navigate to any application 136 of a set of applications optionally executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on touchscreen 112.

[0139] In some embodiments, device 100 includes a touchscreen 112, a menu button 204, a push-button 206 for powering on / off and locking the device, one or more volume control buttons 208, a SIM card slot 210, a headset jack 212, and a docking / charging external port 124. The push-button 206 is optionally used to power on / off the device by pressing the button and holding it in the pressed state for a predefined time interval; to lock the device by pressing the button and releasing it before the predefined time interval has elapsed; and / or to unlock the device or initiate an unlocking process. In another embodiment, device 100 also accepts voice input via microphone 113 for activating or deactivating certain functions. Device 100 also optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on the touchscreen 112, and / or one or more haptic output generators 167 for generating haptic outputs for a user of device 100.

[0140] Figure 3This is a block diagram of an exemplary multifunctional device with a display and a touch-sensitive surface according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a children's learning toy), gaming system, or control device (e.g., a home controller or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuitry (sometimes referred to as a chipset) that interconnects system components and controls communication between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touchscreen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, and a haptic output generator 357 for generating haptic output on device 300 (e.g., similar to the reference above). Figure 1A The described tactile output generator 167) and sensor 359 (e.g., optical sensor, accelerometer, proximity sensor, touch sensor and / or contact intensity sensor (similar to the one described above)) Figure 1A The described contact strength sensor 165). Memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. Memory 370 optionally includes one or more storage devices located remotely from CPU 310. In some embodiments, memory 370 stores information related to portable multifunction device 100. Figure 1A The memory 370 stores programs, modules, and data structures similar to those in the memory 102 of the portable multifunction device 100, or subsets thereof. Additionally, the memory 370 optionally stores additional programs, modules, and data structures not present in the memory 102 of the portable multifunction device 100. For example, the memory 370 of the device 300 optionally stores a drawing module 380, a rendering module 382, ​​a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while the portable multifunction device 100 (… Figure 1A The memory 102 may optionally not store these modules.

[0141] Figure 3Each of the elements described above is optionally stored in one or more memory devices of the previously mentioned memory devices. Each of the modules described above corresponds to a set of instructions for performing the functions described above. The modules or computer programs described above (e.g., instruction sets or including instructions) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), processes, or modules, and therefore various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores a subgroup of the modules and data structures described above. In addition, memory 370 optionally stores additional modules and data structures not described above.

[0142] Now let’s turn our attention to the implementation of the user interface, which is optionally implemented on, for example, a portable multifunction device 100.

[0143] Figure 4A An exemplary user interface for an application menu on a portable multifunction device 100 according to some embodiments is illustrated. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements or a subset or superset thereof:

[0144] ●Signal strength indicator 402 for wireless communications such as cellular signals and Wi-Fi signals;

[0145] ●Time 404;

[0146] ●Bluetooth indicator 405;

[0147] ● Battery status indicator 406;

[0148] ● Tray tray 408 features icons for frequently used applications, such as:

[0149] ○ The telephone module 138 has an icon 416 labeled "telephone", which optionally includes an indicator 414 indicating the number of missed calls or voicemail messages;

[0150] ○ An icon 418 labeled "Mail" in the email client module 140, which optionally includes an indicator 410 for the number of unread emails;

[0151] ○ The icon 420 labeled "Browser" in browser module 147; and

[0152] ○ The icon 422 labeled "iPod" for the video and music player module 152 (also known as the iPod (a trademark of Apple Inc.) module 152); and

[0153] ● Icons of other applications, such as:

[0154] ○The icon 424 of the IM module 141 marked as "Message";

[0155] ○The calendar module 148 has an icon 426 labeled "Calendar";

[0156] ○ The icon 428 of the image management module 144 is labeled "Photo".

[0157] ○ The icon 430 of camera module 143, which is labeled "camera";

[0158] ○ The icon 432 of the online video module 155, which is labeled "Online Video";

[0159] ○ The icon 434 labeled "Stock Market" in the Stock Market widget 149-2;

[0160] ○The icon 436 of the map module 154 that is labeled "map";

[0161] ○The weather widget 149-1 has icon 438 labeled "weather";

[0162] ○ The alarm clock widget 149-4 has an icon 440 labeled "clock";

[0163] ○ The icon 442 of the fitness support module 142 is labeled "fitness support";

[0164] ○ The icon 444 labeled "Notepad" in Notepad module 153; and

[0165] ○ Set an icon 446 labeled "Settings" for an application or module, which provides access to settings for device 100 and its various applications 136.

[0166] It should be pointed out that, Figure 4A The illustrated icon labels are merely exemplary. For example, icon 422 of video and music player module 152 is labeled "Music" or "Music Player". Other labels may be optionally used for various application icons. In some embodiments, the label of a particular application icon includes the name of the application corresponding to that particular application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to that particular application icon.

[0167] Figure 4B An example is illustrated having a touch-sensitive surface 451 (e.g., separate from the display 450 (e.g., touchscreen display 112)). Figure 3 A tablet device or touchpad 355) device (e.g., Figure 3An exemplary user interface on the device 300. The device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of the sensors 359) for detecting the intensity of contact on the tactile surface 451 and / or one or more tactile output generators 357 for generating tactile outputs for the user of the device 300.

[0168] While some examples of inputs on a reference touchscreen display 112 (which combines a touch-sensitive surface and a display) are given below, in some embodiments, the device detects inputs on a touch-sensitive surface separate from the display, such as... Figure 4B As shown in the diagram. In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a spindle (e.g., on the display (e.g., 450)). Figure 4B The spindle corresponding to 453 in the middle (e.g., Figure 4B (452 in the example). According to these embodiments, the device detects the position corresponding to the corresponding position on the display (e.g., in the example). Figure 4B In the middle, 460 corresponds to 468 and 462 corresponds to 470) is in contact with the touch-sensitive surface 451 (e.g., Figure 4B (460 and 462 in the text). Thus, when the touch-sensitive surface (e.g., ...) Figure 4B 451) and the display of a multi-functional device (e.g., Figure 4B When 450 is separated from the touch-sensitive surface, user input detected by the device on that touch-sensitive surface (e.g., touches 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods may be optionally used for other user interfaces described herein.

[0169] Additionally, while the examples below are given primarily with reference to finger input (e.g., finger touch, single-finger tap gesture, finger swipe gesture), it should be understood that in some implementations, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of a touch), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the touch). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is above the location of the tap gesture (e.g., instead of detection of touch, followed by cessation of touch detection). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or mouse and finger touch are optionally used simultaneously.

[0170] Figure 5AAn exemplary personal electronic device 500 is illustrated. Device 500 includes a body 502. In some embodiments, device 500 may include components relative to devices 100 and 300 (e.g., Figures 1A to 4B The device 500 may include some or all of the features described herein. In some embodiments, the device 500 has a touch-sensitive display 504, referred to below as a touchscreen 504. Alternatively, or in addition to the touchscreen 504, the device 500 may also have a display and a touch-sensitive surface. Similar to the cases of devices 100 and 300, in some embodiments, the touchscreen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of an applied contact (e.g., a touch). The one or more intensity sensors of the touchscreen 504 (or touch-sensitive surface) may provide output data representing the intensity of the touch. The user interface of the device 500 may respond to touches based on the intensity of the touch, meaning that touches of different intensities may invoke different user interface operations on the device 500.

[0171] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related applications: International Patent Application Serial No. PCT / US2013 / 040061, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Displaying UserInterface Objects Corresponding to an Application,” published as WIPO Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, filed November 11, 2013, entitled “Device, Method, and Graphical User Interface for Transitioning Between TouchInput to Display Output Relationships,” published as WIPO Publication No. WO / 2014 / 105276, each of which is incorporated herein by reference in its entirety.

[0172] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508 (if included) may be physical. Examples of physical input mechanisms include push-buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) allow device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watch straps, bangles, trousers, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow a user to wear device 500.

[0173] Figure 5B An exemplary personal electronic device 500 is depicted. In some embodiments, device 500 may include, relative to... Figure 1A , Figure 1B and Figure 3 Some or all of the components described. Device 500 has a bus 512 that operatively couples I / O portion 514 to one or more computer processors 516 and memory 518. I / O portion 514 may be connected to display 504, which may have touch-sensitive components 522 and optionally have an intensity sensor 524 (e.g., a contact intensity sensor). Furthermore, I / O portion 514 may be connected to communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular, and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 may optionally be a rotatable input device or a pressable input device and a rotatable input device. In some examples, input mechanism 508 may optionally be a button.

[0174] In some examples, the input mechanism 508 is optionally a microphone. The personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which are operatively connected to the I / O section 514.

[0175] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions, which, when executed by one or more computer processors 516, may cause the computer processors to perform, for example, the techniques described below, including process 700. Figure 7A computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, or device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media can include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on CD, DVD, or Blu-ray technology, and persistent solid-state storage such as flash memory, solid-state drives, etc. Personal electronic devices are not limited to... Figure 5B It can be the components and configurations, or it can include other components or additional components in a variety of configurations.

[0176] As used herein, the term "power indication" refers optionally to the power indication in devices 100, 300, and / or 500 ( Figure 1A , Figure 3 and Figures 5A to 5B A user-interactive graphical user interface object displayed on a screen. For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) optionally each constitute a functional representation.

[0177] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some specific implementations that include a cursor or other positional marker, the cursor acts as a "focus selector," such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), the cursor is positioned on a touch-sensitive surface (e.g., a...). Figure 3 The touchpad 355 or Figure 4B When an input (e.g., a press input) is detected on the touch-sensitive surface 451 of the display, the specific user interface element is adjusted according to the detected input. This applies to touchscreen displays (e.g., those capable of enabling direct interaction with user interface elements on the touchscreen display) Figure 1A The touch-sensitive display system 112 or Figure 4AIn some embodiments of the touchscreen 112, a touch detected on the touchscreen acts as a "focus selector," such that when input (e.g., a press input by touch) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, that particular user interface element is adjusted according to the detected input. In some embodiments, focus moves from one area of ​​the user interface to another without corresponding movement of the cursor or movement of a touch on the touchscreen display (e.g., moving focus from one button to another using tab keys or arrow keys); in these embodiments, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user-controlled user interface element (or a touch on the touchscreen display) that delivers the user-expected interaction with the user interface (e.g., by indicating to the device the element of the user interface that the user expects to interact with). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of the focus selector (e.g., a cursor, touch, or selection box) above the corresponding button will indicate to the user that they expect to activate the corresponding button (rather than other user interface elements shown on the device's display).

[0178] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of the contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected over a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted away, before or after contact begins to move, before contact ends, before or after contact intensity is detected to increase and / or before or after contact intensity decreases). The characteristic intensity of the contact is optionally based on one or more of the following: the maximum value of the contact intensity, the mean value of the contact intensity, the average value of the contact intensity, the value at the top 10% of the contact intensity, the half maximum value of the contact intensity, the 90% maximum value of the contact intensity, etc. In some embodiments, the duration of the contact is used when determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the contact intensity over time). In some implementations, the feature intensity is compared to a set of one or more intensity thresholds to determine whether a user has performed an action. For example, the set of one or more intensity thresholds may optionally include a first intensity threshold and a second intensity threshold. In this example, contact with a feature intensity not exceeding the first threshold results in a first action, contact with a feature intensity exceeding the first intensity threshold but not exceeding the second intensity threshold results in a second action, and contact with a feature intensity exceeding the second threshold results in a third action. In some implementations, a comparison between the feature intensity and one or more thresholds is used to determine whether one or more actions should be performed (e.g., whether to perform the corresponding action or abstain from performing the corresponding action) rather than to determine whether to perform the first or second action.

[0179] Now let’s turn our attention to the implementation of user interfaces (“UIs”) and associated processes on electronic devices (such as portable multifunction devices 100, 300 or 500).

[0180] Figures 6A to 6L Exemplary user interfaces for managing cruise control are illustrated according to some implementation schemes. The user interfaces in these figures are used to illustrate the processes described below, including... Figure 7 The process in.

[0181] Figure 6AA computer system 600 with a display 602 is illustrated. In some embodiments, the computer system 600 is integrated into and / or communicates with a vehicle. In some embodiments, the computer system 600 includes two displays. In some embodiments, the computer system 600 is part of a user wearable device such as a headset. In some embodiments, the computer system 600 includes one or more features of the electronic devices 100, 300, and 500 as described above.

[0182] exist Figure 6A At this location, computer system 600 displays an instrument cluster including a speedometer 604 and a power meter 606. Speedometer 604 provides an indication of speed (such as the vehicle's or computer system 600's current speed). Speedometer 604 includes a path 608. In some embodiments, this path is not visually displayed. In this embodiment, path 608 is displayed in an arc shape. In some embodiments, path 608 is not in an arc shape, but rather, for example, a straight line or another shape. Indicators 612 along path 608 indicate portions of path 608 corresponding to different speeds. For example, "120" is displayed adjacent to the portion of path 608 corresponding to a speed of 120 mph. For another example, "40" is displayed adjacent to the portion of path 608 corresponding to a speed of 40 mph. Speedometer 604 indicates the vehicle's speed in three ways: filling the first portion 610A of path 608 without filling the second portion 610B, a digital mph speed indicator 614A, and a digital kph speed indicator 614B.

[0183] exist Figure 6A At this location, the first portion 610A of path 608 indicates a speed of 64 mph based on how far the first portion 610A has extended along path 608 and / or the position of the first portion 610A. Similarly, a digital mph speed indicator 614A indicates a speed of 64 mph, while a digital kph speed indicator 614B indicates a corresponding speed of 103 kph. Therefore, the user of computer system 600 can quickly and accurately determine the vehicle's speed visually. Speedometer 604 also includes: a speed limit indicator 616A that provides an indication of the speed limit for the current location (e.g., street or highway); and a lane guidance indicator 616B that indicates that the driving lane is being monitored and will notify the user (e.g., visual, audio, and / or tactile warning) if the vehicle unintentionally leaves the driving lane. Figure 6A At this point, computer system 600 does not display the cruise control indicator because cruise control is not set / enabled.

[0184] exist Figure 6AAt this location, the power meter 606 includes a path 618 comprising a first portion 620 and a second portion 622. Path 618 is used to indicate power quantities, such as power being generated or stored (along the first portion 620) and / or power being used (along the second portion 622). Neither the first portion 620 nor the second portion 622 has any fill when no power is being used and no power is being generated. Figure 6A At this point, the amount of power the vehicle is using for driving is indicated by path 618, which is filled by fill 618A to a level corresponding to the amount of power currently in use. Fill 618B indicates the amount of power that is currently unavailable due to the power being displayed (e.g., indicating maximum power). For example, power can be limited because the vehicle's battery is cold and therefore cannot currently generate its full power and / or based on limitations set by the vehicle to allow it to reach its destination with limited battery power (e.g., the user has reached their destination and the vehicle determines that hard acceleration will result in insufficient battery power to reach the destination). Figure 6A At this point, end 618C of filler 618B indicates the maximum currently available power, and end 618D of filler 618B indicates the maximum power (e.g., under ideal conditions). Figure 6A At this point, the vehicle begins to accelerate. In addition, the computer system 600 detects user input to activate cruise control, and in response, activates cruise control and updates the instrument cluster accordingly, such as... Figure 6B As shown.

[0185] exist Figure 6B In response to a detected request to activate cruise control, computer system 600 activates cruise control, causing a cruise control indicator 630A and a text cruise control speed 630B to be displayed. Because cruise control is not activated, the cruise control indicator 630A and text cruise control speed 630B are displayed in an appearance indicating that cruise control is not activated (e.g., light color, gray, and / or smaller size). The cruise control indicator 630A indicates the cruise control speed along path 608. Similarly, the text cruise control speed 630B indicates the cruise control speed via alphanumeric text and solely via its display position along path 608. In some embodiments, the cruise control indicator 630A and text cruise control speed 630B continue to be displayed (e.g., as part of a speedometer) while cruise control is activated and not activated (e.g., the display of the cruise control indicator 630A and text cruise control speed 630B does not time out). Figure 6BIn response to a detected request to activate cruise control, computer system 600 displays indication 630C. In some implementations, indication 630C is displayed when cruise control is active (regardless of whether cruise control is activated or not) to indicate to the user that cruise control is active. The position of indication 630C does not indicate cruise control speed, unlike cruise control indicator 630A and text cruise control speed 630B.

[0186] exist Figure 6B At this location, cruise control indicator 630A and text cruise control speed 630B are displayed along path 608 at a position corresponding to 32 mph, indicating that the vehicle will adjust to a speed of 32 mph if cruise control is activated. Similarly, text cruise control speed 630B specifies "32," indicating that the vehicle will adjust to a speed of 32 mph if cruise control is activated. Figure 6B At this point, the vehicle's speed has increased to 65 mph, as indicated by the first section 610A, numerical mph speed indicator 614A, and numerical kph speed indicator 614B extending along path 608 to the location corresponding to 65 mph.

[0187] exist Figure 6B At this point, the 618A filler has been increased in size to correspond to the level of power currently being used, which is greater than [amount missing]. Figure 6A The amount of power in the filler 618B has been reduced in size, thus indicating that more power is available for acceleration (e.g., higher maximum available power and continues to be indicated by end 618C). Figure 6B In this process, computer system 600 receives user input requesting an increase in cruise control speed. This input may be on the steering wheel rollers, a gesture (e.g., hand gesture, facial gesture, and / or air gesture), or a voice command.

[0188] exist Figure 6C In response to receiving an input requesting an increase in cruise control speed, computer system 600 increases the cruise control speed and updates the display of cruise control indicator 630A and text cruise control speed 630B. Specifically, cruise control indicator 630A and text cruise control speed 630B move together along path 608 to a position corresponding to the increased cruise control speed of 40. Text cruise control speed 630B is updated to "40" to reflect the increased cruise control speed. Because cruise control is not activated, cruise control indicator 630A and text cruise control speed 630B continue to be displayed in an appearance indicating that cruise control is not activated (e.g., light color, gray, and / or smaller size).

[0189] exist Figure 6CAt this point, the vehicle's battery continues to preheat, thereby achieving a higher maximum power output. Therefore, the filler 618B of the power meter 606 continues to decrease in size. Figure 6C At this point, the computer system 600 receives user input again requesting an increase in cruise control speed. This input may be on the steering wheel rollers, a gesture (e.g., hand gesture, facial gesture, and / or air gesture), or a voice command.

[0190] exist Figure 6D In response to receiving an input requesting an increase in cruise control speed, computer system 600 increases the cruise control speed and updates the display of cruise control indicator 630A and text cruise control speed 630B. Specifically, cruise control indicator 630A and text cruise control speed 630B move together along path 608 (e.g., consistently or at similar speeds along the same path) to a position corresponding to the increased cruise control speed of 72 mph. Text cruise control speed 630B is updated to "72" to reflect the increased cruise control speed. Because cruise control is not activated, cruise control indicator 630A and text cruise control speed 630B continue to be displayed in an appearance indicating that cruise control is not activated (e.g., lighter color, gray, and / or smaller size). Figure 6D At this point, the vehicle's battery continues to preheat, thereby achieving a higher maximum power output. Therefore, the filler 618B of the power meter 606 continues to decrease in size.

[0191] exist Figure 6D At this point, computer system 600 receives user input requesting the activation of cruise control. This input may be on a button on the vehicle's steering wheel, a gesture (e.g., hand gesture, facial gesture, and / or air gesture), or a voice command.

[0192] exist Figure 6E In response to a user input requesting the activation of cruise control, computer system 600 activates cruise control and updates the display of cruise control indicator 630A and text cruise control speed 630B. Cruise control indicator 630A and text cruise control speed 630B continue to be displayed at the location corresponding to the cruise control speed of 72 mph. Because cruise control has been activated, computer system 600 has changed the appearance of cruise control indicator 630A (e.g., a darker color such as green, a different size, and / or a different shape) and has changed the appearance of text cruise control speed 630B (e.g., a darker color and / or a larger size) to indicate that cruise control has been activated. When the vehicle is applying more power to increase the speed from 65 mph to 72 mph, power meter 606 indicates the increased power used. Figure 6DAt this point, the vehicle's battery continues to preheat, thereby achieving a higher maximum power output. Therefore, the filler 618B of the power meter 606 continues to decrease in size.

[0193] exist Figure 6F At this location, with cruise control activated, the vehicle speed has reached the cruise control speed of 72 mph. Cruise control indicator 630A and text cruise control speed 630B continue to be displayed at the location corresponding to the 72 mph cruise control speed. Figure 6F At this point, the vehicle's battery has been preheated, thus achieving maximum power output. Therefore, filler 618B is no longer displayed as part of power meter 606.

[0194] exist Figure 6G In some embodiments, the computer system 600 stops displaying the text cruise control speed 630B for a predetermined amount of time (e.g., 1 second, 3 seconds, or 5 seconds) after cruise control is activated, while continuing to display the cruise control indicator 630A. In some implementations, the computer system 600 stops displaying the text cruise control speed 630B for a predetermined amount of time (e.g., 1 second, 3 seconds, or 5 seconds) after the vehicle speed reaches the cruise control speed (rather than after cruise control is activated), while continuing to display the cruise control indicator 630A. By stopping the display of the text cruise control speed 630B, the computer system 600 clears the display 602, and specifically the speedometer 604. By continuing to display the cruise control indicator 630A, the computer system 600 continues to provide feedback to the user regarding the cruise control speed. Figure 6G At this point, the computer system 600 detects an input to disengage cruise control (e.g., activation of the brake pedal).

[0195] like Figure 6H As illustrated, in response to the user activating the vehicle's brake pedal, cruise control is disengaged and the vehicle has slowed to 40 mph, as indicated by the first section 610A of path 608 and the digital mph speed indicator 614A. Because cruise control is now disengaged (while remaining active), the text cruise control speed 630B is newly displayed and the cruise control indicator 630A continues to be displayed, both having an appearance indicating that cruise control is not activated (e.g., light color, gray, and / or smaller in size) and both located along path 608 at a position corresponding to a cruise control speed of 72 mph. If the computer system receives user input to activate cruise control, the appearance of the cruise control indicator 630A and the text cruise control speed 630B will change to indicate that cruise control is activated (e.g., as indicated by the first section 610A of path 608 and the digital mph speed indicator 614A). Figure 6E As shown), the vehicle's speed will increase again to 72 mph (as shown). Figure 6FAs shown), and the text cruise control speed 630B will stop being displayed after a predetermined amount of time (as shown). Figure 6G (As shown).

[0196] Therefore, when cruise control is not activated, the cruise control indicator 630A and the text cruise control speed 630B are not displayed. When cruise control is activated but not yet started, the cruise control indicator 630A and the text cruise control speed 630B are displayed continuously. When cruise control is activated and started, the cruise control indicator 630A is displayed continuously, and the text cruise control speed 630B is displayed for a predetermined amount of time before it stops being displayed.

[0197] exist Figure 6H At this point, because the car is slowing down and power is being generated using regenerative braking, power meter 606 indicates that power is being generated through a portion of the first section 620 of filling path 618. The amount of power filled in the first section 620 corresponds to the amount of power being generated and / or stored. Figure 6H At this point, computer system 600 receives user input requesting a reduction in cruise control speed. This input may be on the steering wheel rollers, a gesture (e.g., hand gesture, facial gesture, and / or air gesture), or a voice command.

[0198] exist Figure 6I In response to receiving an input requesting a reduction in cruise control speed, computer system 600 reduces the cruise control speed and updates the display of cruise control indicator 630A and text cruise control speed 630B. Specifically, cruise control indicator 630A and text cruise control speed 630B move together along path 608 to a position corresponding to a reduced cruise control speed of 68 mph. Text cruise control speed 630B is updated to "68" to reflect the increased cruise control speed. Because cruise control is not activated, the cruise control indicator 630A and text cruise control speed 630B, in an appearance indicating that cruise control is not activated (e.g., lighter color, gray, and / or smaller size), continue to be displayed (without timeout). Figure 6I At this point, computer system 600 receives user input requesting the activation of cruise control. This input may be on a button on the vehicle's steering wheel, a gesture (e.g., hand gesture, facial gesture, and / or air gesture), or a voice command.

[0199] exist Figure 6JIn response to a user input requesting the activation of cruise control, computer system 600 activates cruise control and updates the display of cruise control indicator 630A and text cruise control speed 630B. Specifically, cruise control indicator 630A and text cruise control speed 630B continue to be displayed at the location corresponding to a cruise control speed of 72 mph. Because cruise control has been activated, cruise control indicator 630A has changed its appearance (e.g., a darker color such as green, a different size, and / or a different shape) and text cruise control speed 630B has changed its appearance (e.g., a darker color and / or a larger size) to indicate that cruise control has been activated. When the vehicle is applying more power to increase the speed from 40 mph to 68 mph, power meter 606 indicates the increased power used. Figure 6J At this point, computer system 600 has determined that power usage should not exceed a threshold amount so that the battery can support the vehicle to reach the requested destination. Therefore, maximum power has been limited, as indicated by the fill 618B and end 618C of the second portion 622 of path 618. Figure 6J and Figure 6K As shown.

[0200] exist Figure 6K At this location, with cruise control activated, the vehicle speed has reached the cruise control speed of 68 mph. Computer system 600 continues to display the cruise control indicator 630A at the location corresponding to the 68 mph cruise control speed, and computer system 600 has stopped displaying the text cruise control speed 630B because a predetermined amount of time (e.g., 1 second, 3 seconds, or 5 seconds) has elapsed since cruise control was activated. In other words, cruise control indicator 630A continues to be displayed without timeout, and the text cruise control speed 630B is displayed for a limited duration once cruise control is activated. Figure 6K At this point, computer system 600 receives user input requesting to enter map mode. In some implementations, the computer system is navigating to a destination, and the request to enter map mode is a request to display navigation instructions to the destination.

[0201] exist Figure 6L In response to a user input requesting to enter map mode, computer system 600 simultaneously displays a reduced-size instrument cluster 650 and a map 640. Map 640 replaces the display of speedometer 604 and power meter 606 on display 602 (e.g., map 640 is now displayed where speedometer 604 and power meter 606 were previously displayed). In response to a user input requesting to enter map mode, computer system 600 stops displaying speedometer 604 and instead displays the reduced-size instrument cluster 650.

[0202] The reduced-size instrument cluster 650 includes three sections 652-656. Section 652 includes navigation information, including the duration before arrival 652A, arrival time 652B, and distance to the destination 652C. Section 654 includes an indication of cruise control speed 654A (which indicates speed not based on the displayed location), a speed limit indicator 654B (which provides an indication of the speed limit for the current location, such as a street or highway), current vehicle speed 654C (which indicates speed not based on the displayed location or size), a lane guidance indicator 654D (which indicates that the driving lane is being monitored and will notify the user (e.g., visual, audio, and / or tactile warnings)), and an indication that stability control is enabled 654E. Section 656 includes a power meter 656A (which includes a straight path consisting of a first part and a second part, where the path is used to indicate the power quantity, similar to power meter 606). Therefore, the user of the computer system 600 can quickly and easily access the navigation map while still having access to the vehicle's instrument cluster.

[0203] Figure 7 This is a flowchart illustrating a method for managing cruise control settings according to some embodiments. Method 700 is performed at a computer system (e.g., 100, 300, 500, and / or 600) (e.g., a smartphone, wearable (e.g., head-mounted) device, and / or a vehicle (e.g., a car, boat, or aircraft) computer system), wherein the computer system communicates with one or more display generating components (e.g., one or more display generating components of a vehicle, one or more displays disposed in the front console of the vehicle, one or more displays positioned in front of / in front of the driver's seat of the vehicle, one or more head-up displays, one or more display drivers, and / or one or more displays of a wearable device) and one or more input devices (touch-sensitive surfaces, input devices integrated into the vehicle's steering wheel (e.g., scroll wheels, buttons, and / or touch-sensitive surfaces), one or more cameras (e.g., for detecting postures in the air) and / or microphones). In some embodiments, the computer system communicates with the vehicle (e.g., a car, boat, or aircraft) (e.g., integrated into the vehicle, communicating with the vehicle via wired and / or wireless communication). Some operations in method 700 may be arbitrarily combined, the order of some operations may be arbitrarily changed, and some operations may be arbitrarily omitted.

[0204] As described below, method 700 provides an intuitive way to manage cruise control settings. This method reduces the cognitive burden on users when managing cruise control settings, thereby creating a more efficient human-machine interface. For battery-powered computing devices, it enables users to manage cruise control settings more quickly and efficiently, saving power and increasing the time interval between battery charging.

[0205] The computer system (e.g., 600) simultaneously (702) via one or more display generation components (e.g., 602) and as part of an instrument cluster (e.g., for the vehicle and / or for the vehicle) to: display cruise control (e.g., adaptive cruise control or non-adaptive cruise control) indicators (e.g., 630A) (e.g., dot or non-dot indicators) at a location corresponding to the cruise control speed (e.g., 65 mph or 75 mph, a set cruise control speed or an unset cruise control speed) (e.g., along the path of the speedometer and / or along the path corresponding to the speed).

[0206] When both the cruise control indicator and the text indication of the cruise control speed are displayed simultaneously, the computer system (e.g., 600) receives (704) a first input (e.g., a confirmation input to set the desired cruise control speed, an input to start cruise control, and / or an input to resume cruise control) via one or more input devices.

[0207] In response to receiving the first input, the computer system (e.g., 600) stops (710) displaying the text indication of the cruise control speed via one or more display generating components (e.g., 630B) after a non-zero duration (e.g., 1 second, 3 seconds, or 5 seconds), while continuing to display the cruise control indicator at the location corresponding to the cruise control speed via one or more display generating components (e.g., 630A) (the display of the cruise control indicator at the location corresponding to the cruise control speed is not stopped after the non-zero duration). Stopping the display of the text indication of the cruise control speed while continuing to display the cruise control indicator at the location corresponding to the cruise control speed provides the user with visual feedback on the cruise control speed without cluttering the user interface, thereby providing improved visual feedback.

[0208] According to some implementations, a computer system (e.g., 600) is integrated into the vehicle. In some implementations, one or more display generation components are integrated into the vehicle. The computer system integrated into the vehicle provides the user with real-time feedback on vehicle operation, thereby providing improved feedback.

[0209] According to some implementations, displaying a cruise control indicator (e.g., 630A) as part of the instrument cluster at a location corresponding to the cruise control speed includes: based on determining that the vehicle's cruise control system is activated (e.g., cruise control is active and the vehicle is controlling its speed based on a set cruise control speed), the cruise control indicator (e.g., ... Figure 6EThe cruise control indicator (e.g., at location 630A) has a first appearance (e.g., a first color (e.g., white or green), a first size, and / or a first shape (regardless of the display position of the cruise control indicator)); and based on the determination that the vehicle's cruise control system is not activated (e.g., cruise control is active and the vehicle is not controlling the vehicle's speed based on a set cruise control speed (such as based on detecting activation of the vehicle's brake or accelerator pedal, detecting that the vehicle has stopped for more than a (zero or non-zero) predetermined duration, and / or receiving other inputs), the cruise control indicator (e.g., Figure 6D The cruise control indicator (630A) has a second appearance (e.g., a second color (e.g., gray or black), a second size, and / or a second shape, independent of the display position of the cruise control indicator) that differs from the first appearance. Displaying the cruise control indicator with a different appearance when cruise control is activated and not activated provides the user with visual feedback on the status of the vehicle's cruise control system (e.g., whether it is activated or not), thereby providing improved visual feedback.

[0210] According to some implementations, displaying text indications for cruise control speed as part of the instrument cluster (e.g., 630B) includes: based on determining that the vehicle's cruise control system is activated (e.g., cruise control is active and the vehicle is controlling its speed based on a set cruise control speed), displaying text indications for cruise control speed (e.g., ...). Figure 6E The 630B at the location has a third appearance (e.g., a third color (e.g., white or green), a third size, and / or a third font); and based on the determination that the vehicle's cruise control system is not activated (e.g., cruise control is active and the vehicle is not controlling the vehicle's speed based on a set cruise control speed (such as based on detecting activation of the vehicle's brake or accelerator pedal, detecting that the vehicle has stopped for more than a (zero or non-zero) predetermined duration, and / or receiving other input), a textual indication of the cruise control speed (e.g., Figure 6F The 630B at the location has a fourth appearance (e.g., a fourth color (e.g., gray or black), a fourth size, and / or a fourth font) that differs from the third appearance. Displaying textual indications of cruise control speed with different appearances when cruise control is activated and deactivated provides the user with visual feedback on the status of the vehicle's cruise control system (e.g., whether it is activated or deactivated), thereby providing improved visual feedback.

[0211] According to some embodiments, a computer system (e.g., 600) displays a speed indicator (e.g., 610A) (e.g., an extended bar to fill a path, a needle-like object with a pointed tip following the path) via one or more display generating components and as part of an instrument cluster. This speed indicator moves along a speed-corresponding path (e.g., 608) (in conjunction with detected changes in the vehicle's speed) to indicate the vehicle's current speed. In some embodiments, different portions of the path correspond to different speeds. In some embodiments, a cruise control indicator (e.g., 630A) is displayed at a position along a speed-corresponding path (e.g., 608) (e.g., on, immediately adjacent to, and / or adjacent to the path) (e.g., while continuing to display the speed indicator at positions along the speed-corresponding path). In some embodiments, the path is linear and / or straight. In some embodiments, the path is curved. In some embodiments, the path is arc-shaped. In some embodiments, the position where the cruise control indicator is displayed along the path is based on (e.g., indicating) the cruise control speed. Displaying cruise control indicators at locations along a path corresponding to speed allows the computer system to provide the user with visual feedback on how cruise control will affect the vehicle's speed, thus providing improved visual feedback.

[0212] According to some implementations, a speed indicator (e.g., 610A) fills an area corresponding to a path (e.g., 608), and the filled area indicates the vehicle's current speed. Filling the area corresponding to the path provides the user with visual feedback about the vehicle's speed, thereby providing improved visual feedback.

[0213] According to some implementations, a textual (numerical, alphanumeric, and / or alphanumeric) indication of the cruise control speed (e.g., 630B) is displayed at a location corresponding to the cruise control speed (e.g., along a path corresponding to the speed (e.g., 608) (e.g., on, immediately adjacent to, and / or adjacent to the path)). Displaying the textual indication of the cruise control speed at a location reflecting the cruise control speed provides the user with visual feedback regarding location-based rather than content-based cruise control speed, thereby providing improved visual feedback.

[0214] According to some embodiments, a computer system (e.g., 600) displays a speed indicator (e.g., 610A) (e.g., an extended bar to fill a path, a needle-like object with a pointed tip following the path) via one or more display generating components (e.g., 602) and as part of an instrument cluster. This speed indicator moves along a path (e.g., 608) corresponding to a speed to indicate the vehicle's current speed. In some embodiments, different sections of the path correspond to different speeds. The computer system (e.g., 600) receives input for changing the cruise control speed via one or more input devices. In response to receiving an input to change the cruise control speed (e.g., when cruise control is active and activated or not activated), the computer system (e.g., 600) moves the cruise control indicator (e.g., 630A) along at least a portion of a speed-corresponding path (e.g., 608) (e.g., on, adjacent to, and / or adjacent to the at least a portion) (e.g., translating, sliding, and / or animing the cruise control indicator) (e.g., while continuing to display the speed indicator at a position along the speed-corresponding path). In some embodiments, the path is linear and / or straight. In some embodiments, the path is curved. In some embodiments, the path is arc-shaped. Moving the cruise control indicator along the speed-corresponding path provides the user with visual feedback about the cruise control speed to be set, thereby providing the user with improved visual feedback.

[0215] According to some embodiments, in response to receiving an input to change the cruise control speed (e.g., when cruise control is active and activated or deactivated), a computer system (e.g., 600) (e.g., in conjunction with the input to change the cruise control speed) combines a cruise control indicator (e.g., 630A) and moves a text (numeric, alphanumeric, and / or alphanumeric) indication of the cruise control speed (e.g., 630B) along at least a portion (e.g., on, adjacent to, and / or adjacent to) a speed-corresponding path (e.g., 608) (e.g., translating, sliding, and / or animates the text indication) (e.g., while continuing to display the speed indicator at a position along the speed-corresponding path). In some embodiments, the path is linear and / or straight. In some embodiments, the path is curved. In some embodiments, the path is arc-shaped. Displaying and moving the text indication of the cruise control speed along the speed-corresponding path provides the user with visual feedback about the cruise control speed to be set, thereby providing the user with improved visual feedback.

[0216] According to some implementations, when a speedometer of a first size (e.g., 604) is displayed, a computer system (e.g., 600) receives a second input (e.g., an input to initiate navigation to a destination, an input to request the display of a user interface of an application (e.g., a map of a navigation application or a music user interface of an audio application), and / or an input to request a reduction in the display size of the instrument cluster via one or more input devices. The speedometer includes a speed indicator (e.g., 610A) that moves along a path corresponding to the speed (e.g., 608) (in conjunction with a detected change in the vehicle's speed) to indicate the vehicle's current speed (e.g., a bar that expands to fill the path, a needle-like object with a tip that follows the path), and includes a cruise control indicator (e.g., 630A) corresponding to the cruise control speed (and optionally, a text indication of the cruise control speed). In response to receiving a second input, the computer system displays, via one or more display generation components (e.g., 602) and without displaying the speedometer (e.g., 604): a second speed indicator (e.g., 654C) (e.g., a digital indication of speed at a location not corresponding to speed) (e.g., it is not displayed when the second input is received), the second speed indicator having a second size smaller than the first size; and a second cruise control indicator (e.g., 654A), the second cruise control indicator indicating the cruise control speed regardless of its display position (the position of the second cruise control indicator is independent of the cruise control speed). Reducing the size of the instrument cluster, such as by decreasing the size of the speed indicator and / or the cruise control indicator, allows the computer system to provide visual feedback to the user regarding other relevant information, thereby improving the human-machine interface and providing improved visual feedback.

[0217] According to some implementations, a second speed indicator (e.g., 654C) indicates the vehicle's speed without moving along a path corresponding to the speed, and / or a second cruise control indicator (e.g., 654A) indicates the cruise control speed without moving along a path corresponding to the speed. The absence of a second speed indicator and / or a second cruise control indicator along its path reduces the amount of space required to display content, allowing the computer system to provide visual feedback to the user regarding other relevant content, thereby improving the human-machine interface and providing enhanced visual feedback.

[0218] According to some implementations, a speedometer (e.g., 604) is displayed at a first location. In response to receiving a second input, a computer system (e.g., 600) displays a map user interface (e.g., 640, for example, in a map application) at the first location via one or more display generation components (e.g., 602), replacing the display of the speedometer (e.g., 604). Replacing the speedometer display with a map user interface enables the computer system to provide the user with feedback on the vehicle's position on the map, thereby providing the user with improved visual feedback.

[0219] According to some embodiments, a computer system (e.g., 600) displays a power meter (e.g., 606) at a second location, indicating a power quantity (e.g., used by or generated by the vehicle), which is displayed simultaneously with a speedometer (e.g., 604) via one or more display generation components (e.g., 602). In response to receiving a second input, the computer system (e.g., 600) displays a map user interface (e.g., 640, of a map application) at the second location via one or more display generation components (e.g., 602), replacing the display of the power meter (e.g., 606). In some embodiments, the map user interface replaces both the speedometer and the power meter. Replacing the display of the power meter with the map user interface allows the computer system to provide feedback to the user regarding the vehicle's position on the map, thereby providing the user with improved visual feedback.

[0220] According to some embodiments, in response to receiving a second input, a computer system (e.g., 600) displays, via one or more display generation components (e.g., 602) (and optionally simultaneously with the map user interface): a first indication (e.g., 654A, 654D, or 654E) corresponding to a first setting of the vehicle (e.g., whether cruise control is set and / or activated, cruise control settings, whether lane guidance is enabled / disabled, and / or whether stability control is enabled / disabled); and a second indication (e.g., 654A, 654D, or 654E) corresponding to a second setting of the vehicle different from the first setting (e.g., whether cruise control is set and / or activated, cruise control settings, whether lane guidance is enabled / disabled, and / or whether stability control is enabled / disabled). In some embodiments, the first and second indications are not overlaid on the map user interface. In some embodiments, the first and second indications are displayed below the map user interface. In some embodiments, the first and second indications are alert indications of the vehicle's status, such as indicating important aspects of the vehicle's status. Displaying indications of the vehicle's status provides the user with visual feedback on the vehicle's status, thereby providing improved visual feedback.

[0221] According to some implementations, a computer system (e.g., 600) displays a power meter (e.g., 606) simultaneously with a cruise control (e.g., adaptive cruise control or non-adaptive cruise control) indicator (e.g., 630A) (e.g., dot or non-dot indicator) and a textual (numeric, alphanumeric) indication of cruise control speed (e.g., 630B). This power meter includes a path (e.g., 618) having a first portion (e.g., 620) and a second portion (e.g., 622), where the first portion (e.g., 620) corresponds to the amount of power the vehicle is generating and / or storing based on driving (e.g., using regenerative braking and / or wind power generation), and the second portion (e.g., 622) corresponds to the amount of power the vehicle is using based on driving (e.g., to propel the vehicle and / or to operate the vehicle's electronics). Displaying a power meter with different portions for generated and used power enables the computer system to provide the user with visual feedback on the vehicle's power status, thereby providing the user with improved visual feedback.

[0222] According to some implementations, the first section (e.g., 620) is filled with a first appearance (e.g., a third color, such as green), and the second section (e.g., 622) is filled with a second appearance (e.g., a fourth color different from the third color, such as white or blue). Filling different sections of the power meter path with different colors provides the user with feedback about which section of the power meter path is being filled, thus providing the user with improved visual feedback.

[0223] According to some embodiments, the second part (e.g., 622) of the power meter path (e.g., 618) includes an indication of the currently available maximum power (e.g., 618B) (e.g., based on the vehicle's battery output power capability and / or based on limitations set by the vehicle to enable the vehicle to reach a planned destination with limited battery power). In some embodiments, the indication of the currently available maximum power has a fifth color, different from the third and fourth colors. Indicating the amount of available maximum power along the power meter path provides the user with visual feedback regarding the amount of available power, thereby providing improved visual feedback.

[0224] According to some implementations, the indication of the current maximum available power (e.g., 618B) changes as the current maximum available power changes over time (e.g., moves, resizes, and / or is otherwise updated). Updating the indicated maximum available power amount as the current maximum available power changes provides the user with feedback on the maximum available power at any given time, thereby providing improved visual feedback.

[0225] In some implementations, the currently available maximum power changes over time based on the temperature of one or more batteries in the vehicle (e.g., those used to propel the vehicle), ambient temperature, and / or reduced power, so that the vehicle can reach its planned destination with limited battery power. Determining the amount of currently available maximum power based on battery temperature, ambient temperature, and / or reduced power enables longer driving ranges and provides the user with visual feedback on how the battery's power performance is being affected, thus providing improved visual feedback.

[0226] For purposes of explanation, the foregoing description has been given by reference to specific embodiments. However, the illustrative discussion above is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible based on the teachings above. These embodiments were chosen and described in order to best explain the principles of these techniques and their practical application. Others skilled in the art will thus be able to best utilize these techniques and the various embodiments with various modifications suitable for the particular intended use.

[0227] While this disclosure and examples have been fully described with reference to the accompanying drawings, it should be noted that various changes and modifications will become apparent to those skilled in the art. It should be understood that such changes and modifications are considered to be included within the scope of this disclosure and examples as defined by the claims.

[0228] As described above, one aspect of the present invention is the collection and use of data available from various sources to improve cruise control settings. This disclosure contemplates that, in some instances, this collected data may include personal information data that uniquely identifies or can be used to contact or locate specific individuals. Such personal information data may include demographic data, location-based data, telephone numbers, email addresses, social network IDs, home addresses, or any other identifying or personal information.

[0229] This disclosure recognizes that the use of such personal information data in the present invention can benefit users. For example, personal information data can be used to set cruise control based on personal preferences. Therefore, using such personal information data enables users to exercise planned control over cruise control settings. Furthermore, this disclosure also anticipates other uses of personal information data that benefit users.

[0230] This disclosure anticipates that entities responsible for the collection, analysis, disclosure, transmission, storage, or other use of such personal information data will comply with robust privacy policies and / or privacy measures. Specifically, such entities should implement and adhere to privacy policies and measures recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and should be updated as the collection and / or use of data changes. Personal information from users should be collected for legitimate and reasonable entity purposes and should not be shared or sold outside of these legitimate purposes. Furthermore, such collection / sharing should be conducted only after receiving informed consent from the user. Additionally, such entities should consider taking any necessary steps to protect and safeguard the right to access such personal information data and ensure that other entities with access to such personal information data comply with the privacy policies and procedures of those other entities. Furthermore, such entities may be subject to third-party assessments to demonstrate their compliance with widely accepted privacy policies and privacy practices. Moreover, policies and practices should be adapted to the specific types of personal information data collected and / or accessed, and to applicable laws and standards, including considerations of specific jurisdictions. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while in other countries, health data may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy measures should be advocated for different types of personal data in each country.

[0231] Regardless of the foregoing, this disclosure also anticipates implementation schemes for users to selectively block the use or access to personal information data. That is, this disclosure anticipates providing hardware and / or software components to prevent or block access to such personal information data. For example, with regard to personalized cruise control settings, this technology can be configured to allow users to opt-in or opt-out at any time during or after service registration to participate in the collection of personal information data. In addition to providing opt-in and opt-out options, this disclosure also anticipates providing notifications related to access to or use of personal information. For example, users may be notified when downloading an application that their personal information data will be accessed, and then reminded again just before the application accesses the personal information data.

[0232] Furthermore, the intent of this disclosure is that personal information data should be managed and processed in a manner that minimizes the risk of unintentional or unauthorized access or use. Once data is no longer needed, this risk can be minimized by restricting data collection and deleting data. Additionally, and where applicable, including in certain health-related applications, data deidentification can be used to protect user privacy. Deidentification can be facilitated, where appropriate, by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than the address level), controlling how data is stored (e.g., aggregating data among users), and / or other methods.

[0233] Therefore, while this disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, it is also contemplated that various embodiments can be implemented without access to such personal information data. That is, various embodiments of the present invention will not be rendered inoperable due to the absence of all or part of such personal information data. For example, cruise control settings can still be managed based on non-personal information data or an absolute minimum measure of personal information (such as content requested by the user's associated device, other non-personal information available to the system, or publicly available information).

Claims

1. A method for displaying an instrument cluster, comprising: At the computer system, the computer system communicates with one or more display generation components and one or more input devices: Simultaneously via the one or more display generation components and as part of the instrument group: Display the cruise control indicator at the location corresponding to the cruise control speed, and Displays a textual indication of the cruise control speed; When the cruise control indicator and the text indication of the cruise control speed are displayed simultaneously, a first input for starting the cruise control system of the vehicle is received via the one or more input devices; as well as In response to receiving the first input for activating the cruise control system of the vehicle: Activate the cruise control system of the vehicle; The text indication of the cruise control speed continues to be displayed for a non-zero duration; After the non-zero duration, the display of the text indication of the cruise control speed via the one or more display generation components ceases; and The cruise control indicator is continued to be displayed at the position corresponding to the cruise control speed via the one or more display generation components.

2. The method of claim 1, wherein the computer system is integrated into the vehicle.

3. The method according to any one of claims 1 to 2, wherein displaying the cruise control indicator at the location corresponding to the cruise control speed as part of the instrument cluster comprises: Based on the determination that the vehicle's cruise control system is activated, the cruise control indicator has a first appearance; and Based on the determination that the vehicle's cruise control system is not activated, the cruise control indicator has a second appearance that differs from the first appearance.

4. The method according to any one of claims 1 to 2, wherein displaying the text indication of the cruise control speed as part of the instrument cluster comprises: The textual indication of the cruise control speed has a third appearance, depending on whether the vehicle's cruise control system is activated. and Based on the determination that the vehicle's cruise control system is not activated, the text indication of the cruise control speed has a fourth appearance that differs from the third appearance.

5. The method according to any one of claims 1 to 2, further comprising: A speed indicator is displayed via one or more display generating components and as part of the instrument cluster, the speed indicator moving along a path corresponding to the speed to indicate the vehicle's current speed; and The cruise control indicator is displayed at a location along the path corresponding to the speed.

6. The method according to any one of claims 1 to 2, wherein the text indication of the cruise control speed is displayed at a position corresponding to the cruise control speed.

7. The method according to any one of claims 1 to 2, further comprising: A speed indicator is displayed via one or more display generating components and as part of the instrument cluster, the speed indicator moving along a path corresponding to the speed to indicate the vehicle's current speed; Receive input for changing the cruise control speed via the one or more input devices; as well as In response to receiving the input for changing the cruise control speed, the cruise control indicator is moved along at least a portion of the path corresponding to the speed.

8. The method according to any one of claims 1 to 2, further comprising: When a speedometer of a first size is displayed, a second input is received via the one or more input devices, the speedometer including a speed indicator that moves along a path corresponding to the speed to indicate the vehicle’s current speed and including a cruise control indicator corresponding to the cruise control speed; as well as In response to receiving the second input, the following is displayed via the one or more display generation components and without displaying the speedometer: A second speed indicator, the second speed indicator having a second size smaller than the first size; and A second cruise control indicator indicates the cruise control speed regardless of its display position.

9. The method of claim 8, wherein the speed meter is displayed at a first position, the method further comprising: In response to receiving the second input, a map user interface that replaces the speedometer is displayed at the first location via the one or more display generation components.

10. The method of claim 8, further comprising: At the second position, a power meter indicating the amount of power is displayed via the one or more display generating components and simultaneously with the speed meter; as well as In response to receiving the second input, a map user interface that replaces the display of the power meter is displayed at the second location via the one or more display generation components.

11. The method according to any one of claims 1 to 2, further comprising: The power meter, including a path having a first portion and a second portion, is displayed simultaneously via the one or more display generating components and along with the cruise control indicator and the text indication of the cruise control speed, wherein the first portion corresponds to the amount of power the vehicle is generating and / or storing based on driving, and the second portion corresponds to the amount of power the vehicle is using based on driving.

12. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generating components and one or more input devices, the one or more programs including instructions for performing the method according to any one of claims 1 to 11.

13. A computer system configured to communicate with one or more display generation components and one or more input devices, the computer system comprising: One or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the method according to any one of claims 1 to 11.

14. A computer system configured to communicate with one or more display generation components and one or more input devices, the computer system comprising: A module for performing the method according to any one of claims 1 to 11.

15. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with one or more display generation components and one or more input devices, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 11.

Images