User interface with variable appearance
Patent Information
- Application Number
- CN202311374032.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-11-19
- Filing Date
- 2022-03-11
- Publication Date
- 2026-10-23
- Estimated Expiration
- 2042-03-11
AI Technical Summary
[0032]因此,为设备提供了用于管理数字仪表组的更快、更有效的方法和界面,从而提高了此类设备的有效性、效率和用户满意度。此类方法和界面可补充或替换用于管理数字仪表组的其他方法。
Smart Images

Figure CN117215709B_ABST
Abstract
Description
[0001] This application is a divisional application of the invention patent application filed on March 11, 2022, with application number 202280021073.1 and entitled "User Interface with Variable Appearance".
[0002] Cross-references to related applications
[0003] This application claims priority to U.S. Provisional Patent Application Serial No. 63 / 160,909, filed March 14, 2021, entitled “USER INTERFACES WITH VARIABLE APPEARANCE”; U.S. Provisional Patent Application Serial No. 63 / 210,388, filed June 14, 2021, entitled “USER INTERFACES WITH VARIABLE APPEARANCE”; and U.S. Provisional Patent Application Serial No. 63 / 281,620, filed November 19, 2021, entitled “USER INTERFACES WITH VARIABLE APPEARANCE”, the contents of which are incorporated herein by reference in their entirety. Background Technology
[0004] The electronic instrument cluster provides the driver with information about the vehicle, such as its speed and fuel level. Summary of the Invention
[0005] However, some technologies used to manage digital meter groups using electronic devices are often cumbersome and inefficient. For example, some existing technologies use complex and time-consuming user interfaces that may involve multiple keystrokes or button presses. These existing technologies require more time than necessary, resulting in wasted user time and device power. This latter consideration is particularly important in battery-powered devices.
[0006] Therefore, this technology provides electronic devices with a faster and more efficient method and interface for managing digital instrument clusters. Such methods and interfaces optionally complement or replace other methods for managing digital instrument clusters. These methods and interfaces reduce the cognitive burden on the user and result in a more efficient human-machine interface. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charging. Furthermore, such methods and technologies reduce driver distraction by providing the user with visual feedback about the vehicle by optionally emphasizing relevant information and / or presenting information in a customized manner.
[0007] According to some embodiments, a method is described that is executed at a computer system communicating with a display generation component. The method includes: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a first vehicle instrument cluster interface having a first appearance, the first vehicle instrument cluster interface including a first group of one or more instrument cluster elements; after providing the display generation component with the information defining the appearance of the vehicle instrument cluster, detecting a sequence of one or more user reconfiguration inputs for reconfiguring a user interface for the vehicle instrument cluster; and after receiving the sequence of one or more user reconfiguration inputs, providing the display generation component with information defining an updated appearance of the vehicle instrument cluster for display via the display generation component as a second vehicle instrument cluster interface having a second appearance different from the first appearance, the second vehicle instrument cluster interface including a second group of one or more instrument cluster elements that differ in appearance, location, and / or arrangement from the first group of one or more instrument cluster elements.
[0008] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component. The one or more programs include instructions for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a first vehicle instrument cluster interface having a first appearance, the first vehicle instrument cluster interface including a first group of one or more instrument cluster elements; after providing the display generation component with the information defining the appearance of the vehicle instrument cluster, detecting a sequence of one or more user reconfiguration inputs for reconfiguring the user interface of the vehicle instrument cluster; and after receiving the sequence of one or more user reconfiguration inputs, providing the display generation component with information defining an updated appearance of the vehicle instrument cluster for display via the display generation component as a second vehicle instrument cluster interface having a second appearance different from the first appearance, the second vehicle instrument cluster interface including a second group of one or more instrument cluster elements that differ in appearance, position, and / or arrangement from the first group of one or more instrument cluster elements.
[0009] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component. The one or more programs include instructions for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a first vehicle instrument cluster interface having a first appearance, the first vehicle instrument cluster interface including a first group of one or more instrument cluster elements; after providing the display generation component with the information defining the appearance of the vehicle instrument cluster, detecting a sequence of one or more user reconfiguration inputs for reconfiguring a user interface for the vehicle instrument cluster; and after receiving the sequence of one or more user reconfiguration inputs, providing the display generation component with information defining an updated appearance of the vehicle instrument cluster for display via the display generation component as a second vehicle instrument cluster interface having a second appearance different from the first appearance, the second vehicle instrument cluster interface including a second group of one or more instrument cluster elements that differ in appearance, location, and / or arrangement from the first group of one or more instrument cluster elements.
[0010] According to some embodiments, a computer system is described. The computer system includes: a display generation component; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster to be displayed via the display generation component as a first vehicle instrument cluster interface having a first appearance, the first vehicle instrument cluster interface including a first group of one or more instrument cluster elements; after providing the display generation component with information defining the appearance of the vehicle instrument cluster, detecting a sequence of one or more user reconfiguration inputs for reconfiguring a user interface for the vehicle instrument cluster; and after receiving the sequence of one or more user reconfiguration inputs, providing the display generation component with information defining an updated appearance of the vehicle instrument cluster to be displayed via the display generation component as a second vehicle instrument cluster interface having a second appearance different from the first appearance, the second vehicle instrument cluster interface including a second group of one or more instrument cluster elements that differ in appearance, position, and / or arrangement from the first group of one or more instrument cluster elements.
[0011] According to some embodiments, a computer system is described. The computer system includes: a display generation component; means for providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a first vehicle instrument cluster interface having a first appearance, the first vehicle instrument cluster interface including a first group of one or more instrument cluster elements; means for detecting a sequence of one or more user reconfiguration inputs for reconfiguring a user interface for the vehicle instrument cluster after providing the display generation component with information defining the appearance of the vehicle instrument cluster; and means for providing the display generation component with information defining an updated appearance of the vehicle instrument cluster for display via the display generation component as a second vehicle instrument cluster interface having a second appearance different from the first appearance, the second vehicle instrument cluster interface including a second group of one or more instrument cluster elements that differ in appearance, position, and / or arrangement from the first group of one or more instrument cluster elements.
[0012] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component. The one or more programs include instructions for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a first vehicle instrument cluster interface having a first appearance, the first vehicle instrument cluster interface including a first group of one or more instrument cluster elements; after providing the display generation component with the information defining the appearance of the vehicle instrument cluster, detecting a sequence of one or more user reconfiguration inputs for reconfiguring the user interface of the vehicle instrument cluster; and after receiving the sequence of one or more user reconfiguration inputs, providing the display generation component with information defining an updated appearance of the vehicle instrument cluster for display via the display generation component as a second vehicle instrument cluster interface having a second appearance different from the first appearance, the second vehicle instrument cluster interface including a second group of one or more instrument cluster elements that differ in appearance, position, and / or arrangement from the first group of one or more instrument cluster elements.
[0013] According to some embodiments, a method is described that is executed at a computer system communicating with a display generation component. The method includes: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a corresponding vehicle instrument cluster interface having the corresponding appearance, including: defining a first vehicle instrument cluster interface having a first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component of a first type of vehicle; and defining a second vehicle instrument cluster interface having a second appearance different from the first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component of a second type of vehicle different from the first type of vehicle.
[0014] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component. The one or more programs include instructions for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a corresponding vehicle instrument cluster interface having the corresponding appearance, including: defining a first vehicle instrument cluster interface having a first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component of a first type of vehicle; and defining a second vehicle instrument cluster interface having a second appearance different from the first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component of a second type of vehicle different from the first type of vehicle.
[0015] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component. The one or more programs include instructions for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a corresponding vehicle instrument cluster interface having the corresponding appearance, including: defining a first vehicle instrument cluster interface having a first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component of a first type of vehicle; and defining a second vehicle instrument cluster interface having a second appearance different from the first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component of a second type of vehicle different from the first type of vehicle.
[0016] According to some embodiments, a computer system is described. The computer system includes: a display generation component; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a corresponding vehicle instrument cluster interface having the corresponding appearance, including: defining a first vehicle instrument cluster interface having a first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component of a first type of vehicle; and defining a second vehicle instrument cluster interface having a second appearance different from the first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component of a second type of vehicle different from the first type of vehicle.
[0017] According to some embodiments, a computer system is described. The computer system includes: a display generation component; and means for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a corresponding vehicle instrument cluster interface having the corresponding appearance, including: defining a first vehicle instrument cluster interface having a first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component for a first type of vehicle; and defining a second vehicle instrument cluster interface having a second appearance different from the first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component for a second type of vehicle different from the first type of vehicle.
[0018] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component. The one or more programs include instructions for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a corresponding vehicle instrument cluster interface having the corresponding appearance, including: defining a first vehicle instrument cluster interface having a first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component of a first type of vehicle; and defining a second vehicle instrument cluster interface having a second appearance different from the first appearance based on the information provided to the display generation component when it is determined that the display generation component is a display generation component of a second type of vehicle different from the first type of vehicle.
[0019] According to some embodiments, a method is described that is executed at a computer system communicating with a display generation component. The method includes: displaying a speedometer indicating a current vehicle speed via the display generation component, wherein: based on determining that the current speed limit is a first speed and the current vehicle speed is a second speed higher than the first speed, the speedometer has a first appearance in the portion between a position on the speedometer corresponding to the first speed and a position on the speedometer corresponding to the second speed; and based on determining that the current speed limit is a third speed higher than the first speed and the current vehicle speed is not higher than the second speed, the speedometer has a second appearance different from the first appearance in the portion between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed.
[0020] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component. The one or more programs include instructions for performing the following operations: displaying a speedometer indicating a current vehicle speed via the display generating component, wherein: based on determining that the current speed limit is a first speed and that the current vehicle speed is a second speed higher than the first speed, the speedometer has a first appearance in the portion between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed; and based on determining that the current speed limit is a third speed higher than the first speed and that the current vehicle speed is not higher than the second speed, the speedometer has a second appearance different from the first appearance in the portion between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed.
[0021] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component. The one or more programs include instructions for performing the following operations: displaying a speedometer indicating a current vehicle speed via the display generating component, wherein: based on determining that the current speed limit is a first speed and that the current vehicle speed is a second speed higher than the first speed, the speedometer has a first appearance in the portion between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed; and based on determining that the current speed limit is a third speed higher than the first speed and that the current vehicle speed is not higher than the second speed, the speedometer has a second appearance different from the first appearance in the portion between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed.
[0022] According to some embodiments, a computer system is described. The computer system includes: a display generation component; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: displaying a speedometer indicating a current vehicle speed via the display generation component, wherein: based on determining that the current speed limit is a first speed and the current vehicle speed is a second speed higher than the first speed, the speedometer has a first appearance in the portion between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed; and based on determining that the current speed limit is a third speed higher than the first speed and the current vehicle speed is not higher than the second speed, the speedometer has a second appearance different from the first appearance in the portion between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed.
[0023] According to some embodiments, a computer system is described. The computer system includes: a display generating component; and means for performing the following operations: displaying a speedometer indicating a current vehicle speed via the display generating component, wherein: based on determining that the current speed limit is a first speed and the current vehicle speed is a second speed higher than the first speed, the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed has a first appearance; and based on determining that the current speed limit is a third speed higher than the first speed and the current vehicle speed is not higher than the second speed, the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed has a second appearance different from the first appearance.
[0024] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component. The one or more programs include instructions for performing the following operations: displaying a speedometer indicating a current vehicle speed via the display generation component, wherein: based on determining that the current speed limit is a first speed and that the current vehicle speed is a second speed higher than the first speed, the speedometer has a first appearance in the portion between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed; and based on determining that the current speed limit is a third speed higher than the first speed and that the current vehicle speed is not higher than the second speed, the speedometer has a second appearance different from the first appearance in the portion between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed.
[0025] According to some embodiments, a method is described that is executed at a computer system communicating with a display generation component. The method includes: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a corresponding vehicle instrument cluster interface having a corresponding appearance, including: displaying the vehicle instrument cluster interface with a first appearance based on a determination that the display of the vehicle instrument cluster interface is subject to a first set of constraints on a visible display area of a display of the vehicle instrument cluster; and displaying the vehicle instrument cluster interface with a second appearance different from the first appearance based on a determination that the display of the vehicle instrument cluster interface is subject to a second set of constraints on the visible display area of the display of the vehicle instrument cluster, wherein the second set of constraints is different from the first set of constraints.
[0026] According to some embodiments, a non-transitory computer-readable storage medium is described. The non-transitory computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system communicating with a display generating component. The one or more programs include instructions for performing the following operations: providing the display generating component with information defining the appearance of a vehicle instrument cluster for display via the display generating component as a corresponding vehicle instrument cluster interface having the corresponding appearance, including: displaying the vehicle instrument cluster interface with a first appearance based on a determination that the display of the vehicle instrument cluster interface is subject to a first set of constraints on the visible display area of the display of the vehicle instrument cluster; and displaying the vehicle instrument cluster interface with a second appearance different from the first appearance based on a determination that the display of the vehicle instrument cluster interface is subject to a second set of constraints on the visible display area of the display of the vehicle instrument cluster, wherein the second set of constraints differs from the first set of constraints.
[0027] According to some embodiments, a transient computer-readable storage medium is described. The transient computer-readable storage medium stores one or more programs configured to be executed by one or more processors of a computer system in communication with a display generating component. The one or more programs include instructions for performing the following operations: providing the display generating component with information defining the appearance of a vehicle instrument cluster for display via the display generating component as a corresponding vehicle instrument cluster interface having the corresponding appearance, including: displaying the vehicle instrument cluster interface with a first appearance based on a determination that the display of the vehicle instrument cluster interface is subject to a first set of constraints on the visible display area of the display of the vehicle instrument cluster; and displaying the vehicle instrument cluster interface with a second appearance different from the first appearance based on a determination that the display of the vehicle instrument cluster interface is subject to a second set of constraints on the visible display area of the display of the vehicle instrument cluster, wherein the second set of constraints differs from the first set of constraints.
[0028] According to some embodiments, a computer system is described. The computer system includes: a display generation component; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster to be displayed via the display generation component as a corresponding vehicle instrument cluster interface having a corresponding appearance, including: displaying the vehicle instrument cluster interface with a first appearance based on a first set of constraints determined to be displayed on a visible display area of a display of the vehicle instrument cluster; and displaying the vehicle instrument cluster interface with a second appearance different from the first appearance based on a second set of constraints determined to be displayed on the visible display area of the display of the vehicle instrument cluster.
[0029] According to some embodiments, a computer system is described. The computer system includes: a display generation component; and means for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a corresponding vehicle instrument cluster interface having a corresponding appearance, including: displaying the vehicle instrument cluster interface with a first appearance based on a first set of constraints determined to be present on a visible display area of a display of the vehicle instrument cluster; and displaying the vehicle instrument cluster interface with a second appearance different from the first appearance based on a second set of constraints determined to be present on the visible display area of the display of the vehicle instrument cluster.
[0030] According to some embodiments, a computer program product is described. The computer program product includes one or more programs configured to be executed by one or more processors of a computer system communicating with a display generation component. The one or more programs include instructions for performing the following operations: providing the display generation component with information defining the appearance of a vehicle instrument cluster for display via the display generation component as a corresponding vehicle instrument cluster interface having the corresponding appearance, including: displaying the vehicle instrument cluster interface with a first appearance based on a first set of constraints determined to be displayed on a visible display area of a display of the vehicle instrument cluster; and displaying the vehicle instrument cluster interface with a second appearance different from the first appearance based on a second set of constraints determined to be displayed on the visible display area of the display of the vehicle instrument cluster.
[0031] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors.
[0032] Therefore, faster and more efficient methods and interfaces are provided for managing digital instrument clusters, thereby improving the effectiveness, efficiency, and user satisfaction of such devices. These methods and interfaces can complement or replace other methods used for managing digital instrument clusters. Attached Figure Description
[0033] To better understand the various embodiments described, reference should be made to the following detailed description in conjunction with the accompanying drawings, wherein similar reference numerals indicate corresponding parts in all the drawings.
[0034] Figure 1A This is a block diagram illustrating a portable multi-functional device with a touch-sensitive display according to some embodiments.
[0035] Figure 1B This is a block diagram illustrating exemplary components for event handling according to some implementation schemes.
[0036] Figure 2 A portable multi-functional device with a touchscreen is shown according to some embodiments.
[0037] Figure 3 This is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to some implementation schemes.
[0038] Figure 4A An exemplary user interface for a menu on an application on a portable multifunction device, according to some implementation schemes, is shown.
[0039] Figure 4B An exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display is shown according to some embodiments.
[0040] Figure 5A A personal electronic device according to some implementation schemes is shown.
[0041] Figure 5B This is a block diagram illustrating a personal electronic device according to some implementation schemes.
[0042] Figures 6A to 6I Exemplary devices and user interfaces for customizing user-adjustable instrument groups are shown according to some implementation schemes.
[0043] Figure 7This is a flowchart illustrating a method for customizing a user-adjustable instrument group using a computer system, according to some implementation schemes.
[0044] Figures 8A to 8G Exemplary devices and user interfaces for providing vehicle-specific instrument clusters are shown according to some implementation schemes.
[0045] Figure 9 This is a flowchart illustrating a method for providing a vehicle-specific instrument cluster using a computer system, according to some implementation schemes.
[0046] Figures 10A to 10F An exemplary user interface for displaying a speed limit indication is shown according to some implementation schemes.
[0047] Figure 11 This is a flowchart illustrating a method for displaying a speed limit indication using a computer system, according to some implementation schemes.
[0048] Figures 12A to 12D Exemplary devices and user interfaces for providing dynamic instrument clusters are shown according to some implementation schemes.
[0049] Figure 13 This is a flowchart illustrating a method for providing a dynamic instrument group using a computer system, according to some implementation schemes.
[0050] Figure 14 This is a flowchart illustrating a method for displaying content using a computer system according to some implementation schemes.
[0051] Figure 15 This is a flowchart illustrating a method for conditionally displaying a user interface using a computer system, according to some implementation schemes. Detailed Implementation
[0052] The following description illustrates exemplary methods, parameters, etc. However, it should be understood that such description is not intended to limit the scope of this disclosure, but is provided as a description of exemplary embodiments.
[0053] There is a need for electronic devices that provide effective methods and interfaces for managing instrument clusters. For example, updating the appearance of the instrument cluster provides users with visual feedback on vehicle status while reducing driver distraction. Such technologies can alleviate the cognitive burden on users of instrument clusters, thereby improving productivity. Furthermore, such technologies can reduce processor and battery power wasted otherwise on redundant user input.
[0054] under, Figures 1A to 1B , Figure 2 , Figure 3 , Figures 4A to 4B as well as Figures 5A to 5B A description is provided of an exemplary device for implementing techniques for managing groups of electronic instruments.
[0055] Figures 6A to 6I Exemplary devices and user interfaces for customizing user-adjustable instrument groups are shown according to some implementation schemes. Figure 7 This is a flowchart illustrating a method for customizing a user-adjustable instrument group using a computer system, according to some implementation schemes. Figure 15 This is a flowchart illustrating a method for conditionally displaying a user interface using a computer system, according to some implementation schemes. Figures 6A to 6I The user interface in the document is used to illustrate the process described below, including Figure 7 and Figure 15 The process in.
[0056] Figures 8A to 8G Exemplary devices and user interfaces for providing vehicle-specific instrument clusters are shown according to some implementation schemes. Figure 9 This is a flowchart illustrating a method for providing a vehicle-specific instrument cluster using a computer system, according to some implementation schemes. Figure 14 This is a flowchart illustrating a method for displaying content using a computer system according to some implementation schemes. Figures 8A to 8G The user interface in the document is used to illustrate the process described below, including Figure 9 and Figure 14 The process in.
[0057] Figures 10A to 10F An exemplary user interface for displaying a speed limit indication is shown according to some implementation schemes. Figure 11 This is a flowchart illustrating a method for displaying a speed limit indication using a computer system, according to some implementation schemes. Figures 10A to 10F The user interface in the document is used to illustrate the process described below, including Figure 11 The process in.
[0058] Figures 12A to 12D Exemplary devices and user interfaces for providing dynamic instrument clusters are shown according to some implementation schemes. Figure 13 This is a flowchart illustrating a method for providing a dynamic instrument group using a computer system, according to some implementation schemes. Figures 12A to 12D The user interface in the document is used to illustrate the process described below, including Figure 13 The process in.
[0059] The processes described below enhance device operability and make the user-device interface more efficient through various technologies (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), including providing users with improved visual feedback, reducing the amount of input required to perform operations, providing additional control options without cluttering the user interface with additional display controls, and performing operations without further user input and / or additional techniques when a set of conditions have been met. These technologies also reduce power consumption and extend device battery life by enabling users to use the device faster and more efficiently.
[0060] Furthermore, in methods described herein where one or more steps depend on the satisfaction of one or more conditions, it should be understood that the method may be repeated in multiple repetitions such that, during the repetitions, all conditions determining the steps in the method are satisfied in different repetitions of the method. For example, if a method requires performing a first step (if a condition is satisfied) and a second step (if a condition is not satisfied), those skilled in the art will know that the stated steps are repeated until both conditions are satisfied and not satisfied (in no particular order). Thus, a method described as having one or more steps depending on the satisfaction of one or more conditions can be rewritten as a method that repeats until each condition described in the method is satisfied. However, this does not require the system or computer-readable medium to declare that the system or computer-readable medium contains instructions for performing discretionary operations based on the satisfaction of the corresponding one or more conditions, and thus to determine whether possible conditions have been satisfied without explicitly repeating the steps of the method until all conditions determining the steps in the method are satisfied. Those skilled in the art will also understand that, similar to methods having discretionary steps, a system or computer-readable storage medium may repeat the steps of the method multiple times as needed to ensure that all discretionary steps have been performed.
[0061] Although the following description uses terms such as "first," "second," etc., to describe various elements, these elements should not be limited by the terminology. In some embodiments, these terms are used only to distinguish one element from another. For example, a first touch may be named a second touch and similarly, a second touch may be named a first touch, without departing from the scope of the various described embodiments. In some embodiments, a first touch and a second touch are two separate references to the same touch. In some embodiments, both a first touch and a second touch are touches, but they are not the same touch.
[0062] The terminology used in the description of the various embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various embodiments and the appended claims, the singular forms “a” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and covers any and all possible combinations of one or more of the associated listed items. It will also be understood that the terms “comprising” and / or “including” as used in this specification specify the presence of the stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0063] Depending on the context, the term "if" may optionally be interpreted as meaning "when," "in response to," or "in response to detection." Similarly, depending on the context, the phrases "if it is determined..." or "if [the stated condition or event] is detected" may optionally be interpreted as meaning "in response to determining..." or "in response to detecting [the stated condition or event]."
[0064] This document describes implementations of electronic devices, user interfaces for such devices, and associated processes for using such devices. In some implementations, the device is a portable communication device, such as a mobile phone, that also includes other functionalities such as PDA and / or music player functionality. Exemplary implementations of portable multi-functional devices include, but are not limited to, those from Apple Inc. (Cupertino, California). Devices, iPod Equipment, and Device. Optionally, other portable electronic devices may be used, such as laptops or tablets with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads). In some embodiments, the electronic device is a computer system that communicates with a display generating component (e.g., via wireless or wired communication). The display generating component is configured to provide visual output, such as a display via a CRT monitor, a display via an LED monitor, or a display via image projection. In some embodiments, the display generating component is integrated with the computer system. In some embodiments, the display generating component is separate from the computer system. As used herein, “display” content includes displaying content (e.g., video data rendered or decoded by display controller 156) by transmitting data (e.g., image data or video data) to an integrated or external display generating component via a wired or wireless connection to visually generate content.
[0065] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device may optionally include one or more other physical user interface devices, such as a physical keyboard, mouse, and / or joystick.
[0066] The device typically supports a variety of applications, such as one or more of the following: drawing applications, presentation applications, word processing applications, website creation applications, disk editing applications, spreadsheet applications, game applications, phone applications, video conferencing applications, email applications, instant messaging applications, fitness support applications, photo management applications, digital camera applications, digital video camcorder applications, web browsing applications, digital music player applications, and / or digital video player applications.
[0067] Various applications running on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and the corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the respective applications. In this way, the device's common physical architecture (such as the touch-sensitive surface) optionally utilizes a user interface that is intuitive and clear to the user to support various applications.
[0068] Now let’s turn our attention to implementation schemes for portable devices with touch-sensitive displays. Figure 1AThis is a block diagram illustrating a portable multi-functional device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a “touchscreen” for convenience, and is sometimes referred to as or called a “touch-sensitive display system.” Device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, RF circuitry 108, audio circuitry 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of device 100). Device 100 optionally includes one or more haptic output generators 167 for generating haptic output on device 100 (e.g., generating haptic output on a touch-sensitive surface such as the touch-sensitive display system 112 of device 100 or the touchpad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.
[0069] As used in this specification and claims, the term "intensity" of contact on a tactile surface refers to the force or pressure (force per unit area) of a contact (e.g., finger contact) on a tactile surface, or to a substitute (alternative) for the force or pressure of a contact on a tactile surface. The intensity of contact has a range of values that includes at least four different values and more typically hundreds of different values (e.g., at least 256). The intensity of contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the tactile surface are optionally used to measure the force at different points on the tactile surface. In some embodiments, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the tactile surface. Alternatively, the size and / or variation of the contact area detected on the touch-sensitive surface, the capacitance and / or variation of the touch-sensitive surface near the contact, and / or the resistance and / or variation of the touch-sensitive surface near the contact may optionally be used as substitutes for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether an intensity threshold (e.g., the intensity threshold is described in units corresponding to the substitute measurement) has been exceeded. In some embodiments, the substitute measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold (e.g., the intensity threshold is a pressure threshold measured in units of pressure) has been exceeded. Using the intensity of the contact as an attribute of user input allows the user to access additional device functions that would otherwise be inaccessible to the user on a smaller device with limited physical space, which is used (e.g., on a touch-sensitive display) to display an indication and / or receive user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical controls, such as knobs or buttons).
[0070] As used in this specification and claims, the term "haptic output" refers to a physical displacement of the device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., the housing), or a displacement of a component relative to the center of mass of the device, which is detected by the user using the user's tactile sense. For example, when the device or a component of the device comes into contact with a touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the haptic output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical characteristics of the device or a component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or touchpad) may optionally be interpreted by the user as a "press-click" or "release-click" on a physically actuated button. In some cases, the user will feel a tactile sensation, such as a "press-click" or "release-click," even when a physically actuated button associated with a touch-sensitive surface that has been physically pressed (e.g., displaced) by the user's movement does not move. For example, even when the smoothness of the tactile surface remains unchanged, the movement of the tactile surface can optionally be interpreted or sensed by the user as the "roughness" of the tactile surface. While such interpretations of touch by users will be limited by the individualized sensory perceptions of the user, many sensory perceptions of touch are common to most users. Therefore, when a tactile output is described as corresponding to a specific sensory perception of a user (e.g., "press click", "release click", "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or its components that will generate the sensory perception of a typical (or ordinary) user.
[0071] It should be understood that device 100 is merely an example of a portable multifunctional device, and device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of these components. Figure 1A The various components shown are implemented in hardware, software, or a combination of both, including one or more signal processing and / or application-specific integrated circuits.
[0072] Memory 102 optionally includes high-speed random access memory and also optionally includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls other components of device 100 to access memory 102.
[0073] Peripheral interface 118 can be used to couple the device's input and output peripherals to CPU 120 and memory 102. The one or more processors 120 run or execute various software programs (such as computer programs (e.g., including instructions)) and / or instruction sets stored in memory 102 to perform various functions of device 100 and process data. In some embodiments, peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.
[0074] RF (Radio Frequency) circuit 108 receives and transmits RF signals, also known as electromagnetic signals. RF circuit 108 converts electrical signals into electromagnetic signals and vice versa, and communicates with communication networks and other communication devices via these electromagnetic signals. RF circuit 108 optionally includes well-known circuitry for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, Subscriber Identity Module (SIM) cards, memory, etc. RF circuit 108 optionally communicates wirelessly with networks and other devices, such as the Internet (also known as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuit 108 optionally includes well-known circuitry for detecting near-field communication (NFC) fields, such as via near-field communication radio components. Wireless communication may optionally employ any of a variety of communication standards, protocols, and technologies, including but not limited to Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed Downlink Packet Access (HSDPA), High-Speed Uplink Packet Access (HSUPA), Evolution, Pure Data (EV-DO), HSPA, HSPA+, Dual-Unit HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), and Wi-Fi (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE...). 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Messaging Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence with Extended Utility (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol that has not been developed as of the date of this document submission.
[0075] Audio circuitry 110, speaker 111, and microphone 113 provide an audio interface between the user and device 100. Audio circuitry 110 receives audio data from peripheral interface 118, converts the audio data into electrical signals, and transmits the electrical signals to speaker 111. Speaker 111 converts the electrical signals into sound waves that are audible to humans. Audio circuitry 110 also receives electrical signals converted from sound waves by microphone 113. Audio circuitry 110 converts the electrical signals into audio data and transmits the audio data to peripheral interface 118 for processing. Audio data is optionally retrieved by peripheral interface 118 from and / or transmitted to memory 102 and / or RF circuitry 108. In some embodiments, audio circuitry 110 also includes a headset jack (e.g., ...). Figure 2 (212 in the text). The headset jack provides an interface between the audio circuitry 110 and a removable audio input / output peripheral device, such as an output-only headphone or a headset with both output (e.g., a single-ear or dual-ear headphone) and input (e.g., a microphone).
[0076] I / O subsystem 106 couples input / output peripherals on device 100, such as touchscreen 112 and other input control devices 116, to peripheral interface 118. I / O subsystem 106 optionally includes display controller 156, optical sensor controller 158, depth camera controller 169, intensity sensor controller 159, haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive electrical signals from / send electrical signals to the other input control device 116. The other input control device 116 optionally includes physical buttons (e.g., push-buttons, rocker buttons, etc.), dial pads, slide switches, joysticks, click dials, etc. In some embodiments, input controller 160 is optionally coupled to (or not coupled to) any of the following: keyboard, infrared port, USB port, and pointing device such as mouse. One or more buttons (e.g., Figure 2 Optionally, 208) includes an increase / decrease button for volume control of speaker 111 and / or microphone 113. The one or more buttons optionally include a push-button (e.g., Figure 2(Ref. 206 in the original text). In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wireless communication or via wired communication). In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a touchpad, as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking user gestures (e.g., hand gestures and / or air gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system. In some implementations, air gestures are gestures detected without the user touching an input element that is part of the device (or independently of an input element that is part of the device) and based on the detected movement of a part of the user's body through the air (including movement of the user's body relative to an absolute reference (e.g., the angle of the user's arm relative to the ground or the distance of the user's hand relative to the ground), movement relative to another part of the user's body (e.g., movement of the user's hand relative to the user's shoulder, movement of one of the user's hands relative to the user's other hand, and / or movement of the user's fingers relative to another finger or part of the user's hand), and / or absolute movement of a part of the user's body (e.g., a tapping gesture that includes a hand moving a predetermined amount and / or speed in a predetermined posture, or a shaking gesture that includes a predetermined speed or amount of rotation of a part of the user's body)).
[0077] A quick press of the push button optionally disengages the touchscreen 112 from its lock or optionally initiates a process of unlocking the device using gestures on the touchscreen, as described in U.S. Patent Application 11 / 322,549 (i.e., U.S. Patent No. 7,657,849), filed December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image," the entire contents of which are incorporated herein by reference. A long press of the push button (e.g., 206) optionally powers the device 100 on or off. The function of one or more buttons is optionally user-customizable. The touchscreen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.
[0078] The touch-sensitive display 112 provides input and output interfaces between the device and the user. The display controller 156 receives electrical signals from and / or sends electrical signals to the touchscreen 112. The touchscreen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively, "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.
[0079] Touchscreen 112 has a touch-sensitive surface, sensor, or sensor array that accepts input from a user based on tactile and / or haptic contact. Touchscreen 112 and display controller 156 (along with any associated modules and / or instruction set in memory 102) detect contact on touchscreen 112 (and any movement or interruption of that contact) and translate the detected contact into interaction with user interface objects (e.g., one or more soft keys, icons, web pages, or images) displayed on touchscreen 112. In an exemplary embodiment, the contact point between touchscreen 112 and the user corresponds to the user's finger.
[0080] Touchscreen 112 optionally employs LCD (Liquid Crystal Display) technology, LPD (Light Emitting Polymer Display) technology, or LED (Light Emitting Diode) technology, but other display technologies are used in other embodiments. Touchscreen 112 and display controller 156 optionally employ any of a variety of touch sensing technologies now known or to be developed hereafter, along with other proximity sensor arrays or other elements for determining one or more points of contact with touchscreen 112, to detect contact and any movement or interruption thereof. These various touch sensing technologies include, but are not limited to, capacitive, resistive, infrared, and surface acoustic wave technologies. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as that from Apple Inc. (Cupertino, California). and iPod The technology used.
[0081] In some embodiments of the touchscreen 112, the touch-sensitive display optionally resembles a multi-touch touchpad described in the following U.S. patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.) and / or U.S. Patent Publication 2002 / 0015024A1, each of which is incorporated herein by reference in its entirety. However, the touchscreen 112 displays visual output from the device 100, while the touch-sensitive touchpad does not provide visual output.
[0082] The touch-sensitive display in some embodiments of the touchscreen 112 is described in the following applications: (1) U.S. Patent Application 11 / 381,313, filed May 2, 2006, “Multipoint Touch Surface Controller”; (2) U.S. Patent Application 10 / 840,862, filed May 6, 2004, “Multipoint Touchscreen”; (3) U.S. Patent Application 10 / 903,964, filed July 30, 2004, “Gestures For Touch Sensitive Input Devices”; (4) U.S. Patent Application 11 / 048,264, filed January 31, 2005, “Gestures For Touch Sensitive Input Devices”; and (5) U.S. Patent Application 11 / 038,590, filed January 18, 2005, “Mode-Based Graphical User Interfaces For Touch Sensitive Input”. (6) U.S. Patent Application No. 11 / 228,758, filed September 16, 2005, “Virtual Input Device Placement On A Touch Screen User Interface”; (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, “Operation Of A Computer With A Touch Screen Interface”; (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, “Activating Virtual Keys Of A Touch-Screen Virtual Keyboard”; and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, “Multi-Functional Hand-Held Device”. The full text of all these applications is incorporated herein by reference.
[0083] Touchscreen 112 optionally has a video resolution exceeding 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. Users optionally use any suitable object or accessory such as a stylus, finger, etc., to interact with touchscreen 112. In some embodiments, the user interface is designed to operate primarily through finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of a finger on the touchscreen. In some embodiments, the device translates coarse finger-based input into precise pointer / cursor positions or commands to perform the user-desired actions.
[0084] In some embodiments, in addition to the touchscreen, device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of the device that, unlike the touchscreen, does not display visual output. Optionally, the touchpad is a touch-sensitive surface separate from the touchscreen 112, or an extension of the touch-sensitive surface formed by the touchscreen.
[0085] The device 100 also includes a power system 162 for supplying power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., light-emitting diodes (LEDs)), and any other components associated with the generation, management, and distribution of power in the portable device.
[0086] The device 100 may optionally also include one or more optical sensors 164. Figure 1AAn optical sensor 164 is shown coupled to an optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with an imaging module 143 (also called a camera module), the optical sensor 164 optionally captures still images or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite to a touchscreen display 112 on the front of the device, allowing the touchscreen display to be used as a viewfinder for still image and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device, allowing images of the user to be optionally acquired for video conferencing while the user views other video conferencing participants on the touchscreen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lenses and sensor within the device housing), allowing a single optical sensor 164 to be used in conjunction with the touchscreen display for both video conferencing and still image and / or video image acquisition.
[0087] The device 100 optionally also includes one or more depth camera sensors 175. Figure 1A A depth camera sensor is shown coupled to a depth camera controller 169 in I / O subsystem 106. Depth camera sensor 175 receives data from the environment to create a 3D model of an object (e.g., a face) within the scene from a viewpoint (e.g., the depth camera sensor). In some embodiments, in conjunction with imaging module 143 (also referred to as a camera module), depth camera sensor 175 may optionally be used to determine depth maps of different portions of an image captured by imaging module 143. In some embodiments, the depth camera sensor is located at the front of device 100, such that user images with depth information are optionally acquired for video conferencing while the user views other video conferencing participants on a touchscreen display, and selfies with depth map data are captured. In some embodiments, depth camera sensor 175 is located at the rear of the device, or both the rear and front of device 100. In some embodiments, the position of depth camera sensor 175 may be changed by the user (e.g., by rotating a lens and sensor within the device housing), such that depth camera sensor 175 is used in conjunction with a touchscreen display for both video conferencing and still image and / or video image acquisition.
[0088] The device 100 may optionally also include one or more contact strength sensors 165. Figure 1AA contact strength sensor is shown coupled to a strength sensor controller 159 in I / O subsystem 106. The contact strength sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electro-force sensors, piezoelectric sensors, optical force sensors, capacitive touch-sensitive surfaces, or other strength sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). The contact strength sensor 165 receives contact strength information (e.g., pressure information or a substitute for pressure information) from the environment. In some embodiments, at least one contact strength sensor is arranged juxtaposed with or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact strength sensor is located on the rear of device 100, opposite to the touchscreen display 112 located on the front of device 100.
[0089] The device 100 optionally also includes one or more proximity sensors 166. Figure 1A A proximity sensor 166 coupled to a peripheral device interface 118 is shown. Alternatively, the proximity sensor 166 may optionally be coupled to an input controller 160 in an I / O subsystem 106. The proximity sensor 166 may optionally perform as described in the following U.S. patent applications: No. 11 / 241,839, entitled "Proximity Detector In Handheld Device"; No. 11 / 240,788, entitled "Proximity Detector In Handheld Device"; No. 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; No. 11 / 586,862, entitled "Automated Response To And Sensing Of User Activity In Portable Devices"; and No. 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", the entire contents of which are incorporated herein by reference. In some implementations, the proximity sensor is turned off and the touchscreen 112 is disabled when the multifunction device is placed near the user's ear (e.g., when the user is making a phone call).
[0090] The device 100 may optionally also include one or more tactile output generators 167. Figure 1AA haptic output generator coupled to a haptic feedback controller 161 in I / O subsystem 106 is shown. The haptic output generator 167 optionally includes one or more electroacoustic devices such as speakers or other audio components; and / or electromechanical devices for converting energy into linear motion, such as motors, solenoids, electroactive polymers, piezoelectric actuators, electrostatic actuators, or other haptic output generating components (e.g., components for converting electrical signals into haptic outputs on the device). A contact intensity sensor 165 receives haptic feedback generation instructions from a haptic feedback module 133 and generates a haptic output on device 100 that can be felt by a user of device 100. In some embodiments, at least one haptic output generator is juxtaposed or adjacent to a haptic surface (e.g., haptic display system 112) and optionally generates the haptic output by moving the haptic surface vertically (e.g., in / outward from the surface of device 100) or laterally (e.g., backward and forward in the same plane as the surface of device 100). In some embodiments, at least one haptic output generator sensor is located on the rear of the device 100, opposite to the touch screen display 112 located on the front of the device 100.
[0091] The device 100 may optionally also include one or more accelerometers 168. Figure 1A An accelerometer 168 coupled to a peripheral device interface 118 is shown. Alternatively, the accelerometer 168 may be coupled to an input controller 160 in an I / O subsystem 106. The accelerometer 168 may optionally perform as described in the following U.S. patent publications: U.S. Patent Publication No. 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and U.S. Patent Publication No. 20060017692, entitled "Methods and Apparatuses For Operating A Portable Device Based On An Accelerometer," both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed on a touchscreen display in portrait or landscape view based on analysis of data received from one or more accelerometers. Device 100 may optionally include, in addition to the accelerometer 168, a magnetometer and a GPS (or GLONASS or other global navigation system) receiver for acquiring information about the location and orientation (e.g., portrait or landscape) of device 100.
[0092] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application program (or instruction set) 136. Furthermore, in some embodiments, memory 102 ( Figure 1A ) or 370 ( Figure 3 Storage device / global internal state 157, such as Figure 1A and Figure 3 As shown in the figure. Device / global internal state 157 includes one or more of the following: active application state, which indicates which applications (if any) are currently active; display state, indicating what applications, views or other information occupy various areas of the touch screen display 112; sensor state, including information obtained from the device's various sensors and input control devices 116; and position information relating to the device's position and / or orientation.
[0093] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or embedded operating systems such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.) and facilitates communication between various hardware and software components.
[0094] The communication module 128 facilitates communication with other devices via one or more external ports 124 and includes various software components for processing data received by the RF circuitry 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) are adapted to be directly coupled to other devices or indirectly coupled via a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is connected to… (Trademark of Apple Inc.) The same or similar and / or compatible multi-pin (e.g., 30-pin) connectors used in Apple Inc. devices.
[0095] The contact / motion module 130 optionally detects contact with the touchscreen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., touchpads or physical click-based rotary dials). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether a contact has occurred (e.g., detecting a finger press event), determining the contact intensity (e.g., the force or pressure of the contact, or an alternative to force or pressure), determining whether there is movement of the contact and tracking movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or a contact break). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point optionally includes determining the rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to single-point contact (e.g., single-finger contact) or multi-point simultaneous contact (e.g., "multi-touch" / multiple-finger contact). In some implementations, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.
[0096] In some implementations, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by a user (e.g., determining whether the user has “clicked” an icon). In some implementations, at least a subset of the intensity thresholds is determined based on software parameters (e.g., the intensity thresholds are not determined by the activation threshold of a specific physical actuator and can be adjusted without changing the physical hardware of device 100). For example, the mouse “click” threshold of a touchpad or touchscreen can be set to any threshold in a wide range of predefined thresholds without changing the touchpad or touchscreen display hardware. Additionally, in some specific implementations, the user of the device is provided with software settings for adjusting one or more intensity thresholds in a set (e.g., by adjusting the individual intensity thresholds and / or by adjusting multiple intensity thresholds at once using system-level clicks on the “intensity” parameter).
[0097] The touch / motion module 130 optionally detects gesture input performed by the user. Different gestures on a touch-sensitive surface have different contact patterns (e.g., different movements, timings, and / or intensities of the detected contact). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event and then detecting a finger lift-off (lift-away) event at the same (or substantially the same) location as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on a touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and subsequently detecting a finger lift-off (lift-away) event.
[0098] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other displays, including components for altering the visual impact of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). As used herein, the term "graphics" includes any object that can be displayed to a user, including but not limited to text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.
[0099] In some implementations, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from an application or the like to specify the graphic to be displayed, and, if necessary, also receives coordinate data and other graphic attribute data, and then generates screen image data for output to the display controller 156.
[0100] The haptic feedback module 133 includes various software components for generating instructions which are used by the haptic output generator 167 to generate haptic output at one or more locations on the device 100 in response to user interaction with the device 100.
[0101] Optionally, the text input module 134, a component of the graphics module 132, provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application that requires text input).
[0102] GPS module 135 determines the location of the device and provides that information for use in various applications (e.g., to phone 138 for use in location-based dialing; to camera 143 as image / video metadata; and to applications that provide location-based services, such as weather widgets, local yellow pages widgets, and map / navigation widgets).
[0103] Application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof:
[0104] • Contacts module 137 (sometimes called address book or contact list);
[0105] • Telephone module 138;
[0106] • Video conferencing module 139;
[0107] • Email client module 140;
[0108] • Instant Messaging (IM) module 141;
[0109] Fitness support module 142;
[0110] • Camera module 143 for still images and / or video images;
[0111] • Image management module 144;
[0112] • Video player module;
[0113] Music player module;
[0114] • Browser module 147;
[0115] • Calendar module 148;
[0116] • Widget module 149, which optionally includes one or more of the following: weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, and other widgets acquired by the user, and user-created widgets 149-6;
[0117] • Widget creator module 150 for creating user-created widgets 149-6;
[0118] • Search module 151;
[0119] • Video and music player module 152, which combines a video player module and a music player module;
[0120] • Notes module 153;
[0121] • Map module 154; and / or
[0122] • Online video module 155.
[0123] Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, Java-enabled applications, encryption, digital rights management, speech recognition, and speech duplication.
[0124] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., in the application internal state 192 of the contact module 137 stored in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140, or IM 141; and so on.
[0125] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, telephone module 138 is optionally used to input character sequences corresponding to telephone numbers, access one or more telephone numbers in contact module 137, modify entered telephone numbers, dial corresponding telephone numbers, initiate conversations, and disconnect or hang up when a conversation is completed. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.
[0126] Combining RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138, video conferencing module 139 includes executable instructions to initiate, conduct, and terminate video conferences between the user and one or more other participants based on user instructions.
[0127] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user commands. Combined with image management module 144, email client module 140 makes it very easy to create and send emails containing still images or video images captured by camera module 143.
[0128] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for: inputting a character sequence corresponding to an instant message, modifying previously input characters, transmitting a corresponding instant message (e.g., using Short Message Service (SMS) or Multimedia Messaging Service (MMS) protocols for telephone-based instant messaging or using XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving an instant message, and viewing a received instant message. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments supported in MMS and / or Enhanced Messaging Services (EMS). As used herein, "instant message" refers to both telephone-based messages (e.g., messages sent using SMS or MMS) and internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).
[0129] Incorporating RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, fitness support module 142 includes executable instructions for creating fitness activities (e.g., with time, distance, and / or calorie burning goals); communicating with fitness sensors (executive devices); receiving fitness sensor data; calibrating sensors used to monitor fitness; selecting and playing music for fitness activities; and displaying, storing, and transmitting fitness data.
[0130] In conjunction with the touchscreen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, the camera module 143 includes executable instructions for: capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.
[0131] Incorporating the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, tagging, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.
[0132] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, browser module 147 includes executable instructions for browsing the Internet according to user instructions, including searching, linking to, receiving, and displaying web pages or portions thereof, as well as links to attachments and other files on web pages.
[0133] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, calendar module 148 includes executable instructions to create, display, modify, and store calendars and associated data (e.g., calendar entries, to-dos, etc.) according to user instructions.
[0134] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget module 149 is optionally a microapplication downloaded and used by a user (e.g., weather widget 149-1, stock market widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5) or a user-created microapplication (e.g., user-created widget 149-6). In some embodiments, the widget includes HTML (Hypertext Markup Language) files, CSS (Cascading Style Sheets) files, and JavaScript files. In some embodiments, the widget includes XML (Extensible Markup Language) files and JavaScript files (e.g., Yahoo! widgets).
[0135] In conjunction with RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and browser module 147, widget creator module 150 can optionally be used by the user to create widgets (e.g., to convert user-specified portions of a webpage into widgets).
[0136] In conjunction with the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos, and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.
[0137] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions allowing users to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touchscreen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).
[0138] Incorporating the touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the note-taking module 153 includes executable instructions for creating and managing notes, to-do items, etc., according to user instructions.
[0139] Combining RF circuitry 108, touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, map module 154 is optionally used to receive, display, modify, and store maps and map-related data (e.g., driving directions, data related to shops and other points of interest at or near a specific location, and other location-based data) according to user instructions.
[0140] Incorporating touchscreen 112, display controller 156, touch / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, text input module 134, email client module 140, and browser module 147, the online video module 155 includes instructions for performing the following actions: allowing users to access, browse, receive (e.g., via streaming and / or downloading), play back (e.g., on the touchscreen or on an external display connected via external port 124), send emails with links to specific online videos, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, an instant messaging module 141 is used instead of the email client module 140 to send links to specific online videos. Further descriptions of the online video application can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are incorporated herein by reference in their entirety.
[0141] Each of the above modules and applications corresponds to an executable set of instructions for performing one or more of the functions described above and the methods described in this patent application (e.g., computer-implemented methods and other information processing methods as described herein). These modules (e.g., instruction sets) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), processes, or modules; therefore, various subsets of these modules may optionally be combined or otherwise rearranged in various embodiments. For example, a video player module may optionally be combined with a music player module into a single module (e.g., Figure 1A (e.g., video and music player module 152). In some embodiments, memory 102 optionally stores subgroups of the aforementioned modules and data structures. Additionally, memory 102 optionally stores other modules and data structures not described above.
[0142] In some implementations, device 100 is a device on which the operation of a predefined set of functions is performed solely via a touchscreen and / or touchpad. By using a touchscreen and / or touchpad as the primary input control device for operating device 100, the number of physical input control devices (e.g., push-buttons, dials, etc.) on device 100 can be optionally reduced.
[0143] A predefined set of functions, uniquely performed via a touchscreen and / or touchpad, optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by a user, navigates device 100 from any user interface displayed on device 100 to the main menu, home menu, or root menu. In such embodiments, a "menu button" is implemented using a touchpad. In some other embodiments, the menu button is a physical push-button or other physical input control device, rather than a touchpad.
[0144] Figure 1B This is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370 ( Figure 3 This includes an event classifier 170 (e.g., in operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).
[0145] Event classifier 170 receives event information and determines the application 136-1 and application view 191 of application 136-1 to which the event information should be delivered. Event classifier 170 includes event monitor 171 and event dispatcher module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information should be delivered.
[0146] In some implementations, the application internal state 192 includes additional information such as one or more of the following: recovery information to be used when the application 136-1 resumes execution, user interface state information indicating that information is being displayed or ready to be displayed by the application 136-1, a state queue for enabling the user to return to the previous state or view of the application 136-1, and a repeat / undo queue for the user's previous actions.
[0147] Event monitor 171 receives event information from peripheral device interface 118. The event information includes information about sub-events (e.g., user touches on touch-sensitive display 112 as part of a multi-touch gesture). Peripheral device interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (via audio circuitry 110). The information received by peripheral device interface 118 from I / O subsystem 106 includes information from touch-sensitive display 112 or touch-sensitive surfaces.
[0148] In some implementations, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other implementations, peripheral device interface 118 transmits event information only when a significant event occurs (e.g., receiving input above a predetermined noise threshold and / or receiving input for a predetermined duration).
[0149] In some implementations, the event classifier 170 also includes a hit view determination module 172 and / or an activity event recognizer determination module 173.
[0150] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides a software process for determining where a sub-event has occurred within one or more views. A view consists of controls and other elements that the user can see on the display.
[0151] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of the corresponding application) in which a touch is detected optionally corresponds to a procedural level within the application's procedural or view hierarchy. For example, the lowest-level view in which a touch is detected is optionally referred to as the hit view, and the set of events identified as correct input is optionally determined at least in part based on the hit view of the initial touch that initiates a touch-based gesture.
[0152] The hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchical structure, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchical structure from which the sub-events should be processed. In most cases, the hit view is the lowest-level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events forming an event or potential event) occurs. Once the hit view is identified by the hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source to which it was identified as the hit view.
[0153] The activity event recognizer determination module 173 determines which views(s) within the view hierarchy should receive a specific sub-event sequence. In some embodiments, the activity event recognizer determination module 173 determines that only the hit view should receive the specific sub-event sequence. In other embodiments, the activity event recognizer determination module 173 determines that all views including the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive the specific sub-event sequence. In other embodiments, even if the touch sub-event is entirely confined to the area associated with a particular view, higher views in the hierarchy will still remain actively participating views.
[0154] Event assigner module 174 assigns event information to event identifiers (e.g., event identifier 180). In embodiments that include active event identifier determination module 173, event assigner module 174 delivers event information to the event identifier determined by active event identifier determination module 173. In some embodiments, event assigner module 174 stores event information in an event queue, which is retrieved by the corresponding event receiver 182.
[0155] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or part of another module (such as contact / motion module 130) stored in memory 102.
[0156] In some implementations, application 136-1 includes a plurality of event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, a corresponding application view 191 includes a plurality of event recognizers 180. In other implementations, one or more of the event recognizers 180 are part of a separate module, such as a user interface toolkit or a higher-level object from which application 136-1 inherits methods and other properties. In some implementations, a corresponding event handler 190 includes one or more of the following: a data updater 176, an object updater 177, a GUI updater 178, and / or event data 179 received from an event classifier 170. Event handlers 190 optionally utilize or invoke the data updater 176, the object updater 177, or the GUI updater 178 to update the application's internal state 192. Alternatively, one or more application views in application view 191 include one or more corresponding event handlers 190. Additionally, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.
[0157] The corresponding event recognizer 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event recognizer 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event recognizer 180 also includes at least one subset of metadata 183 and event delivery instructions 188 (which optionally include sub-event delivery instructions).
[0158] Event receiver 182 receives event information from event classifier 170. The event information includes information about sub-events, such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves touch movement, the event information optionally also includes the rate and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another (e.g., from a longitudinal orientation to a lateral orientation, or vice versa), and the event information includes corresponding information about the device's current orientation (also referred to as device orientation).
[0159] Event comparator 184 compares event information with predefined event or sub-event definitions and determines the event or sub-event based on the comparison, or determines or updates the state of the event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 contains definitions of events (e.g., predefined sequences of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, event 1 (187-1) is defined as a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on the displayed object, a first lift-off of a predetermined duration (touch end), a second touch (touch start) of a predetermined duration on the displayed object, and a second lift-off of a predetermined duration (touch end). In another example, event 2 (187-2) is defined as a drag on a displayed object. For example, dragging includes a touch (or contact) on the displayed object for a predetermined duration, movement of the touch on the touch-sensitive display 112, and lifting off the touch (end of touch). In some embodiments, the event also includes information for one or more associated event handlers 190.
[0160] In some implementations, event definition 187 includes definitions of events for corresponding user interface objects. In some implementations, event comparator 184 performs a hit test to determine which user interface object is associated with the sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects the event handler associated with the sub-event and the object that triggered the hit test.
[0161] In some implementations, the definition of the corresponding event (187) also includes a delay action that delays the delivery of event information until it has been determined whether the sub-event sequence actually corresponds to or does not correspond to the event type of the event recognizer.
[0162] When the corresponding event recognizer 180 determines that the sub-event sequence does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events based on touch gestures are ignored. In this case, other event recognizers (if any) that remain active in the hit view continue to track and process the ongoing sub-events based on touch gestures.
[0163] In some embodiments, the corresponding event recognizer 180 includes metadata 183 having configurable attributes, flags, and / or lists instructing how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing how or how event recognizers can interact with each other. In some embodiments, the metadata 183 includes configurable attributes, flags, and / or lists instructing whether sub-events are delivered to different levels in a view or programmatic hierarchy.
[0164] In some implementations, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates the event handler 190 associated with the event. In some implementations, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and delaying) the sub-event to the corresponding hit view. In some implementations, the event recognizer 180 throws a flag associated with the identified event, and the event handler 190 associated with that flag retrieves the flag and executes a predefined process.
[0165] In some implementations, event delivery instruction 188 includes a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with the sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or the actively participating view receives the event information and executes a predetermined process.
[0166] In some implementations, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some implementations, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the location of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on touch-sensitive display.
[0167] In some implementations, event handler 190 includes, or has access to, a data updater 176, an object updater 177, and a GUI updater 178. In some implementations, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other implementations, they are included in two or more software modules.
[0168] It should be understood that the above discussion regarding event handling for user touch on a touch-sensitive display also applies to other forms of user input used to operate the multifunction device 100 using an input device, and not all user input is initiated on the touchscreen. For example, mouse movement and mouse button presses optionally in conjunction with single or multiple keyboard presses or holds; touch movements on the touchpad, such as taps, drags, scrolls, etc.; stylus input; device movement; verbal commands; detected eye movements; biometric input; and / or any combination thereof may optionally be used as input corresponding to sub-events that define the event to be identified.
[0169] Figure 2A portable multifunction device 100 with a touchscreen 112 is shown according to some embodiments. The touchscreen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more graphics by gesturing over the graphics, for example, using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of one or more graphics occurs when the user breaks contact with one or more graphics. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down), and / or scrolling (from right to left, from left to right, up and / or down) of a finger already in contact with the device 100. In some specific embodiments or in some cases, unintentional contact with a graphic does not select the graphic. For example, a swipe gesture over an application icon optionally does not select the corresponding application when the gesture corresponding to selection is a tap.
[0170] Device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, menu button 204 is optionally used to navigate to any application 136 of a set of applications optionally executed on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on touchscreen 112.
[0171] In some embodiments, device 100 includes a touchscreen 112, a menu button 204, a push-button 206 for powering on / off and locking the device, one or more volume control buttons 208, a SIM card slot 210, a headset jack 212, and a docking / charging external port 124. The push-button 206 is optionally used to power on / off the device by pressing the button and holding it in the pressed state for a predefined time interval; to lock the device by pressing the button and releasing it before the predefined time interval has elapsed; and / or to unlock the device or initiate an unlocking process. In another embodiment, device 100 also accepts voice input via microphone 113 for activating or deactivating certain functions. Device 100 also optionally includes one or more contact strength sensors 165 for detecting the intensity of contact on the touchscreen 112, and / or one or more haptic output generators 167 for generating haptic outputs for a user of device 100.
[0172] Figure 3This is a block diagram of an exemplary multi-functional device with a display and a touch-sensitive surface according to some embodiments. Device 300 need not be portable. In some embodiments, device 300 is a laptop, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a children's learning toy), gaming system, or control device (e.g., a home controller or industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuitry (sometimes referred to as a chipset) that interconnects system components and controls communication between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touchscreen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350 and a touchpad 355, and a haptic output generator 357 for generating haptic output on device 300 (e.g., similar to the reference above). Figure 1A The tactile output generator 167 and sensor 359 (e.g., optical sensor, accelerometer, proximity sensor, touch sensor and / or contact intensity sensor (similar to the one mentioned above)) are described. Figure 1A The contact strength sensor 165 is described above. The memory 370 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. The memory 370 optionally includes one or more storage devices located remotely from the CPU 310. In some embodiments, the memory 370 stores information related to the portable multifunction device 100. Figure 1A The memory 370 stores programs, modules, and data structures similar to those in the memory 102 of the portable multifunction device 100, or subsets thereof. Additionally, the memory 370 optionally stores additional programs, modules, and data structures not present in the memory 102 of the portable multifunction device 100. For example, the memory 370 of the device 300 optionally stores a drawing module 380, a rendering module 382, a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while the portable multifunction device 100 (… Figure 1A The memory 102 may optionally not store these modules.
[0173] Figure 3Each of the elements described above is optionally stored in one or more memory devices of the previously mentioned memory devices. Each of the modules described above corresponds to a set of instructions for performing the functions described above. The modules or computer programs described above (e.g., instruction sets or including instructions) need not be implemented as separate software programs (such as computer programs (e.g., including instructions)), processes, or modules, and therefore various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores a subgroup of the modules and data structures described above. In addition, memory 370 optionally stores additional modules and data structures not described above.
[0174] Now let’s turn our attention to the implementation of the user interface, which is optionally implemented on, for example, a portable multifunction device 100.
[0175] Figure 4A An exemplary user interface for an application menu on a portable multifunction device 100 according to some embodiments is shown. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements or a subset or superset thereof:
[0176] • Signal strength indicator 402 for wireless communications such as cellular signals and Wi-Fi signals;
[0177] • Time 404;
[0178] Bluetooth indicator 405;
[0179] • Battery status indicator 406;
[0180] • Tray tray 408 with icons for commonly used applications, such as:
[0181] The telephone module 138 has an icon 416 labeled "telephone", which optionally includes an indicator 414 indicating the number of missed calls or voicemail messages.
[0182] The email client module 140 has an icon 418 labeled "Mail", which optionally includes an indicator 410 for the number of unread emails;
[0183] The browser module 147 has an icon 420 labeled "Browser"; and
[0184] The video and music player module 152 (also known as the iPod module 152, a trademark of Apple Inc.) with an icon 422 labeled "iPod"; and
[0185] • Icons of other applications, such as:
[0186] Icon 424 of the οIM module 141, labeled "Message";
[0187] The icon 426 of the calendar module 148 is labeled "Calendar";
[0188] The icon 428 of the image management module 144 is labeled "photo";
[0189] The icon 430 of the camera module 143 is labeled "camera";
[0190] The icon 432 of the online video module 155 is labeled "Online Video";
[0191] The icon 434 labeled "Stock Market" in the Stock Market widget 149-2;
[0192] The icon 436 of the map module 154 is labeled "map";
[0193] The weather widget 149-1 has icon 438 labeled "weather";
[0194] The alarm clock widget 149-4 has an icon 440 labeled "clock";
[0195] The icon 442 of the fitness support module 142 is labeled "fitness support";
[0196] The icon 444 labeled "Notes" in the Notes module 153; and
[0197] The icon 446, labeled "Settings," is used to set the settings of the device 100 and its various applications 136.
[0198] It should be pointed out that, Figure 4A The icon labels shown are merely exemplary. For example, icon 422 of video and music player module 152 is labeled "Music" or "Music Player". Other labels may be optionally used for various application icons. In some embodiments, the label of a particular application icon includes the name of the application corresponding to that particular application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to that particular application icon.
[0199] Figure 4B A touch-sensitive surface 451 (e.g., separate from the display 450 (e.g., touchscreen display 112)) is shown. Figure 3 Devices such as tablets or touchpads (e.g., 355) Figure 3An exemplary user interface on the device 300. The device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of the sensors 359) for detecting the intensity of contact on the tactile surface 451 and / or one or more tactile output generators 357 for generating tactile outputs for the user of the device 300.
[0200] While some examples of input on a reference touchscreen display 112 (which combines a touch-sensitive surface and a display) are given below, in some implementations the device detects input on a touch-sensitive surface separate from the display, such as... Figure 4B As shown in the diagram. In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a spindle (e.g., on the display (e.g., 450)). Figure 4B The spindle corresponding to 453 in the middle (e.g., Figure 4B (452 in the example). According to these embodiments, the device detects the position corresponding to the corresponding position on the display (e.g., in the example). Figure 4B In the middle, 460 corresponds to 468 and 462 corresponds to 470) is in contact with the touch-sensitive surface 451 (e.g., Figure 4B (460 and 462 in the text). Thus, when the touch-sensitive surface (e.g., ...) Figure 4B 451) and the display of a multi-functional device (e.g., Figure 4B When 450 is separated from the touch-sensitive surface, user input detected by the device on that touch-sensitive surface (e.g., touches 460 and 462 and their movement) is used by the device to manipulate the user interface on the display. It should be understood that similar methods may optionally be used for other user interfaces described herein.
[0201] Additionally, while the examples below are primarily given with reference to finger input (e.g., finger touch, single-finger tap, finger swipe), it should be understood that in some implementations, one or more of these finger inputs may be replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may optionally be replaced by a mouse click (e.g., instead of a touch), followed by movement of the cursor along the swipe path (e.g., instead of movement of the touch). Similarly, a tap gesture may optionally be replaced by a mouse click while the cursor is over the location of the tap gesture (e.g., instead of detection of touch, followed by cessation of touch detection). Likewise, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice may optionally be used simultaneously, or mouse and finger touch may optionally be used simultaneously.
[0202] Figure 5AAn exemplary personal electronic device 500 is illustrated. Device 500 includes a body 502. In some embodiments, device 500 may include components relative to devices 100 and 300 (e.g., Figures 1A to 4B Some or all of the features described herein. In some embodiments, device 500 has a touch-sensitive display 504, referred to below as touchscreen 504. As an alternative to or complement to touchscreen 504, device 500 has a display and a touch-sensitive surface. Similar to devices 100 and 300, in some embodiments, touchscreen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors for detecting the intensity of an applied contact (e.g., touch). The one or more intensity sensors of touchscreen 504 (or touch-sensitive surface) can provide output data representing the intensity of the touch. The user interface of device 500 can respond to touches based on the intensity of the touch, meaning that touches of different intensities can invoke different user interface operations on device 500.
[0203] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related patent applications: International Patent Application Serial No. PCT / US2013 / 040061, filed May 8, 2013, entitled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” published as WIPO Patent Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, filed November 11, 2013, entitled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” published as WIPO Patent Publication No. WO / 2014 / 105276, each of which is incorporated herein by reference in its entirety.
[0204] In some embodiments, device 500 has one or more input mechanisms 506 and 508. Input mechanisms 506 and 508 (if included) may be physical. Examples of physical input mechanisms include push-buttons and rotatable mechanisms. In some embodiments, device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) allow device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watch straps, bangles, trousers, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow a user to wear device 500.
[0205] Figure 5B An exemplary personal electronic device 500 is depicted. In some embodiments, device 500 may include a reference retrieval system. Figure 1A , Figure 1B and Figure 3 Some or all of the components described herein. Device 500 has a bus 512 that operatively couples I / O portion 514 to one or more computer processors 516 and memory 518. I / O portion 514 may be connected to display 504, which may have touch-sensitive components 522 and optionally have an intensity sensor 524 (e.g., a contact intensity sensor). Furthermore, I / O portion 514 may be connected to communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 may optionally be a rotatable input device or a pressable input device and a rotatable input device. In some examples, input mechanism 508 may optionally be a button.
[0206] In some examples, the input mechanism 508 is optionally a microphone. The personal electronic device 500 optionally includes various sensors, such as a GPS sensor 532, an accelerometer 534, an orientation sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or combinations thereof, all of which are operatively connected to the I / O section 514.
[0207] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may cause the computer processors to perform, for example, the techniques described below, including processes 700, 900, 1100, and 1300. Figure 7 , Figure 9 , Figure 11 and Figure 13A computer-readable storage medium can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with an instruction execution system, apparatus, or device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media can include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical discs based on CD, DVD, or Blu-ray technology, and persistent solid-state storage such as flash memory, solid-state drives, etc. Personal electronic devices are not limited to... Figure 5B It can be the components and configurations, or it can include other components or additional components in a variety of configurations.
[0208] As used herein, the term "power indication" refers optionally to the power indication in devices 100, 300, and / or 500 ( Figure 1A , Figure 3 and Figures 5A to 5B A user-interactive graphical user interface object displayed on a screen. For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) optionally each constitute a functional representation.
[0209] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some specific implementations that include a cursor or other positional marker, the cursor acts as a "focus selector," such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), the cursor is positioned on a touch-sensitive surface (e.g., a...). Figure 3 The touchpad 355 or Figure 4B When an input (e.g., a press input) is detected on the touch-sensitive surface 451 of the display, the specific user interface element is adjusted according to the detected input. This applies to touchscreen displays (e.g., those capable of enabling direct interaction with user interface elements on the touchscreen display) Figure 1A The touch-sensitive display system 112 or Figure 4AIn some embodiments of the touchscreen 112, a touch detected on the touchscreen acts as a "focus selector," such that when input (e.g., a press input by touch) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, that particular user interface element is adjusted according to the detected input. In some embodiments, focus moves from one area of the user interface to another without corresponding movement of the cursor or movement of a touch on the touchscreen display (e.g., moving focus from one button to another using tab keys or arrow keys); in these embodiments, the focus selector moves according to the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user-controlled user interface element (or a touch on the touchscreen display) that delivers the user-expected interaction with the user interface (e.g., by indicating to the device the element of the user interface that the user expects to interact with). For example, when a press input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen), the position of the focus selector (e.g., a cursor, touch, or selection box) above the corresponding button will indicate to the user that they expect to activate the corresponding button (rather than other user interface elements shown on the device's display).
[0210] Now let’s turn our attention to the implementation of user interfaces (“UIs”) and associated processes on electronic devices such as portable multifunction devices 100, 300 or 500.
[0211] Figures 6A to 6I Exemplary devices and user interfaces for customizing user-adjustable instrument groups are illustrated according to some embodiments. The user interfaces in these figures are used to illustrate the following descriptions, including… Figure 7 The process of...
[0212] Figure 6A Exemplary user interfaces 604 according to various embodiments presented herein are illustrated. In some examples, user interface 604 is provided by computer system 600A (e.g., operatively communicating with display screen 600B (e.g., display screen 600B displaying user interface 600)). In some examples, the user interface for display is provided by computer system 600A, which operatively communicates with display screen 600C (e.g., display screen 600C displaying user interface). In some embodiments, computer system 600A, display screen 600B, and display screen 600C include some or all of the features of device 100, device 300, or device 500 discussed above.
[0213] In some embodiments, computer system 600A is a mobile phone that communicates wired (e.g., USB, Lightning) or wireless (e.g., Bluetooth, WiFi) with displays 600B and / or 600C, including the dashboard of a car / vehicle, or with an external computer system having displays 600B and / or 600C. In some embodiments, displays 600B and 600C are mounted on the dashboard 602 of the car / vehicle. In some embodiments, according to the various embodiments discussed herein, the mobile phone (e.g., computer system 600A) transmits instruction signals to generate a user interface at displays 600B and 600C. Additionally, in some embodiments, user interactions detected at displays 600B and / or 600C are transmitted to the mobile phone (e.g., computer system 600A). In some embodiments, as described herein, the user interface displayed on display 600B is provided at the display of computer system 600A. In some implementations, computer system 600 provides information to computer systems of displays 600B and / or 600C so that computer systems of displays 600B and / or 600C can prepare, update and display user interfaces on displays 600B and 600C respectively.
[0214] The display 600C is optionally located within the dashboard area 602 of the vehicle and positioned in front of / in front of the driver's seat. Therefore, the driver can view the information displayed on the display 600C while continuing to drive the vehicle.
[0215] In some embodiments, user interface 604 is provided by computer system 600A and is displayed immediately after display screen 600B is activated from an inactive state (e.g., previously not displaying another user interface) in response to the computer system (e.g., the computer system of a car / vehicle including dashboard 602) determining that a set of external device display content standards are met. In some embodiments, the set of external device display content standards includes a requirement that computer system 600A connect to the computer system of the car / vehicle when the car / vehicle was last driven. In some embodiments, display screen 600B is activated in response to the computer system detecting an initiation event, such as opening and / or unlocking a car / vehicle door, detecting a key fob or digital key (e.g., set on a smartphone) approaching the car / vehicle, detecting that a user / driver is in the car / vehicle, and / or detecting starting the car / vehicle or a request to start the car / vehicle. In some embodiments, in response to the detection of an initiation event, when a different set of display content standards are met, another user interface (e.g., an interface generated by the car / vehicle's computer system) is displayed instead of user interface 604. For example, when the vehicle's computer system is not connected to computer system 600A and / or the presence of computer system 600A is not detected, the vehicle's computer system instead provides a locally generated user interface when display screen 600B is activated. In some embodiments, the vehicle's computer system provides an appropriate user interface to the user when display screen 600B is initially activated by conditionally displaying user interface 604 provided by computer system 600A or displaying another user interface (e.g., a locally generated user interface).
[0216] exist Figure 6B At the same location, display screen 600C displays a settings user interface for customizing the instrument group. Computer system 600A also optionally displays (e.g., the same or a different) a settings user interface for customizing the instrument group. In some embodiments, the described user selection is optionally detected at a touch-sensitive surface of display screen 600C instead of at computer system 600A.
[0217] exist Figure 6CAt this location, computer system 600A displays various instrument cluster templates, including a first instrument cluster template 606A, a second instrument cluster template 606B, and a third instrument cluster 606C. Computer system 600A receives a user selection of the first instrument cluster template 606A (e.g., a tap on the first instrument cluster template) and, in response, transmits information defining the appearance of the vehicle's instrument cluster to display screen 600C. A check mark 608A indicates that the first instrument cluster template 606A has been selected. Upon user selection, display screen 600C displays the vehicle's instrument cluster based on the received information. If the user selects a different instrument cluster template (e.g., 606B, 606C), computer system 600A will instead transmit information defining the corresponding appearance of the selected vehicle's instrument cluster to display screen 600C.
[0218] exist Figure 6C At this location, instrument cluster 630 includes multiple instrument cluster elements, including 630A-630E and 640. In some examples, the instrument cluster elements display information about the vehicle's status regarding which the instrument cluster is displayed. Navigation element 630A provides navigation instructions and estimated arrival time. Temperature element 630B indicates the vehicle's temperature, such as oil temperature, battery temperature, and / or interior cabin temperature. Gearshift element 630C indicates multiple available vehicle gears and identifies the currently selected gear. Percentage element 630D indicates a percentage of vehicle characteristics, such as the percentage of battery charge and / or the percentage of a full fuel tank. Compass 630E indicates the current direction the vehicle is facing or traveling. Audio element 630F indicates the vehicle's current audio characteristics, such as the volume of audio output from the vehicle's speakers and / or the volume level detected inside the vehicle (e.g., road noise). Speedometer 640 is an instrument cluster element that displays the vehicle's current speed and the current speed limit of the road on which the vehicle is traveling and / or located. Speedometer 640 is relative to... Figures 10A to 10F A more detailed description is available.
[0219] exist Figure 6DAt this location, computer system 600A displays various instrument cluster font options, including a first font option 610A, a second font option 610B, and a third font option 610C. Computer system 600A receives a user selection of the second font option 610B (e.g., a tap on the second font option) and, in response, transmits information indicating changes to the vehicle instrument cluster (e.g., defining an updated appearance) to display screen 600C. A check mark 608B indicates that the second font option 610B has been selected. Display screen 600C updates the vehicle instrument cluster 630 to use the user-selected font based on the received information (or optionally, based on the corresponding selection received at a touch-sensitive surface of display screen 600C). For example, the font of the text for navigation elements 630A, temperature elements 630B, shift element 630C, percentage elements 630D, compass 630E, and / or speedometer 640 is updated to the user-selected font, such as... Figure 6D As shown. In some examples, font variations include changes in the size, weight, and / or font of one or more text elements in the vehicle's instrument cluster.
[0220] exist Figure 6E At this location, computer system 600A displays various color options, including a first color option 612A (e.g., blue), a second color option 612B (e.g., green), and a third color option 612C (e.g., yellow). Computer system 600A receives a user selection of the second color option 612B (e.g., a tap on the second color option) and, in response, transmits information indicating changes to the vehicle's instrument cluster (e.g., defining an updated appearance) to display screen 600C. A check mark 608C indicates that the second color option 612B has been selected. Display screen 600C updates instrument cluster 630 to use the user-selected color based on the received information (or optionally, based on the corresponding selection received at a touch-sensitive surface of display screen 600C). For example, the font of the text on navigation elements 630A, temperature elements 630B, gear shift elements 630C, percentage elements 630D, compass 630E, and / or speedometer 640 is updated to the user-selected color. Similarly, the background of instrument cluster 630 is updated to the user-selected color, such as... Figure 6E As shown.
[0221] exist Figure 6FAt the display screen 600A, the computer system 600A displays various line thickness options, including a first line thickness option 614A (e.g., thin), a second line thickness option 614B (e.g., normal), and a third line thickness option 614C (e.g., bold). The computer system 600A receives a user selection of the third line thickness option 614C (e.g., a tap on the third line thickness option) and, in response, transmits information indicating a change to the vehicle instrument cluster (e.g., defining an updated appearance) to the display screen 600C. A check mark 608D indicates that the third line thickness option 614C has been selected. The display screen 600C updates the instrument cluster 630 to use the user-selected thickness based on the received information (or optionally, based on the corresponding selection received at a touch-sensitive surface of the display screen 600C). For example, the lines surrounding navigation element 630A, temperature element 630B, gear shift element 630C, percentage element 630D, compass 630E, and / or speedometer 640 are updated to the user-selected line thickness (e.g., without changing the thickness of text elements), such as... Figure 6F As shown.
[0222] exist Figure 6G At the same location, computer system 600A displays various instrument cluster element display options 616 corresponding to the respective instrument cluster elements, including compass display option 616A corresponding to compass 630E. Computer system 600A receives a user selection of compass display option 616A (e.g., a tap on the compass display option) and, in response, transmits information indicating changes to the vehicle instrument cluster (e.g., defining an updated appearance) to display screen 600C. Checkmarks 608E-608H indicate that instrument cluster elements corresponding to those display options 616 should be displayed as part of instrument cluster 630, while the user selection causes the checkmarks not to be displayed adjacent to compass display option 616A, thereby indicating that compass 630E will not be displayed as part of instrument cluster 630. Display screen 600C updates instrument cluster 630 based on the received information (or optionally, based on the corresponding selection received at the touch-sensitive surface of display screen 600C) to remove (or alternatively, include) the corresponding instrument cluster element corresponding to the element display option selected by the user. For example, as Figure 6G As shown, the instrument cluster 630 has been updated to exclude the compass 630E and the audio element 630F (for example, without removing other instrument cluster elements).
[0223] exist Figure 6HAt this location, computer system 600A displays various instrument cluster element shape options, including a first shape option 618A, a second shape option 618B, and a third shape option 618C. Computer system 600A receives a user selection of the second shape option 618B (e.g., a tap on the second shape option) and, in response, transmits information indicating changes to the vehicle's instrument cluster (e.g., defining an updated appearance) to display screen 600C. A check mark 608I indicates that the third linewidth option 614C has been selected. Display screen 600C updates instrument cluster 630 based on the received information (or optionally, based on the corresponding selection received at a touch-sensitive surface of display screen 600C) to shape one or more instrument cluster elements of instrument cluster 630. For example, instrument cluster 630 is updated such that the shapes of navigation element 630A, temperature element 630B, shift element 630C, and percentage element 630D are changed to rectangular shapes, such as... Figure 6H As shown.
[0224] exist Figure 6I At this location, computer system 600A displays a user interface for changing the position of various instrument cluster elements. Computer system 600A receives user input corresponding to percentage element options 620A (e.g., a drag gesture on a percentage element option). The user input begins at a position of percentage element option 620A and moves to a different position. In response, computer system 600A transmits information indicating changes to the vehicle's instrument cluster (e.g., defining an updated appearance) to display screen 600C. Display screen 600C updates instrument cluster 630 based on the received information (or optionally, based on the corresponding selection received at a touch-sensitive surface of display screen 600C) to change the position of one or more instrument cluster elements of instrument cluster 630. For example, as... Figure 6I As shown, the instrument group 630 is updated such that the position of the percentage element 630D on the display 600C and / or relative to one or more other instrument group elements of the instrument group 630 has been changed (from adjacent to the temperature element 630B to above the speedometer 640).
[0225] Computer system 600A optionally stores based on user selection (such as relative to...) Figures 6B to 6IThe description describes a customized vehicle instrument cluster. Subsequently, upon user selection, computer system 600A provides display screen 600C with information defining the appearance of the vehicle instrument cluster based on the selection. For example, when the vehicle is started, computer system 600A provides information defining the appearance of the customized vehicle instrument cluster. In some embodiments, the computer system of display screen 600C (e.g., the vehicle's) stores a customized vehicle instrument cluster based on information received from computer system 600A and / or based on user selection received at the touch-sensitive surface of display screen 600C. Subsequently, upon user selection, display screen 600C displays the customized vehicle instrument cluster without requiring additional information from computer system 600A and / or without receiving additional information from the computer system. For example, when the vehicle is started, display screen 600C displays the vehicle instrument cluster.
[0226] Figure 7 This is a flowchart illustrating a method for customizing a user-adjustable instrument cluster using a computer system according to some embodiments. Method 700 is performed at a computer system (e.g., 100, 300, 500, 600A, 600B, 600C) that communicates with display generating components (e.g., 600B, 600C; the vehicle's display generating components, a display disposed in the vehicle's front console, and / or a display positioned in front of / in front of the driver's seat). Some operations in method 700 may optionally be combined, some operations may optionally be changed in order, and some operations may optionally be omitted.
[0227] As described below, method 700 provides an intuitive way to customize user-adjustable instrument clusters. This method reduces the cognitive burden on users when customizing user-adjustable instrument clusters, thereby creating a more efficient human-machine interface. For battery-powered computing devices, enabling users to customize user-adjustable instrument clusters faster and more efficiently saves power and increases the time between battery charging sessions.
[0228] A computer system (e.g., 600A) provides (702) information defining the appearance of a vehicle instrument cluster to a display generation component (e.g., 600C) for display via the display generation component (e.g., 600C) as a first vehicle instrument cluster interface having a first appearance. Figure 6C The first vehicle instrument cluster interface (630) includes a first group of one or more instrument cluster elements (e.g., speedometer (e.g., 640), tachometer, fuel level indicator (e.g., 630D), battery level indicator, and / or gearshift position indicator (e.g., 630C)). In some embodiments, the first group of one or more instrument cluster elements indicates information about the vehicle in which the display generating component is located.
[0229] After providing information defining the appearance of the vehicle instrument cluster to the display generation component, the computer system (e.g., 600A) detects (704) one or more user reconfiguration inputs (e.g., in) for the reconfiguration user interface (e.g., 606, 610, 612, 614, 616, 618, 620) for the vehicle instrument cluster. Figures 6C to 6I A sequence of inputs (e.g., one or more inputs detected at a touch-sensitive surface and / or button of a computer system 600A).
[0230] After receiving a sequence of one or more user reconfiguration inputs, the computer system (e.g., 600A) provides (706) the display generation component with an updated appearance defining the vehicle instrument cluster (e.g., Figure 6D 630 Figure 6E The information of (630) is displayed via a display generation component as a second vehicle instrument cluster interface having a second appearance different from the first appearance. The second vehicle instrument cluster interface includes one or more second instrument cluster elements that differ in appearance, position, and / or arrangement from the first group of one or more instrument cluster elements (e.g., such as...). Figures 6D to 6I In this context, the instrument cluster includes speedometer, tachometer, fuel gauge, battery gauge, and / or gearshift position. In some implementations, a second group of one or more instrument cluster elements indicates information about the vehicle in which the display unit is located. Providing information defining various appearances of the vehicle's instrument clusters enables the computer system to display different appearances of the vehicle's instrument clusters for the user to view information about the vehicle, thereby providing the user with improved feedback.
[0231] In some embodiments, the first group of one or more instrument group elements and the second group of one or more instrument group elements include the same instrument group elements (but not the same visual appearance, location, and / or arrangement). In some embodiments, the first group of one or more instrument group elements and the second group of one or more instrument group elements include different instrument group elements. In some embodiments, the first group of one or more instrument group elements and the second group of one or more instrument group elements include some of the same instrument group elements (with or without the same visual appearance, location, and / or arrangement) and some of the different instrument group elements.
[0232] In some embodiments, a sequence of one or more user reconfiguration inputs is detected at one or more input devices of the computer system. In some embodiments, the computer system is a smartphone that communicates wirelessly and / or wiredly with a display generation component, and the sequence of one or more user reconfiguration inputs is detected at the smartphone (e.g., at the smartphone's touch-sensitive display and / or button inputs). In some embodiments, a reconfiguration user interface for a vehicle instrument cluster is displayed on the smartphone's display. Enabling the user to provide reconfiguration input allows the computer system to display the appearance of the vehicle instrument cluster based on the user-provided reconfiguration input, thereby providing the user with improved feedback.
[0233] In some implementations, a sequence of one or more user reconfiguration inputs is detected when the computer system (e.g., 600A) is not (wired or wirelessly) connected to the display generation component (e.g., 600C). In some implementations, the user provides one or more user reconfiguration inputs at the computer system, and the computer system subsequently (e.g., once connected to the display generation device) provides the display generation device with information defining an updated appearance. Providing information defining the appearance of the vehicle instrument cluster based on reconfiguration inputs detected when the computer system is not connected to the display generation component enables the computer system to receive reconfiguration inputs and provide appearance-defining information once connected to the display generation component, thereby providing improved feedback to the user.
[0234] In some implementations, updating the appearance (a second vehicle instrument cluster interface with a second appearance) includes relative to the first appearance (e.g., Figure 6D The font (e.g., size, weight, and / or style) of the instrument cluster (e.g., one or more instrument cluster elements) is changed between a first appearance and an updated appearance. In some embodiments, the font of the content (e.g., one or more instrument cluster elements) is changed between a first appearance and an updated appearance, without changing other visual aspects between the first appearance and the updated appearance. In some embodiments, the only visual difference between the first appearance and the updated appearance is a change in one or more fonts. In some embodiments, providing the display generating component with information defining the updated appearance of the vehicle instrument cluster includes providing font information that is different from the font information provided to define the first appearance. Changing the font of the vehicle instrument cluster provides the user with feedback on the state of the computer system, and specifically, feedback on which appearance of the vehicle instrument cluster the computer system is providing for display, thereby providing the user with improved feedback.
[0235] In some implementations, updating the appearance (a second vehicle instrument cluster interface with a second appearance) includes relative to the first appearance (e.g., Figure 6EThe color of the instrument cluster (e.g., the color of one or more instrument cluster elements and / or the background of the instrument cluster interface) is changed. In some embodiments, the color of the content (e.g., one or more instrument cluster elements) is changed between the first appearance and the updated appearance, without changing other visual aspects between the first appearance and the updated appearance. In some embodiments, the only visual difference between the first appearance and the updated appearance is the change of one or more colors. In some embodiments, providing the information defining the updated appearance of the vehicle instrument cluster to the display generating component includes providing color information that is different from the color information provided to define the first appearance. Changing the color of the vehicle instrument cluster provides the user with feedback on the state of the computer system, and specifically, feedback on which appearance of the vehicle instrument cluster the computer system is providing for display, thereby providing the user with improved feedback.
[0236] In some implementations, updating the appearance (a second vehicle instrument cluster interface with a second appearance) includes relative to the first appearance (e.g., Figure 6F The linewidth of (e.g., one or more instrument cluster elements) is changed between a first appearance and an updated appearance. In some embodiments, the linewidth of the content (e.g., one or more instrument cluster elements) is changed between a first appearance and an updated appearance without changing other visual aspects between the first appearance and the updated appearance. In some embodiments, the only visual difference between the first appearance and the updated appearance is the change in one or more linewidths. In some embodiments, providing the display generating component with information defining the updated appearance of the vehicle instrument cluster includes providing linewidth information that is different from the linewidth information provided to define the first appearance. Changing the linewidth of the vehicle instrument cluster provides the user with feedback on the state of the computer system, and specifically, feedback on which appearance of the vehicle instrument cluster the computer system is providing for display, thereby providing the user with improved feedback.
[0237] In some implementations, updating the appearance (a second vehicle instrument cluster interface with a second appearance) includes relative to the first appearance (e.g., Figure 6GThe addition and / or removal of one or more instrument cluster elements (e.g., 630E, 630F) of a first vehicle instrument cluster interface (having a first appearance). In some embodiments, one or more instrument cluster elements are changed (added and / or removed) between the first appearance and the updated appearance without changing other visual aspects between the first appearance and the updated appearance. In some embodiments, a second group of one or more instrument cluster elements in a second appearance includes different instrument cluster elements compared to the first group of one or more instrument cluster elements displayed in the first appearance. In some embodiments, providing information defining the updated appearance of the vehicle instrument cluster to the display generating component includes providing instrument cluster element information that is different from the instrument cluster element information provided to define the first appearance. Adding and / or removing group elements enables the user to access different information about the vehicle and provides the user with feedback on the status of the computer system, and specifically feedback on which appearance of the vehicle instrument cluster the computer system is providing for display, thereby providing the user with improved feedback.
[0238] In some implementations, updating the appearance (a second vehicle instrument cluster interface with a second appearance) includes relative to the first appearance (e.g., Figure 6H The shape of one or more instrument cluster elements of the 630 (a first vehicle instrument cluster interface having a first appearance) (e.g., such as Figure 6H The shape of one or more instrument cluster elements is changed between a first appearance and an updated appearance, without changing other visual aspects between the first and updated appearances. In some embodiments, the only visual difference between the first and updated appearances is a change in the shape of one or more instrument cluster elements. In some embodiments, providing the display generating component with information defining the updated appearance of the vehicle instrument cluster includes providing shape information that differs from the shape information provided to define the first appearance. Changing the shape of the instrument cluster elements provides the user with feedback on the state of the computer system, and specifically, feedback on which appearance of the vehicle instrument cluster the computer system is providing for display, thereby providing the user with improved feedback.
[0239] In some implementations, updating the appearance (a second vehicle instrument cluster interface with a second appearance) includes relative to the first appearance (e.g., Figure 6GThe number of instrument cluster elements in the first vehicle instrument cluster interface (630) with a first appearance varies. In some embodiments, the number of instrument cluster elements is changed between the first appearance and the updated appearance without changing other visual aspects (e.g., background image / color and / or text size). In some embodiments, the only visual difference between the first appearance and the updated appearance is the change in the number of instrument cluster elements. In some embodiments, providing the information defining the updated appearance of the vehicle instrument cluster to the display generating component includes providing instrument cluster number information that is different from the instrument cluster number information provided to define the first appearance. Changing the number of group elements allows the user to access different information about the vehicle and provides the user with feedback on the status of the computer system, and specifically, feedback on which appearance of the vehicle instrument cluster the computer system is providing for display, thereby providing the user with improved feedback.
[0240] In some implementations, updating the appearance (a second vehicle instrument cluster interface with a second appearance) includes relative to the first appearance (e.g., Figure 6I The change in position of one or more instrument cluster elements (e.g., 630D) of a first vehicle instrument cluster interface having a first appearance (630). In some embodiments, the position (e.g., of one or more instrument cluster elements) is changed between the first appearance and the updated appearance without changing other visual aspects between the first appearance and the updated appearance. In some embodiments, the only visual difference between the first appearance and the updated appearance is the change in position of one or more instrument cluster elements. In some embodiments, providing the information defining the updated appearance of the vehicle instrument cluster to the display generating component includes providing instrument cluster position information that is different from the instrument cluster position information provided to define the first appearance. Changing the position of the instrument cluster elements provides the user with feedback on the state of the computer system, and specifically, feedback on which appearance of the vehicle instrument cluster the computer system is providing for display, thereby providing the user with improved feedback.
[0241] In some implementations, before providing information defining an updated appearance for the vehicle instrument cluster to the display generating component, a first vehicle instrument cluster interface with a first appearance is an initial instrument cluster displayed via the display generating component when the vehicle, to which the display generating component is located (e.g., where it is mounted), is started. After providing information defining an updated appearance for the vehicle instrument cluster to the display generating component, a second vehicle instrument cluster interface with a second appearance is the initial instrument cluster displayed via the display generating component when the vehicle, to which the display generating component is located (e.g., where it is mounted), is started. Displaying the vehicle instrument cluster as an initial instrument cluster with a second appearance after providing information defining an updated appearance provides feedback to the user regarding the provided appearance and reduces the need for the user to provide input for reselecting the second appearance when the vehicle is started, thereby providing improved feedback to the user and reducing the number of inputs required to perform the operation.
[0242] In some implementations, a first appearance of the first vehicle instrument cluster interface is determined by a computer system (e.g., 600A, a vehicle-separated accessory, and / or a smartphone), and a second appearance of the second vehicle instrument cluster interface is determined by the computer system (e.g., 600A). In some implementations, the computer system determines the appearance of the first and second instrument cluster interfaces based on one or more of the following: contextual information (e.g., the location of the computer system, such as GPS location, weather, and / or recent driving habits) and selections made via user input. The computer system's determination of the first and second appearances enables the provision of different appearances of the instrument cluster for display without requiring user input to determine the appearance, thereby reducing the number of inputs required to perform the operation.
[0243] In some implementations, the sequence of reconfiguring input for one or more users reconfiguring the user interface includes selecting a first template instrument group interface (e.g., 606A) from a plurality of template instrument group interfaces (e.g., 606A-606C), and wherein the updated appearance is based on the selection of the first template instrument group interface. Providing an updated appearance for the vehicle instrument group based on the user's selection of the template instrument group interface provides the user with feedback on the status of the computer system, and specifically feedback on the computer system having received the user's selection, thereby providing improved user feedback.
[0244] According to some implementations, a computer system (e.g., 600C) displays (e.g., on a display integrated with the computer system) multiple objects corresponding to multiple template instrument cluster interfaces. The computer system (e.g., 600C) receives (e.g., via a touch-sensitive surface) a selection of a template instrument cluster interface and optionally receives additional user input for customizing the template instrument cluster interface. The computer system then provides information to a display generation component defining an updated appearance for the vehicle instrument cluster, wherein the updated information is based on the selected and optionally customized template instrument cluster interface.
[0245] It should be noted that the above description is in contrast to the process described in method 700 (e.g., Figure 7 The details of the methods described below also apply in a similar manner. For example, methods 900, 1100, and 1300 optionally include one or more features of the various methods described above with reference to method 700. For example, the instrument group (e.g., 630) is the same as the instrument group (e.g., 630) of other methods. Similarly, the speedometer (e.g., 640) is the same speedometer of other methods. For the sake of brevity, these details will not be repeated below.
[0246] Figures 8A to 8G Exemplary devices and user interfaces for providing vehicle-specific instrument clusters are shown according to some embodiments. The user interfaces in these figures are used to illustrate the following descriptions, including… Figure 9 The process of...
[0247] exist Figure 8A At the location where, when (or) computer system 600A enters, approaches, and / or accesses vehicle 802, computer system 600A optionally (e.g., when computer system 600A determines it is inside vehicle 802 and / or when computer system 600A receives a communication request) connects to display screen 600C of vehicle 802, which is a van. After computer system 600A connects to display screen 600C, computer system 600A will define the appearance of the vehicle instrument cluster of vehicle 802 (e.g., ...). Figure 8A The first information (shown) is transmitted to the display screen 600C. The computer system 600A selects which first information to transmit based on the display screen 802 connected to the vehicle 600C, such as based on the type of the display screen 600C (e.g., model, serial number, size, and / or shape) and / or the type of the vehicle 802 (e.g., brand, model, configuration level / style, and / or model year). The appearance of the instrument cluster 630 is based on the first information provided by the computer system 600A. In some embodiments, the instrument cluster 630 may be user-customized, such as relative to... Figures 6A to 6I As described. Figure 8AAs shown, the instrument cluster 630 includes a navigation element 630A, a temperature element 630B, a gear shifter element 630C, a percentage element 630D, a compass 630E, an audio element 630F, and a speedometer 640.
[0248] exist Figure 8B At this location, computer system 600A enters, approaches, and / or accesses vehicle 804. Computer system 600A optionally (e.g., when computer system 600A determines it is inside vehicle 804 and / or when computer system 600A receives a communication request) connects to display screen 600D of vehicle 804, which is a pickup truck. In some embodiments, display screen 600D includes some or all of the features of device 100, device 300, or device 500 discussed above. In some embodiments, display screen 600D includes some or all of the features of display screen 600C, but has a different shape, is a different type, and / or is installed in a different vehicle.
[0249] After the computer system 600A is connected to the display screen 600D, the computer system 600A will define the appearance of the vehicle instrument cluster of the vehicle 804 (such as...). Figure 8B The second information (as shown) is transmitted to the display screen 600D. The computer system 600A selects the second information (compared to the first information) for transmission based on the display screen 804 connected to the vehicle 600D, such as based on the type of the display screen 600D (e.g., model, serial number, size, and / or shape) and / or the type of the vehicle 804 (e.g., brand, style, configuration level / style, and / or model year). The appearance of the instrument cluster 650 is based on the second information provided by the computer system 600A. In some embodiments, the instrument cluster 650 may be user-customized, such as relative to... Figures 6A to 6I As described. Figure 8B As shown, the instrument cluster 650 includes a navigation element 650A, a temperature element 650B, a turn indicator 650C, a percentage element 650D, a compass 650E, an audio element 650F, and a speedometer 640. In this example, the instrument cluster 650 does not include a gear shift element. A visual element 810 displayed as part of the instrument cluster 650 indicates the manufacturer of the vehicle 804, and optionally, is specific to a display screen for vehicles manufactured by that manufacturer.
[0250] Therefore, the computer system 600A transmits different information defining the different appearances of the vehicle's instrument cluster based on the type of vehicle in which the corresponding display screen (e.g., 600C, 600D) is located (e.g., installed).
[0251] like Figure 8A and Figure 8BAs shown, instrument clusters 630 and 650 include some identical instrument cluster elements with different appearances (e.g., navigation elements 630A and 650A, temperature elements 630B and 650B, percentage elements 630C and 650D, and compasses 630E and 650E), some identical instrument cluster elements with the same appearance (e.g., speedometer 640), and some different instrument cluster elements (e.g., instrument cluster 630 includes an audio element 630F, while instrument cluster 650 does not; instrument cluster 630 does not include a turn indicator, while instrument cluster 650 includes a turn indicator 650C). At least some differences in appearance between instrument clusters 630 and 650 are based on different information received from computer system 600A defining the appearance of the instrument clusters.
[0252] The appearance of two instrument cluster elements is not based solely on the corresponding values of the information displayed (e.g., two speedometers do not have different appearances simply because one speedometer indicates the vehicle is traveling at a first speed while the other indicates the vehicle is traveling at a different second speed), but rather on, for example, the visual style of the information being displayed (e.g., the font, size, position, and / or other visual features of how information such as speed is displayed). Similarly, the appearance of two instrument clusters is not based solely on the values of the information displayed by the respective instrument cluster elements (e.g., two instrument clusters do not have different appearances simply because one instrument cluster indicates the vehicle is traveling at a first speed while the other indicates the vehicle is traveling at a different second speed), but rather on, for example, the visual style of the information being displayed (e.g., the font, size, position, and / or other visual features of how information such as speed is displayed) and / or the type of instrument cluster elements included in the respective instrument cluster.
[0253] In some implementation schemes, refer to Figure 8A An external computer system (e.g., 600A) renders first content, such as navigation element 630A (which optionally includes animation of driving direction), for display on instrument cluster 630, while the computer system of instrument cluster 630 renders second content, such as elements 630B-630F, for display on instrument cluster 630. Figure 8A As shown, the first and second contents are displayed concurrently on the instrument group 630.
[0254] In some implementation schemes, refer to Figure 8AWhen the first and second content are displayed concurrently, user input is detected at the instrument cluster 630. For example, a user may tap on a user-selectable option displayed as part of a navigation element 630A (rendered by an external computer system such as 600A), or a user may swipe on a temperature element 630B (rendered by the computer system of the instrument cluster 630) to change the settings of the heating system of the vehicle 802. When input is directed to an area rendered by the computer system of the instrument cluster 630 on the display, the instrument cluster 630 processes the input and performs a corresponding operation, such as changing the settings of the auditory system. When input is directed to an area rendered by an external computer system on the display, the computer system of the instrument cluster 630 transmits the details of the input to the external computer system so that the external computer system can determine whether an operation should be performed. Thus, the two different computer systems can interoperate to provide visual feedback to the user on their actions and receive user input using the display and touch-sensitive surface of the instrument cluster 630.
[0255] exist Figure 8C At this point, computer system 600A receives one or more inputs for changing the visual appearance of the instrument cluster of vehicle 802. Based on one or more inputs, computer system 600A transmits updated information indicative of changes to the vehicle instrument cluster (e.g., defining an updated appearance) to display screen 600C, such that the updated information (transmitted to display screen 600C) defines the same appearance as the second information previously transmitted to display screen 600D. Therefore, display screen 600C changes the appearance of the instrument cluster from that of instrument cluster 630 to have many of the same elements as the appearance of instrument cluster 632. In this example, vehicle 802 and vehicle 804 are manufactured by the same manufacturer, and visual element 810 indicating that manufacturer is displayed as part of vehicle instrument cluster 632. In some examples, if vehicle 802 and vehicle 804 are manufactured by different manufacturers, computer system 600A does not allow the display of visual element 810 to be configured on display screen 600C (e.g., the information transmitted to display screen 600C will not define an instrument cluster including visual element 810).
[0256] exist Figure 8D At this location, computer system 600A receives one or more inputs for changing the visual appearance of the instrument cluster of vehicle 804. Based on the one or more inputs, computer system 600 transmits updated information instructing changes to the vehicle instrument cluster (e.g., defining an updated appearance) to display screen 600D, such that the updated information (transmitted to display screen 600D) defines the same appearance as the first information previously transmitted to display screen 600C. Therefore, display screen 600D changes the appearance of the instrument cluster from that of instrument cluster 650 to that of instrument cluster 652.
[0257] exist Figure 8EAt this point, computer system 600A (e.g., when display screen 600C is displaying instrument cluster 630) receives one or more inputs for changing the visual appearance of the instrument cluster of vehicle 802. Computer system 600A (based on one or more inputs) transmits third information instructing changes to the vehicle's instrument cluster (e.g., defining an updated appearance) to display screen 600C, such that the third information (transmitted to display screen 600C) defines the new appearance, such as... Figure 8E As shown. Therefore, display screen 600C changes the appearance of the instrument cluster from that of instrument cluster 630 to that of instrument cluster 634.
[0258] exist Figure 8F At this point, computer system 600A (e.g., when display screen 600D is displaying instrument cluster 650) receives one or more inputs for changing the visual appearance of the instrument cluster of vehicle 804. Computer system 600 (based on one or more inputs) transmits the same third information instructing changes to the vehicle's instrument cluster (e.g., defining an updated appearance) to display screen 600D (as it would to display screen 600C), such that the third information (transmitted to display screen 600D) defines the new appearance, such as... Figure 8F As shown. Therefore, display 600D changes the appearance of the instrument group from that of instrument group 650 to that of instrument group 654. In some embodiments, since electronic device 600A has already transmitted the same third information to both display 600C and 600D, the appearance of instrument group 634 and instrument group 654 is identical (e.g., completely identical in terms of element size, element position, element quantity, and / or element color).
[0259] Figure 8G Instrument cluster 636 of vehicle 802 and instrument cluster 656 of vehicle 804 are shown. Both instrument clusters 636 and 656 are displayed based on information received defining an instrument cluster with all the same appearance options (e.g., identical information). When displayed on display screen 600C, instrument cluster 636 looks different from instrument cluster 656 displayed on display screen 600D. For example, the sizes and positions of turn indicators 636A and 636B are different. Also, instrument cluster 656 displayed on display screen 600D includes visual element 656B, while instrument cluster 636 does not include the same visual element when displayed on display screen 600C. When displayed on display screen 600C, some aspects of instrument cluster 636 look the same as instrument cluster 656 displayed on display screen 600D. For example, speedometers 636C and 656C have the same size, position, color, and other visual features. For example, navigation elements 636D and 656D have the same size, position, color and other visual features.
[0260] Figure 9 This is a flowchart illustrating a method for providing a vehicle-specific instrument cluster using a computer system according to some embodiments. Method 900 is executed at a computer system (e.g., 100, 300, 500, 600A, 600B, 600C, the vehicle's computer system, vehicle-separated accessories, and / or a smartphone) that communicates with display generation components (e.g., 600B, 600C, the vehicle's display generation components, a display located in the vehicle's front console, and / or a display positioned in front of / in front of the driver's seat). Some operations in method 900 may be optionally combined, some operations may be optionally changed in order, and some operations may be optionally omitted.
[0261] As described below, method 900 provides an intuitive way to offer vehicle-specific instrument clusters. This method reduces the cognitive burden on users of customized, user-adjustable instrument clusters, thereby creating a more efficient human-machine interface. For battery-powered computing devices, enabling users to access vehicle-specific instrument clusters faster and more efficiently saves power and increases the time between battery charging cycles.
[0262] The computer system (e.g., 600A) provides (902) information defining the appearance of the vehicle instrument cluster to the display generation components (e.g., 600C, 600D) for display as a corresponding vehicle instrument cluster interface with the corresponding appearance.
[0263] The corresponding appearance includes: based on the display generating component (e.g., 600C) determining that it is a vehicle of a first type (e.g., 802, first brand, first model, and / or first model year), the information provided to the display generating component (e.g., 600C) defines (904) a first appearance (e.g., Figure 8A The first vehicle instrument cluster interface (located at 630).
[0264] The corresponding appearance includes: based on the determination that the display generating component (e.g., 600D) is a second type of vehicle (e.g., 804, second brand, second model, and / or second model year) different from the first type of vehicle, the information provided to the display generating component defines (906) a second vehicle instrument group interface (e.g., with a second appearance different from the first appearance) having a second appearance different from the first appearance. Figure 8B (650). Based on determining whether the display generating component is of the first or second type, information defining the first or second appearance of the vehicle instrument cluster interface is provided to the user to provide feedback on the status of the computer system, and specifically feedback on whether the computer system has determined that it is communicating with the first or second type of display generating component, thereby providing improved user feedback.
[0265] In some embodiments, a first vehicle instrument cluster interface (e.g., 630) includes a first group of one or more instrument cluster elements (e.g., speedometer, tachometer, fuel level indicator, battery level indicator, and / or shift position indicator). In some embodiments, the first group of one or more instrument cluster elements indicates information about the vehicle (e.g., 802) where the display generating component is located. In some embodiments, a second vehicle instrument cluster interface (e.g., 650) includes a second group of one or more instrument cluster elements (e.g., speedometer, tachometer, fuel level indicator, battery level indicator, and / or shift position indicator). In some embodiments, the second group of one or more instrument cluster elements indicates information about the vehicle (e.g., 804) where the display generating component is located.
[0266] In some implementations, the first type is a vehicle manufacturer, and the first vehicle instrument cluster interface having a first appearance includes one or more visual aspects specific to the first type of vehicle (e.g., instrument cluster elements, and / or brand information specific to the vehicle brand, vehicle model, and / or vehicle manufacturer).
[0267] In some implementations, a first vehicle instrument cluster interface with a first appearance includes a visual identifier of the vehicle manufacturer. Information provided by the vehicle manufacturer defining a first or second appearance of the vehicle instrument cluster interface enables the computer system to provide / display an instrument cluster with visual aspects specific to that type of vehicle and to provide the user with feedback regarding the vehicle manufacturer, as determined by the computer system, thereby providing improved user feedback.
[0268] In some embodiments, a second vehicle instrument cluster interface with a second appearance (e.g., 650) includes one or more visual aspects (e.g., 810, instrument cluster elements) specific to a second type of vehicle (e.g., 804), and does not include one or more visual aspects specific to a first type of vehicle. In some embodiments, the second vehicle instrument cluster interface with a second appearance includes visual identifiers of the vehicle manufacturer (e.g., 810).
[0269] In some implementations, a first vehicle instrument cluster interface with a first appearance (e.g., Figure 8A 630) includes a first plurality of instrument cluster elements, including first instrument cluster elements (e.g., 630B, 630E, 640). In some embodiments, a second vehicle instrument cluster interface with a second appearance (e.g., Figure 8BThe 650) includes a second plurality of instrument cluster elements, including the first instrument cluster elements (e.g., 650B, 650E, 640). In some embodiments, the first appearance and the second appearance include at least some of the same instrument cluster elements (e.g., one, two, all, or some). Providing information defining a first appearance or a second appearance of the vehicle instrument cluster interface that all include the first instrument cluster elements enables the computer system to provide feedback to the user regarding the information provided by the first instrument cluster elements, whether the first appearance or the second appearance is provided, thereby providing improved user feedback.
[0270] In some embodiments, a first instrument group element in a first plurality of instrument group elements has the same appearance as a first instrument group element in a second plurality of instrument group elements. In some embodiments, a first instrument group element in a first plurality of instrument group elements has a different appearance compared to a first instrument group element in a second plurality of instrument group elements. In some embodiments, the first plurality of instrument group elements are identical to the second plurality of instrument group elements (e.g., both groups include a speedometer, fuel gauge, and tachometer). In some embodiments, the first plurality of instrument group elements are different from the second plurality of instrument group elements (e.g., a speedometer and fuel gauge compared to a speedometer and battery level gauge).
[0271] In some implementations, after providing information defining the appearance of the vehicle instrument cluster to the display generation component for display as a corresponding vehicle instrument cluster interface with the corresponding appearance, the computer system (e.g., 600A) detects a reconfigured user interface for the first vehicle instrument cluster interface (e.g., in...). Figure 8C A first sequence of one or more user reconfiguration inputs (e.g., one or more inputs detected at touch-sensitive surfaces and / or buttons of the computer system) is received at location 600A. After receiving the first sequence of one or more user reconfiguration inputs, the computer system (e.g., 600A) provides information to a display generation component (e.g., 600C) defining the appearance of the vehicle instrument cluster for display via the display generation component as a corresponding vehicle instrument cluster interface with a corresponding appearance. This includes: defining a first vehicle instrument cluster interface with a second appearance based on information provided to the display generation component (e.g., 600C) that determines the display generation component is a first type (e.g., 802, first brand, first model, first configuration level / style, and / or first model year) vehicle. Figure 8C (632), and based on the information provided to the display generating component that determines the display generating component to be a second type (e.g., 804, second brand, second model, second configuration level / style and / or second model year) of a vehicle, defines a second vehicle instrument cluster interface with a second appearance (e.g., Figure 8B(650). This enables the computer system to receive user input to customize the appearance of the vehicle instrument cluster to a second appearance, allowing the user to configure the vehicle instrument cluster to display the most helpful / relevant information to the user, thereby providing improved user feedback.
[0272] In some implementations, the computer system receives user input to customize a first instrument group interface so that the first instrument group interface has the same appearance as the second instrument group interface (e.g., the same instrument group elements, the same background, the same size instrument group elements, and the same spacing between instrument group elements).
[0273] In some implementations, after providing information defining the appearance of the vehicle instrument cluster to the display generation component for display as a corresponding vehicle instrument cluster interface with the corresponding appearance via the display generation component, detection is performed for a second vehicle instrument cluster interface (e.g., as in...). Figure 8D A second sequence of one or more user reconfiguration inputs (e.g., one or more inputs detected at touch-sensitive surfaces and / or buttons of the computer system) is provided to the display generation component. After receiving the first sequence of one or more user reconfiguration inputs, the computer system (e.g., 600A) provides information defining the appearance of the vehicle instrument cluster to the display generation component for display as a corresponding vehicle instrument cluster interface with the corresponding appearance, including: defining a first vehicle instrument cluster interface with a first appearance (e.g., based on the information provided to the display generation component that determines the display generation component is a first type (e.g., 802, first brand, first model, and / or first model year) of vehicle. Figure 8A (630), and based on the information provided to the display generating component that determines the display generating component to be a second type (e.g., 804, second brand, second model and / or second model year) vehicle, defines a second vehicle instrument cluster interface with a first appearance (e.g., Figure 8D (652). This enables the computer system to receive user input to customize the appearance of the vehicle instrument cluster as a first appearance, allowing the user to configure the vehicle instrument cluster to display the most helpful / relevant information to the user, thereby providing improved user feedback.
[0274] In some implementations, the computer system receives user input to customize a second instrument group interface so that the second instrument group interface has the same appearance as the first instrument group interface (e.g., the same instrument group elements, the same background, the same size instrument group elements, and the same spacing between instrument group elements).
[0275] In some implementations, after providing information defining the appearance of a vehicle instrument cluster to a display generation component for display as a corresponding vehicle instrument cluster interface with the corresponding appearance, a reconfiguration user interface for the first vehicle instrument cluster interface is displayed, wherein the reconfiguration user interface for the first vehicle instrument cluster interface does not enable (and / or prevent) (e.g., via user input) the first vehicle instrument cluster interface (e.g., Figure 8A The 630) is customized to have a second appearance (e.g., 650). Not allowing the user to customize the appearance of the vehicle's instrument cluster to a second appearance enables the computer system to distinguish the second appearance from the first appearance (for display to the user), thereby providing improved user feedback.
[0276] In some implementations, the first vehicle instrument cluster interface cannot be customized to have the appearance of the second vehicle instrument cluster interface. In some implementations, the second vehicle instrument cluster interface includes specific elements (e.g., (text and / or graphic) indications for a second type of vehicle, and / or instrument cluster elements with a specific appearance), and the computer system does not enable (and / or prevent) the first vehicle instrument cluster interface from being customized to include these specific elements.
[0277] In some implementations, after providing information defining the appearance of a vehicle instrument cluster to a display generation component for display as a corresponding vehicle instrument cluster interface with the corresponding appearance, a reconfiguration user interface for a second vehicle instrument cluster interface is displayed, wherein the reconfiguration user interface for the second vehicle instrument cluster interface does not enable (and / or prevent) (e.g., via user input) the second vehicle instrument cluster interface (e.g., Figure 8B The 650) is customized to have a first appearance (e.g., 630). Not allowing the user to customize the appearance of the vehicle instrument cluster to the first appearance enables the computer system to distinguish the first appearance from the second appearance (to display to the user), thereby providing improved user feedback.
[0278] In some implementations, the second vehicle instrument cluster interface cannot be customized to have the appearance of the first vehicle instrument cluster interface. In some implementations, the first vehicle instrument cluster interface includes specific elements (e.g., (text and / or graphic) indications for a first type of vehicle, and / or instrument cluster elements with a specific appearance), and the computer system does not enable (and / or prevent) the second vehicle instrument cluster interface from being customized to include these specific elements.
[0279] In some implementations, after providing information defining the appearance of a vehicle instrument cluster to a display generation component for display as a corresponding vehicle instrument cluster interface with the corresponding appearance, the computer system (e.g., 600A) detects a third sequence of user reconfiguration inputs (e.g., one or more inputs detected at touch-sensitive surfaces and / or buttons of the computer system) for a reconfigurable user interface for the first vehicle instrument cluster interface. In response to detecting the third sequence of user reconfiguration inputs for a reconfigurable user interface for the first vehicle instrument cluster interface, the computer system will display the first vehicle instrument cluster interface (e.g., ...) as a reconfigurable user interface for the first vehicle instrument cluster interface. Figure 8E The 630) is customized to have a third look (e.g., Figure 8E 634, different from the first appearance and / or the second appearance). The computer system (e.g., 600A) detects a fourth sequence of user reconfiguration inputs (e.g., one or more inputs detected at touch-sensitive surfaces and / or buttons of the computer system) for a reconfigurable user interface for a second vehicle instrument cluster interface. In response to detecting a fourth sequence of user reconfiguration inputs for a reconfigurable user interface for a second vehicle instrument cluster interface, the computer system (e.g., 600A) will reconfigure the second vehicle instrument cluster interface (e.g., ... Figure 8F The 650) is customized to have a third appearance (e.g., Figure 8F 654, which differs from the first appearance and / or the second appearance.
[0280] In some implementations, after receiving a third sequence of one or more user reconfiguration inputs and a fourth sequence of one or more user reconfiguration inputs, the computer system (e.g., 600A) provides information to a display generation component defining the appearance of a vehicle instrument cluster for display via the display generation component as a corresponding vehicle instrument cluster interface with the corresponding appearance. This includes: defining a first vehicle instrument cluster interface with a third appearance (e.g., 634) based on the information provided to the display generation component, depending on whether the display generation component is determined to be a first type (e.g., 802, first brand, first model, and / or first model year); and defining a second vehicle instrument cluster interface with a third appearance (e.g., 654) based on the information provided to the display generation component, depending on whether the display generation component is determined to be a second type (e.g., 804, second brand, second model, and / or second model year). Enabling the computer system to receive user input to customize the appearance of two vehicle instrument clusters to a third appearance allows the user to configure the vehicle instrument cluster to display the most helpful / relevant information to the user, thereby providing improved user feedback.
[0281] In some implementations, the first vehicle instrument cluster interface and the second vehicle instrument cluster interface can be customized by the user of the computer system to have the same appearance.
[0282] In some implementations, based on information provided regarding the display generation component of a vehicle that is determined to be of a first type (e.g., 802, first brand, first model, and / or first model year), the user selects the same appearance of the instrument cluster based on information provided regarding the display generation component of a vehicle that is determined to be of a second type (e.g., 804, second brand, second model, second configuration level / style, and / or second model year). Providing different appearances for the vehicle instrument cluster based on the vehicle type provides the user with feedback regarding the type of vehicle to which the information is being provided, thereby providing improved user feedback.
[0283] In some implementations, defining the same user selections for the instrument cluster (e.g., the same template instrument cluster interface (same layout), same font, same line width, same color, same instrument cluster element shape) makes the display of the instrument cluster visually different when displayed via the display generation component of a first type of vehicle compared to when displayed via the display generation component of a second type of vehicle.
[0284] In some implementations, the information provided to the display generation component for different types of vehicles is the same. In other implementations, the information provided to the display generation component is different (e.g., based on vehicle type).
[0285] In some implementations, the display of the vehicle instrument cluster is based on features of display generation components that are advantageous to the display of the vehicle instrument cluster.
[0286] It should be noted that the above is relative to method 900 (e.g., Figure 9 The details of the process described herein also apply in a similar manner to the methods described below / above. For example, methods 700, 1100, and 1300 optionally include one or more features of the various methods described above with reference to method 900. For example, the instrument group (e.g., 630) is the same instrument group as in other methods (e.g., 630). Similarly, the speedometer (e.g., 640) is the same speedometer as in other methods. For the sake of brevity, these details will not be repeated below.
[0287] Figures 10A to 10F An exemplary user interface for displaying a speed limit indication, according to some embodiments, is shown. The user interface in these figures is used to illustrate the processes described below, including... Figure 11 The process in.
[0288] Figure 10AInstrument cluster 630 is shown, comprising multiple instrument cluster elements, including 630A-630E and 640. In some examples, the instrument cluster elements display information about the vehicle's status, including where the instrument cluster is displayed. Navigation element 630A provides navigation instructions and estimated arrival time. Temperature element 630B indicates the vehicle's temperature, such as oil temperature, battery temperature, and / or interior cabin temperature. Gearshift element 630C indicates multiple available vehicle gears and identifies the currently selected gear. Percentage element 630D indicates a percentage of vehicle characteristics, such as the percentage of battery charge and / or the percentage of a full fuel tank. Compass 630E indicates the current direction the vehicle is facing or traveling. Audio element 630F indicates the vehicle's current audio characteristics, such as the volume of audio output from the vehicle's speakers and / or the volume level detected inside the vehicle (e.g., road noise). Speedometer 640 is an instrument cluster element that displays the vehicle's current speed and the current speed limit of the road on which the vehicle is traveling and / or located.
[0289] The speedometer 640 includes a first visual indication of the current speed, such as by changing the appearance of the speedometer 640, and optionally a second visual indication of the current speed, such as by a speed indicator 650A. The speedometer 640 optionally includes a visual indication of a current speed limit, such as by changing the appearance of the speedometer 640 (as described in further detail below), and optionally a second visual indication of the current speed limit, such as by a limit indicator 650B. Different positions on the speedometer 640 correspond to different speeds. Therefore, filling a portion of the speedometer at a specific position corresponding to a specific speed provides feedback to the user about the vehicle's current speed. Similarly, changing the color of the filled portion of the speedometer outside the specific position corresponding to a specific speed limit provides feedback to the user about the speed limit. Additionally, displaying the speed indicator 650A at a specific position corresponding to a specific speed provides feedback to the user about the vehicle's current speed, and displaying the limit indicator 650B at a specific position corresponding to a specific speed limit provides feedback to the user about the speed limit.
[0290] When the vehicle accelerates / decelerates and when different speed limits are detected, the indicators and visual components of the speedometer 640 change to provide the user with visual feedback on the current speed, the current speed limit, and whether the vehicle's current speed is above or below the current speed limit.
[0291] exist Figure 10B At this location, the speed limit is a first speed 640A, and the vehicle speed is a second speed 640B, which is higher than the first speed 640A. In response to detecting the speed limit and the vehicle speed, and based on determining that the vehicle speed is higher than the speed limit, the system (e.g., computer system 600A and / or computer system display 630) displays as shown... Figure 10BThe speedometer 640 is shown. The system concurrently displays a limit indicator 650B at a location corresponding to a first speed 640A and a speed indicator 650A at a location corresponding to a second speed 640B on or adjacent to the speedometer 640. A portion 660A of the speedometer 640 has a first appearance (e.g., a first color (such as red, yellow, orange, gray, black), a first emphasis level, a first brightness, markings of a first size, and / or markings of a first length) because that is the portion of the speedometer above the speed limit (first speed 640A) and below the vehicle speed (second speed 640B). The first appearance provides the user with feedback that the vehicle speed has exceeded the speed limit and by how much. Section 660B of the speedometer 640 has a second appearance (e.g., a second color (such as green, blue, white, or purple), a second emphasis level, a second brightness, markings with a second size, and / or markings with a second length) (different from the first appearance) because that is the portion of the speedometer below the speed limit and below the vehicle speed (e.g., between 0 mph (seventh speed 640G) and the speed limit (first speed 640A)). Section 660C of the speedometer 640 (between the second speed 640B and the sixth speed 640F) has a fifth appearance (e.g., a third color (such as white or beige), a third emphasis level, a third brightness, markings with a third size, and / or markings with a third length) because that is the portion of the speedometer above the vehicle speed.
[0292] exist Figure 10C At this point, the speed limit changes to a third speed 640C as the vehicle continues to travel at the second speed 640B. In response to detecting the speed limit change and determining that the vehicle speed is not higher than the speed limit, the system (e.g., the computer system 600A and / or the computer system of the display 630) displays as shown below. Figure 10C The speedometer 640 is shown. The system displays a speed limit indicator 650B at a third speed 640C and a speed indicator 650A at a second speed 640B concurrently on or adjacent to the speedometer 640. A portion 660A of the speedometer 640 has a second appearance because this portion of the speedometer is below the speed limit (third speed 640C) and below the vehicle speed (second speed 640B). A portion 660B of the speedometer 640 has a second appearance because this portion of the speedometer is below the speed limit and below the vehicle speed (e.g., between 0 mph (seventh speed 640G) and the speed limit (first speed 640A)). A portion 660C of the speedometer 640 has a fifth appearance because this portion of the speedometer is above the vehicle speed.
[0293] exist Figure 10DAt this point, the speed limit changes to a fourth speed 640D as the vehicle continues to travel at the second speed 640B. The fourth speed 640D is between the first speed 640A and the second speed 640B. In response to detecting a change in the speed limit and determining that the vehicle speed is above the speed limit, the system (e.g., the computer system 600A and / or the computer system of the display 630) displays as shown... Figure 10D The speedometer 640 is shown. A portion 660A of the speedometer 640 has a third appearance (a portion has a first appearance and a portion has a second appearance) because this portion of the speedometer is below the vehicle speed (second speed 640B) and partially below the speed limit (third speed 640D). A portion 660B of the speedometer 640 has a second appearance because this portion of the speedometer is below the speed limit and below the vehicle speed (e.g., between 0 mph (seventh speed 640G) and the first speed 640A). A portion 660C of the speedometer 640 has a fifth appearance because this portion of the speedometer is above the vehicle speed.
[0294] exist Figure 10E At this point, the speed limit is changed to a first speed 640A, and the vehicle speed is changed to a fifth speed 640E. The fifth speed 640E is between the first speed 640A and the second speed 640B. In response to detecting the speed limit and the change in vehicle speed, and based on determining that the vehicle speed is higher than the speed limit, the system (e.g., the computer system of computer system 600A and / or the computer system of display screen 630) displays as shown below. Figure 10E The speedometer 640 is shown. A portion 660A of the speedometer 640 has a fourth appearance (a portion has a first appearance and a portion has a third appearance) because a vehicle speed exceeding the speed limit (640A) (a fifth speed 640E) is within this portion of the speedometer, and a portion of this portion of the speedometer is above the vehicle speed (fifth speed 640E). A portion 660B of the speedometer 640 has a second appearance because this portion of the speedometer is below the speed limit and below the vehicle speed. A portion 660C of the speedometer 640 has a fifth appearance because this portion of the speedometer is above the vehicle speed.
[0295] exist Figure 10F At this point, the speed limit changes to the third speed 640C when the vehicle speed is maintained at the fifth speed 640E. In response to detecting the speed limit change and determining that the vehicle speed is not higher than the speed limit, the system (e.g., the computer system of computer system 600A and / or the computer system of display screen 630) displays as shown below. Figure 10FThe speedometer 640 is shown. A portion 660A of the speedometer 640 has a seventh appearance (a portion has a second appearance and a portion has a third appearance) because the vehicle speed (fifth speed 640E) is higher than the speed limit (640A) and within that portion of the speedometer, and a portion of that portion of the speedometer is higher than the vehicle speed (fifth speed 640E). A portion 660B of the speedometer 640 has a second appearance because that portion of the speedometer is lower than the speed limit and lower than the vehicle speed. A portion 660C of the speedometer 640 has a fifth appearance because that portion of the speedometer is higher than the vehicle speed.
[0296] although Figures 10A to 10F The speedometer shown is arranged in a straight line, but the same technique for indicating vehicle speed and speed limits can be achieved when using a non-linear speedometer. In some embodiments, the speedometer is circular, the speed indicator is a pointer that rotates about an axis and points to a position on the speedometer, and the speed limit is indicated by changing the color (or size or other appearance) of the numerical speed and / or by markings along the circle corresponding to the corresponding speed. In some embodiments, the speedometer is arc-shaped, the speed indicator is a pointer that rotates about an axis or slides along a path, and the speed indicator points to a position on the speedometer, wherein the speed limit is indicated by changing the color (or size or other appearance) of the numerical speed and / or by markings along the circle corresponding to the corresponding speed.
[0297] Figure 11 This is a flowchart illustrating a method for displaying a speed limit indication using a computer system according to some embodiments. Method 1100 is executed at a computer system (e.g., 100, 300, 500, 600A, 600B, 600C, the vehicle's computer system) that communicates with a display generating component (e.g., 600B, 600C, the vehicle's display generating component, a display disposed in the vehicle's front console, and / or a display positioned in front of / in front of the driver's seat). Some operations in method 1100 may optionally be combined, some operations may optionally be changed in order, and some operations may optionally be omitted.
[0298] As described below, method 1100 provides an intuitive way to display speed limit indications. This method reduces the cognitive burden on users monitoring speed limits, thereby creating a more efficient human-machine interface. For battery-powered computing devices, enabling users to monitor speed limits faster and more effectively saves power and increases the time between battery charging sessions.
[0299] A computer system (e.g., 600C) displays (e.g., 1102) a speedometer (e.g., 640) via a display generation component, which indicates (e.g., by changing the color (and / or other appearance) of a path such as the boundary of the speedometer; and / or using a pointer that moves and / or rotates to point to different parts of the speedometer to indicate the current vehicle speed) the current vehicle speed (e.g., the speed of the vehicle where the display generation component is located), wherein: based on determining that the current speed limit is a first speed (e.g., 640A, 40 mph, 50 mph) and the current vehicle speed is a second speed (e.g., 640B, 55 mph, 60 mph) higher than the first speed (e.g., 640A, 40 mph, 50 mph), the portion of the speedometer (e.g., 640) between the position on the speedometer corresponding to the first speed (e.g., 40 mph, 50 mph) and the position on the speedometer corresponding to the second speed (e.g., 55 mph, 60 mph) (e.g., 660A) has (1104) a first appearance (e.g., as shown in...). Figure 10B (e.g., a first color (such as red, yellow, orange, gray, black), a first emphasis level, a first brightness, a mark with a first size and / or a mark with a first length); and based on the determination that the current speed limit is a third speed (e.g., 640A) higher than the first speed (e.g., 640C, 65mph, 70mph) and the current vehicle speed is not higher than (e.g., equal to or lower than) the third speed (e.g., 640C, 65mph, 70mph) and is a second speed (e.g., 640B, 55mph, 60mph), the portion of the speedometer (e.g., 640) between the position on the speedometer corresponding to the first speed (e.g., 40mph, 50mph) and the position on the speedometer corresponding to the second speed (e.g., 55mph, 60mph) (e.g., 660A) has (1106) a second appearance different from the first appearance (e.g., as in...) Figure 10C (e.g., a second color (such as green, blue, white, purple), a second emphasis level, a second brightness, markings with a second size, and / or markings with a second length). In some embodiments, the difference between the first and second appearances is based on parameters other than the size and / or shape of the area of the speedometer between the first and second speeds or the markings on the speedometer between the first and second speeds. The portion of the speedometer with a different appearance based on whether the current vehicle speed is above or below the current speed limit provides the user with feedback on whether the vehicle's current speed is above or below the speed limit, thereby providing improved user feedback.
[0300] In some implementations, the technology is executed at a second computer system (e.g., a smartphone and / or a vehicle-separated accessory device) that communicates with a display generating component (e.g., 600C, the vehicle's display generating component, a display located in the vehicle's front console, and / or a display positioned in front of / in front of the driver's seat).
[0301] The second computer system (e.g., 600A) provides the display generating component (e.g., 600C) with information defining the appearance of a speedometer (e.g., 640) indicating (e.g., the current speed of the vehicle and / or the second computer system) to be displayed as a corresponding speedometer via the display generating component. This includes: based on determining that the current speed limit is a first speed (e.g., 40 mph, 50 mph) and the current vehicle speed is a second speed (e.g., 55 mph, 60 mph) higher than the first speed (e.g., 40 mph, 50 mph), the portion of the speedometer between the position on the speedometer corresponding to the first speed (e.g., 40 mph, 50 mph) and the position on the speedometer corresponding to the second speed (e.g., 55 mph, 60 mph) has a first appearance (e.g., a first color (such as red, yellow, orange, gray, etc.)). The speedometer has a second appearance (e.g., a second color (such as green, blue, white, purple), a second emphasis level, a second brightness, a mark with a second size, and / or a mark with a second length) between the position on the speedometer corresponding to the first speed (e.g., 40 mph, 50 mph) and the position on the speedometer corresponding to the second speed (e.g., 55 mph, 60 mph) that is not higher than (e.g., equal to or lower than) the third speed (e.g., 65 mph, 70 mph). In some embodiments, the difference between the first and second appearances is based on parameters other than the size and / or shape of the area on the speedometer between the first and second speeds or the mark on the speedometer between the first and second speeds.
[0302] In some implementations, based on the determination that the current speed limit is a first speed (e.g., 640A, 40 mph, 50 mph) and the current vehicle speed is a second speed (e.g., 640B, 55 mph, 60 mph) higher than the first speed (e.g., 40 mph, 50 mph) and the position on the speedometer corresponding to a seventh speed (e.g., 0 mph, 5 mph) lower than the first speed, the portion between the position on the speedometer corresponding to the first speed (e.g., 40 mph, 50 mph) and the position on the speedometer corresponding to a seventh speed (e.g., 0 mph, 5 mph) lower than the first speed (e.g., ... Figure 10B The 660B) has a second appearance that is different from the first appearance (e.g., a second color (such as green), a second emphasis level, and / or a second brightness).
[0303] In some implementations, based on the determination that the current speed limit is a first speed (e.g., 640A, 40 mph, 50 mph) and the current vehicle speed is a second speed (e.g., 640B, 55 mph, 60 mph) higher than the first speed limit (e.g., 40 mph, 50 mph) and the position on the speedometer corresponding to the second speed (e.g., 55 mph, 60 mph) and the position on the speedometer corresponding to the third speed (e.g., 65 mph, 70 mph), the portion between the position on the speedometer corresponding to the second speed (e.g., 55 mph, 60 mph) and the position on the speedometer corresponding to the third speed (e.g., 65 mph, 70 mph) is considered. Figure 10B A portion of 660C in the model has a fifth appearance (e.g., a third color (e.g., white), a third emphasis level, and / or a third brightness) that differs from the first appearance and optionally from the second appearance. In some embodiments, based on determining that the current speed limit is a first speed (e.g., 640A, 40 mph, 50 mph) and the current vehicle speed is a second speed (e.g., 650B, 55 mph, 60 mph) higher than the first speed (e.g., 40 mph, 50 mph), the speedometer is positioned between the location on the speedometer corresponding to the third speed (e.g., 65 mph, 70 mph) and the location on the speedometer corresponding to the sixth speed (e.g., the maximum indicated speed, 100 mph, 105 mph). Figure 10C (A portion of 660C) has a fifth appearance (e.g., a third color (e.g., white), a third emphasis level, and / or a third brightness) that is different from the first appearance and optionally different from the second appearance.
[0304] In some implementations, based on the determination that the current speed limit is a third speed (e.g., 640C, 65 mph, 70 mph) higher than a first speed (e.g., 640A) and the current vehicle speed is a second speed (e.g., 640B, 55 mph, 60 mph) not higher than (e.g., equal to or lower than) the third speed (e.g., 640C, 65 mph, 70 mph) and not higher than (e.g., equal to or lower than) the third speed (e.g., 640C, 65 mph, 70 mph), the speedometer position on the speedometer corresponding to the first speed (e.g., 40 mph, 50 mph) and the position on the speedometer corresponding to the seventh speed (e.g., 0 mph, 5 mph) is the portion between these positions. Figure 10C The 660B) has a second appearance that is different from the first appearance (e.g., a second color (such as green), a second emphasis level, and / or a second brightness).
[0305] In some implementations, based on the determination that the current speed limit is a third speed (e.g., 640C, 65 mph, 70 mph) higher than a first speed (e.g., 640A) and the current vehicle speed is not higher than (e.g., equal to or lower than) a second speed (e.g., 640B, 55 mph, 60 mph) higher than the third speed (e.g., 640C, 65 mph, 70 mph), the speedometer is positioned between the position on the speedometer corresponding to the second speed (e.g., 55 mph, 60 mph) and the position on the speedometer corresponding to the third speed (e.g., 65 mph, 70 mph). Figure 10C A portion of 660C has a sixth appearance (e.g., a fourth color (e.g., yellow or light green), a fourth emphasis level, and / or a fourth brightness) that is different from the first appearance and optionally different from the second and third appearances. In some embodiments, the sixth appearance is the same as the fifth appearance (e.g., the third color, such as white).
[0306] In some implementations, based on the determination that the current speed limit is a third speed (e.g., 640C, 65 mph, 70 mph) higher than the first speed and the current vehicle speed is a second speed (e.g., 640B, 55 mph, 60 mph) not higher than (e.g., equal to or lower than) the third speed (e.g., 65 mph, 70 mph) and the position on the speedometer corresponding to the third speed (e.g., 65 mph, 70 mph) and the position on the speedometer corresponding to the sixth speed (e.g., the maximum indicated speed, 100 mph, and / or 105 mph), the portion between the position on the speedometer corresponding to the third speed (e.g., 65 mph, 70 mph) and the position on the speedometer corresponding to the sixth speed (e.g., the maximum indicated speed, 100 mph, and / or 105 mph) is considered. Figure 10C A portion of the 660C has a fifth appearance (e.g., a third color (e.g., white), a third emphasis level, and / or a third brightness) that is different from the first appearance and optionally different from the second appearance.
[0307] In some implementations, while a speedometer (e.g., 640) indicating the current vehicle speed (e.g., 640B) is displayed via a display generation component (e.g., 600C), a computer system (e.g., 600C) detects a change in the speed limit of a fourth speed (e.g., 640D) between a first speed (e.g., 640A) and a second speed (e.g., 640B). In response to detecting the speed limit change to the fourth speed, the computer system (e.g., 600C) adjusts the speedometer position on the speedometer between the position corresponding to the first speed (e.g., 40 mph, 50 mph) and the position on the speedometer corresponding to the second speed (e.g., 55 mph, 60 mph). Figure 10DThe appearance of the speedometer (660A) is changed by the display generating component to a third appearance different from the first and second appearances (e.g., a first portion with a first color (such as red) and a second portion with a second color (such as green), a first portion with a first emphasis level and a second portion with a second emphasis level, a first portion with a first brightness and a second portion with a second brightness, a first portion with a first width and a second portion with a second width). Changing the appearance of this portion of the speedometer based on detected speed limit changes provides the user with feedback on what speed limit has been detected and whether the vehicle's current speed is above or below that speed limit, thereby providing improved user feedback.
[0308] In some implementations, while displaying a speedometer indicating a second speed (e.g., 640B) as the current vehicle speed via a display generation component (e.g., 600C) (and when the speed limit is a first or third speed), the computer system (e.g., 600C) detects a change in the current vehicle speed to a fifth speed (e.g., 640E) that is lower than the second speed (and optionally higher than the first speed). In response to detecting a change in the current vehicle speed to the fifth speed (e.g., 640E), the computer system (e.g., 600C) stores the portion of the speedometer position corresponding to the first speed (e.g., 40 mph, 50 mph) and the position corresponding to the second speed (e.g., 55 mph, 60 mph) (e.g., ...). Figure 10E The appearance of the speedometer (660A) is changed by the display generating component to a fourth appearance different from the first and second appearances (and optionally, a third appearance). This includes (e.g., a first portion with a first color (such as red) and a second portion with a third color (such as white), a first portion with a first emphasis level and a second portion with a third emphasis level, a first portion with a first brightness and a second portion with a third brightness, a first portion with a first width and a second portion with a third width). Changing the appearance of this portion of the speedometer based on detected changes in the current vehicle speed provides the user with feedback on what vehicle speed has been detected and whether the vehicle's current speed is above or below the speed limit, thus providing improved user feedback.
[0309] In some implementations, a computer system (e.g., 600C) displays a speedometer (e.g., 640) via a display generation component, which indicates (e.g., by changing the color (and / or other appearance) of a path such as the boundary of the speedometer; and / or using a pointer that moves and / or rotates to point to different portions of the speedometer to indicate the current vehicle speed) the current vehicle speed (e.g., the speed of the vehicle where the generation component is located), including: based on determining that the current speed limit is a first speed (e.g., 640A, 40 mph, 50 mph) and the current vehicle speed is a second speed (e.g., 640B, 55 mph, 60 mph) higher than the first speed (e.g., 40 mph, 50 mph) and the speedometer is a second speed (e.g., 640B, 55 mph, 60 mph), the portion of the speedometer between the position on the speedometer corresponding to the second speed (e.g., 55 mph, 60 mph) and the position on the speedometer corresponding to the sixth speed (e.g., 640F, maximum indicated speed, 100 mph, 105 mph) (e.g., ...). Figure 10B The 660C has a fifth appearance (e.g., a third color (such as white), a third emphasis level, and / or a third brightness); and based on the determination that the current speed limit is a third speed higher than the first speed (e.g., 640C, 65 mph, 70 mph) and the current vehicle speed is not higher than (e.g., equal to or lower than) the third speed (e.g., 640C, 65 mph, 70 mph) and is a second speed (e.g., 640B, 55 mph, 60 mph), the speedometer is positioned between the position on the speedometer corresponding to the second speed (e.g., 55 mph, 60 mph) and the position on the speedometer corresponding to the sixth speed (e.g., the maximum indicated speed, 100 mph, 105 mph) (e.g., ...). Figure 10C The 660C features a fifth appearance (e.g., a third color (such as white), a third emphasis level, and / or a third brightness). Displaying the portion of the speedometer above the current vehicle speed with a different appearance compared to the portion not exceeding the current vehicle speed provides the user with feedback on what current vehicle speed is detected, thus offering improved user feedback.
[0310] In some implementations, the first appearance has a first color (e.g., without a second color), and the second appearance has a second color different from the first color (e.g., without the first color). In some implementations, the first and second appearances are different (and distinguishable) based on color. Displaying the first and second appearances using different colors allows the computer system to allow the user to distinguish between the two appearances, thereby providing improved user feedback.
[0311] In some embodiments, the speedometer (e.g., 640) includes multiple numerical indicators for multiple speeds, and wherein the corresponding numerical indicator among the multiple numerical indicators that corresponds to the current speed limit (e.g., indicating 50 mph, indicating 60 mph) has a different appearance (e.g., color, emphasis level, size, and / or brightness) from the other numerical indicators among the multiple numerical indicators (e.g., indicating 10 mph, indicating 15 mph). In some embodiments, the multiple numerical indicators (except for the corresponding numerical indicator that corresponds to the current speed limit) have the same appearance (e.g., the same color, the same emphasis level, the same size, and / or the same brightness). By using a different appearance for the numerical indicator of the speedometer for the current speed limit compared to other numerical indicators of the speedometer, the speedometer provides the user with feedback on what current speed limit has been detected, thereby providing improved user feedback.
[0312] In some implementations, the numerical indicator is displayed with an emphasized appearance (e.g., color, brightness, and / or size) based on whether it corresponds to the current speed limit, and is not displayed with an emphasized appearance based on whether it does not correspond to the current speed limit.
[0313] In some embodiments, a numerical indicator for the first speed is adjacent to a position display on the speedometer corresponding to the first speed. In some embodiments, a numerical indicator for the second speed is adjacent to a position display on the speedometer corresponding to the second speed. In some embodiments, multiple numerical indicators for each speed are adjacent to corresponding positions on the speedometer corresponding to the respective speeds.
[0314] In some embodiments, when a speedometer (e.g., 640) indicating the current vehicle speed is displayed via a display generation component (e.g., 600C), a change in the speed limit from a first speed (e.g., 640A) to a third speed (e.g., 640C) is detected. In response to detecting the speed limit change from the first speed to the third speed, the appearance of the numerical indicator corresponding to the first speed is changed via the display generation component (e.g., by de-emphasis). In some embodiments, in response to detecting the speed limit change from the first speed to the third speed, the appearance of the numerical indicator corresponding to the third speed is changed via the display generation component (e.g., by emphasis). Changing the appearance of the speedometer's numerical indicator based on the speed limit change provides feedback to the user that a speed limit change has been detected, thereby providing improved user feedback.
[0315] In some implementations, the computer system (e.g., 600C) concurrently displays (e.g., as part of the vehicle instrument cluster interface) multiple instrument cluster elements (e.g., such as...) via a display generation component and a speedometer indicating the current vehicle speed. Figure 10A As shown, this includes a tachometer, fuel level indicator 630D, battery level indicator, and / or shift position indicator 630C. In some embodiments, the speedometer and / or these multiple instrument cluster elements indicate information about the vehicle in which the display generation component is located. Displaying multiple cluster elements concurrently with the speedometer allows the computer system to concurrently provide the user with various information about the vehicle, thereby providing improved user feedback.
[0316] In some embodiments, the speedometer (e.g., the speedometer's appearance) is based at least in part on information provided to a display generation component (e.g., 600C) from an accessory device (e.g., 600A) separate from the computer system, wherein the information provided to the display generation component defines the appearance of the speedometer (e.g., 640) for display. In some embodiments, this information defines the appearance of a vehicle instrument cluster for display, and the speedometer (and optionally multiple instrument cluster elements) is part of the vehicle instrument cluster. In some embodiments, the information provided to the display generation component defines the appearance of the vehicle instrument cluster (which includes the speedometer) for display via the display generation component as a corresponding vehicle instrument cluster interface with a corresponding appearance, as described in more detail above. Making the speedometer at least in part based on information provided by the accessory device enables the computer system to change the speedometer's appearance based on the accessory device (and thus the user) currently within the scope of the computer system, thereby providing improved user feedback.
[0317] In some implementations, when selecting a first speedometer appearance, the first appearance has a first visual quality; and when selecting a second speedometer appearance, the first appearance has a second visual quality different from the first visual quality; and when selecting a first speedometer appearance, the second appearance has a third visual quality; and when selecting a second speedometer appearance, the second appearance has a fourth visual quality different from the third visual quality. By having different appearances and different visual qualities for this part of the speedometer based on whether the current vehicle speed is above or below the current speed limit, feedback is provided to the user regarding whether the vehicle's current speed is above or below the speed limit, thereby providing improved user feedback.
[0318] In some embodiments, when selecting a first speedometer appearance, the portion of the speedometer having the first / second appearance is a straight line, and when selecting a second speedometer appearance, the portion of the speedometer having the first / second appearance is a circular arc (or an elliptical arc).
[0319] In some embodiments, the positions on the speedometer corresponding to different speeds are arranged as lines. In some embodiments, the positions on the speedometer corresponding to different speeds are arranged as circles. In some embodiments, the positions on the speedometer corresponding to different speeds are arranged as arcs. In some embodiments, the positions on the speedometer corresponding to different speeds are arranged as semicircles.
[0320] In some embodiments, the first and second appearances of the portion of the speedometer between a first and a second speed are based on whether the speed limit is above or below the current speed and the selected speedometer appearance (e.g., theme). In some embodiments, the computer system receives user input to change the appearance of the speedometer, which optionally also visually alters the first and second appearances (while maintaining the first and second appearances distinct).
[0321] In some embodiments, the computer system (e.g., 600C) displays a speed indicator (e.g., 640A, as part and / or supplement to the speedometer) concurrently with a display generating component and a speedometer (e.g., 640), indicating the current vehicle speed (e.g., the speed of the vehicle where the generating component is located). In some embodiments, the speed indicator (e.g., 640A) is a displayed instrument pointer that points to and / or overlaps with a position on the speedometer corresponding to and / or with the current vehicle speed (e.g., by rotating about a fixed axis, or by moving along a predetermined path). In some embodiments, the speed indicator indicates the current vehicle speed by displaying a numerical representation of the current vehicle speed. Displaying a speed indicator indicating the current vehicle speed concurrently with the speedometer provides the user with feedback on the current vehicle speed (e.g., at two locations or in two different formats), thereby providing improved user feedback.
[0322] It should be noted that the above description is relative to the process described in method 1100 (e.g., Figure 11 The details of the methods described below also apply in a similar manner. For example, methods 700, 900, and 1300 optionally include one or more features of the various methods described above with reference to method 1100. For example, the instrument group (e.g., 630) is the same as the instrument group (e.g., 630) of other methods. Similarly, the speedometer (e.g., 640) is the same speedometer of other methods. For the sake of brevity, these details will not be repeated below.
[0323] Figures 12A to 12D Exemplary devices and user interfaces for providing dynamic instrument clusters are illustrated according to some embodiments. The user interface in these figures is used to illustrate the inclusion of… Figure 13 The process described below is the process in the middle.
[0324] Figures 12A to 12BDisplay screens 600C and 600B, which are part of dashboard 602, are shown. In this example, a computer system 600A, representing a smartphone with a display, is shown positioned next to dashboard 602. Dashboard 602 is part of vehicle 802. Vehicle 802 includes a steering wheel 1200, at least partially positioned between dashboard 602 and the driver's seat of vehicle 802. The position of steering wheel 1200 is adjustable, such as automatically by the computer system and / or manually by user-provided adjustment / input.
[0325] exist Figure 12A At this point, computer system 600A transmits information defining the appearance of the vehicle's instrument cluster to display screen 600C, such as the information mentioned above relative to... Figures 6A to 6I and 8A to Figure 8G The described information, and / or information defining the appearance of the auxiliary user interface, is transmitted to display screen 600B. Therefore, display screen 600C displays the vehicle's instrument cluster, and display screen 600B displays the user interface, such as application icons and / or the user interface of an application. Computer system 600A also displays the user interface, such as application icons and / or the user interface of an application.
[0326] exist Figure 12A At the location of the instrument cluster, display screen 600C shows an instrument cluster including navigation elements. The position of the steering wheel 1200 (e.g., relative to instrument panel 602 and / or display screens 600C and / or 600B) is determined by the computer system of display screen 600C and / or computer system 600A. Based on the position of the steering wheel 1200, the instrument cluster displayed on display screen 600C is optionally modified. In some embodiments, the instrument cluster displayed on display screen 600C is modified to reduce, minimize, and / or avoid obstruction of the instrument cluster from the driver's perspective by the steering wheel 1200. Based on the position of the steering wheel 1200, the user interface 604 displayed on display screen 600B is optionally modified. In some embodiments, the user interface 604 is modified to reduce, minimize, and / or avoid obstruction of the user interface 604 from the driver's perspective by the steering wheel 1200. Based on the position of the steering wheel 1200, the user interface displayed on the monitor of computer system 600A is optionally modified. In some embodiments, the user interface is modified to reduce, minimize, and / or avoid obstruction of the user interface from the driver's perspective by the steering wheel 1200.
[0327] In some embodiments, the user interface is modified based on: the position of the steering wheel 1200, the position of the driver's seat, the user's physiological parameters (e.g., height), and / or the shape of the display on which the user interface is displayed (e.g., the instrument cluster including directional element 636D, user interface 604, and / or the user interface displayed on the computer system 600A). In some embodiments, the modification is one or more of the following: a shift in the display position of the user interface (or some of the elements of the user interface) (e.g., to the left, right, up, down), a change in the distance between user interface elements (e.g., pushing the elements closer together), and / or a change in the size of the user interface (or some of the elements of the user interface).
[0328] exist Figure 12A At this location, the system (e.g., the computer system of computer system 600A and / or display screen 600C) determines, based on the current height of steering wheel 1200 (and / or the position of the driver's seat, the user's physiological parameters (e.g., height) and / or the shape of the display), that display screen 600C is not partially (or less than a threshold amount) obstructed, and in response, displays directional element 636D at a large size at a first position. Optionally, the system determines, based on the current height of steering wheel 1200 (and / or the position of the driver's seat, the user's physiological parameters (e.g., height) and / or the shape of the display), that a portion of display screen 600B is obstructed by steering wheel 1200, and in response, reduces the horizontal size of user interface 604 of display screen 600B and shifts user interface 604 of display screen 600B to the right, as... Figure 12A As shown. Therefore, from the driver's perspective, the degree to which the user interface 604 (of display screen 600B) is obstructed by the steering wheel 1200 is reduced (e.g., the user interface 604 is not obstructed by the steering wheel 1200). The system optionally determines that a portion of the display of computer system 600A is obstructed based on the current height of the steering wheel 1200 (and / or the position of the driver's seat, the user's physiological parameters (e.g., height) and / or the position / shape of the display), and in response, shifts a portion of the user interface of computer system 600A to the right. Therefore, from the driver's perspective, the degree to which the user interface of computer system 600A is obstructed by the steering wheel 1200 is reduced (e.g., the user interface is less obstructed by the steering wheel 1200).
[0329] exist Figure 12BIn this configuration, the steering wheel 1200 (e.g., downwardly adjusted) and / or the driver's seat position has been adjusted. The system (e.g., the computer system of computer system 600A and / or display 600C) determines, based on the current position of the steering wheel 1200 (and / or the position of the driver's seat, the user's physiological parameters (e.g., height), and / or the position / shape of the display), that portions of display 600C, display 600B, and the display of computer system 600A are obscured by the steering wheel 1200 from the driver's angle. In response, the instrument cluster displayed on display 600C, the user interface 604 of display 600B, and the user interface of computer system 600A are optionally modified. In some embodiments, the modification is intended to reduce, minimize, and / or avoid obstruction of the corresponding user interface by the steering wheel 1200 from the driver's angle. Figure 12B In this case, the positioning element 636D has been reduced in size and shifted downward on the display screen 600C, thereby reducing the degree to which the positioning element 636D is obstructed (e.g., the user interface is not obstructed by the steering wheel 1200). Similarly, after the position of the steering wheel and / or driver's seat is adjusted, the user interface 604 of the display screen 600B is expanded and shifted to the left to take advantage of the reduced amount of obstruction caused by the steering wheel 1200.
[0330] If the steering wheel 120° and / or the driver's seat are readjusted to return to the position as follows: Figure 12A The position in the middle can be arbitrarily selected again as follows. Figure 12A The direction element 636D shown is used to take advantage of the reduction (e.g., elimination) of the occlusion previously caused by the steering wheel 1200.
[0331] Figure 12C and 12D This illustrates how different adjustments can be made to the user interface (e.g., the display on displays 600B, 600C and / or the display on computer system 600A) for different users. For example, as Figure 12C As shown, when a first user (or first user account) is detected (e.g., when logging into a device, or when in the driver's seat), adjustments to the steering wheel cause the user interface 636 to shift downwards by a first amount, without changing the size or number of instrument cluster elements. Conversely, as... Figure 12D As shown, when a second user (or a second user account) is detected (e.g., when logging into a device, or when in the driver's seat), the same adjustment to the steering wheel causes the user interface 636 to shift downwards by a second amount (different from the first amount) and causes the elements of the user interface to shrink in size. Furthermore, in Figure 12DIn the example, the adjustment of the steering wheel also causes the display of additional visual elements 636E (e.g., because this part of the display is not obstructed (or less obstructed) for the second user, and is therefore available to convey information to the second user), while continuing to reduce distraction while the second user is driving the vehicle.
[0332] like Figure 12C and 12D As shown, compared to when a second user (or second user account) is detected (e.g., when logging into a device, when in the driver's seat), the same adjustment of the steering wheel and / or driver's seat position results in different changes to the user interface of computer system 600A when a first user (or first user account) is detected (e.g., when logging into a device, when in the driver's seat). Similarly, compared to when a second user (or second user account) is detected (e.g., when logging into a device, when in the driver's seat), the same adjustment of the steering wheel and / or driver's seat position results in different changes to the user interface of display screen 600B when a first user (or first user account) is detected (e.g., when logging into a device, when in the driver's seat).
[0333] Figure 13 This is a flowchart illustrating a method for providing a dynamic instrument cluster using a computer system according to some embodiments. Method 1300 is executed at a computer system (e.g., 100, 300, 500, 600A, 600B, 600C, and / or the vehicle's computer system) that communicates with display generation components (e.g., 600B, 600C, the vehicle's display generation components, a display disposed in the vehicle's front console, and / or a display positioned in front of / in front of the driver's seat). Some operations in method 1300 may optionally be combined, some operations may optionally be changed in order, and some operations may optionally be omitted.
[0334] As described below, method 1100 provides an intuitive way to present dynamic instrument clusters. This method reduces the cognitive burden on the user when viewing the instrument cluster, thus creating a more efficient human-machine interface. For battery-powered computing devices, enabling faster and more efficient viewing of the instrument cluster saves power and increases the time between battery charging cycles.
[0335] A computer system (e.g., 600A) provides (e.g., 1302) information defining the appearance of a vehicle instrument cluster to a display generation component (e.g., 600C) for display as a corresponding vehicle instrument cluster interface with the corresponding appearance.
[0336] The corresponding appearance includes: the display of the vehicle instrument cluster interface is subject to a first set of constraints on the visible display area of the vehicle instrument cluster display (e.g., Figure 12A The steering wheel at position 1200 in the center, with the first appearance (e.g., Figure 12A The 636D) displays the (1304) vehicle instrument cluster interface.
[0337] The corresponding appearance includes: the display of the vehicle instrument cluster interface is subject to a second set of constraints on the visible display area of the vehicle instrument cluster display (e.g., Figure 12B The steering wheel at position 1200 in the middle), where the second set of constraints differs from the first set of constraints, with a second appearance different from the first appearance (e.g., Figure 12B The 636D) displays the (1306) vehicle instrument cluster interface.
[0338] In some implementations, the vehicle instrument cluster interface includes a first group of one or more instrument cluster elements (e.g., speedometer, tachometer, fuel level indicator, battery level indicator, and / or shift position indicator). In some implementations, the first group of one or more instrument cluster elements indicates information about the vehicle in which the display generation component is located. Displaying the instrument cluster with different visual appearances based on the constraints of the first or second group of constraints enables the computer system to provide the same information about the vehicle instrument cluster and adapt the displayed vehicle instrument cluster to the constraints of the display. This reduces the need for the computer system to store multiple versions of the vehicle instrument cluster and allows the user to view the vehicle instrument cluster appropriately, thereby providing enhanced visual feedback to the user.
[0339] In some implementations, at least one of the first set of constraints and the second set of constraints (e.g., the first set of constraints, the second set of constraints, and / or both sets of constraints) includes a constraint based on the shape of the display of the vehicle instrument cluster (e.g., 600C, 660B) (e.g., the shape of the display on which the vehicle instrument cluster interface will be displayed). Displaying the instrument cluster with different visual appearances based on the shape of the display enables the display to appropriately display the vehicle instrument cluster (e.g., with reduced obstruction), thereby providing enhanced visual feedback to the user.
[0340] In some implementations, at least one of the first set of constraints and the second set of constraints (e.g., the first set of constraints, the second set of constraints, and / or both sets of constraints) includes a steering wheel-based constraint (e.g., Figures 12A to 12BThe position (e.g., tilt, height, depth, and / or distance from the driver's seat) of the instrument cluster (1200 in the steering wheel) relative to the displayed instrument cluster (e.g., a display of the vehicle in which the instrument cluster is displayed). Displaying the instrument cluster with different visual appearances based on the position of the steering wheel enables the display to show the instrument cluster while reducing obstruction to relevant parts of the instrument cluster (e.g., from the user's perspective), thereby providing enhanced visual feedback to the user.
[0341] In some implementations, at least one of the first set of constraints and the second set of constraints (e.g., the first set of constraints, the second set of constraints, and / or both sets of constraints) includes constraints based on the position (e.g., tilt, height, depth, and / or distance from the steering wheel) of the seat (e.g., the driver's seat, and / or the seat in the vehicle where the instrument cluster is displayed) (e.g., relative to the displayed instrument cluster). Displaying the instrument cluster with a different visual appearance based on the seat position enables the display to show the instrument cluster while reducing obstruction to relevant parts of the instrument cluster (e.g., from the user's perspective), thereby providing enhanced visual feedback to the user.
[0342] In some implementations, at least one of the first set of constraints and the second set of constraints (e.g., the first set of constraints, the second set of constraints, and / or both sets of constraints) includes constraints based on the physiological parameters (e.g., height and / or eye position) of the user (e.g., the driver of the vehicle displaying the instrument cluster and / or a person in the driver's seat of the vehicle). Displaying the instrument cluster in a different visual appearance based on the user's physiological parameters enables the display to show the vehicle instrument cluster while reducing obstruction to relevant parts of the vehicle instrument cluster (e.g., from the user's perspective), thereby providing the user with enhanced visual feedback.
[0343] In some implementations, at least one of the first set of constraints and the second set of constraints (e.g., the first set of constraints, the second set of constraints, and / or both sets of constraints) includes constraints based on one or more prior adjustments to the vehicle instrument cluster interface (e.g., customizations, such as customization of instrument cluster element size and / or customization of instrument cluster element position). Displaying the instrument cluster with a different visual appearance based on prior adjustments allows the display to reuse the prior adjustments, thereby reducing obstruction to relevant parts of the instrument cluster (e.g., from the user's perspective) and reducing the need for the user to provide input for performing the same adjustments again, thus providing enhanced visual feedback to the user and reducing the number of inputs required to perform the operation.
[0344] In some implementations, a computer system (e.g., 600A) communicates with a second display generating component (e.g., 600B, different from display generating component 600C, but the same as the display generating component for a vehicle in which a vehicle instrument cluster is displayed). The computer system (e.g., 600A) provides the second display generating component (e.g., 600B) with information defining the appearance of an auxiliary interface for display via the second display generating component as a corresponding auxiliary interface with a corresponding appearance, including: determining that the display of the auxiliary interface is subject to a third set of constraints on the visible display area of the auxiliary interface's display (e.g., some or all of the constraints in the first set, constraints based on the shape of the auxiliary interface's display, constraints based on the steering wheel position, constraints based on the seat position, constraints based on the user's physiological parameters, and / or constraints based on one or more previously adjusted constraints of the auxiliary interface), to a third appearance (e.g., Figure 12A (604) Displays an auxiliary interface; and the display of the auxiliary interface is subject to a fourth set of constraints on the visible display area of the auxiliary interface's display (e.g., some or all of the constraints in the first set, constraints based on the shape of the auxiliary interface's display, constraints based on the steering wheel's position, constraints based on the seat's position, constraints based on the user's physiological parameters, and / or constraints based on one or more previously adjusted constraints of the auxiliary interface), wherein the fourth set of constraints differs from the third set of constraints, in order to have a fourth appearance different from the third appearance (e.g., Figure 12B (604) Displaying an auxiliary interface. Displaying the auxiliary interface with different visual appearances based on different sets of constraints on the second display allows the computer system to provide the same information about the auxiliary interface and adapt the displayed auxiliary interface to the constraints of the second display. This reduces the need for the computer system to store multiple versions of the auxiliary interface and allows the user to view the auxiliary interface appropriately, thereby providing enhanced visual feedback to the user.
[0345] In some implementations, when (e.g., in) Figure 12A and Figure 12B When a change is detected in one or more parameters of the vehicle displayed in the instrument cluster (e.g., position 1200), the corresponding appearance of the instrument cluster interface changes based on the change in parameters (e.g., in response to detecting a change). Changing the corresponding appearance of the instrument cluster when a change in vehicle parameters is detected (and based on the change in parameters) provides the user with feedback that a change in vehicle parameters has been detected, thereby providing improved visual feedback.
[0346] In some implementations, the first parameter among one or more parameters of the vehicle is the position of the vehicle's steering wheel (e.g., 120°) (e.g., tilt, height, depth, and / or distance from the driver's seat). When a change in the position of the vehicle's steering wheel is detected (and based on the change in parameters), the corresponding appearance of the vehicle's instrument cluster is changed to provide feedback to the user that a change in the position of the vehicle's steering wheel has been detected, and, for example, the vehicle's instrument cluster interface is adjusted so that relevant parts are not obstructed for the user, thereby providing improved visual feedback.
[0347] In some implementations, the second parameter among one or more parameters of the vehicle is the position of the vehicle's seat (e.g., driver's seat) (e.g., tilt, height, depth, and / or distance from the steering wheel). When a change in the vehicle's seat position is detected (and based on the change in parameters), the corresponding appearance of the vehicle's instrument cluster is changed to provide feedback to the user that the change in the vehicle's seat position has been detected, and, for example, the vehicle's instrument cluster interface is adjusted so that relevant parts are not obstructed for the user, thereby providing improved visual feedback.
[0348] In some implementations, the first set of constraints and the second set of constraints are determined based on the fact that the first user is the driver of the vehicle (e.g., as...). Figure 12C (As shown). A computer system (e.g., 600A) provides information defining the appearance of a vehicle instrument cluster to a display generation component (e.g., 600C) for display as a corresponding vehicle instrument cluster interface with a corresponding appearance via the display generation component, including: displaying the vehicle instrument cluster interface on the visible display area of the vehicle instrument cluster display with a fourth appearance different from the first and second appearances, subject to a third set of constraints different from the first and second sets of constraints; and displaying the vehicle instrument cluster interface on the visible display area of the vehicle instrument cluster display with a fourth set of constraints different from the first, second, and third sets of constraints, subject to the fourth set of constraints, wherein the fourth set of constraints is different from the first, second, and third sets of constraints. The third and fourth sets of constraints are determined based on the fact that the second user is the driver of the vehicle (e.g., as shown). Figure 12D (As shown). The system provides customized definitions for the appearance of the vehicle's instrument cluster to accommodate different users, such as the vehicle's driver. It also provides feedback to the user about which driver has been detected, and, for example, adjusts the instrument cluster interface so that relevant sections are not obstructed for the detected driver, thereby providing improved visual feedback.
[0349] In some implementations, the first set of constraints and the second set of constraints are used to determine the instrument group based on a first instrument group template. A computer system (e.g., 600A) provides information defining the appearance of a vehicle instrument group (e.g., 636) to a display generation component (e.g., 600C) for display as a corresponding vehicle instrument group interface with a corresponding appearance via the display generation component. This includes: subjecting the determined vehicle instrument group interface to a third set of constraints on the visible display area of the vehicle instrument group's display, which are different from the first and second sets of constraints, to display the vehicle instrument group interface with a third appearance different from the first and second appearances; and subjecting the determined vehicle instrument group interface to a fourth set of constraints on the visible display area of the vehicle instrument group's display, where the fourth set of constraints are different from the first, second, and third sets of constraints, to display the vehicle instrument group interface with a fourth appearance different from the first, second, and third appearances. The third and fourth sets of constraints are used to determine the instrument group based on a second instrument group template. Providing information defining the corresponding appearance of the vehicle instrument group for adjustment based on different instrument group templates enables the computer system to provide feedback to the user about which instrument group template has been selected, thereby providing improved visual feedback.
[0350] In some implementations, the vehicle instrument cluster interface with a first appearance has the same number of instrument cluster elements as the vehicle instrument cluster interface with a second appearance (e.g., such as...). Figure 12C (As shown). In some implementations, the only difference between the first and second appearances is the number of instrument cluster elements, and other visual aspects (e.g., background image / color and / or text size) remain unchanged between the first and second appearances. Providing information defining the appropriate appearance of the vehicle's instrument cluster such that the first and second appearances have the same number of instrument cluster elements enables the computer system to provide feedback to the user about the vehicle using the same number of instrument cluster elements, thereby providing improved visual feedback.
[0351] In some implementations, the vehicle instrument cluster interface with a first appearance has the same set of one or more instrument cluster elements as the vehicle instrument cluster interface with a second appearance, wherein the vehicle instrument cluster interface with the first appearance does not have any instrument cluster elements that are not part of the vehicle instrument cluster interface with the second appearance, and wherein the vehicle instrument cluster interface with the second appearance does not have any instrument cluster elements that are not part of the vehicle instrument cluster interface with the first appearance (e.g., such as...). Figure 12C (As shown). Providing information that defines the corresponding appearance of the vehicle's instrument cluster so that the first and second appearances have the same set of instrument cluster elements enables the computer system to provide feedback to the user about the vehicle using the same instrument cluster elements, thereby providing improved visual feedback.
[0352] In some implementations, the corresponding instrument cluster elements of the first appearance are visually identical to the corresponding instrument cluster elements of the second appearance.
[0353] In some implementations, the vehicle instrument cluster interface having a first appearance includes a first instrument cluster element having a first size (e.g., Figure 12A The 636D in the text, and the vehicle instrument cluster interface with a second appearance includes first instrument cluster elements with a second size different from the first size (e.g., Figure 12B (referring to 636D). In some embodiments, the vehicle instrument cluster interface with a second appearance does not include the first instrument cluster elements having a first size. Providing information defining the corresponding appearance of the vehicle instrument cluster such that the first and second appearances include the same instrument cluster elements with different sizes enables the computer system to provide feedback to the user about the status of the vehicle and / or the computer system, and specifically about the selected appearance of the vehicle instrument cluster interface, thereby providing improved visual feedback.
[0354] In some implementations, a vehicle instrument cluster interface with a first appearance includes a plurality of instrument cluster elements of various sizes, and a vehicle instrument cluster interface with a second appearance includes the same plurality of instrument cluster elements of various sizes, wherein corresponding instrument cluster elements of the first and second appearances have different sizes. For example, the size of an instrument cluster element (e.g., a tachometer) in the vehicle instrument cluster interface with the first appearance is different from the size of the same instrument cluster element (e.g., a tachometer) in the vehicle instrument cluster interface with the second appearance. Similarly, the size of another instrument cluster element (e.g., a speedometer) in the vehicle instrument cluster interface with the first appearance is different from the size of the same instrument cluster element (e.g., a speedometer) in the vehicle instrument cluster interface with the second appearance.
[0355] In some implementations, the size of one or more instrument cluster elements changes (increases and / or decreases) based on whether the vehicle instrument cluster interface is subject to a first set of constraints or a second set of constraints. For example, when the vehicle instrument cluster interface is subject to a first set of constraints, the instrument cluster elements are displayed at a specific size, while when the vehicle instrument cluster interface is changed to be subject to a second set of constraints, the size of the instrument cluster elements changes (e.g., becomes larger or smaller). In some implementations, the only difference between the first appearance and the second appearance is the change in size of one or more instrument cluster elements.
[0356] In some implementations, the vehicle instrument cluster interface having a first appearance is included in a first location within the vehicle instrument cluster interface (e.g., Figure 12A The first instrument cluster element at position 636D in the diagram, and the vehicle instrument cluster interface with a second appearance includes a second position in the vehicle instrument cluster interface that is different from the first position (e.g., ...). Figure 12B The first instrument cluster element is located at 636D). In some embodiments, the vehicle instrument cluster interface with a second appearance does not include the first instrument cluster element at the first location. Information defining the corresponding appearance of the vehicle instrument cluster is provided so that the first appearance and the second appearance have the same instrument cluster elements at different locations, enabling the computer system to provide feedback to the user about the status of the vehicle and / or the computer system, and specifically about the selected appearance of the vehicle instrument cluster interface, thereby providing improved visual feedback.
[0357] In some implementations, a vehicle instrument cluster interface with a first appearance includes multiple instrument cluster elements located in various positions within the interface, and a vehicle instrument cluster interface with a second appearance includes the same multiple instrument cluster elements located in various positions within the interface, wherein corresponding instrument cluster elements of the first and second appearances have different positions within their respective interfaces. For example, an instrument cluster element (e.g., a tachometer) of the vehicle instrument cluster interface with the first appearance may be located in a different position than the same instrument cluster element (e.g., a tachometer) of the vehicle instrument cluster interface with the second appearance. Similarly, another instrument cluster element (e.g., a speedometer) of the vehicle instrument cluster interface with the first appearance may be located in a different position than the same instrument cluster element (e.g., a speedometer) of the vehicle instrument cluster interface with the second appearance.
[0358] In some implementations, the position of one or more instrument cluster elements changes based on whether the vehicle instrument cluster interface is subject to a first set of constraints or a second set of constraints. For example, when the vehicle instrument cluster interface is subject to the first set of constraints, the instrument cluster elements are displayed at a specific location, while when the vehicle instrument cluster interface is changed to be subject to the second set of constraints, the instrument cluster elements move to different locations (e.g., some or all instrument cluster elements move to different locations). In some implementations, the only difference between the first appearance and the second appearance is the change in the position of one or more instrument cluster elements.
[0359] In some embodiments, a vehicle instrument cluster interface with a first appearance includes first instrument cluster elements having a first aspect ratio (e.g., a rectangle having a first aspect ratio), and a vehicle instrument cluster interface with a second appearance includes first instrument cluster elements having a second aspect ratio different from the first aspect ratio (e.g., a rectangle having a second aspect ratio different from the first aspect ratio). In some embodiments, a vehicle instrument cluster interface with a second appearance does not include first instrument cluster elements having a first aspect ratio. Providing information defining the corresponding appearances of the vehicle instrument clusters such that the first and second appearances include the same instrument cluster elements with different aspect ratios enables the computer system to provide feedback to the user regarding the status of the vehicle and / or the computer system, and specifically regarding the selected appearance of the vehicle instrument cluster interface, thereby providing improved visual feedback.
[0360] In some implementations, a vehicle instrument cluster interface with a first appearance includes multiple instrument cluster elements with various aspect ratios, and a vehicle instrument cluster interface with a second appearance includes the same multiple instrument cluster elements with various aspect ratios, wherein corresponding instrument cluster elements of the first and second appearances have different aspect ratios. For example, an instrument cluster element (e.g., a tachometer) of the vehicle instrument cluster interface with the first appearance has a different aspect ratio than the same instrument cluster element (e.g., a tachometer) of the vehicle instrument cluster interface with the second appearance. Similarly, another instrument cluster element (e.g., a speedometer) of the vehicle instrument cluster interface with the first appearance has a different aspect ratio than the same instrument cluster element (e.g., a speedometer) of the vehicle instrument cluster interface with the second appearance.
[0361] In some implementations, the aspect ratio of one or more instrument cluster elements changes based on whether the vehicle instrument cluster interface is subject to a first set of constraints or a second set of constraints. For example, when the vehicle instrument cluster interface is subject to the first set of constraints, one or more instrument cluster elements are displayed with a specific aspect ratio, while when the vehicle instrument cluster interface is subject to the second set of constraints, one or more instrument cluster elements change to a different aspect ratio. In some implementations, the only difference between the first appearance and the second appearance is the change in the aspect ratio of one or more instrument cluster elements.
[0362] It should be noted that the above description is relative to the process described in method 1300 (e.g., Figure 13 The details of the above-described methods also apply in a similar manner. For example, methods 700, 900, and 1100 optionally include one or more features of the various methods described above with reference to method 1300. For example, the instrument group (e.g., 630) is the same as the instrument group (e.g., 630) of other methods. Similarly, the speedometer (e.g., 640) is the same speedometer of other methods.
[0363] Figure 14 This is a flowchart illustrating a method for displaying content using a computer system according to some embodiments. Method 700 is performed at a computer system (e.g., 100, 300, 500, 630, and / or 650) (e.g., a vehicle's computer system (e.g., infotainment system; instrument panel system), vehicle-separated accessories, and / or a smartphone), which communicates with display generating components (e.g., displays of 630 or 650) (e.g., display portion of a touchscreen, integrated display; external display; display monitor; display adapter) (e.g., display generating components of a vehicle, a display disposed in the vehicle's front console, and / or a display positioned in front of / in front of the driver's seat), touch-sensitive surfaces (e.g., touch-sensitive displays of 630 or 650) (e.g., touch-sensitive portions of a touchscreen), and external devices (e.g., 600A, e.g., a telephone and / or table wirelessly and / or wiredly connected to the computer system). Some operations in method 1400 are optionally combined, some operations are optionally changed in order, and some operations are optionally omitted.
[0364] The computer system receives first content (e.g., 600A) for display from an external device (e.g., 600A). Figure 8A 630A or Figure 8B (e.g., the rendered video feed and / or the video feed rendered at an external device for display via the display generation component of the computer system).
[0365] The computer system generates, at the computer system, a second content for display that is different from the first content (e.g., 630B-630F, and / or the displayed portion of 630 other than 630A; or 650B-650F, and / or the displayed portion of 650 other than 650A (e.g., a second rendered video feed).
[0366] The computer system concurrently displays (e.g., as part of a vehicle instrument cluster) a user interface via a display generation component, the user interface including: first content in a first area of the user interface (e.g., a first area of a display or a first area of a touch-sensitive display); and second content in a second area of the user interface different from the first area (e.g., a second area of a display or a second area of a touch-sensitive display).
[0367] While concurrently displaying first content in a first area of the user interface and second content in a second area of the user interface, the computer system receives input via a touch-sensitive surface (e.g., tap input, swipe input, and / or press and hold input).
[0368] In response to receiving input, based on determining that the input was received at a location corresponding to a first area (e.g., at a touchscreen on the first area), the computer system transmits one or more characteristics of the input (e.g., type of input, location of input, path of input, and / or duration of input) to an external device (e.g., 600A).
[0369] In response to receiving input, and based on the determination that the input was not received at a location corresponding to the first region (e.g., received at a second region), the computer system abandons the transmission of one or more features of the input (e.g., any feature) to an external device.
[0370] According to some implementations, one or more features of the input include an indication of the input's position relative to the first region (e.g., a start position (e.g., a downward touch position), an end position (e.g., a lift-off position), and / or a path of travel).
[0371] According to some implementations, one or more features of the input include an indication of the duration of the input relative to the first region (e.g., the length of time in seconds and / or the length of time in milliseconds).
[0372] According to some implementations, one or more features of the input are transmitted to an external device while input continues to be received (e.g., before the input has ended and / or before the input is lifted).
[0373] According to some implementations, the first content (e.g., updates to visual content received from an external device) continues to be displayed while input continues to be received (e.g., before input has ended and / or before input is lifted).
[0374] According to some implementations, in response to receiving input, and based on determining that the input was not received at a location corresponding to a first area (e.g., received at a second area), the computer system performs (e.g., at the computer system) operations (e.g., updating the display, changing the user interface, and / or changing the settings of the vehicle on which the computer system is installed) based on the location (and / or type and / or duration) of the input.
[0375] As described below, method 1400 provides an intuitive way to display content. This method reduces the cognitive burden on users when viewing content, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling users to view content faster and more efficiently saves power and increases the time between battery charging sessions.
[0376] Figure 15This is a flowchart illustrating a method for conditionally displaying a user interface using a computer system according to some embodiments. Method 1500 is executed at a computer system (e.g., 100, 300, 500, 600A, 600B, 600C, and / or a vehicle's computer system) that communicates with display generation components (e.g., 600B, 600C, a vehicle's display generation component, a display disposed in the vehicle's front console, and / or a display positioned in front of / in front of the driver's seat). Some operations in method 1500 may optionally be combined, some operations may optionally be changed in order, and some operations may optionally be omitted.
[0377] As described below, method 1500 provides an intuitive way to conditionally display a user interface using a computer system. This method reduces the cognitive burden on the user when displaying a conditional user interface using a computer system. For battery-powered computing devices, enabling faster and more efficient display of the conditional user interface saves power and increases the time between battery charging cycles.
[0378] When the display generating component (e.g., 600B) is inactive (e.g., power failure and / or currently not displaying content), the computer system (e.g., a computer system integrated into a car / vehicle having dashboard 602) detects (1502) the proximity of a display initiation event (e.g., engine / motor ignition and / or ignition input; a first type of electronic device (e.g., a key fob; a device with a digital key for accessing one or more restricted functions of the computer system); the opening and / or unlocking of a door (e.g., a car door) associated with the computer system; or the detection of the presence of a user (e.g., a user sitting in the driver's seat of the car).
[0379] In response to the detection of a display initiation event, the computer system will change the display generation component (1503) to an active state.
[0380] In response to detecting a display initiation event (1503) and based on determining that a first set of display content criteria is met (in some embodiments, the first set of display content criteria includes criteria that are met when a second set of display content criteria is not met), the computer system displays (1504) a first user interface including the first content (e.g., reference 1504) via a display generation component. Figure 6A Another user interface for discussion).
[0381] In response to the detection of a display initiation event (1503) and based on the determination that a second set of display content criteria is met, a second user interface (e.g., 604) including second content transmitted from a first external device (e.g., 600A) (e.g., a mobile computer (e.g., a smartphone, tablet, smartwatch, or laptop)) is displayed (1506) via a display generation component. The second set of display content criteria includes (1508) criteria satisfied when the computer system communicates with the first external device (in some embodiments, the second set of display content criteria includes criteria satisfied when the first set of display content criteria is not satisfied), and the second user interface is displayed (1510) when the first user interface has not been previously displayed since the transition from an inactive state to an active state (in some embodiments, the first content has not been previously displayed). Conditionally displaying the first or second content based on whether the first or second set of display content criteria is met allows the computer system to display specific content under appropriate conditions, performing an operation without further user input once a set of conditions has been met.
[0382] In some implementations, the computer system is integrated into the vehicle (e.g., a car / vehicle with a dashboard 602) (e.g., a car; a truck; a motorcycle; a boat).
[0383] In some implementations, the first content is generated by a computer system (e.g., rendered and / or acquired) (e.g., the first user interface and the first local content generated by the computer system).
[0384] In some implementations, the second set of display content criteria includes criteria that are met when the first external device (e.g., 600A) was previously (e.g., in a preceding operating session of the computer system, e.g., a previous driving session) connected to the computer system and previously (e.g., in a preceding operating session of the computer system, e.g., a previous driving session) transmitted third content displayed via the display generation component. Displaying the second content based at least in part on whether the first external device was previously connected to the computer system and previously transmitted content enables the system to display additional content from the first external device when the system has previously been used to display additional content from the first external device, performing the operation without further user input once a set of conditions has been met.
[0385] In some implementations, the computer system communicates with one or more input devices (e.g., a touch-sensitive surface of the display 600B) (e.g., a touch-sensitive surface, a keyboard, hardware buttons, and / or hardware knobs). When the display generation component is active, input (e.g., a touch on the display 600B) is received via one or more input devices. In response to receiving input and determining that the input corresponds to a first piece of content (e.g., a reference), the system... Figure 6B The content associated with another user interface discussed performs a first function at the computer system (e.g., modifying one or more settings of the computer system (e.g., climate control settings, lighting settings); adjusting media playback or navigation operations being performed by the computer system). In response to receiving input and determining that the input corresponds to second content (e.g., content of user interface 604), the first external device (e.g., 600A) is caused to perform a second function different from the first function (e.g., modifying media playback or navigation operations being performed by the first external device) (in some embodiments, the first function is not performed). Performing the first function at the computer system or causing the second function to be performed at the external device in response to input enables the computer to route input to the appropriate system / device without requiring the user to identify the target device via additional input, which performs operations without further user input once a set of conditions are met.
[0386] It should be noted that the above is relative to method 1500 (e.g., Figure 15 The details of the process described above also apply in a similar manner to the methods described above. For example, methods 700, 900, and 1100 may optionally be performed using the conditionally displayed user interface described above with reference to method 1500. For example, an instrument group (e.g., 630) is displayed in the conditionally displayed user interface (e.g., 604) of method 1500.
[0387] For purposes of explanation, the foregoing description has been given by reference to specific embodiments. However, the illustrative discussion above is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible based on the teachings above. These embodiments were chosen and described in order to best explain the principles of these techniques and their practical applications. Others skilled in the art will thus be able to best utilize these techniques and the various embodiments with various modifications suitable for the particular intended use.
[0388] While this disclosure and examples have been fully described with reference to the accompanying drawings, it should be noted that various changes and modifications will become apparent to those skilled in the art. It should be understood that such changes and modifications are considered to be included within the scope of this disclosure and examples as defined by the claims.
[0389] As described above, one aspect of the present invention is the collection and use of data available from various sources to improve the presentation of electronic instrument clusters. This disclosure contemplates that, in some instances, this collected data may include personal information that uniquely identifies or can be used to contact or locate specific individuals. Such personal information may include demographic data, location-based data, telephone numbers, email addresses, Twitter IDs, home addresses, or any other identifying or personal information.
[0390] This disclosure recognizes that the use of such personal information data in the present invention can benefit users. For example, personal information data can be used to present users with customized dashboards that are more useful to them. Therefore, the use of such personal information data enables users to have planned control over the presented content. Furthermore, this disclosure also anticipates other uses of personal information data that are beneficial to users.
[0391] This disclosure assumes that entities responsible for collecting, analyzing, disclosing, transmitting, storing, or otherwise using such personal information data will comply with established privacy policies and / or privacy practices. Specifically, such entities should implement and adhere to privacy policies and practices that are generally recognized as meeting or exceeding industry or governmental requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and should be updated as data collection and / or use change. Personal information from users should be collected for the entity's lawful and reasonable purposes and not shared or sold outside of these lawful uses. Furthermore, such collection / sharing should be conducted only after obtaining informed consent from users. Additionally, such entities should consider taking any necessary steps to protect and safeguard access to such personal information data and ensure that others with access to such personal information data comply with their privacy policies and processes. Furthermore, such entities may be subject to third-party evaluations to demonstrate their compliance with widely accepted privacy policies and practices. Additionally, policies and practices should be adapted to the specific types of personal information data collected and / or accessed, and to applicable laws and standards, including specific considerations regarding jurisdiction. For example, in the United States, the collection or acquisition of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA); while in other countries, health data may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy practices should be maintained for different types of personal data in each country.
[0392] Regardless of the foregoing, this disclosure also contemplates implementation schemes for users to selectively block the use or access to personal information data. That is, this disclosure contemplates providing hardware and / or software components to prevent or block access to such personal information data. For example, with regard to a display instrument cluster, the inventive technology can be configured to allow a user to opt-in or opt-out at any time during or after registration for the service to participate in the collection of personal information data. As another example, a user may choose not to be provided with a user-specific instrument cluster. Yet another example is that a user may choose not to have the instrument cluster adjusted to suit user and / or vehicle parameters. In addition to providing "opt-in" and "opt-out" options, this disclosure also envisions providing notifications related to access to or use of personal information. For example, a user may be notified when downloading an application that their personal information data will be accessed, and then reminded again just before the application accesses the personal information data.
[0393] Furthermore, the purpose of this disclosure is to manage and process personal information data to minimize the risk of unintentional or unauthorized access or use. Once data is no longer needed, this risk can be minimized by limiting data collection and deleting data. Additionally, and where applicable, including in certain health-related applications, data deidentification can be used to protect user privacy. Deidentification can be facilitated, where appropriate, by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than the address level), controlling how data is stored (e.g., aggregating data among users), and / or other methods.
[0394] Therefore, while this disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, it is also contemplated that various embodiments can be implemented without access to such personal information data. That is, various embodiments of the present invention will not be rendered inoperable due to the absence of all or part of such personal information data. For example, preferences can be inferred from non-personal information data or an absolute minimum amount of personal information, other non-personal information available to the system, or publicly available information to infer user preferences.
Claims
1. A method comprising: At the computer system communicating with the display generation component: The speedometer, indicating the current vehicle speed, is displayed via the display generation component. in: Based on the determination that the current speed limit is a first speed and the current vehicle speed is a second speed higher than the first speed, the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed has a first appearance; Based on the determination that the current speed limit is a third speed higher than the first speed and the current vehicle speed is a second speed not higher than the third speed, the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed has a second appearance different from the first appearance; When selecting a first speedometer appearance, the first appearance has a first visual quality; and when selecting a second speedometer appearance, the first appearance has a second visual quality different from the first visual quality; and When the first speedometer appearance is selected, the second appearance has a third visual quality, and when the second speedometer appearance is selected, the second appearance has a fourth visual quality different from the third visual quality.
2. The method according to claim 1, further comprising: While displaying the speed indicator indicating the current vehicle speed via the display generation component, a speed limit change to a fourth speed between the first speed and the second speed is detected; as well as In response to detecting a speed limit change to the fourth speed, the appearance of the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed is changed via the display generation component to a third appearance different from the first appearance and the second appearance.
3. The method according to any one of claims 1 to 2, further comprising: While displaying the speed indicating the second speed as the current vehicle speed via the display generation component, a change from the current vehicle speed to a fifth speed lower than the second speed is detected; as well as In response to detecting the change from the current vehicle speed to the fifth speed, the appearance of the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed is changed via the display generating component to a fourth appearance different from the first appearance and the second appearance.
4. The method according to any one of claims 1 to 2, wherein: The speedometer, which displays an indication of the current vehicle speed via the display generation component, includes: Based on the determination that the current speed limit is the first speed and the current vehicle speed is a second speed higher than the first speed, the portion of the speedometer between the position on the speedometer corresponding to the second speed and the position on the speedometer corresponding to the sixth speed has a fifth appearance; and Based on the determination that the current speed limit is a third speed higher than the first speed and the current vehicle speed is a second speed not higher than the third speed, the portion of the speedometer between the position on the speedometer corresponding to the second speed and the position on the speedometer corresponding to the sixth speed has the fifth appearance.
5. The method according to any one of claims 1 to 2, wherein the first appearance has a first color, and the second appearance has a second color different from the first color.
6. The method according to any one of claims 1 to 2, wherein the speedometer includes a plurality of numerical indicators of a plurality of speeds, and wherein a corresponding numerical indicator of the plurality of numerical indicators corresponding to the current speed limit has an appearance different from that of the other numerical indicators of the plurality of numerical indicators.
7. The method according to claim 6, further comprising: While displaying the speed indicator indicating the current vehicle speed via the display generation component, a change in the speed limit from the first speed to the third speed is detected; as well as In response to detecting a change in the speed limit from the first speed to the third speed, the appearance of the numerical indicator corresponding to the first speed is changed via the display generation component.
8. The method according to any one of claims 1 to 2, further comprising: Multiple instrument cluster elements are displayed concurrently via the display generation component and the speedometer indicating the current vehicle speed.
9. The method according to any one of claims 1 to 2, wherein the speedometer is based at least in part on information provided to the display generating component from an accessory device separate from the computer system, wherein the information provided to the display generating component defines the appearance of the speedometer for display.
10. The method according to any one of claims 1 to 2, further comprising: A speed indicator, indicating the current vehicle speed, is displayed concurrently with the speedometer via the display generation component.
11. A computer system, comprising: Display generated components; as well as Apparatus for performing the method according to any one of claims 1 to 2.
12. A computer program product comprising one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs comprising instructions for performing the method according to any one of claims 1 to 2.
13. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a computer system in communication with a display generation component, the one or more programs including instructions for: The speedometer indicating the current vehicle speed is displayed via the display generation component, wherein: Based on the determination that the current speed limit is a first speed and the current vehicle speed is a second speed higher than the first speed, the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed has a first appearance; Based on the determination that the current speed limit is a third speed higher than the first speed and the current vehicle speed is a second speed not higher than the third speed, the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed has a second appearance different from the first appearance; When selecting a first speedometer appearance, the first appearance has a first visual quality, and when selecting a second speedometer appearance, the first appearance has a second visual quality that is different from the first visual quality. as well as When the first speedometer appearance is selected, the second appearance has a third visual quality, and when the second speedometer appearance is selected, the second appearance has a fourth visual quality different from the third visual quality.
14. The computer-readable storage medium of claim 13, wherein the one or more programs further include instructions for performing the following operations: While displaying the speed indicator indicating the current vehicle speed via the display generation component, a speed limit change to a fourth speed between the first speed and the second speed is detected; and In response to detecting a speed limit change to the fourth speed, the appearance of the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed is changed via the display generation component to a third appearance different from the first appearance and the second appearance.
15. The computer-readable storage medium according to any one of claims 13 to 14, wherein the one or more programs further include instructions for performing the following operations: While displaying a speed indicating the second speed as the current vehicle speed via the display generation component, a change from the current vehicle speed to a fifth speed lower than the second speed is detected; and In response to detecting the change from the current vehicle speed to the fifth speed, the appearance of the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed is changed via the display generating component to a fourth appearance different from the first appearance and the second appearance.
16. The computer-readable storage medium according to any one of claims 13 to 14, wherein: The speedometer, which displays an indication of the current vehicle speed via the display generation component, includes: Based on the determination that the current speed limit is the first speed and the current vehicle speed is a second speed higher than the first speed, the portion of the speedometer between the position on the speedometer corresponding to the second speed and the position on the speedometer corresponding to the sixth speed has a fifth appearance; and Based on the determination that the current speed limit is a third speed higher than the first speed and the current vehicle speed is a second speed not higher than the third speed, the portion of the speedometer between the position on the speedometer corresponding to the second speed and the position on the speedometer corresponding to the sixth speed has the fifth appearance.
17. The computer-readable storage medium according to any one of claims 13 to 14, wherein the first appearance has a first color, and the second appearance has a second color different from the first color.
18. The computer-readable storage medium of any one of claims 13 to 14, wherein the speedometer includes a plurality of numerical indicators of a plurality of speeds, and wherein a corresponding numerical indicator of the plurality of numerical indicators corresponding to the current speed limit has an appearance different from that of the other numerical indicators of the plurality of numerical indicators.
19. The computer-readable storage medium of claim 18, wherein the one or more programs further include instructions for: While displaying a speed timer indicating the current vehicle speed via the display generation component, a change in the speed limit from the first speed to the third speed is detected; and In response to detecting a change in the speed limit from the first speed to the third speed, the appearance of the numerical indicator corresponding to the first speed is changed via the display generation component.
20. The computer-readable storage medium according to any one of claims 13 to 14, wherein the one or more programs further include instructions for: Multiple instrument cluster elements are displayed concurrently via the display generation component and the speedometer indicating the current vehicle speed.
21. The computer-readable storage medium according to any one of claims 13 to 14, wherein the velocities are based at least in part on information provided to the display generating component from an accessory device separate from the computer system, wherein the information provided to the display generating component defines the appearance of the velocities for display.
22. The computer-readable storage medium according to any one of claims 13 to 14, wherein the one or more programs further include instructions for performing the following operations: A speed indicator, indicating the current vehicle speed, is displayed concurrently with the speedometer via the display generation component.
23. A computer system, comprising: Display generated components; One or more processors; as well as The memory stores one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for performing the following operations: The speedometer, indicating the current vehicle speed, is displayed via the display generation component. in: Based on the determination that the current speed limit is a first speed and the current vehicle speed is a second speed higher than the first speed, the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed has a first appearance; Based on the determination that the current speed limit is a third speed higher than the first speed and the current vehicle speed is a second speed not higher than the third speed, the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed has a second appearance different from the first appearance; When selecting a first speedometer appearance, the first appearance has a first visual quality; and when selecting a second speedometer appearance, the first appearance has a second visual quality different from the first visual quality; and When the first speedometer appearance is selected, the second appearance has a third visual quality, and when the second speedometer appearance is selected, the second appearance has a fourth visual quality different from the third visual quality.
24. The computer system of claim 23, wherein the one or more programs further include instructions for performing the following operations: While displaying the speed indicator indicating the current vehicle speed via the display generation component, a speed limit change to a fourth speed between the first speed and the second speed is detected; and In response to detecting a speed limit change to the fourth speed, the appearance of the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed is changed via the display generation component to a third appearance different from the first appearance and the second appearance.
25. The computer system according to any one of claims 23 to 24, wherein the one or more programs further include instructions for performing the following operations: While displaying a speed indicating the second speed as the current vehicle speed via the display generation component, a change from the current vehicle speed to a fifth speed lower than the second speed is detected; and In response to detecting the change from the current vehicle speed to the fifth speed, the appearance of the portion of the speedometer between the position on the speedometer corresponding to the first speed and the position on the speedometer corresponding to the second speed is changed via the display generating component to a fourth appearance different from the first appearance and the second appearance.
26. The computer system according to any one of claims 23 to 24, wherein: The speedometer, which displays an indication of the current vehicle speed via the display generation component, includes: Based on the determination that the current speed limit is the first speed and the current vehicle speed is a second speed higher than the first speed, the portion of the speedometer between the position on the speedometer corresponding to the second speed and the position on the speedometer corresponding to the sixth speed has a fifth appearance; and Based on the determination that the current speed limit is a third speed higher than the first speed and the current vehicle speed is a second speed not higher than the third speed, the portion of the speedometer between the position on the speedometer corresponding to the second speed and the position on the speedometer corresponding to the sixth speed has the fifth appearance.
27. The computer system according to any one of claims 23 to 24, wherein the first appearance has a first color, and the second appearance has a second color different from the first color.
28. The computer system according to any one of claims 23 to 24, wherein the speedometer includes a plurality of numerical indicators of a plurality of speeds, and wherein a corresponding numerical indicator of the plurality of numerical indicators corresponding to the current speed limit has an appearance different from that of the other numerical indicators of the plurality of numerical indicators.
29. The computer system of claim 28, wherein the one or more programs further include instructions for performing the following operations: While displaying a speed timer indicating the current vehicle speed via the display generation component, a change in the speed limit from the first speed to the third speed is detected; and In response to detecting a change in the speed limit from the first speed to the third speed, the appearance of the numerical indicator corresponding to the first speed is changed via the display generation component.
30. The computer system according to any one of claims 23 to 24, wherein the one or more programs further include instructions for performing the following operations: Multiple instrument cluster elements are displayed concurrently via the display generation component and the speedometer indicating the current vehicle speed.
31. The computer system according to any one of claims 23 to 24, wherein the speedometer is based at least in part on information provided to the display generating component from an accessory device separate from the computer system, wherein the information provided to the display generating component defines the appearance of the speedometer for display.
32. The computer system according to any one of claims 23 to 24, wherein the one or more programs further include instructions for performing the following operations: A speed indicator, indicating the current vehicle speed, is displayed concurrently with the speedometer via the display generation component.
Citation Information
Patent Citations
Method and apparatus for integrating manual input
US20020015024A1
Acceleration-based theft detection system for portable electronic devices
US20050190059A1
Methods and apparatuses for operating a portable device based on an accelerometer
US20060017692A1
Gestures for touch sensitive input devices
US20060026521A1
Gestures for touch sensitive input devices
US20060026536A1