User interface for health monitoring
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- APPLE INC
- Filing Date
- 2026-02-12
- Publication Date
- 2026-06-23
AI Technical Summary
Existing health monitoring technologies using electronic devices are cumbersome and inefficient, often requiring complex user interfaces that consume time and device energy, particularly in battery-powered devices.
Implementing faster and more efficient methods and interfaces for health monitoring, including tutorials and user interfaces that reduce cognitive burden, conserve power, and enhance user interaction with electronic devices.
Enhances user satisfaction and efficiency in health monitoring by reducing time and energy consumption, motivating frequent health monitoring and improving user awareness of health status.
Smart Images

Figure 2026102552000001_ABST
Abstract
Description
Cross - reference to related applications
[0001] This application claims priority to U.S. Provisional Patent Application No. 62 / 641,994, titled "USER INTERFACES FOR HEALTH MONITORING", filed on March 12, 2018; U.S. Provisional Patent Application No. 62 / 643,699, titled "USER INTERFACES FOR HEALTH MONITORING", filed on March 15, 2018; U.S. Provisional Patent Application No. 62 / 657,870, titled "USER INTERFACES FOR HEALTH MONITORING", filed on April 15, 2018; U.S. Provisional Patent Application No. 62 / 657,881, titled "USER INTERFACES FOR HEALTH MONITORING", filed on April 15, 2018; U.S. Patent Application No. 16 / 143,909, titled "USER INTERFACES FOR HEALTH MONITORING", filed on September 27, 2018; U.S. Patent Application No. 16 / 143,959, titled "USER INTERFACES FOR HEALTH MONITORING", filed on September 27, 2018; U.S. Patent Application No. 16 / 143,997, titled "USER INTERFACES FOR HEALTH MONITORING", filed on September 27, 2018; U.S. Patent Application No. 16 / 144,030, titled "USER INTERFACES FOR HEALTH MONITORING", filed on September 27, 2018; Danish Patent Application No. PA201870599, filed on September 15, 2018; Danish Patent Application No. PA201870600, filed on September 15, 2018; Danish Patent Application No. PA201870601, filed on September 15, 2018; and Danish Patent Application No. PA201870602, filed on September 15, 2018, and the entire contents of these documents are hereby incorporated by reference into this specification for all appropriate purposes.
[0002] This application relates to U.S. Provisional Patent Application No. 62 / 554,196, filed September 5, 2017, entitled "WEARABLE DEVICE WITH ELECTRODES FOR SENSING BIOLOGICAL PARAMETERS," the contents of which are incorporated herein by reference in their entirety and included herein as Annex A. [Technical Field]
[0003] This disclosure relates, in general terms, to computer user interfaces, and more specifically, to technologies for managing health monitoring. [Background technology]
[0004] Using electronic devices to monitor health, including cardiac health, using heart rhythm and heart rate information is a convenient and effective way to provide and maintain awareness of a person's health. Electronic devices enable users to quickly and easily capture biometric information used to monitor their own health. [Overview of the project]
[0005] However, some technologies for managing health monitoring using electronic devices are generally cumbersome and inefficient. For example, some existing technologies use complex and time-consuming user interfaces that may involve multiple key presses or keystrokes. Existing technologies take more time than necessary, wasting both user time and device energy. The latter problem is particularly serious in battery-powered devices.
[0006] Therefore, this technology provides electronic devices with faster and more efficient methods and interfaces for managing health monitoring. Such methods and interfaces optionally complement or replace other methods for managing health monitoring. Such methods and interfaces reduce the cognitive burden on the user and create a more efficient human-machine interface. In the case of battery-operated computing devices, such methods and interfaces conserve power and extend the interval between battery charging. Such methods and interfaces enable users to quickly and easily capture health information (therefore also motivating users to monitor their health more frequently) and to conveniently view and manage recorded health information (therefore increasing the user's awareness of their current health status).
[0007] According to some embodiments, a method is described for being performed on a first electronic device having a display and one or more input devices, which is paired with a second electronic device. The method includes: displaying a first part of a tutorial for using the functions of the second electronic device on the display; detecting a request to advance the tutorial via one or more input devices; in response to detecting a request to advance the tutorial, displaying on the display an instruction to perform an operation on the second electronic device involving the functions of the second electronic device; receiving an indication from the second electronic device that the instruction has been executed; and in response to receiving the indication that the instruction has been executed, displaying on the display a second part of the tutorial different from the first part.
[0008] According to some embodiments, a non-temporary computer-readable storage medium is described. A non-temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices, wherein the first electronic device is paired with a second electronic device, and the one or more programs include instructions to display on the display a first part of a tutorial for using the functions of the second electronic device, to detect a request to advance the tutorial via one or more input devices, to display on the display an instruction to perform an operation on the second electronic device with the functions of the second electronic device in response to the detection of a request to advance the tutorial, to receive an indication from the second electronic device that the instruction has been executed, and to display on the display a second part of the tutorial different from the first part in response to the receipt of the indication that the instruction has been executed.
[0009] According to some embodiments, a temporary computer-readable storage medium is described. A temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices, wherein the first electronic device is paired with a second electronic device, and the one or more programs include instructions to display on the display a first part of a tutorial for using the functions of the second electronic device, to detect a request to advance the tutorial via one or more input devices, to display on the display an instruction to perform an operation on the second electronic device with the functions of the second electronic device in response to the detection of a request to advance the tutorial, to receive an indication from the second electronic device that the instruction has been executed, and to display on the display a second part of the tutorial different from the first part in response to the receipt of the indication that the instruction has been executed.
[0010] According to several embodiments, a first electronic device is described. The first electronic device, paired with a second electronic device, comprises a display, one or more input devices, one or more processors, and a memory for storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for displaying a first part of a tutorial for using the functions of the second electronic device on the display, detecting a request to advance the tutorial via one or more input devices, displaying instructions on the display for performing an operation on the second electronic device with the functions of the second electronic device in response to detecting a request to advance the tutorial, receiving an indication from the second electronic device that the instructions have been executed, and displaying a second part of the tutorial on the display, different from the first part, in response to receiving the indication that the instructions have been executed.
[0011] A first electronic device is described according to several embodiments. The first electronic device, paired with a second electronic device, includes a display, one or more input devices, means for displaying a first part of a tutorial for using the functions of the second electronic device on the display, means for detecting a request to advance the tutorial via one or more input devices, means for displaying an instruction on the display for performing an operation on the second electronic device with the functions of the second electronic device in response to detecting a request to advance the tutorial, means for receiving an indication from the second electronic device that the instruction has been executed, and means for displaying a second part of the tutorial on the display, different from the first part, in response to receiving the indication that the instruction has been executed.
[0012] According to some embodiments, a method is described for being performed in a first electronic device having a display and one or more input devices including a biosensor. The method includes: displaying a first user interface on the display indicating that the first electronic device is ready to detect biological information; detecting a first input from a biosensor that satisfies a first criterion; in response to the detection of the first input from the biosensor, initiating the recording of biological information detected by the biosensor; displaying a second user interface on the display that is different from the first user interface, wherein the second user interface includes an indication of the progress of recording of biological information; detecting, after recording at least a portion of the biological information, via one or more input devices that the first criterion is no longer met; in response to the detection that the first criterion is no longer met during a first period, resetting the indication of the progress of recording of biological information and maintaining the display of the second user interface; and in response to the detection that the first criterion is no longer met during a second period longer than the first period, replacing the display of the second user interface with the first user interface.
[0013] According to some embodiments, non-temporary computer-readable storage media are described. A non-temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices including a biosensor, wherein the one or more programs include instructions to display a first user interface on the display indicating that the first electronic device is ready to detect biological information, to detect a first input from a biosensor that satisfies a first criterion, to start recording the biological information detected by the biosensor in response to the detection of the first input from the biosensor, to display a second user interface on the display that is different from the first user interface and includes an indication of the progress of recording the biological information, to detect, after recording at least a portion of the biological information, via one or more input devices that the first criterion is no longer met, to reset the indication of the progress of recording the biological information in response to the detection that the first criterion is no longer met during a first period, to maintain the display of the second user interface, and to replace the display of the second user interface with the first user interface in response to the detection that the first criterion is no longer met during a second period longer than the first period.
[0014] According to some embodiments, a temporary computer-readable storage medium is described. A temporary computer-readable storage medium storing a display and one or more programs configured to be executed by one or more processors of a first electronic device having one or more input devices including a biosensor, wherein the one or more programs include instructions to display a first user interface on the display indicating that the first electronic device is ready to detect biological information, to detect a first input from a biosensor that satisfies a first criterion, to start recording the biological information detected by the biosensor in response to the detection of the first input from the biosensor, to display a second user interface on the display that is different from the first user interface and includes an indication of the progress of recording the biological information, to detect, after recording at least a portion of the biological information, via one or more input devices that the first criterion is no longer met, to reset the indication of the progress of recording the biological information in response to the detection that the first criterion is no longer met during a first period, to maintain the display of the second user interface, and to replace the display of the second user interface with the first user interface in response to the detection that the first criterion is no longer met during a second period longer than a first period.
[0015] A first electronic device is described according to several embodiments. The first electronic device comprises a display, one or more input devices including a biosensor, one or more processors, and a memory for storing one or more programs configured to be executed by the one or more processors, wherein one or more programs include instructions for displaying a first user interface on the display indicating that the first electronic device is ready to detect biological information, detecting a first input from a biosensor that satisfies a first criterion, in response to detecting a first input from a biosensor, initiating the recording of biological information detected by the biosensor, displaying a second user interface on the display that is different from the first user interface and includes an indication of the progress of recording of biological information, after recording at least a portion of the biological information, detecting via one or more input devices that the first criterion is no longer met, resetting the indication of the progress of recording of biological information in response to detecting that the first criterion is no longer met during a first period, maintaining the display of the second user interface, and replacing the display of the second user interface with the first user interface in response to detecting that the first criterion is no longer met during a second period longer than the first period.
[0016] A first electronic device is described according to several embodiments. The first electronic device includes a display, one or more input devices including a biosensor, means for displaying a first user interface on the display indicating that the first electronic device is ready to detect biological information, means for detecting a first input from a biosensor that satisfies a first criterion, means for initiating recording of biological information detected by the biosensor in response to the detection of the first input from the biosensor and displaying a second user interface on the display that includes an indication of the progress of recording of biological information, which is different from the first user interface, after recording at least a portion of the biological information, means for detecting via one or more input devices that the first criterion is no longer met, means for resetting the indication of the progress of recording of biological information and maintaining the display of the second user interface in response to the detection that the first criterion is no longer met during a first period, and means for replacing the display of the second user interface with the first user interface in response to the detection that the first criterion is no longer met during a second period longer than the first period.
[0017] According to some embodiments, a method is described for being performed in an electronic device having a display and one or more input devices, including a first input device having an integrated biosensor. The method includes: displaying a user interface for an application for capturing biometric information from a biosensor on the display; detecting a first activation of the first input device while displaying the user interface for an application for capturing biometric information from a biosensor; performing a default action associated with the first input device in response to the detection of the first activation of the first input device and while capturing biometric information from the biosensor, in accordance with the determination that the first activation of the first input device has been detected when a first criterion is met based on progress toward capturing biometric information with the biosensor; and continuing to capture biometric information without performing a default action associated with the first input device in accordance with the determination that the first activation of the first input device has been detected when the first criterion is not met.
[0018] According to some embodiments, a non-temporary computer-readable storage medium is described. A non-temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices including a first input device having an integrated biosensor, the one or more programs including instructions to display a user interface of an application for capturing biometric information from a biosensor on the display, to detect a first activation of the first input device while the user interface of the application for capturing biometric information from a biosensor is being displayed, and to perform a default operation associated with the first input device in response to the detection of the first activation of the first input device and while capturing biometric information from the biosensor, in accordance with the determination that the first activation of the first input device has been detected when a first criterion is met based on progress toward capturing biometric information with the biosensor, and to interrupt the capture of biometric information, and to continue capturing biometric information without performing a default operation associated with the first input device in accordance with the determination that the first activation of the first input device has been detected when the first criterion is not met.
[0019] According to some embodiments, a temporary computer-readable storage medium is described. A temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices including a first input device having an integrated biosensor, the one or more programs including instructions to display a user interface of an application for capturing biometric information from a biosensor on the display, to detect a first activation of the first input device while the user interface of the application for capturing biometric information from a biosensor is being displayed, and to perform a default operation associated with the first input device in response to the detection of the first activation of the first input device and while capturing biometric information from the biosensor, in accordance with the determination that the first activation of the first input device has been detected when a first criterion is met based on progress toward capturing biometric information with the biosensor, and to interrupt the capture of biometric information, and to continue capturing biometric information without performing a default operation associated with the first input device in accordance with the determination that the first activation of the first input device has been detected when the first criterion is not met.
[0020] According to several embodiments, a first electronic device is described. The first electronic device comprises a display, one or more input devices including a first input device having an integrated biosensor, one or more processors, and a memory for storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for displaying a user interface for an application for capturing biometric information from a biosensor on the display, detecting a first activation of the first input device while displaying the user interface for an application for capturing biometric information from a biosensor, and in response to the detection of the first activation of the first input device and while capturing biometric information from the biosensor, executing a default action associated with the first input device to interrupt the capture of biometric information when a first criterion is met based on progress toward capturing biometric information with the biosensor, and continuing to capture biometric information without executing a default action associated with the first input device when the first criterion is not met, according to the determination that the first activation of the first input device has been detected.
[0021] A first electronic device is described according to several embodiments. The first electronic device includes a display, one or more input devices including a first input device having an integrated biosensor, means for displaying a user interface for an application for capturing biometric information from a biosensor on the display, means for detecting a first activation of the first input device while displaying the user interface for an application for capturing biometric information from a biosensor, and means for performing a default action associated with the first input device in response to detecting a first activation of the first input device and while capturing biometric information from the biosensor, in accordance with the determination that a first activation of the first input device has been detected when a first criterion based on progress toward capturing biometric information with the biosensor is met, and continuing to capture biometric information without performing a default action associated with the first input device in accordance with the determination that a first activation of the first input device has been detected when the first criterion is not met.
[0022] According to some embodiments, a method is described that is performed in a first electronic device having a display and one or more input devices. The method includes capturing biometric information using a biosensor communicating with the first electronic device; displaying on the display a representation of an assessment of medical characteristics determined based on the biometric information captured by the biosensor; detecting a series of one or more inputs via one or more input devices while the representation of the assessment of medical characteristics is displayed and adding user-specified symptoms to the assessment of medical characteristics; in response to the detection of a series of one or more inputs, displaying on the display a first user interface that, when activated, includes affordances to initiate a process for seeking immediate treatment, in accordance with the determination that at least one of the user-specified symptoms meets a corresponding criterion; and displaying on the display, without displaying the first user interface, a representation of the assessment of medical characteristics and one or more representations of user-specified symptoms, in accordance with the determination that the user-specified symptoms do not meet a corresponding criterion.
[0023] According to some embodiments, a non-temporary computer-readable storage medium is described. A non-temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices, wherein the one or more programs include instructions to capture biological information using a biosensor communicating with the first electronic device, display on the display a representation of an evaluation of medical characteristics determined based on the biological information captured by the biosensor, while displaying the representation of the evaluation of medical characteristics, detect a series of one or more inputs via one or more input devices, add user-specified symptoms to the evaluation of medical characteristics, and, in response to the detection of a series of one or more inputs, display on the display a first user interface, which, when activated, includes affordances to initiate a process for seeking immediate treatment, in accordance with the determination that at least one of the user-specified symptoms meets a corresponding criterion, and, in accordance with the determination that the user-specified symptoms do not meet a corresponding criterion, display on the display, without displaying the first user interface, the representation of the evaluation of medical characteristics and one or more representations of the user-specified symptoms.
[0024] According to some embodiments, a temporary computer-readable storage medium is described. A temporary computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices, wherein the one or more programs include instructions to capture biological information using a biosensor communicating with the first electronic device, display on the display a representation of an evaluation of medical characteristics determined based on the biological information captured by the biosensor, while displaying the representation of the evaluation of medical characteristics, detect a series of one or more inputs via one or more input devices, add user-specified symptoms to the evaluation of medical characteristics, and, in response to the detection of a series of one or more inputs, display on the display a first user interface, which, when activated, includes affordances to initiate a process for seeking immediate treatment, in accordance with the determination that at least one of the user-specified symptoms meets a corresponding criterion, and, in accordance with the determination that the user-specified symptoms do not meet a corresponding criterion, display on the display, without displaying the first user interface, the representation of the evaluation of medical characteristics and one or more representations of the user-specified symptoms.
[0025] A first electronic device is described according to several embodiments. The first electronic device comprises a display, one or more input devices, one or more processors, and a memory for storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for capturing biometric information using a biosensor communicating with the first electronic device, displaying on the display a representation of an assessment of medical characteristics determined based on the biometric information captured by the biosensor, detecting a series of one or more inputs via one or more input devices while the representation of the assessment of medical characteristics is displayed, adding user-specified symptoms to the assessment of medical characteristics, and, in response to the detection of a series of one or more inputs, displaying on the display a first user interface, which, when activated, includes affordances to initiate a process for seeking immediate treatment, in accordance with the determination that at least one of the user-specified symptoms meets a corresponding criterion, and, in accordance with the determination that the user-specified symptoms do not meet a corresponding criterion, displaying on the display a representation of the assessment of medical characteristics and one or more representations of the user-specified symptoms without displaying the first user interface.
[0026] According to some embodiments, a first electronic device is described. The first electronic device includes a display, one or more input devices, means for capturing biometric information using a biometric sensor in communication with the first electronic device, means for displaying an expression of an evaluation of a medical characteristic determined based on the biometric information captured by the biometric sensor on the display, means for detecting a series of one or more inputs via the one or more input devices while the expression of the evaluation of the medical characteristic is being displayed, and means for adding user-specified symptoms to the evaluation of the medical characteristic, and in response to detecting the series of one or more inputs, according to a determination that at least one of the user-specified symptoms meets the corresponding criteria, displaying on the display a first user interface including an affordance that, when activated, initiates a process for seeking immediate treatment, and according to a determination that the user-specified symptoms do not meet the corresponding criteria, displaying on the display an expression of the evaluation of the medical characteristic and one or more expressions of the user-specified symptoms without displaying the first user interface.
[0027] According to some embodiments, a method executed in an electronic device having a display and one or more input devices and operably connected to a plurality of biometric sensors is described. The method includes receiving first biometric information from a first biometric sensor of the plurality of biometric sensors, and in response to receiving the first biometric information and according to a determination that the first biometric information meets a first criterion, displaying on the display a warning including a first affordance for detecting additional biometric information, receiving user activation of the first affordance via the one or more input devices, and after receiving user activation of the first affordance, receiving second biometric information associated with the first biometric information from a second biometric sensor of the plurality of biometric sensors different from the first biometric sensor.
[0028] According to some embodiments, a non - transient computer - readable storage medium is described. A non - transient computer - readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, wherein the electronic device is operably connected to a plurality of biosensors, and the one or more programs receive first biometric information from a first biosensor of the plurality of biosensors, and in response to receiving the first biometric information and according to a determination that the first biometric information meets a first criterion, display a warning on the display that includes a first affordance for detecting additional biometric information, receive user activation of the first affordance via one or more input devices, and after receiving user activation of the first affordance, receive second biometric information associated with the first biometric information from a second biosensor of the plurality of biosensors that is different from the first biosensor, including instructions.
[0029] According to some embodiments, a transient computer - readable storage medium is described. A transient computer - readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, wherein the electronic device is operably connected to a plurality of biosensors, and the one or more programs receive first biometric information from a first biosensor of the plurality of biosensors, and in response to receiving the first biometric information and according to a determination that the first biometric information meets a first criterion, display a warning on the display that includes a first affordance for detecting additional biometric information, receive user activation of the first affordance via one or more input devices, and after receiving user activation of the first affordance, receive second biometric information associated with the first biometric information from a second biosensor of the plurality of biosensors that is different from the first biosensor, including instructions.
[0030] According to several embodiments, an electronic device is described. The electronic device is operably connected to a plurality of biosensors and comprises a display, one or more input devices, and a memory for storing one or more programs configured to be executed by one or more processors, the one or more programs including instructions for receiving first biometric information from a first biosensor of the plurality of biosensors, and in response to receiving the first biometric information and in accordance with a determination that the first biometric information satisfies a first criterion, to display a warning on the display including a first affordance for detecting additional biometric information, to receive user activation of the first affordance via one or more input devices, and after receiving user activation of the first affordance, to receive second biometric information associated with the first biometric information from a second biosensor of the plurality of biosensors different from the first biosensor.
[0031] According to several embodiments, an electronic device is described. The electronic device is operably connected to a plurality of biosensors and comprises a display, one or more input devices, means for receiving first biometric information from a first biosensor of the plurality of biosensors, means for displaying a warning on the display including a first affordance for detecting additional biometric information in response to the reception of the first biometric information and in accordance with the determination that the first biometric information satisfies a first criterion, means for receiving user activation of the first affordance via one or more input devices, and means for receiving second biometric information associated with the first biometric information from a second biosensor of a plurality of biosensors different from the first biosensor after receiving user activation of the first affordance.
[0032] The executable instructions that perform these functions are contained in a non-temporary computer-readable storage medium or other computer program product configured to be executed by one or more processors, at the discretion of the user.
[0033] Therefore, devices will be provided with faster and more efficient methods and interfaces for managing health monitoring, thereby increasing the effectiveness, efficiency, and user satisfaction of such devices. Such methods and interfaces can complement or replace other methods for managing health monitoring. [Brief explanation of the drawing]
[0034] To better understand the various embodiments described, the following “Modes for Carrying Out the Invention” should be referenced in conjunction with the following drawings, and similar reference numbers throughout the following drawings refer to the corresponding parts.
[0035] [Figure 1A] This is a block diagram showing a portable multifunctional device having a touch-sensitive display according to several embodiments.
[0036] [Figure 1B] This is a block diagram showing exemplary components for event handling according to several embodiments.
[0037] [Figure 2] Several embodiments of portable multifunctional devices having a touchscreen are shown.
[0038] [Figure 3] This is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface, according to several embodiments.
[0039] [Figure 4A] This shows an exemplary user interface for an application menu on a portable multifunction device according to several embodiments.
[0040] [Figure 4B] This document illustrates an exemplary user interface for a multifunctional device having a touch-sensitive surface separate from the display according to several embodiments.
[0041] [Figure 5A] Several embodiments of personal electronic devices are shown.
[0042] [Figure 5B] This is a block diagram showing personal electronic devices according to several embodiments.
[0043] [Figure 5C] The following are exemplary components of a personal electronic device having a touch-sensitive display and intensity sensor according to several embodiments. [Figure 5D] The following are exemplary components of a personal electronic device having a touch-sensitive display and intensity sensor according to several embodiments.
[0044] [Figure 5E] The following are exemplary components and user interfaces of personal electronic devices according to several embodiments. [Figure 5F] The following are exemplary components and user interfaces of personal electronic devices according to several embodiments. [Figure 5G] The following are exemplary components and user interfaces of personal electronic devices according to several embodiments. [Figure 5H] The following are exemplary components and user interfaces of personal electronic devices according to several embodiments.
[0045] [Figure 6A] This shows an exemplary user interface for initial health monitoring setup. [Figure 6B] This shows an exemplary user interface for initial health monitoring setup. [Figure 6C] This shows an exemplary user interface for initial health monitoring setup. [Figure 6D] This shows an exemplary user interface for initial health monitoring setup. [Figure 6E] This shows an exemplary user interface for initial health monitoring setup. [Figure 6F] This shows an exemplary user interface for initial health monitoring setup. [Figure 6G] This shows an exemplary user interface for initial health monitoring setup. [Figure 6H] This shows an exemplary user interface for initial health monitoring setup. [Figure 6I] This shows an exemplary user interface for initial health monitoring setup. [Figure 6J] This shows an exemplary user interface for initial health monitoring setup. [Figure 6K] This shows an exemplary user interface for initial health monitoring setup. [Figure 6L] This shows an exemplary user interface for initial health monitoring setup. [Figure 6M] This shows an exemplary user interface for initial health monitoring setup. [Figure 6N] This shows an exemplary user interface for initial health monitoring setup. [Figure 6O] This shows an exemplary user interface for initial health monitoring setup. [Figure 6P]This shows an exemplary user interface for initial health monitoring setup. [Figure 6Q] This shows an exemplary user interface for initial health monitoring setup. [Figure 6R] This shows an exemplary user interface for initial health monitoring setup. [Figure 6S] This shows an exemplary user interface for initial health monitoring setup. [Figure 6T] This shows an exemplary user interface for initial health monitoring setup. [Figure 6U] This shows an exemplary user interface for initial health monitoring setup. [Figure 6V] This shows an exemplary user interface for initial health monitoring setup. [Figure 6W] This shows an exemplary user interface for initial health monitoring setup. [Figure 6X] This shows an exemplary user interface for initial health monitoring setup. [Figure 6Y] This shows an exemplary user interface for initial health monitoring setup. [Figure 6Z] This shows an exemplary user interface for initial health monitoring setup. [Figure 6AA] This shows an exemplary user interface for initial health monitoring setup. [Figure 6AB] This shows an exemplary user interface for initial health monitoring setup. [Figure 6AC] This shows an exemplary user interface for initial health monitoring setup. [Figure 6AD] This shows an exemplary user interface for initial health monitoring setup. [Figure 6AE] This shows an exemplary user interface for initial health monitoring setup.
[0046] [Figure 7A] The following are flowcharts illustrating the initial setup of health monitoring according to several embodiments. [Figure 7B] The following are flowcharts illustrating the initial setup of health monitoring according to several embodiments. [Figure 7C] The following are flowcharts illustrating the initial setup of health monitoring according to several embodiments.
[0047] [Figure 8A] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8B] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8C] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8D] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8E] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8F] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8G] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8H] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8I] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8J] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8K]This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8L] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8M] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8N] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8O] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8P] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8Q] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8R] This shows an exemplary user interface for recording biometric information for use in health monitoring. [Figure 8S] This shows an exemplary user interface for recording biometric information for use in health monitoring.
[0048] [Figure 9A] The following are flowcharts for recording biometric information for health monitoring, according to several embodiments. [Figure 9B] The following are flowcharts for recording biometric information for health monitoring, according to several embodiments.
[0049] [Figure 10A] This document provides an exemplary user interface for using input devices for health monitoring. [Figure 10B] This document provides an exemplary user interface for using input devices for health monitoring. [Figure 10C] This document provides an exemplary user interface for using input devices for health monitoring. [Figure 10D] This document provides an exemplary user interface for using input devices for health monitoring. [Figure 10E] This document provides an exemplary user interface for using input devices for health monitoring. [Figure 10F] This document provides an exemplary user interface for using input devices for health monitoring. [Figure 10G] This document provides an exemplary user interface for using input devices for health monitoring. [Figure 10H] This document provides an exemplary user interface for using input devices for health monitoring. [Figure 10I] This document provides an exemplary user interface for using input devices for health monitoring. [Figure 10J] This document provides an exemplary user interface for using input devices for health monitoring.
[0050] [Figure 11] The following are flowcharts illustrating the use of an input device for health monitoring according to several embodiments.
[0051] [Figure 12A] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12B] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12C] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12D] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12E]This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12F] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12G] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12H] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12I] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12J] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12K] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12L] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12M] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12N] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12O] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12P] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12Q] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12R] This document provides an exemplary user interface for managing aspects of health monitoring. [Figure 12S] This document provides an exemplary user interface for managing aspects of health monitoring.
[0052] [Figure 13A]The following are flowcharts for managing aspects of health monitoring according to several embodiments. [Figure 13B] The following are flowcharts for managing aspects of health monitoring according to several embodiments.
[0053] [Figure 14A] This shows an example user interface for providing health status warnings. [Figure 14B] This shows an example user interface for providing health status warnings. [Figure 14C] This shows an example user interface for providing health status warnings. [Figure 14D] This shows an example user interface for providing health status warnings. [Figure 14E] This shows an example user interface for providing health status warnings. [Figure 14F] This shows an example user interface for providing health status warnings. [Figure 14G] This shows an example user interface for providing health status warnings. [Figure 14H] This shows an example user interface for providing health status warnings. [Figure 14I] This shows an example user interface for providing health status warnings.
[0054] [Figure 15] A flowchart for providing health status warnings according to several embodiments is shown. [Modes for carrying out the invention]
[0055] The following description includes exemplary methods, parameters, etc. However, it should be noted that such descriptions are not intended to limit the scope of this disclosure, but rather are provided as descriptions of exemplary embodiments.
[0056] There is a need for electronic devices that provide efficient methods and interfaces for managing health monitoring. For example, there is a need for electronic devices that can quickly and conveniently capture biometric information from users to enable them to easily monitor their own health. In another example, there is a need for electronic devices that manage biometric information captured from users so that users can easily and conveniently access and view monitoring and evaluation results. In yet another example, there is a need for electronic devices that can efficiently present evaluation results to users so that they can easily understand the results and respond appropriately. Such technologies can reduce the cognitive burden on users accessing health monitoring functions, thereby increasing productivity. Furthermore, such techniques can reduce the power of processors and batteries that would normally be wasted on redundant user input.
[0057] Figures 1A-1B, 2, 3, 4A-4B, and 5A-5H below provide a description of exemplary devices for performing techniques for managing event notifications. Figures 6A-6AE show exemplary user interfaces for initial health monitoring setup. Figures 7A-7C show flowcharts for initial health monitoring setup. The user interfaces in Figures 6A-6AE are used to illustrate later processes, including the processes in Figures 7A-7C. Figures 8A-8S show exemplary user interfaces for recording biometric information for use in health monitoring. Figures 9A-9B show flowcharts for recording biometric information for health monitoring according to several embodiments. The user interfaces in Figures 8A-8S are used to illustrate later processes, including the processes in Figures 9A-9B. Figures 10A-10J show exemplary user interfaces for using input devices for health monitoring. Figure 11 shows flowcharts for using input devices for health monitoring according to several embodiments. The user interfaces in Figures 10A to 10J are used to illustrate processes described later, including the process in Figure 11. Figures 12A to 12S show exemplary user interfaces for managing aspects of health monitoring. Figures 13A to 13B show flowcharts for managing aspects of health monitoring according to several embodiments. The user interfaces in Figures 12A to 12S are used to illustrate processes described later, including the processes in Figures 13A to 13B. Figures 14A to 14I show exemplary user interfaces for providing health status alerts. Figure 15 shows flowcharts for providing health status alerts according to several embodiments. The user interfaces in Figures 14A to 14I are used to illustrate processes described later, including the process in Figure 15.
[0058] In the following description, terms such as “first,” “second,” etc., are used to describe various elements, but these elements should not be limited by these terms. These terms are used solely to distinguish one element from another. For example, without departing from the scope of the various embodiments described, the first touch may be called the second touch, and similarly, the second touch may be called the first touch. Both the first touch and the second touch are touches, but they are not the same touch.
[0059] The terminology used in the descriptions of the various embodiments described herein is intended solely to describe specific embodiments and is not intended to be limiting. In the descriptions of the various embodiments and the accompanying claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless otherwise explicitly stated in the context. Furthermore, it should be understood that, as used herein, the term “and / or” refers to and includes any and all possible combinations of one or more of the enumerated items relating to the description. It will be further understood that, as used herein, the terms “includes,” “comprises,” and / or “comprising” specify the presence of the described features, integers, steps, actions, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, actions, elements, components, and / or groups thereof.
[0060] The phrase "if" can be interpreted, at will, depending on the context, as "when" or "upon," or "in response to determining" or "in response to detecting." Similarly, the phrases "if it is determined" or "if [a stated condition or event] is detected" can be interpreted, at will, depending on the context, as "upon determining" or "in response to determining," or "upon detecting [the stated condition or event]" or "in response to detecting [the stated condition or event]."
[0061] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some embodiments, the device is a portable communication device, such as a mobile phone, which also includes other functions such as PDA functionality and / or music player functionality. Exemplary embodiments of portable multifunction devices include, but are not limited to, the iPhone®, iPod Touch®, and iPad® devices from Apple Inc., Cupertino, California. Optionally, other portable electronic devices such as laptops or tablet computers having touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads) are also used. It should also be understood that in some embodiments, the device is not a portable communication device but a desktop computer having touch-sensitive surfaces (e.g., touchscreen displays and / or touchpads).
[0062] The following discussion describes electronic devices including displays and touch-sensitive surfaces. However, it should be understood that electronic devices optionally include one or more other physical user interface devices such as physical keyboards, mice, and / or joysticks.
[0063] The device typically supports a variety of applications, including drawing applications, presentation applications, word processing applications, website creation applications, disk authoring applications, spreadsheet applications, game applications, telephone applications, video conferencing applications, email applications, instant messaging applications, training support applications, photo management applications, digital camera applications, digital video camera applications, web browsing applications, digital music player applications, and / or digital video player applications.
[0064] Various applications running on this device optionally utilize at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface, as well as the corresponding information displayed on the device, are optionally adjusted and / or modified on an application-by-application basis and / or within each application. In this way, the device's common physical architecture (such as the touch-sensitive surface) optionally supports a variety of applications with intuitive and transparent user interfaces for the user.
[0065] Here, we turn our attention to embodiments of portable devices having a touch-sensitive display. Figure 1A is a block diagram of a portable multifunction device 100 having a touch-sensitive display system 112 according to several embodiments. The touch-sensitive display 112 may be conveniently referred to as a “touchscreen” and may be known or referred to as a “touch-sensitive display system”. Device 100 includes a memory 102 (optionally including one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. Device 100 optionally includes one or more optical sensors 164. Device 100 optionally includes one or more contact intensity sensors 165 (e.g., touch-sensitive surfaces such as the touch-sensitive display system 112 of Device 100) that detect the intensity of contact on Device 100. Device 100 optionally includes one or more tactile output generators 167 that generate tactile outputs on Device 100 (for example, on touch-sensitive surfaces such as the touch-sensitive display system 112 of Device 100 or the touchpad 355 of Device 300). These components optionally communicate via one or more communication buses or signal lines 103.
[0066] In this specification and in the claims, the term “strength” of contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of contact on the touch-sensitive surface (e.g., finger contact), or a proxy for the force or pressure of contact on the touch-sensitive surface. The strength of contact has a range of values, including at least four distinct values, and more typically, including several hundred (e.g., at least 256) distinct values. The strength of contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at various points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted average) to determine the estimated force of contact. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size and / or change in the contact area detected on the touch-sensing surface, the capacitance and / or change in the touch-sensing surface adjacent to the contact, and / or the resistance and / or change in the touch-sensing surface adjacent to the contact may optionally be used as a substitute for the force or pressure of the contact on the touch-sensing surface. In some implementations, the substitute measurement for the force or pressure of the contact is used directly to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some implementations, the substitute measurement for the contact force or pressure is converted to an estimated force or pressure, and the estimated force or pressure is used to determine whether an intensity threshold is exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). By using the intensity of contact as an attribute of user input, it becomes possible to enable user access to additional device functions that would normally be inaccessible to the user on a reduced-size device where the area for displaying affordances (e.g., on a touch-sensitive display) and / or receiving user input (e.g., via a touch-sensitive display, touch-sensitive surface, or physical / mechanical control unit such as a knob or button) is limited.
[0067] As used herein and in the claims, the term “tactile output” refers to the physical displacement of a device relative to its previous position, the physical displacement of a component of a device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or the displacement of a component relative to the center of mass of a device, which will be detected by the user through the user’s sense of touch. For example, in a situation where a device or component of a device is in contact with a touch-sensitive user’s surface (e.g., the user’s fingers, palm, or other part of their hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in the physical properties of the device or component of the device. For example, the movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) may be optionally interpreted by the user as a “down-click” or “up-click” of a physical actuator button. In some cases, the user may feel a tactile sensation such as a “down-click” or “up-click” even when there is no movement of a physical actuator button associated with a touch-sensitive surface that has been physically pressed (e.g., displaced) by the user’s action. As another example, movement of a touch-sensitive surface may be interpreted or perceived by the user as "roughness" of that surface, even if there is no change in the smoothness of the touch-sensitive surface. Such user interpretations of touch depend on the user's personal sensory perception, but there are many touch sensory perceptions common to the majority of users. Therefore, when a tactile output is described as corresponding to a user's specific sensory perception (e.g., "up-click," "down-click," "roughness"), unless otherwise stated, the generated tactile output corresponds to the physical displacement of the device or its components that produce the described sensory perception of a typical (or average) user.
[0068] It should be understood that device 100 is merely an example of a portable multifunction device, and that device 100 may optionally have more or fewer components than those shown, may optionally combine two or more components, or may optionally have different configurations or arrangements of those components. The various components shown in Figure 1A are implemented in hardware, software, or a combination of both hardware and software, including one or more signal processing circuits and / or application-specific integrated circuits.
[0069] Memory 102 optionally includes high-speed random-access memory and optionally includes non-volatile memory such as one or more magnetic disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls access to memory 102 by other components of device 100.
[0070] The peripheral interface 118 can be used to connect the device's input and output peripherals to the CPU 120 and memory 102. One or more processors 120 operate or execute various software programs and / or instruction sets stored in memory 102 to perform various functions for device 100 and process data. In some embodiments, the peripheral interface 118, CPU 120, and memory controller 122 are optionally implemented on a single chip, such as chip 104. In some other embodiments, they are optionally implemented on separate chips.
[0071] The RF (radio frequency) circuit 108 transmits and receives RF signals, also known as electromagnetic signals. The RF circuit 108 converts electrical signals to electromagnetic signals, or electromagnetic signals to electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. The RF circuit 108 optionally includes well-known circuits for performing these functions, which include, but are not limited to, antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, CODEC chipsets, subscriber identity module (SIM) cards, and memory. The RF circuit 108 optionally communicates wirelessly with networks such as the Internet, also known as the World Wide Web (WWW), intranets, and / or wireless networks such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs), as well as with other devices. The RF circuit 108 optionally includes a well-known circuit for detecting a near-field communication (NFC) field using a short-range communication radio, etc. Wireless communication is optionally not limited to this, but includes Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), high-speed downlink packet access (HSDPA), high-speed uplink packet access (HSUPA), Evolution Data-Only (EV-DO), HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), and long-term evolution.Bluetooth evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth®, Bluetooth Low Energy® (BTLE), Wireless Fidelity (Wi-Fi®) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n, and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX®, Email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), Instant messaging (e.g., Extensible Messaging and Presence Protocol) Using any of several communication standards, protocols, and technologies, including the XMPP protocol, Session Initiation Protocol for Instant Messaging and Presence Leveraging Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS), and / or Short Message Service (SMS), or any other suitable communication protocol, including a communication protocol not yet developed as of the filing date of this specification.
[0072] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between the user and the device 100. The audio circuit 110 receives audio data from the peripheral interface 118, converts this audio data into an electrical signal, and transmits this electrical signal to the speaker 111. The speaker 111 converts the electrical signal into human audible sound waves. The audio circuit 110 also receives the electrical signal converted from the sound waves by the microphone 113. The audio circuit 110 converts the electrical signal into audio data and transmits this audio data to the peripheral interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or RF circuit 108 by the peripheral interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., 212 in Figure 2). The headset jack provides an interface between the audio circuit 110 and detachable audio input / output peripherals such as output-only headphones or headsets that have both output (e.g., headphones for one or both ears) and input (e.g., a microphone).
[0073] The I / O subsystem 106 connects input / output peripherals on device 100, such as the touchscreen 112 and other input control devices 116, to the peripheral interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, an intensity sensor controller 159, a haptic feedback controller 161, and one or more input controllers 160 for other input or control devices. One or more input controllers 160 receive electrical signals from / transmit electrical signals to other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons), dials, slider switches, joysticks, click wheels, etc. In some alternative embodiments, the input controller(s) 160 are optionally connected to (or not connected to) one or more of the following: a keyboard, an infrared port, a USB port, and a pointer device such as a mouse. One or more buttons (e.g., 208 in Figure 2) optionally include up and down buttons for volume control of speaker 111 and / or microphone 113. One or more buttons optionally include push buttons (e.g., 206 in Figure 2).
[0074] As described in U.S. Patent Application No. 11 / 322,549, “Unlocking a Device by Performing Gestures on an Unlock Image,” filed December 23, 2005, U.S. Patent No. 7,657,849, incorporated herein by reference in its entirety, a quick press of a push button optionally unlocks the touchscreen 112, or optionally initiates a process to unlock the device using gestures on the touchscreen. A longer press of a push button (e.g., 206) optionally turns power on or off the device 100. The functionality of one or more of the buttons is optionally customizable by the user. The touchscreen 112 is used to implement virtual or soft buttons and one or more soft keyboards.
[0075] The touch-sensitive display 112 provides input and output interfaces between the device and the user. The display controller 156 receives electrical signals from and / or transmits electrical signals to the touchscreen 112. The touchscreen 112 displays a visual output to the user. This visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively, “graphics”). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.
[0076] The touchscreen 112 has a touch-sensing surface, sensor, or set of sensors that accept user input based on touch and / or tactile contact. The touchscreen 112 and the display controller 156 (along with any associated modules and / or instruction sets in memory 102) detect contact (and any movement or interruption of contact) on the touchscreen 112 and translate the detected contact into interaction with user interface objects displayed on the touchscreen 112 (e.g., one or more soft keys, icons, web pages, or images). In an exemplary embodiment, the point of contact between the touchscreen 112 and the user corresponds to the user's finger.
[0077] The touchscreen 112 optionally uses LCD (liquid crystal display) technology, LPD (polymer light-emitting display) technology, or LED (light-emitting diode) technology, but other display technologies may also be used in other embodiments. The touchscreen 112 and the display controller 156 optionally, but not limited to, use any of several currently known or future-developed touch sensing technologies, including capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements that determine one or more points of contact with the touchscreen 112, to detect contact and any movement or interruption thereof. In exemplary embodiments, projected mutual capacitive sensing technology is used, such as that found in the iPhone® and iPod Touch® from Apple Inc. of Cupertino, California.
[0078] The touch-sensitive displays in some embodiments of the touchscreen 112 are, optionally, similar to the multi-touch-sensitive touchpads described in U.S. Patent No. 6,323,846 (Westerman et al.), No. 6,570,557 (Westerman et al.), and / or No. 6,677,932 (Westerman), and / or U.S. Patent Publication No. 2002 / 0015024A1, which are each incorporated herein by reference as a whole. However, the touchscreen 112 displays visual output from device 100, whereas the touch-sensitive touchpad does not provide visual output.
[0079] The touch-sensitive displays in several embodiments of the touchscreen 112 include: (1) U.S. Patent Application No. 11 / 381,313, filed May 2, 2006, "Multipoint Touch Surface Controller"; (2) U.S. Patent Application No. 10 / 840,862, filed May 6, 2004, "Multipoint Touchscreen"; (3) U.S. Patent Application No. 10 / 903,964, filed July 30, 2004, "Gestures For Touch Sensitive Input Devices"; (4) U.S. Patent Application No. 11 / 048,264, filed January 31, 2005, "Gestures For Touch Sensitive Input Devices"; and (5) U.S. Patent Application No. 11 / 038,590, filed January 18, 2005, "Mode-Based Graphical User Interfaces For Touch Sensitive Input These are described in the following applications: (6) U.S. Patent Application No. 11 / 228,758, filed September 16, 2005, "Virtual Input Device Placement On A Touch Screen User Interface"; (7) U.S. Patent Application No. 11 / 228,700, filed September 16, 2005, "Operation Of A Computer With A Touch Screen Interface"; (8) U.S. Patent Application No. 11 / 228,737, filed September 16, 2005, "Activating Virtual Keys Of A Touch-Screen Virtual Keyboard"; and (9) U.S. Patent Application No. 11 / 367,749, filed March 3, 2006, "Multi-Functional Hand-Held Device". All of these applications are incorporated herein by reference as a whole.
[0080] The touchscreen 112 optionally has a video resolution greater than 100 dpi. In some embodiments, the touchscreen has a video resolution of approximately 160 dpi. The user optionally touches the touchscreen 112 using any suitable object or attachment, such as a stylus or finger. In some embodiments, the user interface is designed to primarily handle finger-based touch and gestures, which may be less precise than stylus-based input due to the larger contact area of the finger on the touchscreen. In some embodiments, the device translates coarse finger input into a precise pointer / cursor position or command to perform an action desired by the user.
[0081] In some embodiments, in addition to the touchscreen, the device 100 optionally includes a touchpad (not shown) for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensing area of the device that, unlike the touchscreen, does not display a visual output. The touchpad is optionally a touch-sensing surface separate from the touchscreen 112 or an extension of the touch-sensing surface formed by the touchscreen.
[0082] Device 100 also includes a power system 162 that supplies power to various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., a battery, alternating current (AC)), a recharge system, a power failure detection circuit, a power converter or inverter, a power status indicator (e.g., a light-emitting diode (LED)), and any other components associated with generating, managing, and distributing power within the portable device.
[0083] The device 100 also optionally includes one or more optical sensors 164. Figure 1A shows an optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106. The optical sensor 164 optionally includes a charge-coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light from the environment projected through one or more lenses and converts that light into data representing an image. The optical sensor 164 works in conjunction with an imaging module 143 (also called a camera module) to optionally capture still images or video. In some embodiments, the optical sensor is located on the back of the device 100, opposite to the touchscreen display 112 which is on the front of the device, so that the touchscreen display can be effectively used as a viewfinder for acquiring still images and / or video images. In some embodiments, the light sensor is located on the front of the device, so that the user's image is optionally acquired for video conferencing, and the user views other video conferencing participants on the touchscreen display. In some embodiments, the position of the light sensor 164 can be changed by the user (for example, by rotating the lens and sensor within the device housing), so that a single light sensor 164 is used for both video conferencing and acquiring still and / or video images, together with the touchscreen display.
[0084] Device 100 also optionally includes one or more contact intensity sensors 165. Figure 1A shows a contact intensity sensor coupled to an intensity sensor controller 159 in the I / O subsystem 106. The contact intensity sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electric force sensors, pressure-power sensors, optical force sensors, capacitive touch-sensing surfaces, or other intensity sensors (e.g., sensors used to measure the force (or pressure) of contact on a touch-sensing surface). The contact intensity sensor 165 receives contact intensity information (e.g., pressure information, or a proxy for pressure information) from the environment. In some embodiments, at least one contact intensity sensor is positioned juxtaposed with or adjacent to a touch-sensing surface (e.g., a touch-sensing display system 112). In some embodiments, at least one contact intensity sensor is located on the back of Device 100, opposite the touchscreen display 112 located on the front of Device 100.
[0085] The device 100 also optionally includes one or more proximity sensors 166. Figure 1A shows a proximity sensor 166 coupled to a peripheral interface 118. Alternatively, the proximity sensor 166 is optionally coupled to an input controller 160 in the I / O subsystem 106. The proximity sensor 166 may optionally function as described in U.S. Patent Applications 11 / 241,839, “Proximity Detector In Handheld Device,” 11 / 240,788, “Proximity Detector In Handheld Device,” 11 / 620,702, “Using Ambient Light Sensor To Augment Proximity Sensor Output,” 11 / 586,862, “Automated Response To And Sensing Of User Activity In Portable Devices,” and 11 / 638,251, “Methods And Systems For Automatic Configuration Of Peripherals,” which are incorporated herein by reference as a whole. In some embodiments, when the multifunction device is positioned near the user's ear (for example, when the user is making a phone call), the proximity sensor turns off and disables the touchscreen 112.
[0086] Device 100 also optionally includes one or more tactile output generators 167. Figure 1A shows a tactile output generator coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices such as a speaker or other audio component, and / or electromechanical devices that convert energy into linear motion, such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component that converts an electrical signal into a tactile output on the device). The contact intensity sensor 165 receives a tactile feedback generation command from the tactile feedback module 133 and generates a tactile output on device 100 that can be sensed by the user of device 100. In some embodiments, at least one tactile output generator is positioned alongside or adjacent to a touch-sensing surface (e.g., a touch-sensing display system 112) and optionally generates a tactile output by moving the touch-sensing surface vertically (e.g., inward / outward from the surface of device 100) or horizontally (e.g., forward / backward in the same plane as the surface of device 100). In some embodiments, at least one tactile output generator sensor is located on the back of device 100, opposite the touchscreen display 112 which is located on the front of device 100.
[0087] The device 100 also optionally includes one or more accelerometers 168. Figure 1A shows an accelerometer 168 coupled to a peripheral interface 118. Alternatively, the accelerometer 168 is optionally coupled to an input controller 160 in the I / O subsystem 106. The accelerometer 168 optionally functions as described in U.S. Patent Publication No. 20050190059, “Acceleration-based Theft Detection System for Portable Electronic Devices,” and U.S. Patent Publication No. 20060017692, “Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer,” both of which are incorporated herein by reference as a whole. In some embodiments, information is displayed on a touchscreen display in portrait or landscape view based on an analysis of data received from one or more accelerometers. Device 100 optionally includes, in addition to one or more accelerometers 168, a magnetometer (not shown), and a GPS (or GLONASS or other global navigation system) receiver (not shown) for acquiring information regarding the position and orientation of Device 100 (e.g., portrait or landscape).
[0088] In some embodiments, the software components stored in memory 102 include an operating system 126, a communications module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a Global Positioning System (GPS) module (or instruction set) 135, and an application (or instruction set) 136. Furthermore, in some embodiments, memory 102 (Figure 1A) or 370 (Figure 3) stores a device / global internal state 157, as shown in Figures 1A and 3. The device / global internal state 157 includes one or more of the following: an active application state indicating which application is active, if there is an application currently active; a display state indicating which applications, views, or other information occupy different areas of the touchscreen display 112; a sensor state including information obtained from various sensors and input control devices 116 of the device; and position information relating to the location and / or orientation of the device.
[0089] An operating system 126 (for example, embedded operating systems such as Darwin®, RTXC®, LINUX®, UNIX®, OS X®, iOS®, WINDOWS®, or VxWorks®) includes various software components and / or drivers that control and manage common system tasks (e.g., memory management, memory device control, power management, etc.) and facilitate communication between various hardware components and software components.
[0090] The communication module 128 facilitates communication with other devices via one or more external ports 124 and also includes various software components for processing data received by the RF circuit 108 and / or the external ports 124. The external ports 124 (e.g., Universal Serial Bus (USB), FireWire®, etc.) are adapted to connect to other devices directly or indirectly via a network (e.g., the Internet, Wi-Fi, etc.). In some embodiments, the external ports are multi-pin (e.g., 30-pin) connectors that are the same as and / or similar to the 30-pin connector used on iPod® (a trademark of Apple Inc.) devices.
[0091] The contact / motion module 130 optionally detects contact with the touchscreen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger being lowered), determining the intensity of contact (e.g., the force or pressure of contact, or a substitute for the force or pressure of contact), determining whether there is movement of contact and tracking movement across the touch-sensitive surface (e.g., detecting one or more events of a finger being dragged), and determining whether contact has stopped (e.g., detecting a finger being lifted or an interruption of contact). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of the contact point, represented by a series of contact data, optionally includes determining the speed (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point. These actions can be optionally applied to a single contact (e.g., a single finger contact) or multiple simultaneous contacts (e.g., "multi-touch" / multiple finger contacts). In some embodiments, the contact / motion module 130 and the display controller 156 detect contact on the touchpad.
[0092] In some embodiments, the contact / motion module 130 uses one or more sets of intensity thresholds to determine whether an action has been performed by the user (for example, whether the user has "clicked" on an icon). In some embodiments, at least one subset of the intensity thresholds is determined according to a software parameter (for example, the intensity thresholds can be adjusted without changing the physical hardware of device 100, rather than being determined by the activation threshold of a particular physical actuator). For example, the mouse "click" threshold for a trackpad or touchscreen display can be set to one of a range of default thresholds without changing the trackpad or touchscreen display hardware. In addition, in some implementations, the user of the device is provided with software settings to adjust one or more of the sets of intensity thresholds (for example, by adjusting individual intensity thresholds and / or multiple intensity thresholds at once using a system-level click "intensity" parameter).
[0093] The contact / motion module 130 optionally detects gesture input from the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motion, timing, and / or intensity of the detected contact). Therefore, gestures are optionally detected by detecting a specific contact pattern. For example, detecting a finger tap gesture involves detecting a finger down event, followed by a finger up (lift-off) event at the same location (or substantially the same location) as the finger down event (e.g., the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface involves detecting a finger down event, followed by one or more finger drag events, and then a finger up (lift-off) event.
[0094] The graphics module 132 includes various known software components for rendering and displaying graphics on the touchscreen 112 or other display, including components for changing the visual effects of the displayed graphics (e.g., brightness, transparency, saturation, contrast, or other visual properties). In this specification, the term “graphics” includes, but is not limited to, any object that can be displayed to the user, including characters, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.
[0095] In some embodiments, the graphics module 132 stores data representing the graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes from an application or the like, as needed, along with coordinate data and other graphic characteristic data, specifying the graphics to be displayed, and then generates screen image data to be output to the display controller 156.
[0096] The haptic feedback module 133 includes various software components for generating instructions used by a haptic output generator(s) 167 to generate haptic outputs at one or more locations on the device 100 in response to user interaction with the device 100.
[0097] The text input module 134 is optionally a component of the graphics module 132 and provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other applications that require text input).
[0098] The GPS module 135 determines the device's location and provides this information for use in various applications (for example, to the telephone 138 for location-based dialing, to the camera 143 as metadata for photos / videos, and to applications that provide location-based services, such as weather widgets, local yellow pages widgets, and map / navigation widgets).
[0099] Application 136 optionally includes the following modules (or instruction sets) or subsets or supersets thereof: ● Contact module 137 (sometimes called the address book or contact list), ●Telephone module 138, ●Video conferencing module 139, ● Email client module 140, ● Instant messaging (IM) module 141, ●Training support module 142, ● Camera module 143 for still images and / or video images, ●Image management module 144, ●Video player module, ● Music player module, ● Browser module 147, ● Calendar module 148, ● A widget module 149 that optionally includes one or more of the following: weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, dictionary widget 149-5, other widgets obtained by the user, and user-created widgets 149-6. ●Widget creation module 150 for creating user-created widget 149-6, ● Search module 151, ●Video and music player module 152, which integrates a video player module and a music player module. ●Memo Module 153, ●Map module 154, and / or, ● Online video module 155.
[0100] Examples of other applications 136 that may be optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, presentation applications, Java®-enabled applications, encryption, digital rights management, speech recognition, and speech duplication.
[0101] In conjunction with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the contact module 137 is used to manage an address book or contact list (stored, for example, in the application internal state 192 of the contact module 137 in memory 102 or memory 370), including optionally adding names(s) to the address book, deleting names(s) from the address book, associating names(s) to telephone numbers(s), email addresses(s) to or from physical addresses(s) to or from names, associating images to names, categorizing and sorting names, and providing telephone numbers or email addresses to initiate and / or facilitate communication via telephone 138, video conferencing module 139, email 140, or IM 141.
[0102] In conjunction with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the telephone module 138 is optionally used for inputting character sequences corresponding to telephone numbers, accessing one or more telephone numbers in the contact module 137, modifying entered telephone numbers, dialing each telephone number, conducting conversations, and ending or hanging up a call when a conversation is finished. As previously mentioned, wireless communication optionally uses one of several communication standards, protocols, and technologies.
[0103] In conjunction with the RF circuit 108, audio circuit 110, speaker 111, microphone 113, touchscreen 112, display controller 156, light sensor 164, light sensor controller 158, contact / motion module 130, graphics module 132, text input module 134, contact module 137, and telephone module 138, the video conferencing module 139 includes executable commands for starting, running, and ending video conferences between the user and one or more other participants in accordance with user commands.
[0104] In conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the email client module 140 includes executable commands for creating, sending, receiving, and managing emails in response to user commands. In conjunction with the image management module 144, the email client module 140 makes it very easy to create and send emails containing still or video images captured by the camera module 143.
[0105] In conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the instant messaging module 141 includes executable commands for inputting character sequences corresponding to instant messages, modifying previously entered characters, sending each instant message (e.g., using the Short Message Service (SMS) or Multimedia Message Service (MMS) protocol for telephone-based instant messaging, or XMPP, SIMPLE, or IMPS for internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photographs, audio files, video files, and / or other attachments supported by MMS and / or Enhanced Messaging Service (EMS). In this specification, “instant messaging” refers to both telephone-based messaging (e.g., messages sent using SMS or MMS) and internet-based messaging (e.g., messages sent using XMPP, SIMPLE, or IMPS).
[0106] In conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, map module 154, and music player module, the training support module 142 includes executable commands for creating training (e.g., having time, distance, and / or calorie burn targets), communicating with training sensors (sports devices), receiving training sensor data, calibrating sensors (e.g., heart rate or heart rhythm sensors) used to monitor training, selecting and playing music for training, and displaying, storing, and transmitting training data.
[0107] In conjunction with the touchscreen 112, display controller 156, optical sensor(s) 164, optical sensor controller 158, contact / motion module 130, graphics module 132, and image management module 144, the camera module 143 includes executable commands for capturing still images or videos (including video streams) and storing them in memory 102, modifying the characteristics of still images or videos, or deleting still images or videos from memory 102.
[0108] In conjunction with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and camera module 143, the image management module 144 includes executable commands for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still and / or video images.
[0109] In conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the browser module 147 includes executable commands for browsing the Internet according to user commands, including searching, linking, receiving, and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.
[0110] In conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, email client module 140, and browser module 147, the calendar module 148 includes executable commands for creating, displaying, modifying, and storing a calendar and data associated with the calendar (e.g., calendar items, to-do lists, etc.) according to user commands.
[0111] In conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, the widget module 149 is a mini-application that can be optionally downloaded and used by the user (e.g., weather widget 149-1, stock price widget 149-2, calculator widget 149-3, alarm clock widget 149-4, and dictionary widget 149-5), or a mini-application created by the user (e.g., user-created widget 149-6). In some embodiments, the widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., Yahoo! Widget).
[0112] In conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, and browser module 147, the widget creator module 150 is used by the user to optionally create widgets (for example, to turn a user-specified portion of a web page into a widget).
[0113] In conjunction with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the search module 151 includes executable instructions for searching for characters, music, sounds, images, videos, and / or other files in memory 102 that match one or more search criteria (e.g., one or more user-specified search terms) according to user instructions.
[0114] In conjunction with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, and browser module 147, the video and music player module 152 includes executable commands that allow the user to download and play recorded music and other sound files stored in one or more file formats such as MP3 or AAC files, as well as executable commands for displaying, presenting, or otherwise playing video (for example, on the touchscreen 112 or on an external display connected via the external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player such as an iPod (a trademark of Apple Inc.).
[0115] In conjunction with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, the memo module 153 includes executable commands for creating and managing memos, to-do lists, etc., according to user commands.
[0116] In conjunction with the RF circuit 108, touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, text input module 134, GPS module 135, and browser module 147, the map module 154 is optionally used to receive, display, modify, and store maps and map-related data (e.g., driving directions, data on shops and other points of interest in or near a particular location, and other location-based data) in accordance with user commands.
[0117] In conjunction with the touchscreen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, the online video module 155 includes instructions that enable the user to access, browse, receive (e.g., by streaming and / or downloading), play (e.g., on the touchscreen or on an external display connected via external port 124), send emails with links to specific online videos, and perform other management of online videos in one or more file formats such as H.264. In some embodiments, an instant messaging module 141 is used instead of the email client module 140 to send links to specific online videos. Further descriptions of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” filed June 20, 2007, and U.S. Patent Application No. 11 / 968,067, “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” filed December 31, 2007, the contents of which are incorporated herein by reference in their entirety.
[0118] Each of the modules and applications identified above corresponds to a set of executable instructions that perform one or more of the functions described above and the methods described in this application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not need to be implemented as separate software programs, procedures, or modules; therefore, in various embodiments, various subsets of these modules may be optionally combined or otherwise reconfigured. For example, a video player module may optionally be combined with a music player module to form a single module (e.g., the video and music player module 152 in Figure 1A). In some embodiments, memory 102 may optionally store a subset of the modules and data structures identified above. Furthermore, memory 102 may optionally store additional modules and data structures not described above.
[0119] In some embodiments, device 100 is a device in which the operation of a default set of functions in the device is performed solely via a touchscreen and / or touchpad. By using a touchscreen and / or touchpad as the primary input control device for device 100 to operate, the number of physical input control devices (push buttons, dials, etc.) on device 100 is optionally reduced.
[0120] A default set of functions, which are performed only through the touchscreen and / or touchpad, optionally includes navigation between user interfaces. In some embodiments, the touchpad, when touched by the user, navigates the device 100 from any user interface displayed on the device 100 to the main menu, home menu, or root menu. In such embodiments, a “menu button” is implemented using the touchpad. In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a touchpad.
[0121] Figure 1B is a block diagram showing exemplary components for event processing according to several embodiments. In some embodiments, memory 102 (Figure 1A) or 370 (Figure 3) includes an event sorter 170 (e.g., within the operating system 126) and each application 136-1 (e.g., any of the aforementioned applications 137-151, 155, 380-390).
[0122] The event sorter 170 receives event information and determines the application 136-1 to which the event information is delivered, and the application view 191 of application 136-1. The event sorter 170 includes an event monitor 171 and an event dispatcher module 174. In some embodiments, application 136-1 includes an application internal state 192 that indicates the current application view(s) displayed on the touch-sensitive display 112 when the application is active or running. In some embodiments, a device / global internal state 157 is used by the event sorter 170 to determine which application(s) is currently active, and the application internal state 192 is used by the event sorter 170 to determine the application view(s) to which the event information is delivered.
[0123] In some embodiments, the application internal state 192 includes additional information such as resume information to be used when the application 136-1 resumes execution, user interface state information that indicates or is ready to display information displayed by the application 136-1, a state queue that allows the user to return to a previous state or view of the application 136-1, and one or more redo / undo queues of previous actions performed by the user.
[0124] The event monitor 171 receives event information from the peripheral interface 118. The event information includes information about sub-events (for example, user touch on the touch-sensitive display 112 as part of a multi-touch gesture). The peripheral interface 118 transmits information received from the I / O subsystem 106, or from sensors such as the proximity sensor 166, one or more accelerometers 168, and / or the microphone 113 (via the audio circuit 110). The information received by the peripheral interface 118 from the I / O subsystem 106 includes information from the touch-sensitive display 112 or the touch-sensitive surface.
[0125] In some embodiments, the event monitor 171 sends requests to the peripheral interface 118 at predetermined intervals. In response, the peripheral interface 118 transmits event information. In other embodiments, the peripheral interface 118 transmits event information only when there is a significant event (e.g., reception of input exceeding a predetermined noise threshold and / or exceeding a predetermined duration).
[0126] In some embodiments, the event sorter 170 also includes a hit view determination module 172 and / or an active event recognition determination module 173.
[0127] The hit view determination module 172 provides a software procedure for determining where in one or more views a sub-event occurred when the touch-sensitive display 112 displays two or more views. A view consists of control devices and other elements that the user can see on the display.
[0128] Another aspect of the user interface associated with an application is a set of views, sometimes referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application view (of each application) in which a touch is detected optionally corresponds to the program level within the application's program hierarchy or view hierarchy. For example, the lowest-level view in which a touch is detected optionally refers to the hit view, and the set of events recognized as appropriate input is optionally determined at least in part based on the hit view of the initial touch that initiates the touch gesture.
[0129] The hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views arranged in a hierarchy, the hit view determination module 172 identifies the hit view as the lowest-level view in the hierarchy from which the sub-events should be processed. In most situations, the hit view is the lowest-level view from which the initiating sub-event (e.g., the first sub-event in a sub-event sequence that forms an event or potential event) occurs. Once a hit view is identified by the hit view determination module 172, this hit view typically receives all sub-events related to the same touch or input source that identified it as the hit view.
[0130] The active event recognition determination module 173 determines which view(s) in the view hierarchy should receive a particular sequence of sub-events. In some embodiments, the active event recognition determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, the active event recognition determination module 173 determines that all views, including the physical location of the sub-event, are actively involved views, and therefore all actively involved views should receive a particular sequence of sub-events. In other embodiments, even if the touch sub-event is entirely confined to an area associated with one particular view, higher-level views in the hierarchy still remain actively involved views.
[0131] The event dispatcher module 174 dispatches event information to an event recognition unit (e.g., an event recognition unit 180). In embodiments including an active event recognition unit determination module 173, the event dispatcher module 174 distributes the event information to the event recognition unit determined by the active event recognition unit determination module 173. In some embodiments, the event dispatcher module 174 stores the event information acquired by each event receiving unit 182 in an event queue.
[0132] In some embodiments, the operating system 126 includes an event sorter 170. Alternatively, application 136-1 includes an event sorter 170. In yet another embodiment, the event sorter 170 is a standalone module or part of another module stored in memory 102, such as a contact / motion module 130.
[0133] In some embodiments, application 136-1 includes a plurality of event processing units 190 and one or more application views 191, each containing instructions for handling touch events occurring within each view of the application's user interface. Each application view 191 of application 136-1 includes one or more event recognition units 180. Typically, each application view 191 includes a plurality of event recognition units 180. In other embodiments, one or more of the event recognition units 180 are part of a separate module, such as a user interface kit (not shown) or a higher-level object from which application 136-1 inherits methods and other characteristics. In some embodiments, each event processing unit 190 includes one or more of the following: a data update unit 176, an object update unit 177, a GUI update unit 178, and / or event data 179 received from an event sorter 170. The event processing unit 190 optionally uses or calls the data update unit 176, the object update unit 177, or the GUI update unit 178 to update the application's internal state 192. Alternatively, one or more of the application views 191 include one or more event processing units 190. In some embodiments, one or more of the data update unit 176, object update unit 177, and GUI update unit 178 are included in each application view 191.
[0134] Each event recognition unit 180 receives event information (e.g., event data 179) from the event sorter 170 and identifies an event from this event information. The event recognition unit 180 includes an event receiving unit 182 and an event comparison unit 184. In some embodiments, the event recognition unit 180 also includes metadata 183 and at least a subset of event distribution commands 188 (optionally including sub-event distribution commands).
[0135] The event receiving unit 182 receives event information from the event sorter 170. The event information includes information about sub-events, such as touches or the movement of touches. Depending on the sub-event, the event information also includes additional information, such as the position of the sub-event. When the sub-event involves the movement of a touch, the event information also optionally includes the speed and direction of the sub-event. In some embodiments, an event includes the rotation of the device from one orientation to another (e.g., from portrait to landscape, or vice versa), and the event information includes corresponding information about the current orientation of the device (also called the device's orientation).
[0136] The event comparison unit 184 compares event information with a predefined definition of an event or sub-event, and based on the comparison, determines an event or sub-event, or determines or updates the state of an event or sub-event. In some embodiments, the event comparison unit 184 includes an event definition 186. The event definition 186 includes definitions of events (e.g., a sequence of default sub-events), such as event 1 (187-1) and event 2 (187-2). In some embodiments, sub-events within event (187) include, for example, touch start, touch end, touch movement, touch cancel, and multiple touches. In one embodiment, the definition for event 1 (187-1) is a double tap on a displayed object. A double tap includes, for example, a first touch on the displayed object for a predetermined stage (touch start), a first lift-off for the predetermined stage (touch end), a second touch on the displayed object for the predetermined stage (touch start), and a second lift-off for the predetermined stage (touch end). In another embodiment, event 2(187-2) is defined as a drag on a displayed object. The drag includes, for example, a touch (or contact) on the displayed object to a predetermined stage, movement of the touch across the touch-sensitive display 112, and lift-off of the touch (end of touch). In some embodiments, the event also includes information about one or more associated event processing units 190.
[0137] In some embodiments, the event definition 187 includes an event definition for each user interface object. In some embodiments, the event comparison unit 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view where three user interface objects are displayed on the touch-sensitive display 112, when a touch is detected on the touch-sensitive display 112, the event comparison unit 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with its respective event processing unit 190, the event comparison unit uses the results of the hit test to determine which event processing unit 190 should be activated. For example, the event comparison unit 184 selects the sub-event and the event processing unit associated with the object that triggers the hit test.
[0138] In some embodiments, the definition of each event 187 also includes a delay action that delays the delivery of event information until it is determined whether the sequence of sub-events corresponds to the event type of the event recognition unit.
[0139] If each event recognition unit 180 determines that a series of sub-events does not match any of the events in the event definition 186, each event recognition unit 180 enters an event impossible, event failed, or event terminated state and thereafter ignores subsequent sub-events of the touch-based gesture. In this situation, if there are other event recognition units that remain active for the hit view, those event recognition units continue to track and process the sub-events of the ongoing touch-based gesture.
[0140] In some embodiments, each event recognition unit 180 includes metadata 183 having configurable properties, flags, and / or lists that indicate to the actively involved event recognition unit how the event distribution system should perform sub-event distribution. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists that indicate how the event recognition units interact with each other, or how they can interact with each other. In some embodiments, the metadata 183 includes configurable properties, flags, and / or lists that indicate how sub-events are distributed to various levels in the view hierarchy or program hierarchy.
[0141] In some embodiments, each event recognition unit 180 activates an event processing unit 190 associated with an event when one or more specific sub-events of an event are recognized. In some embodiments, each event recognition unit 180 delivers event information associated with the event to the event processing unit 190. Activating the event processing unit 190 is separate from sending (and delaying the sending of) sub-events to the respective hit view. In some embodiments, the event recognition unit 180 sets a flag associated with the recognized event, and the event processing unit 190 associated with that flag captures the flag and executes a default process.
[0142] In some embodiments, the event distribution command 188 includes a sub-event distribution command that distributes event information about a sub-event without activating an event processing unit. Instead, the sub-event distribution command distributes event information to an event processing unit associated with a set of sub-events, or to a view that is actively involved. The event processing unit associated with the set of sub-events or the view that is actively involved receives the event information and performs predetermined processing.
[0143] In some embodiments, the data update unit 176 creates and updates data used in application 136-1. For example, the data update unit 176 updates telephone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, the object update unit 177 creates and updates objects used in application 136-1. For example, the object update unit 177 creates new user interface objects or updates the position of user interface objects. The GUI update unit 178 updates the GUI. For example, the GUI update unit 178 prepares display information and sends it to graphics module 132 for display on touch-sensitive display.
[0144] In some embodiments, the event processing unit(s) 190 includes or has access to a data update unit 176, an object update unit 177, and a GUI update unit 178. In some embodiments, the data update unit 176, the object update unit 177, and the GUI update unit 178 are included in a single module of their respective applications 136-1 or application view 191. In other embodiments, they are included in two or more software modules.
[0145] The foregoing description regarding the handling of user touch events on a touch-sensitive display also applies to other forms of user input for operating the multifunction device 100 using input devices, but it should be understood that not all of these begin on the touchscreen. For example, mouse movement and mouse button presses, touch movements such as taps, drags, and scrolls on a touchpad, pen stylus input, device movement, verbal commands, detected eye movements, biometric input, and / or any combination thereof may be optionally used as inputs corresponding to sub-events that define the events to be recognized.
[0146] Figure 2 shows a portable multifunction device 100 having a touchscreen 112 according to several embodiments. The touchscreen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment, and in other embodiments described below, the user can select one or more of the graphics by performing gestures on the graphics using, for example, one or more fingers 202 (not shown in the figure to an exact scale) or one or more styluses 203 (not shown in the figure to an exact scale). In some embodiments, the selection of one or more graphics is performed when the user interrupts contact with that one or more graphics. In some embodiments, the gesture optionally includes one or more taps, one or more swipes (from left to right, right to left, upward and / or downward), and / or rolling of a finger in contact with the device 100 (from right to left, left to right, upward and / or downward). In some implementations or situations, accidental contact with a graphic does not constitute a selection of that graphic. For example, if the gesture corresponding to selection is a tap, a swipe gesture sweeping over an application icon does not arbitrarily select the corresponding application.
[0147] Device 100 also optionally includes one or more physical buttons, such as a "Home" button or a menu button 204. As previously mentioned, the menu button 204 is optionally used to navigate to any application 136 within a set of applications running on device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touchscreen 112.
[0148] In some embodiments, device 100 includes a touchscreen 112, a menu button 204, a push button 206 for turning the device on / off and locking the device, volume control buttons 208, a subscriber identification module (SIM) card slot 210, a headset jack 212, and an external docking / charging port 124. The push button 206 is optionally used to turn the device on / off by pressing down and holding the button down for a predetermined period of time, to lock the device by pressing down and releasing the button before the predetermined period of time has elapsed, and / or to unlock the device or initiate an unlocking process. In alternative embodiments, device 100 also accepts verbal input via a microphone 113 to activate or deactivate certain functions. Device 100 also optionally includes one or more contact intensity sensors 165 for detecting the intensity of contact on the touchscreen 112, and / or one or more tactile output generators 167 for generating tactile output to the user of device 100.
[0149] Figure 3 is a block diagram of an exemplary multifunctional device having a display and a touch-sensitive surface according to several embodiments. Device 300 does not need to be portable. In some embodiments, device 300 is a laptop computer, desktop computer, tablet computer, multimedia player device, navigation device, educational device (such as a children's learning toy), game system, or control device (e.g., a home or commercial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, memory 370, and one or more communication buses 320 that interconnect these components. The communication buses 320 optionally include circuitry (sometimes called a chipset) that interconnects and controls communication between system components. Device 300 includes an input / output (I / O) interface 330 including a display 340, the display 340 is typically a touchscreen display. The I / O interface 330 also optionally includes a keyboard and / or mouse (or other pointing device) 350, a touchpad 355, a tactile output generator 357 that generates tactile output on device 300 (for example, similar to the tactile output generator 167 described above with reference to Figure 1A), and a sensor 359 (for example, an optical, acceleration, proximity, touch-sensing, and / or contact intensity sensor similar to the contact intensity sensor 165 described above with reference to Figure 1A). The memory 370 includes high-speed random-access memory such as DRAM, SRAM, DDR RAM, or other random-access solid-state memory devices, and optionally includes non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 370 optionally includes one or more storage devices located remotely from the CPU(s) 310.In some embodiments, memory 370 stores programs, modules, and data structures similar to, or subsets thereof, that are stored in memory 102 of the portable multifunction device 100 (Figure 1A). Furthermore, memory 370 optionally stores additional programs, modules, and data structures that are not present in memory 102 of the portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk authoring module 388, and / or a spreadsheet module 390, whereas memory 102 of the portable multifunction device 100 (Figure 1A) optionally does not store these modules.
[0150] Each of the elements identified above in Figure 3 is optionally stored in one or more of the memory devices described above. Each of the modules identified above corresponds to an instruction set that performs the function described above. The modules or programs (e.g., instruction sets) identified above do not need to be implemented as separate software programs, procedures, or modules, and therefore, in various embodiments, various subsets of these modules are optionally combined or otherwise reconfigured. In some embodiments, memory 370 optionally stores a subset of the modules and data structures identified above. Furthermore, memory 370 optionally stores additional modules and data structures not described above.
[0151] Next, we turn our attention to an optional embodiment of a user interface that may be implemented, for example, on a portable multi-functional device 100.
[0152] Figure 4A shows an exemplary user interface of an application menu on a portable multifunction device 100 according to several embodiments. A similar user interface is optionally implemented on device 300. In some embodiments, the user interface 400 includes the following elements, or subsets or supersets thereof. ●Signal strength indicators (single or multiple) for wireless communication (single or multiple) such as cellular signals and Wi-Fi® signals 402, ●Time 404, ●Bluetooth® indicator 405, ●Battery status indicator 406, ●Tray 408 containing icons for frequently used applications, as shown below. ○Optionally including an indicator 414 for the number of missed calls or voicemail messages, an icon 416 of the telephone module 138 labeled "Telephone", ○Optionally including an indicator 410 for the number of unread emails, an icon 418 of the email client module 140 labeled "Mail", ○ Icon 420 of browser module 147, labeled "Browser", and ○ Icon 422 of the video and music player module 152, also known as the iPod (trademark of Apple Inc.) module 152, labeled as "iPod", and ● Icons of other applications, such as the following: ○ Icon 424 of IM module 141, labeled "Message", ○ Icon 426 of calendar module 148, labeled "Calendar", ○ Icon 428 of image management module 144, labeled "Photo" ○ Icon 430 of camera module 143, labeled "Camera" ○ Icon 432 of online video module 155, labeled "online video" ○ Icon 434 of stock price widget 149-2, labeled "Stock Price" ○ Icon 436 of map module 154, labeled "Map" ○ Icon 438 of weather widget 149-1, labeled "Weather" ○ Icon 440 of the alarm clock widget 149-4, labeled "Clock" ○ Icon 442 of training support module 142, labeled "Training Support" ○ Icon 444 of memo module 153, labeled as "Memo", and ○ An icon 446 labeled "Settings," which provides access to settings for device 100 and its various applications 136, for a settings application or module.
[0153] Please note that the icon labels shown in Figure 4A are for illustrative purposes only. For example, the icon 422 for the video and music player module 152 may display "Music" or "Music Player," and other labels may be used optionally for various application icons. In some embodiments, the label for each application icon includes the name of the application corresponding to that application icon. In some embodiments, the label for a particular application icon is different from the name of the application corresponding to that particular application icon.
[0154] Figure 4B shows an exemplary user interface on a device (e.g., device 300 in Figure 3) having a touch-sensitive surface 451 (e.g., tablet or touchpad 355 in Figure 3) separate from the display 450 (e.g., touchscreen display 112). Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting the intensity of contact on the touch-sensitive surface 451, and / or one or more tactile output generators 357 for generating tactile output to the user of device 300.
[0155] Some of the following examples are given by referring to input on a touchscreen display 112 (a combination of a touch-sensing surface and a display), but in some embodiments, the device detects input on a touch-sensing surface separate from the display shown in Figure 4B. In some embodiments, the touch-sensing surface (e.g., 451 in Figure 4B) has a primary axis (e.g., 452 in Figure 4B) corresponding to a primary axis (e.g., 453 in Figure 4B) on the display (e.g., 450). According to these embodiments, the device detects contact with the touch-sensing surface 451 (e.g., 460 and 462 in Figure 4B) at locations corresponding to each location on the display (e.g., 460 corresponds to 468 and 462 corresponds to 470 in Figure 4B). In this way, user input (e.g., touches 460 and 462, and their movements) detected by the device on a touch-sensitive surface (e.g., 451 in Figure 4B) is used by the device to operate the user interface on the display of the multifunction device (e.g., 450 in Figure 4B) when the touch-sensitive surface is separate from the display. It should be understood that a similar method may be optionally used for other user interfaces described herein.
[0156] In addition, while the following examples are given primarily with reference to finger input (e.g., finger touch, finger tap gesture, finger swipe gesture), it should be understood that in some embodiments, one or more of the finger inputs may be replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture may be optionally replaced by a mouse click (e.g., instead of touch) followed by cursor movement along the swipe path (e.g., instead of touch movement). As another example, a tap gesture may be optionally replaced with a mouse click while the cursor is positioned over the tap gesture location (e.g., instead of detecting touch and then ceasing touch detection). Similarly, it should be understood that when multiple user inputs are detected simultaneously, multiple computer mice may be optionally used simultaneously, or mouse and finger touch may be optionally used simultaneously.
[0157] Figure 5A shows an exemplary personal electronic device 500. Device 500 includes a body 502. In some embodiments, device 500 may include some or all of the features described with respect to devices 100 and 300 (e.g., Figures 1A-4B). In some embodiments, device 500 has a touch-sensitive display screen 504, hereafter referred to as touchscreen 504. Alternatively, in addition to touchscreen 504, device 500 may have a display and a touch-sensitive surface. Similar to devices 100 and 300, in some embodiments, touchscreen 504 (or touch-sensitive surface) optionally includes one or more intensity sensors that detect the intensity of the applied contact (e.g., touch). One or more intensity sensors on touchscreen 504 (or touch-sensitive surface) may provide output data representing the intensity of the touch. The user interface of device 500 may respond to touches based on the intensity of the touch, meaning that touches of different intensity may invoke different user interface behaviors on device 500.
[0158] Exemplary techniques for detecting and processing touch intensity can be found, for example, in related applications, International Patent Application No. PCT / US2013 / 040061, “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” filed on 8 May 2013 and published as International Patent No. WO / 2013 / 169849, and International Patent Application No. PCT / US2013 / 069483, “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” filed on 11 November 2013 and published as International Patent No. WO / 2014 / 105276.
[0159] In some embodiments, the device 500 has one or more input mechanisms 506 and 508. The input mechanisms 506 and 508, if included, can be physical mechanisms. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, the device 500 has one or more attachment mechanisms. Such attachment mechanisms, if included, can allow the device 500 to be attached to, for example, a hat, eyewear, earrings, necklace, shirt, jacket, bracelet, watch band, chain, trousers, belt, shoes, wallet, backpack, etc. These attachment mechanisms allow the user to wear the device 500.
[0160] Figure 5B shows an exemplary personal electronic device 500. In some embodiments, the device 500 may include some or all of the components described with respect to Figures 1A, 1B, and 3. The device 500 has a bus 512 that operably connects an I / O section 514 to one or more computer processors 516 and memory 518. The I / O section 514 may be connected to a display 504, which may have a touch-sensing component 522 and optionally an intensity sensor 524 (e.g., a contact intensity sensor). In addition, the I / O section 514 may be connected to a communication unit 530 that receives application and operating system data using Wi-Fi, Bluetooth®, Near Field Communication (NFC), cellular, and / or other wireless communication techniques. The device 500 may include input mechanisms 506 and / or 508. The input mechanism 506 may optionally be, for example, a rotatable input device or a pressable and rotatable input device (e.g., a rotating crown). In some examples, the input mechanism 508 is optionally a button.
[0161] In some examples, the input mechanism 508 is optionally a microphone. The personal electronic device 500 optionally includes a variety of sensors such as a GPS sensor 532, an accelerometer 534, a direction sensor 540 (e.g., a compass), a gyroscope 536, a motion sensor 538, and / or a combination thereof, all of which can be operably connected to the I / O section 514.
[0162] The memory 518 of the personal electronic device 500 may include one or more non-temporary computer-readable storage media for storing computer-executable instructions, which, when executed by one or more computer processors 516, can cause the computer processors to execute techniques described below, including, for example, process 700 (Figures 7A-7C), process 900 (Figures 9A and 9B), process 1100 (Figure 11), and process 1300 (Figures 13 and 13B). The computer-readable storage media can be any medium that can tangibly contain or store computer-executable instructions for use by or connected to an instruction execution system, apparatus, or device. In some embodiments, the storage medium is a temporary computer-readable storage medium. In some embodiments, the storage medium is a non-temporary computer-readable storage medium. The non-temporary computer-readable storage medium may include, but is not limited to, magnetic, optical, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, CDs, DVDs, or optical disks based on Blu-ray technology, as well as resident solid-state memory such as flash and solid-state drives. The personal electronic device 500 is not limited to the components and configurations shown in Figure 5B, and may include other or additional components in multiple configurations.
[0163] In this specification, the term "affordance" refers to user-interactive graphical user interface objects that are optionally displayed on the display screens of devices 100, 300, and / or 500 (Figures 1A, 3, and 5A-5B). For example, images (e.g., icons), buttons, and text (e.g., hyperlinks) each optionally constitute affordances.
[0164] As used herein, the term “focus selector” refers to an input element that indicates the current part of the user interface that the user is interacting with. In some implementations, including a cursor or other location marker, the cursor acts as a “focus selector,” and therefore, when input (e.g., a press input) is detected on a touch-sensitive surface (e.g., touchpad 355 in Figure 3 or touch-sensitive surface 451 in Figure 4B) while the cursor is positioned over a particular user interface element (e.g., a button, window, slider, or other user interface element), the particular user interface element is adjusted according to the detected input. In some implementations, including a touchscreen display that enables direct interaction with user interface elements on the touchscreen display (e.g., touch-sensitive display system 112 in Figure 1A or touchscreen 112 in Figure 4A), detected contact on the touchscreen acts as a “focus selector,” and therefore, when input (e.g., a press input by touch) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touchscreen display, the particular user interface element is adjusted according to the detected input. In some implementations, focus is moved from one area of the user interface to another without the movement of a corresponding cursor or touch on the touchscreen display (e.g., by using the tab key or arrow keys to move focus from one button to another), and in these implementations, the focus selector moves in accordance with the movement of focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is generally a user interface element (or touch on the touchscreen display) that is controlled by the user to communicate the user's intended interaction through the user interface (e.g., by indicating to the device the user interface element in which the user intends to interact).For example, the position of a focus selector (e.g., cursor, touch, or selection box) over a corresponding button while pressure input is detected on a touch-sensitive surface (e.g., a touchpad or touchscreen) indicates that the user intends to activate that corresponding button (rather than other user interface elements displayed on the device's display).
[0165] As used herein and in the claims, the term “characteristic intensity” of a contact refers to the characteristics of that contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a set of intensity samples collected over a predetermined period (e.g., 0.05, 0.1, 0.2, 0.5, 1, 2, 5, 10 seconds) associated with a predetermined event (e.g., after detection of contact, before detection of lift-off of contact, before or after detection of the start of movement of contact, before detection of the end of contact, before or after detection of an increase in contact intensity, and / or before or after detection of a decrease in contact intensity). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of the contact intensity, the mean value of the contact intensity, the average value of the contact intensity, the top 10 percentile value of the contact intensity, the maximum half value of the contact intensity, the maximum 90 percent value of the contact intensity, etc. In some embodiments, the duration of contact is used when determining characteristic intensity (for example, when characteristic intensity is the average intensity of contact over time). In some embodiments, characteristic intensity is compared to a set of one or more intensity thresholds to determine whether an action has been performed by the user. For example, a set of one or more intensity thresholds optionally includes a first intensity threshold and a second intensity threshold. In this example, contact with a characteristic intensity not exceeding the first threshold results in a first action, contact with a characteristic intensity exceeding the first intensity threshold but not exceeding the second intensity threshold results in a second action, and contact with a characteristic intensity exceeding the second threshold results in a third action. In some embodiments, the comparison between characteristic intensity and one or more thresholds is not used to determine whether a first action should be performed or a second action should be performed, but rather to determine whether one or more actions should be performed at all (for example, whether each action should be performed or whether each action should be refrained from).
[0166] Figure 5C shows that multiple intensity sensors 524A-524D detect multiple contacts 552A-552E on a touch-sensitive display screen 504. Figure 5C also includes an intensity diagram showing the current intensity measurements of intensity sensors 524A-524D against intensity units. In this example, the intensity measurements of intensity sensors 524A and 524D are 9 intensity units each, and the intensity measurements of intensity sensors 524B and 524C are 7 intensity units each. In some implementations, the aggregate intensity is the sum of the intensity measurements of the multiple intensity sensors 524A-524D, which in this example is 32 intensity units. In some embodiments, each contact is assigned a corresponding intensity, which is a portion of the aggregate intensity. Figure 5D shows that the aggregate intensity is assigned to contacts 552A-552E based on their distance from the center of force 554. In this example, contacts 552A, 552B, and 552E are each assigned a contact intensity of 8 intensity units of the aggregate intensity, and contacts 552C and 552D are each assigned a contact intensity of 4 intensity units of the aggregate intensity. More generally, in some implementations, each contact j is assigned an intensity Ij, which is a portion of the total intensity A, according to a predetermined mathematical function Ij = A·(Dj / ΣDi), where Dj is the distance from the center of force to each contact j, and ΣDi is the sum of the distances from the center of force to each of the contacts (e.g., from i=1 to the end). The operations described with reference to Figures 5C-5D can be performed using electronic devices similar to or identical to devices 100, 300, or 500. In some embodiments, the characteristic intensity of a contact is based on one or more intensities of the contact. In some embodiments, an intensity sensor is used to determine a single characteristic intensity (e.g., a single characteristic intensity of a single contact). Please note that the intensity diagrams are not part of the display user interface, but are included in Figures 5C-5D to assist the reader.
[0167] In some embodiments, a portion of the gesture is identified for the purpose of determining characteristic intensity. For example, a touch-sensitive surface optionally receives a series of swipe contacts transitioning from a start location to an end location, at which point the intensity of the contact increases. In this example, the characteristic intensity of the contact at the end location is optionally based only on a portion of the series of swipe contacts (e.g., only the portion of the swipe contact that reaches the end location), rather than the entire swipe contact. In some embodiments, optionally, a smoothing algorithm is applied to the intensity of the swipe contact before determining the characteristic intensity of the contact. For example, the smoothing algorithm optionally includes one or more of the following: an unweighted moving average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some situations, these smoothing algorithms eliminate small increases or decreases in the intensity of the swipe contact for the purpose of determining characteristic intensity.
[0168] The intensity of contact on the touch-sensitive surface is optionally characterized with respect to one or more intensity thresholds, such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to the intensity at which the device performs an action typically associated with clicking a physical mouse button or trackpad. In some embodiments, the deep press intensity threshold corresponds to the intensity at which the device performs an action different from the action typically associated with clicking a physical mouse button or trackpad. In some embodiments, when a contact with a characteristic intensity below the light press intensity threshold (e.g., above the nominal contact detection intensity threshold below which contact is no longer detected) is detected, the device moves the focus selector in accordance with the movement of the contact on the touch-sensitive surface without performing an action associated with the light press intensity threshold or the deep press intensity threshold. Generally, unless otherwise specified, these intensity thresholds are consistent across different sets of user interface diagrams.
[0169] An increase in the characteristic intensity of contact from an intensity below a light pressure intensity threshold to an intensity between the light and deep pressure intensity thresholds is sometimes referred to as a "light pressure" input. An increase in the characteristic intensity of contact from an intensity below a deep pressure intensity threshold to an intensity above a deep pressure intensity threshold is sometimes referred to as a "deep pressure" input. An increase in the characteristic intensity of contact from an intensity below a contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light pressure intensity threshold is sometimes referred to as the detection of contact on the touch surface. A decrease in the characteristic intensity of contact from an intensity above a contact detection intensity threshold to an intensity below a contact detection intensity threshold is sometimes referred to the detection of contact lift-off from the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.
[0170] In some embodiments described herein, one or more actions are performed in response to the detection of a gesture including each press input, or in response to the detection of each press input performed by each (or more) contact, and each press input is detected at least in part on the detection of an increase in the intensity of the contact (or more) above a press input intensity threshold. In some embodiments, each action is performed in response to the detection of an increase in the intensity of each contact above a press input intensity threshold (e.g., a "downstroke" of each press input). In some embodiments, a press input includes an increase in the intensity of each contact above a press input intensity threshold, followed by a decrease in the intensity of the contact below the press input intensity threshold, and each action is performed in response to the detection of a decrease in the intensity of each contact below the press input threshold (e.g., an "upstroke" of each press input).
[0171] Figures 5E-5H show the intensity threshold for light pressure in Figure 5E (for example, "IT L From an intensity below ) to the deep press intensity threshold in Figure 5H (for example, "IT DThe device indicates the detection of a gesture including a press input corresponding to an increase in the intensity of contact 562 to an intensity exceeding the intensity of a deep press (e.g., "IT"). The gesture performed by contact 562 is detected on the touch-sensitive surface 560, and on the display user interface 570, which includes application icons 572A to 572D displayed within a predetermined area 574, a cursor 576 is displayed over the application icon 572B corresponding to app 2. In some embodiments, the gesture is detected on the touch-sensitive display 504. An intensity sensor detects the intensity of contact on the touch-sensitive surface 560. The device indicates that the intensity of contact 562 exceeds the intensity threshold for a deep press (e.g., "IT"). D It is determined that the touch has reached its peak by exceeding the "IT" threshold. Contact 562 is maintained on the touch sensing surface 560. In response to the detection of the gesture, the intensity threshold for deep press during the gesture (e.g., "IT") is determined. D According to a contact 562 having an intensity exceeding '', a scaled representation 578A-578C (e.g., thumbnail) of the recently opened document is displayed for app 2, as shown in Figures 5F-5H. In some embodiments, this intensity, compared to one or more intensity thresholds, is the characteristic intensity of the contact. Note that the intensity diagram for contact 562 is not part of the display user interface but is included in Figures 5E-5H to assist the reader.
[0172] In some embodiments, the display of representations 578A to 578C includes animation. For example, as shown in Figure 5F, representation 578A is initially displayed close to the application icon 572B. As the animation progresses, as shown in Figure 5G, representation 578A moves upward and representation 578B is displayed close to the application icon 572B. Then, as shown in Figure 5H, representation 578A moves upward and representation 578B moves upward toward representation 578A and representation 578C is displayed close to the application icon 572B. Representations 578A to 578C form an array above the icon 572B. In some embodiments, as shown in Figures 5F to 5G, the animation progresses according to the intensity of the contact 562, where the intensity of the contact 562 is a deep press intensity threshold (e.g., "IT").D As it increases toward (), expressions 578A-578C appear and move upward. In some embodiments, the intensity on which the animation progresses is based is the characteristic intensity of the contact. The actions described with reference to Figures 5E-5H can be performed using electronic devices similar to or identical to devices 100, 300, or 500.
[0173] In some embodiments, the device employs intensity hysteresis to avoid accidental inputs, which may be referred to as “jitter,” and the device defines or selects a hysteresis intensity threshold that has a predetermined relationship with a press input intensity threshold (for example, the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable percentage of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of each contact above the press input intensity threshold, followed by a decrease in the intensity of the contact below the hysteresis intensity threshold corresponding to the press input intensity threshold, and each action is performed in response to the detection of a subsequent decrease in the intensity of each contact below the hysteresis intensity threshold (for example, an “upstroke” of each press input). Similarly, in some embodiments, a press input is detected only when the device detects an increase in contact intensity from below a hysteresis intensity threshold to above a press input intensity threshold, and optionally a decrease in contact intensity to below the hysteresis intensity, and each action is performed in response to the detection of a press input (e.g., depending on the situation, an increase in contact intensity or a decrease in contact intensity).
[0174] For the sake of clarity, the description of an action performed in response to a press input associated with a press input intensity threshold, or a gesture involving a press input, is optionally triggered in response to the detection of any of the following: an increase in contact intensity above the press input intensity threshold, an increase in contact intensity from below the hysteresis intensity threshold to above the press input intensity threshold, a decrease in contact intensity below the press input intensity threshold, and / or a decrease in contact intensity below the hysteresis intensity threshold corresponding to the press input intensity threshold. Furthermore, in examples where an action is described to be performed in response to the detection of a decrease in contact intensity below the press input intensity threshold, the action is optionally performed in response to the detection of a decrease in contact intensity below a hysteresis intensity threshold corresponding to and lower than the press input intensity threshold.
[0175] In this specification, “installed application” refers to a software application that has been downloaded onto an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched on the device (e.g., opened). In some embodiments, a downloaded application becomes an installed application by an installation program that extracts the program portion from the downloaded package and integrates the extracted portion with the operating system of the computer system.
[0176] In this specification, the terms “open application” or “running application” refer to a software application that has retained state information (e.g., as part of the device / global internal state 157 and / or application internal state 192). An open or running application is optionally one of the following types of applications: ● The active application currently displayed on the display screen of the device on which the application is being used. ● Background applications (or background processes) that are not currently displayed but whose applications have one or more processes being handled by one or more processors, and ● An application in a suspended or hibernating state that is not running but has state information stored in memory (both volatile and non-volatile) that can be used to resume the execution of the application.
[0177] In this specification, the term “closed application” refers to a software application that does not retain state information (for example, state information for a closed application is not stored in the device’s memory). Therefore, closing an application involves stopping and / or removing the application process for the application and removing the state information for the application from the device’s memory. Generally, opening a second application while a first application is running does not close the first application. When the second application is displayed and the first application is closed, the first application becomes a background application.
[0178] Here, we focus on embodiments of user interfaces ("UI") and related processes implemented on one or more electronic devices, such as portable multifunction device 100, device 300, or device 500.
[0179] Figures 6A to 6AE show exemplary user interfaces for initial setup of health monitoring according to several embodiments. The user interfaces in these figures are used to illustrate the processes described below, including the processes in Figures 7A to 7C. The exemplary user interfaces in these figures relate to monitoring health using recorded biometric information and are not limited to any particular type of biometric information. For convenience only, the exemplary user interfaces in these figures will be described with reference to one type of biometric information, electrocardiogram (ECG) information.
[0180] Figure 6A shows a first electronic device 600A (e.g., a smartphone) having a display 602 and one or more input devices. In some embodiments, the one or more input devices include a touch layer of the display 602 for detecting touch input, one or more image sensors 604 (e.g., a camera, a depth sensor), a first mechanical button 606 (e.g., including an integrated biosensor such as a fingerprint sensor) configured to perform one or more actions, and a second mechanical button 608 configured to perform one or more actions. In some embodiments, the first electronic device 600A includes a wireless communication radio (e.g., for LTE, Bluetooth®, WiFi® connectivity). In some embodiments, the first electronic device 600A is paired with a second electronic device (e.g., a smartwatch). In some embodiments, the second electronic device corresponds to a second electronic device 600B, which is described below with reference to Figures 6S to 6X.
[0181] In Figure 6A, the first electronic device 600A displays a home screen user interface 610 on the display 602, which corresponds to the home screen of the operating system running on the device. In some embodiments, the home screen user interface 610 includes a number of icons corresponding to different applications installed on the device, including a health application corresponding to icon 610A. In some embodiments, the health application can be used to manage the user's biometric information, such as heart rhythm information and / or heart rate information (for example, using recorded ECG information).
[0182] In some embodiments, the first electronic device 600A detects user activation 601 of an icon 610A corresponding to a health application that includes functions for managing the recording of biometric information, including ECG information (e.g., via touch input). In response to detecting user activation 601, the first electronic device 600A launches the health application (e.g., by replacing the display of the home screen user interface 610 with the user interface of the health application).
[0183] In some embodiments, the health application includes ECG affordances for viewing and managing existing ECG records on the device, the ECG information is recorded using an associated ECG application on a second electronic device (e.g., the second electronic device 600B as described with reference to Figures 6S-6X), and the ECG application on the second electronic device (e.g., the second electronic device 600B) is associated with the ECG management function of the health application on the first electronic device 600A. In some embodiments, if the ECG management function has not yet been set up on the first electronic device 600A (e.g., the user has not yet used the ECG recording function), the health application is activated to trigger the ECG management function (e.g., in response to detecting a user selection of ECG affordances), which in turn triggers the display of a first page of a tutorial for performing the initial setup of the health application's ECG management function (e.g., as described with reference to Figure 6F).
[0184] In some embodiments, the home screen user interface 610 includes a paired device application that corresponds to icon 610B and is associated with a device paired with the first electronic device 600A (e.g., a second electronic device 600B). In some embodiments, while the home screen user interface 610 is displayed, the first electronic device 600A detects user activation 641 of icon 610B (e.g., via tap input), as shown in Figure 6B.
[0185] In some embodiments, upon detecting user activation 641, the first electronic device 600A displays the main user interface 643 of the paired device's application on the display 602, as shown in Figure 6C. In some embodiments, the paired device's application includes a plurality of application setting affordances 645A-645H corresponding to various applications installed on the paired device (e.g., the second electronic device 600B), including a cardiac application setting affordance 645G corresponding to a cardiac application (e.g., an ECG application) installed on the paired device. In some embodiments, while displaying the main user interface 643 of the paired device's application, the device detects user activation 647 of the cardiac application setting affordance 645G (e.g., via tap input).
[0186] In some embodiments, upon detecting user activation 647 of the cardiac application setting affordance 645G, the first electronic device 600A displays an application setting page 649 on the display 602, as shown in Figure 6D, for changing and / or configuring the application settings of the corresponding cardiac application (e.g., the ECG application) on the second electronic device 600B. In some embodiments, if the ECG management function has not yet been set up on the first electronic device 600A, the application setting page 649 includes an affordance 651 (e.g., an affordance labeled “Set up ECG function” or “Set up ECG application in health”) for performing the initial setup of the ECG management function. In some embodiments, upon detecting user activation 651 of the first electronic device 600A, it launches the first page of the tutorial (as illustrated, for example, with reference to Figure 6F).
[0187] Figure 6E shows a first electronic device 600A displaying a (selectable) notification 612 on the display 602 indicating (to the device user) that an ECG application associated with a health application on the first electronic device 600A has been launched (or is active) on a second electronic device (e.g., a second electronic device 600B). In some embodiments, the notification 612 is displayed on the lock screen user interface of the first electronic device. In some embodiments, the notification 612 is displayed within the device's home screen user interface 610 (e.g., at the top of the display). In some embodiments, the notification 612 is displayed on the user interface of an application running on the device (e.g., an email application, a web browser application).
[0188] In some embodiments, notification 612 indicates that initial setup (e.g., orientation) of the health application's ECG management function is required to utilize the application's ECG functionality. In some embodiments, while notification 612 is displayed, the first electronic device 600A detects a user selection 603 of notification 612 (e.g., via touch input). In response to detecting the user selection 603, the first electronic device 600A launches the first page of a tutorial for performing the initial setup of the ECG management function and associated ECG application.
[0189] Figure 6F shows a first electronic device 600A that displays the first page 614 of a tutorial for performing the initial setup of the ECG management function and associated ECG applications on a display 602. In some embodiments, the first page 614 of the tutorial includes a graphical indication area 614A that graphically shows (e.g., via still images, via animation) a description of how to perform the functions of the ECG management function and associated ECG applications (e.g., recording heart rhythm information and / or heart rate information) and (e.g., using the associated ECG application on a smartwatch paired with the device). In some embodiments, the first page 614 of the tutorial includes a text description area 614B that describes the use of the ECG management function and associated ECG applications (e.g., describing "check your heart rhythm") and background information related to the use of the ECG management function and associated ECG applications.
[0190] In some embodiments, the first page 614 of the tutorial includes a date of birth input field 614C for accepting user input corresponding to the user's date of birth, which is used to determine whether the user meets the minimum age requirement (e.g., 22 years old) for using the functionality of the ECG application. In some embodiments, the date of birth input field 614C includes scrollable month, day, and year fields. In some embodiments, the first page 614 of the tutorial does not include the date of birth input field 614C. In some embodiments, the first page 614 of the tutorial includes an age restriction message (e.g., "You must be 22 years of age or older") indicating to the user that the user must meet the minimum age requirement (e.g., "You must be 22 years of age or older").
[0191] In some embodiments, the first page 614 of the tutorial includes an affordance 614D for advancing the tutorial. In Figure 6F, while displaying the first page 614 of the tutorial for performing the initial setup of the ECG management function and associated ECG application, the first electronic device 600A detects user activation 605 of affordance 614D for advancing the tutorial (e.g., via touch input). In some embodiments, in accordance with a determination that the minimum age requirement is not met (e.g., a determination made in response to the detection of user activation 605), the first electronic device 600A displays an error notification on the display 602 indicating that the user does not meet the required minimum age requirement (e.g., stating, "The ECG application is not intended for use by persons under 22 years of age"). In some embodiments, the error notification is superimposed on the first page 614 of the tutorial. In some embodiments, while displaying the error notification, the background of the display (displaying the first page 614) is darkened (therefore to highlight the displayed error notification).
[0192] In some embodiments, upon detection of user activation 605 (and in accordance with the determination that the minimum age requirement is met), the first electronic device 600A displays the second page 616 of the tutorial on the display 602, as shown in Figure 6G (for example, replacing the display of the first page 614).
[0193] Figure 6G shows a first electronic device 600A on display 602 that displays a second page 616 of a tutorial for performing the initial setup of the ECG management function and associated ECG application (for example, the associated ECG application is running on or can be launched on a second electronic device such as a second electronic device 600B). In some embodiments, the second page 616 of the tutorial includes an animation area 616A that graphically displays exemplary ECG information captured using the application (for example, via still images, via animation). In some embodiments, the animation area 616A includes an exemplary tachogram animation. In some embodiments, the exemplary tachogram animation includes one or more objects that move sequentially across the animation by tracking the tachogram-like portion of the animation. In some embodiments, the second page 616 of the tutorial includes a text description area 616B that summarizes how ECG information is captured from the user and how the recorded biometric information can be viewed by the user. In some embodiments, the second page 616 of the tutorial includes affordances 616C for advancing the tutorial.
[0194] In Figure 6G, while displaying the second page 616 of the tutorial for performing the initial setup of the ECG management function and associated ECG applications, the first electronic device 600A detects user activation 607 of affordance 616C to advance the tutorial (e.g., via touch input). In some embodiments, upon detecting user activation 607, the device displays a possible result page 618 of the tutorial on the display 602 (e.g., replacing the display of the first page 616) as shown in Figure 6H.
[0195] Figure 6H shows a first electronic device 600A displaying a possible results page 618 of a tutorial for performing the initial setup of the ECG management function and associated ECG applications on a display 602. In some embodiments, the possible results page 618 includes multiple representations of possible evaluation results, which can be created based on ECG information recorded using the associated ECG application on a second electronic device (e.g., second electronic device 600B).
[0196] In some embodiments, the multiple representations of possible evaluation results shown on page 618 of the tutorial include possible evaluation results corresponding to heart rhythm and heart rate captured from the ECG recording. In some embodiments, the first possible evaluation result is a “normal rhythm” result (or “normal result”) corresponding to the result in which no abnormal signs were detected from the user’s ECG recording. In some embodiments, the second possible evaluation result is an “abnormal heart rhythm” result (e.g., “atrial fibrillation” result) corresponding to the result in which abnormal heart rhythm signs (and possibly high / low heart rate signs) were detected from the user’s ECG recording. In some embodiments, the third possible evaluation result is an “abnormal heart rate” result (e.g., “high or low heart rate” result) corresponding to the result in which a heart rate higher or lower than normal (or abnormally high) (e.g., above 150 BPM or below 50 BPM) was detected from the user’s ECG recording. In some embodiments, a fourth possible evaluation result is an "uncertain" result, which corresponds to a result where the evaluation result cannot be determined from the user's ECG record (for example, due to poor quality readings).
[0197] In some embodiments, as shown in Figure 6H, the possible results page 618 shows multiple representations of possible evaluation results, where not all representations are visible on the display simultaneously. In Figure 6H, the representation 620 of the first evaluation result ("normal" result) and the representation (partial) of the second ejection result ("atrial fibrillation" result) 622 are visible on the display.
[0198] In some embodiments, as shown in Figure 6H, each representation of a possible evaluation result shown on page 618 includes an animation area containing a graphical animation representing the corresponding evaluation result (e.g., a tachogram-like animation, a beating heart animation, or one or more objects moving continuously / repeatedly across a tachogram-like animation at a specific frequency), and a text area containing a portion of a text description explaining the (medical) characteristics of the corresponding evaluation result.
[0199] In Figure 6H, the representation of the “normal” result 620 includes an animation area 620A containing an exemplary animation of the “normal” result and a text area 620B showing a portion of text description describing the characteristics of the “normal” result, while the representation of the “atrial fibrillation” result 622 includes an animation area 622A containing an exemplary animation of the “atrial fibrillation” result and a text area 622B showing a portion of text description describing the medical characteristics of the “atrial fibrillation” result. In some embodiments, the animations include a beating heart animation and a tachogram-like animation that shows a combination of heartbeat rhythm and velocity.
[0200] In some embodiments, the representation of possible evaluation results also includes extended affordances (e.g., “Show More” affordances) for displaying a complete text description of each evaluation result (e.g., by expanding the text area). In Figure 6H, the representation 620 for “normal” results includes an extended affordance 620C that, when selected (e.g., via touch input), causes the display of a complete text description of the “normal” result (e.g., including additional text information not shown in text area 620B), and the representation 622 for “atrial fibrillation” results includes an extended affordance 622C that, when selected (e.g., via touch input), causes the display of a complete text description of the “atrial fibrillation” result (e.g., including additional text information not shown in text area 622B).
[0201] In Figure 6I, while displaying a possible result page 618 having representations 620 and 622 visible on the display 602, the first electronic device 600A detects a scroll input 609 (e.g., a scroll touch gesture on the display). In response to detecting the scroll input 609, the device scrolls the possible result page 618 so that one or more other representations of other possible evaluation results are visible on the display 602, as shown in Figure 6J.
[0202] In Figure 6J, the representation 624 for the “high or low heart rate” result is fully visible on the display 602. Like other representations of possible assessment results, representation 624 includes an animation area 624A containing an exemplary graphical animation of the “high or low heart rate” result, a text area 624B showing a portion of the text description explaining the medical characteristics of the “high or low heart rate” result, and an extended affordance 624C to extend the text area 624C to fully display all of the text of the text description. Also in Figure 6J, the representation 622 for “atrial fibrillation” remains fully visible on the display, while only a portion of the representation 626 for the “uncertain” result is visible on the display.
[0203] In Figure 6K, while displaying a possible results page 618 having a representation 620 of the “atrial fibrillation” result visible on display 602, the first electronic device 600A detects user activation 611 of the augmented affordance 622C (e.g., via touch input) (e.g., because the user wants to see all the text of the text description explaining the “atrial fibrillation” result). As shown in Figure 6L, in response to detecting user activation 622C of the augmented affordance 622C, the first electronic device 600A expands the text area 622B of the representation 622 of the “atrial fibrillation” result to display the entire text of the text description. In some embodiments, when the text area is expanded, the augmented affordance is removed from the representation. In some embodiments, when the text area is expanded, the augmented affordance is replaced with a contraction affordance (e.g., the “show less” affordance).
[0204] In Figure 6M, while displaying a possible result page 618 on display 602 having an extended text area 622C of the representation 622 for the “atrial fibrillation” result, the first electronic device detects a scroll input 613 (e.g., a scroll touch gesture) (e.g., via the touch layer of the display). In response to detecting the scroll input 613, the device scrolls the possible result page 618 so that the entire representation 626 for the “uncertain” result is visible on the display, as shown in Figure 6N.
[0205] In Figure 6N, the representation 626 of the “uncertain” result is fully visible on the display 602. Like other representations of possible evaluation results, representation 626 includes an animation area 626A containing an exemplary graphical animation of the “uncertain” result, a text area 626B showing a portion of the text description explaining the medical properties of the “uncertain” result, and an extended affordance 626C to extend the text area 626C to fully show all of the text of the text description. In some embodiments, the possible result page 618 includes an affordance 628 for advancing the tutorial (e.g., at the bottom of the page).
[0206] In some embodiments, as described above, the animations of the plurality of representations 620-626 of the possible evaluation results on the possible result page 618 (of the animation regions 620A-626A) include animations of a beating heart and tachogram-like animations that combine to indicate the rhythm and speed of the heartbeat. In some embodiments, the animations are synchronized. In some examples, each animation includes a repeating loop, and each loop consists of an object (e.g., a circular object) that moves across the screen out of the animation of the beating heart while tracking the tachogram-like animation. The repeating loops of the plurality of animations (of the representations 620-626) are synchronized to start and end at synchronized time intervals.
[0207] In FIG. 6N, while displaying the affordance 628 of the possible result page 618 for advancing the tutorial on the display 602, the first electronic device 600A detects the user activation 615 of the affordance 628 for advancing the tutorial (e.g., via a touch input). In response to detecting the user activation 615, the first electronic device 600A displays the restriction page 630 on the display 602 (e.g., replaces the display of the possible result page 618 with it), as shown in FIG. 6O.
[0208] In some embodiments, the restriction page 630 shows the user some restrictions of the evaluation results determined from an ECG record taken on a second electronic device (e.g., the second electronic device 600B) (e.g., via a text description). In some examples, the restriction page 630 includes a list 630A of one or more medical characteristics (e.g., heart attack, thrombus / stroke) that cannot be determined from the recorded ECG information. In some embodiments, the restriction page 630 includes an affordance 630B for advancing the tutorial (e.g., at the bottom of the page).
[0209] In Figure 6O, while displaying the restriction page 630 on the display 602, the first electronic device 600A detects user activation 617 of affordance 630B for advancing the tutorial (e.g., via touch input). In some embodiments, upon detecting user activation 617 of affordance 630B, the device displays instruction page 632 on the display 602, as shown in Figure 6P.
[0210] In some embodiments, one or more of the tutorial pages 614, 616, 618, and / or 632 (as shown in Figures 6F, 6G, 6H, and 6O, respectively) include a cancel affordance. In some embodiments, upon detecting a user selection of a cancel affordance (e.g., one of the tutorial pages 614, 616, 618, and / or 632), the first electronic device 600A displays a notification 653 on the display 602, as shown in Figure 6Q. In some embodiments, the notification 653 includes an indication 653A (e.g., "If you cancel here, you can take an ECG after you have completed the initial setup") informing the user that the current progress through the tutorial will be lost and that the user needs to restart the initial setup process in order to begin taking an ECG on the second electronic device 600B. In some embodiments, notification 653 includes a confirmation affordance 653B (e.g., "Configure Later") to confirm the cancellation of the setup process and thus exit the tutorial. In some embodiments, while notification 653 is displayed, the background of the display is darkened (therefore to highlight notification 653).
[0211] Figure 6P shows a first electronic device 600A displaying instruction page 632 on a display 602. In some embodiments, instruction page 632 includes a graphical indication area 632A and a text indication area 632B that provides instructions on how to proceed with an ECG recording using a second electronic device (e.g., a second electronic device 600B). In some embodiments, the graphical indication area 632A corresponds to the graphical indication area 614A on the first page 614 of the tutorial and graphically shows (e.g., via still images, via animation) that the user is taking an ECG recording using a second electronic device (e.g., a second electronic device 600B). In some embodiments, the text indication area 632B includes a list of instructions that include the steps necessary to perform an ECG recording on a second electronic device, which may be, for example, a smartwatch (e.g., a second electronic device 600B) having one or more biosensors paired with the first electronic device 600A.
[0212] In some embodiments, instruction page 632 includes a deferral affordance 632C (e.g., indicating “Take a recording later”) which allows the user to postpone taking a first ECG recording (and thus allow the user to complete the initialization process without performing a first ECG recording). In some embodiments, while instruction page 632 is being displayed, the first electronic device 600A detects user activation 631 of the deferral affordance 632C (e.g., via touch input).
[0213] In some embodiments, upon detecting user activation 631 of the deferred affordance 632C, the first electronic device 600A displays an acknowledgment notice 633 on the display 602, as shown in Figure 6R. In some embodiments, the acknowledgment notice 633 is superimposed on the instruction page 632. In some embodiments, the acknowledgment notice 633 includes a text indication 633A that indicates to the user that the initialization process is complete and that a second electronic device (e.g., the second electronic device 600B) is now capable of performing an ECG recording. In some embodiments, the acknowledgment notice 633 includes an acknowledgment affordance 633B for acknowledging the completion of the ECG initialization process (without taking the first ECG recording) and exiting the initialization process. In some embodiments, in addition to the acknowledgment notice 633, the device displays a cancel affordance 635 for discarding the acknowledgment notice 633 and returning to the instruction page 632. In some embodiments, while the acknowledgment notice 633 (and the cancellation affordance 635) is displayed, the background of the display (which displays instruction page 632) is darkened (therefore to highlight the displayed acknowledgment notice).
[0214] Figures 6S to 6X show a second electronic device 600B (e.g., a smartwatch) having a display 634 and one or more input devices (e.g., including a touch layer of the display 634 and one or more mechanical buttons such as a pressable rotary crown). In some embodiments, the second electronic device 600B includes one or more biosensors (e.g., for detecting the user's heart rhythm and heart rate, for recording ECG information) including one or more electrodes integrated into the input device 636 of the second electronic device 600B (e.g., a mechanical input device such as a pressable rotary crown). In some embodiments, the one or more biosensors of the second electronic device 600B further include one or more electrodes (e.g., integrated into) a housing portion of the second electronic device 600B (e.g., a backplate), and the one or more electrodes integrated into the input device work in conjunction with the one or more electrodes of the housing portion to capture biometric information (e.g., ECG information). Features of one or more biosensors of the second electronic device 600B used to capture biometric information (e.g., ECG information) are described in more detail in Annex A. In Figure 6S, the second electronic device 600B is displaying a clock face user interface 638 (e.g., the device's time screen).
[0215] In Figure 6S, while the lock user interface 638 is displayed, the second electronic device 600B detects user input 619 on the input device 636. In some embodiments, the user input 619 is a single press on the input device 636 (for example, such that the force of the press exceeds a threshold amount that causes the input device 636 to "click"). In some embodiments, in response to detecting user input 619 on the input device 636, the second electronic device displays a home user interface 640 on the display 634 (for example, a screen containing multiple icons corresponding to applications installed on and launchable on the device, corresponding to the device's home screen) (for example, replacing the display of the lock user interface 638). The home user interface 640 includes an icon 642 (for example, a graphically depicted heart icon) corresponding to an ECG application installed on the device, and the ECG application on the second electronic device 600B is associated with the ECG management function of a health application installed on the first electronic device 600A.
[0216] In Figure 6T, while displaying the icon 642 corresponding to the ECG application on the display 634, the second electronic device 600B detects user activation 621 of the icon 642 (e.g., via touch input). In response to detecting user activation of the icon 642, the device launches and displays the ECG application, as shown in Figure 6U, and displays the user interface 644 of the ECG application on the display 634 (e.g., replacing the home user interface 640 with it).
[0217] In some embodiments, the user interface 644 of the ECG application includes an animation 646 (e.g., a fluid animation) that depicts a specific shape (e.g., a heart). In some embodiments, as shown in Figure 6U, the animation 646 includes a plurality of dynamic objects (e.g., circular objects) that form a specific shape (e.g., a heart), which appears three-dimensional and is visually fluid as the plurality of dynamic objects constantly move while maintaining the structure of the shape.
[0218] In some embodiments, after a predetermined time (e.g., 5 seconds) has elapsed since the launch and display of the ECG application on the second electronic device 600B (but the device has not detected any additional input from the user), the second electronic device 600B displays a notification message 648 (e.g., "Hold your finger on the crown") on the user interface 644 (and while maintaining the display of animation 646) indicating to the user that an action must be taken (by the user) to proceed with recording ECG information using the device, as shown in Figure 6V. In some embodiments, the user provides user input (e.g., finger contact or touch) on the first input device 636 (e.g., including one or more integrated electrodes that work in conjunction with one or more electrodes on a housing portion (e.g., backplate) of the second electronic device 600B) to proceed with recording ECG information as instructed by the notification message 648.
[0219] Figure 6W shows a first electronic device 600A displaying a tutorial recording progress page 694 on a display 602. In some embodiments, while ECG information is being recorded on a second electronic device 600B, the first electronic device 600A displays an indication 696 within the recording progress page 694 of the health application associated with the ECG application, indicating that the ECG recording is being performed on the second electronic device 600B. In some embodiments, the indication 696 includes a graphical indication portion (e.g., showing an image corresponding to the device being used to perform the recording) and a text indication portion (e.g., reading "Recording in progress").
[0220] Figure 6W also shows a second electronic device 600B that displays a user interface 644 for an ECG application on a display 634 while an ECG recording is being performed (e.g., corresponding to a user input 629 on an input device 636). In some embodiments, while recording ECG information, the second electronic device 600B displays a BPM indicator 698 indicating the heart rate being detected by the recording. In some embodiments, while recording ECG information, the second electronic device 600B further displays a tachogram 699 that graphically depicts the recording in progress over an animation 646 (e.g., transitioning from its initial shape, such as a heart, to a grid pattern during recording). In some embodiments, while recording ECG information, a timer 697 continuously reflects the remaining time to successfully complete the recording (e.g., by counting down). Features relating to the manner in which ECG recording is performed (for example, on a device such as the second electronic device 600B) will be described in more detail below in Figures 8A to 8S, 10A to 10J, and 12A to 12S.
[0221] Figure 6X shows the first electronic device 600A and the second electronic device 600B immediately after completing the ECG recording configuration of Figure 6W. In some embodiments, upon completion of the ECG recording, the second electronic device 600B transmits the ECG recording data to the first electronic device 600A (e.g., via a Bluetooth® connection). In some embodiments, upon completion of the ECG recording, the second electronic device 600B transmits the ECG recording data to an external server (e.g., via an LTE or WiFi® connection), which is also accessible by the first electronic device 600A. In some embodiments, the second electronic device 600B can record and locally store multiple ECG recordings and transmit multiple ECG recordings to the first electronic device 600A.
[0222] In some embodiments, immediately after completing an ECG recording, the first electronic device 600A displays a tutorial summary page 695, which includes a representation 693 of the completed recording. In some embodiments, the representation 693 includes an evaluation result (e.g., "normal rhythm"), a heart rate reading (e.g., in BPM units), and a graphical representation of the recording (e.g., a tachogram). In some embodiments, the tutorial summary page 695 includes an affordance 693 for exiting the summary page. In some embodiments, the summary page 695 of the first electronic device 600A includes a complete button 691 for exiting the tutorial (after completing the tutorial). In some embodiments, if the tutorial is completed without the user taking a first ECG recording, the representation 639 of the summary page 695 is displayed without indication of the evaluation result, heart rate reading, and graphical representation of the recording (e.g., the evaluation result, heart rate reading, and graphical representation fields are blank), as described with reference to Figure 6R.
[0223] In some embodiments, immediately after completing the ECG recording, the second electronic device 600B displays at least a portion of the corresponding summary page 689 (for example, on the user interface 644 of the ECG application, which has an animation 646 of its initial pattern (for example, a fluid heart shape pattern as shown in Figure 6V)). In some embodiments, the summary page 689 includes evaluation results (e.g., “normal results”) and other relevant information about the completed recording. In some embodiments, the summary page 689 slides onto the display from the edge of the display (e.g., the bottom edge of the display). Features relating to the manner in which the ECG recording is performed on the device (e.g., the second electronic device 600B) are described in more detail below in Figures 12A to 12S.
[0224] In some embodiments, a user can perform multiple ECG recordings using an ECG application on the second electronic device 600B. In some embodiments, the multiple ECG recordings are transmitted from the second electronic device 600B to the first electronic device 600A (or an external server accessible by the first electronic device 600A) for viewing and management via the ECG management function of a health application on the first electronic device 600A.
[0225] Figure 6Y shows a first electronic device 600A displaying a health data user interface 650 of a health application (e.g., associated with an ECG application on the second electronic device 600B) on a display 602 after performing several ECG reads using a second device 600B. In some embodiments, the health application is accessible via a corresponding icon on the home user interface of the operating system of the first electronic device 600A.
[0226] In some embodiments, the health data user interface 650 of the health application includes an affordance 650A (for example, described as “heart”) for viewing and managing cardiac health information. In Figure 6Y, while the health data user interface 650 is being displayed, the first electronic device 600A detects user activation 623 of the affordance 650A (for example, via touch input). In response to detecting user activation 623, the device displays the cardiac data user interface 652 on the display 602, corresponding to the heart-specific functions of the health application.
[0227] In some embodiments, the cardiac data user interface 652 of a health application on a first electronic device 600A includes a heart rate affordance 654. In some embodiments, the heart rate affordance 654 includes an indication of the range of the user's heart rate measured over a specific period (e.g., today) (e.g., via a second electronic device 600B). In some embodiments, upon detecting a user selection on the heart rate affordance 654, the cardiac data user interface 652 displays a graphical representation of the heart rate information summarized by the heart rate affordance 654 within a graphical rendering area 656 of the user interface (and further highlights the affordance with certain visual characteristics, such as different colors, to indicate to the user that the heart rate affordance is currently selected by the user).
[0228] In some embodiments, the heart data user interface 652 of the health application on the first electronic device 600A includes an ECG affordance 658. In some embodiments, the ECG affordance 658 includes an overview of the heart health assessment results (e.g., "normal" result, "atrial fibrillation" result, "high or low heart rate" result, "uncertain" result) determined from one or more ECG recordings performed during a specific period (e.g., today), and the number of recordings taken during that period (e.g., "two readings"). In some embodiments, the ECG affordance 658 includes an information affordance 658A for viewing and managing information regarding existing ECG recordings (e.g., previously performed by the user on the second electronic device 600B).
[0229] In FIG. 6Z, while displaying the heart data user interface 652 having the ECG affordance 658 visible on the display 602, the first electronic device 600A detects (e.g., via a touch input) a user activation 625 of the information affordance 658A of the ECG affordance 658. In response to detecting the user activation 625 of the information affordance 658A, the first electronic device 600A displays an ECG management user interface 660 on the display 602 as shown in FIG. 6AA.
[0230] In some embodiments, the ECG management user interface 660 (first) displays a predetermined number (e.g., three) representations of the most recent assessment result determined from the corresponding most recent ECG recording performed on the second electronic device 600B. In some embodiments, the representation of the most recent assessment result includes a graphical portion (e.g., a tachogram) that graphically depicts the recording and a text portion indicating the type of assessment result (e.g., “normal” result, “atrial fibrillation” result, “high or low heart rate” result, “uncertain” result) and the measured heart rate (e.g., in BPM). In some embodiments, the representation of the most recent assessment result includes an indication of one or more user-specified symptoms associated with the result and / or the number of user-specified symptoms associated with the result. In some embodiments, if the user specifies that there are no symptoms associated with the result, a “no symptoms” indication is shown in the corresponding representation of the result. In some embodiments, if the user does not specify any symptoms related to the result (or indicates that there are no symptoms related to the result), no symptom indication is shown in the corresponding representation of the result. The characteristics of user selection of symptoms related to each evaluation result will be explained in more detail by referring to Figures 12A to 12S.
[0231] In some embodiments, the first electronic device 600A detects user activation of ECG affordance 658 at an affordance location that does not correspond to information affordance 658A. In some embodiments, in response to user activation, the first electronic device 600A replaces the display of heart rate information shown in the graphical rendering area 656 of Figure 6Z with heart rhythm information in a graphical form.
[0232] In Figure 6AA, the heart rate rhythm data user interface 660 shows representation 662A corresponding to the most recent ECG record, representation 662B corresponding to the second most recent ECG record, and representation 662C corresponding to the third most recent ECG record. In some embodiments, representation 662A corresponds to a “normal” result with a heart rate measurement of 74 BPM and indications of two symptoms selected for the result. In some embodiments, representation 662B corresponds to an “uncertain” result with no determined heart rate measurement for the result and “no symptoms” specifically indicated by the user for the result. In some embodiments, representation 662C corresponds to an “atrial fibrillation” result with a heart rate measurement of 111 BPM and no indication or zero or more selected symptoms, because the user did not specify any symptoms or whether or not there were symptoms for the result. Furthermore, in some embodiments, because the “atrial fibrillation” result is an abnormal result, at least a portion of representation 662C is highlighted with a specific visual characteristic (e.g., a warning color such as yellow) that differs from the default visual characteristics.
[0233] In some embodiments, the ECG management user interface 660 also includes multiple affordances for viewing additional / different representations of additional / different past evaluation results and for classifying / filtering existing evaluation results. In some embodiments, the ECG management user interface 660 includes a “Show All Results” affordance 664A for displaying representations of all past ECG records performed by the user (e.g., also indicating the number of relevant existing records). In some embodiments, the ECG management user interface 660 includes a first filter affordance 664B for displaying all representations of existing ECG records corresponding to “normal” results (e.g., representation 662A) (e.g., filtering and displaying existing records). In some embodiments, the ECG management user interface 660 includes a second filter affordance 664C for displaying all representations of existing ECG records corresponding to “atrial fibrillation” results (e.g., representation 662C) (e.g., filtering and displaying existing records). In some embodiments, the ECG management user interface 660 includes a second filter affordance 664C for displaying all representations of existing ECG records corresponding to the “atrial fibrillation” result (e.g., representation 662C) (e.g., filtering and displaying existing records). In some embodiments, the ECG management user interface 660 includes a third filter affordance 664D for displaying all representations of existing ECG records corresponding to both the “atrial fibrillation” result and the “high heart rate” (e.g., heart rate above 150 BPM) result (e.g., filtering and displaying existing records). In some embodiments, the ECG management user interface 660 includes a fourth filter affordance 664E for displaying all representations of existing ECG records corresponding to both the “high heart rate” (e.g., heart rate above 150 BPM) result and the “low heart rate” (e.g., heart rate below 50 BPM) result (e.g., filtering and displaying existing records).In some embodiments, the ECG management user interface 660 includes a fifth filter affordance 664F for displaying all representations of existing ECG records corresponding to “high heart rate” results (e.g., heart rate above 150 BPM) (e.g., filtering and displaying existing records). In some embodiments, the ECG management user interface 660 includes a sixth filter affordance 664G for displaying all representations of existing ECG records corresponding to “low heart rate” results (e.g., heart rate below 50 BPM) (e.g., filtering and displaying existing records). In some embodiments, the ECG management user interface 660 includes a seventh filter affordance 664H for displaying all representations of existing ECG records corresponding to “uncertain” results (e.g., because the measured heart rate was too high or too low to determine the evaluation result, or because the captured ECG information was incomplete and / or unreadable to determine the evaluation result) (e.g., filtering and displaying existing records).
[0234] In Figure 6AB, while the ECG management user interface 660 is displayed on the display 602, the first electronic device 600A detects (e.g., via touch input) a user selection 627 of representation 662A (corresponding to a “normal” result with a heart rate measurement of 74 BPM and indications of two symptoms selected for the result). In response to detecting the user selection 627, the first electronic device 600A displays a detail page 666 corresponding to the selected evaluation result on the display 602 (e.g., replacing the display of the ECG management user interface 660) as shown in Figure 6AC.
[0235] In some embodiments, the detail page includes one or more descriptive items associated with the selected assessment result (e.g., a tachogram, the type of assessment result, the measured BPM of the result, the presence or absence of atrial fibrillation, one or more selected symptoms). The detail page 666 corresponds to the assessment result of representation 662A (from Figure 6AB), which is a “normal” result. In some embodiments, the detail page 666 includes an animation 668A that graphically depicts the record of this normal result (e.g., a tachogram representing the measured heart rhythm and heart rate data), an indication 668B that shows the determined assessment result of the record ("normal" result), an indication 668C that shows whether one or more specific medical characteristics (e.g., atrial fibrillation) were determined from the ECG record (e.g., “This record did not show signs of atrial fibrillation”), and an indication 668D that shows (or enumerates) user-specified symptoms associated with the ECG record (e.g., “chest pain” and “shortness of breath”).
[0236] In some embodiments, a detail page (e.g., detail page 666) includes an information affordance 670 that triggers the display of a text description explaining the general medical characteristics of the corresponding evaluation result. In some embodiments, the text description corresponds to a complete text description displayed within an extended text area of the tutorial's possible results page 618, as described above with reference to Figures 6H–6N.
[0237] In some embodiments, a detail page (e.g., detail page 666) includes a sharing affordance 672 for sharing a document (e.g., a PDF document) summarizing the corresponding ECG record with a specified external source (e.g., sending the document to an email account). An exemplary document generated for transmission to the indicated external source is shown in Figure 6AD. In some embodiments, upon detecting a user selection of the sharing affordance 672, the first electronic device 600A generates a document and allows the user to enter the intended recipient (e.g., an email account) for (automatic) transmission of the generated document to the intended recipient.
[0238] In some embodiments, a detail page (e.g., detail page 666) includes an emergency contact affordance 674 (e.g., for contacting 911 to request immediate medical attention). In some embodiments, upon detecting a user selection of the emergency contact affordance 674, the first electronic device 600A initiates a call to the emergency contact (e.g., 911).
[0239] In some embodiments, a detail page (e.g., detail page 666) includes a metadata list 676 that shows one or more information items related to the ECG record (e.g., the device used to perform the record, the time of the record, the operating system of the device used to perform the record).
[0240] In some embodiments, a detail page (e.g., detail page 666) includes a delete affordance 678 for deleting an ECG record (e.g., from a local storage device on a first electronic device 600A, from a local storage device on a second electronic device used to perform recording, such as a second electronic device 600B, or from a remote storage device on an external server).
[0241] Figure 6AD shows a document 680 (e.g., a PDF document) generated in response to the detection of a user selection of a shared affordance 672 from detail page 666. In some embodiments, document 680 includes basic user information 682 (e.g., user's name, user's date of birth). In some embodiments, document 680 includes the evaluation results of the ECG record 684 (e.g., "normal" result, "atrial fibrillation" result, "high or low heart rate" result, "uncertain" result). In some embodiments, document 680 includes heart rate measurements of the ECG record in units of BPM 686. In some embodiments, document 680 includes the time of the ECG record 694. In some embodiments, document 680 includes a list of symptoms selected by the user for the ECG record 688. In some embodiments, document 680 includes a tachogram of the ECG record 690 (e.g., an unfiltered, full tachogram). In some embodiments, document 680 includes notation information 692 describing the tachogram 690.
[0242] In some embodiments, the first electronic device 600A can enable and disable the ECG recording function on the second electronic device 600B (for example, via the health application and / or the paired device application described with reference to Figure 6A). In some embodiments, if the ECG application is launched on the second electronic device 600B while the ECG recording function is disabled (by the first electronic device 600A), the second electronic device 600B displays an error notification user interface 637 on the display 634, as shown in Figure 6AE, informing the user (for example, via text stating "The ECG application has been remotely disabled") that ECG recording cannot be performed because the ECG recording function is disabled (by the first electronic device 600A).
[0243] Figures 7A to 7C are flowcharts illustrating a method for initializing health monitoring according to several embodiments. Method 700 is performed in a first electronic device (e.g., 100, 300, 500, 600A) having a display and one or more input devices (e.g., biosensors, touch layers of the display), the first electronic device being paired with a second electronic device (e.g., 600B). Some operations of Method 700 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.
[0244] As will be described later, Method 700 provides an intuitive way to manage health monitoring. This method reduces the cognitive burden on the user when managing health monitoring, thereby creating a more efficient human-machine interface. In the case of battery-powered computing devices, power is saved and the intervals between battery charges are increased by enabling users to manage health monitoring faster and more efficiently.
[0245] The first electronic device (e.g., 600A) displays on a display (e.g., 602) the first part of a tutorial (e.g., 614, 616, 618, 630, 632) for using the functions of the second electronic device (e.g., 600B) (e.g., measuring heart rhythm information (electrocardiogram) or heart rate information (BPM)) (e.g., a function performed using one or more biosensors of the second electronic device) (706). By displaying the first part of the tutorial for using the functions of the second electronic device, guidance is provided on how to successfully complete the initialization process, and important background information regarding the use of the functions is provided (e.g., without having the user test the functions without any guidance to learn how to use them), thereby reducing the number of inputs required for the user to initialize the first electronic device (e.g., 600A) and the second electronic device (e.g., 600B) in order to use the functions. By reducing the number of inputs required to perform an action, the usability of the device is improved, the user-device interface is made more efficient (for example, by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by allowing the user to use the device more quickly and efficiently.
[0246] In some embodiments, before displaying the first part of a tutorial for using the functions of the second electronic device (e.g., 614, 616, 618, 630, 632) on a display (e.g., 602), the first electronic device (e.g., 600A) receives a second indication (e.g., via the first electronic device's radio communication radio) (702) from the second electronic device (e.g., 600B) that an application configured to control the use of functions on the second electronic device (e.g., 600B) is open (e.g., launched, started) on the second electronic device (e.g., 600B). By displaying the second indication that an application configured to control the use of functions on the second device (e.g., 600B) is open, feedback is provided to the user regarding the current state of the second electronic device, and the user is visually shown that the second electronic device is ready to operate for using functions. By providing users with improved visual feedback, we enhance device usability, make the user-device interface more efficient (for example, by helping users provide appropriate input when operating / interacting with the device and reducing user errors), and reduce power consumption and improve device battery life by enabling users to use the device more quickly and efficiently.
[0247] In some embodiments, upon receiving a second indication that an application configured to control the use of a function on a second electronic device (e.g., 600B) is open, the first electronic device (e.g., 600A) displays a notification (e.g., 612) on its display (e.g., 602) corresponding to a tutorial for using the function on the second electronic device (704). By displaying the notification on the display (e.g., 602) corresponding to a tutorial for using the function on the second electronic device, the first electronic device (e.g., 600A) provides the user with feedback on the current state of the second electronic device and visually indicates to the user that a tutorial is available on the first electronic device (e.g., 600A) to help configure the use of the function on the second electronic device. By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently.
[0248] In some embodiments, a notification (e.g., 612) informs the user that an application has been launched on a second electronic device (e.g., 600B) and that the user can view a tutorial for using the functions of the second electronic device (e.g., 600B) related to the launched application. In some embodiments, the first electronic device (e.g., 600A) displays the tutorial on a display (e.g., 602) in response to detecting a user selection (e.g., tap gesture) of the notification (e.g., 612). Displaying the tutorial on a display (e.g., 602) in response to detecting a user selection of the notification (e.g., 612) improves visual feedback by indicating to the user that a tutorial corresponding to the displayed notification has been launched on the first electronic device (e.g., 600A). By providing users with improved visual feedback, we enhance device usability, make the user-device interface more efficient (for example, by helping users provide appropriate input when operating / interacting with the device and reducing user errors), and reduce power consumption and improve device battery life by enabling users to use the device more quickly and efficiently.
[0249] In some embodiments, the first electronic device (e.g., 600A) displays a first portion of a tutorial (e.g., 614, 616, 618, 630, 632) in response to input received while displaying a user interface (e.g., 643) configured to change one or more settings of a second electronic device (e.g., 600B). By displaying the first portion of the tutorial in response to input received while displaying a user interface configured to change one or more settings of the second electronic device, visual feedback is improved by indicating to the user that the displayed tutorial is associated with an application that can be used on the second electronic device. By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently.
[0250] A first electronic device (e.g., 600A) detects a request to advance the tutorial via one or more input devices (e.g., user tap input on one or more "continue" buttons 614C, 616C, 628, 630B) (708).
[0251] In response to detecting a request to proceed with the tutorial, the first electronic device (e.g., 600A) displays on its display (e.g., 602) an instruction to perform an action on the second electronic device (e.g., 600B) with the functionality of the second electronic device (e.g., 600B) (e.g., capturing / recording biometric data) (710). By displaying on the display (e.g., 602) of the first electronic device (e.g., 600A) an instruction to perform an action on the second electronic device (e.g., 600B) with the functionality of the second electronic device, the visual feedback to the user is improved by indicating that the action corresponding to the tutorial needs to be performed on the second electronic device (e.g., and not on the first electronic device). By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by allowing the user to use the device more quickly and efficiently.
[0252] In some embodiments, the operation on the second electronic device (e.g., 600B) includes capturing biometric data (e.g., using a biosensor on the second electronic device). In some embodiments, the biometric data captured by the second electronic device (e.g., 600B) is heart-related data (e.g., ECG data, BPM data).
[0253] In some embodiments, the first part of the tutorial includes multiple graphical indications (e.g., 620, 622, 624, 626, heart rate rhythm evaluation results, heart rate measurements) of possible results of operations performed on a second electronic device (e.g., 600b) (e.g., ECG recording operation, BPM measurement operation).
[0254] In some embodiments, the operation evaluates (the user's) medical characteristics, including a heart rhythm assessment (e.g., electrocardiogram readings) and a heart rate assessment (e.g., BPM readings), and possible outcomes are selected from a group consisting of normal outcomes (e.g., for heart rhythm assessment and / or heart rate assessment), abnormal heart rhythm pattern outcomes (e.g., signs of atrial fibrillation), abnormal heart rate outcomes (e.g., BPM above a high threshold or below a low threshold, such as BPM above 150 or BPM below 50), and indeterminate outcomes (e.g., based on poor quality readings).
[0255] In some embodiments, while displaying at least one first possible outcome (e.g., 624) of possible outcomes, where the first possible outcome includes a portion of the first result summary (text) (e.g., 624B, text summarizing the medical characteristics of the corresponding outcome), the first electronic device (e.g., 600A) detects user activation of an extended affordance (e.g., 624C) associated with the first result summary via one or more input devices. While displaying at least one first possible outcome of possible outcomes, where the first possible outcome includes a portion of the first result summary, the extended affordance is provided to improve visual feedback by indicating to the user that only a portion of the first result summary is not currently displayed and that the extended affordance can be selected to display the entirety of the first result summary. By providing the user with improved visual feedback, the usability of the device is enhanced, the user-device interface is made more efficient (for example, by assisting the user in providing appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently. In some embodiments, in response to detecting user activation of an extended affordance (e.g., 624C), the first electronic device (e.g., 600A) displays the entirety of the first results summary (text) on a display (e.g., 602).
[0256] In some embodiments, a plurality of graphical indications of possible outcomes (e.g., 620, 622, 624, 626) include a first graphical indication (e.g., 620) that includes a first animation display (e.g., 620A) for a first possible outcome, and a second graphical indication (e.g., 622) that includes a second animation (e.g., 622A) for a second possible outcome, wherein the first and second animations are synchronized. In some embodiments, the first and second animations are dynamic animations that include an animation of a beating heart depicting the rhythm and velocity of a heartbeat and tachogram-like features.
[0257] In some embodiments, while displaying a plurality of graphical indications (e.g., 620, 622, 624, 626) of possible outcomes on a display (e.g., 602), a first electronic device (e.g., 600A) detects a scroll gesture (e.g., scrolling on the touch layer of the display) via one or more input devices. In some embodiments, in response to detecting a scroll gesture, the first electronic device (e.g., 600A) scrolls through the plurality of graphical indications (e.g., 620, 622, 624, 626). In some embodiments, the first electronic device (e.g., 600A) displays a third graphical indication (e.g., 624) on the display (e.g., 602) including a third animation (e.g., 624A) of a third possible outcome, the third animation being synchronized with the first animation (e.g., 620A) and the second animation (e.g., 622A).
[0258] In some embodiments, a first animation (e.g., 620A) includes a first part of the animation (e.g., a beating heart) that is animated at a fixed position, and a second part of the animation (e.g., a dot) that is animated to move from the fixed position to a second position. In some embodiments, the object follows a tachogram-like pattern as it exits the heart shape animation. In some embodiments, the first object in the first dynamic animation and the second object in the second dynamic animation exit their corresponding heart shape animations synchronously and repeatedly (continuously). Visual feedback is improved by providing an animation (e.g., first animation 620A) of a graphical indication of possible outcomes (e.g., one of 620, 622, 624, 626), showing the user that the actions described by the tutorial relate to cardiac monitoring, as shown in the animation, and by providing visual guidance on how each possible outcome derived from the cardiac monitoring actions differs. By providing users with improved visual feedback, we enhance device usability, make the user-device interface more efficient (for example, by helping users provide appropriate input when operating / interacting with the device and reducing user errors), and reduce power consumption and improve device battery life by enabling users to use the device more quickly and efficiently.
[0259] In some embodiments, the first part of the tutorial (e.g., 614, 616, 618, 630, 632) includes a limitation indication (e.g., 630, which explains the limitations of the operation to the user, showing a list of medical properties that cannot be determined by the operation) that include one or more medical properties that cannot be derived from the operation. By providing the limitation indication (e.g., 630) in the first part of the tutorial, visual feedback is improved by visually showing the user one or more medical properties that cannot be derived from the operation during the setup process (so that the user is more likely to recognize them). By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently.
[0260] The first electronic device 600A receives an indication from the second electronic device (e.g., 600B) that a command has been executed (on the second electronic device) (716) via wireless communication between the devices (for example, after the user has executed a command on the second electronic device (e.g., 600B)).
[0261] In some embodiments, before receiving an indication from the second electronic device (e.g., 600B) that an instruction has been executed (e.g., via inter-device radio communication), the first electronic device (e.g., 600A) receives an indication from the second electronic device (e.g., 600B) (e.g., via inter-device radio communication) that an instruction has begun to be executed (on the second electronic device) (712). In some embodiments, upon receiving the indication that an instruction has begun to be executed, the first electronic device (e.g., 600A) displays an indication on a display (e.g., 602) that an instruction is being executed on the second electronic device (e.g., 820, the "Recording in Progress" page of the tutorial) (714). Visual feedback is improved by visually indicating to the user that the operation is running successfully on the second electronic device (and therefore the setup process is proceeding as intended) by displaying an indication on the display (e.g., 602) that the command is being executed on the second electronic device (e.g., 600B) in response to receiving an indication that the command has started to be executed, thereby improving visual feedback. By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently.
[0262] Upon receiving an indication that an instruction has been executed, the first electronic device (e.g., 600A) displays a second part of the tutorial (e.g., 828, the "Complete" page) on its display (e.g., 602), which is different from the first part (718). Visual feedback is improved by indicating to the user that the operation performed on the second electronic device is complete (e.g., the setup process has been successfully completed and the operation is available for future use) by displaying the second part of the tutorial on its display (e.g., 602) upon receiving an indication that an instruction has been executed. By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently.
[0263] In some embodiments, the second part of the tutorial (e.g., page 828, "Completion") includes a graphical animation (e.g., a tachogram-like animation) representing (biological) information obtained from the operation on the second electronic device.
[0264] In some embodiments, after displaying the second part of the tutorial (e.g., 828) on a display (e.g., 602), the first electronic device (e.g., 600A) displays the user interface of the health application (e.g., 650, 656, 660) on the display (e.g., 602) (720).
[0265] In some embodiments, a first electronic device (e.g., 600A) detects user activation of an affordance (e.g., 658A, ECG affordance) for viewing recorded biometric information (e.g., recorded ECG and BPM readings) via one or more input devices (722). In some embodiments, the affordance for viewing existing biometric information (e.g., 658A) includes an indication of the number of existing biometric information records (e.g., the number of recorded ECG and / or BPM readings). By providing an indication of the number of existing biometric information records within the affordance for viewing existing biometric information, visual feedback is improved by conveniently informing the user of the number of existing records that can be viewed in the health application. By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by allowing the user to use the device more quickly and efficiently.
[0266] In some embodiments, upon detection of user activation of an affordance for viewing an existing biometric record (e.g., 658A), the first electronic device (e.g., 600A) displays a first set of representations (e.g., 662A-662C) corresponding to the existing biometric record on a display (e.g., 602) (724). In some embodiments, the representations of the existing biometric record (e.g., 662A-66C) include a tachogram corresponding to the record, an evaluation result of the record, the number of symptoms associated with the record (if any), and the heart rate (BPM) recorded by the record. By displaying a first set of representations (e.g., 662A-662C) corresponding to the existing biometric record on a display (e.g., 602) upon detection of user activation of an affordance for viewing an existing biometric record, visual feedback is improved by conveniently providing the user with representations of some of the existing records that are most relevant to the user (e.g., some of the most recent records). By providing users with improved visual feedback, we enhance device usability, make the user-device interface more efficient (for example, by helping users provide appropriate input when operating / interacting with the device and reducing user errors), and reduce power consumption and improve device battery life by enabling users to use the device more quickly and efficiently.
[0267] In some embodiments, a first set of representations (e.g., 662A-66C) of an existing record of biometric information includes a first representation (e.g., 662C) corresponding to a first existing record having an abnormal evaluation result (e.g., an abnormal heart rhythm such as atrial fibrillation), where the first representation (e.g., 662C) includes an indication of the abnormal evaluation result displayed with a first visual characteristic (e.g., highlighted with a warning color such as yellow). In some embodiments, a set of representations (e.g., 662A-66C) of an existing record of biometric information includes a fourth representation (e.g., 662A) corresponding to a fourth existing record having a normal evaluation result, where the fourth representation includes an indication of the normal evaluation result displayed with a second visual characteristic different from the first visual characteristic (e.g., a default color).
[0268] In some embodiments, a first plurality of representations of an existing record of biometric information (e.g., 662A-66C) includes a second representation (e.g., 662A, 662B) corresponding to a second existing record associated with a user-specified symptom, the second representation including an indication of the number of user-specified symptoms associated with the second existing record (e.g., "2 symptoms", "no symptoms"). In some embodiments, a first plurality of representations of an existing record of biometric information (e.g., 662A-66C) includes a third representation (e.g., 662C) corresponding to a third existing record not associated with any user-specified symptoms (e.g., because the user did not specify any symptoms for the record), the third representation not including an indication of user-specified symptoms associated with the third existing record. Visual feedback is improved by providing a second representation (e.g., 662A, 662B) corresponding to a second existing record associated with a user-specified symptom, thereby conveniently indicating to the user whether (if any) symptoms have been previously selected by the user for a record (e.g., thereby enabling the user to quickly recognize whether a particular record corresponds to a more severe reading when there are many user-specified symptoms associated with a record). By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently. In some embodiments, the user-specified symptom cannot be changed after the symptom has been specified and saved (by the user on the second electronic device).
[0269] In some embodiments, in response to detecting user activation of an affordance (e.g., 658A) for viewing recorded biometric information, the first electronic device (e.g., 600A) displays on a display (e.g., 602) a plurality of classification affordances (e.g., 664A-664H, a plurality of classification affordances for filtering records visible by type of evaluation result, such as normal result, abnormal heart rhythm result, or abnormal heart rate result) including a first classification affordance and a second classification affordance (726). In some embodiments, the first classification affordance includes an indication of the number of existing records of biometric information associated with a first type of evaluation result, and the second classification affordance includes an indication of the number of existing records of biometric information associated with a second type of evaluation result. In some embodiments, the first electronic device (e.g., 600A) detects user activation of the first classification affordance via one or more input devices (728).
[0270] In some embodiments, upon detecting user activation of a first classification affordance, the first electronic device (e.g., 600A) displays a second plurality of representations on a display (e.g., 602) (e.g., by replacing the first plurality of representations) (730), where the second plurality of representations correspond to existing records associated with a first type of evaluation result (e.g., normal result, abnormal heart rhythm result, abnormal heart rate result, indeterminate result). In some embodiments, the first electronic device (e.g., 600A) detects user activation of a second classification affordance via one or more input devices (732).
[0271] In some embodiments, upon detecting user activation of a second classification affordance, the first electronic device (e.g., 600A) displays on a display (e.g., 602) (e.g., by replacing the first plurality of representations) (734) a third plurality of representations corresponding to existing records of biometric information, the third plurality of representations corresponding to existing records associated with a second type of evaluation result. In some embodiments, the second and third plurality of representations have corresponding overlapping existing records if one or more existing records are associated with both a first type of evaluation result and a second type of evaluation result.
[0272] In some embodiments, a first electronic device (e.g., 600A) detects a user selection of a first representation (e.g., 662A) of a first set of representations (e.g., 662A-66C) corresponding to a first existing record corresponding to a first evaluation result, via one or more input devices. In some embodiments, upon detecting a user selection of a first representation, the first electronic device (e.g., 600A) displays a first detail view (e.g., 666) of the first existing record.
[0273] In some embodiments, while displaying a first detail view (e.g., 666) of a first existing record, a first electronic device (e.g., 600A) detects user activation of an information affordance (e.g., 670, the "i" icon) via one or more input devices. In some embodiments, in response to detecting user activation of an information affordance (e.g., 670), the first electronic device (e.g., 600A) displays on a display (e.g., 602) a results summary (e.g., text summarizing the medical characteristics of the corresponding result) and an animation of the corresponding possible results from a first part of a tutorial (e.g., the possible results from the tutorial correspond to the evaluation results of the first existing record).
[0274] In some embodiments, while displaying a first detail view (e.g., 666) of a first existing record corresponding to a first evaluation result, a first electronic device (e.g., 600A) detects user activation of an export affordance (e.g., 672, marked "Share as PDF") via one or more input devices. In some embodiments, in response to detecting user activation of an export affordance (e.g., 672), the first electronic device (e.g., 600A) creates (and subsequently sends to the intended recipient) a document containing information about the first existing record (e.g., information about the user, the date and time of the record, the (ECG) tachogram of the record, the evaluation result of the record). In some embodiments, biometric data of the record (e.g., ECG data) is included in the document without any filtering (of the data from the record). By automatically generating and sending a document (to the intended recipient) in response to detecting user activation of an information affordance, the number of inputs required from the user to create a summary document of the record and subsequently send the document to the intended recipient is reduced. By reducing the number of inputs required to perform an action, the usability of the device is improved, the user-device interface is made more efficient (for example, by assisting the user in providing appropriate inputs when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently. In some embodiments, user-specified symptoms cannot be changed after they have been specified and saved (by the user on the second electronic device).
[0275] It should be noted that the details of the process described above with respect to Method 700 (for example, Figures 7A to 7C) can also be applied in a similar manner to the methods described later. For example, Method 900 optionally includes one or more of the characteristics of the various methods described above with reference to Method 700. In another example, Method 1100 optionally includes one or more of the characteristics of the various methods described above with respect to Method 700. In another example, Method 1300 optionally includes one or more of the characteristics of the various methods described above with respect to Method 700. In another example, Method 1500 optionally includes one or more of the characteristics of the various methods described above with respect to Method 700. For brevity, these details will not be repeated below.
[0276] Figures 8A–8S show exemplary user interfaces for recording biometric information for use in health monitoring. These user interfaces are used to illustrate the processes described below, including those in Figures 9A and 9B. The exemplary user interfaces in these figures are generally limited to monitoring health using recorded biometric information and are not limited to any particular type of biometric information. For convenience only, the exemplary user interfaces in these figures will be described with reference to one type of biometric information, electrocardiogram (ECG) information.
[0277] Figure 8A shows a first electronic device 800A (corresponding, for example, to a second electronic device 600B). In some embodiments, the first electronic device 800A is a smartwatch. In some embodiments, the first electronic device 800A has a display 802 and one or more input devices (including, for example, a touch layer of the display 802 and one or more mechanical buttons such as a rotary crown). In some embodiments, the first electronic device 800A includes one or more biosensors (for example, for detecting the user's heart rhythm and heart rate for recording ECG information) which include one or more electrodes integrated into the input device 804 of the first electronic device 800A (e.g., a mechanical input device such as a pressable rotary crown). In some embodiments, one or more biosensors of the first electronic device 800A further include one or more electrodes (e.g., integrated therewith) of a housing portion (e.g., a backplate) of the first electronic device 800A, and one or more electrodes integrated with an input device operate in conjunction with one or more electrodes of the housing portion to capture biological information (e.g., ECG information). Features of one or more biosensors of the first electronic device 800A used to capture biological information (e.g., ECG information) are described in detail in Annex A.
[0278] Figure 8A shows a first electronic device 800A that displays the user interface 806 of an ECG application on the display 802 (corresponding, for example, to the user interface 644 of the ECG application described with reference to Figures 6A to 6AE).
[0279] In some embodiments, similar to user interface 644, user interface 806 includes an animation 808 (e.g., a fluid animation, corresponding to animation 646 of user interface 644) that depicts a specific shape (e.g., a heart). In some embodiments, as shown in Figure 8A, animation 808 includes a plurality of dynamic objects (e.g., circular objects) that form a specific shape (e.g., a heart), which appears three-dimensional and is visually fluid as the plurality of dynamic objects constantly move while maintaining the structure of the shape.
[0280] In some embodiments, while displaying an animation 808 of a specific shape (e.g., a heart), the user interface 806 displays a notification message 810 (e.g., corresponding to notification message 648 in user interface 644) indicating to the user that an action must be taken on the device (by the user) in order to advance the ECG recording (to capture heart rhythm and heart rate information). In some embodiments, the notification message 810 instructs the user on the type of input (e.g., a touch or contact on the input device below a threshold amount so that the input does not "click" the input device) and that the input must be maintained on the input device (e.g., for the duration of the recording).
[0281] In some embodiments, before displaying the user interface 806 of the ECG application (for example, while the first electronic device 800A is displaying the user interface of a different application or the display is off), the device detects the user's heart rate information for a certain period (e.g., 1 minute) (e.g., using a second biosensor that measures heart rate information without user input) and determines that the detected heart rate is above a threshold velocity (e.g., above 150 BPM). In some embodiments, upon detecting that the detected heart rate is above the threshold velocity for at least that period, the device displays a notification on the display 802 informing the user of the (continuously) high heart rate and prompting the user to monitor their cardiac health using the ECG application.
[0282] In Figure 8B, while the user interface 806 of the ECG application is displayed on the display 802, the first electronic device 800A detects user input 801 on the input device 804 in accordance with the instructions from the notification message 810. In some embodiments, user input 801 is a continuous touch or contact on the input device (e.g., input that does not "click" the input device) that falls below a threshold amount. In some embodiments, upon detection (and continued detection) of user input 801 on the input device 804, a plurality of dynamic objects forming the animation 808 transition from their initial pattern (e.g., of a certain shape) to a different pattern, as shown in Figure 8B. In some embodiments, upon detection (and continued detection) of user input 801, the first electronic device 800A stops displaying the notification message 810 on the display 802.
[0283] Figure 8C shows a first electronic device 800A that continuously detects user input 801 on input device 804. In some embodiments, while continuously detecting user input 801 on input device 804, a plurality of dynamic objects forming animation 808 continue to transition toward different patterns (e.g., a grid of tachograms) and begin to form it. In some embodiments, the first electronic device 800A displays a timer 810 (e.g., a countdown timer for a predetermined time, such as 30 seconds) within the user interface 806 (e.g., below animation 808) indicating the remaining time to complete the ECG recording. In some embodiments, the first electronic device 800A displays a notification message 812 within the user interface 806 (e.g., below timer 810) instructing the user to maintain input on input device 804 in order to successfully complete the ECG recording (e.g., it states, "Try to touch the crown and remain still").
[0284] Figure 8D shows a first electronic device 800A that continues to detect user input 801 on input device 804. In some embodiments, as the user maintains user input 801 on input device 804, the first electronic device 800A begins recording ECG information. In some embodiments, while recording ECG information, the device displays a BPM indicator 814 within the user interface 806 indicating the heart rate being detected by the recording. In some embodiments, while recording ECG information, the device further displays a tachogram 816 that graphically depicts the recording in progress over an animation 808 (forming a grid pattern during recording). In some embodiments, while recording ECG information, a timer 810 continuously reflects the remaining time to successfully complete the recording (e.g., by counting down).
[0285] Figure 8E shows a second electronic device 800B (corresponding, for example, to the first electronic device 600A described with reference to Figures 6A to 6AE). In some embodiments, the second electronic device 800B is a smartphone paired with the first electronic device 800A (for example, via a short-range wireless communication connection such as Bluetooth® connection). In Figure 8E, the second electronic device 800B displays on the display 818 the user interface 820 of a health application associated with the ECG application running on the first electronic device 800A. In some embodiments, while recording ECG information on the first electronic device 800A, the second electronic device 800B displays an indication 822 within the user interface 820 of the health application associated with the ECG application that ECG recording is in progress on the first electronic device 800A. In some embodiments, the indication 822 includes a graphical indication portion (for example, showing an image corresponding to the device used to perform the recording) and a text indication portion (for example, describing "Recording in progress").
[0286] Figure 8F shows a first electronic device 800A that displays the user interface 806 of the ECG application on display 802 while the device continues to perform ECG recording from Figure 8E. In Figure 8F, during ECG recording, the device detects that user input 801 on input device 804 is lost (for example, because the user lifts the finger used for input away from input device 804). In some embodiments, in response to detecting that user input on input device 804 is lost, the device displays a message indication 824 within the user interface 806 requesting the user to recover user input on input device 804 in order to continue ECG recording (for example, describing "Keep your finger on the crown"). In some embodiments, while user input is lost on input device 804, the device continues to count down toward the end of recording (indicated by timer 810). In some embodiments, while user input is lost on input device 804, the device pauses recording until user input is recovered on input device 804. In some embodiments, upon detecting that user input has been lost on the input device 804, the first electronic device 800A resets the value of the timer 810 (for example, to the initial value of 30 seconds) and resumes recording if user input is recovered (for example, recovered within a predetermined time).
[0287] In some embodiments, if user input on input device 804 is not recovered within a time limit (e.g., 5 seconds), the first electronic device 800A (automatically) terminates recording and transitions back to the initial user interface in Figure 8A. In some embodiments, if user input on input device 804 is recovered within a time limit (e.g., 5 seconds), the device (automatically) continues recording (e.g., restarts the timer if paused). In some embodiments, the time limit for recovering input (e.g., 5 seconds) is reset when user input is recovered. That is, if user input is lost for a second period during recording, the device (automatically) terminates recording, and if the entire time limit (e.g., 5 seconds) has elapsed without the user recovering user input, it transitions back to the initial user interface in Figure 8A.
[0288] In Figure 8G, the first electronic device 800A detects user input 801 on input device 804 again before the time limit (e.g., 5 seconds) has elapsed since user input was lost in Figure 8F. Because user input on input device 804 was recovered before the time limit (e.g., 5 seconds) expired, the device continues ECG recording without (automatically) terminating the recording.
[0289] Figure 8H shows a first electronic device 800A that continues to detect user input 801 on input device 804, and the device continues ECG recording from Figure 8G. In some embodiments, a timer 810 continues to indicate the remaining time (e.g., "1 second") to complete the recording.
[0290] Figure 8I shows the user interface 806 of the ECG application when recording is complete (indicated by a timer 810 that indicates no time is remaining). In some embodiments, when recording is complete, several dynamic objects that form the animation 808 transition back from a grid-like pattern during recording to their initial patterns before recording (e.g., of a heart shape).
[0291] Figure 8J shows the first electronic device 800A and the second electronic device 800B immediately after completing an ECG recording. In some embodiments, upon completion of the ECG recording, the first electronic device 800A transmits the ECG recording data to the second electronic device 800B (e.g., via a Bluetooth® connection). In some embodiments, upon completion of the ECG recording, the first electronic device 800A transmits the ECG recording data to an external server (e.g., via an LTE or WiFi® connection), which is also accessible by the second electronic device 800B. In some embodiments, the first electronic device 800A can record and store multiple ECG recordings locally and transmit multiple ECG recordings to the second electronic device 800B.
[0292] In some embodiments, immediately after completing an ECG recording, the first electronic device 800A displays on the display 802 a user interface 806 for the ECG application having an animation 808 of its initial pattern (e.g., a fluid heart shape pattern), as well as at least a portion of a summary page 826 containing evaluation results (e.g., "normal results") and other relevant information regarding the completed recording. In some embodiments, the summary page 826 slides onto the display from the edge of the display (e.g., the bottom edge of the display).
[0293] In some embodiments, immediately after completing an ECG recording, the second electronic device 800B displays a summary page 828 of the health application associated with the ECG application on the second electronic device 800A within the health application, and the summary page 828 includes a representation 830 of the completed recording. In some embodiments, the representation 830 includes an evaluation result (e.g., "normal rhythm"), heart rate readings (e.g., in BPM units), and a graphical representation of the recording (e.g., a tachogram). In some embodiments, the summary page 828 includes an affordance 832 for exiting the summary page.
[0294] Figure 8K shows a first electronic device 800A that displays at least a portion of an overview page 826 corresponding to an ECG recording on a display 802. In some embodiments, the overview page 826 includes an overview area 834 that includes an indication 834A of an evaluation result (e.g., “normal rhythm”) and an indication 834B of a heart rate reading (e.g., in BPM units). In some embodiments, the overview area 834 also includes an information affordance 836 for viewing a detailed description of the corresponding evaluation result (e.g., the detailed description corresponds to the text description shown on page 618 of the possible results tutorial described with reference to Figures 6A–6AE). In some embodiments, the overview page 826 includes an indication 838 of whether a particular medical characteristic (e.g., a sign of atrial fibrillation, a sign of an irregular heart rhythm) was determined from the recording. In some embodiments, the overview page 826 includes a symptom area 840 that includes an affordance 842 for associating one or more symptoms with the readings. In some embodiments, while displaying the overview page 826, the device maintains the display of animation 808 (for example, in its initial shape as shown in Figure 8A) in the background of the overview page (for example, in a brighter color so that the overview page is easily legible to the user).
[0295] Figures 8L to 8O illustrate several different error notification messages that may be displayed within the user interface 806 of the ECG application while recording ECG information. In Figure 8L, while performing a first ECG recording corresponding to user input 803 on input device 804, the first electronic device 800A detects movement of user input on input device 804 that exceeds a threshold amount (e.g., there is movement of user contact with input device 804 where the amount of movement exceeds a threshold amount). In some embodiments, upon detecting movement of user input on input device 804 that exceeds a threshold amount (for at least a certain period of time, such as 5 seconds), the first electronic device 800A displays a notification message 844 (e.g., under timer 810) requesting the user to limit movement of user input 803 during recording (e.g., stating "Try not to move your arm").
[0296] In Figure 8M, for a certain period (e.g., 5 seconds) after displaying notification message 844, and while continuing to perform the first ECG recording corresponding to the user input 803 on input device 804, the first electronic device 800A continues to detect movement of user input on input device 804 that exceeds a threshold amount. In some embodiments, depending on how long this has continued (e.g., for another period such as 5 seconds after displaying the initial notification message 844), the first electronic device 800A displays notification message 846 (e.g., stating "Placing your arm on a table or your knee may help") indicating that the user may try placing their arm on a surface to stabilize the user input on input device 804 (e.g., under timer 810, replacing the display of notification message 844 with it).
[0297] In Figure 8N, while performing a second ECG recording corresponding to user input 805 on input device 804, the first electronic device 800A detects a press input on input device 804, and the force of the press exceeds a threshold amount (e.g., the user "clicks" input device 804). In some embodiments, upon detecting a press input on input device 804, the first electronic device 800A displays a notification message 848 (e.g., stating "No need to click crown") (e.g., below timer 810) to inform the user that it is not necessary to "click" input device 804 to perform the recording and / or that a weaker force can be used for the input on input device 804 to successfully complete the recording.
[0298] In Figure 8O, while performing a third ECG recording corresponding to user input 807 on input device 804, the first electronic device 800A detects (for example, as in Figure 8F) that user input 807 on input device 804 has been lost (for example, because the user has lifted the finger used for input away from input device 804). In some embodiments, in response to detecting that user input on input device 804 (for example, user contact with it) has been lost, the first electronic device 800A displays a notification message 850 (for example, below timer 810) requesting the user to recover user input on input device 804 and continue ECG recording (for example, corresponding to notification message 824, which states, "Keep your finger on the crown").
[0299] Figure 8P shows a first electronic device 800A that displays the user interface 806 of the ECG application on the display 802 while performing an ECG recording corresponding to user input 809 on the input device 804 (for example, after an initial threshold period (e.g., 5 seconds) has elapsed from the start of the recording). In some embodiments, the required duration of the ECG recording is 30 seconds. Ten seconds have elapsed from the start of the recording, as shown by the timer 810 (e.g., showing "20 seconds") in Figure 8P. In some embodiments, the first electronic device 800A displays a tachogram 816 corresponding to a visual description of the ECG recording.
[0300] In Figure 8Q, the first electronic device 800A loses detection of user input 809 on input device 804. In some embodiments, in response to the loss of detection of user input on input device 804 (e.g., immediately or within a short period such as 1 second), the first electronic device 800A resets the ECG record (e.g., to end the previous record and prepare to start a new one) as indicated by timer 810 (e.g., the total duration of the record, here indicating "30 seconds"). In some embodiments, in response to the loss of detection of user input on input device 804, the first electronic device 800A "rewinds" the remaining time indicated by timer 810 back to the initial duration (e.g., counts up). In some embodiments, the first electronic device 800A causes tachogram 816 to display a "silent" tachogram, thereby further indicating to the user that no ECG information has been captured.
[0301] In some embodiments (for example, after resetting the record), if the first electronic device 800A detects that user input on the input device 804 has not been recovered for at least a predetermined period (e.g., 2.5 seconds), it displays a notification message 852 (e.g., describing "Please hold your fingers on the crown") within the user interface 806 of the ECG application, as shown in Figure 8R, requesting the user to recover input on the input device 804. In some embodiments (for example, in addition to displaying the notification message 852), the device displays (e.g., redisplays) an animation 808 of its initial pattern (e.g., a heart shape), as initially described with reference to Figure 8A. In some embodiments, a plurality of dynamic objects forming the animation that make up animation 808 dynamically transition from a grid pattern in Figure 8Q to its initial pattern (e.g., a heart shape) in Figure 8R.
[0302] In some embodiments (for example, after resetting the record), if the first electronic device 800A detects that user input on the input device 804 has not been recovered for at least a predetermined period (e.g., 2.5 seconds), it instead displays an animation 808 of its initial pattern (e.g., a heart shape) within the user interface 806 of the ECG application, as shown in Figure 8S, but refrains from displaying a notification message 852.
[0303] In some embodiments, if the first electronic device 800A detects that user input on the input device 804 has not been recovered during a first predetermined period (e.g., 2.5 seconds), it first transitions from the user interface of Figure 8Q to the user interface of Figure 8R, and then, after the first predetermined period has elapsed, if it detects that user input on the input device 804 has not been recovered during a second predetermined period (e.g., the same as or different from the first predetermined period), it transitions from the user interface of Figure 8R to the user interface of Figure 8S.
[0304] Figures 9A and 9B are flowcharts illustrating a method for recording biometric information for health monitoring according to several embodiments. Method 900 is performed in a first electronic device (e.g., 100, 300, 500, 600B, 800A) having a display and one or more input devices including biosensors (e.g., a set of one or more sensors, such as electrodes, configured to measure electrical activity correlated to a part of the user's heart of the electronic device). Some operations of Method 900 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.
[0305] As will be described later, Method 900 provides an intuitive way to manage health monitoring. This method reduces the cognitive burden on the user when managing health monitoring, thereby creating a more efficient human-machine interface. In the case of battery-powered computing devices, power is saved and the intervals between battery charges are increased by enabling users to manage health monitoring faster and more efficiently.
[0306] The first electronic device (e.g., 800A) displays a first user interface (e.g., the main user interface 806 of an ECG application, as shown in Figure 8A, of a health monitoring application or a health data measurement application) on a display (e.g., 802) (908) indicating that the first electronic device (e.g., 800A) is ready to detect biometric information (e.g., ECG data, BPM data, heart-related data). Visual feedback is provided by displaying the first user interface on the display (e.g., 802) indicating that the first electronic device (e.g., 800A) is ready to detect biometric information, thereby indicating that biometric information is ready to be recorded on the first electronic device. By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently.
[0307] In some embodiments, before displaying a first user interface (e.g., 806 in Figure 8A), the first electronic device (e.g., 800A) displays a home screen (e.g., 1012) (902) that includes application affordances (e.g., 1014) corresponding to a health monitoring application (e.g., an ECG application for monitoring cardiac health). Visual feedback is provided by displaying application affordances on the display (e.g., 802) corresponding to the health monitoring application on the home screen, thereby indicating to the user that the health monitoring application can be accessed from the home screen of the first electronic device (e.g., 800A). By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently. In some embodiments, a first electronic device (e.g., 800A) detects user activation of an application affordance via one or more input devices (904). In some embodiments, in response to detecting user activation of an application affordance, the first electronic device (e.g., 800A) displays a first user interface (e.g., 806) on a display (e.g., 802) (906).
[0308] In some embodiments, a (text) notification (e.g., 810) requesting a first input on a biosensor (e.g., 804) is displayed in the first user interface (e.g., 806 in Figure 8A) after a predetermined time (e.g., 5 seconds) has elapsed following detection of user activation of an application affordance. In some embodiments, the notification (e.g., 810) instructs the user to place a finger on the first input device (e.g., 804). By providing a notification (e.g., 810) requesting a first input on a biosensor within the first user interface after a predetermined time has elapsed following detection of user activation of an application affordance, the system helps the user avoid unintended actions (e.g., by selecting the wrong button or affordance) and, at the same time, provides the user with more control over the device by enabling the user to recognize that input on the biosensor is required to proceed with the recording operation. By providing additional control over the device (without cluttering the user interface with additional controllers displayed), it improves the usability of the device, makes the user-device interface more efficient (for example, by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, reduces power consumption and improves the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0309] In some embodiments, the recorded biometric information includes an electrocardiogram recording derived from biometric information detected by a biosensor (e.g., 804). In some embodiments, the biosensor (e.g., 804) is a contact-based sensor, and a first input from the biosensor (e.g., 804) satisfies a first criterion when contact (e.g., from a user's finger) is detected on the biosensor (e.g., 804).
[0310] A first electronic device (e.g., 800A) detects a first input from a biosensor (e.g., 804) that satisfies a first criterion (e.g., user contact with a biosensor, movement below a threshold, electrical interference below a threshold) (910).
[0311] In response to detecting a first input from a biosensor (e.g., 804), the first electronic device (e.g., 800A) begins recording the biometric information detected by the biosensor (e.g., 804) (912). Also in response to detecting a first input from a biosensor (e.g., 804), the first electronic device (e.g., 800A) displays a second user interface (e.g., 806 in Figure 8D) (e.g., a measurement page for a health application) on a display (e.g., 802) which is different from the first user interface (e.g., 806 in Figure 8A) (914), and the second user interface (e.g., 806 in Figure 8D) includes an indication (e.g., 810) of the progress of recording the biometric information. In some embodiments, the progress indication (e.g., 810) is a countdown timer (e.g., showing a countdown in seconds from a predetermined start time to zero). Visual feedback is improved by displaying an indication (e.g., 810) of the progress of biometric information recording on a second user interface (e.g., 806 in Figure 8D), showing the user that recording is in progress and the duration for which the user must maintain input to continue recording. By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently.
[0312] After recording at least a portion of the biometric information, the first electronic device (e.g., 800A) detects via one or more input devices that the first criterion is no longer met (e.g., user contact with biosensor 804 is lost) (912).
[0313] In response to detecting that the first criterion is no longer met during a first period (e.g., 5 seconds), the first electronic device (e.g., 800A) resets the progress indicator (e.g., 810) of the biometric information recording and maintains the display of the second user interface (e.g., 806 in Figure 8D) (918). By resetting the progress indicator (e.g., 810) while maintaining the display of the second user interface (e.g., 806 in Figure 8D) in response to detecting that the first criterion is no longer met during a first period, the device provides the user with more control over the device by helping to prevent the user from unintentionally leaving the health monitoring application, while at the same time allowing the user to easily continue recording without having to manually restart the recording or health monitoring application. By providing additional control over the device (without cluttering the user interface with additional controllers displayed), it improves the usability of the device, makes the user-device interface more efficient (for example, by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, reduces power consumption and improves the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0314] In response to detecting that the first criterion is no longer met during a second period longer than the first period (e.g., longer than 5 seconds), the first electronic device (e.g., 800A) replaces the display of the second user interface (e.g., 806 in Figure 8D) with the display of the first user interface (e.g., 806 in Figure 8A) (920). By replacing the display of the second user interface (e.g., 806 in Figure 8D) with the display of the first user interface (e.g., 806 in Figure 8A) in response to detecting that the first criterion is no longer met during a second period longer than the first period, visual feedback is improved by visually indicating to the user that recording has stopped and that a new recording can be resumed by the user. By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by enabling the user to use the device more quickly and efficiently.
[0315] In some embodiments, the first user interface (e.g., 806 in Figure 8A) includes a graphical animation (e.g., a graphical animation of a shape such as a heart, 808 in Figure 8A) indicating to the user that the first electronic device (e.g., 800A) is ready to detect biometric information, the graphical animation consisting of multiple moving objects (e.g., 808, circular dots) forming the first shape (e.g., heart shape). By providing the user with the graphical animation (e.g., 808 in Figure 8A) indicating that the first electronic device (e.g., 800A) is ready to detect biometric information, visual feedback on the current state of the application is provided, indicating that the user can proceed with recording. By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by allowing the user to use the device more quickly and efficiently.
[0316] In some embodiments, multiple moving objects (e.g., 808) in a graphical animation transition from a first shape (e.g., a heart shape) to a second shape (e.g., a grid shape) that is different from the first shape, as the display transitions from a first user interface to a second user interface.
[0317] In some embodiments, the first electronic device (e.g., 800A) further detects that the first criterion is no longer met during the first period, and then transitions a plurality of moving objects (e.g., 808) of the graphical animation to an intermediate shape between a first shape (e.g., a heart shape) and a second shape (e.g., a grid shape).
[0318] In some embodiments, while displaying a second user interface (e.g., 806 in Figure 8D) and recording biometric information (e.g., heart rhythm information, heart rate information), the first electronic device (e.g., 800A) displays a visual representation of the recorded biometric information within a graphical animation in the second shape (e.g., 808 in Figure 8D, a grid), and the recorded biometric information is filtered and scaled so that the visual representation of the recorded biometric information can be displayed within the graphical animation. Displaying a visual representation of the recorded biometric information while displaying the second user interface (e.g., 806 in Figure 8D) and recording biometric information improves visual feedback by allowing the user to see the current state and progress of the recording and by indicating to the user that recording is being performed. By providing the user with improved visual feedback, the usability of the device is improved, the user-device interface is made more efficient (e.g., by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by allowing the user to use the device more quickly and efficiently.
[0319] In some embodiments, a second user interface (e.g., 806 in Figure 8D) includes a (dynamic) graphical representation (e.g., a dynamic tachogram-like animation) corresponding to the visualization of biometric information from the recorded biometric information, and a (countdown) timer (e.g., 810) indicating the remaining time (to the user) to complete the recording of biometric information. In some embodiments, the biometric information to be recorded is heart-related data, and the graphical representation is a dynamic animation including a tachogram that reflects data acquired from a biosensor (e.g., 804).
[0320] In some embodiments, while recording biometric information, the first electronic device (e.g., 800A) detects that a second criterion is met via one or more input devices. In some embodiments, in response to detecting that the second criterion is met, the first electronic device (e.g., 800A) displays a (text) notification (e.g., 824) regarding the second criterion within a second user interface (e.g., 806 in Figure 8D, below the progress indication 810). By displaying a notification (e.g., 824) regarding the second criterion on the second user interface (e.g., 806 in Figure 8D) in response to detecting that the second criterion is met, the device provides the user with more control over the device by quickly indicating to the user that one or more actions need to be taken by the user to maintain the recording. By providing additional control over the device (without cluttering the user interface with additional controllers displayed), it improves the usability of the device, makes the user-device interface more efficient (for example, by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, reduces power consumption and improves the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0321] In some embodiments, the second criterion is met when an amount of movement (of the device caused by the user) exceeding a threshold is detected, and a notification (e.g., 844) indicates (to the user) that the amount of movement should be reduced. In some embodiments, a notification (e.g., 844) informs the user that too much movement has been detected. In some embodiments, a notification (e.g., 844) further informs the user to restrict the user's movement.
[0322] In some embodiments, the second criterion is met when a threshold is detected for the amount of movement (of the user-induced device) during at least a third period, and a notification (e.g., 846) indicates (to the user) that the first electronic device should be moved to a stationary position (e.g., on a table). In some embodiments, if the first electronic device is a smartwatch, the notification (e.g., 846) instructs the user to place their arm on the table.
[0323] In some embodiments, the second criterion is met when a second input (e.g., a press input, a click input) having a different type from the first input type is detected on the first input device (e.g., 804, a crown, a mechanical button, a rotary button), and a notification (e.g., 848) indicates to the user that the second input should not be repeated on the first input device. In some embodiments, the biosensor includes a housing portion of one or more electrodes integrated with the first input device (e.g., 804) (e.g., working in conjunction with one or more electrodes integrated with the backplate of a first electronic device (e.g., 800A)). In some embodiments, the second input is a press / click input on the first input device (e.g., 804), and a notification (e.g., 848) indicates that the user should not press / click the first input device (e.g., 804).
[0324] In some embodiments, the second criterion is met when the first input is no longer detected by the biosensor (e.g., 804) (e.g., aborted, interrupted) while biometric information recording is not yet complete, and a notification (e.g., 850) indicates (to the user) that the first input should be maintained on the biosensor (e.g., 804). In some embodiments, the first electronic device (e.g., 800A) detects that the first input is no longer detected when the user has stopped contacting the biosensor (e.g., 804) while biometric information recording is still in progress. In some embodiments, a notification (e.g., 850) instructs the user to re-establish contact with the biosensor (e.g., 804) (e.g., by returning the user's finger to it).
[0325] In some embodiments, after taking a first record of first biometric information and a second record of second biometric information different from the first biometric information (for example, the first and second records are different records taken at different times), the first electronic device (e.g., 800A) transmits the recorded first biometric information and the recorded second biometric information to the second electronic device (e.g., 800B, a smartphone paired with a smartwatch) (922).
[0326] In some embodiments, the first electronic device (e.g., 800A) detects (the user's) heart rate information for a predetermined period of time (e.g., via a second biosensor that measures heart rate information without user input) (924) (while not displaying applications corresponding to the first and second user interfaces on the display). In some embodiments, upon determination that the detected heart rate information satisfies a first condition (e.g., exceeding a threshold such as 150 BPM, exceeding the threshold for a specific period of time), the first electronic device (e.g., 800A) displays a notification indicating a high heart rate on the display (e.g., 802) (926). Visual feedback is improved by quickly notifying the user of a high heart rate by displaying a notification indicating a high heart rate on the display (e.g., 802) upon determination that the detected heart rate information satisfies a first condition. By providing users with improved visual feedback, the device's usability is enhanced, the user-device interface is made more efficient (for example, by helping users provide appropriate input when operating / interacting with the device and reducing user errors), and power consumption is reduced and device battery life is improved by enabling users to use the device more quickly and efficiently.
[0327] In some embodiments, the first electronic device (e.g., 800A) detects user activation of a notification via one or more input devices (928). In some embodiments, in response to detecting user activation of a notification, the first electronic device (e.g., 800A) displays a first user interface (e.g., 806 in Figure 8A) on a display (e.g., 802) (930) (thereby allowing the user to view their electrocardiogram recording using an application corresponding to the first user interface). By displaying the first user interface (e.g., 806 in Figure 8A) on a display (e.g., 802) in response to detecting user activation of a notification, the number of inputs required to launch an application corresponding to the first user interface when the device detects a high heart rate in the user is reduced. By reducing the number of inputs required to perform an action, the usability of the device is improved, the user-device interface is made more efficient (for example, by helping the user provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the battery life of the device is improved by allowing the user to use the device more quickly and efficiently.
[0328] It should be noted that the details of the process described above with respect to Method 900 (for example, Figures 9A to 9B) are also applicable in a similar manner to the methods described above and below. For example, Method 700 optionally includes one or more of the characteristics of the various methods described above with reference to Method 900. In another example, Method 1100 optionally includes one or more of the characteristics of the various methods described above with respect to Method 900. In another example, Method 1300 optionally includes one or more of the characteristics of the various methods described above with respect to Method 900. In another example, Method 1500 optionally includes one or more of the characteristics of the various methods described above with respect to Method 900. For brevity, these details will not be repeated below.
[0329] Figures 10A to 10J show exemplary user interfaces for health monitoring according to several embodiments. These exemplary user interfaces in these figures are used to illustrate processes described later, including the process in Figure 11. The exemplary user interfaces in these figures relate to monitoring health using recorded biometric information and are not limited to any particular type of biometric information. For convenience only, the exemplary user interfaces in these figures will be described with reference to one type of biometric information, electrocardiogram (ECG) information.
[0330] Figure 10A shows a first electronic device 1000 (corresponding, for example, to a second electronic device 600B and a first electronic device 800A). In some embodiments, the first electronic device 1000A is a smartwatch. In some embodiments, the first electronic device 1000A has a display 1002 and one or more input devices (including, for example, a touch layer of the display 1002 and one or more mechanical buttons such as a rotary crown). In some embodiments, the first electronic device 1000 includes one or more biosensors (for example, for detecting the user's heart rhythm and heart rate for recording ECG information) including one or more electrodes integrated into the input device 1004 of the first electronic device 1000 (e.g., a mechanical input device such as a pressable rotary crown). In some embodiments, one or more biosensors of the first electronic device 1000 further include one or more electrodes (e.g., integrated therewith) of a housing portion (e.g., a backplate) of the first electronic device 1000, and one or more electrodes integrated with the input device operate in conjunction with one or more electrodes of the housing portion to capture biological information (e.g., ECG information). Features relating to one or more biosensors of the first electronic device 1000 used to capture biological information (e.g., ECG information) are described in detail in Annex A.
[0331] In some embodiments, the first electronic device 1000 is configured to detect and respond to the activation of the input device 1004 (for example, by performing a first default action or a second default action), the activation being different from and unrelated to the capture of biological information (e.g., ECG information).
[0332] Figure 10A shows a first electronic device 1000 that displays the user interface 1006 of an ECG application on a display 1002 (corresponding, for example, to the user interface 644 of the ECG application described with reference to Figures 6A to 6AE and the user interface 806 of the ECG application described with reference to Figures 8A to 8S). In some embodiments, the ECG application is configured to cause the first electronic device 1000 to capture biometric information without detecting the activation of the input device 1004.
[0333] In some embodiments, user interface 1006 includes an animation 1008 that depicts a specific shape (e.g., a heart) (e.g., a fluid animation, corresponding to animation 646 of user interface 644 and animation 808 of user interface 806). In some embodiments, as shown in Figure 10A, animation 1008 includes a plurality of dynamic objects (e.g., circular objects) that form a specific shape (e.g., a heart), which appears three-dimensional and is visually fluid as the plurality of dynamic objects constantly move while maintaining the structure of the shape. In some embodiments, the plurality of dynamic objects forming animation 1008 have consistent visual characteristics (e.g., the same color).
[0334] In some embodiments, while displaying an animation 1008 of a specific shape (e.g., a heart), the user interface 1006 displays a notification message 1010 (e.g., corresponding to notification message 648 in user interface 644 and notification message 810 in user interface 806) indicating that the user must perform an action on the device to advance the recording of the user's ECG information. In some embodiments, the notification message 1010 instructs the user on the type of input (e.g., a touch or contact on the input device 1004 below a threshold amount so that the input does not "click" the input device 1004), and that the input must be maintained on the input device 1004 (e.g., for the duration of the recording).
[0335] In some embodiments, as shown in Figure 10A, while displaying the user interface 1006 of the ECG application, the first electronic device 1000 detects a press input 1001 on the input device 1004, the press input being an input on the input device 1004 having a press force exceeding a threshold amount so that the input "clicks" the input device 1004.
[0336] In some embodiments, as shown in Figure 10A, upon detecting a press input 1001 while displaying the user interface 1006 of the ECG application, the first electronic device 1000 displays a home user interface 1012 (e.g., the main user interface of the device's operating system) on the display 1002 (e.g., replacing the display of user interface 1006 with it), as shown in Figure 10B. In some embodiments, the home user interface 1012 includes a plurality of icons corresponding to different applications installed on the device, including an icon 1014 corresponding to the ECG application.
[0337] Figure 10C shows a first electronic device 1000 that, while displaying the user interface 1006 of an ECG application, detects (and maintains) user input 1003 on an input device 1004 (e.g., continuous touches or contacts of a finger on the input device 1000) and starts ECG recording (as described with reference to, for example, Figures 8A-8C). In some embodiments, when ECG recording is started, the dynamic objects (e.g., circular objects) of the animation 1008 transition from their initial fluid shape in Figure 10A to a grid shape. In some embodiments, when ECG recording is started, the device displays a timer 1016 within the user interface 1006 (e.g., below animation 1010) indicating the remaining time to complete the recording (e.g., 30 seconds initially). In some embodiments, when ECG recording is initiated, the device displays a notification message 1018 within the user interface 1006 (for example, under the timer 1016) requesting the user to maintain (stable) user input 1003 on the input device 1004 while ECG information is being recorded (for example, stating "Try to touch the crown and remain still").
[0338] Figure 10D shows a first electronic device 1000 that records ECG information from a user before an initial threshold period (e.g., 5 seconds) has elapsed since the start of recording (as indicated by a timer 1016 that shows, for example, 3 seconds have elapsed since the start of recording). In some embodiments, while the initial threshold period has not yet elapsed, the first electronic device 1000 detects a press input 1005 on an input device 1004, the press input being an input on the input device 1004 with a press force exceeding a threshold amount so that the input "clicks" the input device 1004. In some embodiments, in response to detecting a press input 1005 on the input device 1004 while the initial threshold period has not yet elapsed, the first electronic device 1000 (automatically) terminates recording and displays the user interface 1006 of the ECG application, as shown in Figure 10A.
[0339] Figure 10E shows a first electronic device that records ECG information from a user, with an initial threshold period (e.g., 5 seconds) elapsed from the start of recording (as indicated by timer 1016, which shows, for example, 6 seconds have elapsed since the start of recording). In some embodiments, after the initial threshold period has elapsed, the first electronic device 1000 detects a press input 1007 (e.g., similar to press input 1005) on input device 1004, the press input being an input on input device 1004 with a press force exceeding a threshold amount so that the input "clicks" the input device 1004. In some embodiments, in response to detecting a press input 1007 on input device 1004 after the initial threshold period (e.g., 5 seconds) has elapsed, the first electronic device 1000 does not terminate the recording. In some embodiments, instead of ending the recording, the first electronic device 1000 displays a notification message 1020 within the user interface 1006 indicating that it is not necessary to "click" the input device 1004 during or to successfully complete the recording (for example, stating "You do not need to click the crown").
[0340] In some embodiments, after an initial threshold period (e.g., 5 seconds) has elapsed and the input device 1004 has detected a press input 1007, the first electronic device 1000 does not terminate recording accordingly. Instead, the device detects a second press input (e.g., similar to press input 1007) after detecting press input 1007, but before a predetermined time (e.g., 2.5 seconds) has elapsed since detecting press input 1007. In some embodiments, after detecting press input 1007, but before a predetermined time (e.g., 2.5 seconds) has elapsed since detecting press input 1007, the first electronic device 1000 (automatically) terminates recording and displays the user interface 1006 of the ECG application, as shown in Figure 10A.
[0341] In some embodiments, after an initial threshold period (e.g., 5 seconds) has elapsed and a press input 1007 on the input device 1004 has been detected, the first electronic device 1000 does not terminate the recording accordingly, and the device detects a second press input (e.g., similar to press input 1007) after detecting the press input 1007 and after a predetermined time (e.g., 2.5 seconds) has elapsed since the detection of the press input 1007. In some embodiments, instead of terminating the recording, the first electronic device 1000 displays a notification message 1020 within the user interface 1006 indicating that it is not necessary to "click" the input device 1004 during or to successfully complete the recording (e.g., it states "You do not need to click the crown"). In summary, in some embodiments, and while recording is in progress, the termination of the recording occurs when two inputs are received within a predetermined period (e.g., within a rapid succession (e.g., within 2.5 seconds)). In contrast, in some embodiments, two inputs are received, but the recording is not canceled if the interval between them is longer than a predetermined period (e.g., within 2.5 seconds).
[0342] Figure 10F shows a first electronic device 1000 performing an ECG recording on an ECG application, with 20 seconds remaining to complete the recording, as indicated by the timer 1016 of the user interface 1006 (e.g., showing "20 seconds"). In Figure 10F, an initial threshold period (e.g., 5 seconds) has elapsed from the start of the recording. In some embodiments, after the initial threshold period (e.g., 5 seconds) has elapsed from the start of the recording, the first electronic device 1000 detects a user input, a press input 1009 (or press-and-hold input) on an input device 1004, the press input being an input on the input device 1004 with a press force exceeding a threshold amount such that the input "clicks" the input device 1004 (e.g., and the press force is maintained for at least a certain period of time, such as 1 second). In some embodiments, after an initial threshold time (e.g., 5 seconds) has elapsed, the first electronic device 1000 detects a press input 1009 on the input device 1004 and does not terminate the recording, displaying a notification message 1020 in the user interface 1006 indicating that it is not necessary to "click" the input device 1004 during or to successfully complete the recording (e.g., stating "You do not need to click the crown").
[0343] In some embodiments, after detecting user input 1009, for at least a predetermined time (e.g., 5 seconds), the first electronic device 1000 detects a press-and-hold input 1011 on input device 1004, where the press-and-hold input is an input on input device 1004 having a pressing force exceeding a threshold amount such that the input "clicks" input device 1004 and input device 1004 remains "clicked" for at least a threshold period (e.g., 1 second). In some embodiments, in response to detecting a press-and-hold input 1011 on input device 1004 before the initial threshold period has elapsed, the first electronic device 1000 (automatically) displays a user interface 1022 of a virtual assistant (e.g., a virtual assistant controlled by the device's operating system) on display 1002 (e.g., replacing the display of the user interface 1006 of an ECG application with it), as shown in Figure 10G.
[0344] Figures 10H to 10J show a first electronic device 1000 that receives electronic communications (e.g., phone calls, text messages, email messages) while the device is performing an ECG recording. In Figure 10H, the received electronic communications (e.g., a text message from "Jane Appleseed") are represented as a notification 1026 corresponding to the electronic communications. The electronic communications (represented as notification 1026) are received while the first electronic device 1000 is performing an ECG recording (e.g., from user input 1013 on input device 1004).
[0345] Figure 10I shows a first electronic device 1000 that, upon completion of the ECG recording, displays an ECG recording summary page 1028 (corresponding to, for example, the summary page 826 described with reference to Figures 8J-8K) on the display 1002. In Figure 10J, upon completion of the recording (and displaying the summary page 1028 corresponding to the recording) (or thereafter), the first electronic device 1000 displays a notification alert 1030 on the display 1002 corresponding to electronic communications received during the recording (e.g., a text message from "Jane Appleseed"). In some embodiments, if one or more additional electronic communications are received during the recording, the device also provides one or more notification alerts corresponding to the received electronic communications upon completion of the recording (or thereafter).
[0346] In some embodiments, when ECG recording is started (or before), the first electronic device 1000 automatically disables the device's wireless communication radio (e.g., LTE connection). In some embodiments, when ECG recording is completed (or accordingly), the first electronic device 1000 automatically re-enables the wireless communication radio on the device.
[0347] In some embodiments, when ECG recording is started (or before), the first electronic device 1000 automatically disables the device's tactile feedback controller (e.g., a tactile actuator). In some embodiments, when ECG recording is completed (or accordingly), the first electronic device 1000 automatically re-enables the device's tactile feedback controller.
[0348] Figure 11 is a flowchart illustrating a method of using an input device for health monitoring according to several embodiments. Method 1100 is performed in a device (e.g., 100, 300, 500, 600B, 800A, 1000) having a display and one or more input devices, including a first input device having an integrated biosensor (e.g., a rotatable and pressable watch crown having an integrated biosensor with one or more electrodes for detecting the characteristics of the user's heart). Some operations of Method 1100 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.
[0349] As described later, Method 1100 provides an intuitive method for managing health monitoring. This method reduces the cognitive burden on the user when managing health monitoring, thereby creating a more efficient human-machine interface. In the case of battery-powered computing devices, power is saved and the intervals between battery charges are increased by enabling users to manage health monitoring faster and more efficiently.
[0350] A first electronic device (e.g., 1000) displays on a display (e.g., 1002) a user interface (e.g., 1006 in Figure 10A) (1102) for an application (e.g., a health application such as a health monitoring application or a health data measurement application) for capturing biometric information (e.g., ECG data, BPM data, heart-related data) from a biosensor (e.g., 1004).
[0351] In some embodiments, a first electronic device (e.g., 1000) is configured to detect and respond to the activation of a first input device (e.g., 1004) (e.g., by performing a default action or a second default action), the activation being different from and unrelated to the capture of biometric information.
[0352] In some embodiments, the application is configured to cause a first electronic device (e.g., 1000) to capture biometric information without detecting the activation of a first input device (e.g., 1004).
[0353] While displaying a user interface (e.g., 1006 in Figure 10A) for an application to capture biometric information from a biosensor (e.g., 1004), a first electronic device (e.g., 1000) detects a first activation of a first input device (e.g., 1004, pressing of a first input device such as a rotating crown exceeding a threshold amount that causes a "click" of the crown) (1104).
[0354] In response to detecting a first activation of the first input device (e.g., 1004, pressing on the first input device), and while capturing biometric information from the biosensor (e.g., 1004), when a first criterion is met based on progress toward capturing biometric information with the biosensor (e.g., 1004), the first electronic device (e.g., 1000) performs a default action associated with the first input device (e.g., scrolling displayed content, exiting the currently active application, activating a digital assistant function) (1106). The device provides the user with more control over the device by enabling the user to interrupt biometric information capture in certain situations via input on the first input device, by performing a default action associated with the first input device (e.g., 1004) that interrupts biometric information capture upon determination that a first activation of the first input device (e.g., 1004) has been detected when a first criterion is met. The device's usability is improved by providing additional control options without cluttering the UI with additional controllers displayed, making the user-device interface more efficient (e.g., by helping the user to provide appropriate input when operating / interacting with the device and reducing user errors), and in addition, power consumption is reduced and the device's battery life is improved by enabling the user to use the device more quickly and efficiently.
[0355] Furthermore, in response to the detection of a first activation of the first input device (e.g., 1004, pressing on the first input device), and in accordance with the determination that the first activation of the first input device (e.g., 1004) was detected when the first criterion was not met while capturing biometric information from the biosensor (e.g., 1004), the first electronic device (e.g., 1000) continues to capture biometric information without performing the default operation associated with the first input device (e.g., 1004) (1108). By continuing to capture biometric information without performing the default operation associated with the first input device (e.g., 1004) in accordance with the determination that the first activation of the first input device was detected when the first criterion was not met, the device provides the user with more control over the device by enabling the device to continue capturing biometric information in certain situations without the user having to manually restart the recording process. By providing additional control options without cluttering the UI with additional controllers displayed, the device's usability is improved, the user-device interface is made more efficient (for example, by helping users provide appropriate input when operating / interacting with the device and reducing user errors), and power consumption is reduced and the device's battery life is improved by allowing users to use the device more quickly and efficiently.
[0356] In some embodiments, before capturing biometric information (for example, while displaying an introductory animation such as animation 808 of the main user interface 806, as shown in Figure 8A), the first electronic device (e.g., 1000) detects a second activation of the first input device (e.g., 1004). In some embodiments, upon detecting the second activation of the first input device (e.g., 1004), the first electronic device (e.g., 1000) performs a default action (for example, without determining whether biometric information is being captured).
[0357] In some embodiments, the default operation includes displaying a default user interface (e.g., 1012, a home screen including one or more affordances for launching an application) on a display (e.g., 1002). In some embodiments, displaying the default user interface (e.g., 1012) includes closing or suspending any currently active or running application (e.g., an application for capturing biometric information).
[0358] In some embodiments, the default operation includes displaying the user interface of a digital virtual assistant (e.g., 1022) on a display (e.g., 1002) (for example, by replacing the display of the user interface of an application for capturing biometric information (e.g., 1006)).
[0359] In some embodiments, the first criterion is met when the capture of biometric information occurs within a first threshold time (e.g., 5 seconds).
[0360] In some embodiments, after continuing to capture biometric information without performing a default action associated with the first input device (e.g., 1004), the first electronic device (e.g., 1000) detects a second activation of the first input device (e.g., 1004) (1110). In some embodiments, upon detecting the second activation of the first input device (e.g....
Claims
1. A first electronic device having a display and one or more input devices, which is paired with a second electronic device, The first part of a tutorial for using the functions of the second electronic device is displayed on the aforementioned display, The process involves detecting a request to advance the tutorial via one or more input devices, In response to detecting the request to advance the tutorial, the display shows an instruction to perform an operation on the second electronic device, which includes the function of the second electronic device. Receiving an indication from the second electronic device that the command has been executed, Upon receiving the indication that the command has been executed, the display shows a second part of the tutorial that is different from the first part, Methods that include...
2. Before displaying the first portion of the tutorial for using the function of the second electronic device on the display, the second electronic device receives a second indication that an application configured to control the use of the function on the second electronic device is open on the second electronic device, Upon receiving the second indication that the application configured to control the use of the function on the second electronic device is open, the display shall show a notification on the display corresponding to the tutorial for using the function on the second electronic device, The method according to claim 1, further comprising:
3. The method according to claim 1 or 2, wherein the operation on the second electronic device includes capturing biological data.
4. The method according to any one of claims 1 to 3, wherein the first portion of the tutorial includes a plurality of graphical indications of possible results of the operation performed on the second electronic device.
5. The aforementioned operation evaluates medical characteristics, including heart rhythm assessment and heart rate assessment, and the possible results are: Normal result, Abnormal heart rhythm pattern results, Abnormal heart rate results, and uncertain results, The method according to claim 4, selected from the group consisting of the following.
6. While displaying at least one first possible outcome of the possible outcomes, including a portion of the first result summary, the user activation of the extended affordance associated with the first result summary is detected via one or more input devices. In response to detecting the user activation of the extended affordance, the entirety of the first result summary is displayed on the display, The method according to claim 4 or 5, further comprising:
7. The method according to any one of claims 4 to 6, wherein the plurality of graphical indicators of possible outcomes include a first graphical indicator including the display of a first animation relating to a first possible outcome, and a second graphical indicator including a second animation relating to a second possible outcome, wherein the first animation and the second animation are synchronized.
8. While displaying the multiple graphical indicators of possible results on the display, a scroll gesture is detected via one or more input devices. In response to detecting the aforementioned scroll gesture, the plurality of graphical indicators are scrolled, Displaying a third graphical indication on the display, which includes a third animation relating to a third possible outcome, wherein the third animation is synchronized with the first and second animations. The method according to claim 7, further comprising:
9. The method according to claim 7 or 8, wherein the first animation includes a first portion of the animation which is animated at a fixed position, and a second portion of the animation which is animated to move from the fixed position to a second position.
10. Before receiving the indication from the second electronic device that the instruction has been executed, the second electronic device receives an indication that the instruction has started to be executed, Upon receiving the indication that the command has begun to be executed, the display shows an indication that the command is being executed on the second electronic device, The method according to any one of claims 1 to 9, further comprising:
11. The method according to any one of claims 1 to 10, wherein the second portion of the tutorial includes a graphical animation representing information obtained from the operation on the second electronic device.
12. The method according to any one of claims 1 to 11, wherein the first part of the tutorial includes a limitation indication that includes one or more medical properties that cannot be derived from the operation.
13. After displaying the second portion of the tutorial on the display, the user interface of the health application is displayed on the display. The detection of user activation of affordances for viewing recorded biometric information via one or more input devices, In response to detecting the user activation of the affordance for viewing an existing record of biometric information, a first plurality of representations corresponding to the existing record of biometric information are displayed on the display. The method according to any one of claims 1 to 12, further comprising:
14. The method according to claim 13, wherein the affordance for viewing existing records of biometric information includes an indication of the number of existing records of biometric information.
15. The method according to claim 13 or 14, wherein the first plurality of representations of an existing record of biological information includes a first representation corresponding to a first existing record having an abnormal evaluation result, and the first representation includes an indication of the abnormal evaluation result displayed in a first visual characteristic.
16. The method according to any one of claims 13 to 15, wherein the first plurality of representations of an existing record of biometric information includes a second representation corresponding to a second existing record associated with a user-specified symptom, the second representation includes an indication of the number of user-specified symptoms associated with the second existing record.
17. The method according to any one of claims 13 to 16, wherein the first plurality of representations of existing records of biometric information include a third representation corresponding to a third existing record not associated with any user-specified symptom, and the third representation does not include an indication of a user-specified symptom associated with the third existing record.
18. The method according to claim 16 or 17, wherein the user-specified symptom cannot be changed after it has been specified and saved.
19. Furthermore, in response to detecting the user activation of the affordance for viewing the recorded biometric information, a plurality of classification affordances, including a first classification affordance and a second classification affordance, are displayed on the display. The user activation of the first classification affordance is detected via one or more input devices, In response to detecting the user activation of the first classification affordance, a second plurality of representations corresponding to existing records of biometric information are displayed on the display, wherein the second plurality of representations correspond to existing records associated with the first type of evaluation result. The user activation of the second classification affordance is detected via one or more input devices, In response to detecting user activation of the second classification affordance, a third plurality of representations corresponding to existing records of biometric information are displayed on the display, wherein the third plurality of representations correspond to existing records associated with the second type of evaluation result. The method according to any one of claims 13 to 18, further comprising:
20. The user selection of a first representation of the first plurality of representations corresponding to a first existing record corresponding to a first evaluation result is detected via one or more input devices, In response to detecting the user selection of the first representation, the first detailed view of the first existing record is displayed, While displaying the first detailed view of the first existing record, the user activation of information affordances is detected via one or more input devices. In response to detecting the user activation of the information affordance, the display shows an animation of the results summary and the corresponding possible results from the first part of the tutorial. This also includes, The method according to any one of claims 13 to 19.
21. While displaying the first detailed view of the first existing record corresponding to the first evaluation result, the user activation of the export affordance is detected via one or more input devices. In response to detecting user activation of the export affordance, a document containing information about the first existing record is created, The method according to claim 20, further comprising:
22. The method according to any one of claims 1 to 21, wherein the first portion of the tutorial is displayed in response to input received while displaying a user interface configured to change one or more settings of the second electronic device.
23. A computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a first electronic device having one or more output devices including a display and one or more input devices, wherein the first electronic device is paired with a second electronic device, and the one or more programs include instructions for performing the method according to any one of claims 1 to 22.
24. A first electronic device paired with a second electronic device, The display and One or more input devices, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, Equipped with, The one or more programs described above include instructions for performing the method described in any one of claims 1 to 22, The first electronic device.
25. A first electronic device paired with a second electronic device, The display and One or more input devices, Means for carrying out the method described in any one of claims 1 to 22, A first electronic device comprising the following:
26. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices, wherein the first electronic device is paired with a second electronic device, and the one or more programs are The first part of a tutorial for using the functions of the second electronic device is displayed on the aforementioned display, The system detects a request to advance the tutorial via one or more input devices, Upon detecting the request to advance the tutorial, the display shows an instruction to perform an operation on the second electronic device that includes the function of the second electronic device. The second electronic device receives an indication that the command has been executed. Upon receiving the indication that the command has been executed, the display shows a second part of the tutorial, which is different from the first part. A non-temporary computer-readable storage medium containing instructions.
27. A first electronic device paired with a second electronic device, The display and One or more input devices, One or more processors, The system comprises a memory that stores one or more programs configured to be executed by one or more processors, and the one or more programs are The first part of a tutorial for using the functions of the second electronic device is displayed on the aforementioned display, The system detects a request to advance the tutorial via one or more input devices, Upon detecting the request to advance the tutorial, the display shows an instruction to perform an operation on the second electronic device that includes the function of the second electronic device. The second electronic device receives an indication that the command has been executed. Upon receiving the indication that the command has been executed, the display shows a second part of the tutorial, which is different from the first part. A first electronic device containing instructions.
28. A first electronic device paired with a second electronic device, The display and One or more input devices, The display includes means for displaying a first portion of a tutorial for using the functions of the second electronic device, Means for detecting a request to advance the tutorial via one or more input devices, In response to detecting the request to advance the tutorial, means for displaying on the display an instruction to perform an operation on the second electronic device, which includes the function of the second electronic device, Means for receiving an indication from the second electronic device that the command has been executed, In response to receiving the indication that the command has been executed, means for displaying a second part of the tutorial, different from the first part, on the display, A first electronic device comprising the following:
29. In a first electronic device having a display and one or more input devices including a biosensor, A first user interface indicating that the first electronic device is ready to detect biological information is displayed on the display, To detect a first input from the biosensor that satisfies the first criterion, In response to detecting the first input by the biosensor, the recording of the biological information detected by the biosensor is initiated. Displaying a second user interface on the display that is different from the first user interface, wherein the second user interface includes an indication of the progress of recording the biometric information. After recording at least a portion of the aforementioned biological information, the first criterion is detected via one or more input devices, In response to detecting that the first criterion is no longer met during the first period, the indication of the progress of recording the biometric information is reset, and the display of the second user interface is maintained. In response to detecting that the first criterion is no longer met during a second period longer than the first period, the display of the second user interface is replaced with the first user interface, Methods that include...
30. The method according to claim 29, wherein the recorded biological information includes an electrocardiogram recording derived from the biological information detected by the biological sensor.
31. Before displaying the first user interface, a home screen containing application affordances corresponding to the health monitoring application is displayed, Detecting user activation of the application affordance via one or more input devices, In response to detecting the user activation of the application affordance, the first user interface is displayed on the display. The method according to claim 29 or 30, further comprising:
32. The method according to claim 31, wherein a notification requesting the first input on the biosensor is displayed in the first user interface after a predetermined time has elapsed since the detection of the user activation of the application affordance.
33. The method according to any one of claims 29 to 32, wherein the biosensor is a contact-based sensor, and the first input from the biosensor satisfies the first criterion when contact is detected on the biosensor.
34. The method according to any one of claims 29 to 33, wherein the first user interface includes a graphical animation indicating that the first electronic device is ready to detect biological information, and the graphical animation consists of a plurality of moving objects that form a first shape.
35. The method according to claim 34, wherein the plurality of moving objects in the graphical animation transition from a first shape to a second shape different from the first shape when the display transitions from a first user interface to a second user interface.
36. Furthermore, in response to detecting that the first criterion is no longer met during the first period, the plurality of moving objects in the graphical animation are transitioned to an intermediate shape between the first shape and the second shape. The method according to claim 35, further comprising:
37. Displaying the second user interface and recording the biometric information, while displaying a visual representation of the recorded biometric information within the graphical animation in the second shape, wherein the recorded biometric information is filtered and scaled so that the visual representation of the recorded biometric information can be displayed within the graphical animation. The method according to any one of claims 34 to 36, further comprising:
38. The method according to any one of claims 29 to 37, wherein the second user interface includes a graphical representation corresponding to the visualization of the biometric information from the recorded biometric information, and a timer indicating the remaining time to complete the recording of the biometric information.
39. While recording the aforementioned biological information, it is detected via one or more input devices that a second criterion is met, Upon detecting that the second criterion is met, a notification regarding the second criterion is displayed within the second user interface. The method according to any one of claims 29 to 38, further comprising:
40. The second criterion described above is met when a displacement exceeding the threshold is detected. The aforementioned notice indicates that the amount of movement should be reduced. The method according to claim 39.
41. The second criterion is met when the amount of movement exceeding the threshold is detected during at least the third period. The aforementioned notice indicates that the first electronic device should be moved to a stationary position. The method according to claim 39 or 40.
42. The second criterion is satisfied when a second input having a different type from the first input type is detected on the first input device. The notification indicates that the second input should not be repeated on the first input device. The method according to any one of claims 39 to 41.
43. The second criterion is met when the first input is no longer detected by the biosensor while the recording of the biometric information is not yet complete. The notification indicates that the first input should be maintained on the biosensor. The method according to any one of claims 39 to 42.
44. After recording the first biological information and the second biological information different from the first biological information, the recorded first biological information and the recorded second biological information are transmitted to a second electronic device. The method according to any one of claims 29 to 43, further comprising:
45. To detect heart rate information for a predetermined period of time, In accordance with the determination that the detected heart rate information satisfies the first condition, a notification indicating a high heart rate is displayed on the display. Detecting user activation of the notification via one or more input devices, In response to detecting the user activation of the notification, the first user interface is displayed on the display. The method according to any one of claims 29 to 44, further comprising:
46. The method according to any one of claims 29 to 45, wherein the indication of progress is a countdown timer.
47. A computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices including a biosensor, wherein the one or more programs include instructions for performing the method according to any one of claims 29 to 46.
48. The display and One or more input devices, including a biosensor, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, A first electronic device comprising, The one or more programs described above include instructions for performing the method described in any one of claims 29 to 46, The first electronic device.
49. The display and One or more input devices, including a biosensor, Means for carrying out the method described in any one of claims 29 to 46, A first electronic device comprising the following:
50. A non-temporary computer-readable storage medium that stores one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices including a biosensor, wherein the one or more programs are A first user interface indicating that the first electronic device is ready to detect biological information is displayed on the display. The first input from the biosensor that meets the first criterion is detected, In response to detecting the first input by the biosensor, the recording of the biological information detected by the biosensor is initiated. A second user interface, which is different from the first user interface, is displayed on the display, and which includes an indication of the progress of recording the biometric information. After recording at least a portion of the aforementioned biological information, the system detects, via one or more input devices, that the first criterion is no longer met. In response to detecting that the first criterion is no longer met during the first period, the indication of the biometric information record is reset, and the display of the second user interface is maintained. In response to detecting that the first criterion is no longer met during a second period longer than the first period, the display of the second user interface is replaced with the first user interface. A non-temporary computer-readable storage medium containing instructions.
51. The display and One or more input devices, including a biosensor, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, A first electronic device comprising, the one or more programs, A first user interface indicating that the first electronic device is ready to detect biological information is displayed on the display. The first input from the biosensor that meets the first criterion is detected, In response to detecting the first input by the biosensor, the recording of the biological information detected by the biosensor is initiated. A second user interface, which is different from the first user interface, is displayed on the display, and which includes an indication of the progress of recording the biometric information. After recording at least a portion of the aforementioned biological information, the system detects, via one or more input devices, that the first criterion is no longer met. In response to detecting that the first criterion is no longer met during the first period, the indication of the progress of recording the biometric information is reset, and the display of the second user interface is maintained. In response to detecting that the first criterion is no longer met during a second period longer than the first period, the display of the second user interface is replaced with the first user interface. A first electronic device containing instructions.
52. The first electronic device, The display and One or more input devices, including a biosensor, The means for displaying a first user interface on the display indicating that the first electronic device is ready to detect biological information, Means for detecting a first input from the biosensor that meets the first criterion, In response to detecting the first input by the biosensor, The system starts recording the biological information detected by the aforementioned biosensor. A means for displaying a second user interface on the display, which is different from the first user interface and includes an indication of the progress of recording the biometric information, After recording at least a portion of the aforementioned biological information, means for detecting via one or more input devices that the first criterion is no longer met, In response to detecting that the first criterion is no longer met during the first period, means for resetting the indication of the progress of recording the biometric information and maintaining the display of the second user interface, In response to detecting that the first criterion is no longer met during a second period longer than the first period, means for replacing the display of the second user interface with the first user interface, A first electronic device comprising the following:
53. A first electronic device having a display and one or more input devices including a first input device having an integrated biosensor, The display shows a user interface for an application that captures biological information from the biosensor, While the user interface of the application for capturing biological information from the biosensor is displayed, the first activation of the first input device is detected. In response to the detection of the first activation of the first input device, and while capturing biological information from the biosensor, When a first criterion is met based on progress toward capturing biological information with the biosensor, a predetermined action associated with the first input device is performed, in accordance with the determination that the first activation of the first input device has been detected, which interrupts the capture of the biological information. When the first criterion is not met, and the determination is made that the first activation of the first input device has been detected, the biometric information continues to be captured without performing the default operation associated with the first input device, Methods that include...
54. The method according to claim 53, wherein the first electronic device is configured to detect the activation of the first input device and to respond to the activation of the first input device, the activation being different from and unrelated to the capture of biometric information.
55. The method according to claim 53 or 54, wherein the application is configured to cause the first electronic device to capture the biometric information without detecting the activation of the first input device.
56. Before capturing the aforementioned biological information, the second activation of the first input device is detected, In response to detecting the second activation of the first input device, the default operation is performed, The method according to any one of claims 53 to 55, further comprising:
57. The method according to any one of claims 53 to 56, wherein the default operation includes displaying a default user interface.
58. The method according to any one of claims 53 to 57, wherein the default operation includes displaying a user interface for a digital virtual assistant on the display.
59. The method according to any one of claims 53 to 58, wherein the first criterion is satisfied when the capture of the biological information is performed in less than a first threshold time.
60. After continuing to capture the biometric information without performing the default operation associated with the first input device, the second activation of the first input device is detected. In response to the detection of the second activation of the first input device, Perform the default action associated with the first input device, which interrupts the capture of the biometric information, in accordance with the determination that the second activation of the first input device is detected within a predetermined time after the first activation of the first input device has been detected, After detecting the first activation of the first input device, and in accordance with the determination that the second activation of the first input device is detected after a predetermined time, the system continues to capture the biometric information without performing the default operation associated with the first input device. The method according to any one of claims 53 to 59, further comprising:
61. When the biological information is captured from the biosensor, the haptic feedback controller of the first electronic device is automatically disabled. Upon completion of capturing the aforementioned biological information, the haptic feedback controller will be automatically re-enabled. The method according to any one of claims 53 to 60, further comprising:
62. When the biometric information is captured from the biosensor, the wireless communication radio of the first electronic device is automatically disabled, and a first type of notification is prevented from being displayed, including a notification corresponding to an electronic communication received while the biometric information is being captured. Upon completion of the capture of the biometric information, the wireless communication radio is automatically reactivated, enabling the display of the first type of notification. The method according to any one of claims 53 to 61, further comprising:
63. A computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices including a first input device having an integrated biosensor, wherein the one or more programs include instructions for performing the method according to any one of claims 53 to 62.
64. The display and One or more input devices, including a first input device having an integrated biosensor, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, A first electronic device comprising, The first electronic device comprises one or more programs, each including instructions for performing the method according to any one of claims 53 to 62.
65. The display and One or more input devices, including a first input device having an integrated biosensor, Means for carrying out the method described in any one of claims 53 to 62, A first electronic device comprising the following:
66. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices including a first input device having an integrated biosensor, wherein the one or more programs are The user interface for an application to capture biological information from the biosensor is displayed on the aforementioned display. While the user interface of the application for capturing biological information from the biosensor is displayed, the first activation of the first input device is detected. In response to the detection of the first activation of the first input device, and while capturing biological information from the biosensor, When a first criterion is met based on progress toward capturing biological information with the biosensor, a default action associated with the first input device is performed, interrupting the capture of the biological information, in accordance with the determination that the first activation of the first input device has been detected. When the first criterion is not met, and the determination is made that the first activation of the first input device has been detected, the system continues to capture the biometric information without performing the default operation associated with the first input device. A non-temporary computer-readable storage medium containing instructions.
67. The display and One or more input devices, including a first input device having an integrated biosensor, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, A first electronic device comprising, the one or more programs, The user interface for an application to capture biological information from the biosensor is displayed on the aforementioned display. While the user interface of the application for capturing biological information from the biosensor is displayed, the first activation of the first input device is detected. In response to the detection of the first activation of the first input device, and while capturing biological information from the biosensor, When a first criterion is met based on progress toward capturing biological information with the biosensor, a default action associated with the first input device is performed, interrupting the capture of the biological information, in accordance with the determination that the first activation of the first input device has been detected. When the first criterion is not met, and the determination is made that the first activation of the first input device has been detected, the system continues to capture the biometric information without performing the default operation associated with the first input device. A first electronic device containing instructions.
68. The display and One or more input devices, including a first input device having an integrated biosensor, The display includes means for displaying a user interface for an application for capturing biological information from the biosensor, Means for detecting the first activation of the first input device while the user interface of the application for capturing biological information from the biosensor is displayed, In response to the detection of the first activation of the first input device, and while capturing biological information from the biosensor, When a first criterion is met based on progress toward capturing biological information with the biosensor, a default action associated with the first input device is performed, interrupting the capture of the biological information, in accordance with the determination that the first activation of the first input device has been detected. A means for continuing to capture the biometric information without performing the default operation associated with the first input device, in accordance with the determination that the first activation of the first input device has been detected when the first criterion is not met, A first electronic device comprising the following:
69. In a first electronic device having a display and one or more input devices, The method involves capturing biological information using a biosensor that communicates with the aforementioned first electronic device, The display shows an evaluation of medical characteristics determined based on the biological information captured by the biosensor. While displaying the representation of the evaluation of the medical characteristics, a series of one or more inputs are detected via one or more input devices, and user-specified symptoms are added to the evaluation of the medical characteristics. In response to detecting one or more of the aforementioned series of inputs, In accordance with the determination that at least one of the user-specified symptoms meets the corresponding criteria, a first user interface is displayed on the display, which includes an affordance that, when activated, initiates a process for requesting immediate treatment. In accordance with the determination that the user-specified symptom does not meet the corresponding criteria, the display shall show the expression of the evaluation of the medical characteristics and one or more expressions of the user-specified symptom without displaying the first user interface. Methods that include...
70. While the representation of the evaluation of the medical characteristics is displayed on the display, a scroll input is detected via the first input device. In response to detecting the aforementioned scroll input, the second user interface, which includes the representation of the evaluation of the medical characteristics, is scrolled. The display shows symptom addition affordances for adding the user-specified symptoms to the evaluation, The method according to claim 69, further comprising:
71. Furthermore, in accordance with the determination that the user-specified symptom does not meet the corresponding criteria, a scroll gesture is detected via one or more input devices. In response to detecting the scroll gesture via one or more of the aforementioned input devices, options for requesting treatment are displayed on the display. The method according to claim 69 or 70, further comprising:
72. The method according to any one of claims 69 to 71, wherein the user-specified symptom includes a first symptom corresponding to a severe symptom, and the first expression of the one or more expressions of the user-specified symptom corresponding to the first symptom is displayed with first visual characteristics.
73. The method according to any one of claims 69 to 72, wherein the medical characteristics include heart rhythm characteristics and heart rate characteristics, and the expressed expression of the evaluation of the medical characteristics includes a summary of heart rhythm evaluation and a summary of heart rate evaluation.
74. The method according to claim 73, wherein, if the heart rate rhythm evaluation corresponds to an abnormal result and the heart rate evaluation corresponds to an abnormal result, the heart rate rhythm evaluation summary is displayed with a first visual characteristic, and the heart rate evaluation summary is displayed with the first visual characteristic.
75. The method according to claim 73 or 74, wherein, when the heart rate rhythm evaluation corresponds to an abnormal result and the heart rate evaluation corresponds to a normal result, the heart rate rhythm evaluation summary is displayed with the first visual characteristics, and the heart rate evaluation summary is not displayed with the first visual characteristics.
76. The method according to any one of claims 73 to 75, wherein, when the heart rate evaluation corresponds to an abnormal result and the heart rhythm evaluation corresponds to a normal result, the heart rate evaluation summary is displayed with the first visual characteristics, and the heart rhythm evaluation summary is not displayed with the first visual characteristics.
77. The method according to any one of claims 73 to 76, wherein if the heart rate evaluation results in a highly abnormal outcome and it becomes impossible to make a judgment regarding the heart rhythm evaluation, the heart rate evaluation summary is displayed using a first visual characteristic, and the heart rhythm evaluation summary is displayed using the first visual characteristic.
78. In accordance with the determination that the evaluation of the medical characteristics cannot be determined, an indication that the evaluation was uncertain shall be displayed within the expression of the evaluation. The method according to any one of claims 69 to 77, further comprising:
79. The method according to any one of claims 69 to 78, wherein the evaluation of the medical characteristics is a normal result, and the series of one or more inputs for adding the user-specified symptoms are detected while the representation of the evaluation corresponding to the normal result is displayed.
80. While displaying the expression of the evaluation of the medical characteristics, the user activation of information affordances is detected via one or more input devices. In response to detecting the user activation of the information affordance, text information relating to the evaluation is displayed on the display. The method according to any one of claims 69 to 79, further comprising:
81. When the biosensor captures the biometric information, the wireless communication radio of the first electronic device is automatically disabled to prevent the notification from being displayed. Upon completion of the capture of the aforementioned biometric information, the wireless communication device is automatically reactivated, enabling the display of notifications. The method according to any one of claims 69 to 80, further comprising:
82. After detecting one or more of the aforementioned inputs, the system detects user activation of the confirmation button. In response to detecting the user activation of the confirmation button, the evaluation of the medical characteristics is transmitted from the first electronic device to the second electronic device in order to display the corresponding representation of the evaluation of the medical characteristics on the second electronic device. The method according to any one of claims 69 to 81, further comprising:
83. The method according to claim 82, wherein the user-specified symptom cannot be changed after the user activation of the confirmation button is detected.
84. A computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices, wherein the one or more programs include instructions for performing the method according to any one of claims 69 to 83.
85. The display and One or more input devices, One or more processors, A memory that stores one or more programs configured to be executed by one or more processors, A first electronic device comprising, The one or more programs include instructions for performing the method described in any one of claims 69 to 83, The first electronic device.
86. The display and One or more input devices, Means for carrying out the method described in any one of claims 69 to 83, A first electronic device comprising the following:
87. A non-temporary computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of a first electronic device having a display and one or more input devices, wherein the one or more programs are A biosensor communicating with the first electronic device is used to capture biological information. On the display, an expression of the evaluation of medical characteristics determined based on the biological information captured by the biosensor is displayed. While displaying the representation of the evaluation of the medical characteristics, a series of one or more inputs are detected via the one or more input devices, and user-specified symptoms are added to the evaluation of the medical characteristics. In response to detecting one or more of the aforementioned series of inputs, In accordance with the determination that at least one of the user-specified symptoms meets the corresponding criteria, a first user interface is displayed on the display, which includes an affordance that, when activated, initiates a process for requesting immediate treatment. In accordance with the determination that the user-specified symptom does not meet the corresponding criteria, the display shows the expression of the evaluation of the medical characteristics and one or more expressions of the user-specified symptom without displaying the first user interface. A non-temporary computer-readable storage medium containing instructions.
88. The display and One or more input devices, One or more processors, A first electronic device comprising: a memory for storing one or more programs configured to be executed by one or more processors, wherein the one or more programs are A biosensor communicating with the first electronic device is used to capture biological information. On the display, an expression of the evaluation of medical characteristics determined based on the biological information captured by the biosensor is displayed. While displaying the representation of the evaluation of the medical characteristics, a series of one or more inputs are detected via the one or more input devices, and user-specified symptoms are added to the evaluation of the medical characteristics. In response to detecting one or more of the aforementioned series of inputs, In accordance with the determination that at least one of the user-specified symptoms meets the corresponding criteria, a first user interface is displayed on the display, which includes an affordance that, when activated, initiates a process for requesting immediate treatment. In accordance with the determination that the user-specified symptom does not meet the corresponding criteria, the display shows the expression of the evaluation of the medical characteristics and one or more expressions of the user-specified symptom without displaying the first user interface. A first electronic device containing instructions.
89. The first electronic device, The display and One or more input devices, A means for capturing biological information using a biosensor communicating with the first electronic device, The means for displaying on the display an evaluation of medical characteristics determined based on the biological information captured by the biosensor, While displaying the representation of the evaluation of the medical characteristics, means for detecting a series of one or more inputs via one or more input devices and adding user-specified symptoms to the evaluation of the medical characteristics, In response to detecting one or more of the aforementioned series of inputs, In accordance with the determination that at least one of the user-specified symptoms meets the corresponding criteria, a first user interface is displayed on the display, which includes an affordance that, when activated, initiates a process for requesting immediate treatment. A means for displaying, on the display, the expression of the evaluation of the medical characteristics and one or more expressions of the user-specified symptoms, without displaying the first user interface, in accordance with the determination that the user-specified symptoms do not meet the corresponding criteria, A first electronic device comprising the following:
90. An electronic device having a display and one or more input devices, which is operably connected to a plurality of biosensors, Receiving first biological information from the first biological sensor of the plurality of biological sensors, In response to receiving the first biometric information and in accordance with the determination that the first biometric information meets the first criterion, a warning including a first affordance for detecting additional biometric information is displayed on the display. Receiving user activation of the first affordance via one or more input devices, After receiving the user activation of the first affordance, the system receives second biometric information associated with the first biometric information from a second biometric sensor of the plurality of biometric sensors that is different from the first biometric sensor, Methods that include...
91. The method according to claim 90, wherein the first biological information includes biological information recorded at a first time and biological information recorded at a second time different from the first time.
92. The method according to claim 90 or 91, relating to information related to the heart.
93. The method according to claim 92, wherein the first criterion includes abnormal heart rhythm information.
94. The method according to any one of claims 90 to 93, wherein the warning includes one or more times when the first biometric information was recorded by the electronic device.
95. The method according to any one of claims 90 to 94, wherein the warning includes an indication of a medical condition identified based on the first biological information.
96. The method according to any one of claims 90 to 95, wherein the warning includes an indication to seek treatment.
97. The method according to any one of claims 90 to 96, wherein the first biosensor includes one or more photodiode sensors.
98. The method according to any one of claims 90 to 97, wherein the second biosensor is integrated with the first input device of the one or more input devices.
99. In response to receiving the user activation of the first affordance, and before receiving the second biometric information, display on the display the first application associated with receiving the second biometric information. The method according to any one of claims 90 to 98, further comprising:
100. After displaying the first application and before receiving the second biometric information, the system detects user input on the first input device of one or more input devices, wherein the second biosensor is integrated with the first input device. In response to detecting the user input, the system receives the second biometric information from the second biosensor, The method according to claim 99, further comprising:
101. The method according to claim 100, wherein the second biometric information is received from the second biosensor while the user input is maintained on the first input device.
102. A computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, wherein the electronic device is operably connected to a plurality of biosensors, and the one or more programs include instructions for performing the method according to any one of claims 90 to 101.
103. An electronic device operably connected to multiple biosensors, The display and One or more input devices, A memory that stores one or more programs configured to be executed by one or more processors, Equipped with, The one or more programs described above include instructions for performing the method described in any one of claims 90 to 101, Electronic devices.
104. An electronic device operably connected to multiple biosensors, The display and One or more input devices, Means for carrying out the method described in any one of claims 90 to 101, An electronic device equipped with the following features.
105. A computer-readable storage medium for storing one or more programs configured to be executed by one or more processors of an electronic device having a display and one or more input devices, wherein the electronic device is operably connected to a plurality of biosensors, and the one or more programs are The system receives first biological information from the first biological sensor of the plurality of biological sensors. Upon receiving the first biometric information, and in accordance with the determination that the first biometric information meets the first criterion, a warning including a first affordance for detecting additional biometric information is displayed on the display. The user activation of the first affordance is received via one or more input devices. After receiving the user activation of the first affordance, the system receives second biometric information associated with the first biometric information from a second biometric sensor of the plurality of biometric sensors that is different from the first biometric sensor. A computer-readable storage medium containing instructions.
106. An electronic device operably connected to multiple biosensors, The display and One or more input devices, The system comprises a memory that stores one or more programs configured to be executed by one or more processors, and the one or more programs are The system receives first biological information from the first biological sensor of the plurality of biological sensors. Upon receiving the first biometric information, and in accordance with the determination that the first biometric information meets the first criterion, a warning including a first affordance for detecting additional biometric information is displayed on the display. The user activation of the first affordance is received via one or more input devices. After receiving the user activation of the first affordance, the system receives second biometric information associated with the first biometric information from a second biometric sensor of the plurality of biometric sensors that is different from the first biometric sensor. An electronic device that includes instructions.
107. An electronic device operably connected to multiple biosensors, The display and One or more input devices, Means for receiving first biological information from the first biological sensor of the plurality of biological sensors, In response to receiving the first biometric information and in accordance with the determination that the first biometric information meets a first criterion, means for displaying a warning on the display including a first affordance for detecting additional biometric information, Means for receiving user activation of the first affordance via one or more input devices, After receiving the user activation of the first affordance, means for receiving second biometric information associated with the first biometric information from a second biometric sensor of the plurality of biometric sensors different from the first biometric sensor, An electronic device equipped with the following features.