Research User Interface
By displaying the task view associated with multiple investigations and research on electronic devices, it provides a faster and more effective user interface and interactive method, solving the complex and time -consuming problems in existing technologies, and realized more efficiently. User interaction and equipment energy management.
Patent Information
- Application Number
- CN202210346306.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-09-09
- Filing Date
- 2020-07-15
- Publication Date
- 2025-01-28
- Estimated Expiration
- 2040-07-15
AI Technical Summary
When the prior art interacts with surveys and research in electronic devices, the user interface is complex and time-consuming, resulting in a waste of time and increased energy consumption of the device, especially in battery-powered devices.
Provide a faster and more effective user interface and interactive method. By displaying a task view associated with multiple investigations and research on electronic devices, users can allow users to interact through simple input operations, reduce cognitive burdens, and increase people. The efficiency of the machine interface.
This method reduces the cognitive burden and equipment energy consumption of user interaction, and improves the efficiency and safety of interaction, especially the battery life in the battery -driven device.
Smart Images

Figure CN114706505B_ABST
Abstract
Description
[0001] This application is a divisional application of the invention patent application with application number 202080060533.2, application date July 15, 2020, and invention name “Investigation and Research User Interface”.
[0002] CROSS-REFERENCE TO RELATED APPLICATIONS
[0003] This patent application claims priority to U.S. Provisional Patent Application No. 62 / 897,693, filed on September 9, 2019, entitled “RESEARCH STUDY USER INTERFACES,” which is incorporated herein by reference in its entirety for all purposes. Technical Field
[0004] The present disclosure relates generally to computer user interfaces, and more particularly to techniques and user interfaces for interacting with research studies. Background Art
[0005] Users of electronic devices can provide information to surveys that collect data for use in explorations involving multiple users of multiple electronic devices. Such information can be provided to such studies using a user interface that includes one or more graphical elements suitable for use with the survey. Summary of the invention
[0006] However, some techniques for using electronic devices to interact with research studies are often cumbersome and inefficient. For example, some prior art techniques use complex and time-consuming user interfaces that may include multiple keystrokes or keystrokes. Prior art techniques require more time than necessary, which results in wasted user time and device energy. This latter consideration is particularly important in battery-powered devices.
[0007] Thus, the present technology provides electronic devices with faster, more efficient methods and interfaces for interacting with surveys. Such methods and interfaces optionally supplement or replace other methods for interacting with surveys. Such methods and interfaces reduce the cognitive burden imposed on users and produce more efficient human-computer interfaces. For battery-powered computing devices, such methods and interfaces save power and increase the time interval between battery charges. For surveys involving requests for personal and / or sensitive data, such methods and interfaces can improve data processing security and provide users with an effective and efficient method to manage data access permissions.
[0008] According to some embodiments, a method is described. In some embodiments, the method is performed at an electronic device having a display device and one or more input devices. In some embodiments, the method includes: displaying a first user interface via a display device, the first user interface including a task view enable representation associated with a plurality of different studies, the plurality of different studies including a first study in which a user of the electronic device participates and a second study in which a user of the electronic device participates; while displaying the first user interface, detecting a first input via one or more input devices; in response to detecting the first input and based on determining that the first input corresponds to a selection of the task view enable representation, displaying a task view via a display device, the task view including simultaneously displaying: a first task corresponding to the first study; and a second task corresponding to the second study.
[0009] According to some embodiments, a non-transitory computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of an electronic device having a display device and one or more input devices. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a first user interface via a display device, the first user interface including a task view enable representation associated with a plurality of different studies, the plurality of different studies including a first study in which a user of the electronic device participates and a second study in which the user of the electronic device participates; while displaying the first user interface, detecting a first input via one or more input devices; in response to detecting the first input and based on determining that the first input corresponds to a selection of the task view enable representation, displaying a task view via the display device, the task view including simultaneously displaying: a first task corresponding to the first study; and a second task corresponding to the second study.
[0010] According to some embodiments, a transient computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of an electronic device having a display device and one or more input devices. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a first user interface via a display device, the first user interface including a task view enable representation associated with a plurality of different studies, the plurality of different studies including a first study in which a user of the electronic device participates and a second study in which the user of the electronic device participates; while displaying the first user interface, detecting a first input via one or more input devices; in response to detecting the first input and based on determining that the first input corresponds to a selection of the task view enable representation, displaying a task view via the display device, the task view including simultaneously displaying: a first task corresponding to the first study; and a second task corresponding to the second study.
[0011] According to some embodiments, an electronic device is described. In some embodiments, the electronic device includes: a display device; one or more input devices; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a first user interface via a display device, the first user interface including a task view enabling representation associated with a plurality of different studies, the plurality of different studies including a first study in which a user of the electronic device participates and a second study in which a user of the electronic device participates; when displaying the first user interface, detecting a first input via one or more input devices; in response to detecting the first input and according to determining that the first input corresponds to a selection of a task view enabling representation, displaying a task view via a display device, the task view including simultaneously displaying: a first task corresponding to the first study; and a second task corresponding to the second study.
[0012] According to some embodiments, an electronic device is described. In some embodiments, the electronic device includes: a display device; one or more input devices; a device for displaying a first user interface via the display device, the first user interface including a task view affordance associated with a plurality of different studies, the plurality of different studies including a first study in which a user of the electronic device participates and a second study in which the user of the electronic device participates; a device for detecting a first input while displaying the first user interface and via one or more input devices; and a device for displaying a task view via the display device in response to detecting the first input and based on determining that the first input corresponds to a selection of the task view affordance, the task view including simultaneously displaying: a first task corresponding to the first study; and a second task corresponding to the second study.
[0013] According to some embodiments, a method is described. In some embodiments, the method is performed at an electronic device having a display device and one or more input devices. In some embodiments, the method includes: displaying a survey study user interface associated with a first survey study via a display device; receiving a set of one or more inputs via one or more input devices while displaying the survey study, the set of one or more inputs including interactions with the survey study user interface associated with the first survey study; and in response to receiving the set of one or more inputs: displaying an indication of a question that prevents participation in the first survey study based on determining that a set of participation question criteria are met; and abandoning displaying an indication of a difficulty that prevents participation in the first survey study based on determining that the set of participation question criteria are not met.
[0014] According to some embodiments, a non-transitory computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of an electronic device having a display device and one or more input devices. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a survey study user interface associated with a first survey study via a display device; receiving a set of one or more inputs via one or more input devices while displaying the survey study, the set of one or more inputs including interactions with the survey study user interface associated with the first survey study; and in response to receiving the set of one or more inputs: displaying an indication of a question that prevents participation in the first survey study based on determining that a set of participation question criteria are met; and abandoning displaying an indication of a difficulty that prevents participation in the first survey study based on determining that the set of participation question criteria are not met.
[0015] According to some embodiments, a transient computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of an electronic device having a display device and one or more input devices. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a survey study user interface associated with a first survey study via a display device; receiving a set of one or more inputs via one or more input devices while displaying the survey study, the set of one or more inputs including interactions with the survey study user interface associated with the first survey study; and in response to receiving the set of one or more inputs: displaying an indication of a question that prevents participation in the first survey study based on determining that a set of participation question criteria are met; and abandoning displaying an indication of a difficulty that prevents participation in the first survey study based on determining that the set of participation question criteria are not met.
[0016] According to some embodiments, an electronic device is described. In some embodiments, the electronic device includes: a display device; one or more input devices; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a survey research user interface associated with a first survey research via a display device; receiving a set of one or more inputs via one or more input devices when displaying the survey research, the set of one or more inputs including interactions with the survey research user interface associated with the first survey research; and in response to receiving the set of one or more inputs: displaying an indication of a question that blocks participation in the first survey research based on determining that a set of participation question criteria are met; and abandoning the indication of the difficulty of displaying the difficulty of blocking participation in the first survey research based on determining that the set of participation question criteria are not met.
[0017] According to some embodiments, an electronic device is described. In some embodiments, the electronic device includes: a display device; one or more input devices; means for displaying a survey study user interface associated with a first survey study via the display device; means for receiving a set of one or more inputs via the one or more input devices while displaying the survey study, the set of one or more inputs including interactions with the survey study user interface associated with the first survey study; and means for performing the following operations in response to receiving the set of one or more inputs: displaying an indication of a problem that prevents participation in the first survey study based on determining that a set of participation question criteria are met; and forgoing displaying an indication of a difficulty that prevents participation in the first survey study based on determining that the set of participation question criteria are not met.
[0018] According to some embodiments, a method is described. According to some embodiments, the method is performed at an electronic device having a display device, one or more input devices, and one or more microphones. In some embodiments, the method includes: displaying a hearing test user interface associated with a hearing test via a display device; while displaying the hearing test user interface, receiving a set of one or more inputs corresponding to a request to initiate a hearing test via one or more input devices; in response to receiving the set of one or more inputs, initiating a hearing test; during the hearing test, detecting an ambient noise level including an audio characteristic via one or more microphones; in response to detecting the ambient noise level: pausing the hearing test and displaying a re-enablement indication via a display device based on determining that the audio characteristic of the ambient noise level exceeds a first threshold, the re-enablement indication restarts the hearing test when selected; and continuing the hearing test and abandoning displaying the re-enablement indication based on determining that the audio characteristic of the ambient noise level does not exceed the first threshold.
[0019] According to some embodiments, a non-transitory computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of an electronic device having a display device, one or more input devices and one or more microphones. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a hearing test user interface associated with a hearing test via a display device; receiving a set of one or more inputs corresponding to a request to initiate a hearing test via one or more input devices while displaying the hearing test user interface; in response to receiving the set of one or more inputs, initiating a hearing test; during the hearing test, detecting an ambient noise level including an audio characteristic via one or more microphones; in response to detecting the ambient noise level: pausing the hearing test and displaying a re-indication indication via a display device based on determining that the audio characteristic of the ambient noise level exceeds a first threshold, the re-indication indication restarts the hearing test when selected; and continuing the hearing test and abandoning the display of the re-indication indication based on determining that the audio characteristic of the ambient noise level does not exceed the first threshold.
[0020] According to some embodiments, a transient computer-readable storage medium is described, which stores one or more programs configured to be executed by one or more processors of an electronic device having a display device, one or more input devices, and one or more microphones. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a hearing test user interface associated with a hearing test via a display device; receiving a set of one or more inputs corresponding to a request to initiate a hearing test via one or more input devices while displaying the hearing test user interface; in response to receiving the set of one or more inputs, initiating a hearing test; during the hearing test, detecting an ambient noise level including an audio characteristic via one or more microphones; in response to detecting the ambient noise level: pausing the hearing test and displaying a re-indication indication via a display device based on determining that the audio characteristic of the ambient noise level exceeds a first threshold, the re-indication indication restarts the hearing test when selected; and continuing the hearing test and abandoning the display of the re-indication indication based on determining that the audio characteristic of the ambient noise level does not exceed the first threshold.
[0021] According to some embodiments, an electronic device is described. In some embodiments, the electronic device includes: a display device; one or more input devices; one or more microphones; one or more processors; and a memory storing one or more programs configured to be executed by the one or more processors. In some embodiments, the one or more programs include instructions for performing the following operations: displaying a hearing test user interface associated with a hearing test via a display device; receiving a set of one or more inputs corresponding to a request to initiate a hearing test via one or more input devices when the hearing test user interface is displayed; in response to receiving the set of one or more inputs, initiating a hearing test; during the hearing test, detecting an ambient noise level including an audio characteristic via one or more microphones; in response to detecting the ambient noise level: pausing the hearing test and displaying a re-indication indication via a display device based on determining that the audio characteristic of the ambient noise level exceeds a first threshold, the re-indication indication restarts the hearing test when selected; and continuing the hearing test and abandoning the display of the re-indication indication based on determining that the audio characteristic of the ambient noise level does not exceed the first threshold.
[0022] According to some embodiments, an electronic device is described. In some embodiments, the electronic device includes: a display device, one or more input devices, one or more microphones; a device for displaying a hearing test user interface associated with a hearing test via the display device; a device for receiving a set of one or more inputs corresponding to a request to initiate a hearing test via one or more input devices when displaying the hearing test user interface; a device for initiating a hearing test in response to receiving the set of one or more inputs; a device for detecting an ambient noise level including an audio characteristic via one or more microphones during the hearing test; a device for performing the following operations in response to detecting the ambient noise level: pausing the hearing test and displaying a re-enablement indication via the display device based on determining that the audio characteristic of the ambient noise level exceeds a first threshold, the re-enablement indication restarts the hearing test when selected; and continuing the hearing test and abandoning the display of the re-enablement indication based on determining that the audio characteristic of the ambient noise level does not exceed the first threshold.
[0023] Executable instructions for performing these functions are optionally included in a non-transitory computer-readable storage medium or other computer program product configured for execution by one or more processors. Executable instructions for performing these functions are optionally included in a transient computer-readable storage medium or other computer program product configured for execution by one or more processors.
[0024] Thus, a faster and more efficient method and interface is provided for devices to interact with research studies, thereby improving the effectiveness, efficiency, and user satisfaction of such devices.Such methods and interfaces may supplement or replace other methods for interacting with research studies. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] For a better understanding of the various described embodiments, reference should be made to the following detailed description taken in conjunction with the following drawings, wherein like reference numerals designate corresponding parts throughout the several views.
[0026] Figure 1A is a block diagram showing a portable multifunction device with a touch-sensitive display according to some embodiments.
[0027] Figure 1B is a block diagram illustrating example components for event processing according to some embodiments.
[0028] Figure 2 A portable multifunction device with a touch screen according to some embodiments is shown.
[0029] Figure 3 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments.
[0030] Figure 4A An exemplary user interface for a menu of applications on a portable multifunction device is shown according to some embodiments.
[0031] Figure 4B An exemplary user interface is shown for a multifunction device having a touch-sensitive surface that is separate from the display according to some embodiments.
[0032] Figure 5A A personal electronic device according to some embodiments is shown.
[0033] Figure 5B is a block diagram illustrating a personal electronic device according to some embodiments.
[0034] FIG. 6A to FIG. 6N An exemplary user interface for interacting with and / or managing a survey is shown.
[0035] Figure 7 is a flow chart illustrating a method for interacting with and / or managing a survey study.
[0036] FIG. 8A to FIG. 8U An exemplary user interface for participating in a research study is shown.
[0037] Fig. 9 is a flow chart illustrating a method for participating in a survey study.
[0038] FIG. 10A to FIG. 10X An exemplary user interface for interacting with a hearing test is shown.
[0039] Fig.11 is a flow chart illustrating a method for interacting with a hearing test. DETAILED DESCRIPTION
[0040] The following description sets forth exemplary methods, parameters, etc. However, it should be appreciated that such description is not intended to limit the scope of the present disclosure, but is provided as a description of exemplary embodiments.
[0041] Electronic devices need to provide efficient methods and interfaces for interacting with surveys. Such techniques can reduce the cognitive burden on users when interacting with surveys, thereby increasing productivity. In addition, such techniques can reduce processor power and battery power that would otherwise be wasted on redundant user input.
[0042] under Figure 1A to Figure 1B , Figure 2 , Figure 3 , FIG. 4A to FIG. 4B and FIG. 5A to FIG. 5B A description of an exemplary device for performing techniques for interacting with a research study is provided. FIG. 6A to FIG. 6N An exemplary user interface for interacting with a survey study is shown. Figure 7 is a flow chart illustrating a method of interacting with a survey study according to some embodiments. FIG. 6A to FIG. 6N The user interface in is used to illustrate the processes described below, which include Figure 7 process. FIG. 8A to FIG. 8U An exemplary user interface for participating in a research study is shown. Fig. 9 is a flow chart illustrating a method for participating in a research study according to some embodiments. FIG. 8A to FIG. 8U The user interface in is used to illustrate the processes described below, which include Fig. 9 process. FIG. 10A to FIG. 10X An exemplary user interface for interacting with a hearing test is shown. Fig.11 is a flow chart illustrating a method for interacting with a survey study according to some embodiments. FIG. 10A to FIG. 10X The user interface in is used to illustrate the processes described below, which include Fig.11 process.
[0043] Although the following description uses the terms "first", "second", etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another element. For example, a first touch can be named a second touch and similarly a second touch can be named a first touch without departing from the scope of the various described embodiments. Both the first touch and the second touch are touches, but they are not the same touch.
[0044] The terms used in the description of various described embodiments herein are only for the purpose of describing specific embodiments, and are not intended to be limited. As used in the description of various described embodiments and in the appended claims, the singular forms "one" and "the" are intended to also include plural forms, unless the context clearly indicates otherwise. It will also be understood that the term "and / or" used herein refers to and encompasses any and all possible combinations of one or more items in the associated listed items. It will also be understood that the term "includes", "including", "comprises" and / or "comprising" when used in this specification specifies the presence of stated features, integers, steps, operations, elements and / or parts, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, parts and / or their grouping.
[0045] The term "if" is optionally interpreted to mean "when," "upon," or "in response to determining," or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined that ..." or "if [a stated condition or event] is detected" are optionally interpreted to mean "upon determining that ..." or "in response to determining that ..." or "upon detecting [a stated condition or event]," or "in response to detecting [a stated condition or event]," depending on the context.
[0046] Embodiments of electronic devices, user interfaces for such devices, and associated processes for using such devices are described herein. In some embodiments, the device is a portable communication device, such as a mobile phone, that also includes other functions, such as a PDA and / or a music player function. Exemplary embodiments of portable multifunction devices include, but are not limited to, the Apple iPod from Apple Inc. (Cupertino, California). Devices, iPod Equipment, and Device. Optionally use other portable electronic devices, such as laptops or tablet computers with touch-sensitive surfaces (e.g., touch screen displays and / or touch pads). It should also be understood that in some embodiments, the device is not a portable communication device, but a desktop computer with a touch-sensitive surface (e.g., touch screen displays and / or touch pads). In some embodiments, the electronic device is a computer system that communicates with the display generation component (e.g., via wireless communication, via wired communication). The display generation component is configured to provide visual output, such as display via a CRT display, display via an LED display, or display via image projection. In some embodiments, the display generation component is integrated with the computer system. In some embodiments, the display generation component is separated from the computer system. As used herein, "display" content includes transmitting data (e.g., image data or video data) to an integrated or external display generation component via a wired or wireless connection to visually generate content to display content (e.g., video data rendered or decoded by display controller 156).
[0047] In the following discussion, an electronic device including a display and a touch-sensitive surface is described. However, it should be understood that the electronic device optionally includes one or more other physical user interface devices, such as a physical keyboard, mouse and / or joystick.
[0048] The device typically supports a variety of applications, such as one or more of the following: a drawing application, a presentation application, a word processing application, a website creation application, a disk editing application, a spreadsheet application, a gaming application, a telephony application, a video conferencing application, an email application, an instant messaging application, a fitness support application, a photo management application, a digital camera application, a digital video camera application, a web browsing application, a digital music player application, and / or a digital video player application.
[0049] Various applications executed on the device optionally use at least one common physical user interface device, such as a touch-sensitive surface. One or more functions of the touch-sensitive surface and corresponding information displayed on the device are optionally adjusted and / or varied for different applications, and / or adjusted and / or varied within the respective applications. In this way, the common physical architecture of the device (such as a touch-sensitive surface) optionally supports a variety of applications with a user interface that is intuitive and clear to the user.
[0050] Attention is now turned to embodiments of portable devices having touch-sensitive displays. Figure 1Ais a block diagram showing a portable multifunction device 100 with a touch-sensitive display system 112 according to some embodiments. The touch-sensitive display 112 is sometimes referred to as a "touch screen" for convenience, and is sometimes referred to as or referred to as a "touch-sensitive display system." The device 100 includes a memory 102 (which optionally includes one or more computer-readable storage media), a memory controller 122, one or more processing units (CPUs) 120, a peripheral device interface 118, an RF circuit 108, an audio circuit 110, a speaker 111, a microphone 113, an input / output (I / O) subsystem 106, other input control devices 116, and an external port 124. The device 100 optionally includes one or more optical sensors 164. The device 100 optionally includes one or more contact force sensors 165 for detecting the intensity of contact on the device 100 (e.g., a touch-sensitive surface, such as the touch-sensitive display system 112 of the device 100). Device 100 optionally includes one or more tactile output generators 167 for generating tactile output on device 100 (e.g., generating tactile output on a touch-sensitive surface such as touch-sensitive display system 112 of device 100 or touch pad 355 of device 300). These components optionally communicate via one or more communication buses or signal lines 103.
[0051] As used in this specification and claims, the term "intensity" of a contact on a touch-sensitive surface refers to the force or pressure (force per unit area) of a contact (e.g., a finger contact) on the touch-sensitive surface, or to a surrogate (surrogate) of the force or pressure of a contact on the touch-sensitive surface. The intensity of a contact has a range of values that includes at least four different values and more typically includes hundreds of different values (e.g., at least 256). The intensity of a contact is optionally determined (or measured) using various methods and various sensors or combinations of sensors. For example, one or more force sensors below or adjacent to the touch-sensitive surface are optionally used to measure the force at different points on the touch-sensitive surface. In some implementations, force measurements from multiple force sensors are combined (e.g., weighted averaged) to determine an estimated contact force. Similarly, the pressure-sensitive tip of a stylus is optionally used to determine the pressure of the stylus on the touch-sensitive surface. Alternatively, the size of the contact area detected on the touch-sensitive surface and / or its change, the capacitance of the touch-sensitive surface near the contact and / or its change, and / or the resistance of the touch-sensitive surface near the contact and / or its change are optionally used as a substitute for the force or pressure of the contact on the touch-sensitive surface. In some embodiments, the substitute measurement of the contact force or pressure is used directly to determine whether the intensity threshold has been exceeded (e.g., the intensity threshold is described in units corresponding to the substitute measurement). In some embodiments, the substitute measurement of the contact force or pressure is converted into an estimated force or pressure, and the estimated force or pressure is used to determine whether the intensity threshold has been exceeded (e.g., the intensity threshold is a pressure threshold measured in units of pressure). Using the intensity of the contact as an attribute of the user input allows the user to access additional device functions that would otherwise be inaccessible to the user on a smaller device with limited real estate, which is used to display an enable indication (e.g., on a touch-sensitive display) and / or receive user input (e.g., via a touch-sensitive display, a touch-sensitive surface, or a physical control / mechanical control, such as a knob or button).
[0052] As used in this specification and claims, the term "tactile output" refers to a physical displacement of a device relative to a previous position of the device, a physical displacement of a component of the device (e.g., a touch-sensitive surface) relative to another component of the device (e.g., a housing), or a displacement of a component relative to the center of mass of the device, which will be detected by a user using the user's sense of touch. For example, in the case where a device or a component of the device is in contact with a user's touch-sensitive surface (e.g., a finger, palm, or other part of the user's hand), the tactile output generated by the physical displacement will be interpreted by the user as a tactile sensation corresponding to a perceived change in a physical characteristic of the device or component of the device. For example, movement of a touch-sensitive surface (e.g., a touch-sensitive display or trackpad) is optionally interpreted by the user as a "press click" or "release click" to a physical actuation button. In some cases, the user will feel a tactile sensation, such as a "press click" or "release click", even when the physical actuation button associated with the touch-sensitive surface that is physically pressed (e.g., displaced) by the user's movement does not move. As another example, even when there is no change in the smoothness of the touch-sensitive surface, movement of the touch-sensitive surface may optionally be interpreted or sensed by the user as "roughness" of the touch-sensitive surface. Although such a user's interpretation of touch will be limited by the user's individualized sensory perceptions, many sensory perceptions of touch are common to most users. Thus, when a tactile output is described as corresponding to a particular sensory perception of a user (e.g., "press click," "release click," "roughness"), unless otherwise stated, the generated tactile output corresponds to a physical displacement of the device or a component thereof that would generate that sensory perception for a typical (or average) user.
[0053] It should be understood that device 100 is merely one example of a portable multifunction device, and that device 100 optionally has more or fewer components than shown, optionally combines two or more components, or optionally has a different configuration or arrangement of the components. Figure 1A The various components shown in the EMBODIMENTS 2000 are implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.
[0054] Memory 102 optionally includes high-speed random access memory, and optionally also includes non-volatile memory, such as one or more disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. Memory controller 122 optionally controls other components of device 100 to access memory 102.
[0055] The peripheral device interface 118 can be used to couple the input peripheral devices and output peripheral devices of the device to the CPU 120 and the memory 102. The one or more processors 120 run or execute various software programs and / or instruction sets stored in the memory 102 to perform various functions of the device 100 and process data. In some embodiments, the peripheral device interface 118, the CPU 120, and the memory controller 122 are optionally implemented on a single chip such as the chip 104. In some other embodiments, they are optionally implemented on separate chips.
[0056] RF (radio frequency) circuit 108 receives and sends RF signals, also referred to as electromagnetic signals. RF circuit 108 converts electrical signals into / converts electromagnetic signals into electrical signals, and communicates with communication networks and other communication devices via electromagnetic signals. RF circuit 108 optionally includes well-known circuits for performing these functions, including but not limited to antenna systems, RF transceivers, one or more amplifiers, tuners, one or more oscillators, digital signal processors, codec chipsets, user identity modules (SIM) cards, memories, and the like. RF circuit 108 optionally communicates with networks and other devices via wireless communications, such as the Internet (also referred to as the World Wide Web (WWW)), intranets, and / or wireless networks (such as cellular telephone networks, wireless local area networks (LANs), and / or metropolitan area networks (MANs)). RF circuit 108 optionally includes well-known circuits for detecting near field communications (NFC) fields, such as through short-range communications radio components. Wireless communication optionally uses any of a variety of communication standards, protocols and technologies, including, but not limited to, Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Evolution, Data-Only (EV-DO), HSPA, HSPA+, Dual Cell HSPA (DC-HSPDA), Long Term Evolution (LTE), Near Field Communication (NFC), Wideband Code Division Multiple Access (W-CDMA), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity (Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11d), IEEE 802.11e, IEEE 802.11f, IEEE 802.11g, IEEE 802.11g). 802.11n and / or IEEE 802.11ac), Voice over Internet Protocol (VoIP), Wi-MAX, email protocols (e.g., Internet Message Access Protocol (IMAP) and / or Post Office Protocol (POP)), instant messaging (e.g., Extensible Messaging and Presence Protocol (XMPP), Session Initiation Protocol for Instant Messaging and Presence Utilizing Extensions (SIMPLE), Instant Messaging and Presence Service (IMPS)), and / or Short Message Service (SMS), or any other suitable communication protocol including communication protocols that have not been developed as of the filing date of this document.
[0057] The audio circuit 110, speaker 111, and microphone 113 provide an audio interface between a user and the device 100. The audio circuit 110 receives audio data from the peripheral device interface 118, converts the audio data into electrical signals, and transmits the electrical signals to the speaker 111. The speaker 111 converts the electrical signals into sound waves audible to humans. The audio circuit 110 also receives electrical signals converted from sound waves by the microphone 113. The audio circuit 110 converts the electrical signals into audio data and transmits the audio data to the peripheral device interface 118 for processing. The audio data is optionally retrieved from and / or transmitted to the memory 102 and / or the RF circuit 108 by the peripheral device interface 118. In some embodiments, the audio circuit 110 also includes a headset jack (e.g., Figure 2 The headset jack provides an interface between the audio circuit 110 and a removable audio input / output peripheral device, such as an output-only headset or a headset having both output (e.g., a single or dual-ear headset) and input (e.g., a microphone).
[0058] The I / O subsystem 106 couples input / output peripherals on the device 100, such as a touch screen 112 and other input control devices 116, to a peripheral device interface 118. The I / O subsystem 106 optionally includes a display controller 156, an optical sensor controller 158, a depth camera controller 169, an intensity sensor controller 159, a tactile feedback controller 161, and one or more input controllers 160 for other input or control devices. The one or more input controllers 160 receive / send electrical signals from other input control devices 116. The other input control devices 116 optionally include physical buttons (e.g., push buttons, rocker buttons, etc.), dials, slide switches, joysticks, click wheels, etc. In some alternative embodiments, the input controller 160 is optionally coupled to any of the following (or none of the following): a keyboard, an infrared port, a USB port, and a pointing device such as a mouse. One or more buttons (e.g., Figure 2 208) optionally includes an increase / decrease button for volume control of the speaker 111 and / or the microphone 113. The one or more buttons optionally include a push button (e.g., Figure 2206 in). In some embodiments, the electronic device is a computer system that communicates with one or more input devices (e.g., via wireless communication, via wired communication). In some embodiments, the one or more input devices include a touch-sensitive surface (e.g., a touchpad as part of a touch-sensitive display). In some embodiments, the one or more input devices include one or more camera sensors (e.g., one or more optical sensors 164 and / or one or more depth camera sensors 175), such as for tracking a user's gestures (e.g., hand gestures) as input. In some embodiments, the one or more input devices are integrated with the computer system. In some embodiments, the one or more input devices are separate from the computer system.
[0059] A quick press of the push button optionally disengages the lock of the touch screen 112 or optionally begins the process of unlocking the device using gestures on the touch screen, as described in U.S. Patent Application 11 / 322,549, filed on December 23, 2005, entitled "Unlocking a Device by Performing Gestures on an Unlock Image" (i.e., U.S. Patent No. 7,657,849), which is hereby incorporated by reference in its entirety. A long press of the push button (e.g., 206) optionally turns the device 100 on or off. The functions of one or more buttons are optionally user-customizable. The touch screen 112 is used to implement virtual buttons or soft buttons and one or more soft keyboards.
[0060] The touch-sensitive display 112 provides an input interface and an output interface between the device and the user. The display controller 156 receives electrical signals from the touch screen 112 and / or sends electrical signals to the touch screen 112. The touch screen 112 displays visual output to the user. The visual output optionally includes graphics, text, icons, videos, and any combination thereof (collectively referred to as "graphics"). In some embodiments, some or all of the visual output optionally corresponds to user interface objects.
[0061] The touch screen 112 has a touch-sensitive surface, sensor, or sensor group that accepts input from a user based on tactile and / or haptic contact. The touch screen 112 and display controller 156 (together with any associated modules and / or instruction sets in memory 102) detect contact on the touch screen 112 (and any movement or interruption of the contact) and convert the detected contact into interaction with a user interface object (e.g., one or more soft keys, icons, web pages, or images) displayed on the touch screen 112. In an exemplary embodiment, the point of contact between the touch screen 112 and the user corresponds to a finger of the user.
[0062] The touch screen 112 optionally uses LCD (liquid crystal display) technology, LPD (light emitting polymer display) technology, or LED (light emitting diode) technology, although other display technologies are used in other embodiments. The touch screen 112 and display controller 156 optionally use any of a variety of touch sensing technologies now known or later developed, including but not limited to capacitive, resistive, infrared, and surface acoustic wave technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch screen 112 to detect contact and any movement or interruption thereof. In an exemplary embodiment, projected mutual capacitance sensing technology is used, such as in the Apple ® from Apple Inc. (Cupertino, California). and iPod The technology used in.
[0063] The touch-sensitive display in some embodiments of the touch screen 112 is optionally similar to the multi-touch-sensitive trackpad described in the following U.S. Patents: 6,323,846 (Westerman et al.), 6,570,557 (Westerman et al.), and / or 6,677,932 (Westerman et al.), and / or U.S. Patent Publication 2002 / 0015024A1, each of which is hereby incorporated by reference in its entirety. However, the touch screen 112 displays visual output from the device 100, while the touch-sensitive trackpad does not provide visual output.
[0064] In some embodiments, the touch-sensitive display of the touch screen 112 is as described in the following patent applications: (1) U.S. patent application No. 11 / 381,313, entitled “Multipoint Touch Surface Controller,” filed on May 2, 2006; (2) U.S. patent application No. 10 / 840,862, entitled “Multipoint Touchscreen,” filed on May 6, 2004; (3) U.S. patent application No. 10 / 903,964, entitled “Gestures For Touch Sensitive Input Devices,” filed on July 30, 2004; (4) U.S. patent application No. 11 / 048,264, entitled “Gestures For Touch Sensitive Input Devices,” filed on January 31, 2005; (5) U.S. patent application No. 11 / 086,874, entitled “Mode-Based Graphical User Interfaces For Touch Sensitive Input Devices,” filed on January 18, 2005 and (9) U.S. patent application No. 11 / 367,749, filed on March 3, 2006, entitled “Multi-Functional Hand-Held Device.” All of these applications are hereby incorporated by reference in their entirety.
[0065] The touch screen 112 optionally has a video resolution of more than 100 dpi. In some embodiments, the touch screen has a video resolution of about 160 dpi. The user optionally uses any suitable object or attachment such as a stylus, finger, etc. to contact the touch screen 112. In some embodiments, the user interface is designed to work primarily through finger-based contacts and gestures, which may not be as precise as stylus-based input due to the larger contact area of the finger on the touch screen. In some embodiments, the device converts rough finger-based input into precise pointer / cursor positions or commands for performing the actions desired by the user.
[0066] In some embodiments, in addition to the touch screen, the device 100 optionally includes a touchpad for activating or deactivating specific functions. In some embodiments, the touchpad is a touch-sensitive area of the device that, unlike the touch screen, does not display visual output. The touchpad is optionally a touch-sensitive surface that is separate from the touch screen 112 or an extension of the touch-sensitive surface formed by the touch screen.
[0067] The device 100 also includes a power system 162 for powering the various components. The power system 162 optionally includes a power management system, one or more power sources (e.g., batteries, alternating current (AC)), a recharging system, a power fault detection circuit, a power converter or inverter, a power status indicator (e.g., a light emitting diode (LED)), and any other components associated with the generation, management, and distribution of power in a portable device.
[0068] Device 100 optionally also includes one or more optical sensors 164 . Figure 1AAn optical sensor coupled to an optical sensor controller 158 in the I / O subsystem 106 is shown. The optical sensor 164 optionally includes a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The optical sensor 164 receives light projected through one or more lenses from the environment and converts the light into data representing an image. In conjunction with the imaging module 143 (also called a camera module), the optical sensor 164 optionally captures a static image or video. In some embodiments, the optical sensor is located on the rear of the device 100, opposite to the touch screen display 112 on the front of the device, so that the touch screen display can be used as a viewfinder for static images and / or video image acquisition. In some embodiments, the optical sensor is located on the front of the device so that the user's image is optionally obtained for video conferencing while the user views other video conference participants on the touch screen display. In some embodiments, the position of the optical sensor 164 can be changed by the user (e.g., by rotating the lens and sensor in the device housing) so that a single optical sensor 164 is used with the touch screen display for both video conferencing and static image and / or video image acquisition.
[0069] Device 100 optionally also includes one or more depth camera sensors 175 . Figure 1A A depth camera sensor coupled to a depth camera controller 169 in the I / O subsystem 106 is shown. The depth camera sensor 175 receives data from the environment to create a three-dimensional model of an object (e.g., a face) within the scene from a viewpoint (e.g., a depth camera sensor). In some embodiments, in conjunction with the imaging module 143 (also referred to as a camera module), the depth camera sensor 175 is optionally used to determine a depth map of different portions of an image captured by the imaging module 143. In some embodiments, the depth camera sensor is located at the front of the device 100, so that an image of the user with depth information is optionally obtained for video conferencing while the user is viewing other video conference participants on the touch screen display, and a selfie with depth map data is captured. In some embodiments, the depth camera sensor 175 is located at the rear of the device, or at both the rear and front of the device 100. In some embodiments, the position of the depth camera sensor 175 can be changed by the user (e.g., by rotating the lens and sensor in the device housing) so that the depth camera sensor 175 is used with the touch screen display for both video conferencing and still image and / or video image acquisition.
[0070] Device 100 optionally also includes one or more contact intensity sensors 165 . Figure 1AA contact force sensor is shown coupled to a force sensor controller 159 in the I / O subsystem 106. Contact force sensor 165 optionally includes one or more piezoresistive strain gauges, capacitive force sensors, electrical force sensors, piezoelectric force sensors, optical force sensors, capacitive touch-sensitive surfaces, or other force sensors (e.g., sensors for measuring the force (or pressure) of contact on a touch-sensitive surface). Contact force sensor 165 receives contact force information (e.g., pressure information or a surrogate for pressure information) from the environment. In some embodiments, at least one contact force sensor is juxtaposed or adjacent to a touch-sensitive surface (e.g., touch-sensitive display system 112). In some embodiments, at least one contact force sensor is located on the back of device 100, opposite to touch screen display 112 located on the front of device 100.
[0071] Device 100 optionally also includes one or more proximity sensors 166 . Figure 1A A proximity sensor 166 is shown coupled to the peripherals interface 118. Alternatively, the proximity sensor 166 is optionally coupled to the input controller 160 in the I / O subsystem 106. The proximity sensor 166 is optionally implemented as described in the following U.S. patent applications: No. 11 / 241,839, entitled "Proximity Detector In Handheld Device"; No. 11 / 240,788, entitled "Proximity Detector In Handheld Device"; No. 11 / 620,702, entitled "Using Ambient Light Sensor To Augment Proximity Sensor Output"; No. 11 / 586,862, entitled "Automated Response To And Sensing Of User Activity In Portable Devices"; and No. 11 / 638,251, entitled "Methods And Systems For Automatic Configuration Of Peripherals", which are hereby incorporated by reference in their entirety. In some embodiments, when the multifunction device is placed near the user's ear (e.g., when the user is on a phone call), the proximity sensor turns off and disables the touch screen 112.
[0072] Device 100 optionally also includes one or more tactile output generators 167 . Figure 1AA tactile output generator is shown coupled to a tactile feedback controller 161 in the I / O subsystem 106. The tactile output generator 167 optionally includes one or more electroacoustic devices such as a speaker or other audio component; and / or an electromechanical device for converting energy into linear motion such as a motor, solenoid, electroactive polymer, piezoelectric actuator, electrostatic actuator, or other tactile output generating component (e.g., a component for converting an electrical signal into a tactile output on the device). The contact force sensor 165 receives tactile feedback generation instructions from the tactile feedback module 133 and generates a tactile output on the device 100 that can be felt by a user of the device 100. In some embodiments, at least one tactile output generator is arranged in parallel or adjacent to a touch-sensitive surface (e.g., a touch-sensitive display system 112) and optionally generates a tactile output by moving the touch-sensitive surface vertically (e.g., inward / outward of the surface of the device 100) or laterally (e.g., backward and forward in the same plane as the surface of the device 100). In some embodiments, at least one tactile output generator sensor is located on the back of the device 100, opposite the touch screen display 112 located on the front of the device 100.
[0073] Device 100 optionally also includes one or more accelerometers 168 . Figure 1A An accelerometer 168 coupled to the peripheral device interface 118 is shown. Alternatively, the accelerometer 168 is optionally coupled to the input controller 160 in the I / O subsystem 106. The accelerometer 168 is optionally implemented as described in the following U.S. patent publications: U.S. Patent Publication No. 20050190059, entitled "Acceleration-based Theft Detection System for Portable Electronic Devices" and U.S. Patent Publication No. 20060017692, entitled "Methods And Apparatuses For Operating A Portable Device Based On An Accelerometer", both of which are incorporated herein by reference in their entirety. In some embodiments, information is displayed in a portrait view or a landscape view on a touch screen display based on analysis of data received from one or more accelerometers. The device 100 optionally includes a magnetometer and a GPS (or GLONASS or other global navigation system) receiver in addition to the accelerometer 168 for obtaining information about the position and orientation (e.g., portrait or landscape) of the device 100.
[0074] In some embodiments, the software components stored in memory 102 include an operating system 126, a communication module (or instruction set) 128, a contact / motion module (or instruction set) 130, a graphics module (or instruction set) 132, a text input module (or instruction set) 134, a global positioning system (GPS) module (or instruction set) 135, and an application (or instruction set) 136. In addition, in some embodiments, memory 102 ( Figure 1A ) or 370( Figure 3 ) storage device / global internal state 157, such as Figure 1A and Figure 3 . The device / global internal state 157 includes one or more of the following: an active application state, which indicates which applications (if any) are currently active; a display state, which indicates what applications, views, or other information occupy various areas of the touch screen display 112; a sensor state, including information obtained from the device's various sensors and input control devices 116; and position information about the device's position and / or posture.
[0075] The operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS, WINDOWS, or an embedded operating system such as VxWorks) includes various software components and / or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.), and facilitating communication between various hardware components and software components.
[0076] The communication module 128 facilitates communication with other devices through one or more external ports 124, and also includes various software components for processing data received by the RF circuit 108 and / or the external port 124. The external port 124 (e.g., Universal Serial Bus (USB), FireWire, etc.) is suitable for coupling directly to other devices, or indirectly through a network (e.g., the Internet, wireless LAN, etc.). In some embodiments, the external port is connected to (trademark of Apple Inc.) devices.
[0077] The contact / motion module 130 optionally detects contact with the touch screen 112 (in conjunction with the display controller 156) and other touch-sensitive devices (e.g., a touchpad or physical click wheel). The contact / motion module 130 includes various software components for performing various operations related to contact detection, such as determining whether contact has occurred (e.g., detecting a finger press event), determining the contact strength (e.g., the force or pressure of the contact, or a substitute for the force or pressure of the contact), determining whether there is movement of the contact and tracking the movement on the touch-sensitive surface (e.g., detecting one or more finger drag events), and determining whether the contact has stopped (e.g., detecting a finger lift event or contact disconnection). The contact / motion module 130 receives contact data from the touch-sensitive surface. Determining the movement of a contact point optionally includes determining a rate (magnitude), velocity (magnitude and direction), and / or acceleration (change in magnitude and / or direction) of the contact point, the movement of which is represented by a series of contact data. These operations are optionally applied to a single point of contact (e.g., a single finger contact) or multiple points of simultaneous contact (e.g., "multi-touch" / multiple finger contacts). In some embodiments, the contact / motion module 130 and display controller 156 detect contact on a touch pad.
[0078] In some embodiments, the contact / motion module 130 uses a set of one or more intensity thresholds to determine whether an operation has been performed by a user (e.g., to determine whether a user has "clicked" an icon). In some embodiments, at least a subset of the intensity thresholds are determined based on software parameters (e.g., the intensity thresholds are not determined by the activation thresholds of specific physical actuators and can be adjusted without changing the physical hardware of the device 100). For example, without changing the touchpad or touchscreen display hardware, the mouse "click" threshold of a touchpad or touchscreen can be set to any one of a large range of predefined thresholds. In addition, in some specific implementations, a software setting is provided to the user of the device for adjusting one or more intensity thresholds in a set of intensity thresholds (e.g., by adjusting individual intensity thresholds and / or by utilizing a system-level click on an "intensity" parameter to adjust multiple intensity thresholds at once).
[0079] The contact / motion module 130 optionally detects gesture input by the user. Different gestures on the touch-sensitive surface have different contact patterns (e.g., different motions, timings, and / or intensities of the detected contacts). Therefore, gestures are optionally detected by detecting specific contact patterns. For example, detecting a finger tap gesture includes detecting a finger press event, and then detecting a finger lift (lift-off) event at the same location (or substantially the same location) as the finger press event (e.g., at the location of an icon). As another example, detecting a finger swipe gesture on the touch-sensitive surface includes detecting a finger press event, then detecting one or more finger drag events, and then detecting a finger lift (lift-off) event.
[0080] The graphics module 132 includes various known software components for rendering and displaying graphics on the touch screen 112 or other display, including components for changing the visual impact (e.g., brightness, transparency, saturation, contrast, or other visual attributes) of the displayed graphics. As used herein, the term "graphics" includes any object that can be displayed to a user, including, but not limited to, text, web pages, icons (such as user interface objects including soft keys), digital images, videos, animations, etc.
[0081] In some embodiments, the graphics module 132 stores data representing graphics to be used. Each graphic is optionally assigned a corresponding code. The graphics module 132 receives one or more codes for specifying the graphics to be displayed from an application program, etc., and also receives coordinate data and other graphic attribute data together if necessary, and then generates screen image data to be output to the display controller 156.
[0082] Haptic feedback module 133 includes various software components for generating instructions used by tactile output generator 167 to produce tactile output at one or more locations on device 100 in response to user interaction with device 100 .
[0083] Text input module 134, which is optionally a component of graphics module 132, provides a soft keyboard for entering text in various applications (e.g., contacts 137, email 140, IM 141, browser 147, and any other application requiring text input).
[0084] The GPS module 135 determines the location of the device and provides this information for use in various applications (e.g., to the phone 138 for use in location-based dialing; to the camera 143 as picture / video metadata; and to applications that provide location-based services, such as the Weather widget, the Local Pages widget, and the Maps / Navigation widget).
[0085] The application 136 optionally includes the following modules (or instruction sets) or a subset or superset thereof:
[0086] Contacts module 137 (sometimes called address book or contact list);
[0087] Telephone module 138;
[0088] Video conferencing module 139;
[0089] Email client module 140;
[0090] Instant messaging (IM) module 141;
[0091] Fitness support module 142;
[0092] A camera module 143 for still images and / or video images;
[0093] Image management module 144;
[0094] Video player module;
[0095] Music player module;
[0096] Browser module 147;
[0097] Calendar module 148;
[0098] A widget module 149, which optionally includes one or more of the following: a weather widget 149-1, a stock widget 149-2, a calculator widget 149-3, an alarm widget 149-4, a dictionary widget 149-5, and other widgets acquired by the user, and a user-created widget 149-6;
[0099] A widget creator module 150 for forming a user-created widget 149-6;
[0100] Search module 151;
[0101] Video and music player module 152, which merges the video player module and the music player module;
[0102] Notepad module 153;
[0103] Map module 154; and / or
[0104] Online video module 155.
[0105] Examples of other applications 136 optionally stored in memory 102 include other word processing applications, other image editing applications, drawing applications, rendering applications, JAVA-enabled applications, encryption, digital rights management, voice recognition, and voice replication.
[0106] In conjunction with the touch screen 112, display controller 156, touch / motion module 130, graphics module 132, and text input module 134, the contact module 137 is optionally used to manage an address book or contact list (e.g., stored in the application internal state 192 of the contact module 137 in memory 102 or memory 370), including: adding one or more names to the address book; deleting names from the address book; associating phone numbers, email addresses, physical addresses, or other information with names; associating images with names; categorizing and classifying names; providing phone numbers or email addresses to initiate and / or facilitate communications via telephone 138, video conferencing module 139, email 140, or IM 141; and the like.
[0107] In conjunction with RF circuitry 108, audio circuitry 110, speaker 111, microphone 113, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, phone module 138 is optionally used to enter a sequence of characters corresponding to a phone number, access one or more phone numbers in contact module 137, modify an entered phone number, dial a corresponding phone number, conduct a conversation, and disconnect or hang up when the conversation is complete. As described above, wireless communication optionally uses any of a variety of communication standards, protocols, and technologies.
[0108] In combination with the RF circuit 108, the audio circuit 110, the speaker 111, the microphone 113, the touch screen 112, the display controller 156, the optical sensor 164, the optical sensor controller 158, the contact / motion module 130, the graphics module 132, the text input module 134, the contact module 137 and the telephone module 138, the video conferencing module 139 includes executable instructions for initiating, conducting and terminating a video conference between a user and one or more other participants in accordance with user instructions.
[0109] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, email client module 140 includes executable instructions for creating, sending, receiving, and managing emails in response to user instructions. In conjunction with image management module 144, email client module 140 makes it very easy to create and send emails with still images or video images captured by camera module 143.
[0110] In conjunction with RF circuit 108, touch screen 112, display controller 156, contact / motion module 130, graphics module 132, and text input module 134, instant messaging module 141 includes executable instructions for the following operations: inputting a character sequence corresponding to an instant message, modifying previously input characters, transmitting a corresponding instant message (e.g., using a short message service (SMS) or multimedia message service (MMS) protocol for phone-based instant messaging or using XMPP, SIMPLE, or IMPS for Internet-based instant messaging), receiving instant messages, and viewing received instant messages. In some embodiments, the transmitted and / or received instant messages optionally include graphics, photos, audio files, video files, and / or other attachments supported in MMS and / or enhanced messaging services (EMS). As used herein, "instant messaging" refers to both phone-based messages (e.g., messages sent using SMS or MMS) and Internet-based messages (e.g., messages sent using XMPP, SIMPLE, or IMPS).
[0111] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, the GPS module 135, the map module 154 and the music player module, the fitness support module 142 includes executable instructions for creating a fitness (e.g., with time, distance and / or calorie burn goals); communicating with fitness sensors (sports equipment); receiving fitness sensor data; calibrating sensors for monitoring fitness; selecting and playing music for fitness; and displaying, storing and transmitting fitness data.
[0112] In conjunction with the touch screen 112, display controller 156, optical sensor 164, optical sensor controller 158, contact / motion module 130, graphics module 132 and image management module 144, the camera module 143 includes executable instructions for the following operations: capturing still images or videos (including video streams) and storing them in the memory 102, modifying the characteristics of the still images or videos, or deleting the still images or videos from the memory 102.
[0113] In conjunction with touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134, and camera module 143, image management module 144 includes executable instructions for arranging, modifying (e.g., editing), or otherwise manipulating, labeling, deleting, presenting (e.g., in a digital slideshow or album), and storing still images and / or video images.
[0114] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132 and the text input module 134, the browser module 147 includes executable instructions for browsing the Internet in accordance with user instructions, including searching, linking to, receiving and displaying web pages or portions thereof, as well as attachments and other files linked to web pages.
[0115] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the email client module 140 and the browser module 147, the calendar module 148 includes executable instructions for creating, displaying, modifying and storing calendars and data associated with the calendar (e.g., calendar entries, to-do items, etc.) in accordance with user instructions.
[0116] In conjunction with the RF circuit 108, the touch screen 112, the display controller 156, the contact / motion module 130, the graphics module 132, the text input module 134, and the browser module 147, the desktop widget module 149 is a mini-application that is optionally downloaded and used by the user (e.g., the weather desktop widget 149-1, the stock desktop widget 149-2, the calculator desktop widget 149-3, the alarm desktop widget 149-4, and the dictionary desktop widget 149-5) or a mini-application created by the user (e.g., the user-created desktop widget 149-6). In some embodiments, the desktop widget includes an HTML (Hypertext Markup Language) file, a CSS (Cascading Style Sheets) file, and a JavaScript file. In some embodiments, the desktop widget includes an XML (Extensible Markup Language) file and a JavaScript file (e.g., the Yahoo! desktop widget).
[0117] In combination with the RF circuit 108, touch screen 112, display controller 156, touch / motion module 130, graphics module 132, text input module 134 and browser module 147, the desktop widget creator module 150 is optionally used by a user to create a desktop widget (e.g., converting a user-specified portion of a web page into a desktop widget).
[0118] In combination with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the search module 151 includes executable instructions for searching the memory 102 for text, music, sound, images, videos and / or other files that match one or more search criteria (e.g., one or more user-specified search terms) in accordance with user instructions.
[0119] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuitry 110, speaker 111, RF circuitry 108, and browser module 147, video and music player module 152 includes executable instructions that allow a user to download and play back recorded music and other sound files stored in one or more file formats, such as MP3 or AAC files, and executable instructions for displaying, presenting, or otherwise playing back video (e.g., on touch screen 112 or on an external display connected via external port 124). In some embodiments, device 100 optionally includes the functionality of an MP3 player, such as an iPod (trademark of Apple Inc.).
[0120] In conjunction with the touch screen 112, display controller 156, contact / motion module 130, graphics module 132 and text input module 134, the notepad module 153 includes executable instructions for creating and managing notes, to-do lists, etc. according to user instructions.
[0121] In combination with the RF circuit 108, the touch screen 112, the display controller 156, the touch / motion module 130, the graphics module 132, the text input module 134, the GPS module 135 and the browser module 147, the map module 154 is optionally used to receive, display, modify and store maps and data associated with the maps (e.g., driving directions, data relating to stores and other points of interest at or near a particular location, and other location-based data) in accordance with user instructions.
[0122] In conjunction with touch screen 112, display controller 156, contact / motion module 130, graphics module 132, audio circuit 110, speaker 111, RF circuit 108, text input module 134, email client module 140, and browser module 147, online video module 155 includes instructions for performing the following operations: allowing a user to access, browse, receive (e.g., by streaming and / or downloading), playback (e.g., on the touch screen or on an external display connected via external port 124), send an email with a link to a specific online video, and otherwise manage online videos in one or more file formats such as H.264. In some embodiments, instant messaging module 141 is used instead of email client module 140 to send a link to a specific online video. Additional descriptions of online video applications can be found in U.S. Provisional Patent Application No. 60 / 936,562, filed on June 20, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” and U.S. Patent Application No. 11 / 968,067, filed on December 31, 2007, entitled “Portable Multifunction Device, Method, and Graphical User Interface for Playing Online Videos,” the contents of which are hereby incorporated by reference in their entirety.
[0123] Each of the modules and applications described above corresponds to an executable instruction set for performing one or more of the functions described above and the methods described in this patent application (e.g., the computer-implemented methods and other information processing methods described herein). These modules (e.g., instruction sets) do not have to be implemented as independent software programs, processes, or modules, so various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. For example, a video player module is optionally combined with a music player module into a single module (e.g., Figure 1A In some embodiments, the memory 102 optionally stores a subset of the above modules and data structures. In addition, the memory 102 optionally stores additional modules and data structures not described above.
[0124] In some embodiments, the device 100 is a device on which operation of a predefined set of functions is performed exclusively through a touch screen and / or a touch pad. By using a touch screen and / or a touch pad as the primary input control device for operating the device 100, the number of physical input control devices (e.g., push buttons, dials, etc.) on the device 100 is optionally reduced.
[0125] A predefined set of functions that are performed exclusively through the touch screen and / or trackpad optionally includes navigation between user interfaces. In some embodiments, the trackpad, when touched by the user, navigates the device 100 to a main menu, a home menu, or a root menu from any user interface displayed on the device 100. In such embodiments, a "menu button" is implemented using a trackpad. In some other embodiments, the menu button is a physical push button or other physical input control device, rather than a trackpad.
[0126] Figure 1B 1 is a block diagram illustrating exemplary components for event processing according to some embodiments. In some embodiments, memory 102 ( Figure 1A ) or memory 370( Figure 3 ) includes an event classifier 170 (e.g., in the operating system 126) and a corresponding application 136-1 (e.g., any one of the aforementioned applications 137 to 151, 155, 380 to 390).
[0127] Event classifier 170 receives event information and determines the application 136-1 and the application view 191 of application 136-1 to which the event information is to be delivered. Event classifier 170 includes event monitor 171 and event distributor module 174. In some embodiments, application 136-1 includes application internal state 192, which indicates one or more current application views displayed on touch-sensitive display 112 when the application is active or executing. In some embodiments, device / global internal state 157 is used by event classifier 170 to determine which application(s) is currently active, and application internal state 192 is used by event classifier 170 to determine the application view 191 to which the event information is to be delivered.
[0128] In some embodiments, the application internal state 192 includes additional information, such as one or more of the following: resumption information to be used when the application 136-1 resumes execution, user interface state information indicating that information is being displayed or is ready to be displayed by the application 136-1, a state queue for enabling a user to return to a previous state or view of the application 136-1, and a repeat / undo queue of previous actions taken by the user.
[0129] Event monitor 171 receives event information from peripherals interface 118. Event information includes information about sub-events (e.g., user touches on touch-sensitive display 112 as part of a multi-touch gesture). Peripherals interface 118 transmits information it receives from I / O subsystem 106 or sensors such as proximity sensor 166, one or more accelerometers 168, and / or microphone 113 (through audio circuit 110). The information that peripherals interface 118 receives from I / O subsystem 106 includes information from touch-sensitive display 112 or a touch-sensitive surface.
[0130] In some embodiments, event monitor 171 sends requests to peripheral device interface 118 at predetermined intervals. In response, peripheral device interface 118 transmits event information. In other embodiments, peripheral device interface 118 transmits event information only when there is a significant event (e.g., receiving an input above a predetermined noise threshold and / or receiving an input for more than a predetermined duration).
[0131] In some embodiments, the event classifier 170 also includes a hit view determination module 172 and / or an active event identifier determination module 173.
[0132] When the touch-sensitive display 112 displays more than one view, the hit view determination module 172 provides software procedures for determining where within one or more views a sub-event has occurred. A view consists of controls and other elements that a user can see on the display.
[0133] Another aspect of the user interface associated with an application is a set of views, sometimes also referred to herein as application views or user interface windows, in which information is displayed and touch-based gestures occur. The application views (of the respective application) in which a touch is detected optionally correspond to a programmatic level within the programmatic or view hierarchy of the application. For example, the lowest level view in which a touch is detected is optionally referred to as a hit view, and the set of events recognized as correct input is optionally determined at least in part based on the hit view of the initial touch that started the touch-based gesture.
[0134] Hit view determination module 172 receives information related to sub-events of touch-based gestures. When an application has multiple views organized in a hierarchy, hit view determination module 172 identifies the hit view as the lowest view in the hierarchy where the sub-events should be processed. In most cases, the hit view is the lowest level view in which the initiating sub-event (e.g., the first sub-event in a sequence of sub-events that form an event or potential event) occurs. Once a hit view is identified by hit view determination module 172, the hit view typically receives all sub-events related to the same touch or input source for which it was identified as the hit view.
[0135] Active event recognizer determination module 173 determines which view or views within the view hierarchy should receive a particular sequence of sub-events. In some embodiments, active event recognizer determination module 173 determines that only the hit view should receive a particular sequence of sub-events. In other embodiments, active event recognizer determination module 173 determines that all views that include the physical location of the sub-event are actively participating views, and therefore determines that all actively participating views should receive a particular sequence of sub-events. In other embodiments, even if a touch sub-event is completely confined to an area associated with one particular view, higher views in the hierarchy will still remain as actively participating views.
[0136] Event distributor module 174 distributes event information to event recognizers (e.g., event recognizers 180). In embodiments including active event recognizer determination module 173, event distributor module 174 delivers the event information to the event recognizers determined by active event recognizer determination module 173. In some embodiments, event distributor module 174 stores the event information in an event queue, which is retrieved by corresponding event receivers 182.
[0137] In some embodiments, operating system 126 includes event classifier 170. Alternatively, application 136-1 includes event classifier 170. In yet another embodiment, event classifier 170 is a standalone module or is part of another module stored in memory 102, such as contact / motion module 130.
[0138] In some embodiments, application 136-1 includes multiple event handlers 190 and one or more application views 191, each of which includes instructions for handling touch events occurring within a corresponding view of the user interface of the application. Each application view 191 of application 136-1 includes one or more event recognizers 180. Typically, the corresponding application view 191 includes multiple event recognizers 180. In other embodiments, one or more event recognizers in event recognizers 180 are part of an independent module, which is a higher-level object such as a user interface toolkit or application 136-1 from which methods and other properties are inherited. In some embodiments, the corresponding event handler 190 includes one or more of the following: data updater 176, object updater 177, GUI updater 178, and / or event data 179 received from event classifier 170. Event handler 190 optionally utilizes or calls data updater 176, object updater 177, or GUI updater 178 to update application internal state 192. Alternatively, one or more of the application views in application view 191 include one or more corresponding event handlers 190. In addition, in some embodiments, one or more of data updater 176, object updater 177, and GUI updater 178 are included in the corresponding application view 191.
[0139] The corresponding event identifier 180 receives event information (e.g., event data 179) from the event classifier 170 and identifies the event based on the event information. The event identifier 180 includes an event receiver 182 and an event comparator 184. In some embodiments, the event identifier 180 also includes metadata 183 and at least a subset of event delivery instructions 188 (which optionally include sub-event delivery instructions).
[0140] Event receiver 182 receives event information from event classifier 170. Event information includes information about sub-events such as touch or touch movement. Depending on the sub-event, the event information also includes additional information, such as the location of the sub-event. When the sub-event involves the movement of the touch, the event information optionally also includes the speed and direction of the sub-event. In some embodiments, the event includes the device rotating from one orientation to another orientation (for example, from a longitudinal orientation to a transverse orientation, or vice versa), and the event information includes corresponding information about the current orientation of the device (also referred to as the device posture).
[0141] Event comparator 184 compares event information with predefined event or sub-event definitions, and determines an event or sub-event based on the comparison, or determines or updates the state of an event or sub-event. In some embodiments, event comparator 184 includes event definition 186. Event definition 186 includes the definition of an event (e.g., a predefined sequence of sub-events), such as event 1 (187-1), event 2 (187-2), and others. In some embodiments, sub-events in event (187) include, for example, touch start, touch end, touch move, touch cancel, and multi-touch. In one example, the definition of event 1 (187-1) is a double-click on a displayed object. For example, a double-click includes a first touch (touch start) of a predetermined duration on a displayed object, a first lift-off (touch end) of a predetermined duration, a second touch (touch start) of a predetermined duration on a displayed object, and a second lift-off (touch end) of a predetermined duration. In another example, the definition of event 2 (187-2) is a drag on a displayed object. For example, dragging includes a touch (or contact) of a predetermined duration on a displayed object, movement of the touch on the touch-sensitive display 112, and lifting of the touch (touch end). In some embodiments, the event also includes information for one or more associated event handlers 190.
[0142] In some embodiments, event definition 187 includes definitions of events for corresponding user interface objects. In some embodiments, event comparator 184 performs a hit test to determine which user interface object is associated with a sub-event. For example, in an application view displaying three user interface objects on touch-sensitive display 112, when a touch is detected on touch-sensitive display 112, event comparator 184 performs a hit test to determine which of the three user interface objects is associated with the touch (sub-event). If each displayed object is associated with a corresponding event handler 190, the event comparator uses the result of the hit test to determine which event handler 190 should be activated. For example, event comparator 184 selects an event handler associated with a sub-event and the object that triggered the hit test.
[0143] In some embodiments, the definition of the corresponding event (187) also includes a delay action that delays the delivery of the event information until it has been determined that the sub-event sequence does or does not correspond to the event type of the event identifier.
[0144] When a corresponding event recognizer 180 determines that a sequence of sub-events does not match any event in event definition 186, the corresponding event recognizer 180 enters an event impossible, event failed, or event ended state, after which subsequent sub-events of the touch-based gesture are ignored. In this case, other event recognizers (if any) that remain active for the hit view continue to track and process sub-events of the ongoing touch-based gesture.
[0145] In some embodiments, the corresponding event recognizers 180 include metadata 183 with configurable properties, flags, and / or lists that indicate how the event delivery system should perform sub-event delivery to actively participating event recognizers. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate how event recognizers interact or can interact with each other. In some embodiments, metadata 183 includes configurable properties, flags, and / or lists that indicate whether sub-events are delivered to different levels in a view or programmatic hierarchy.
[0146] In some embodiments, when one or more specific sub-events of an event are identified, the corresponding event recognizer 180 activates an event handler 190 associated with the event. In some embodiments, the corresponding event recognizer 180 delivers event information associated with the event to the event handler 190. Activating the event handler 190 is different from sending (and deferred sending) the sub-events to the corresponding hit view. In some embodiments, the event recognizer 180 throws a tag associated with the identified event, and the event handler 190 associated with the tag obtains the tag and performs a predefined process.
[0147] In some embodiments, the event delivery instructions 188 include a sub-event delivery instruction that delivers event information about a sub-event without activating an event handler. Instead, the sub-event delivery instruction delivers the event information to an event handler associated with a sub-event sequence or to an actively participating view. The event handler associated with the sub-event sequence or with an actively participating view receives the event information and performs a predetermined process.
[0148] In some embodiments, data updater 176 creates and updates data used in application 136-1. For example, data updater 176 updates phone numbers used in contact module 137 or stores video files used in video player module. In some embodiments, object updater 177 creates and updates objects used in application 136-1. For example, object updater 177 creates new user interface objects or updates the position of user interface objects. GUI updater 178 updates the GUI. For example, GUI updater 178 prepares display information and sends the display information to graphics module 132 for display on a touch-sensitive display.
[0149] In some embodiments, event handler 190 includes or has access to data updater 176, object updater 177, and GUI updater 178. In some embodiments, data updater 176, object updater 177, and GUI updater 178 are included in a single module of the corresponding application 136-1 or application view 191. In other embodiments, they are included in two or more software modules.
[0150] It should be understood that the above discussion of event processing of user touches on a touch-sensitive display also applies to other forms of user input that utilize input devices to operate the multifunction device 100, and not all user input is initiated on the touch screen. For example, mouse movement and mouse button presses, optionally in conjunction with single or multiple keyboard presses or hold; contact movement on a touch pad, such as tapping, dragging, scrolling, etc.; stylus input; movement of the device; verbal commands; detected eye movement; biometric input; and / or any combination thereof are optionally used as input corresponding to sub-events defining the event to be recognized.
[0151] Figure 2A portable multifunction device 100 with a touch screen 112 according to some embodiments is shown. The touch screen optionally displays one or more graphics within a user interface (UI) 200. In this embodiment and other embodiments described below, a user can select one or more of these graphics by, for example, making gestures on the graphics using one or more fingers 202 (not drawn to scale in the figure) or one or more styluses 203 (not drawn to scale in the figure). In some embodiments, selection of one or more graphics will occur when the user interrupts contact with the one or more graphics. In some embodiments, gestures optionally include one or more taps, one or more swipes (from left to right, from right to left, up and / or down) and / or rolling of fingers that have been in contact with the device 100 (from right to left, from left to right, up and / or down). In some specific implementations or in some cases, inadvertent contact with a graphic will not select the graphic. For example, when the gesture corresponding to the selection is a tap, a swipe gesture that sweeps over an application icon optionally does not select the corresponding application.
[0152] The device 100 optionally also includes one or more physical buttons, such as a "home" or menu button 204. As previously described, the menu button 204 is optionally used to navigate to any application 136 in a set of applications that are optionally executed on the device 100. Alternatively, in some embodiments, the menu button is implemented as a soft key in a GUI displayed on the touch screen 112.
[0153] In some embodiments, the device 100 includes a touch screen 112, a menu button 204, a push button 206 for turning the device on / off and for locking the device, one or more volume adjustment buttons 208, a user identity module (SIM) card slot 210, an earphone jack 212, and a docking / charging external port 124. The push button 206 is optionally used to turn the device on / off by pressing the button and keeping the button in a pressed state for a predefined time interval; lock the device by pressing the button and releasing the button before the predefined time interval passes; and / or unlock the device or initiate an unlocking process. In an alternative embodiment, the device 100 also accepts voice input for activating or deactivating certain functions through a microphone 113. The device 100 also optionally includes one or more contact strength sensors 165 for detecting the strength of contact on the touch screen 112, and / or one or more tactile output generators 167 for generating tactile output for a user of the device 100.
[0154] Figure 3300 is a block diagram of an exemplary multifunction device with a display and a touch-sensitive surface according to some embodiments. Device 300 does not have to be portable. In some embodiments, device 300 is a laptop, a desktop computer, a tablet computer, a multimedia player device, a navigation device, an educational device (such as a children's learning toy), a game system, or a control device (e.g., a home controller or an industrial controller). Device 300 typically includes one or more processing units (CPUs) 310, one or more network or other communication interfaces 360, a memory 370, and one or more communication buses 320 for interconnecting these components. The communication bus 320 optionally includes circuits (sometimes referred to as a chipset) that interconnect system components and control communications between system components. Device 300 includes an input / output (I / O) interface 330 with a display 340, which is typically a touch screen display. The I / O interface 330 also optionally includes a keyboard and / or a mouse (or other pointing device) 350 and a touchpad 355, a tactile output generator 357 for generating tactile output on the device 300 (e.g., similar to the above reference Figure 1A The tactile output generator 167 described above), sensor 359 (e.g., optical sensor, acceleration sensor, proximity sensor, touch sensor and / or contact intensity sensor (similar to the above reference Figure 1A The memory 370 may include a high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and may optionally include a non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices. The memory 370 may optionally include one or more storage devices located away from the CPU 310. In some embodiments, the memory 370 stores data related to the portable multifunction device 100 ( Figure 1A ) or a subset thereof. In addition, memory 370 optionally stores additional programs, modules, and data structures not present in memory 102 of portable multifunction device 100. For example, memory 370 of device 300 optionally stores a drawing module 380, a presentation module 382, a word processing module 384, a website creation module 386, a disk editing module 388, and / or a spreadsheet module 390, while portable multifunction device 100 ( Figure 1A )'s memory 102 optionally does not store these modules.
[0155] Figure 3Each element in the above-mentioned elements in is optionally stored in one or more memory devices of the previously mentioned memory device. Each module in the above-mentioned modules corresponds to the instruction set for performing the above-mentioned functions. The above-mentioned modules or programs (e.g., instruction sets) do not have to be implemented as independent software programs, processes or modules, and therefore the various subsets of these modules are optionally combined or otherwise rearranged in various embodiments. In some embodiments, memory 370 optionally stores the subset of the above-mentioned modules and data structures. In addition, memory 370 optionally stores additional modules and data structures not described above.
[0156] Attention is now turned to an embodiment of a user interface that is optionally implemented on, for example, portable multifunction device 100.
[0157] Figure 4A An exemplary user interface of an application menu on portable multifunction device 100 according to some embodiments is shown. A similar user interface is optionally implemented on device 300. In some embodiments, user interface 400 includes the following elements, or a subset or superset thereof:
[0158] Signal strength indicators 402 for wireless communications such as cellular signals and Wi-Fi signals;
[0159] Time 404;
[0160] Bluetooth indicator 405;
[0161] Battery status indicator 406;
[0162] A tray 408 with icons for commonly used applications, such as:
[0163] o an icon 416 of the phone module 138 labeled “Phone”, which optionally includes an indicator 414 of the number of missed calls or voicemails;
[0164] o an icon 418 of the email client module 140 labeled “Mail,” which optionally includes an indicator 410 of the number of unread emails;
[0165] o An icon 420 labeled “Browser” of the browser module 147; and
[0166] o an icon 422 labeled “iPod” for a video and music player module 152 (also referred to as an iPod (trademark of Apple Inc.) module 152); and
[0167] Icons for other apps, such as:
[0168] o Icon 424 of IM module 141 labeled “Message”;
[0169] o Icon 426 labeled “Calendar” of calendar module 148;
[0170] o Icon 428 labeled “Photos” of the image management module 144;
[0171] o An icon 430 labeled “Camera” of the camera module 143;
[0172] o Icon 432 labeled “Online Video” of the online video module 155;
[0173] o Icon 434 labeled "Stock Market" of the Stock Market widget 149-2;
[0174] o an icon 436 labeled “MAP” of the map module 154;
[0175] o Icon 438 labeled "Weather" of the Weather widget 149-1;
[0176] o Icon 440 labeled as “Clock” of the alarm clock widget 149-4;
[0177] o an icon 442 labeled “Fitness Support” of the fitness support module 142;
[0178] o An icon 444 labeled "Notepad" of the notepad module 153; and
[0179] o An icon 446 labeled “Settings” of a settings application or module that provides access to settings for the device 100 and its various applications 136.
[0180] It should be noted that Figure 4A The icon labels shown in are exemplary only. For example, icon 422 of video and music player module 152 is labeled "Music" or "Music Player". Other labels are optionally used for various application icons. In some embodiments, the label of a corresponding application icon includes the name of the application corresponding to the corresponding application icon. In some embodiments, the label of a particular application icon is different from the name of the application corresponding to the particular application icon.
[0181] Figure 4B A touch-sensitive surface 451 (eg, touch screen display 112) is shown having a touch-sensitive surface 451 (eg, Figure 3 tablet or touch pad 355) device (e.g., Figure 3Device 300 also optionally includes one or more contact intensity sensors (e.g., one or more of sensors 359) for detecting intensity of contacts on touch-sensitive surface 451 and / or one or more tactile output generators 357 for generating tactile output for a user of device 300.
[0182] Although some of the examples below are given with reference to input on a touch screen display 112 (where a touch-sensitive surface and a display are combined), in some embodiments, the device detects input on a touch-sensitive surface that is separate from the display, such as Figure 4B In some embodiments, the touch-sensitive surface (e.g., Figure 4B 451) has a main axis (e.g., Figure 4B 453) corresponding to the principal axis (for example, Figure 4B According to these embodiments, the device detects a position corresponding to a corresponding position on the display (e.g., Figure 4B 460 corresponds to 468 and 462 corresponds to 470) in contact with touch-sensitive surface 451 (e.g., Figure 4B Thus, when the touch-sensitive surface (e.g., Figure 4B 451) and a display of a multi-function device (e.g., Figure 4B When the user input detected by the device on the touch-sensitive surface (e.g., contacts 460 and 462 and their movement) is separated, the device is used to manipulate the user interface on the display. It should be understood that similar methods are optionally used for other user interfaces described herein.
[0183] In addition, although the following examples are primarily given with reference to finger inputs (e.g., finger contacts, single-finger tap gestures, finger swipe gestures), it should be understood that in some embodiments, one or more of these finger inputs are replaced by input from another input device (e.g., mouse-based input or stylus input). For example, a swipe gesture is optionally replaced by a mouse click (e.g., instead of contact), followed by movement of the cursor along the path of the swipe (e.g., instead of movement of the contact). As another example, a tap gesture is optionally replaced by a mouse click when the cursor is over the location of the tap gesture (e.g., instead of detecting contact, followed by ceasing to detect contact). Similarly, when multiple user inputs are detected simultaneously, it should be understood that multiple computer mice are optionally used simultaneously, or a mouse and finger contact are optionally used simultaneously.
[0184] Figure 5AAn exemplary personal electronic device 500 is shown. Device 500 includes a body 502. In some embodiments, device 500 may include a body 502 relative to devices 100 and 300 (e.g., Figures 1A to 4B ) some or all of the features described in the foregoing. In some embodiments, device 500 has a touch-sensitive display screen 504, referred to hereinafter as touch screen 504. As an alternative or in addition to touch screen 504, device 500 has a display and a touch-sensitive surface. As with devices 100 and 300, in some embodiments, touch screen 504 (or touch-sensitive surface) optionally includes one or more strength sensors for detecting the intensity of contact (e.g., touch) applied. One or more strength sensors of touch screen 504 (or touch-sensitive surface) can provide output data representing the intensity of touch. The user interface of device 500 can respond to touch based on the intensity of the touch, which means that touches of different intensities can invoke different user interface operations on device 500.
[0185] Exemplary techniques for detecting and processing touch intensity are found, for example, in the following related patent applications: International Patent Application Serial No. PCT / US2013 / 040061, filed on May 8, 2013, entitled “Device, Method, and Graphical User Interface for Displaying User Interface Objects Corresponding to an Application,” published as WIPO Patent Publication No. WO / 2013 / 169849; and International Patent Application Serial No. PCT / US2013 / 069483, filed on November 11, 2013, entitled “Device, Method, and Graphical User Interface for Transitioning Between Touch Input to Display Output Relationships,” published as WIPO Patent Publication No. WO / 2014 / 105276, each of which is hereby incorporated by reference in its entirety.
[0186] In some embodiments, the device 500 has one or more input mechanisms 506 and 508. The input mechanisms 506 and 508 (if included) can be physical. Examples of physical input mechanisms include push buttons and rotatable mechanisms. In some embodiments, the device 500 has one or more attachment mechanisms. Such attachment mechanisms (if included) can allow the device 500 to be attached to, for example, hats, glasses, earrings, necklaces, shirts, jackets, bracelets, watchbands, bracelets, pants, belts, shoes, wallets, backpacks, etc. These attachment mechanisms allow the user to wear the device 500.
[0187] Figure 5B An exemplary personal electronic device 500 is shown. In some embodiments, the device 500 may include a reference Figure 1A , Figure 1B and Figure 3 Some or all of the components described. Device 500 has a bus 512 that operatively couples an I / O portion 514 to one or more computer processors 516 and a memory 518. I / O portion 514 may be connected to a display 504, which may have a touch-sensitive component 522 and optionally a strength sensor 524 (e.g., a contact strength sensor). In addition, I / O portion 514 may be connected to a communication unit 530 for receiving application and operating system data using Wi-Fi, Bluetooth, near field communication (NFC), cellular and / or other wireless communication technologies. Device 500 may include input mechanisms 506 and / or 508. For example, input mechanism 506 is optionally a rotatable input device or a depressible input device and a rotatable input device. In some examples, input mechanism 508 is optionally a button.
[0188] In some examples, input mechanism 508 is optionally a microphone. Personal electronic device 500 optionally includes various sensors, such as GPS sensor 532, accelerometer 534, orientation sensor 540 (e.g., compass), gyroscope 536, motion sensor 538, and / or combinations thereof, all of which are operably connected to I / O portion 514.
[0189] The memory 518 of the personal electronic device 500 may include one or more non-transitory computer-readable storage media for storing computer-executable instructions that, when executed by one or more computer processors 516, may, for example, cause the computer processors to perform the techniques described below, including processes 700, 900, and 1100. Computer-readable storage media may be any medium that can tangibly contain or store computer-executable instructions for use by or in conjunction with an instruction execution system, apparatus, and device. In some examples, the storage medium is a transient computer-readable storage medium. In some examples, the storage medium is a non-transitory computer-readable storage medium. Non-transitory computer-readable storage media may include, but are not limited to, magnetic storage devices, optical storage devices, and / or semiconductor storage devices. Examples of such storage devices include magnetic disks, optical disks based on CD, DVD, or Blu-ray technology, and persistent solid-state memory such as flash memory, solid-state drives, and the like. The personal electronic device 500 is not limited to Figure 5B components and configurations, but may include other components or additional components in a variety of configurations.
[0190] As used herein, the term "indicative representation" refers to an optional feature of the apparatus 100, 300, and / or 500 ( Figure 1A , Figure 3 and FIG. 5A to FIG. 5B ) is a user-interactive graphical user interface object displayed on a display screen of a computer. For example, an image (e.g., an icon), a button, and text (e.g., a hyperlink) optionally each constitute an affordance.
[0191] As used herein, the term "focus selector" refers to an input element used to indicate the current portion of a user interface with which a user is interacting. In some implementations that include a cursor or other position marker, the cursor acts as a "focus selector" such that when the cursor is over a particular user interface element (e.g., a button, window, slider, or other user interface element), a focus selector is displayed on a touch-sensitive surface (e.g., Figure 3 Touchpad 355 or Figure 4B In the event that an input (e.g., a press input) is detected on the touch-sensitive surface 451 in the display, the particular user interface element is adjusted according to the detected input. In the case that a touch-screen display (e.g., Figure 1A A touch-sensitive display system 112 or Figure 4AIn some implementations of the touch screen 112 in FIG. 1 , a contact detected on the touch screen acts as a “focus selector” such that when an input (e.g., a press input by the contact) is detected at the location of a particular user interface element (e.g., a button, window, slider, or other user interface element) on the touch screen display, the particular user interface element is adjusted in accordance with the detected input. In some implementations, the focus moves from one area of the user interface to another area of the user interface without corresponding movement of a cursor or movement of a contact on the touch screen display (e.g., by using a tab key or arrow keys to move the focus from one button to another); in these implementations, the focus selector moves in accordance with the movement of the focus between different areas of the user interface. Regardless of the specific form the focus selector takes, the focus selector is typically a user interface element (or contact on the touch screen display) that is controlled by the user to deliver the user's intended interaction with the user interface (e.g., by indicating to the device the element of the user interface with which the user desires to interact). For example, when a press input is detected on a touch-sensitive surface (e.g., a trackpad or touch screen), the position of a focus selector (e.g., a cursor, contact, or selection box) over a corresponding button will indicate that the user intends to activate the corresponding button (rather than other user interface elements shown on the device display).
[0192] As used in the specification and claims, the term "characteristic intensity" of a contact refers to a characteristic of a contact based on one or more intensities of the contact. In some embodiments, the characteristic intensity is based on multiple intensity samples. The characteristic intensity is optionally based on a predefined number of intensity samples or a set of intensity samples collected during a predetermined time period (e.g., 0.05 seconds, 0.1 seconds, 0.2 seconds, 0.5 seconds, 1 second, 2 seconds, 5 seconds, 10 seconds) relative to a predefined event (e.g., after contact is detected, before contact is detected to be lifted off, before or after contact starts to move, before contact ends, before or after contact intensity is detected to increase, and / or before or after contact intensity is detected to decrease). The characteristic intensity of a contact is optionally based on one or more of the following: the maximum value of the intensity of the contact, the mean value of the intensity of the contact, the average value of the intensity of the contact, the value at the top 10% of the intensity of the contact, the half-maximum value of the intensity of the contact, the 90% maximum value of the intensity of the contact, etc. In some embodiments, the duration of the contact is used when determining the characteristic intensity (e.g., when the characteristic intensity is the average value of the intensity of the contact over time). In some embodiments, the feature strength is compared to a set of one or more strength thresholds to determine whether the user has performed an operation. For example, the set of one or more strength thresholds optionally includes a first strength threshold and a second strength threshold. In this example, a contact whose feature strength does not exceed the first threshold results in a first operation, a contact whose feature strength exceeds the first strength threshold but does not exceed the second strength threshold results in a second operation, and a contact whose feature strength exceeds the second threshold results in a third operation. In some embodiments, a comparison between the feature strength and one or more thresholds is used to determine whether to perform one or more operations (e.g., whether to perform the corresponding operation or to abandon the corresponding operation) rather than to determine whether to perform the first operation or the second operation.
[0193] In some embodiments, a portion of a gesture is identified for determining characteristic strength. For example, the touch-sensitive surface optionally receives a continuous swipe contact that transitions from a starting position and reaches an end position, where the contact strength increases. In this example, the characteristic strength of the contact at the end position is optionally based only on a portion of the continuous swipe contact, rather than the entire swipe contact (e.g., only the portion of the swipe contact at the end position). In some embodiments, a smoothing algorithm is optionally applied to the strength of the swipe contact before determining the characteristic strength of the contact. For example, a smoothing algorithm optionally includes one or more of the following: an unweighted sliding average smoothing algorithm, a triangular smoothing algorithm, a median filter smoothing algorithm, and / or an exponential smoothing algorithm. In some cases, these smoothing algorithms eliminate narrow peaks or depressions in the strength of the swipe contact to achieve the purpose of determining the characteristic strength.
[0194] The intensity of contact on the touch-sensitive surface is optionally characterized relative to one or more intensity thresholds such as a contact detection intensity threshold, a light press intensity threshold, a deep press intensity threshold, and / or one or more other intensity thresholds. In some embodiments, the light press intensity threshold corresponds to an intensity at which the device will perform an operation typically associated with clicking a button of a physical mouse or trackpad. In some embodiments, the deep press intensity threshold corresponds to an intensity at which the device will perform an operation different from the operation typically associated with clicking a button of a physical mouse or trackpad. In some embodiments, when a contact having a characteristic intensity lower than the light press intensity threshold (e.g., and higher than a nominal contact detection intensity threshold, contacts lower than the nominal contact detection intensity threshold are no longer detected) is detected, the device will move the focus selector according to the movement of the contact on the touch-sensitive surface without performing an operation associated with the light press intensity threshold or the deep press intensity threshold. Generally speaking, unless otherwise stated, these intensity thresholds are consistent between different groups of user interface illustrations.
[0195] An increase in contact feature intensity from an intensity below a light press intensity threshold to an intensity between the light press intensity threshold and the deep press intensity threshold is sometimes referred to as a "light press" input. An increase in contact feature intensity from an intensity below a deep press intensity threshold to an intensity above the deep press intensity threshold is sometimes referred to as a "deep press" input. An increase in contact feature intensity from an intensity below a contact detection intensity threshold to an intensity between the contact detection intensity threshold and the light press intensity threshold is sometimes referred to as detecting contact on the touch surface. A decrease in contact feature intensity from an intensity above the contact detection intensity threshold to an intensity below the contact detection intensity threshold is sometimes referred to as detecting contact lifted from the touch surface. In some embodiments, the contact detection intensity threshold is zero. In some embodiments, the contact detection intensity threshold is greater than zero.
[0196] In some embodiments described herein, one or more operations are performed in response to detecting a gesture that includes a corresponding press input or in response to detecting a corresponding press input performed using a corresponding contact (or multiple contacts), wherein the corresponding press input is detected at least in part based on detecting that the strength of the contact (or multiple contacts) increases to above a press input strength threshold. In some embodiments, the corresponding operation is performed in response to detecting that the strength of the corresponding contact increases to above the press input strength threshold (e.g., a "down stroke" of the corresponding press input). In some embodiments, the press input includes an increase in the strength of the corresponding contact to above the press input strength threshold and the strength of the contact subsequently decreases to below the press input strength threshold, and the corresponding operation is performed in response to detecting that the strength of the corresponding contact subsequently decreases to below the press input threshold (e.g., an "up stroke" of the corresponding press input).
[0197] In some embodiments, the device employs intensity hysteresis to avoid unexpected inputs sometimes referred to as "jitter," where the device defines or selects a hysteresis intensity threshold that has a predefined relationship to a press input intensity threshold (e.g., the hysteresis intensity threshold is X intensity units lower than the press input intensity threshold, or the hysteresis intensity threshold is 75%, 90%, or some reasonable proportion of the press input intensity threshold). Thus, in some embodiments, a press input includes an increase in the intensity of the corresponding contact to above the press input intensity threshold and a subsequent decrease in the intensity of the contact to below the hysteresis intensity threshold corresponding to the press input intensity threshold, and a corresponding operation is performed in response to detecting that the intensity of the corresponding contact subsequently decreases to below the hysteresis intensity threshold (e.g., an "upward stroke" of the corresponding press input). Similarly, in some embodiments, a press input is detected only when the device detects that the contact intensity increases from an intensity equal to or below the hysteresis intensity threshold to an intensity equal to or above the press input intensity threshold and, optionally, that the contact intensity subsequently decreases to an intensity equal to or below the hysteresis intensity, and a corresponding operation is performed in response to detecting the press input (e.g., an increase in contact intensity or a decrease in contact intensity, depending on the circumstances).
[0198] For ease of explanation, optionally, a description of an operation performed in response to a press input associated with a press input intensity threshold or in response to a gesture including a press input is triggered in response to detecting any of the following: contact intensity increasing to above the press input intensity threshold, contact intensity increasing from an intensity below a hysteresis intensity threshold to an intensity above the press input intensity threshold, contact intensity decreasing to below the press input intensity threshold, and / or contact intensity decreasing to below a hysteresis intensity threshold corresponding to the press input intensity threshold. Additionally, in examples where an operation is described as being performed in response to detecting that the intensity of the contact decreases below the press input intensity threshold, the operation is optionally performed in response to detecting that the intensity of the contact decreases below a hysteresis intensity threshold that corresponds to and is less than the press input intensity threshold.
[0199] As used herein, an "installed application" refers to a software application that has been downloaded to an electronic device (e.g., device 100, 300, and / or 500) and is ready to be launched (e.g., become open) on the device. In some embodiments, a downloaded application becomes an installed application using an installer that extracts program portions from a downloaded software package and integrates the extracted portions with the operating system of a computer system.
[0200] As used herein, the term "open application" or "executing application" refers to a software application that has retained state information (e.g., as part of device / global internal state 157 and / or application internal state 192). An open or executing application is optionally any of the following types of applications:
[0201] The active application currently displayed on the display of the device on which the application is being used;
[0202] Background applications (or background processes), which are not currently displayed but one or more processes of the application are being processed by one or more processors; and
[0203] - A suspended or dormant application that is not running but has state information stored in memory (volatile and non-volatile, respectively) and can be used to resume execution of the application.
[0204] As used herein, the term "closed application" refers to a software application that does not have retained state information (e.g., the state information of a closed application is not stored in the memory of the device). Therefore, closing an application includes stopping and / or removing the application process of the application and removing the state information of the application from the memory of the device. Generally speaking, when in a first application, opening a second application does not close the first application. When the second application is displayed and the first application stops being displayed, the first application becomes a background application.
[0205] Attention is now turned to embodiments of a user interface ("UI") and associated processes implemented on an electronic device, such as portable multifunction device 100, device 300, or device 500.
[0206] FIG. 6A to FIG. 6N An exemplary user interface for managing tasks associated with a research study is shown according to some embodiments. The user interface in these figures is used to illustrate the following description including Figure 7 The process of the process.
[0207] Fig. 6A An electronic device 600 is shown, which is a smart phone. Device 600 includes a touch-sensitive display screen 602 and one or more microphones. In some embodiments, device 600 also includes one or more features of device 100, 300, or 500.
[0208] exist Fig. 6A, the device 600 is displaying the user interface 604 of the survey research management application. The survey research management application is configured to provide information and functions related to the management of one or more survey researches currently participated in (e.g., actively participated in) by the user of the device 600 and the interaction with the one or more survey researches. For example, the survey research management application facilitates participation in new researches, completing tasks of active researches, transmitting data to the organizer of the research, and viewing information about past / inactive researches. In some embodiments, the survey research is an exploration including collecting data (e.g., health-related data) from multiple users (e.g., users of electronic devices). In some embodiments, the survey research is organized by an individual or institution (e.g., a university) for the purpose of collecting data for multiple survey work, including for published surveys. In some embodiments, the data collected via the methods described herein are periodically forwarded (e.g., exported) to the organizer of the survey research who has been granted permission to access the data (e.g., granting permission during the participation process).
[0209] Fig. 6A The interface 604 is configured to display multiple views or tabs, depending on which view is currently selected for display (e.g., selected via the view enable representation 606 (e.g., via the enable representation (task view enable representation 606a, research view enable representation 606b, data view enable representation 606c)). Fig. 6A As seen in FIG. 6 , interface 604 is currently displaying task view 604a, as indicated by the bold font of task view affordance 606a. Task view affordance 606a includes a numerical marker 606a1 indicating the number of the current task (e.g., Fig. 6A ), the number mark provides the user with an indication of the current number of tasks, even when interface 604 is currently displaying a view other than the task view.
[0210] exist Fig. 6A, task view 604a includes multiple current tasks (e.g., tasks to be completed) 608, which include: task 608a, which is a survey profile questionnaire associated with a survey management application (e.g., not associated with any specific study); task 608b, which is a lifestyle questionnaire associated with a women's health study; task 608c, which is a running questionnaire associated with the same women's health study; and task 608d, which is a voice and noise test associated with an annual medical history study. Each task in task 608 is an enable representation, which, when selected (e.g., selected by providing input corresponding to a "start" indication of enable representation 608b), causes device 600 to initiate a process for completing the corresponding task. A task may have a limited time window for completing the task. For example, task 608b includes an indication of "6 days remaining," indicating that the task will expire (e.g., become inactive) if it is not completed within the next 6 days. As Fig. 6A As seen in , the current tasks are sorted by the amount of time remaining to complete the tasks, with tasks that are due sooner displayed first (e.g., at the top). Fig. 6A , task 608c is activated based on device 600 detecting that the user of device 600 recently completed a running workout (e.g., via a separate physical activity tracking application and / or via one or more sensors (e.g., motion sensors) of device 600). In some embodiments, the set of active tasks is dependent on permissions (e.g., data access permissions) being granted to the survey management application, as discussed in more detail below. For example, if permission to access data from a sensor of device 600 is not granted and task 608c is dependent on sensor data, task 608c will not be presented as an active task.
[0211] exist Fig. 6A , task view 604a also includes survey study contribution indicators 610a and 610b that provide engagement metrics. Indication 610a provides a measure of engagement time for the user of device 600 (e.g., hours, minutes spent interacting with the survey management application, or time spent completing a task). Indication 610b provides the total number of questions answered (e.g., answered as part of completing a task) by the user of device 600. In some embodiments, the measurement is made across all survey studies.
[0212] exist Fig. 6A , the device 600 detects a touch input 612 on the touch-sensitive display 602 that is a tap gesture corresponding to the task 608a, and in response, displays a task completion interface 614, such as Figure 6B As seen in.
[0213] exist Figure 6B, a task completion interface 614 is shown having fields 616a-616g that are pre-populated with information about a user of device 600 that is available to device 600 (e.g., stored on device 600). In some embodiments, one or more fields are not pre-populated but are completed via further user input (e.g., input provided via a soft keyboard). Figure 6B As shown, fields 616a-616g are selectable for entering new text or editing existing text. Task completion interface 614 includes a cancel affordance 616 for exiting interface 614 without completing the task associated with task 608a (e.g., without submitting the information pre-filled into fields 616a-616g).
[0214] exist Figure 6B , device 600 detects touch input 618, i.e., a tap gesture corresponding to completion affordance 620. In response to touch input 618, device 620 stores and / or populates information in fields 616a-616g as a response to the survey profile questionnaire task and redisplays task view 604A of interface 604, as shown. Figure 6C As seen in.
[0215] exist Figure 6C , completed task 608a is no longer displayed at the top of task view 604a. Indicator 610b now shows a total of 15 questions answered (increased from 8 questions answered), reflecting that an additional 7 questions were answered as part of completing task 608a. The number marker 606a1 of task view indicator 606a now shows "4" remaining tasks to be completed. Task view 604a now includes an additional current task 608e, which is a tone and volume test associated with an annual medical history study (e.g., the same study associated with task 608d). Since task 608e has 8 days left to complete, task 608e is listed after tasks 608b-608d, which have less time to complete.
[0216] exist Figure 6C , the device 600 detects a touch input 622 on the touch-sensitive display 602 that is an upward swipe gesture, and in response, scrolls the task view 604a of the interface 604, such as Fig.6D As seen in.
[0217] exist Fig.6D , after scrolling up, task view 604a now includes additional tasks 608f corresponding to available studies that can be participated in (e.g., active studies that the user is not currently participating in but is eligible to participate in). In some embodiments, task 604a is presented to the user of device 600 based on the user's participation in a related women's health study. Fig.6D In the embodiment, task view 604a also includes a completed task section 624, which includes completed tasks 624a corresponding to the previous current task 608a. In some embodiments, completed tasks 624a are enabled to indicate that when selected, further information about the task is displayed, including answers submitted to complete the task. In some embodiments, completed tasks section 624 only includes tasks completed within a predefined period (e.g., the last day, week, or month). After scrolling, task view 604a also includes displaying all tasks enabled to indicate 626, which, when selected, displays a larger set of completed tasks (e.g., completed tasks within a longer predefined period; all completed tasks).
[0218] exist Fig.6D , device 600 detects touch input 628 on touch-sensitive display 602 that is a tap gesture corresponding to research view affordance 606 b and, in response, transitions user interface 604 to research view 604 b, as shown in FIG. Fig. 6E As seen in.
[0219] exist Fig. 6E , the study view enable indication 606b is bold, while the task view enable indication 606a is no longer bold, to indicate that the study view is currently active. Study view 604b includes a current studies section 630 that includes a plurality of current studies in which the user of device 600 is currently participating, the plurality of current studies including current study 630a (annual medical history study) and current study 630b (women's health study), each of which includes an indication that the study is active (e.g., incomplete; not concluded with respect to data collection). Each current study also includes indications of a number of active tasks, if any. For example, current study 630a includes indication 630a1 that indicates that two tasks corresponding to tasks 608d and 608e of task view 604 are currently active and to be completed. Study view 604b also includes an available studies section 632 that includes a plurality of studies that are active and potentially available for the user of device 600 to participate in. As Fig. 6E As seen in , the available studies section 632 includes: a first available study 632a, which is a female dietary study (e.g., associated with task 608f of task view 604a); and a second available study 632b, which is a male health study. The studies include an indication of the organizer of the study (e.g., the entity receiving the data if the user participates). For example, study 632a shows that the organizer is the American Health Sciences Laboratory. Based on the requirements of the study and the information available on device 600, study 632b is marked as "Not Eligible" when active. In Fig. 6EIn the example, study 632b requires that the user must be male to participate, and the current data available to device 600 indicates that the user is female. In some embodiments, if the information about the user is updated to indicate that the user is male, the eligibility status of study 632b will also be updated to indicate that study 632b is no longer an ineligible study. Fig. 6E As seen in FIG. 6A , the research view 604 b also includes a past research section 634 , which is described in more detail below.
[0220] exist Fig. 6E , the device 600 detects a touch input 636 on the touch-sensitive display 602 that is an upward swipe gesture, and in response, scrolls the research view 604b of the interface 604, as shown in FIG. Fig. 6F As seen in.
[0221] exist Fig. 6F , after scrolling up, the study view 604b now includes a past study 634a that is a sleep health data study and a past study 634b that is a dietary health study in the past studies section 634. Past study 634a includes an indication of "ended," indicating that the study is no longer valid. In some embodiments, past studies also include an indication of the user's participation status for the past studies (e.g., "participated" or "not participated"). Past study 634b includes an indication of "exited," indicating that a user of device 600 participated in the study while the study was active, but the user exited the study before the study ended (as described in more detail below). Past study 634b also includes an indication 634b1 that provides information about how data from the study was used. In Fig. 6F , 634b1 indicates that the data of the study has been cited by 3 articles. In some embodiments, indication 634b1 is dynamic and updated as further information about the use of the study data is received, even after the study is concluded and / or the user exits the study.
[0222] exist Fig. 6F , device 600 detects touch input 638 on touch-sensitive display 602 that is a tap gesture corresponding to current study 630b, and in response, displays study details interface 640 that includes further information and functionality specific to study 630b, such as Figure 6G As seen in.
[0223] exist Figure 6G, the research details interface 640 includes a current task section 642, which includes current task affordances 642a and 642b, which correspond to active tasks for the female health study corresponding to the research 630b of the research view 604b. Task affordances 642a and task affordances 642b correspond to tasks 608b and 608c of the task view 604a, respectively, and when selected, cause the device 600 to display a user interface for completing the task. In some embodiments, task affordances 642a and task 608b cause the device 600 to perform the same function. The research details interface 640 also includes a shared data section 644, which includes affordances 644a-644c, which each correspond to a data type shared (e.g., authorized to be shared) with the female health study and each can be selected to view further information and / or functions specific to the selected data type. For example, affordance 644a, when selected, causes device 600 to display further information about demographic data shared with the Women's Health Study. In some embodiments, the further information is similar to Figure 6K Study details interface 640 also includes a study options section 646 that includes affordances 646a-646d that provide additional functionality related to the women's health study. For example, affordance 646a, when selected, causes device 600 to display information about the consent provided at the time of participation (e.g., Figure 8K ). Indicator 646b, when selected, causes device 600 to display a privacy policy regarding the study (e.g., a data privacy policy, such as can be viewed from the Fig.8O Affordance 646c, when selected, causes device 600 to display frequently asked questions about the current study. Affordance 646d, when selected, causes device 600 to initiate a process for contacting a support service that can provide support (e.g., technical support) related to the current study. Study view 604b also includes an initiate exit affordance 648, which, when selected, initiates a process for exiting the current study.
[0224] exist Figure 6G , device 600 detects touch input 650 on touch-sensitive display 602 that is a tap gesture corresponding to initiating exit affordance 648, and in response, displays Figure 6H Exit interface 652.
[0225] exist Figure 6H, exit interface 652 provides information about the results of exiting the study ("This study will no longer have access to newly collected data"). Interface 652 includes exit affordance 654 and cancel affordance 656, which, when selected, cancels the exit process initiated by the selection of affordance 648.
[0226] exist Figure 6H , device 600 detects touch input 658 on touch-sensitive display 602 that is a tap gesture corresponding to exit affordance 654 and, in response, exits the user of device 600 from the women's health study and redisplays study view 604b.
[0227] exist Fig.6I , after exiting the women's health study, the device displays study view 604b. Past studies section 634 now includes past studies 634c corresponding to the exited women's health study, which is no longer displayed as current study 630b in current studies section 630. In some embodiments, active tasks associated with the women's health study are removed from task view 604A. In some embodiments, exiting the study causes device 600 to stop sharing data (e.g., newly collected data) with the study, including any collected data that has not yet been shared with the study.
[0228] exist Fig.6I , device 600 detects touch input 660 on touch-sensitive display 602 that is a tap gesture corresponding to data view affordance 606 c, and in response displays data view 604 c that provides information and functionality related to data shared by a study managed by a survey management application, such as Figure 6J As seen in.
[0229] exist Figure 6J, data view affordance 606c is bold, while study view affordance 606b is no longer bold, to indicate that the data view is currently active. Data view 604c includes demographic data section 662 and sensor and usage data section 664, which correspond to different types of data available for sharing with one or more survey studies managed via the survey management application. Demographic data section 662 includes affordance 662a, which, when selected, causes device 600 to display additional information about the user's demographic data available for sharing. Demographic data section 662 also includes affordance 662b, which, when selected, causes device 600 to display additional information about which studies currently have access to the user's demographic data. Similarly, sensor and usage data section 664 includes affordance 664a, which, when selected, causes device 600 to display additional information about the user's sensor and usage data available for sharing. Sensor and usage data section 664 also includes an affordance 664b that, when selected, causes device 600 to display additional information about which studies currently have access to the user's sensor and usage data.
[0230] exist Figure 6J , while displaying data view 604c, device 600 detects touch inputs 666a-666c on touch-sensitive display 602 and, in response, performs operations as described below.
[0231] exist Figure 6K 6, device 600 displays demographic data details interface 668 in response to input 666a corresponding to affordance 662a of data view 604c. Demographic data details interface 668 includes data details 670a-670c corresponding to demographic data that can be shared with a study that grants access to the user's demographic data. In some embodiments, data details interface 668 can be used to edit the user's demographic data.
[0232] exist Figure 6L, device 600 displays demographic data access interface 672 in response to input 666b of enable representation 662b corresponding to data view 604c. Demographic data access interface 672 provides information about which studies have access to the user's demographic data and includes enable representations 674a and 674b, which correspond to a women's health study and an annual medical history study, respectively. In some embodiments, demographic data access interface 672 lists all studies that are currently accessible or have previously accessed a particular type of data (e.g., demographic data). In some embodiments, only studies that currently have access to a particular type of data are shown (e.g., a women's health study will not be shown after the user exits). In some embodiments, selection of enable representation 674a or 674b provides additional details about the corresponding study (e.g., selection of 674a will result in a Figure 6G of the research details interface 640).
[0233] exist Figure 6M 6, device 600 displays sensor and usage data details interface 676 in response to input 666c of affordance 664a corresponding to data view 604c. Sensor and usage data details interface 676 includes details about sensor data (e.g., sensors of device 600 or sensors on devices connected to device 600 to which device 600 has data access) and usage data (e.g., usage of certain functions of device 600, such as phone call usage or messaging usage) available for research. Usage data details interface 676 includes switchable affordance 678, which, when selected, changes the state of data collection regarding sensors and usage on device 600. In some embodiments, data collection utilizes additional resources of device 600 and turning off data collection can significantly improve battery life or resource availability on device 600. Usage data details interface 676 also includes affordances 680a-680g, which, when selected, provide additional information and functionality related to specific types of sensor or usage data. The usage data details interface 676 also includes a data export affordance 682, which, when selected, results in the immediate export of collected data that has not yet been exported to a study that has been granted access to sensor and usage data. In some embodiments, the device 600 collects data over a period of time (e.g., a day, a week, a month) and then exports the data in batches at the end of the period. The usage data details interface 676 also includes a data delete affordance 684, which deletes any collected but not yet exported data.
[0234] exist Figure 6M, device 600 detects touch input 686 corresponding to enable indication 680e on touch-sensitive display 602, and in response, displays ECG monitor detail interface 688, as shown in FIG. Figure 6N As seen in.
[0235] exist Figure 6N In the embodiment of the present invention, device 600 displays ECG monitor details interface 688, which provides specific information and functions related to the ECG monitor sensor available to device 600. ECG monitor details interface 688 includes information section 690, which provides information about which data are collected and shared for ECG monitor sensor and which information is not selected. Information section 690 includes affordance 690a, which, when selected, causes device 600 to display an example of ECG monitoring data collected and available for sharing. ECG monitor details interface 688 also includes applications and research with access section 692, which includes affordances 692a and 692b corresponding to research and application programs that can access ECG monitor data. Affordances 692a and 692b can be used to independently control access to ECG monitor data (e.g., data of an application or research can be closed without affecting other applications or research). The information section 690 also includes an enable indication 694 which, when selected, provides data collected from the ECG monitor since the last data export event. The information section 690 also includes an enable indication 696 which, when selected, deletes all unexported data for a particular sensor or use (e.g., an ECG monitor) without deleting unexported data for other sensors and / or uses.
[0236] Figure 7 700 is a flow chart illustrating a method for interacting with a survey using an electronic device according to some embodiments. The method 700 is performed at a device (e.g., 100, 300, 500, 600) having a display device (e.g., 602) and one or more input devices (e.g., 602). Some operations in the method 700 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.
[0237] As described below, method 700 provides an intuitive way to interact with a survey. The method reduces the cognitive burden on a user when interacting with a survey, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling a user to interact with a survey faster and more efficiently saves power and increases the time between battery charges.
[0238] An electronic device (e.g., 600) displays (702) a first user interface (e.g., 604) (e.g., an interface having multiple tabbed views; an interface generated by a survey application) via a display device (e.g., 602), the first user interface including a task view enable representation (e.g., 606a) associated with multiple different studies, the multiple different studies including a first study (e.g., 630a) in which a user of the electronic device participates (e.g., an exploration that includes collecting data (e.g., health-related data) from multiple users (e.g., users of the electronic device); an exploration that includes presenting a set of data collection tasks to multiple users (e.g., users of the electronic device); a heart health study; a reproductive health study; a dietary study) in which the user of the electronic device participates (e.g., a study different from the first study).
[0239] In some embodiments, displaying a task view includes: based on determining that a first set of permissions has been granted (e.g., data access permissions (e.g., sensor data; demographic data (e.g., biological data, historical data, medical data); call data; messaging data; activities (e.g., physical / exercise activities))), the electronic device displays a third task (e.g., 608d) (e.g., a task different from the first task and the second task; a task associated with one or more data types among the data types to which access permissions have been granted) via the display device; based on determining that a second set of permissions has been granted (e.g., a permission different from the first set of permissions; a set of permissions that does not include permission to access at least one of the data types included in the first set of permissions; a set of permissions that includes permission to access at least one data type not included in the first set of permissions) (e.g., the first set of permissions is not granted), the electronic device abandons displaying the third task. In some embodiments, based on determining that the second set of permissions has been granted, a fourth task (e.g., a task different from the first task, the second task, and the third task) is displayed via the display device. Displaying different sets of tasks based on different sets of permissions that have been granted without requiring further user input reduces clutter on the user interface with tasks corresponding to ungranted permissions, and improves device security by not presenting tasks for which the user has not provided the necessary permissions. Reducing clutter on the user interface enhances device operability and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends device battery life by enabling the user to use the device more quickly and efficiently.
[0240] In some embodiments, the task view includes an indication (e.g., 610a; 610b) of a level of participation (e.g., graphical indication, alphanumeric indication) (e.g., quantified; measured (e.g., total amount of time participated (e.g., participation in data contributed), total number of tasks performed; total number of questions answered)) of a user associated with the electronic device in multiple studies, the multiple studies including at least a first study and a second study.
[0241] In some embodiments, the task view affordance representation includes (e.g., as part of the affordance representation, displayed adjacent to the affordance representation) indications (e.g., numerical indications, dynamic numbering) of available tasks (e.g., 606a1) (e.g., tasks displayed in the task view; tasks that are active (e.g., still completeable) but not yet completed). Including indications of available tasks provides the user with visual feedback about the task status of multiple studies. Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), and in addition, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0242] In some embodiments, the task view includes a fourth task (e.g., 608a) (e.g., a task different from the first, second, and third tasks), which does not correspond to a specific study (e.g., does not correspond to any specific study; the fourth task is not initiated or generated by a specific study; the fourth task is generated by a research application used to manage the research).
[0243] In some embodiments, tasks in a task view are displayed in order (e.g., vertically displayed, with earlier tasks in the order displayed at the top; horizontally displayed, with earlier tasks in the order displayed on the left) and based on a determination that the remaining time for completing a first task (e.g., "6 days remaining" of 608b) (e.g., the time a task remains active for completion; the time after which the task may no longer be completed and is no longer displayed as active in the task view (or not displayed at all)) is less than the remaining time for completing a second task (e.g., "7 days remaining" of 608b), the first task is displayed in order before the second task; and based on a determination that the remaining time for completing the first task is greater than the remaining time for completing the second task, the first task is displayed in order after the second task.
[0244] In some embodiments, the task view includes a fifth task (e.g., 624a), and in some embodiments, the fifth task is a completed task (e.g., a task that is no longer active; a task that corresponds to a set of steps that has been completed). In some embodiments, the fifth task (and other completed tasks) are displayed after active tasks (e.g., tasks displayed in the task view; tasks that are active (e.g., still completable) but not yet completed), if any, in the order in which the tasks are displayed in the task view. For multiple studies, displaying completed tasks in the task view provides users with improved visual feedback about tasks that have been completed and therefore no longer need to be completed. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0245] In some embodiments, the task view includes a sixth task (e.g., 608f). In some embodiments, the electronic device detects a third input corresponding to the sixth task via one or more input devices; and in response to detecting the third input, initiates a process for enrolling the user of the electronic device in a third study (e.g., 632a) (e.g., a study associated with one or more studies that the user of the electronic device is currently enrolled in or has previously enrolled in; a study that is a sub-study of the study that the user is currently enrolled in). In some embodiments, initiating the process for enrolling the user of the electronic device in the third study includes displaying a user interface for enrolling the user of the electronic device in the third study (e.g., a user interface including one or more questions that can be answered in order to complete the first task). In some embodiments, initiating the process for enrolling the user of the electronic device in the third study includes completing the participation in response to the third input.
[0246] While displaying the first user interface, the electronic device detects ( 704 ) a first input (eg, selection of 606 a ) via one or more input devices (eg, a tap input; a mouse click).
[0247] In response to detecting a first input and based on determining that the first input corresponds to a selection of a task view enable representation (e.g., 606a), the electronic device displays (706) a task view (e.g., 604a) via a display device. Displaying the task view includes displaying (708) a first task (e.g., 608b) corresponding to a first study (e.g., 630b) (e.g., a data collection task; a set of discrete steps to be taken (e.g., user input) that generate data and / or grant access to data (e.g., health-related data (e.g., exercise data; dietary-related data)), and (in some embodiments, the task (e.g., a representation of the task) when selected, initiates the collection of data related to an active research study that initiated (e.g., generated) the task and / or provides access to the data) displaying (710) a second task (e.g., 608d) corresponding to a second study (e.g., 630a) ) (e.g., a task different from the first task). Simultaneously displaying a first task and a second task from different studies based on selection of a single affordance reduces the number of inputs required to identify tasks for multiple different studies, and also provides improved feedback regarding which tasks are active for multiple studies. Reducing the number of inputs required to perform an operation enhances the operability of the device, and providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0248] In some embodiments, the first task is an optional object (e.g., an enabling representation), and the second task is an optional object. In some embodiments, the electronic device detects a second input via one or more input devices (e.g., 612). In some embodiments, in response to detecting the second input, the electronic device: initiates a process for completing the first task based on determining that the second input corresponds to the first task. In some embodiments, initiating a process for completing the first task includes displaying a user interface for completing the first task (e.g., a user interface including one or more questions that can be answered in order to complete the first task). In some embodiments, initiating a process for completing the first task includes completing the first task in response to the second input (e.g., granting access permission and / or transmitting data required to complete the first task). In some embodiments, based on determining that the second input corresponds to the second task, the electronic device initiates a process for completing the second task (e.g., without initiating a process for completing the first task).
[0249] In some embodiments, the electronic device includes one or more sensors (e.g., physiological sensors (e.g., heart rate sensors; heart rhythm sensors); motion sensors; gyroscopes). In some embodiments, before detecting the first input, the electronic device detects a sensor event (e.g., a pattern of sensor data) via one or more sensors; in response to detecting the sensor event and based on determining that the sensor event satisfies a set of task generation criteria (e.g., the pattern of sensor data indicates an event or activity (e.g., a health-related activity, such as a high heart rate, an irregular heart rhythm, a fall experienced by the user)), the electronic device generates a first task (e.g., task 608c) (e.g., creates the first task and makes the first task active).
[0250] In some embodiments, the first user interface includes a study view affordance (e.g., 606b) associated with multiple different studies. In some embodiments, in response to detecting a first input and based on determining that the first input corresponds to a selection of a study view affordance, the electronic device displays a study view (e.g., 604b) via a display device, the study view including simultaneously displaying: a graphical representation of a first study (e.g., 630a) (e.g., a graphical and / or textual indication of the first study (e.g., including an indication that the study is currently active and / or attended); an affordance corresponding to the first study, which, when selected, results in the display of additional information about the first study); and a graphical representation of a second study (e.g., 630b). In some embodiments, the study view further includes a third study (e.g., a study available for participation) in which the user of the electronic device is not participating. Simultaneously displaying representations of multiple studies in which a user is participating based on selection of a single affordance reduces the number of inputs required to access representations of different studies and also provides improved feedback about the studies in which the user is participating. Reducing the number of inputs required to perform an operation enhances the operability of the device, and providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0251] In some embodiments, the study view includes a graphical representation of a third study (e.g., 632b) in which the user of the electronic device is not participating (e.g., an ongoing study, an active study that can be participated in without meeting the eligibility criteria), wherein displaying the graphical representation of the third study includes: based on determining that a set of one or more eligibility criteria are met, displaying an indication (e.g., a graphic and / or text indication) in the graphical representation of the third study that the user of the electronic device is not eligible to participate in the third study (e.g., a "not eligible" indication of 632b). In some embodiments, the user of the electronic device cannot participate in the study that includes the eligibility indication. Displaying an indication that the device is not eligible to participate in the study based on the eligibility criteria provides improved feedback on the availability status of the study. Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the device / interacting with the device). In addition, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0252] In some embodiments, displaying the graphical representation of the third study includes: based on determining that one or more of the set of disqualification criteria are not met (in some embodiments, when a set of eligibility criteria are met, none of the disqualification criteria are met), displaying (e.g., in the graphical representation of the third study) an indication that the user of the device is eligible to participate in the third study (e.g., and the third study is currently active). Displaying an indication that the device is eligible to participate in the study based on the disqualification criteria provides improved feedback about the availability status of the study. Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), and in addition, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0253] In some embodiments, the study view includes a graphical representation of a fourth study (e.g., including information about the fourth study; including an affordance corresponding to the fourth study, which affordance, when selected, provides additional information about the fourth study), the fourth study being an inactive study (e.g., a completed study, a past study, a study no longer available for participation). Displaying the graphical representation of the inactive study provides the user with improved visual feedback about the inactive state of the inactive study. Providing the user with improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0254] In some embodiments, displaying the graphical representation of the fourth study includes: based on determining that the user of the electronic device has participated in the fourth study, displaying (e.g., in the graphical representation of the fourth study) an indication (e.g., a graphic or text indication) that the user of the electronic device has participated in the fourth study; and based on determining that the user of the electronic device has not participated in the fourth study, displaying (e.g., in the graphical representation of the fourth study) an indication that the user of the electronic device has not participated in the fourth study. Displaying an indication of user participation for an inactive study provides improved feedback about the user's participation status for the inactive study. Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), and in addition, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0255] In some embodiments, displaying the graphical representation of the fourth study includes: based on determining that the data associated with the fourth study has been used in the first data usage instance (e.g., used by another study, research paper, or article), displaying (e.g., in the graphical representation of the fourth study) an indication of the first data usage instance (e.g., an indication of the study, research paper, or article that used the data from the fourth study); and based on determining that the data associated with the fourth study has been used in the second data usage instance (e.g., a usage instance that occurred after the first usage instance), displaying (e.g., in the graphical representation of the fourth study) an indication of the second data usage instance. In some embodiments, information related to past studies is continuously updated over time, including information related to continued use of data from past studies even after the studies have been completed. Displaying indications of data usage instances for past studies provides users with feedback on how data from the studies are used and reduces the amount of user input required to access such usage data. Providing improved feedback and reducing the number of inputs required to perform functions enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0256] In some embodiments, the graphical representations of studies in the study view are displayed in order (e.g., Fig. 6E and 6FIn some embodiments, graphical representations of inactive studies (e.g., completed studies, past studies, studies no longer available for participation) are displayed in order after graphical representations of participated studies (e.g., studies that are active and participated in by the user of the electronic device) and available studies (e.g., ongoing studies, active studies that can be participated in without meeting the ineligibility criteria); and graphical representations of available studies are displayed in order after graphical representations of participated studies.
[0257] In some embodiments, the graphical representation of the first study includes an optional object (e.g., 630b) (e.g., an affordance). In some embodiments, the electronic device detects a fourth input (e.g., 638) via one or more input devices, the fourth input corresponding to the optional object included in the graphical representation of the first study; in response to detecting the fourth input, the electronic device displays a detailed view of the first study (e.g., 642) via a display device (e.g., as a separate user interface or as additional information in the study view), the detailed view including an indication of data (e.g., 644) (e.g., demographic data (e.g., biological data, historical data, medical data); call data; messaging data; activity (e.g., physical / exercise activity)) that is being provided to the first study (e.g., shared, transmitted to a recipient associated with the first study (e.g., the creator / manager of the study)). Displaying an indication of the data of the device being shared with the study (e.g., transmitted to the study) provides feedback to the user about the sharing of the data. Providing improved visual feedback about data sharing improves device security and enhances device operability, and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends device battery life by enabling the user to use the device more quickly and efficiently.
[0258] In some embodiments, the detailed view of the first study includes an exit-enabled representation (e.g., 648). In some embodiments, the electronic device detects a fifth input (e.g., 650) via one or more input devices, which corresponds to the selection of the exit-enabled representation; in response to the fifth user input, the electronic device stops including the first task (e.g., 608b) in the task view (e.g., 604a) (e.g., all currently active tasks associated with the first study are deleted from the task view and any further tasks in the first study are stopped from being included in the task view). In some embodiments, in response to the fifth user input, the first study is designated as a completed study and is displayed in the order of the studies in the study view at a position corresponding to the completed study (and no longer displayed at a position corresponding to the active study). In some embodiments, in response to the fifth user input, the electronic device stops sharing data with the first study. Removing the task of exiting the study reduces the clutter of the user interface caused by the task corresponding to exiting the study, and improves the security of the device by not presenting the task of exiting the study. Reducing user interface clutter enhances device operability and makes the user-device interface more efficient (e.g., by helping users provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends device battery life by enabling users to use the device more quickly and efficiently.
[0259] In some embodiments, the detailed view of the first study includes a first option affordance (e.g., 646a) that, when selected, results in display of additional options regarding the first study. In some embodiments, the additional information is selected from the group consisting of: a consent form for the first study, a privacy policy for the first study, a set of frequently asked questions about the first study, and a set of options for obtaining help for the first study.
[0260] In some embodiments, the detailed view of the first study includes a first communication enable indication (e.g., 656d) that, when selected, initiates communication (e.g., a phone call, a messaging session, an email) with an external electronic device (e.g., a device associated with a service center or a contact used to assist in the first study).
[0261] In some embodiments, the detailed view of the first study includes one or more task indications (e.g., 642a; 642b) associated with the first study (e.g., all tasks (e.g., tasks displayed in the task view; indications of tasks that are active (e.g., still completeable) but not yet completed). Displaying the tasks associated with the study in the detailed view of the study provides improved feedback about which tasks are active for the study. Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), and additionally, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0262] In some embodiments, the first user interface includes a data view affordance (e.g., 606c). In some embodiments, in response to detecting a first input and based on determining that the first input corresponds to a selection of a data view affordance, the electronic device displays a data view (e.g., 604c) via a display device, the data view including simultaneously displaying: an indication of a first type of data (e.g., 662) (e.g., sensor data; demographic data (e.g., biological data, historical data, medical data); call data; messaging data; activity (e.g., physical / exercise activity)) accessible to one or more studies (including the first study) in which the user of the electronic device has participated; and an indication (e.g., 662b) (e.g., a graphical and / or alphanumeric indication; an indication of the number of accessible studies) associated with one or more studies (including the first study) in which the user of the electronic device has participated that have access to the first type of data. Simultaneously displaying an indication of a data type and an indication of which studies have access to the data based on the selection of a single affordance reduces the number of inputs required to identify studies that have access to the data type and also provides improved feedback about study access rights. Reducing the number of inputs required to perform an operation enhances the operability of the device, and providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0263] In some embodiments, the indication of the first type of data is an indication of demographic data (e.g., 662), and wherein the indication of the first type of data is a selectable object (e.g., an affordance) that, when selected, results in display of demographic data (e.g., 668) associated with a user of the electronic device (e.g., data related to a comparison of the user to a larger group (e.g., data regarding age, gender, race, marital status, occupation, region of residence)). In some embodiments, the indication of the first type of data, when selected, results in display of medical history data for the user of the electronic device; in some embodiments, the data displayed in response to selection of the indication of the first type of data is organized / sorted based on the type of data.
[0264] In some embodiments, one or more studies in which a user of the electronic device has participated that can access data of the first type are displayed as a selectable object (e.g., 662b) (e.g., an enable representation) that, when selected, results in display of additional information (e.g., 672) associated with the one or more studies that can access data of the first type (e.g., a list of the accessible one or more studies).
[0265] In some embodiments, the indication of the first type of data is an indication of sensors (e.g., heart rate sensor; heart rhythm sensor; motion sensor; gyroscope) and usage data (e.g., 664) (usage of the electronic device (e.g., call data; messaging data; email data)), and wherein the indication of the first type of data is a selectable object (e.g., an affordance) that, when selected, causes display of a sensor and usage data view (e.g., 676). In some embodiments, the sensor and usage data view includes a list of one or more types of sensor and usage data accessible to the study.
[0266] In some embodiments, the sensor and usage data view includes a data collection affordance (e.g., 678) that, when selected, modifies the current state of sensor data collection (e.g., disabled if active, enabled if inactive) (in some embodiments, the data collection affordance, when selected, modifies the state of sensor data collection for multiple sensors). Modifying the state of sensor collection based on the selection of a single affordance can reduce the number of inputs required to modify the state of data collection across multiple sensor types. Reducing the number of inputs required to perform an operation enhances the operability of the device, and providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate inputs and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently. When the modification includes disabling the collection of sensor data, battery life can be significantly improved.
[0267] In some embodiments, the sensor and usage data view includes an export data enable indication (e.g., 682) that, when selected, causes the collected sensor and usage data to be exported (e.g., shared; transmitted; provided) to one or more studies that have access to (e.g., have been granted access to) the sensor and usage data.
[0268] In some embodiments, the sensor and usage data view includes a sensor and usage data affordance (e.g., 680e) of a first type (e.g., a first type of sensor or a first type of usage), which, when selected, results in display of a first type of sensor and usage data view (e.g., 690), which includes information about the first type of sensor and usage data, the first type of sensor and usage data including: examples of data of the first type of sensor and usage data accessible (e.g., collected and accessible) from one or more studies (e.g., 692) in which a user of the electronic device has participated that have access to data of the first type of sensor and usage data; and examples of data of the first type of sensor and usage data accessible from one or more studies in which a user of the electronic device has not participated that have access to data of the first type of sensor and usage data.
[0269] In some embodiments, a first type of sensor and usage data view includes one or more enablement representations (e.g., 692al692b) associated with one or more studies that have access to data of the first type of sensor and usage data, the one or more enablement representations including a first enablement representation associated with a fifth study that has access to data of the first type of sensor and usage data, wherein the first enablement representation associated with the fifth study, when selected, initiates a process for disabling the fifth study's access to the first type of sensor and usage data (e.g., without disabling access by any other study that currently has access to the first type of sensor and usage data).
[0270] It should be noted that the process described above with respect to method 700 (eg Figure 7 ) also applies in a similar manner to the methods described below. For example, method 900 optionally includes one or more of the characteristics of the various methods described above with reference to method 700. For example, method 700 can be used to interact with and / or manage tasks generated by a survey study participated in via method 900. For another example, method 700 can be used to interact with and / or manage a hearing test task performed according to method 1100. For the sake of brevity, these details are not repeated below.
[0271] FIG. 8A to FIG. 8U Exemplary user interfaces for participating in a research study (e.g., a study managed via a research study management application) using device 600 are shown. The user interfaces in these figures are used to illustrate the following description of the Fig. 9 The process of the process.
[0272] exist Fig. 8A , the device 600 displays a research view 604b, which refers to Fig. 6E 632a and 632b in the available studies section 632. The device 600 detects a touch input 802 on the touch-sensitive display 602, which is a tap gesture corresponding to the available study 632a (the Women's Dietary Study). In response to the touch input 802, the device 600 displays a study details interface 804, such as Figure 8B As seen in.
[0273] exist Figure 8B, a study details interface 804 for a female dietary study includes an information section 806 that includes information about the study, including the purpose of the study and expectations of tasks associated with participating in the study. Study details interface 804 also includes a join study enable indication 808a that is grayed out, indicating that the participation requirements are not met. Therefore, when the join study enable indication 808a is selected, the process for joining the study is not initiated. Figure 8B , device 600 displays indication 808b ("Update software to participate") near enable indication 808a, which provides an indication of one or more questions that prevent participation in the study. As indicated by indication 808b, the female dietary study requires updating the software of device 600 in order to participate. In some embodiments, the indication of one or more questions that prevent participation in the study is displayed in response to selection of the participation study enable indication 808a, rather than being initially displayed. In some embodiments, research interface 804 includes an option (e.g., an enable indication) for sharing the survey study with external users. In some embodiments, the option to share the study is available on device 600 even if device 600 (e.g., a user of device 600) is not eligible to participate in the study.
[0274] exist Figure 8C , after the software (e.g., operating system software) of device 600 has been updated, device 600 displays study details interface 804. Study details interface 804 now includes ungrayed-out Join Study affordance 808c. Study details interface 804 does not include indication 808b because the software update issue has been resolved.
[0275] exist Figure 8C , device 600 detects touch input 810 on touch-sensitive display 602 that is a tap gesture corresponding to participation in a study affordance 808b, and in response, initiates a process for participation in a female dietary study and displays a survey overview interface 812, as shown in FIG. Fig.8D As seen in.
[0276] exist Fig.8D608a). In some embodiments, survey profile interface 812 includes fields 814a-814g that are pre-populated with information about the user of device 600 that is available to device 600 (e.g., stored on device 600). In some embodiments, one or more fields are not pre-populated, but are completed via further user input (e.g., input provided via a soft keyboard). In some embodiments, the information is pre-populated based on information provided to the survey study management application via completion of a profile questionnaire task (e.g., task 608a). In some embodiments, survey profile interface 812 is not shown as part of the process for participating, and information about the user is automatically provided to the study (e.g., automatically provided via prior authorization provided during participation in a prior study).
[0277] exist Fig.8D , device 600 detects touch input 816 on touch-sensitive display 602 that is a tap gesture corresponding to completion affordance 818, and in response, displays Fig. 8E interface.
[0278] exist Fig. 8E , device 600 displays notification 820 overlaid on survey overview interface 812. Notification 820 provides an indication of one or more questions that prevent participation in the study. As indicated by notification 820, the female dietary study requires participants to be over 21 years old. Notification 820a includes an enablement 820a for dismissing the notification and an enablement 820b that initiates a process for verifying the user's age when selected. In some embodiments, unless the user's age is verified to be over 21 years old, the participation process will not progress beyond survey overview interface 812.
[0279] exist Figure 8F , birth date field 814c has been edited to indicate a birth date of June 1, 1994 (e.g., device 600 receives input of a revised birth date via a soft keyboard), making the user's age over 21. Device 600 detects touch input 822 on touch-sensitive display 602 as a second tap gesture corresponding to completion affordance 818, and in response to the input and determining that the user's entered birth date indicates an age over 21, displays Figure 8G Request interface 824.
[0280] exist Figure 8G, device 600 displays requirements interface 824 including an indication 826 of requirements for participating in a female dietary study. In some embodiments, these requirements may include one or more of software compatibility requirements, hardware compatibility requirements, demographic requirements, health history requirements, data access requirements, and consent requirements. Device 600 detects touch input 828 on touch-sensitive display 602, which is a tap gesture corresponding to next affordance 830, and in response, displays study partner interface 832.
[0281] exist Figure 8H 8, device 600 displays a research partner interface 832 that includes a section 834 that provides information about one or more research partners associated with the research. In some embodiments, the research partners receive access to data exported by device 600 as part of participating in the research study. Device 600 detects touch input 836 on touch-sensitive display 602 that is a tap gesture corresponding to continue affordance 838, and in response, displays Figure 8I The consent information interface 840 is displayed.
[0282] exist Figure 8I , device 600 displays a consent information interface 840 that includes a section 842 that provides information related to participating in the research study. In some embodiments, such information may include information about tasks associated with the study, the duration of the study, data collected as part of the study, and information about how to exit the study. Device 600 detects touch input 844 on touch-sensitive display 602 that is a tap gesture corresponding to continue enable indication 846, and in response, displays Figure 8J Terms and conditions interface 848.
[0283] exist Figure 8I , device 600 displays terms and conditions interface 848, which includes section 850 that provides information about the terms and conditions of participating in the research study. Device 600 detects touch input 852 on touch-sensitive display 602, which is a tap gesture corresponding to next affordance 854, and in response, displays Figure 8K The consent signature interface 856.
[0284] exist Figure 8K, the device 600 displays a consent signature interface 856 that includes a signature field 858. In some embodiments, the device 600 detects touch input corresponding to a signature on the touch-sensitive display 602. In some embodiments, the device 600 accepts a digital signature via a soft keyboard. In some embodiments, the device 600 accepts a digital signature in the form of an authenticated token. In some embodiments, the device 600 requires biometric authentication (e.g., fingerprint or facial recognition authentication) to accept the signature. In some embodiments, the participation process will not progress beyond interface 856 unless a valid signature is provided (e.g., the consent signature is a mandatory requirement for participation). The device 600 detects touch input 860 on the touch-sensitive display 602 that is a tap gesture corresponding to a next enable indication 862, and in response, displays Figure 8L Data request interface 864.
[0285] exist Figure 8L , the device 600 displays a data request interface 864 that presents information about the type of data to which the study is requesting access. In some embodiments, one or more of these data requests are mandatory (e.g., if access to mandatory data is not granted, participation in the study is unavailable). Figure 8L As seen in FIG. 8 , the Women's Dietary Study is requesting access to three types of data: demographic data 865a, health data 865b, and sensor data 865c. In some embodiments, the enrollment process does not continue until each data request has been reviewed and either granted or denied. Figure 8L , data request interface 864 includes review enable indications 865a1, 865b1, and 865c1, which correspond to demographic data 865a, health data 865b, and sensor and usage data 865c, respectively. Device 600 detects touch input 866 on touch-sensitive display 602, which is a tap gesture of review enable indication 865a1 corresponding to demographic data 865a, and in response, displays Figure 8M Demographics request interface 867 .
[0286] exist Figure 8M, device 600 displays a demographic request interface 867 that includes an information section 868 that provides information about the demographic data request. In some embodiments, the information section includes information about which specific demographic data is requested for the study and / or information about how the data will be used. Demographic request interface 867 also includes: a share enable indication 869 that, when selected, authorizes the request for demographic data; and a do not share enable indication 870 that, when selected, denies the request for demographic data. In some embodiments, the requested demographic data is mandatory data required to complete participation. In such embodiments, in response to detecting selection of the do not share enable indication 870, device 600 may provide an indication that the requested data is mandatory and required for participation (e.g., similar to Fig. 8E Notice 820). Figure 8M , device 600 detects touch input 871 on touch-sensitive display 602 that is a tap gesture corresponding to sharing affordance 869, and in response, redisplays data request interface 864, as shown in FIG. Figure 8N As seen in.
[0287] exist Figure 8N , the data request interface 864 has been updated to indicate that the request for demographic information 865a has been reviewed by replacing the review enable indication 865a1 with a reviewed indication 865a2. In some embodiments, the indication 865a2 includes an indication of whether the request is approved or denied. The device 600 detects a touch input 872 on the touch-sensitive display 602 that is a tap gesture corresponding to the review enable indication 865c1 of the sensor and usage data 865c, and in response, displays Fig.8O Sensor and usage request interface 873.
[0288] exist Fig.8O, the device 600 displays a sensor and use request interface 873, the format of which is different from the format of the data request interface 864. It is worth noting that the sensor and use data are mandatory data for the female dietary study of the present embodiment. Although the sensor and use request interface 873 also includes an information section 874 that provides information about the sensor and use data request, the sensor and use request interface 873 also includes a privacy policy enable representation 875, which, when selected, causes the device 600 to display detailed information about the research privacy handling policy. In some embodiments, the privacy policy disclosure persists throughout the study, so that the policy is only displayed once during the participation process and will not be redisplayed during the subsequent participation process. The sensor and use request interface 873 also includes: an audit enable representation 878, which is used to continue to review the sensor and use data request; and a non-participation enable representation 877, which, when selected, rejects the sensor and use data request and exits the participation process (for example, because the requested data is mandatory data). Device 600 detects touch input 878 on touch-sensitive display 602 that is a tap gesture corresponding to review affordance 878 and, in response, displays Figure 8P Request details interface 879a.
[0289] exist Figure 8P , the device 600 displays a request details interface 879a that provides additional details 880a about the sensor and usage data request. In some embodiments, the details include details about which sensors and which usage data are requested. In some embodiments, the details include details about the frequency of requesting data and the potential impact on the performance of the device 600 (e.g., battery life). The request details interface 879a also includes a next enable indication 881 and a don't participate enable indication 882, which, when selected, performs a similar function to the don't participate enable indication 877. The device 600 detects a touch input 881 on the touch-sensitive display 602, which is a tap gesture corresponding to the next enable indication 881, and in response, displays a Figure 8Q Request details interface 879b.
[0290] exist Figure 8Q In FIG. 6 , device 600 displays a request details interface 879b, which is a second interface for details of the sensor and usage request. Request details interface 879b includes additional details 880b, which include details of which usage data is requested. Figure 8Q, the details indicate that message usage (e.g., text message usage) data is collected only from message usage on device 600 (e.g., not collected for other devices associated with the user of device 600) and what is collected (e.g., the number of messages) and what is not collected (e.g., the context of the messages). Request details interface 879b includes an enable indication 883a, which, when selected, causes device 600 to display an example of the collected message usage data. Request details interface 879b also includes an allow enable indication 883b and a do not allow enable indication 883c. Because sensor and message data are mandatory for the female dietary study, selecting enable indication 883c will deny the request and forgo participation in the study. In some embodiments, selection of do not allow enable indication 883c results in Fig. 8E Notification 820 is displayed similar to notification.
[0291] exist Figure 8Q , while request details interface 879b is displayed, device 600 detects touch inputs 884a and 884b on touch-sensitive display 602 and, in response, performs operations as described below.
[0292] exist Figure 8R , in response to input 884a on exemplary affordance 883a, device 600 displays exemplary interface 885, which includes exemplary data 885a for using the message usage data collected by the female dietary study. Device 600 detects touch input 886 on touch-sensitive display 602, which is a tap gesture corresponding to return affordance 887, and in response, redisplays request details interface 879b.
[0293] exist Figure 8S In response to input 884b on the allow enable indication 883b of the request details interface 879b, the device 600 displays: a final authorization review interface 888, which includes details 888a of which data access authorizations have been provided and a next enable indication 888b. In some embodiments, the details 888a also include information about which access has been requested but not granted. The device 600 detects a touch input 889 on the touch-sensitive display 602, which is a tap gesture corresponding to the next enable indication 888b, and in response, displays a participation confirmation interface 890, such as Figure 8T As seen in.
[0294] exist Figure 8T, device 600 displays participation confirmation interface 890 indicating successful participation in the female dietary study. Device 600 detects touch input 891 on touch-sensitive display 602, which is a tap gesture corresponding to completion affordance 892, and in response, redisplays study view 604b, as shown in FIG. Figure 8U As seen in.
[0295] exist Figure 8U , the Women's Dietary Study is no longer displayed in the Available Studies section 632, but is instead displayed in the Current Studies section 630 of the Studies view 604b, indicating that it is now enrolled.
[0296] Fig. 9 900 is a flow chart illustrating a method for participating in a research study using an electronic device according to some embodiments. Method 900 is performed at a device (e.g., 100, 300, 500, 600) having a display device (e.g., 602) and one or more input devices (e.g., 602). Some operations in method 900 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.
[0297] As described below, method 900 provides an intuitive way to participate in a research study. The method reduces the cognitive burden on users when participating in a research study, thereby creating a more effective human-computer interface. For battery-powered computing devices, enabling users to interact with research studies faster and more efficiently saves power and increases the time between battery charges.
[0298] The electronic device displays (902) via a display device a survey user interface (e.g., 804) associated with a first survey study (e.g., an interface generated by a survey study application; an interface that displays information associated with the first survey study (e.g., one or more requirements for participating in the first survey study)) (e.g., an exploration that includes collecting data (e.g., health-related data) from multiple users (e.g., users of the electronic device); an exploration that includes presenting a set of data collection tasks to multiple users (e.g., users of the electronic device); a heart health study; a reproductive health study; a dietary study; an exploration that has a set of participation criteria that must be met to participate in the first survey study).
[0299] In some embodiments, displaying a survey study user interface includes: displaying first information about the survey study (e.g., 806) in the survey study user interface (e.g., details about the purpose of the study, the creator of the study, and / or the requirements of the study); and based on determining that a set of participation blocking criteria are not met (e.g., criteria that prohibit users with one or more incompatible characteristics (e.g., age, gender) from participating based on the requirements of the survey study), displaying a participation enablement indication (e.g., 808b) in the survey study user interface via a display device (e.g., an enablement indication that, when selected, initiates a process for participating in the survey study), wherein the set of one or more inputs includes a first input corresponding to the participation enablement indication (e.g., 810); and based on determining that the set of participation blocking criteria are met, abandoning displaying the participation enablement indication in the survey study user interface (e.g., abandoning displaying any participation enablement indication; displaying an inactive version of the participation enablement indication (e.g., a non-selectable version; an selectable version that performs a function other than initiating a process for participating in the survey study); abandoning displaying the participation enablement indication until the participation blocking criteria are no longer met). Selectively displaying the participation enablement indication based on the set of criteria provides improved visual feedback about the device's eligibility to participate in the study. Providing improved feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0300] In some embodiments, the survey user interface includes a share survey affordance that, when selected, initiates a process for sharing the survey with a user of the external device (e.g., notifying the user of the external device about the availability of the survey). In some embodiments, the survey user interface includes a share survey affordance even if the user of the electronic device is not eligible (e.g., currently eligible) to participate in the survey.
[0301] While displaying the survey study interface, the electronic device receives (904) via one or more input devices a set of one or more inputs (e.g., 816), the set of one or more inputs comprising interactions with the survey study user interface associated with the first survey study (e.g., initiating a request to participate; a request to display further information about participation requirements).
[0302] In some embodiments, the set of one or more inputs includes a first input (e.g., 810) corresponding to a request to initiate a process for participating. In some embodiments, in response to receiving the set of one or more inputs and based on determining that the set of participation question criteria are not met, the electronic device initiates the process for participating.
[0303] In some embodiments, during a process for participating in a research study, an electronic device displays a signature user interface (e.g., 856) via a display device that is configured to receive a consent signature (e.g., 858) from a user of the electronic device (e.g., configured to receive one or more touch gestures corresponding to a signature of the user of the electronic device (e.g., consent to one or more aspects of the research study (e.g., consent to sharing data, consent to granting access to data shared with the research study))).
[0304] In some embodiments, during a process for participating in a research study and based on determining that a set of privacy disclosure criteria are met (in some embodiments, when a privacy disclosure user interface was not previously displayed during the participation process, the privacy disclosure criteria are met (e.g., for the current research study; or any research study), the electronic device displays a privacy disclosure user interface via a display device (e.g., displayed based on selection 875), which privacy disclosure user interface includes information about the degree of privacy maintained for data accessed (e.g., shared) with the research study. If the user participates in the study, displaying information about the degree of data privacy provides the user with improved visual feedback about the data privacy policy of the research study and about data handling. Providing improved visual feedback to the user enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0305] In some embodiments, when the privacy disclosure user interface was not previously displayed during the process for participating in the survey, the set of privacy disclosure standards is met. In some embodiments, during the process for participating in the survey and based on determining that a set of privacy disclosure standards are not met, the electronic device abandons displaying the privacy disclosure user interface. In some embodiments, if the data privacy disclosure user interface was not previously shown, the data privacy disclosure user interface is only shown during participation. When the standards are not met (e.g., when the user interface has been previously displayed on the device), abandoning the display of the privacy user interface reduces the confusion of the displayed information on the user interface. Reducing the confusion of the user interface enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the device / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0306] In some embodiments, during a process for participating in a survey study, an electronic device displays a data access request user interface (e.g., 864) via a display device, the data access request user interface including: displaying a first request (e.g., 865a) to access a first type of data (e.g., an affordance associated with the first request) (e.g., demographic data, medical information / historical data, sensor data (e.g., physiological sensors (e.g., heart rate sensors; heart rhythm sensors); motion sensors; gyroscopes), device usage data (call data; messaging data; activities (e.g., physical / exercise activities)). In some embodiments, during a process for participating in a survey study, an electronic device displays a data access request user interface (e.g., 864) via a display device, the data access request user interface including: displaying a first request (e.g., 865a) to access a first type of data (e.g., medical information / historical data, sensor data (e.g., physiological sensors (e.g., heart rate sensors; heart rhythm sensors); motion sensors; gyroscopes), device usage data (call data; messaging data; activities (e.g., physical / exercise activities)). While displaying the first request, the electronic device detects a second input via one or more input devices (e.g., a request to scroll a data access request user interface); and in response to detecting the second input, displays via the display device (e.g., by scrolling the data access request user interface; by stopping displaying the first request) a second request (e.g., 865b) to access a second type of data that is different from the first type (e.g., demographic data, medical information / historical data, sensor data (e.g., heart rate sensor; heart rhythm sensor); motion sensor; gyroscope), device usage data (call data; messaging data; activity (e.g., physical / exercise activity)).
[0307] In some embodiments, while displaying a data access request user interface, the electronic device detects a second set of one or more inputs (e.g., 871) (e.g., including inputs corresponding to the first request or the second request) via one or more input devices. In some embodiments, in response to detecting the second set of one or more inputs, the electronic device: grants access to the first type of data to the research study based on determining that the second set of one or more inputs corresponds to approval of the first request to access the first type of data (e.g., input corresponding to 869); (in some embodiments, does not grant access to the second type of data to the research study) based on determining that the second set of one or more inputs corresponds to a rejection of the first request to access the first type of data (e.g., input corresponding to 870), abandons granting (e.g., rejecting) access to the first type of data to the research study. In some embodiments, the research study's access to the second type of data is not rejected. In some embodiments, in response to the rejection of the first request to access the first type of data and based on determining that the first type of data is mandatory data (e.g., access to the data must be granted in order to participate), displays an indication (e.g., an alert) that access to the first type of data is required in order to participate in the research study via a display device. In some embodiments, based on determining that the second set of one or more inputs corresponds to approval of a second request for access to the second type of data, the electronic device grants the investigation into access to the second type of data; and based on determining that the second set of one or more inputs corresponds to a denial of the second request for access to the second type of data, the electronic device forgoes granting (e.g., denies) the investigation into access to the second type of data.
[0308] In some embodiments, the first type of data is sensor data (e.g., data from: a heart rate sensor; a heart rhythm sensor; a motion sensor; and / or a gyroscope) or usage data (e.g., 865c) (e.g., data from usage of an electronic device (e.g., call data; messaging data; email data)), and the first type of data is mandatory data for participating in a research study or non-mandatory data that is not required for participating in the research study.
[0309] In response to receiving a set of one or more inputs (908), the electronic device: based on determining that a set of participation problem criteria are met (e.g., criteria indicating issues, difficulties, or problems that prevent successful participation (e.g., until the difficulties are resolved)) (in some embodiments, the set of participation difficulty criteria is based on the set of participation criteria that must be met to participate in the first survey study (e.g., the set of participation difficulty criteria is met when a parameter (e.g., an existing parameter associated with the electronic device or a user of the electronic device), a parameter input by the user) does not meet at least one of the set of participation criteria), displays (910) an indication (e.g., 808b; 820) (e.g., a graphical indication; a textual indication) of a problem (e.g., an issue, difficulty, or problem) that prevents participation in the first survey study; and (in some embodiments, the indication is an optional indication (e.g., an enable indication) that, when selected, initiates a process for resolving the difficulty and / or providing additional information about the difficulty) based on determining that the set of participation problem criteria are not met, abandons (912) displaying an indication of a difficulty that prevents participation in the first survey study. In some embodiments, during a process for participating in a research study, a user associated with the electronic device is participated in a first research study based on determining that the set of participation criteria is met. An indication of a question that prevents participation is displayed based on meeting a set of participation question criteria without further user input, reducing the steps required to identify the question and providing improved visual feedback about the question. Reducing the steps required to perform an action and providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn can reduce power usage and extend the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0310] In some embodiments, the participation question criteria are met when a demographic characteristic (e.g., 814c) of a user of the electronic device (e.g., characteristics related to comparison of the user to a larger population (e.g., data regarding age, gender, race, marital status, occupation, region of residence)) meets a demographic incompatibility criterion (e.g., matches an incompatible characteristic value or fails to match a compatible characteristic value).
[0311] In some embodiments, the participation question criteria are met when software characteristics of the electronic device (e.g., compatible software (e.g., operating system software) version; availability of required applications) meet software incompatibility criteria (e.g., matching incompatible software characteristics or failing to match compatible software characteristics).
[0312] In some embodiments, the participation question criteria are met when the hardware characteristics of the electronic device (e.g., the availability of required hardware (e.g., required sensors; required processors or circuits)) meet hardware incompatibility criteria (e.g., matching incompatible hardware characteristics or failing to match compatible hardware characteristics).
[0313] In some embodiments, the participation question criteria are met when a health information characteristic of a user of the electronic device (e.g., a characteristic related to the user's current or historical health information (e.g., information indicating a health-related event (e.g., a fall, a heart-related event) within some previous time period)) meets a health information incompatibility criteria (e.g., matches an incompatible health information characteristic or fails to match a compatible health information characteristic).
[0314] In some embodiments, forgoing displaying a participation enablement indication in the survey study user interface includes displaying a first enablement indication (e.g., 808a) (e.g., a disqualification information enablement indication; an enablement indication displayed at a location corresponding to (e.g., matching) a location where a participation enablement indication is displayed when the set of participation blocking criteria is not met); and the set of one or more inputs includes a second input corresponding to the first enablement indication.
[0315] In some embodiments, the participation question criteria are met when the electronic device detects an input (e.g., an input corresponding to 883c) corresponding to a denial of a request to access a third type of data that is mandatory for participating in the survey research (e.g., demographic data, medical information / historical data, sensor data (e.g., physiological sensors (e.g., heart rate sensors; heart rhythm sensors); motion sensors; gyroscopes), device usage data (call data; messaging data; activities (e.g., physical / exercise activity)).
[0316] Note that the above description is relative to method 900 (eg, Fig. 9 ) also apply in a similar manner to the methods described below. For example, method 700 optionally includes one or more of the characteristics of the various methods described above with reference to method 900. For example, method 700 can be used to interact with and / or manage tasks generated by a research study participated in via method 900. For another example, method 1100 can be used to interact with and / or manage hearing test tasks of a study participated in via method 900. For the sake of brevity, these details are not repeated below.
[0317] FIG. 10A to FIG. 10XAn exemplary user interface for conducting a hearing test using device 600 is shown. In some embodiments, a hearing test is conducted to collect data for use in a survey study managed by a survey management application. The user interfaces in these figures are used to illustrate the processes described below, which include Fig.11 process.
[0318] exist Fig. 10A In the embodiment, the device 600 displays a task view 604A, which is relative to Fig. 6A The task view 604A includes a task 608d, which is a voice and noise test associated with an annual medical history study. The device 600 detects a touch input 1002a on the touch-sensitive display 602, which is a tap gesture corresponding to the task 608d. In response to the touch input 1002a, the device 600 displays a voice and noise test interface 1004a, such as Fig. 10B As seen in.
[0319] exist Fig. 10B , device 600 displays a speech and noise test interface 1004a, which includes information 1005 about the speech and noise test and an enable indication 1006a for continuing the test and an enable indication 1006b for canceling the test. Device 600 detects touch input 1002b on touch-sensitive display 602, which is a tap gesture corresponding to the continue enable indication 1006b. In response to touch input 1002b, device 600 displays speech and noise test interface 1004b, as shown in FIG. Fig. 10C As seen in.
[0320] exist Fig. 10C , the device 600 displays a speech and noise test interface 1004b, which includes a section 1007a or a set of headphones selected for testing. In some embodiments, when multiple sets of headphones are connected to the device 600, the section 1007a includes multiple options. Interface 1004b also includes an enable indication 1007b, which, when selected, presents an option to select an alternative headset (e.g., a headset that is not a preferred or recommended headset; a headset that is not currently connected to the device 600 but was previously connected to the device 600). The device 600 detects a touch input 1002c on the touch-sensitive display 602, which is a tap gesture corresponding to the continue enable indication 1008, and in response, Fig. 10D The speech and noise test interface 1004c is displayed.
[0321] exist Fig. 10D, device 600 displays a speech and noise test interface 1004c that can be used to adjust the audio volume for the test. Interface 1004c includes an enable indication 1009 that, when selected, plays an audio sample for calibrating the audio output volume for the test. Device 600 detects touch input 1002d on touch-sensitive display 602 that is a tap gesture corresponding to the continuation enable indication 1010, and in response, Fig.10E The speech and noise test interface 1004d is displayed.
[0322] exist Fig.10E , the device 600 displays a voice and noise test interface 1004d, which includes instructions for the user to find a quiet place to test. Interface 1004d includes an ambient noise level indicator 1011, which visually depicts the current ambient noise level relative to the threshold level required to continue the test. Indicator 1011 includes a level indicator 1011a that grows as the ambient noise level increases. Indicator 1011 also includes a ring portion 1011b, which depicts that if the test is to continue, the threshold noise level cannot be exceeded (for example, the level indicator 1011a cannot grow beyond the boundary of the ring portion). Indicator 1011 also includes a fill portion 1011c, which passes through the ring to indicate the remaining time in the ambient noise level check process. When the fill portion extends across the entire ring, the ambient noise level check of interface 1004d is completed. Interface 1004d includes a start enable indication 1012, which is currently in a disabled state because the ambient noise level check is not completed.
[0323] exist Fig.10F In the embodiment, the device 600 is a display interface 1004d, wherein the noise level indicator 1011a reflects that the ambient noise level exceeds the threshold noise level. Fig.10F After exceeding the threshold level, the noise level indicator 1011a changes to Fig.10E In some embodiments, the ambient noise level cannot exceed the threshold level during the entire test period (e.g., if it exceeds the threshold, the test period must be restarted). In some embodiments, if the ambient noise level exceeds the threshold, the test is paused, but once the noise level is below the threshold, the inspection process will automatically resume (e.g., the filling part continues to fill). In some embodiments, the ambient noise level must only be below the threshold by the end of the test period.
[0324] exist Figure 10G In the example, device 600 is Fig.10FInterface 1004d is shown at a later point in time. The ambient noise level has dropped below the threshold, as indicated by the reduced size of noise level indicator 1011a. Filled portion 1011c indicates that more than half of the time required for the ambient noise level check is still left. While the check is ongoing, start indication 1012 remains disabled.
[0325] exist Fig. 10H , the ambient noise level test has been successfully completed, as indicated by indicator 1011 transitioning to state 1011d. Start affordance 1012 is now enabled (e.g., as indicated by no longer being grayed out). Device 600 detects touch input 1002e on touch-sensitive display 602, the touch input being a tap gesture corresponding to start affordance 1012, and in response, Fig.10I , the speech and noise test interface 1004e is displayed. In some embodiments, if the device 600 has not previously performed a hearing test, selection of the start enable representation 1012 initiates a practice test (eg, a test in which no input is used to assess the user's hearing).
[0326] exist Fig.10I , device 600 displays speech and noise test interface 1004e. Interface 1004e includes instructions for the user to listen to a sentence that will be played once when play affordance 1013 is selected. Device 600 detects touch input 1002f on touch-sensitive display 602, which is a tap gesture corresponding to play affordance 1013, and in response, outputs a spoken sentence (e.g., “This is an example sentence”), such as Fig.10J shown.
[0327] exist Fig.10J In the example of FIG. 1004, interface 1004e displays a visual indicator 1014 that provides a graphical representation of the spoken sentence currently being output audibly. Play affordance 1013 is disabled during audio output. After playback is complete, device 600 displays speech and noise test interface 1004f.
[0328] exist Figure 10K, device 600 displays a speech and noise test interface 1004f for receiving input based on spoken sentences, as heard by a user of device 600. Interface 1004f includes instructions for recording what is heard and a record enable indication 1015 for initiating recording via one or more microphones of device 600. In some embodiments, the one or more microphones are microphones of a set of external headphones connected to device 600. Interface 1004f also includes a keyboard enable indication 1016, which, when selected, causes the display of a soft keyboard for entering text based on spoken sentences, as heard by a user of device 600. Device 600 detects touch input 1002g on touch-sensitive display 602, which is a tap gesture corresponding to record enable indication 1015, and in response, starts recording.
[0329] exist Fig.10L , the device 600 displays a speech and noise test interface 1004f having a visual indicator 1017 that provides a graphical indication of the audio input received via one or more microphones. Fig.10L In the example, interface 1004f includes a stop enable indication 1018 for stopping audio recording while recording audio. Device 600 detects touch input 1002h on touch-sensitive display 602, which is a tap gesture corresponding to stop enable indication 1018, and in response, stops recording and displays Figure 10M Speech and noise test interface 1004g.
[0330] exist Figure 10M , device 600 displays a speech and noise test interface 1004g, which includes a section 1019 that displays a speech-to-text indication of the recorded content ("This is an exemplary sentence"). Interface 1004g includes instructions to review the accuracy of the text transcript. Interface 1004g also includes a submission affordance. Device 600 detects touch input 1002i on touch-sensitive display 602, which is a tap gesture corresponding to submission affordance 1020, and in response, submits the sentence "This is an exemplary sentence" as input for determining the user's hearing level.
[0331] exist Fig.10N , device 600 displays speech and noise test interface 1004f after audibly outputting a second spoken sentence ("This is another sentence"). Device 600 detects touch input 1002j on touch-sensitive display 602, which is a tap gesture corresponding to keyboard affordance 1016, and in response, causes display of a soft keyboard, such as Fig.10O As seen in.
[0332] exist Fig.10O , device 600 displays a speech and noise test interface 1004f with a soft keyboard 1021. Soft keyboard 1021 includes a submit affordance 1022. Device 600 detects touch input 1002i on display 602, which is a tap gesture corresponding to the "T" key 1021a, and in response, begins entering text section 1019.
[0333] exist Figure 10P , device 600 displays speech and noise test interface 1004g, which has a sentence “This is another sentence” typed in text section 1019 based on input received via a soft keyboard. Device 600 detects touch input 10021 on touch-sensitive display 602, which is a tap gesture corresponding to submission affordance 1022, and in response, submits the sentence “This is another sentence” as a second input for determining the user's hearing level.
[0334] exist Figure 10Q In some embodiments, the device 600 detects that the current ambient noise level has risen above the threshold noise level when displaying the voice and noise test interface 1004g. In some embodiments, the device 600 continuously monitors the ambient noise level throughout the execution of the hearing test. In some embodiments, the device 600 periodically monitors the ambient noise level during the hearing test (e.g., only during the period of time during the output or input audio). In response to detecting that the ambient noise level has risen above the threshold noise level, the device 600 displays a notification 1023 indicating that the voice and noise hearing test has been interrupted. Notification 1023 includes a cancel enable indication 1023a, which cancels the hearing test when selected. Notification 1023 also includes an enable indication 1023b, which indicates that when selected, the hearing test is restarted. In some embodiments, the hearing test is restarted (e.g., re-initiated) from the beginning. In some embodiments, the hearing test is restarted at the interruption point (e.g., the test is resumed). In some embodiments, notification 1023 includes an indication of the ambient noise level. In some embodiments, after successfully completing the speech and noise test, the device 600 displays the results of the test. In some embodiments, in response to detecting that the headset used to administer the test has been disconnected, a notification 1023 is displayed.
[0335] exist Figure 10R , the device 600 displays the tone and volume test interface 1024a. In some embodiments, the tone and volume test is used to test the user's hearing characteristics different from those tested by the speech and noise test. In some embodiments, in response to Figure 6CThe device 600 detects a touch input 1002m on the touch-sensitive display 602, which is a tap gesture corresponding to the continue enable indication 1025, and in response, displays the interface 1024a. Fig. 10S Tone and volume test interface 1024b.
[0336] exist Fig. 10S , device 600 displays a tone and volume test interface 1024b that includes instructions for connecting headphones, which are required for the test. Interface 1024b includes a first headphone enable representation 1027a and a second headphone enable representation 1027b for selecting one of two available sets of headphones. It is worth noting that interface 1024b does not include an enable representation for selecting a set of headphones different from the set of headphones displayed (e.g., such as Fig. 10C Device 600 detects touch input 1002n on touch-sensitive display 602, which is a tap gesture corresponding to continue enable indication 1028, and in response, displays Figure 10T In some embodiments, in response to input 1002n, device 600 performs an ambient noise level check, as described above with respect to FIG. 10E to FIG. 10H described.
[0337] exist Figure 10T , device 600 displays tone and volume test interface 1024c. Interface 1024c includes information about tone and volume testing and includes a start enable indication 1029 for initiating tone output. Device 600 detects touch input 1002o on touch-sensitive display 602, which is a tap gesture corresponding to start enable indication 1029, and in response, initiates a tone playback sequence and displays tone and volume test interface 1024d, as shown in FIG. Figure 10U As seen in.
[0338] exist Figure 10U, device 600 displays a tone and volume test interface 1024d that includes instructions to tap enable indication 1030 when a tone is heard. Interface 1024d also includes an indication 1031 of the percentage of the tone and volume test that has been completed (e.g., based on the number of tones output as a percentage of the total tones to be output). While displaying interface 1024d, device 600 outputs and audio tone detects touch input 1002p, which is a tap gesture corresponding to tapping enable indication 1030. In some embodiments, device 600 assesses the user's hearing based on whether input is received within a predetermined time period after outputting the audio tone and / or based on the timing of the received input relative to the output of the audio tone.
[0339] Figure 10V Device 600 is depicted displaying tone and volume test interface 1024 d at a later point in time after 50% of the total tone has been output, as indicated by indication 1031 .
[0340] exist Figure 10W , when interface 1024d is displayed at the 50% completion mark, the device 600 detects that the current ambient noise level has risen above the threshold noise level. In some embodiments, the device 600 continuously monitors the ambient noise level throughout the execution of the hearing test. In some embodiments, the device 600 periodically monitors the ambient noise level during the hearing test (e.g., only during the period during which the audio is output). In response to detecting that the ambient noise level has risen above the threshold noise level, the device 600 displays a notification 1032 indicating that the tone and volume hearing test has been interrupted. Notification 1032 includes a cancel enable indication 1032a, which cancels the hearing test when selected. Notification 1032 also includes an enable indication 1032b, which when selected, restarts the hearing test. In some embodiments, the hearing test is restarted (e.g., re-initiated) from the beginning. In some embodiments, the hearing test is restarted at the interruption point (e.g., the test is resumed). In some embodiments, notification 1032 includes an indication of the ambient noise level.
[0341] Figure 10X Device 600 is depicted displaying tone and volume test interface 1024e indicating that the tone and volume test has been completed. Interface 1024e includes completion indicator 1033, which, when selected, causes redisplay of task view 604a.
[0342] Fig.111 is a flow chart illustrating a method for interacting with a hearing test using an electronic device according to some embodiments. Method 1100 is performed at a device (e.g., 100, 300, 500, 600) having a display device (e.g., 602), one or more input devices (e.g., 602), and one or more microphones. Some operations in method 1100 are optionally combined, the order of some operations is optionally changed, and some operations are optionally omitted.
[0343] As described below, method 1100 provides an intuitive way to interact with a hearing test. The method reduces the cognitive burden on a user when interacting with a hearing test, thereby creating a more efficient human-computer interface. For battery-powered computing devices, enabling a user to interact with a survey faster and more efficiently saves power and increases the time between battery charges.
[0344] An electronic device (e.g., 600) displays (1102) a hearing test user interface (e.g., 1004d) associated with a hearing test (e.g., an interface generated by a survey application; an interface that displays information associated with a hearing test (e.g., instructions for performing a hearing test)) via a display device (e.g., a program for evaluating one or more attributes of the hearing of a user of an electronic device; a program that includes outputting a set of one or more audio outputs and receiving a set of one or more user inputs, and evaluating one or more attributes of the user's hearing based on one or more characteristics (e.g., content, timing) of the set of one or more user inputs).
[0345] While displaying the hearing test user interface, the electronic device receives ( 1104 ) via one or more input devices a set of one or more inputs (eg, 1002 e ) corresponding to a request to initiate a hearing test.
[0346] In response to receiving the set of one or more inputs, the electronic device initiates (1106) a hearing test.
[0347] In some embodiments, initiating a hearing test includes: causing output of an audio representation (e.g., represented by 1014) of a first set of one or more words (e.g., pre-recorded human speech or synthesized human speech); detecting input of a second set of one or more words (e.g., represented by 1017) via one or more input devices or via one or more microphones (e.g., detecting speech or detecting text input (e.g., via one or more keyboards)); and displaying a representation of the second set of one or more words (e.g., 1019) via a display device (e.g., a text transcript of the second set of one or more words). In some embodiments, after displaying the representation of the second set of one or more words, detecting input corresponding to confirmation of the second set of one or more words or detecting a second set of one or more inputs corresponding to a correction of the second set of one or more words, and using the second set of one or more words or the corrected second set of one or more words as data for evaluating the user's hearing. Displaying the representation of the set of one or more words entered by the user for the hearing test provides improved visual feedback about what the device detects (e.g., via the device's input device (e.g., microphone and / or keyboard)). Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), and additionally, by enabling the user to use the device more quickly and efficiently, this may also reduce power usage and extend the battery life of the device.
[0348] In some embodiments, the first group of one or more texts are sentences (e.g., represented by 1014) (e.g., multiple texts that include at least a subject and a predicate and convey a complete concept) (e.g., sentences output as pre-recorded human speech or as synthesized speech).
[0349] In some embodiments, one or more of the inputs of the second group are audio inputs (e.g., speech) detected via one or more microphones (e.g., input represented by 1017) (in some embodiments, the input is processed using one or more speech-to-text algorithms).
[0350] In some embodiments, the second group of one or more inputs is text input (e.g., 1002k) detected via one or more input devices (e.g., one or more keyboards).
[0351] In some embodiments, after displaying a representation of the second group of one or more text, the electronic device detects a third group of one or more inputs (e.g., 1002i); in response to detecting the third group of one or more inputs: submitting the second group of one or more texts according to the third group of one or more inputs corresponding to a request to submit the second group of one or more texts as valid input for a hearing test (e.g., submitting the second group of one or more texts as input for evaluating the user's hearing); and initiating a process of correcting the second group of one or more texts according to the third group of one or more inputs corresponding to a request to correct the second group of one or more texts (e.g., not submitting the second group of one or more texts).
[0352] In some embodiments, initiating a hearing test includes: displaying a response enable indication (e.g., 1030) that, when selected, records a response input used in the hearing test; causing output of a first audio output (e.g., a first audio tone; an output having consistent audio characteristics over its duration) having a first value of a first audio characteristic (e.g., a first tone played when 1024d is displayed) (e.g., the intensity (e.g., in decibels) or frequency (e.g., in hertz) of ambient noise); and monitoring input corresponding to the selection of the response enable indication within a first time period after causing the output of the first audio output, including: based on determining that the input corresponding to the selection of the response enable indication occurs within the first time period, recording a response to the first audio output; and based on determining that the input corresponding to the selection of the response enable indication occurs within the first time period. The input corresponding to the selection indicated by the response enable does not occur within a first time period, abandoning recording a response to the first audio output; and causing an output of a second audio output having a second value of the first audio characteristic different from the first value of the first audio characteristic (e.g., a second audio tone; an output having a consistent audio characteristic over its duration); and monitoring the input corresponding to the selection indicated by the response enable within a second time period (e.g., the same as or different from the first time period) after the output causing the second audio output, including: recording a response to the second audio output based on determining that the input corresponding to the selection indicated by the response enable occurs within the second time period; and abandoning recording a response to the second audio output based on determining that the input corresponding to the selection indicated by the response enable does not occur within the second time period (e.g., abandoning recording any response; recording an indication that no response was received within the second time period). In some embodiments, the absence and / or presence of the recorded response to the audio output is used to assess the user's hearing.
[0353] In some embodiments, during the hearing test, the electronic device displays an indication (e.g., 1031) of the progress of the completion of the hearing test via a display device (e.g., based on a percentage value of the tones emitted compared to the total tones tested). The graphical indication of the progress of the hearing test is displayed to provide the user with feedback on the status of the hearing test. Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the device / interacting with the device), and in addition, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0354] In some embodiments, prior to causing output of the first audio output, the electronic device displays a prompt (1004d) via a display device to find a location with a low ambient noise level (e.g., "Find a Quiet Place").
[0355] In some embodiments, prior to causing output of the first audio output, the electronic device provides a prompt (e.g., 1024c) corresponding to the input of the response affordance after hearing the first audio output via a display device display. In some embodiments, the first audio output is output via external headphones, and the prompt providing the input includes an indication of which ear the first audio output will be output at.
[0356] In some embodiments, during a hearing test (e.g., after outputting a first audio output but before outputting a second audio output), the electronic device: based on determining that a first set of test interruption criteria are met (in some embodiments, the first set of test interruption criteria include one or more criteria selected from the following: an ambient noise level exceeding a threshold; a communication event (e.g., an incoming call), a pause of a hearing test application, and a disconnection of a set of connected speakers (e.g., headphones)), pauses (e.g., suspends; cancels) the hearing test and displays a re-initiate enable indication (e.g., 1023b) via a display device, which, when selected, re-initiates the hearing test (e.g., restarts the hearing test from the beginning and discards any data in the paused test); based on determining that the first set of test interruption criteria are not met, abandons pausing the hearing test and abandons displaying the re-initiate enable indication. Displaying a re-initiate enable indication for the hearing test and pausing the hearing test based on meeting a set of criteria provides the user with improved feedback about the device status and helps reduce errors in the performance of the hearing test. Providing improved feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0357] During a hearing test (e.g., after outputting at least one audio output as part of administering a hearing examination and after receiving at least one user input after the output is identified (e.g., classified) as at least one audio output responsive to the at least one audio output), the electronic device detects (1108) an ambient noise level (e.g., see FIG. 1109 ) via one or more microphones. Figure 10Q )(e.g., the noise level in the current environment)(In some embodiments, the ambient noise level excludes noise determined to be noise generated by a user of the electronic device)(In some embodiments, the ambient noise level is determined based on a single measurement; in some embodiments, the ambient noise level is determined based on multiple measurements (e.g., an average of a set of measurements taken over a period of time)), the ambient noise level includes audio characteristics (e.g., intensity (e.g., in decibels) or frequency (e.g., in hertz) of the ambient noise).
[0358] In some embodiments, during the hearing test, the electronic device detects a first set of one or more external speakers connected to the electronic device (e.g., see Figure 10Q ) (e.g., wired or wireless headphones); and in response to detecting disconnection of the first set of one or more external speakers, pausing (e.g., terminating; canceling) the hearing test (and in some embodiments, displaying a re-enablement indication via a display device).
[0359] In response to detecting an ambient noise level (1110), the electronic device pauses (1112) (e.g., suspends; cancels) the hearing test based on determining that the audio characteristics of the ambient noise level exceed a first threshold and displays a re-enable indication (e.g., 1023b) via a display device, which, when selected, restarts (e.g., resumes or restarts from the beginning) the hearing test.
[0360] In some embodiments, the re-enablement means that when selected, the hearing test is reinitiated (e.g., restarting the hearing test from the beginning and discarding any data from the paused test. In some embodiments, based on determining that the audio characteristics of the ambient noise level exceed a first threshold, the hearing test cannot be resumed and the hearing test can only be restarted or canceled entirely.
[0361] In response to detecting an ambient noise level (1110), based on determining that the audio characteristics of the ambient noise level do not exceed a first threshold, the electronic device continues (1114) (e.g., foregoes pausing the hearing test) to perform the hearing test (e.g., outputs further audio output as part of managing the hearing test) and foregoes displaying a re-enabling indication (e.g., 1023b). Based on the ambient noise level, a re-enabling indication of the hearing test is displayed and the hearing test is paused, providing the user with improved feedback about the current ambient noise level and helping to reduce errors in performing the hearing test. Providing improved feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), which in turn reduces power usage and extends the battery life of the device by enabling the user to use the device more quickly and efficiently.
[0362] In some embodiments, prior to initiating the hearing test (e.g., prior to receiving data (e.g., input) for evaluating the user's hearing) and in response to the set of one or more inputs, the electronic device performs an initial ambient noise level assessment (e.g., see FIG. 10E to FIG. 10H ), the initial environmental noise level assessment includes detecting an initial environmental noise level via one or more microphones (in some embodiments, the initial environmental noise level is determined based on a single measurement value; in some embodiments, the initial environmental noise level is determined based on multiple measurements (e.g., an average of a set of measurements taken over a period of time)), the initial environmental noise level includes a second audio characteristic (e.g., the intensity (e.g., in decibels) or frequency (e.g., in hertz) of the initial environmental noise); and based on determining that the second audio characteristic of the environmental noise level exceeds a second threshold (e.g., a threshold that is the same as the first threshold; a threshold that is different from the first threshold), abandoning initiation of a hearing test (e.g., abandoning initiation until the initial environmental noise level assessment is completed). In some embodiments, based on determining that the second audio characteristic of the environmental noise level does not exceed the second threshold, the hearing test is initiated.
[0363] In some embodiments, performing the initial ambient noise level assessment includes displaying a graphical indication of the current value of the detected initial ambient noise level (e.g., 1011a) via a display device (e.g., displaying a ring with a visual indication of a ring filled with the current ambient noise level, wherein the complete ring is filled when the ambient noise level reaches a second threshold). Displaying the graphical indication of the current ambient noise level provides visual feedback about the noise detected by the microphone. Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the device / interacting with the device), and in addition, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0364] In some embodiments, performing the initial ambient noise level assessment includes displaying an indication (e.g., 1011c) (e.g., a graphic or alphanumeric indication) of the remaining time until the initial ambient noise level assessment is completed via a display device. Displaying a graphical indication of the remaining time provides the user with feedback about when the hearing test is to be performed. Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the device / interacting with the device), and in addition, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0365] In some embodiments, before initiating the hearing test (e.g., before receiving data (e.g., input) for evaluating the user's hearing) and in response to the group of one or more inputs, the electronic device displays a prompt to connect a second group of one or more external speakers (e.g., wired or wireless headphones) via a display device (e.g., 1004b). In some embodiments, after displaying the prompt to connect the second group of one or more external speakers and based on determining that the second group of one or more external speakers are not connected, initiating the hearing test is abandoned (e.g., the initiation is abandoned until the connection of the second group of one or more external speakers is detected).
[0366] In some embodiments, after displaying a prompt to connect a second group of one or more external speakers, the electronic device displays: an indication that the electronic device is configured to output audio signals associated with the hearing test via a third group of one or more external speakers (e.g., wired or wireless headphones; a group of external speakers that is the same as the second group of one or more external speakers) (e.g., an identifier of the third group of one or more external speakers); and a first enable indication (1027b), which, when selected, initiates a process for configuring the electronic device to output audio signals associated with the hearing test via a fourth group of one or more external speakers (e.g., wired or wireless headphones) that is different from the third group of one or more external speakers.
[0367] In some embodiments, before initiating a hearing test (e.g., before receiving data (e.g., input) for assessing the user's hearing) and in response to the group of one or more inputs, the electronic device displays a prompt via a display device to enable a do not disturb mode (e.g., a mode during which at least audio notifications / alerts are suppressed). In some embodiments, the prompt to enable the do not disturb mode includes an indication of enabling the do not disturb mode when selected. Displaying an indication of enabling the do not disturb mode provides the user with feedback about a mode that may help reduce hearing test errors (e.g., by reducing interruptions). Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the device / interacting with the device), and in addition, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0368] In some embodiments, before initiating the hearing test (e.g., before receiving data (e.g., input) for assessing the user's hearing) and in response to the set of one or more inputs, the electronic device displays a prompt (1004d) via a display device to find a location with a low ambient noise level (e.g., "Find a quiet place").
[0369] In some embodiments, while displaying a prompt to find a location with a low ambient noise level, the electronic device displays a second graphical indication (e.g., 1011a) of the current value of the detected ambient noise level via the display device (e.g., displaying a circle whose size varies based on the ambient noise level). Displaying a graphical indication of the current ambient noise level provides visual feedback about the noise detected by the microphone. Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the device / interacting with the device), and in addition, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0370] In some embodiments, the second graphical indication of the current value of the detected ambient noise level includes an indication (e.g., 1011c) (e.g., a graphical or alphanumeric indication) of the remaining time until the second initial ambient noise level assessment is completed. Displaying the graphical indication of the remaining time provides the user with feedback about when the hearing test will be performed. Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating the device / interacting with the device), and in addition, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0371] In some embodiments, the second graphical indication is: displayed with a first value of a first visual characteristic (e.g., a first color) based on a determination that a third audio characteristic of the detected ambient noise level (e.g., intensity (e.g., in decibels) or frequency (e.g., in hertz) of the ambient noise) exceeds a third threshold (e.g., a threshold that is the same as the first threshold; a threshold that is different from the first threshold); and displayed with a second value of the first visual characteristic (e.g., a second color) based on a determination that the third audio characteristic of the detected ambient noise level does not exceed the third threshold (e.g., a threshold that is different from the first threshold). Fig.10E and Fig.10F 1011a). Displaying a graphical indication of the current ambient noise level with different visual characteristics based on a relationship to a threshold value (e.g., a threshold value at which the hearing test will not proceed) provides improved visual feedback regarding the ambient noise level and its relevance to the hearing test. Providing improved visual feedback enhances the operability of the device and makes the user-device interface more efficient (e.g., by helping the user provide appropriate input and reducing user errors when operating / interacting with the device), and in addition, by enabling the user to use the device more quickly and efficiently, this can also reduce power usage and extend the battery life of the device.
[0372] In some embodiments, while displaying a graphical indication of the current value of the detected ambient noise level, the electronic device detects the completion of the second initial ambient noise level assessment; and in response to detecting the completion of the second initial ambient noise level assessment, an indication (e.g., 1011d) (e.g., a check mark) of the completion of the second initial ambient noise level assessment is displayed via the display device. In some embodiments, the graphical indication of the current value of the detected ambient noise level is stopped from being displayed.
[0373] In some embodiments, before initiating a hearing test (e.g., before receiving data (e.g., input) for assessing a user's hearing) and in response to the set of one or more inputs, the electronic device initiates a practice hearing test (e.g., a procedure that includes outputting a set of one or more audio outputs and receiving a set of one or more user inputs; a procedure similar to a hearing test, but does not include collecting and / or using data to assess hearing), wherein data from the practice listening test is not used to assess the hearing of the user of the electronic device.
[0374] In some embodiments, before initiating a hearing test (e.g., before receiving data (e.g., input) for evaluating the user's hearing) and in response to the set of one or more inputs, the electronic device displays a prompt (e.g., 1004c) to adjust the audio output volume (e.g., the output volume via a wired or wireless headset) via a display device. In some embodiments, the prompt to adjust the audio output volume is displayed with an enable indication that, when selected, outputs an audio sample that assists in adjusting the volume.
[0375] In some embodiments, before initiating the hearing test (e.g., before receiving data (e.g., input) for assessing the user's hearing) and in response to the group of one or more inputs, the electronic device displays, via a display device, an indication (e.g., 1027a) that the electronic device is configured to output an audio signal associated with the hearing test via a fifth group of one or more external speakers (e.g., wired or wireless headphones; a group of external speakers that is the same as the second group of one or more external speakers) (e.g., an identifier of the fifth group of one or more external speakers), wherein the fifth group of one or more external speakers meets a set of compatibility criteria (e.g., the fifth group of one or more external speakers are manufactured by a particular manufacturer, meet hardware requirements, meet software requirements). In some embodiments, based on determining that the connected external speakers do not meet the set of compatibility criteria, initiation of the hearing test is abandoned (e.g., initiation is abandoned until speakers that meet the compatibility criteria are connected).
[0376] It should be noted that the above description with respect to method 1100 (eg, Fig.11 ) also apply in a similar manner to the methods described above. For example, method 700 optionally includes one or more of the features of the various methods described above with reference to method 1100. For example, method 700 can be used to interact with and / or manage hearing tests performed via method 1100. For the sake of brevity, these details are not repeated herein.
[0377] For the purpose of explanation, the preceding description is described by reference to specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the invention to the disclosed precise form. According to the above teachings, many modifications and variations are possible. These embodiments are selected and described in order to best explain the principles of these technologies and their practical applications. Others skilled in the art can thus best utilize these technologies and various embodiments with various modifications suitable for the intended specific use.
[0378] Although the disclosure and examples have been fully described with reference to the accompanying drawings, it should be noted that various changes and modifications will become apparent to those skilled in the art. It should be understood that such changes and modifications are considered to be included within the scope of the disclosure and examples defined by the claims.
[0379] As described above, one aspect of the present technology is to collect and use data from various sources to improve and advance research. The disclosure contemplates that, in some instances, these collected data may include personal information data that uniquely identifies or can be used to contact or locate a specific person. Such personal information data may include demographic data, location-based data, phone numbers, email addresses, Twitter IDs, home addresses, data or records related to the user's health or fitness level (e.g., vital sign measurements, medication information, exercise information), date of birth, or any other identification or personal information.
[0380] The present disclosure recognizes that the use of such personal information data in the present technology can be used to benefit users. For example, personal information data can be used to conduct health-related surveys and / or identify research of interest. Therefore, the use of such personal information data enables users to identify relevant health surveys and relevant research. In addition, the present disclosure also anticipates other uses of personal information data that benefit users. For example, health and fitness data can be used to provide insights into the user's overall health status, or can be used as positive feedback to individuals who use technology to pursue health goals.
[0381] This disclosure envisions that entities responsible for collecting, analyzing, disclosing, transmitting, storing or otherwise using such personal information data will comply with established privacy policies and / or privacy practices. Specifically, such entities should implement and adhere to privacy policies and practices that are recognized as meeting or exceeding industry or government requirements for maintaining the privacy and security of personal information data. Such policies should be easily accessible to users and should be updated as the collection and / or use of data changes. Personal information from users should be collected for legitimate and reasonable purposes of the entity and not shared or sold outside of these legitimate uses. In addition, such collection / sharing should be performed after receiving informed consent from the user. In addition, such entities should consider taking any necessary steps to defend and secure access to such personal information data and ensure that others who have access to personal information data comply with their privacy policies and processes. In addition, such entities may subject themselves to third-party assessments to demonstrate their compliance with widely accepted privacy policies and practices. In addition, policies and practices should be adjusted to specific types of personal information data collected and / or accessed, and to applicable laws and standards including specific considerations of jurisdiction. For example, in the United States, the collection or access of certain health data may be governed by federal and / or state laws, such as the Health Insurance Portability and Accountability Act (HIPAA), while health data in other countries may be subject to other regulations and policies and should be handled accordingly. Therefore, different privacy practices should be maintained in each country for different types of personal data.
[0382] Regardless of the foregoing, the present disclosure also contemplates implementation scenarios in which users selectively block the use or access of personal information data. That is, the present disclosure contemplates that hardware elements and / or software elements may be provided to prevent or block access to such personal information data. For example, for survey and research data requests, the technology of the present invention may be configured to allow users to "opt in" or "opt out" of participating in the collection of personal information data at any time during or after registration for the service. As another example, a user may choose not to provide the requested data to the survey and research. In addition to providing "opt-in" and "opt-out" options, the present disclosure contemplates providing notifications related to access or use of personal information. For example, a user may be notified that their personal information data will be accessed when downloading an application, and then reminded again just before the personal information data is accessed by the application.
[0383] In addition, it is an object of the present disclosure that personal information data should be managed and processed to minimize the risk of unintentional or unauthorized access or use. Risks can be minimized by limiting data collection and deleting data once it is no longer needed. In addition, and when applicable, including in certain health-related applications, data de-identification can be used to protect the privacy of users. De-identification can be facilitated by removing specific identifiers (e.g., date of birth, etc.), controlling the amount or specificity of stored data (e.g., collecting location data at the city level rather than at the address level), controlling how data is stored (e.g., aggregating data between users), and / or other methods when appropriate.
[0384] Thus, while the present disclosure broadly covers the use of personal information data to implement one or more of the various disclosed embodiments, the present disclosure also contemplates that various embodiments may also be implemented without access to such personal information data. That is, various embodiments of the present technology will not fail to function properly due to the absence of all or a portion of such personal information data. For example, surveys of interest may be identified based on non-personal information data or an absolute minimum amount of personal information, such as content requested by a device associated with a user, other non-personal information available to a survey organizer, or publicly available information.
Claims
1. A method for user interface display, comprising: At an electronic device having a display device and one or more input devices: Displaying a first user interface via the display device, the first user interface comprising: a task view affordance associated with a plurality of different studies, the plurality of different studies comprising a first study in which a user of the electronic device participated and a second study in which the user of the electronic device participated; and Data view affordances represent; While displaying the first user interface, detecting a first input via the one or more input devices; and In response to detecting the first input: Based on determining that the first input corresponds to a selection of the task view affordance, displaying a task view via the display device, wherein displaying the task view includes simultaneously displaying: a first task corresponding to the first study, wherein the first task is a first data collection task; and a second task corresponding to the second study, wherein the second task is a second data collection task; and Based on determining that the first input corresponds to a selection of the data view affordance, displaying a data view via the display device, displaying the data view includes simultaneously displaying: an indication of a first type of data accessible to one or more studies in which the user of the electronic device is participating, the one or more studies including the first study, wherein the indication of the data of the first type is an indication of sensor and usage data and wherein the indication of the data of the first type is a selectable object that, when selected, causes display of a sensor and usage data view; and An indication associated with one or more studies in which the user of the electronic device has participated with access to the data of the first type, the one or more studies including the first study.
2. The method according to claim 1, wherein displaying the task view comprises: displaying, via the display device, a third task based on determining that the first set of permissions has been granted; Based on determining that the second set of permissions has been granted, displaying the third task is foregone.
3. The method of any one of claims 1 to 2, wherein the task view includes an indication of a level of participation of a user associated with the electronic device in a plurality of research studies including at least the first study and the second study.
4. A method according to any one of claims 1 to 2, wherein the task view indicator represents an indication of available tasks. 5 . The method according to claim 1 , wherein the task view comprises a fourth task not corresponding to a specific study.
6. The method according to any one of claims 1 to 2, wherein the tasks in the task view are displayed in order, and wherein: Based on determining that the remaining time for completing the first task is less than the remaining time for completing the second task, the first task is displayed before the second task in the order; as well as Based on determining that the remaining time for completing the first task is greater than the remaining time for completing the second task, the first task is displayed after the second task in the order.
7. The method according to any one of claims 1 to 2, wherein the first task is a selectable object and the second task is a selectable object, the method further comprising: detecting a second input via the one or more input devices; In response to detecting the second input: initiating a process for completing the first task based on determining that the second input corresponds to the first task; as well as Based on determining that the second input corresponds to the second task, a process for completing the second task is initiated. 8 . The method according to claim 1 , wherein the task view includes a fifth task and wherein the fifth task is a completed task.
9. The method according to any one of claims 1 to 2, wherein the electronic device comprises one or more sensors, the method further comprising: detecting, via the one or more sensors, a sensor event prior to detecting the first input; The first task is generated in response to detecting the sensor event and based on determining that the sensor event satisfies a set of task generation criteria.
10. The method according to any one of claims 1 to 2, wherein the task view includes a sixth task, the method further comprising: detecting, via the one or more input devices, a third input corresponding to the sixth task; as well as In response to detecting the third input, a process for enrolling the user of the electronic device in a third study is initiated.
11. The method of any one of claims 1 to 2, wherein the first user interface includes study view affordances associated with the plurality of different studies, the method further comprising: In response to detecting the first input and based on determining that the first input corresponds to a selection of the research view affordance, displaying a research view via the display device, displaying the research view includes simultaneously displaying: a graphical representation of the first study; as well as Graphical representation of the second study.
12. The method of claim 11, wherein the research view comprises a graphical representation of a third research in which the user of the electronic device did not participate, wherein displaying the graphical representation of the third research comprises: Based on determining that a set of one or more ineligibility criteria are satisfied, an indication is displayed in the graphical representation of the third study that the user of the electronic device is ineligible to participate in the third study.
13. The method of claim 12, wherein displaying the graphical representation of the third study comprises: Based on determining that the set of one or more ineligibility criteria are not met, displaying an indication that the user of the device is eligible to participate in the third study.
14. The method of claim 11, wherein the study view includes a graphical representation of a fourth study that is an inactive study.
15. The method of claim 14, wherein displaying the graphical representation of the fourth study comprises: Based on determining that the user of the electronic device has participated in the fourth study, displaying an indication that the user of the electronic device has participated in the fourth study; as well as Based on determining that the user of the electronic device has not participated in the fourth study, an indication is displayed that the user of the electronic device has not participated in the fourth study.
16. The method of claim 14, wherein displaying the graphical representation of the fourth study comprises: Based on determining that data associated with the fourth study has been used in a first data usage instance, displaying an indication of the first data usage instance; as well as Based on determining that data associated with the fourth study has been used in a second data usage instance, an indication of the second data usage instance is displayed.
17. The method of claim 11, wherein the graphical representations of studies in the study view are displayed in order, and wherein: In said order, graphical representations of inactive studies are displayed after graphical representations of enrolled studies and after available studies; and In the described order, the graphical representations of available studies are displayed after the graphical representations of enrolled studies.
18. The method of claim 11, wherein the graphical representation of the first study includes selectable objects, the method further comprising: detecting, via the one or more input devices, a fourth input corresponding to the selectable object included in the graphical representation of the first study; In response to detecting the fourth input, a detailed view of the first study is displayed via the display device, the detailed view including an indication of data provided to the first study.
19. The method of claim 18, wherein the detailed view of the first study includes an exit affordance, the method further comprising: detecting, via the one or more input devices, a fifth input corresponding to a selection of the exit affordance; In response to the fifth input, ceasing to include the first task in the task view.
20. The method of claim 18, wherein the detailed view of the first study includes a first option affordance that, when selected, causes display of additional options related to the first study.
21. The method of claim 18, wherein the detailed view of the first study includes a first communication enable indication that, when selected, initiates communication with an external electronic device.
22. The method of claim 18, wherein the detailed view of the first study includes one or more task indications associated with the first study.
23. A method according to any one of claims 1 to 2, wherein the indication of the first type of data is an indication of demographic data and wherein the indication of the first type of data is a selectable object that, when selected, causes display of demographic data associated with the user of the electronic device.
24. A method according to any one of claims 1 to 2, wherein the one or more studies in which the user of the electronic device participates and has permission to access the data of the first type are selectable objects, and when the selectable objects are selected, they cause the display of additional information associated with the one or more studies with permission to access the data of the first type.
25. A method according to any one of claims 1 to 2, wherein the sensor and usage data view includes a data collection enable indication, which, when selected, modifies the current state of sensor data collection.
26. A method according to any one of claims 1 to 2, wherein the sensor and usage data view includes an export data enable indication, which, when selected, causes the collected sensor and usage data to be exported to one or more studies with permission to access the sensor and usage data.
27. The method of any one of claims 1 to 2, wherein the sensor and usage data view comprises a first type of sensor and usage data affordance that, when selected, causes display of a first type of sensor and usage data view, the first type of sensor and usage data view comprising information about the first type of sensor and usage data, the information comprising: data examples of the first type of sensor and usage data, the data examples being accessible to one or more studies in which the user of the electronic device participates with permission to access the data of the first type of sensor and usage data; as well as Examples of data other than the first type of sensor and usage data, the examples of data being accessible to one or more studies in which the user of the electronic device participates with permission to access the data of the first type of sensor and usage data.
28. A method according to claim 27, wherein the first type of sensor and usage data view includes one or more enablement representations associated with the one or more studies having permission to access the data of the first type of sensor and usage data, the one or more enablement representations including a first enablement representation associated with a fifth study having permission to access the data of the first type of sensor and usage data, wherein the first enablement representation associated with the fifth study, when selected, initiates a process for disabling the fifth study's access to the first type of sensor and usage data.
29. A computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device having a display device and one or more input devices, the one or more programs comprising instructions for: Displaying a first user interface via the display device, the first user interface comprising: a task view affordance associated with a plurality of different studies, the plurality of different studies comprising a first study in which a user of the electronic device participated and a second study in which the user of the electronic device participated; as well as Data view affordances represent; While displaying the first user interface, detecting a first input via the one or more input devices; as well as In response to detecting the first input: Based on determining that the first input corresponds to a selection of the task view affordance, displaying a task view via the display device, wherein displaying the task view includes simultaneously displaying: a first task corresponding to the first study, wherein the first task is a first data collection task; as well as a second task corresponding to the second study, wherein the second task is a second data collection task; as well as Based on determining that the first input corresponds to a selection of the data view affordance, displaying a data view via the display device, displaying the data view includes simultaneously displaying: an indication of a first type of data accessible to one or more studies in which the user of the electronic device is participating, the one or more studies including the first study, wherein the indication of the data of the first type is an indication of sensor and usage data and wherein the indication of the data of the first type is a selectable object that, when selected, causes display of a sensor and usage data view; as well as An indication associated with one or more studies in which the user of the electronic device has participated with access to the data of the first type, the one or more studies including the first study.
30. The computer-readable storage medium of claim 29, wherein displaying the task view comprises: displaying, via the display device, a third task based on determining that the first set of permissions has been granted; Based on determining that the second set of permissions has been granted, displaying the third task is foregone.
31. The computer-readable storage medium of any one of claims 29 to 30, wherein the task view includes an indication of a level of participation of a user associated with the electronic device in a plurality of research studies including at least the first study and the second study.
32. A computer-readable storage medium according to any one of claims 29 to 30, wherein the task view affordance representation includes an indication of available tasks.
33. The computer-readable storage medium of any one of claims 29 to 30, wherein the task view includes a fourth task that does not correspond to a specific study.
34. The computer-readable storage medium of any one of claims 29 to 30, wherein the tasks in the task view are displayed in order, and wherein: Based on determining that the remaining time for completing the first task is less than the remaining time for completing the second task, the first task is displayed before the second task in the order; as well as Based on determining that the remaining time for completing the first task is greater than the remaining time for completing the second task, the first task is displayed after the second task in the order.
35. The computer-readable storage medium of any one of claims 29 to 30, wherein the first task is a selectable object and the second task is a selectable object, and wherein the one or more programs further include instructions for: detecting a second input via the one or more input devices; In response to detecting the second input: initiating a process for completing the first task based on determining that the second input corresponds to the first task; and Based on determining that the second input corresponds to the second task, a process for completing the second task is initiated.
36. The computer-readable storage medium of any one of claims 29 to 30, wherein the task view includes a fifth task and wherein the fifth task is a completed task.
37. The computer-readable storage medium of any one of claims 29 to 30, wherein the electronic device comprises one or more sensors, and wherein the one or more programs further comprise instructions for: detecting, via the one or more sensors, a sensor event prior to detecting the first input; The first task is generated in response to detecting the sensor event and based on determining that the sensor event satisfies a set of task generation criteria.
38. The computer-readable storage medium of any one of claims 29 to 30, wherein the task view includes a sixth task, and wherein the one or more programs further include instructions for: detecting, via the one or more input devices, a third input corresponding to the sixth task; and In response to detecting the third input, a process for enrolling the user of the electronic device in a third study is initiated.
39. The computer-readable storage medium of any one of claims 29 to 30, wherein the first user interface includes study view affordances associated with the plurality of different studies, and wherein the one or more programs further include instructions for: In response to detecting the first input and based on determining that the first input corresponds to a selection of the research view affordance, displaying a research view via the display device, displaying the research view includes simultaneously displaying: a graphical representation of the first study; and Graphical representation of the second study.
40. The computer-readable storage medium of claim 39, wherein the research view includes a graphical representation of a third research study in which the user of the electronic device did not participate, wherein displaying the graphical representation of the third research study includes: Based on determining that a set of one or more ineligibility criteria are satisfied, an indication is displayed in the graphical representation of the third study that the user of the electronic device is ineligible to participate in the third study.
41. The computer-readable storage medium of claim 40, wherein displaying the graphical representation of the third study comprises: Based on determining that the set of one or more ineligibility criteria are not met, displaying an indication that the user of the device is eligible to participate in the third study.
42. The computer-readable storage medium of claim 39, wherein the study view includes a graphical representation of a fourth study that is an inactive study.
43. The computer-readable storage medium of claim 42, wherein displaying the graphical representation of the fourth study comprises: Based on determining that the user of the electronic device has participated in the fourth study, displaying an indication that the user of the electronic device has participated in the fourth study; as well as Based on determining that the user of the electronic device has not participated in the fourth study, an indication is displayed that the user of the electronic device has not participated in the fourth study.
44. The computer-readable storage medium of claim 42, wherein displaying the graphical representation of the fourth study comprises: Based on determining that data associated with the fourth study has been used in a first data usage instance, displaying an indication of the first data usage instance; as well as Based on determining that data associated with the fourth study has been used in a second data usage instance, an indication of the second data usage instance is displayed.
45. The computer-readable storage medium of claim 39, wherein the graphical representations of studies in the study view are displayed in order, and wherein: In said order, graphical representations of inactive studies are displayed after graphical representations of enrolled studies and after available studies; and In the described order, the graphical representations of available studies are displayed after the graphical representations of enrolled studies.
46. The computer-readable storage medium of claim 39, wherein the graphical representation of the first study includes a selectable object, and wherein the one or more programs further include instructions for: detecting, via the one or more input devices, a fourth input corresponding to the selectable object included in the graphical representation of the first study; In response to detecting the fourth input, a detailed view of the first study is displayed via the display device, the detailed view including an indication of data provided to the first study.
47. The computer-readable storage medium of claim 46, wherein the detailed view of the first study includes an exit affordance, and wherein the one or more programs further include instructions for: detecting, via the one or more input devices, a fifth input corresponding to a selection of the exit affordance; In response to the fifth input, ceasing to include the first task in the task view.
48. The computer-readable storage medium of claim 46, wherein the detailed view of the first study includes a first option affordance that, when selected, causes display of additional options related to the first study.
49. A computer-readable storage medium according to claim 46, wherein the detailed view of the first study includes a first communication enable indication, which, when selected, initiates communication with an external electronic device.
50. The computer-readable storage medium of claim 46, wherein the detailed view of the first study includes one or more task indications associated with the first study.
51. A computer-readable storage medium according to any one of claims 29 to 30, wherein the indication of the first type of data is an indication of demographic data and wherein the indication of the first type of data is a selectable object that, when selected, causes display of demographic data associated with the user of the electronic device.
52. A computer-readable storage medium according to any one of claims 29 to 30, wherein the one or more studies in which the user of the electronic device participates and has permission to access the data of the first type are selectable objects, and when the selectable objects are selected, they cause the display of additional information associated with the one or more studies with permission to access the data of the first type.
53. A computer-readable storage medium according to any one of claims 29 to 30, wherein the sensor and usage data view includes a data collection enable indication, which, when selected, modifies the current state of sensor data collection.
54. A computer-readable storage medium according to any one of claims 29 to 30, wherein the sensor and usage data view includes an export data enable indication, which, when selected, causes the collected sensor and usage data to be exported to one or more studies with permission to access the sensor and usage data.
55. The computer-readable storage medium of any one of claims 29 to 30, wherein the sensor and usage data view comprises a first type of sensor and usage data affordance that, when selected, causes display of a first type of sensor and usage data view, the first type of sensor and usage data view comprising information about the first type of sensor and usage data, the information comprising: data examples of the first type of sensor and usage data, the data examples being accessible to one or more studies in which the user of the electronic device participates with permission to access the data of the first type of sensor and usage data; as well as Examples of data other than the first type of sensor and usage data, the examples of data being accessible to one or more studies in which the user of the electronic device participates with permission to access the data of the first type of sensor and usage data.
56. A computer-readable storage medium according to claim 55, wherein the first type of sensor and usage data view includes one or more enablement representations associated with the one or more studies having permission to access the data of the first type of sensor and usage data, the one or more enablement representations including a first enablement representation associated with a fifth study having permission to access the data of the first type of sensor and usage data, wherein the first enablement representation associated with the fifth study, when selected, initiates a process for disabling the fifth study's access to the first type of sensor and usage data.
57. An electronic device comprising: Display devices; one or more input devices; one or more processors; and A memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for: Displaying a first user interface via the display device, the first user interface comprising: a task view affordance associated with a plurality of different studies, the plurality of different studies comprising a first study in which a user of the electronic device participated and a second study in which the user of the electronic device participated; and Data view affordances represent; While displaying the first user interface, detecting a first input via the one or more input devices; and In response to detecting the first input: Based on determining that the first input corresponds to a selection of the task view affordance, displaying a task view via the display device, wherein displaying the task view includes simultaneously displaying: a first task corresponding to the first study, wherein the first task is a first data collection task; and a second task corresponding to the second study, wherein the second task is a second data collection task; and Based on determining that the first input corresponds to a selection of the data view affordance, displaying a data view via the display device, displaying the data view includes simultaneously displaying: an indication of a first type of data accessible to one or more studies in which the user of the electronic device is participating, the one or more studies including the first study, wherein the indication of the data of the first type is an indication of sensor and usage data and wherein the indication of the data of the first type is a selectable object that, when selected, causes display of a sensor and usage data view; and An indication associated with one or more studies in which the user of the electronic device has participated with access to the data of the first type, the one or more studies including the first study.
58. The electronic device of claim 57, wherein displaying the task view comprises: displaying, via the display device, a third task based on determining that the first set of permissions has been granted; Based on determining that the second set of permissions has been granted, displaying the third task is foregone.
59. An electronic device according to any one of claims 57 to 58, wherein the task view includes an indication of the level of participation of a user associated with the electronic device in a plurality of research studies including at least the first study and the second study.
60. An electronic device according to any one of claims 57 to 58, wherein the task view affordance comprises an indication of available tasks.
61. The electronic device of any one of claims 57 to 58, wherein the task view includes a fourth task that does not correspond to a specific study.
62. An electronic device according to any one of claims 57 to 58, wherein the tasks in the task view are displayed in order, and wherein: Based on determining that the remaining time for completing the first task is less than the remaining time for completing the second task, the first task is displayed before the second task in the order; as well as Based on determining that the remaining time for completing the first task is greater than the remaining time for completing the second task, the first task is displayed after the second task in the order.
63. An electronic device according to any one of claims 57 to 58, wherein the first task is a selectable object and the second task is a selectable object, and wherein the one or more programs further include instructions for: detecting a second input via the one or more input devices; In response to detecting the second input: initiating a process for completing the first task based on determining that the second input corresponds to the first task; and Based on determining that the second input corresponds to the second task, a process for completing the second task is initiated.
64. The electronic device of any one of claims 57 to 58, wherein the task view includes a fifth task and wherein the fifth task is a completed task.
65. An electronic device according to any one of claims 57 to 58, wherein the electronic device comprises one or more sensors, and wherein the one or more programs further comprise instructions for: detecting, via the one or more sensors, a sensor event prior to detecting the first input; The first task is generated in response to detecting the sensor event and based on determining that the sensor event satisfies a set of task generation criteria.
66. An electronic device according to any one of claims 57 to 58, wherein the task view includes a sixth task, and wherein the one or more programs further include instructions for: detecting, via the one or more input devices, a third input corresponding to the sixth task; and In response to detecting the third input, a process for enrolling the user of the electronic device in a third study is initiated.
67. An electronic device according to any one of claims 57 to 58, wherein the first user interface includes a study view affordance associated with the plurality of different studies, and wherein the one or more programs further include instructions for: In response to detecting the first input and based on determining that the first input corresponds to a selection of the research view affordance, displaying a research view via the display device, displaying the research view includes simultaneously displaying: a graphical representation of the first study; and Graphical representation of the second study.
68. The electronic device of claim 67, wherein the research view comprises a graphical representation of a third research study in which the user of the electronic device did not participate, wherein displaying the graphical representation of the third research study comprises: Based on determining that a set of one or more ineligibility criteria are satisfied, an indication is displayed in the graphical representation of the third study that the user of the electronic device is ineligible to participate in the third study.
69. The electronic device of claim 68, wherein displaying the graphical representation of the third study comprises: Based on determining that the set of one or more ineligibility criteria are not met, displaying an indication that the user of the device is eligible to participate in the third study.
70. The electronic device of claim 67, wherein the study view includes a graphical representation of a fourth study that is an inactive study.
71. The electronic device of claim 70, wherein displaying the graphical representation of the fourth study comprises: Based on determining that the user of the electronic device has participated in the fourth study, displaying an indication that the user of the electronic device has participated in the fourth study; as well as Based on determining that the user of the electronic device has not participated in the fourth study, an indication is displayed that the user of the electronic device has not participated in the fourth study.
72. The electronic device of claim 70, wherein displaying the graphical representation of the fourth study comprises: Based on determining that data associated with the fourth study has been used in a first data usage instance, displaying an indication of the first data usage instance; as well as Based on determining that data associated with the fourth study has been used in a second data usage instance, an indication of the second data usage instance is displayed.
73. The electronic device of claim 67, wherein the graphical representations of studies in the research view are displayed in order, and wherein: In said order, graphical representations of inactive studies are displayed after graphical representations of enrolled studies and after available studies; and In the described order, the graphical representations of available studies are displayed after the graphical representations of enrolled studies.
74. The electronic device of claim 67, wherein the graphical representation of the first study includes a selectable object, and wherein the one or more programs further include instructions for: detecting, via the one or more input devices, a fourth input corresponding to the selectable object included in the graphical representation of the first study; In response to detecting the fourth input, a detailed view of the first study is displayed via the display device, the detailed view including an indication of data provided to the first study.
75. The electronic device of claim 74, wherein the detailed view of the first study includes an exit affordance, and wherein the one or more programs further include instructions for: detecting, via the one or more input devices, a fifth input corresponding to a selection of the exit affordance; In response to the fifth input, ceasing to include the first task in the task view.
76. An electronic device as claimed in claim 74, wherein the detailed view of the first study includes a first option enable representation, which, when selected, causes display of additional options related to the first study.
77. An electronic device according to claim 74, wherein the detailed view of the first study includes a first communication enable indication, which, when selected, initiates communication with an external electronic device.
78. The electronic device of claim 74, wherein the detailed view of the first study includes one or more task indications associated with the first study.
79. An electronic device according to any one of claims 57 to 58, wherein the indication of the first type of data is an indication of demographic data and wherein the indication of the first type of data is a selectable object that, when selected, causes display of demographic data associated with the user of the electronic device.
80. An electronic device according to any one of claims 57 to 58, wherein the one or more studies in which the user of the electronic device participates and has permission to access the data of the first type are selectable objects, and when the selectable objects are selected, they cause the display of additional information associated with the one or more studies with permission to access the data of the first type.
81. An electronic device according to any one of claims 57 to 58, wherein the sensor and usage data view includes a data collection enable indication, which, when selected, modifies the current state of sensor data collection.
82. An electronic device according to any one of claims 57 to 58, wherein the sensor and usage data view includes an export data enable indication, which, when selected, causes the collected sensor and usage data to be exported to one or more studies with permission to access the sensor and usage data.
83. The electronic device of any one of claims 57 to 58, wherein the sensor and usage data view comprises a first type of sensor and usage data affordance that, when selected, causes display of a first type of sensor and usage data view, the first type of sensor and usage data view comprising information about the first type of sensor and usage data, the information comprising: data examples of the first type of sensor and usage data, the data examples being accessible to one or more studies in which the user of the electronic device participates with permission to access the data of the first type of sensor and usage data; as well as Examples of data other than the first type of sensor and usage data, the examples of data being accessible to one or more studies in which the user of the electronic device participates with permission to access the data of the first type of sensor and usage data.
84. An electronic device according to claim 83, wherein the first type of sensor and usage data view includes one or more enablement representations associated with the one or more studies having permission to access the data of the first type of sensor and usage data, the one or more enablement representations including a first enablement representation associated with a fifth study having permission to access the data of the first type of sensor and usage data, wherein the first enablement representation associated with the fifth study, when selected, initiates a process for disabling the fifth study's access to the first type of sensor and usage data.
85. A computer program product comprising one or more programs configured to be executed by one or more processors of an electronic device having a display device and one or more input devices, the one or more programs comprising instructions for executing the method according to any one of claims 1 to 2.
Citation Information
Patent Citations
Method and apparatus for integrating manual input
US20020015024A1
Acceleration-based theft detection system for portable electronic devices
US20050190059A1
Methods and apparatuses for operating a portable device based on an accelerometer
US20060017692A1
Gestures for touch sensitive input devices
US20060026521A1
Gestures for touch sensitive input devices
US20060026536A1